Professor Zhigang Zhu
Department of Computer Science
The City College of New York and Graduate Center
The City University of New York (CUNY)
Time: Wednesday 11:45 am -1:45
Office Hours: Wednesday
10:00 - 11:30 am,
"Multimodal Sentient Computing" is to enable a computing system to perceive the world and relate to it in much the same way as people do using multimodal perceptions (seeing, hearing, touching, etc.). This seminar course will discuss issues on the emerging new area of sentient computing using multimodal sensing units, particularly for surveillance and security applications, where “finely sensitive in perception or feeling” are greatly needed. It includes multimodal sensation and perception in psychology, new multimodal sensor designs, mathematical models/algorithms for data fusion, networking / architecture, and other system/social issues.
The instructor intends to offer the course as an interdisciplinary seminar course, in which the instructor will offer 1/4 of the lectures from the introduction of textbook #1 and some from textbook #2, and then students from mathematics, physics, electrical engineering, computer science and psychology and other social sciences will be assigned to read, present and discuss materials in sensations, multimodal fusion models, sensor characterization and new designs, algorithms / system architecture, and other system/social issues. The goal is to stir up interests in multidisciplinary collaborations in both research and education on new sensors, models and applications in this emerging area.
Perception; Wyttenbach: PsyCog: Explorations in Perception
and Cognition (CD-ROM); Sinauer Associates,
OtherReferences (to be updated):
Copyright @ Zhigang
Zhu ( zhu at cs.ccny.cuny.edu