CSc 82200 Seminar 

Multimodal Sentient Computing 

Spring 2008

Professor Zhigang Zhu
Department of Computer Science
The City College of New York  and Graduate Center
The City University of New York (CUNY)

Time: Wednesday 11:45 am -1:45 pm 
Room: 5383
Credits: 1.0

Office Hours: Wednesday 10:00 - 11:30 am, Rm 4439


Course Update Information


Course Description

"Multimodal Sentient Computing" is to enable a computing system to perceive the world and relate to it in much the same way as people do using multimodal perceptions (seeing, hearing, touching, etc.). This seminar course will discuss issues on the emerging new area of sentient computing using multimodal sensing units, particularly for surveillance and security applications, where “finely sensitive in perception or feeling” are greatly needed. It includes multimodal sensation and perception in psychology, new multimodal sensor designs, mathematical models/algorithms for data fusion, networking / architecture, and other system/social issues.

Course Organization

The instructor intends to offer the course as an interdisciplinary seminar course, in which the instructor will offer 1/4 of the lectures from the introduction of textbook  #1 and some from textbook  #2, and then students from mathematics, physics, electrical engineering, computer science and psychology and other social sciences will be assigned to read, present and discuss materials in sensations, multimodal fusion models, sensor characterization and new designs, algorithms / system architecture, and other system/social issues. The goal is to stir up interests in multidisciplinary collaborations in both research and education on new sensors, models and applications in this emerging area.

Textbook and References

Textbook:

1.  Multimodal Surveillance: Sensors, Algorithms and Systems”, Zhigang Zhu and Thomas S. Huang (eds.), ISBN-10: 1596931841, Artech House Publisher, July 2007.  (required)

2. Wolfe et al.: Sensation and Perception; Wyttenbach: PsyCog: Explorations in Perception and Cognition (CD-ROM); Sinauer Associates, 2006.

Other  References (to be updated):


Copyright @ Zhigang Zhu ( zhu at cs.ccny.cuny.edu ), 2007-2008.