A book to be published by Artech House Publishers, 2007

Multimodal Surveillance: Sensors, Algorithms and Systems

Multimodal Surveillance

Editors

Zhigang Zhu, City College of New York

Thomas S. Huang, University of Illinois at Urbana-Champaign

Description

This edited book will be contributed by leading researchers in the emerging field of multimodal surveillance. It will have three parts: (1) multimodal sensor and novel sensing approaches (visible/IR, audio/visual, thermal, acoustic, magnetic, seismic, etc.) for human and vehicle signature detection, (2) multimodal data fusion algorithms for biometrics, speech, and tracking;  (3) multimodal system issues (integration, communication, privacy, 3D modeling and rendering, workbench) for biometrics and surveillance.

Table of Contents

Foreword  

            Anil K. Jain, Michigan State University

Introduction

  1. Multimodal Surveillance: an Introduction, Zhigang Zhu (CCNY), Thomas Huang (UIUC) 

Multimodal Sensors and Sensing Approaches

  1. The ARL Multi-Modal Sensor:  a research tool for target signature collection, algorithm validation, and emplacement studies, Jeff Houser, Lei Zong (Army Research Lab)
  2. Multimodal Image Fusion Systems, Diego Socolinsky (Equinox Corporation)
  3. LDV Sensing and Processing for Remote Hearing in a Multimodal Surveillance System, Zhigang Zhu, Weihong Li, Edgardo Molina and George Wolberg (CUNY City College and Graduate Center)
  4. Sensor and Data Systems, Audio-Assisted Cameras and Acoustic Doppler Sensors, Paris Smaragdis, Bhiksha Raj and Kaustubh Kalgaonkar (MERL Research Lab)

Multimodal Integration Algorithms

  1. Automatic Audio-Visual Speech Recognition, Stephen M. Chu (IBM T.J. Watson Research Center), and Thomas S. Huang (UIUC)
  2. Multimodal Tracking for Smart Videoconferencing and Video Surveillance, Dmitry Zotkin, Vikas Raykar, Ramani Duraiswami and Larry S. Davis (U. Maryland)
  3. Combination of Ear and Face Images in Appearance-Based Biometrics, Christopher Middendorff, Kevin W. Bowyer and Ping Yan (University of Notre Dame)
  4. Fusion of Face and Palmprint for Personal Identification Based on Ordinal Features, Rufeng Chu, Shengcai Liao, Yufei Han, Zhenan Sun, Stan Z. Li and Tieniu Tan (Center for Biometrics and Security Research & National Laboratory of Pattern Recognition, Chinese Academy of Sciences)
  5. Human Identification Using Gait and Face, Rama Chellappa, Amit K. Roy-Chowdhury and  Amit Kale (University of Maryland)

Multimodal Systems and Issues

  1. Sensor Fusion and Environmental Modelling for Multimodal Sentient Computing, Christopher Town (University of Cambridge Computer Laboratory, UK)
  2. An end-to-end eChronicling System for Mobile Human Surveillance, Gopal Pingali, Ying-Li Tian, Shahram Ebadollahi, Mark Podlaseck, Jason Pelecanos, Harry Stavropoulos (IBM T.J. Watson Research Center)
  3. Systems issues in distributed multi-modal surveillance, Li Yu (ObjectVideo Inc.), Terry Boult (University of Colorado at Colorado Spring)
  4. A Multimodal Workbench for Automatic Surveillance, Dragos Datcu, Zhenke Yang, L.J.M. Rothkrantz (Delft University of Technology)
  5. Automatic 3D Modeling of Cities with Multimodal Air and Ground Sensors, Avideh Zakhor (UC Berkeley)
  6. Multimodal Biometric Systems: Applications and Usage Scenarios, Michael Thieme, Director of Special Projects (International Biometric Group)
  7. SATware: Middleware for Sentient Spaces, Bijit Hore, Hojjat Jafarpour, Ramesh Jain, Shengyue Ji, Daniel Massaguer,Sharad Mehrotra, Nalini Venkatasubramanian, Utz Westermann (University of California at Irvine)
Multimodal Surveillance