Video Stabilization 
Back to Zhigang's Homepage | Computer Science | School of Engineering | CCNY
We have presented a novel approach to stabilize digital video sequences. While most of the real-time image stabilization systems used 2D motion models, a 2.5D inter-frame motion model was proposed so that the stabilization system can work in situations where significant depth changes are present and the camera has both rotational and translational movements. By studying the physical mechanism of a vehicle’s motion, we designed an inertial motion filtering model in order to eliminate the vibration of the video sequences and to achieve good perceptual properties. The implementation of this new approach integrated four modules: pyramid-based motion detection, motion classification and 2.5D motion parameter estimation, inertial motion filtering, and affine-based motion compensation. Among them the concept of motion classification was the first attempt among researchers working in image stabilization to adapt the algorithm to different kinds of motion during a mission. Our stabilization system can smooth unwanted vibrations of video sequences in real-time. The implemented system on IBM PC compatible machines have shown that his algorithm outperforms many algorithms that require parallel pipeline image processing machines.
 

Related Publications
 

  1. Jesse S. Jin, Zhigang Zhu, Guangyou Xu, Digital Video Sequence Stabilization Based on 2.5D Motion Estimation and Inertial Motion Filtering, Real-Time Imaging, Vol. 7, No. 4, August 2001, Academic Press, pp. 357-365
  2. Jesse S. Jin, Zhigang Zhu, Guangyou Xu, A stable vision system for moving vehicles, IEEE Transactions on Intelligent Transportation Systems, vol. 1, no. 1, March 2000, pp 32-39.
  3. Zhigang Zhu, Guangyou Xu, Yudong Yang, Jesse S. Jin, Camera stabilization based on 2.5D motion estimation and inertial motion filtering, IEEE Int. Conf. on Intelligent Vehicles, Stuttgart, Germany, October 28-30, 1998, vol. 2, pp 329-334.
  4. Yudong Yang, Guangyou Xu, Zhigang Zhu, 2.5D Digital Video Sequence Stabilization , Journal of Computers, to appear (in Chinese)
  5. Yudong Yang, Guangyou Xu, Zhigang Zhu, "2.5 D inter-frame motion estimation method," Journal of Tsinghua University, Vol.37, No.9, 1997, pp. 78-81(in Chinese).
  6. Zhigang Zhu, Xueyin Lin, Qiang Zhang, Guangyou Xu, Dingji Shi, "Digital image stabilization for tele-operation of a mobile robot," High Technology Letters, vol 6, no 10, pp. 13-17, October 1996 (in Chinese).



Collaborators:
Guangyou Xu, Professor, Department of Computer Science and Technology, Tsinghua University, Beijing
Xueyin Lin, Professor, Department of Computer Science and Technology, Tsinghua University, Beijing
Qiang Zhgang, MS student, Department of Computer Science and Technology, Tsinghua University, Beijing
Yudong Yang, Ph.D. student, Department of Computer Science and Technology, Tsinghua University, Beijing
Jesse S. Jin, Professor, School of Computer Science and Engineering, The University of New South Wales, Sydney 2052, Australia
Supported by
  • China National Science Foundation, Image Stabilization Technique for Mobile Robot,   06/1995- 09/1997, PI (Zhu)
  • China National High-Tech Project (863 Plan), Image-based VR Scene Modeling and Image Retrieval for Internet/Intranet, 7/1997-6/1998, PI (Zhu)
  • China National Advanced Research Program, Image Mosaic-based Visual Scene Modeling and Target Recognition, 1/1996-12/2000, Co-PI (Xu, Zhu)

    •