CSc 470 / I0807
Image Processing

Course description

This course is an intensive introduction to image processing intended for advanced undergraduates and graduate students. It forms the basis of high-quality rendering in computer graphics, as well as low-level processing for computer vision, remote sensing, and medical imaging. You will learn about well-known image processing topics, including

Point operations:

thresholding, quantization, clipping, gamma correction, contrast enhancement

Neighborhood operations:

blurring, sharpening, convolution, halftoning, error diffusion

Fourier transforms

discrete Fourier transform (DFT), fast Fourier transform (FFT)

Digital filtering

sampling theory, image resampling, image reconstruction, antialiasing

Geometric operations

spatial transformations, separable warping, 2-pass scanline algorithms, affine and perspective transformations, texture mapping, morphing

Course goals

Understand the concepts of point, neighborhood, and geometric operations as they apply to digital images.
Understand frequency analysis and its role in filtering and sampling theory.
Understand the concepts of convolution, interpolation, and antialiasing to solve geometric transformation problems.
Use programming assignments to reinforce the material covered in class.
Implement operations efficiently using a high-level language (e.g., C++).
Apply the concept of separability for efficient implementation.

Piazza

This term we will be using Piazza for class discussion.
The system is highly catered to getting you help fast and efficiently from classmates, the TA, and myself.
Rather than emailing questions to the teaching staff, I encourage you to post your questions on Piazza.
If you have any problems or feedback for the developers, email team@piazza.com.
Find our class page here

Zoom

The Zoom link for the lectures and office hours can be found on the Piazza page (see above).
Make sure to add your name to the enrollment on the Piazza page to access all messages and Q/A postings.

Sample code

Click here for code examples useful for homework and implementation details of algorithms discussed in lectures.

Sample images

Click here for sample images that you may use for your homework.

Homework submission

Please follow the instructions here for turning in homework solutions.

Syllabus

LECTURE	LECTURE TOPICS	HOMEWORK	SLIDES
1: 1/30/24	Introduction, history, applications		CSc470-01-Introduction.pdf
2: 2/1/24	Human visual system	Homework 1 is due on 2/29/24	CSc470-02-HVS.pdf
3: 2/6/24	Digital image fundamentals		CSc470-03-Fundamentals.pdf
4: 2/8/24	Point operations		CSc470-04-PointOps.pdf
5: 2/13/24	Point operations (contd)	Qt information for homeworks
6: 2/15/24	Arithmetic/Logic Operations		CSc470-05-ArithLogicOps.pdf
7: 2/20/24	Digital halftoning		CSc470-06-Halftoning.pdf
8: 2/27/24	Digital halftoning (contd)
9: 2/29/24	Neighborhood operations	Homework 2 is due on 3/28/24	CSc470-07-NeighborhoodsOps.pdf
10: 3/5/24	Neighborhood operations (contd)		Image padding notes
11: 3/7/24	Neighborhood operations (contd)	Homework 1 grades
12: 3/12/24	Filtering Theory		CSc470-08-Filtering.pdf
13: 3/14/24	Filtering Theory (contd)
14: 3/19/24	Fourier Transform		CSc470-09-Fourier.pdf
15: 3/21/24	Midterm review
16: 3/26/24	Fourier Transform (contd)	Homework 3 is due on 4/18/24
17: 3/28/24	Filtering in the Frequency Domain	Homework 2 grades	CSc470-10-FreqDomainFiltering.pdf
18: 4/2/24	Midterm
19: 4/4/24	Sampling Theory		CSc470-11-SamplingTheory.pdf
20: 4/9/24	Image Resampling	Midterm grades	CSc470-12-Resampling.pdf
21: 4/11/24	Image Reconstruction		CSc470-13-Reconstruction.pdf
22: 4/16/24	Antialiasing		CSc470-14-Antialiasing.pdf
23: 4/18/24	Spatial Transformations		CSc470-15-SpatialTransformations.pdf
24: 5/2/24	Image Warping		CSc470-16-Warping.pdf
25: 5/7/24	Image Morphing		CSc470-17-Morphing.pdf
26: 5/9/24	Robust Log-Polar Registration		CSc470-18-Registration.pdf
27: 5/14/24	Final Review

Instructor

Professor George Wolberg
Office Hours: Tuesday, 1:00pm-2:00pm, Room NAC 8/202G
wolberg@ccny.cuny.edu

Teaching Assistant

Siavash Zokai
Office Hours: By appointment, online
ccny.cs470@gmail.com

Lectures

CSc 470: Tuesday/Thursday, 3:30pm-4:45pm, Shepard 275

Textbooks

Main Text: Image Processing and Analysis, by Stan Birchfield, Cengage Learning, 2018.
Supplementary Text: Digital Image Processing by Rafael Gonzalez and Richard Woods, Pearson, 2018.
Supplementary Text: Image Processing, Analysis, and Machine Vision by Milan Sonka, Vaclav Hlavac, and Roger Boyle, Cengage Learning, 2014.
Supplementary Text: Digital Image Warping by George Wolberg, IEEE Computer Society Press, 1990.

Supplemental Videos

Watch the brilliant video series by 3Blue1Brown on Youtube that cover convolution , Fourier transforms, and Fourier series..
3Blue1Brown created his own visualization software to animate his lessons, which extend beyond the videos mentioned above. He has videos on a wide variety of topics in math, which impacts image processing, computer graphics, neural networks for machine learning, and more. His linear algebra videos are classic. Definitely check them out!

Grading

Your final grade is computed as a weighted sum of the programming projects, a midterm exam, and a final exam.

4 programming projects (50%)
Midterm exam (25%)
Final exam (25%)
Good class participation is a bonus

George Wolberg, August 24, 2023

CSc 470 / I0807 Image Processing