CS 600.641

             VISION-BASED INTERACTION FOR MAN AND MACHINE

Professor Gregory D. Hager
Wednesday, 10:00, Room 324b NEB

 
 

Overview:

    This seminar course surveys recent research results on algorithms for dynamic vision and their application. Specific emphasis will be placed on approaches which derive novel and efficient algorithms using generalizable mathmetical and/or computational principles. Application papers will cover problems ranging from the automated control of devices using vision (e.g. automated driving) to perception-based user interfaces. Students will be expected to participate in class by reading, presenting, and discussing research papers.
 

Clientelle:

    Graduate students in computer science, electrical engineering, mechanical engineering and related disciplines.  The ideal student should have a background in engineering mathematics, programming experience, and some exposure to signal processing and/or computer vision.
 

Content and Format:

    I will spend the first two lectures introducing the course and covering some basic background material on camera models and imaging that will be useful in the remainder of the course. Starting in the second week, we will cover papers. I will do the first week or two, and then we will rotate through the rest of the group discussing papers. Those taking the course for credit will be required to write a paper and/or do a project of their choice.     The following is an (as yet) unordered, incomplete list of papers from which we can choose.  I doubt we can cover them all during the semester....
 

Background Reading:


Computer Vision Compendium (everything you always wanted to know ...)
Trucco and Verri: Computer Vision (new; I've heard its a decent book)
Ballard and Brown: Computer Vision (and older standby)
Jain: Computer Vision (Presents the basics; I'd stick with one of the two above)

Visual Tracking:

Incremental Focus of Attention for Robust Vision-Based Tracking (with K. Toyama) Accepted to appear in IJCV. (33 pages, 2.7M compressed postscript)
 

Efficient Region Tracking With Parametric Models of Geometry and Illumination (with P. Belhumeur). IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(10), pp. 1125-1139, 1998.  (34 pages, 2.7M compressed postscript)
 

The XVision System: A General-Purpose Substrate for Portable Real-Time Vision Applications (with K. Toyama). In Computer Vision and Image Understanding 69(1) pp. 23 - 37. (32 pages, 1.5M compressed postscript).

Black, M. J. and Jepson, A., EigenTracking: Robust matching and tracking of articulated objects using a view-based representation,International Journal of Computer Vision, 26(1), pp. 63-84, 1998. also Xerox PARC, Technical Report P95-000515, Feb. 1996.

C.Bregler, J.Malik, Video Motion Capure, UCB//CSD-97-973
Paper in gziped PS (843KB) or PDF (2.3MB)

Vision-Based Control:

What Tasks Can Be Performed with an Uncalibrated Stereo Vision System? (with J. Hespanha, Z.Dodds, and A.S. Morse) To appear, IJCV. (21 pages, 300K compressed postscript)
Read the Abstract.

Selected articles from The Confluence of Vision and Control (D. Kriegman, G.D. Hager and A.S. Morse, Editors) LNCIS series, Springer-Verlag, 1998.

Interaction:

Selected articles from Computer Vision for Human-Machine Interaction