This course covers the necessary background of neural-network-based deep learning for robot perception – building on advancements in computer vision that enable robots to physically manipulate objects. During the first part of this course, students will learn to implement, train and debug their own neural networks. During the second part of this course, students will explore recent emerging topics in deep learning for robot perception and manipulation. This exploration will include analysis of research publications in the area, building up to reproducing and implementing state-of-the-art deep learning approaches as a final course project.

This course is being offered at the University of Michigan (Xiaoxiao Du, Anthony Opipari, Chad Jenkins).

This course builds on and is indebted to these existing courses (as a “star” and a “fork” in the open source sense):


Graduate Student Instructor

Edmond Tong

Instructional Assistants

Dalton Richardson

Advising Faculty