Project 3

Overview

The objective of this project is to gain experience building and training convolutional neural networks for 6 degrees-of-freedom rigid body pose estimation. In this project you will implement a version of PoseCNN for object pose estimation.

The goals for this project are as follows:

  • Implement the PoseCNN architecture for object pose estimation.
  • Understand the characteristics of neural network based object pose estimation using the PROPS Pose Dataset.
  • Gain experience reimplementing network architectures by translating from text and figure descriptions to code implementations.

Instructions

  1. Download the project starter code
  2. Unzip the starter code and upload to Google Drive
    • Once unzipped, you should find a root directory titled ‘P3’. The ‘P3’ directory contains all starter code and files needed to complete this project. Please upload the ‘P3’ directory to your Google Drive.
  3. Open the *.ipynb and *.py files and implement features

    • We recommend implementing the features in a Google Colab environment. The Colab development environment can be accessed by double-clicking on each *.ipynb and *.py file within your Drive. Instructions for each feature are included in the pose_estimation.ipynb file.

    • We suggest starting by implementing the required features as they appear in the pose_estimation.ipynb notebook.

    • While working on the project, keep the following in mind:

      • The notebook and the python file have clearly marked blocks where you are expected to write code. Do not write or modify any code outside of these blocks.
      • Do not add or delete cells from the notebook. You may add new cells to perform scratch computations, but you should delete them before submitting your work.
      • Run all cells, and do not clear out the outputs, before submitting. You will only get credit for code that has been run.
      • To avoid experiencing Colab usage limits, save and close your notebooks once finished working.
  4. Submit your implementation for Autograder feedback
    • Once you have implemented a portion of the required features, you may submit your work for feedback from the Autograder. To receive feedback, download your *.ipynb and *.py files then upload them to the Project 3 Autograder. You may submit to the Autograder for feedback up to 2 times per day.
  5. Download final implementation
    • After implementing all features, save your work and download the completed *.ipynb and *.py files.
    • The last cell of the pose_estimation.ipynb notebook will generate a uniqueid_umid_P3.zip file. The zip file should include pose_estimation.ipynb, and pose_cnn.py for this assignment.
  6. Submit your python and notebook files for grading
    • Upload your files to the Autograder for grading consideration. Your highest score will be used for final grades.

Deadline

This project is due on Thursday, March 14th at 11:59pm EST. We suggest starting as soon as possible.

Grading

This project will be graded by the Autograder. The project is worth a total of 20 points. You may submit to the Autograder for feedback up to 5 times per day.