Final Project

For this final project, you will work in teams of 3 students to (1) solve a problem or answer a question, (2) construct an analysis, (3) evaluate the performance of your approach, and (4) clearly communicate your findings to a wide audience. Your final videos and web pages will be evaluated by a panel of judges from across disciplines on campus and bonus points will be awarded to the winning team.

Proposal

To start you off as strong as possible in this project and make sure the course instructors are on board with your idea, you'll submit a short project proposal. Your project proposal will be a two-page document that includes (a) the names of the members of your team, (b) a detailed description of the problem/question to solve/answer and why it is important, (c) a description of the dataset you propose using including a succinct visualization of one or more aspects of the data relevant to your proposal, and (d) your proposed machine learning approach and how you will evaluate your performance.

Final Report

The final project report that you submit will consist of two parts: (1) a working web page containing your report; submit a link to the webpage for your team as the deliverable and (2) a 1-2 minute video communicating the key takeaways from your project.

  1. Abstract. [150 words maximum] This should be the one paragraph that captures the significance of what you did and why you did it.
  2. Introduction. Provide a description of the problem and the value in finding a solution, motivate your reader as to why he/she should care about this question. The idea is to get your reader excited about the solution you are about to present.
  3. Background. This section should cite problems and solutions that have been previously addressed that relate to your work, and the key takeaways of the studies that explored that work. The idea here is to place the problem you’re working on in context and to let the reader know that you’re not working in a knowledge vacuum. For finding relevant literature, a good starting point is Google Scholar. You should have at least 5-10 unique references.
  4. Data. Describe and visualize your data. Make sure every caption fully describes the figure. You may want to visualize the raw data and/or extracted features. What challenges are inherent to this problem? How might they be overcome? What take away messages can you get simply from visualizing your data?
  5. Methods. Your machine learning solution (e.g. a description of any preprocessing, feature extraction, classification/regression techniques) and why you made each of the choices you did. Any methods that you didn’t create yourself, please cite relevant literature. Also include a flow chart of your methodology so the reader can easily conceptualize your solution. Be sure to describe your approach to measuring generalization performance. Imagine that you are writing this section so that someone could recreate your results!
  6. Results. Provide a complete performance assessment that includes your validation approach (cross validation, train/validate/test split, etc.) and the key metrics of performance for the problem (ROC curves or confusion matrices). You should also compare your outcomes to one or more baselines (such as a very simple model). This section should be supported with visualizations including examples where your method worked well, and examples where it failed, and hypotheses as to why.
  7. Conclusions. It’s critical to have a strong ending and not just let the energy fizzle out of the report. Many readers, if pressed for time, will simply read your abstract and your conclusions. In fact, you may want to start by writing your conclusions. Recap the problem you were studying and why. What was your approach to the solution? What are the key takeaways from your work? If the readers took nothing else away from reading your report, what would you want them to know most? Did you identify one particular approach that worked well? Was there a challenge that you faced that opens the door to working on solving a new problem? What avenues of research would you pursue next?
  8. Roles. Since this is a team project, we want to know what your specific contribution was to this project. Provide detail on your roles and how they contributed to the project. This could be a 2-3 sentence description for each team member.
  9. References. An alphabetical list of references cited in this work. A minimum of 5 are required. We recommend using the Zotero citation manager for collecting and compiling your references.

Your report will be in the form of a Jupyter notebook that is both published online (provide us with the link). You will ALSO submit THREE printed PDF versions of this Jupyter notebook.

In your report, every figure should have a caption, axis labels (with units if applicable), and be referenced in the text (such that every figure has a clear point to the story that you tell). If you use any figures that are not your own, they should be cited as well. For citations in Jupyter Notebooks, we recommend author-date notation for ease of composition. For example, if the author was Jocelyn Miller, and the date of publication was 2018, then the citation would be (Miller 2018).

For the 1-2 minute video summarizing / advertising the problem that you worked on and your machine learning solution. This video should be visually compelling and should not miss the “forest for the trees” – don’t get lost in technical details, this video is NOT the place for extreme technical detail, but instead for CLEARLY conveying the big picture of your problem/question and your solution/answer. Imagine your aunt and uncle watching this video – would they know what’s going on? Would they find it interesting / engaging / compelling? For inspiration for what makes a good explanatory video, watch videos from the following series:

If you’re looking for inspiration on how to select a project idea, start by exploring the active competitions and datasets on kaggle.com. Please stop by office hours if you’d like to discuss specific project ideas or for any other help in selecting your project idea.

Once you're working on producing your video, ask your friends (especially those who may not be as technically inclined) as ask them for feedback. Do they think it was engaging/easy to follow/enjoyable to watch? Ask them their takeaways: did they get the message you were trying to communicate? Address their feedback to help you ensure the quality of your video.

Peer Evaluation

Since this is a team project, you will also be evaluated by your teammates (and yourself). This is a chance to offer each other feedback and reflect on your own performance. You will be rating your fellow team members on the following criteria:

  1. Was dependable in attending meetings to work on the project
  2. Did work accurately and completely
  3. Completed work on time
  4. Contributed positively to team discussions
  5. Helped others when needed
  6. Responded to communications in a timely manner
  7. Treated other team members respectfully
  8. Demonstrated a positive attitude about the team and its work

You can download the peer evaluation form here

.