Week 15 — What Next? (12/6–10)

This is the last week of class. We’re going to recap, and talk about what’s next, both for learning and for putting what you’ve learned to practical use.

🧐 Content Overview

Element Length

🎥 Recap


🎥 Drift


🎥 Time Series Operations


🎥 Correlated Errors


🎥 Publishing Projects


🎥 Production Applications


🎥 Topics to Learn


🎥 General Tips


This week has 1h13m of video and 0 words of assigned readings. This week’s videos are available in a Panopto folder and as a podcast.

📅 Deadlines

  • Makeup Midterm, December 7

  • Quiz 14, December 9

  • Assignment 7, December 12

🎥 Recap

This video reviews the concepts we have discussed this term and puts them into the broader context of data science.


🚩 Makeup Exam

The makeup midterm is December 7 in class. It covers the entire semester, with an emphasis on material since the 2nd midterm. The rules and format are the same as for Midterm A.

I encourage you to come and take the exam, as it is the single best way to prepare for the final. You can at any time leave the exam, and take it with you; I will only grade it if you turn it in, and there is no problem with showing up, looking at it, even filling it out, and deciding you like your current grades well enough to not turn it in.


If you turn in the makeup exam to be graded, its grade will replace the lower of your Midterm A and B grades, even if that lowers your final grade. Only turn it in if you think you did better than your worst normal midterm!

🎥 Data and Concept Drift

This video introduces a fundamental assumption of predictive modeling and the way drift can affect it.


🎥 Time Series Operations

Time is an important kind of data that we haven’t spent much time with — this video discusses the fundamental Pandas operations for working with time-series data.

📓 Time Series Example

The MovieLens Time Series notebook demonstrates basic time series operations in Pandas.

🎥 Correlated Errors

Regression models require that the data be independent. This video introduces two kinds of non-independence and methods for addressing them: grouped observations addressed with a mixed-effects model and temporal auto-correlation addressed with ARIMA models.

🎥 Publishing Projects

This video talks about going from an analysis and its notebooks to a publishable paper.


  • PlotNine is a good plotting library for preparing consistent, publication-ready graphics.

  • The book gender example also demonstrates the current evolution of my own practices for preparing for publication.

🎥 Production Applications

How do you put the results of your data science project into product?

🎥 Topics to Learn

This video goes over some useful topics to learn to fill out more of your data science education.

🎥 General Tips

Some final closing tips and suggestions for you to think about as you take the next steps in your data science career.

🚩 No Quiz 15

There is no quiz for this week.

📃 Farewell

It’s been grand!

I would love to hear feedback on how to further improve the course; I have tried to make some corrections as a result of the midterm assessment process, and will be keeping those notes for next year, but further suggestions either in the course evaluations or by Piazza are welcome.

I hope to see many of you in future courses!

📩 Assignment 7

Assignment 7 is due Sunday, December 12, 2021.

🚩 Final Exam

The final exam will be on Tuesday, Dec. 14, 2021 at 9:30 AM.


The exam follows the same format as the midterms. It will be a written in-person exam with a variety of questions to assess your ability to understand and apply concepts from the class. Question formats include:

  • Multiple-choice

  • True/false

  • Matching

  • Fill-in-the-blank

  • Short answer

  • Computation

I may ask you to do a range of things on the exam, including (but not limited to):

  • Define a concept

  • Compute a metric from a small quantity of data

  • Interpret a chart

The final exam will be a little less than twice as long as the midterms, to fit in the scheduled period.

Exam Rules

  • You may have 1 note sheet, letter- or A4-sized, two-sided.

  • You should not need a calculator, but may bring one if you wish.

  • You may answer in either pen or pencil.

Study Tips

  • Review the previous quizzes, assignments, and midterms.

  • Sit for the makeup midterm, even if you do not plan to turn it in.

  • Review lecture slides to see where you are unclear on concepts and need to review.

  • Skim assigned readings, particularly the section headings to remind yourself what was in them.

  • Review the course glossary, keeping in mind that it does contain terms we haven’t gotten to yet.