DSC 80 – The Practice and Application of Data Science

This Week

TF-IDF

Final Project Released! 📊

The Final Project is now available! This project is worth 10% of your overall grade (double a regular project) and will be a culmination of everything you've learned this quarter.

This project is structured differently from previous projects, so read the instructions carefully. Namely, there are two checkpoint assignments, and the project is not autograded.

Important Dates:

  • Checkpoint 1: Thursday, November 20th, 2025 at 11:59PM
  • Checkpoint 2: Tuesday, December 2nd, 2025 at 11:59PM (Note: Due on a Tuesday because of Thanksgiving break)
  • Final Submission: Thursday, December 11th, 2025 at 11:59PM

You'll choose one of three datasets (Recipes and Ratings, League of Legends, or Power Outages) and conduct an open-ended investigation. Your deliverables include a public-facing website and a Jupyter Notebook PDF.

Start early and build something you're proud of – this is a great portfolio piece for your resume!

Lecture 13 — TF-IDF and Features

Lab 7

Due Monday, Nov 17 at 23:59 PM

Worksheet 7 — Models and Text Data

past weeks

Week 6

Parsing HTML and RegEx

Exam 01 on Thursday, Nov 06

Lecture 12 — Text Features

Worksheet 6 — HTML and Regex

Week 5

HTTP and HTML

Lecture 10 — HTML and Scraping

Lecture 11 — Regular Expressions

Lab 6

Was due Monday, Nov 10 at 23:59 PM

Project 3 Checkpoint

  • No checkpoint for this project. 🥳

Project 3

Was due Thursday, Nov 13 at 23:59 PM

Worksheet 5 — Imputation and Test Statistics

Week 4

Imputation

Lecture 8 — Missingness and Imputation

Lecture 9 — APIs and Scraping

Lab 5

Was due Monday, Nov 03 at 23:59 PM

Worksheet 4 — Missingness

Week 3

Missingness

Lecture 6 — Cleaning Data, Hypothesis Testing

Lecture 7 — Permutation Tests, Missing Data

Lab 4

Was due Monday, Oct 27 at 23:59 PM

Project 2 Checkpoint

Was due Thursday, Oct 23 at 23:59 PM

Project 2

Was due Thursday, Oct 30 at 23:59 PM

Worksheet 3 — Hypothesis Testing

Week 2

Hypothesis Testing and Data Granularity

Lecture 4 — Pivot Tables, Simpson's Paradox

Lecture 5 — Merging and Cleaning Data

Lab 3

Was due Monday, Oct 20 at 23:59 PM

Worksheet 2 — Aggregating

Week 1

Tables and Messy Data

Lecture 2 — Pandas

Lecture 3 — Aggregating

Lab 2

Was due Monday, Oct 13 at 23:59 PM

Project 1 Checkpoint

Was due Thursday, Oct 09 at 23:59 PM

Project 1

Was due Thursday, Oct 16 at 23:59 PM

Worksheet 1 — Pandas

Week 0

Introduction

Welcome to DSC 80!

Here's how to get started:

  • Read the syllabus.
  • Join our Campuswire message board and Gradescope with the email invitations you received earlier this week. If you didn't receive an email, you can use access code 42BY42 for Gradescope and access code 7629 for Campuswire.
  • Read the Tech Support page and set up your development environment.
  • The first lectures will be on Thursday, September 25 at:
    • 12:30 PM in CENTR 212.
    • 3:30 PM in PODEM 1A22.
  • There are no discussions for this class. Instead, we'll post optional, ungraded weekly exam study guides and host additional office hours.

See you in lecture!

Lecture 1 — Introduction

Lab 1

Was due Monday, Oct 06 at 23:59 PM
future weeks

Week 8

Features and sklearn

Week 9

Thanksgiving Week

Week 10

Model Evaluation and Fairness

Exam 02 on Saturday, Dec 06

Week 11

Final Exams