Exercise 3 — Leakage: see it, then make it impossible

Guided practice5 min

Time: 20-30 min
You need: the kit, the venv active, data/features.csv from Exercise 1
Deliverable: the two AUC lines of Step 3 and the mean of Step 5

The lab kit of the course: https://github.com/hrhouma2/aiopsatlas-ml-data-diagnostics-labs-en

Goal

You will leak on purpose, twice, and watch what happens. First a scaler that sees the test months: the numbers change, the score does not. Then a column that knows the future: the score becomes too good to be true. Finally you build the Pipeline that makes the first leak impossible. You will use a logistic regression as a black box again; Week 5 opens the box.

Preview — the rest of the lesson is for enrolled readers.

Already enrolled with a code?

Your access is tied to your account, not to this link. Sign in with the same email you used in class: your course is waiting, no need to enter the code again.

This lesson is part of the “Week 4 — Data preparation and dataset separation” module

The first modules of the course are open to everyone. For the rest you have three options: buy this course once and for all, subscribe, or enter the code handed out in class.

Back to the outline