DSC3103
Labs
Each lab is a small simulator of something from the course. Predict what will happen, try it, explain it, then take on the challenges.
Lab 1
Data Profiler, Tukey Outlier Gate & Median Imputer
Data Profiling, Validation & Cleaning
Tasks 0/52 coding
Lab 2
Parquet Columnar I/O & Idempotency Simulator
Pipelines: ETL vs ELT, Parquet & Idempotency
Tasks 0/42 coding
Lab 3
Star Schema Grain & Fan-Trap Simulator
Analytical Star Schemas & DuckDB
Tasks 0/42 coding
Lab 4
Airflow DAG Retry Backoff & Critical Path Simulator
Workflow Orchestration with Apache Airflow
Tasks 0/42 coding
Lab 5
PySpark Partition Waves, Shuffle & Cache Break-Even
Distributed Batch Processing with PySpark
Tasks 0/42 coding
Lab 6
Event-Time Tumbling Window & Watermark Simulator
Streaming, Event-Time Windows & Watermarks
Tasks 0/41 coding
Lab 7
FastAPI Model Serving & Training-Serving Skew Lab
From Model to Data Product: FastAPI & Docker
Tasks 0/42 coding
Lab 8
Milk Validation Funnel, Rule Ordering & Collision Simulator
Practice Exam (sample_qtn): Milk Validation & Collisions
Tasks 0/41 coding
Lab 9
Milk Star Schema Warehouse & Two-Stage Analytics Simulator
Practical Test 02 (dsc3103_test_02): Milk Star Schema & Analytics
Tasks 0/53 coding