IBM Data Engineering: ETL and Data Pipelines with Shell, Airflow and Kafka

A concise archive of my notes from a data engineering course covering ETL and ELT fundamentals, data pipeline design, Apache Airflow orchestration, and real-time streaming with Apache Kafka. Focused on concepts, architecture, and practical trade-offs rather than step-by-step tutorials.