Skip to content

14 — Data Engineering

Home · Index

Data engineering: pipelines, Airflow, ETL/ELT, and data quality.

Cheat Sheets

# File Topic
1 airflow.md Apache Airflow — DAGs, operators, scheduling, sensors, XComs
2 etl-elt.md ETL/ELT patterns — extraction, transformation, loading, incremental processing
3 data-pipelines.md Pipeline design — architecture, orchestration, monitoring, testing

Planned Cheat Sheets

  • dbt Essentials — models, tests, materializations
  • Data Warehousing — schemas, partitioning, cost control
  • Stream Processing — real-time pipeline patterns

Contribute