13 — Big Data¶
Big data processing: Spark, PySpark, Kafka, Delta Lake, and Databricks.
Cheat Sheets¶
| # | File | Topic |
|---|---|---|
| 1 | apache-spark.md | Apache Spark core concepts — SparkSession, DataFrames, transformations, actions |
| 2 | pyspark.md | PySpark DataFrame operations, joins, aggregations, UDFs, optimization |
| 3 | databricks.md | Databricks platform — notebooks, clusters, jobs, Delta Lake integration |
| 4 | delta-lake.md | Delta Lake — ACID transactions, time travel, MERGE, optimization, constraints |
| 5 | kafka.md | Kafka — producers, consumers, topics, partitions, consumer groups, streaming |
Planned Cheat Sheets¶
- Hadoop Ecosystem — HDFS, Hive, and friends
- Spark Streaming — real-time data processing
- Flink Essentials — stream processing
Related Categories¶
- 14-Data-Engineering — pipeline orchestration
- 02-Data-Analysis — single-machine analysis
Contribute¶
- Template: CHEATSHEET_TEMPLATE.md
- Guide: CONTRIBUTING.md