Real-time e-commerce ETL pipeline
Data engineeringKafkaPySparkAirflow
Streaming medallion-architecture pipeline: Kafka orders → PySpark Structured Streaming → bronze/silver/gold layers → star-schema warehouse, orchestrated with Airflow.
Read case study →