Discover and read the best of Twitter Threads about #apacheairflow
Most recents (1)
📣Data Engineering Projects for Beginners 2022
👇🧵[1/x]
#dataengineering #python #Docker #developers #aws #GoogleCloud #apacheairflow
👇🧵[1/x]
#dataengineering #python #Docker #developers #aws #GoogleCloud #apacheairflow
Tracking your Uber Rides and Uber Eats expenses through a data engineering process
Technologies and skills:
Python, Docker, Apache Airflow, AWS Redshift, Power BI, data modelling, Task schedulling, ETL and ELT processes, Data warehousing, Cloud
🧵[2/x]
github.com/Wittline/uber-…
Technologies and skills:
Python, Docker, Apache Airflow, AWS Redshift, Power BI, data modelling, Task schedulling, ETL and ELT processes, Data warehousing, Cloud
🧵[2/x]
github.com/Wittline/uber-…
Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag
Technologies and skills:
Python, Docker, Big Data, Cloud, Google Cloud, Redis, DAG, Parallel Processing, Apache Spark
🧵[3/x]
github.com/Wittline/pyDag
Technologies and skills:
Python, Docker, Big Data, Cloud, Google Cloud, Redis, DAG, Parallel Processing, Apache Spark
🧵[3/x]
github.com/Wittline/pyDag
