I'm taking the freedom to share my talk from DataEngConf 2018 with this group since it's somewhat related to Airflow.
https://www.youtube.com/watch?v=4Spo2QRTz1k Related blog post: https://medium.com/@maximebeauchemin/functional-data-engineering-a-modern-paradigm-for-batch-data-processing-2327ec32c42a Max