In this article we have outlined how you can set up remote S3 logging when using KubernetesExecutor, without creating complex infrastructure. This solution has already been implemented by several members of the Airflow community and the purpose of this post is to share it with anyone that is seeking a solution.

At we have been using Airflow for almost 4 years now. Until recently, our data team has been using the Local Executor. …

Zeev Shteiman

Yet another data engineer

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store