Re: Logging

Hi William, The code is trying to use the first log handler that has name task_log_handler to fetch the log. There can only be one log handler used to retrieve the logs. On Tue, Nov 21, 2017 at 8:28 AM William Pursell wrote: > I will be the first to admit that I'm a little confused about loggin

Re: Airflow Log Handler Abstractions

Bolke > > N.B. It might be smart to cc the dev. Apache doesn’t really like personal > conversations. > > > On 6 Jul 2017, at 09:58, Allison Wang wrote: > > Hi Bolke, > > My name is Allison and I am an intern on Airbnb's Data Platform team. > Sorry for not introd

Re: Airflow Logging Improvements

grouping of a variable number of multiple runs), and > each unit should have a unique key or location. One of the reasons we are > working on this effort is to actually make Airflow play nicer with > Kubernetes/Docker (since airflow workers should ideally be ephemeral), and > allowing

Airflow Logging Improvements

Hi, I am in the process of making airflow logging backed by Elasticsearch (more detail please check AIRFLOW-1325 ). Here are several more logging improvements we are considering: *1. Log streaming.* Auto-refresh the logs if tasks are running. *