nsAstro commented on issue #37999: URL: https://github.com/apache/airflow/issues/37999#issuecomment-1987664667
From a responsibilities perspective, if Airflow deems the user responsible for streaming the tasks to ElasticSearch in any way they see fit, it should allow equally flexible configuration on read since it can make no real assumptions on index schema. If the first option can be done in a way that doesn't create any limitations, I'm all for it. However, I think option 2 is the best way to pass the responsibility back to the operator to define the query to align with how they index the logs in the first place. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
