Re: [I] Adding Support for Yarn queue and other extras in SparkSubmit Operator and Hook [airflow]

2024-03-25 Thread via GitHub
djuarezg commented on issue #35911: URL: https://github.com/apache/airflow/issues/35911#issuecomment-2018288737 Since 4.6.0 where this was introduced, onwards, using SparkSubmitOperator is broken for us, as the queue can no longer be taken into account due to this change. -- This is an a

Re: [I] Adding Support for Yarn queue and other extras in SparkSubmit Operator and Hook [airflow]

2024-03-17 Thread via GitHub
databius commented on issue #35911: URL: https://github.com/apache/airflow/issues/35911#issuecomment-2002920286 I think the update caused the new issue since SparkSubmitOperator accidentally overwrote the Base Operator's parameter. https://github.com/apache/airflow/blob/main/airflow/

Re: [I] Adding Support for Yarn queue and other extras in SparkSubmit Operator and Hook [airflow]

2023-12-13 Thread via GitHub
josh-fell closed issue #35911: Adding Support for Yarn queue and other extras in SparkSubmit Operator and Hook URL: https://github.com/apache/airflow/issues/35911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab