GitHub user mr-staun added a comment to the discussion: SparkKubernetesOperator : FileNotFoundError: [Errno 2] No such file or directory
It seems to be related to [this issue](https://github.com/apache/airflow/issues/38017). The fix has already been merged [here](https://github.com/apache/airflow/pull/38035/changes). You need to upgrade `apache-airflow-providers-cncf-kubernetes` to >= `8.1.0`. The issue was fixed for us by upgrading to Airflow 2.9.3, which uses version 8.3.3. GitHub link: https://github.com/apache/airflow/discussions/39098#discussioncomment-16320259 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
