GitHub user potiuk edited a comment on the discussion: Selenium in Airflow
Not sure if that's a good idea to have airflow. tasks as single action in selenium. In Airflow every task is executed in a separate process, potentially on different machines and AFAIK selenium requires to establish connection and run in the same process. That's why you see serialization issue because Airflow tries to serialize driver connected to your webserver and then it would have to restore it in another process. I simply think it's a bad idea to use it for Airflow. GitHub link: https://github.com/apache/airflow/discussions/43574#discussioncomment-11125531 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
