This issue bugs me a lot. Pretty much all our PRs were updated 2 days ago
again :(
I've opened the ticket to Apache Infrastructure
https://issues.apache.org/jira/browse/INFRA-18589 and I hope we can get to
the bottom of it. I believe it might be some integration we have (but I
have no access to it
We attempted to use zipped dags in the past and ran into a bunch of issues.
I've stopped trying to get them to work and just use a docker operator or
virtualenv operator when I need custom dependencies.
+1 on supporting dag serialization or remote fetching, would work around a
bunch of problems.
+1 to a serialization scheme. I'm happy to give early feedback.
On Mon, Jun 10, 2019 at 8:34 AM Dan Davydov
wrote:
> I know the code around this is pretty hacky (if use_zip_file then...
> instead of an abstraction). I know when it was added it was a bit
> controversial, I would be +1 on removing
I know the code around this is pretty hacky (if use_zip_file then...
instead of an abstraction). I know when it was added it was a bit
controversial, I would be +1 on removing it. That being said I feel the
entire DAG parsing process needs to be moved to the client-side (users who
write DAGs), with
