[jira] [Updated] (AIRFLOW-6566) Replace uses of imp still left with importlib.

2020-01-14 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated AIRFLOW-6566: Summary: Replace uses of imp still left with importlib. (was: Replace uses of imp still

[jira] [Commented] (AIRFLOW-6566) Replace uses of imp still left with importlib

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015704#comment-17015704 ] ASF GitHub Bot commented on AIRFLOW-6566: - sarutak commented on pull request #7174:

[GitHub] [airflow] sarutak opened a new pull request #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib

2020-01-14 Thread GitBox
sarutak opened a new pull request #7174: [AIRFLOW-6566] Replace uses of imp still left with importlib URL: https://github.com/apache/airflow/pull/7174 I've replaced a use of `imp` with `importlib` in #7099 but I noticed are still two uses left. Let's replace them. --- Issue link:

[jira] [Created] (AIRFLOW-6566) Replace uses of imp still left with importlib

2020-01-14 Thread Kousuke Saruta (Jira)
Kousuke Saruta created AIRFLOW-6566: --- Summary: Replace uses of imp still left with importlib Key: AIRFLOW-6566 URL: https://issues.apache.org/jira/browse/AIRFLOW-6566 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6566) Replace uses of imp still left with importlib

2020-01-14 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated AIRFLOW-6566: Description: I've replaced a use of `imp` with `importlib` in AIRFLOW-6507 but I noticed

[GitHub] [airflow] sarutak commented on issue #7099: [AIRFLOW-6507] Replace the use of imp.load_source with another solution.

2020-01-14 Thread GitBox
sarutak commented on issue #7099: [AIRFLOW-6507] Replace the use of imp.load_source with another solution. URL: https://github.com/apache/airflow/pull/7099#issuecomment-574537650 I noticed there are 2 `imp` left... I'll open another PR to fix them.

[GitHub] [airflow] codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-573300577 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7128?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-573300577 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7128?src=pr=h1) Report > :exclamation:

[GitHub] [airflow] tooptoop4 removed a comment on issue #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-14 Thread GitBox
tooptoop4 removed a comment on issue #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#issuecomment-574418492 @zhongjiajie any idea on why test not working? This is an

[jira] [Commented] (AIRFLOW-6565) BigQuery - replace deprecated connection parameters

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015689#comment-17015689 ] ASF GitHub Bot commented on AIRFLOW-6565: - TobKed commented on pull request #7173:

[GitHub] [airflow] TobKed opened a new pull request #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters

2020-01-14 Thread GitBox
TobKed opened a new pull request #7173: [AIRFLOW-6565] BigQuery - replace deprecated connection parameters URL: https://github.com/apache/airflow/pull/7173 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes

[jira] [Updated] (AIRFLOW-6560) db password leaks to logs

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcin Jasiński updated AIRFLOW-6560: - Description: I have configured Airflow metadata db as MySQL. {code:java}

[jira] [Created] (AIRFLOW-6565) BigQuery - replace deprecated parameters with correct ones

2020-01-14 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-6565: --- Summary: BigQuery - replace deprecated parameters with correct ones Key: AIRFLOW-6565 URL: https://issues.apache.org/jira/browse/AIRFLOW-6565 Project:

[jira] [Updated] (AIRFLOW-6565) BigQuery - replace deprecated connection parameters

2020-01-14 Thread Tobiasz Kedzierski (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tobiasz Kedzierski updated AIRFLOW-6565: Summary: BigQuery - replace deprecated connection parameters (was: BigQuery -

[jira] [Updated] (AIRFLOW-6560) db password leaks to logs

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcin Jasiński updated AIRFLOW-6560: - Description: I have configured Airflow metadata db as MySQL. {code:java}

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-14 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r366722592 ## File path: .travis.yml ## @@ -87,6 +91,18 @@ jobs:

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366714188 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars' properties

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366703132 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars' properties

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366702859 ## File path: UPDATING.md ## @@ -938,17 +838,93 @@ The 'properties' and 'jars' properties

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366702370 ## File path: UPDATING.md ## @@ -1043,6 +1019,12 @@

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366701958 ## File path: UPDATING.md ## @@ -1226,6 +1208,11 @@ generates has been fixed. ## Airflow

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366701810 ## File path: UPDATING.md ## @@ -1305,6 +1292,11 @@ or enabled autodetect of schema: ##

[GitHub] [airflow] larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#discussion_r366655381 ## File path: airflow/utils/log/es_task_handler.py ## @@

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366699596 ## File path: UPDATING.md ## @@ -1336,6 +1328,20 @@ Installation and upgrading requires

[GitHub] [airflow] kaxil commented on a change in pull request #7166: [AIRFLOW-XXXX] Move UPDATING changes into correct versions

2020-01-14 Thread GitBox
kaxil commented on a change in pull request #7166: [AIRFLOW-] Move UPDATING changes into correct versions URL: https://github.com/apache/airflow/pull/7166#discussion_r366699525 ## File path: UPDATING.md ## @@ -1336,6 +1328,20 @@ Installation and upgrading requires

[GitHub] [airflow] codecov-io edited a comment on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#issuecomment-573571156 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7141?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#issuecomment-573571156 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7141?src=pr=h1) Report > Merging

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-14 Thread GitBox
zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#discussion_r31407 ## File path: tests/models/test_dagbag.py ## @@ -151,6 +151,42 @@ def test_zip(self):

[jira] [Commented] (AIRFLOW-6564) Display extra diagnostics if initial environment check fails

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015560#comment-17015560 ] ASF GitHub Bot commented on AIRFLOW-6564: - potiuk commented on pull request #7172:

[GitHub] [airflow] potiuk opened a new pull request #7172: [AIRFLOW-6564] Additional diagnostics information on CI check failure

2020-01-14 Thread GitBox
potiuk opened a new pull request #7172: [AIRFLOW-6564] Additional diagnostics information on CI check failure URL: https://github.com/apache/airflow/pull/7172 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes

[jira] [Created] (AIRFLOW-6564) Display extra diagnostics if initial environment check fails

2020-01-14 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-6564: - Summary: Display extra diagnostics if initial environment check fails Key: AIRFLOW-6564 URL: https://issues.apache.org/jira/browse/AIRFLOW-6564 Project: Apache

[GitHub] [airflow] codecov-io edited a comment on issue #7171: [AIRFLOW-6563] Add end_date for marked tasks

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7171: [AIRFLOW-6563] Add end_date for marked tasks URL: https://github.com/apache/airflow/pull/7171#issuecomment-574426943 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7171?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7171: [AIRFLOW-6563] Add end_date for marked tasks

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7171: [AIRFLOW-6563] Add end_date for marked tasks URL: https://github.com/apache/airflow/pull/7171#issuecomment-574426943 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7171?src=pr=h1) Report > Merging

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-14 Thread GitBox
zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#discussion_r31407 ## File path: tests/models/test_dagbag.py ## @@ -151,6 +151,42 @@ def test_zip(self):

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-14 Thread GitBox
zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#discussion_r30224 ## File path: airflow/models/dagbag.py ## @@ -300,26 +302,37 @@ def process_file(self, filepath,

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-14 Thread GitBox
zhongjiajie commented on a change in pull request #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#discussion_r366360841 ## File path: airflow/models/dagbag.py ## @@ -300,26 +302,37 @@ def process_file(self, filepath,

[GitHub] [airflow] larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#issuecomment-574451555 > Also regarding adding index my **5c**: > Currently we have something like: > `GET

[GitHub] [airflow] larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#discussion_r366655381 ## File path: airflow/utils/log/es_task_handler.py ## @@

[GitHub] [airflow] larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#issuecomment-574448853 > @larryzhu2018 Yup, this is two tickets as Andrii mentions. > > And this seems to

[GitHub] [airflow] larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#discussion_r366652482 ## File path: airflow/utils/log/es_task_handler.py ## @@

[GitHub] [airflow] larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#issuecomment-574447922 > @ashb IMO better to split 2 unrelated changes into 2 tickets: > > * add index (good

[GitHub] [airflow] codecov-io edited a comment on issue #7170: [AIRFLOW-6562] mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7170: [AIRFLOW-6562] mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet URL: https://github.com/apache/airflow/pull/7170#issuecomment-574447220 #

[GitHub] [airflow] codecov-io commented on issue #7170: [AIRFLOW-6562] mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet

2020-01-14 Thread GitBox
codecov-io commented on issue #7170: [AIRFLOW-6562] mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet URL: https://github.com/apache/airflow/pull/7170#issuecomment-574447220 #

[GitHub] [airflow] larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on issue #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#issuecomment-574446137 > Also regarding adding index my **5c**: > Currently we have something like: > `GET

[GitHub] [airflow] larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#discussion_r366648976 ## File path: airflow/utils/log/es_task_handler.py ## @@

[GitHub] [airflow] larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#discussion_r366645903 ## File path: airflow/utils/log/es_task_handler.py ## @@

[GitHub] [airflow] larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs

2020-01-14 Thread GitBox
larryzhu2018 commented on a change in pull request #7141: [AIRFLOW-6544] add log_id to end-of-file mark and also add an index config for logs URL: https://github.com/apache/airflow/pull/7141#discussion_r366647600 ## File path: airflow/utils/log/es_task_handler.py ## @@

[GitHub] [airflow] codecov-io commented on issue #7169: [AIRFLOW-6555] mushroom cloud error when clicking 'task instance details' from graph view of dag that has never been run yet

2020-01-14 Thread GitBox
codecov-io commented on issue #7169: [AIRFLOW-6555] mushroom cloud error when clicking 'task instance details' from graph view of dag that has never been run yet URL: https://github.com/apache/airflow/pull/7169#issuecomment-574431885 #

[GitHub] [airflow] yuqian90 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-14 Thread GitBox
yuqian90 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r366633960 ## File path: airflow/sensors/external_task_sensor.py ## @@ -16,22 +16,71 @@ #

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-14 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r366632753 ## File path: .travis.yml ## @@ -87,6 +91,18 @@ jobs:

[jira] [Commented] (AIRFLOW-6233) Task get stuck on scheduled on LocalExecutor

2020-01-14 Thread Robert Conroy (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015492#comment-17015492 ] Robert Conroy commented on AIRFLOW-6233: [~BrechtDeVlieger] I've been unable to reproduce this

[GitHub] [airflow] codecov-io commented on issue #7171: [AIRFLOW-6563] Add end_date for marked tasks

2020-01-14 Thread GitBox
codecov-io commented on issue #7171: [AIRFLOW-6563] Add end_date for marked tasks URL: https://github.com/apache/airflow/pull/7171#issuecomment-574426943 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7171?src=pr=h1) Report > Merging

[GitHub] [airflow] tooptoop4 commented on issue #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-14 Thread GitBox
tooptoop4 commented on issue #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#issuecomment-574418492 @zhongjiajie any idea on why test not working? This is an automated

[jira] [Commented] (AIRFLOW-6563) User marked tasks does not have a valid end_date

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015470#comment-17015470 ] ASF GitHub Bot commented on AIRFLOW-6563: - YingboWang commented on pull request #7171:

[GitHub] [airflow] YingboWang opened a new pull request #7171: [AIRFLOW-6563] Add end_date for marked tasks

2020-01-14 Thread GitBox
YingboWang opened a new pull request #7171: [AIRFLOW-6563] Add end_date for marked tasks URL: https://github.com/apache/airflow/pull/7171 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below before creating

[jira] [Work started] (AIRFLOW-6563) User marked tasks does not have a valid end_date

2020-01-14 Thread Yingbo Wang (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6563 started by Yingbo Wang. > User marked tasks does not have a valid end_date >

[GitHub] [airflow] tooptoop4 opened a new pull request #7170: [AIRFLOW-6562] mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet

2020-01-14 Thread GitBox
tooptoop4 opened a new pull request #7170: [AIRFLOW-6562] mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet URL: https://github.com/apache/airflow/pull/7170 --- Issue link: WILL BE INSERTED BY

[jira] [Commented] (AIRFLOW-6562) mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015460#comment-17015460 ] ASF GitHub Bot commented on AIRFLOW-6562: - tooptoop4 commented on pull request #7170:

[jira] [Work started] (AIRFLOW-6562) mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet

2020-01-14 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6562 started by t oo. - > mushroom cloud error when clicking 'mark failed/success' from graph view of > dag that

[jira] [Created] (AIRFLOW-6563) User marked tasks does not have a valid end_date

2020-01-14 Thread Yingbo Wang (Jira)
Yingbo Wang created AIRFLOW-6563: Summary: User marked tasks does not have a valid end_date Key: AIRFLOW-6563 URL: https://issues.apache.org/jira/browse/AIRFLOW-6563 Project: Apache Airflow

[jira] [Created] (AIRFLOW-6562) mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet

2020-01-14 Thread t oo (Jira)
t oo created AIRFLOW-6562: - Summary: mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet Key: AIRFLOW-6562 URL: https://issues.apache.org/jira/browse/AIRFLOW-6562

[jira] [Updated] (AIRFLOW-6562) mushroom cloud error when clicking 'mark failed/success' from graph view of dag that has never been run yet

2020-01-14 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6562: -- Description: # create a new dag # go to graph view # click on one of the tasks (it should have a white

[jira] [Commented] (AIRFLOW-6555) mushroom cloud error when clicking 'task instance details' from graph view of dag that has never been run yet

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015430#comment-17015430 ] ASF GitHub Bot commented on AIRFLOW-6555: - tooptoop4 commented on pull request #7169:

[GitHub] [airflow] tooptoop4 opened a new pull request #7169: [AIRFLOW-6555] mushroom cloud error when clicking 'task instance details' from graph view of dag that has never been run yet

2020-01-14 Thread GitBox
tooptoop4 opened a new pull request #7169: [AIRFLOW-6555] mushroom cloud error when clicking 'task instance details' from graph view of dag that has never been run yet URL: https://github.com/apache/airflow/pull/7169 --- Issue link: WILL BE INSERTED BY

[jira] [Work started] (AIRFLOW-6555) mushroom cloud error when clicking 'task instance details' from graph view of dag that has never been run yet

2020-01-14 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6555 started by t oo. - > mushroom cloud error when clicking 'task instance details' from graph view of > dag that

[GitHub] [airflow] codecov-io edited a comment on issue #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#issuecomment-572737962 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7119?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-6546) add GDriveToGcsOperator

2020-01-14 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015377#comment-17015377 ] Kamil Bregula commented on AIRFLOW-6546: It seems that the cycles have already been blocked in

[GitHub] [airflow] stijndehaes opened a new pull request #7168: [AIRFLOW-6561] Add possibility to specify default resources for airfl…

2020-01-14 Thread GitBox
stijndehaes opened a new pull request #7168: [AIRFLOW-6561] Add possibility to specify default resources for airfl… URL: https://github.com/apache/airflow/pull/7168 …ow k8s workers --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg)

[jira] [Commented] (AIRFLOW-6561) Kubernetes executor allow to set default resource requirements for created workers

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015363#comment-17015363 ] ASF GitHub Bot commented on AIRFLOW-6561: - stijndehaes commented on pull request #7168:

[jira] [Created] (AIRFLOW-6561) Kubernetes executor allow to set default resource requirements for created workers

2020-01-14 Thread Stijn De Haes (Jira)
Stijn De Haes created AIRFLOW-6561: -- Summary: Kubernetes executor allow to set default resource requirements for created workers Key: AIRFLOW-6561 URL: https://issues.apache.org/jira/browse/AIRFLOW-6561

[GitHub] [airflow] potiuk merged pull request #7164: [AIRFLOW-XXXX]: Set test env vars in confttest.py, not Breeze entrypoint

2020-01-14 Thread GitBox
potiuk merged pull request #7164: [AIRFLOW-]: Set test env vars in confttest.py, not Breeze entrypoint URL: https://github.com/apache/airflow/pull/7164 This is an automated message from the Apache Git Service. To

[GitHub] [airflow] potiuk commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-14 Thread GitBox
potiuk commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r366538449 ## File path: .travis.yml ## @@ -87,6 +91,18 @@ jobs:

[GitHub] [airflow] yqian1991 commented on a change in pull request #7167: [AIRFLOW-5974] AIP-21 Change import paths for celery modules

2020-01-14 Thread GitBox
yqian1991 commented on a change in pull request #7167: [AIRFLOW-5974] AIP-21 Change import paths for celery modules URL: https://github.com/apache/airflow/pull/7167#discussion_r366531206 ## File path: airflow/contrib/sensors/celery_queue_sensor.py ## @@ -16,74 +16,14 @@

[GitHub] [airflow] codecov-io edited a comment on issue #6870: [AIRFLOW-0578] Check return code

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #6870: [AIRFLOW-0578] Check return code URL: https://github.com/apache/airflow/pull/6870#issuecomment-569120114 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6870?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6870: [AIRFLOW-0578] Check return code

2020-01-14 Thread GitBox
codecov-io edited a comment on issue #6870: [AIRFLOW-0578] Check return code URL: https://github.com/apache/airflow/pull/6870#issuecomment-569120114 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6870?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on a change in pull request #7167: [AIRFLOW-5974] AIP-21 Change import paths for celery modules

2020-01-14 Thread GitBox
mik-laj commented on a change in pull request #7167: [AIRFLOW-5974] AIP-21 Change import paths for celery modules URL: https://github.com/apache/airflow/pull/7167#discussion_r366525179 ## File path: airflow/contrib/sensors/celery_queue_sensor.py ## @@ -16,74 +16,14 @@ #

[GitHub] [airflow] roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574327663 > The `spark-on-k8s-operator` project is maintained by the Google Cloud Platform and should therefore comply with the GCP

[jira] [Assigned] (AIRFLOW-5974) Change import paths for "celery" modules

2020-01-14 Thread Yu Qian (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Qian reassigned AIRFLOW-5974: Assignee: Yu Qian > Change import paths for "celery" modules >

[jira] [Created] (AIRFLOW-6560) db password leaks to logs

2020-01-14 Thread Jira
Marcin Jasiński created AIRFLOW-6560: Summary: db password leaks to logs Key: AIRFLOW-6560 URL: https://issues.apache.org/jira/browse/AIRFLOW-6560 Project: Apache Airflow Issue Type: Bug

[jira] [Commented] (AIRFLOW-5974) Change import paths for "celery" modules

2020-01-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015316#comment-17015316 ] ASF GitHub Bot commented on AIRFLOW-5974: - yqian1991 commented on pull request #7167:

[GitHub] [airflow] yqian1991 opened a new pull request #7167: [AIRFLOW-5974] AIP-21 Change import paths for celery modules

2020-01-14 Thread GitBox
yqian1991 opened a new pull request #7167: [AIRFLOW-5974] AIP-21 Change import paths for celery modules URL: https://github.com/apache/airflow/pull/7167 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below

[GitHub] [airflow] feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results

2020-01-14 Thread GitBox
feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results URL: https://github.com/apache/airflow/pull/6075#discussion_r366514619 ## File path: tests/contrib/hooks/test_aws_athena_hook.py ## @@ -0,0 +1,88 @@ +# -*-

[GitHub] [airflow] feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results

2020-01-14 Thread GitBox
feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results URL: https://github.com/apache/airflow/pull/6075#discussion_r366514619 ## File path: tests/contrib/hooks/test_aws_athena_hook.py ## @@ -0,0 +1,88 @@ +# -*-

[GitHub] [airflow] roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366514865 ## File path: airflow/contrib/sensors/spark_kubernetes_sensor.py ## @@ -0,0 +1,82 @@ +# -*-

[GitHub] [airflow] roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366513445 ## File path: airflow/contrib/operators/spark_kubernetes_operator.py ## @@ -0,0 +1,77 @@ +# -*-

[GitHub] [airflow] feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results

2020-01-14 Thread GitBox
feluelle commented on a change in pull request #6075: [AIRFLOW-5266] Allow aws_athena_hook to get all query results URL: https://github.com/apache/airflow/pull/6075#discussion_r366509902 ## File path: tests/contrib/hooks/test_aws_athena_hook.py ## @@ -0,0 +1,88 @@ +# -*-

[GitHub] [airflow] feluelle commented on a change in pull request #6469: [AIRFLOW-5816] S3 to snowflake operator

2020-01-14 Thread GitBox
feluelle commented on a change in pull request #6469: [AIRFLOW-5816] S3 to snowflake operator URL: https://github.com/apache/airflow/pull/6469#discussion_r366504190 ## File path: airflow/providers/snowflake/operators/snowflake.py ## @@ -0,0 +1,90 @@ +# -*- coding: utf-8

[GitHub] [airflow] codecov-io commented on issue #7164: [AIRFLOW-XXXX]: Set test env vars in confttest.py, not Breeze entrypoint

2020-01-14 Thread GitBox
codecov-io commented on issue #7164: [AIRFLOW-]: Set test env vars in confttest.py, not Breeze entrypoint URL: https://github.com/apache/airflow/pull/7164#issuecomment-574307599 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7164?src=pr=h1) Report > Merging

[GitHub] [airflow] rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-14 Thread GitBox
rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r366496424 ## File path: airflow/sensors/external_task_sensor.py ## @@ -16,22 +16,52 @@ #

[GitHub] [airflow] rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-14 Thread GitBox
rconroy293 commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r366496493 ## File path: airflow/plugins_manager.py ## @@ -133,6 +133,9 @@ def

[GitHub] [airflow] rconroy293 commented on issue #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-14 Thread GitBox
rconroy293 commented on issue #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#issuecomment-574305768 Alright, I think thinks are in a good state @kaxil - things should be good on the serialization front. The failing

[GitHub] [airflow] lucafuji commented on a change in pull request #6870: [AIRFLOW-578] Fix check return code

2020-01-14 Thread GitBox
lucafuji commented on a change in pull request #6870: [AIRFLOW-578] Fix check return code URL: https://github.com/apache/airflow/pull/6870#discussion_r366495363 ## File path: airflow/utils/state.py ## @@ -122,3 +122,10 @@ def unfinished(cls):

[jira] [Commented] (AIRFLOW-6546) add GDriveToGcsOperator

2020-01-14 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015256#comment-17015256 ] Kamil Bregula commented on AIRFLOW-6546: I think that wildcard support is very helpful. I would

[GitHub] [airflow] mik-laj commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
mik-laj commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574295974 Have you tested it with GKE? Should we ensure integration with IAM? KubernetesPodOperator have support for IAM via

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366484195 ## File path: docs/operators-and-hooks-ref.rst ## @@ -1049,8 +1049,11 @@ These integrations

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366482784 ## File path: airflow/contrib/operators/spark_kubernetes_operator.py ## @@ -0,0 +1,77 @@ +# -*-

[GitHub] [airflow] mik-laj commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
mik-laj commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574293354 The `spark-on-k8s-operator` project is maintained by the Google Cloud Platform and should therefore comply with the GCP

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366478778 ## File path: airflow/contrib/sensors/spark_kubernetes_sensor.py ## @@ -0,0 +1,82 @@ +# -*-

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366477385 ## File path: airflow/contrib/operators/spark_kubernetes_operator.py ## @@ -0,0 +1,77 @@ +# -*-

[GitHub] [airflow] mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-14 Thread GitBox
mik-laj commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r366476870 ## File path: airflow/contrib/example_dags/example_spark_kubernetes_operator.py ## @@ -0,0

  1   2   3   >