[jira] [Work started] (AIRFLOW-2597) dbapi hook not committing when autocommit is set to false

2018-06-11 Thread Kevin Yang (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2597 started by Kevin Yang. --- > dbapi hook not committing when autocommit is set to false >

[jira] [Created] (AIRFLOW-2597) dbapi hook not committing when autocommit is set to false

2018-06-11 Thread Kevin Yang (JIRA)
Kevin Yang created AIRFLOW-2597: --- Summary: dbapi hook not committing when autocommit is set to false Key: AIRFLOW-2597 URL: https://issues.apache.org/jira/browse/AIRFLOW-2597 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-2585) Bug fix in CassandraHook and CassandraToGoogleCloudStorageOperator

2018-06-11 Thread Joy Gao (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joy Gao updated AIRFLOW-2585: - Description: * Issue with UUID type conversion: currently UUID is converted to hex string, but should

[jira] [Commented] (AIRFLOW-1104) Concurrency check in scheduler should count queued tasks as well as running

2018-06-11 Thread Dan Fowler (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509013#comment-16509013 ] Dan Fowler commented on AIRFLOW-1104: - Sounds good, thanks! > Concurrency check in scheduler

[jira] [Commented] (AIRFLOW-1104) Concurrency check in scheduler should count queued tasks as well as running

2018-06-11 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509004#comment-16509004 ] Tao Feng commented on AIRFLOW-1104: --- let me take a look later today or tomorrow. > Concurrency check

[jira] [Resolved] (AIRFLOW-2590) dbapi hook not committing when conn does not support auto commit

2018-06-11 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2590. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3485

incubator-airflow git commit: [AIRFLOW-2590] Fix commit in DbApiHook.run() for no-autocommit DB

2018-06-11 Thread kaxilnaik
Repository: incubator-airflow Updated Branches: refs/heads/master be3d551f7 -> dae8ac3d6 [AIRFLOW-2590] Fix commit in DbApiHook.run() for no-autocommit DB Closes #3485 from yrqls21/kevin_yang_fix_dbapi Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Commented] (AIRFLOW-2590) dbapi hook not committing when conn does not support auto commit

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508992#comment-16508992 ] ASF subversion and git services commented on AIRFLOW-2590: -- Commit

[jira] [Updated] (AIRFLOW-2512) GoogleCloudBaseHook using deprecated oauth2client

2018-06-11 Thread Tim Swast (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Swast updated AIRFLOW-2512: --- External issue URL: https://github.com/apache/incubator-airflow/pull/3488 > GoogleCloudBaseHook

[jira] [Updated] (AIRFLOW-2522) Cannot use GOOGLE_APPLICATION_CREDENTIALS to authenticate for GCP connections

2018-06-11 Thread Tim Swast (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Swast updated AIRFLOW-2522: --- External issue URL: https://github.com/apache/incubator-airflow/pull/3488 > Cannot use

[jira] [Work started] (AIRFLOW-2595) Oracle to Azure Blob Storage Transfer Operator

2018-06-11 Thread Marcus Rehm (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2595 started by Marcus Rehm. > Oracle to Azure Blob Storage Transfer Operator >

[jira] [Created] (AIRFLOW-2596) Oracle to Azure Datalake Transfer Operator

2018-06-11 Thread Marcus Rehm (JIRA)
Marcus Rehm created AIRFLOW-2596: Summary: Oracle to Azure Datalake Transfer Operator Key: AIRFLOW-2596 URL: https://issues.apache.org/jira/browse/AIRFLOW-2596 Project: Apache Airflow Issue

[jira] [Assigned] (AIRFLOW-2596) Oracle to Azure Datalake Transfer Operator

2018-06-11 Thread Marcus Rehm (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcus Rehm reassigned AIRFLOW-2596: Assignee: Marcus Rehm > Oracle to Azure Datalake Transfer Operator >

[jira] [Created] (AIRFLOW-2595) Oracle to Azure Blob Storage Transfer Operator

2018-06-11 Thread Marcus Rehm (JIRA)
Marcus Rehm created AIRFLOW-2595: Summary: Oracle to Azure Blob Storage Transfer Operator Key: AIRFLOW-2595 URL: https://issues.apache.org/jira/browse/AIRFLOW-2595 Project: Apache Airflow

[jira] [Created] (AIRFLOW-2594) Airflow run state change is non atomic

2018-06-11 Thread Alex Guziel (JIRA)
Alex Guziel created AIRFLOW-2594: Summary: Airflow run state change is non atomic Key: AIRFLOW-2594 URL: https://issues.apache.org/jira/browse/AIRFLOW-2594 Project: Apache Airflow Issue

[jira] [Resolved] (AIRFLOW-1115) github enterprise auth fail to fetch user info

2018-06-11 Thread Joy Gao (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joy Gao resolved AIRFLOW-1115. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3469

[jira] [Commented] (AIRFLOW-1115) github enterprise auth fail to fetch user info

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508842#comment-16508842 ] ASF subversion and git services commented on AIRFLOW-1115: -- Commit

incubator-airflow git commit: [AIRFLOW-1115] fix github oauth api URL

2018-06-11 Thread joygao
Repository: incubator-airflow Updated Branches: refs/heads/master f1df9575b -> be3d551f7 [AIRFLOW-1115] fix github oauth api URL Closes #3469 from renzofrigato/airflow_1115 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Closed] (AIRFLOW-2587) Add TIMESTAMP type mapping to MySqlToHiveTransfer

2018-06-11 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong closed AIRFLOW-2587. - Resolution: Fixed Fix Version/s: 2.0.0 1.10.0 > Add

[jira] [Commented] (AIRFLOW-2587) Add TIMESTAMP type mapping to MySqlToHiveTransfer

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508533#comment-16508533 ] ASF subversion and git services commented on AIRFLOW-2587: -- Commit

[jira] [Commented] (AIRFLOW-2587) Add TIMESTAMP type mapping to MySqlToHiveTransfer

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508532#comment-16508532 ] ASF subversion and git services commented on AIRFLOW-2587: -- Commit

incubator-airflow git commit: [AIRFLOW-2587] Add TIMESTAMP type mapping to MySqlToHiveTransfer

2018-06-11 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master cae918e91 -> f1df9575b [AIRFLOW-2587] Add TIMESTAMP type mapping to MySqlToHiveTransfer This PR fixes MySqlToHiveTransfer to map MySQL TIMESTAMP to Hive TIMESTAMP (not STRING) so that users are not required to cast it

[jira] [Resolved] (AIRFLOW-2591) Set default value of autocommit to False in DbApiHook.run()

2018-06-11 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2591. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3487

[jira] [Commented] (AIRFLOW-2581) Fix DbApiHook autocommit

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508529#comment-16508529 ] ASF subversion and git services commented on AIRFLOW-2581: -- Commit

[jira] [Commented] (AIRFLOW-2591) Set default value of autocommit to False in DbApiHook.run()

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508527#comment-16508527 ] ASF subversion and git services commented on AIRFLOW-2591: -- Commit

[jira] [Commented] (AIRFLOW-2591) Set default value of autocommit to False in DbApiHook.run()

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508530#comment-16508530 ] ASF subversion and git services commented on AIRFLOW-2591: -- Commit

[jira] [Commented] (AIRFLOW-2581) Fix DbApiHook autocommit

2018-06-11 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508528#comment-16508528 ] ASF subversion and git services commented on AIRFLOW-2581: -- Commit

incubator-airflow git commit: [AIRFLOW-2591][AIRFLOW-2581] Set default value of autocommit to False in DbApiHook.run()

2018-06-11 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master c27098b8d -> cae918e91 [AIRFLOW-2591][AIRFLOW-2581] Set default value of autocommit to False in DbApiHook.run() In previous PR (AIRFLOW-2581), I changed the default value of autocommit to True in DbApiHook.run(), which may

[jira] [Commented] (AIRFLOW-2584) Tasks Never Get DeQueued, No New DagRuns Can Start

2018-06-11 Thread andy dreyfuss (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508440#comment-16508440 ] andy dreyfuss commented on AIRFLOW-2584: This appears to be related to operators that directly

[jira] [Commented] (AIRFLOW-1104) Concurrency check in scheduler should count queued tasks as well as running

2018-06-11 Thread Dan Fowler (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508405#comment-16508405 ] Dan Fowler commented on AIRFLOW-1104: - [~saguziel] [~TaoFeng] any updates on this ticket? We are

[jira] [Assigned] (AIRFLOW-2524) Airflow integration with AWS Sagemaker

2018-06-11 Thread Yang Yu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yu reassigned AIRFLOW-2524: Assignee: Yang Yu (was: Rajeev Srinivasan) > Airflow integration with AWS Sagemaker >

[jira] [Created] (AIRFLOW-2593) Expose next scheduled time

2018-06-11 Thread david (JIRA)
david created AIRFLOW-2593: -- Summary: Expose next scheduled time Key: AIRFLOW-2593 URL: https://issues.apache.org/jira/browse/AIRFLOW-2593 Project: Apache Airflow Issue Type: New Feature

[jira] [Created] (AIRFLOW-2592) Bump Bleach dependency to address CVE-2018-7753

2018-06-11 Thread Jan (JIRA)
Jan created AIRFLOW-2592: Summary: Bump Bleach dependency to address CVE-2018-7753 Key: AIRFLOW-2592 URL: https://issues.apache.org/jira/browse/AIRFLOW-2592 Project: Apache Airflow Issue Type: Task

[jira] [Commented] (AIRFLOW-2571) airflow backfill progress bar

2018-06-11 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507723#comment-16507723 ] Chao-Han Tsai commented on AIRFLOW-2571: we also need to close it in background. > airflow

[jira] [Commented] (AIRFLOW-2571) airflow backfill progress bar

2018-06-11 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507722#comment-16507722 ] Chao-Han Tsai commented on AIRFLOW-2571: [https://github.com/tqdm/tqdm] might be better for