[jira] [Resolved] (AIRFLOW-7059) Pass hive_conf to get_pandas_df in HiveServer2Hook

2020-04-21 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-7059. Fix Version/s: 1.10.11 Resolution: Fixed > Pass hive_conf to get_pandas_df in

[jira] [Commented] (AIRFLOW-4421) task related stats should be optional

2020-01-03 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007559#comment-17007559 ] Chao-Han Tsai commented on AIRFLOW-4421: I see then I think should fix the issue. > task

[jira] [Closed] (AIRFLOW-4421) task related stats should be optional

2020-01-03 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-4421. -- Resolution: Won't Fix > task related stats should be optional >

[jira] [Commented] (AIRFLOW-4421) task related stats should be optional

2020-01-03 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007510#comment-17007510 ] Chao-Han Tsai commented on AIRFLOW-4421: [~kamil.bregula] just want to clarify.

[jira] [Resolved] (AIRFLOW-6073) Move Qubole Operator Link class to qubole_operator.py

2019-11-26 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-6073. Resolution: Fixed > Move Qubole Operator Link class to qubole_operator.py >

[jira] [Resolved] (AIRFLOW-5683) Add propagate_skipped_state to SubDagOperator

2019-11-05 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-5683. Fix Version/s: 2.0.0 Resolution: Fixed > Add propagate_skipped_state to

[jira] [Updated] (AIRFLOW-5442) Druid broker hook get pandas DataFrame implementation

2019-10-29 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-5442: --- Fix Version/s: (was: 1.10.7) 1.10.6 > Druid broker hook get pandas

[jira] [Resolved] (AIRFLOW-5442) Druid broker hook get pandas DataFrame implementation

2019-10-29 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-5442. Resolution: Fixed > Druid broker hook get pandas DataFrame implementation >

[jira] [Updated] (AIRFLOW-5442) Druid broker hook get pandas DataFrame implementation

2019-10-29 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-5442: --- Fix Version/s: 1.10.7 > Druid broker hook get pandas DataFrame implementation >

[jira] [Updated] (AIRFLOW-5710) Optionally error on unused operator arguments

2019-10-22 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-5710: --- Fix Version/s: 1.10.6 > Optionally error on unused operator arguments >

[jira] [Resolved] (AIRFLOW-5710) Optionally error on unused operator arguments

2019-10-22 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-5710. Resolution: Fixed > Optionally error on unused operator arguments >

[jira] [Resolved] (AIRFLOW-5714) Collect SLA miss emails only from tasks missed SLA

2019-10-22 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-5714. Fix Version/s: 1.10.7 Resolution: Fixed > Collect SLA miss emails only from tasks

[jira] [Created] (AIRFLOW-5714) Collect SLA miss emails only from tasks missed SLA

2019-10-21 Thread Chao-Han Tsai (Jira)
Chao-Han Tsai created AIRFLOW-5714: -- Summary: Collect SLA miss emails only from tasks missed SLA Key: AIRFLOW-5714 URL: https://issues.apache.org/jira/browse/AIRFLOW-5714 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5666) Create a BaseTransferToS3Operator

2019-10-15 Thread Chao-Han Tsai (Jira)
Chao-Han Tsai created AIRFLOW-5666: -- Summary: Create a BaseTransferToS3Operator Key: AIRFLOW-5666 URL: https://issues.apache.org/jira/browse/AIRFLOW-5666 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-5338) Add a RedsfhitToS3Operator

2019-08-28 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-5338: --- Description: Create an Airflow operator that queries Redshift and persists the results to

[jira] [Created] (AIRFLOW-5337) Add a PostgresToS3Operator

2019-08-28 Thread Chao-Han Tsai (Jira)
Chao-Han Tsai created AIRFLOW-5337: -- Summary: Add a PostgresToS3Operator Key: AIRFLOW-5337 URL: https://issues.apache.org/jira/browse/AIRFLOW-5337 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-5338) Add a RedsfhitToS3Operator

2019-08-28 Thread Chao-Han Tsai (Jira)
Chao-Han Tsai created AIRFLOW-5338: -- Summary: Add a RedsfhitToS3Operator Key: AIRFLOW-5338 URL: https://issues.apache.org/jira/browse/AIRFLOW-5338 Project: Apache Airflow Issue Type: New

[jira] [Closed] (AIRFLOW-4940) DynamoDB to S3 backup operator

2019-08-28 Thread Chao-Han Tsai (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-4940. -- Resolution: Fixed > DynamoDB to S3 backup operator > -- > >

[jira] [Resolved] (AIRFLOW-4138) [AIP] Introduce DAG manifest

2019-08-05 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-4138. Resolution: Fixed > [AIP] Introduce DAG manifest > > >

[jira] [Updated] (AIRFLOW-5094) Make airflow conn prefix configurable

2019-08-05 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-5094: --- Description: Currently the Airflow picks up connection strings from environment variable

[jira] [Closed] (AIRFLOW-5095) airflow.cfg merger

2019-08-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-5095. -- Resolution: Fixed > airflow.cfg merger > -- > > Key:

[jira] [Commented] (AIRFLOW-5095) airflow.cfg merger

2019-08-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899366#comment-16899366 ] Chao-Han Tsai commented on AIRFLOW-5095: Say in the later version of airflow, we introduced a

[jira] [Commented] (AIRFLOW-1482) Error when try to backfill the example_trigger_controller_dag

2019-08-01 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898572#comment-16898572 ] Chao-Han Tsai commented on AIRFLOW-1482: At first glance this is more likely to be a problem in

[jira] [Created] (AIRFLOW-5095) airflow.cfg merger

2019-08-01 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-5095: -- Summary: airflow.cfg merger Key: AIRFLOW-5095 URL: https://issues.apache.org/jira/browse/AIRFLOW-5095 Project: Apache Airflow Issue Type: Improvement

[jira] [Created] (AIRFLOW-5094) Make airflow conn prefix configurable

2019-08-01 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-5094: -- Summary: Make airflow conn prefix configurable Key: AIRFLOW-5094 URL: https://issues.apache.org/jira/browse/AIRFLOW-5094 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-4941) default_args not applied when dag is assigned to task through setter

2019-07-12 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4941: --- Description: When the DAG is set to the task via

[jira] [Updated] (AIRFLOW-4941) default_args not applied when dag is assigned to task through setter

2019-07-12 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4941: --- Summary: default_args not applied when dag is assigned to task through setter (was: Apply

[jira] [Created] (AIRFLOW-4941) Apply default_args when dag is assigned to task through setter

2019-07-12 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4941: -- Summary: Apply default_args when dag is assigned to task through setter Key: AIRFLOW-4941 URL: https://issues.apache.org/jira/browse/AIRFLOW-4941 Project: Apache

[jira] [Created] (AIRFLOW-4940) DynamoDB to S3 backup operator

2019-07-12 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4940: -- Summary: DynamoDB to S3 backup operator Key: AIRFLOW-4940 URL: https://issues.apache.org/jira/browse/AIRFLOW-4940 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-4915) Support backfill through Airflow UI

2019-07-08 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4915: -- Summary: Support backfill through Airflow UI Key: AIRFLOW-4915 URL: https://issues.apache.org/jira/browse/AIRFLOW-4915 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-4914) Submit backfill request through REST endpoint

2019-07-08 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4914: -- Summary: Submit backfill request through REST endpoint Key: AIRFLOW-4914 URL: https://issues.apache.org/jira/browse/AIRFLOW-4914 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4913) Backfill through scheduler

2019-07-08 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4913: -- Summary: Backfill through scheduler Key: AIRFLOW-4913 URL: https://issues.apache.org/jira/browse/AIRFLOW-4913 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-4591) Tag tasks with default pool

2019-05-29 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4591: -- Summary: Tag tasks with default pool Key: AIRFLOW-4591 URL: https://issues.apache.org/jira/browse/AIRFLOW-4591 Project: Apache Airflow Issue Type: New

[jira] [Resolved] (AIRFLOW-4535) Breaks job.py into multiple files

2019-05-23 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-4535. Resolution: Fixed > Breaks job.py into multiple files >

[jira] [Created] (AIRFLOW-4535) Breaks job.py into multiple files

2019-05-18 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4535: -- Summary: Breaks job.py into multiple files Key: AIRFLOW-4535 URL: https://issues.apache.org/jira/browse/AIRFLOW-4535 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-4509) SubDagOperator using scheduler instead of backfill

2019-05-13 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4509: -- Summary: SubDagOperator using scheduler instead of backfill Key: AIRFLOW-4509 URL: https://issues.apache.org/jira/browse/AIRFLOW-4509 Project: Apache Airflow

[jira] [Assigned] (AIRFLOW-2372) SubDAGs should share dag_concurrency of parent DAG

2019-05-05 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-2372: -- Assignee: Chao-Han Tsai > SubDAGs should share dag_concurrency of parent DAG >

[jira] [Assigned] (AIRFLOW-3653) Pausing a Dag does not pause its SubDags

2019-05-05 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-3653: -- Assignee: Chao-Han Tsai > Pausing a Dag does not pause its SubDags >

[jira] [Assigned] (AIRFLOW-1077) Subdags can deadlock

2019-05-05 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-1077: -- Assignee: Chao-Han Tsai > Subdags can deadlock > > >

[jira] [Created] (AIRFLOW-4420) Backfill respects task_concurrency

2019-04-26 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4420: -- Summary: Backfill respects task_concurrency Key: AIRFLOW-4420 URL: https://issues.apache.org/jira/browse/AIRFLOW-4420 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-4422) Stats about pool utilization

2019-04-26 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4422: -- Summary: Stats about pool utilization Key: AIRFLOW-4422 URL: https://issues.apache.org/jira/browse/AIRFLOW-4422 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-4421) task related stats should be optional

2019-04-26 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4421: -- Summary: task related stats should be optional Key: AIRFLOW-4421 URL: https://issues.apache.org/jira/browse/AIRFLOW-4421 Project: Apache Airflow Issue

[jira] [Closed] (AIRFLOW-4254) Create a Presto operator

2019-04-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-4254. -- Resolution: Won't Fix > Create a Presto operator > > >

[jira] [Assigned] (AIRFLOW-1022) Subdag can't receive templated fields

2019-04-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-1022: -- Assignee: (was: Chao-Han Tsai) > Subdag can't receive templated fields >

[jira] [Closed] (AIRFLOW-2552) Improve description for airflow backfill -c

2019-04-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-2552. -- Resolution: Won't Fix > Improve description for airflow backfill -c >

[jira] [Closed] (AIRFLOW-4190) Add instrumentation of schedule delay

2019-04-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-4190. -- Resolution: Won't Fix > Add instrumentation of schedule delay >

[jira] [Assigned] (AIRFLOW-2528) Airflow cli does not allow disabled stdin

2019-04-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-2528: -- Assignee: (was: Chao-Han Tsai) > Airflow cli does not allow disabled stdin >

[jira] [Closed] (AIRFLOW-4189) Airflow table retention

2019-04-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-4189. -- Resolution: Won't Fix > Airflow table retention > --- > >

[jira] [Commented] (AIRFLOW-4402) Update super() calls for nvd3

2019-04-23 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824823#comment-16824823 ] Chao-Han Tsai commented on AIRFLOW-4402: Hmm i have seen changes on those files. > Update

[jira] [Updated] (AIRFLOW-4402) Update super() calls for nvd3

2019-04-23 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4402: --- Description: In all classes under nvd3, replace {{super(__class__, self).__init__(...)}}

[jira] [Created] (AIRFLOW-4402) Update super() calls for nvd3

2019-04-23 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4402: -- Summary: Update super() calls for nvd3 Key: AIRFLOW-4402 URL: https://issues.apache.org/jira/browse/AIRFLOW-4402 Project: Apache Airflow Issue Type:

[jira] [Created] (AIRFLOW-4398) Extra links include try_number

2019-04-23 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4398: -- Summary: Extra links include try_number Key: AIRFLOW-4398 URL: https://issues.apache.org/jira/browse/AIRFLOW-4398 Project: Apache Airflow Issue Type:

[jira] [Assigned] (AIRFLOW-3407) BaseOperator and LoggingMixin do not call super().__init__

2019-04-22 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-3407: -- Assignee: Chao-Han Tsai > BaseOperator and LoggingMixin do not call

[jira] [Updated] (AIRFLOW-4362) Fix test_execution_limited_parallelism logic

2019-04-20 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4362: --- Description: - We should use `assertEqual` to compare two items instead of using

[jira] [Updated] (AIRFLOW-4362) Fix test_execution_limited_parallelism logic

2019-04-20 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4362: --- Description: - We should use `assertEqual` to compare two items instead of using

[jira] [Assigned] (AIRFLOW-4362) Fix test_execution_limited_parallelism logic

2019-04-20 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-4362: -- Assignee: Chao-Han Tsai > Fix test_execution_limited_parallelism logic >

[jira] [Created] (AIRFLOW-4361) Fix flaky test_integration_run_dag_with_scheduler_failure

2019-04-19 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4361: -- Summary: Fix flaky test_integration_run_dag_with_scheduler_failure Key: AIRFLOW-4361 URL: https://issues.apache.org/jira/browse/AIRFLOW-4361 Project: Apache

[jira] [Created] (AIRFLOW-4348) Add a GCP console link in BigQueryOperator

2019-04-17 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4348: -- Summary: Add a GCP console link in BigQueryOperator Key: AIRFLOW-4348 URL: https://issues.apache.org/jira/browse/AIRFLOW-4348 Project: Apache Airflow

[jira] [Resolved] (AIRFLOW-4191) Add stats about pool utilization

2019-04-14 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-4191. Resolution: Fixed > Add stats about pool utilization >

[jira] [Updated] (AIRFLOW-4307) Backfill respect concurrency limit

2019-04-14 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4307: --- Description: Currently backfill respects `pool` limit and `max_active_runs`. It is

[jira] [Created] (AIRFLOW-4307) Backfill respect concurrency limit

2019-04-13 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4307: -- Summary: Backfill respect concurrency limit Key: AIRFLOW-4307 URL: https://issues.apache.org/jira/browse/AIRFLOW-4307 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-4306) Global operator extra links

2019-04-13 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4306: -- Summary: Global operator extra links Key: AIRFLOW-4306 URL: https://issues.apache.org/jira/browse/AIRFLOW-4306 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-4303) Send email report in the end of backfill

2019-04-12 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4303: -- Summary: Send email report in the end of backfill Key: AIRFLOW-4303 URL: https://issues.apache.org/jira/browse/AIRFLOW-4303 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4254) Create a Presto operator

2019-04-07 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4254: -- Summary: Create a Presto operator Key: AIRFLOW-4254 URL: https://issues.apache.org/jira/browse/AIRFLOW-4254 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-4251) Instrument DagRun schedule delay

2019-04-05 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4251: -- Summary: Instrument DagRun schedule delay Key: AIRFLOW-4251 URL: https://issues.apache.org/jira/browse/AIRFLOW-4251 Project: Apache Airflow Issue Type:

[jira] [Assigned] (AIRFLOW-4217) Remove six package in project

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-4217: -- Assignee: Chao-Han Tsai > Remove six package in project >

[jira] [Assigned] (AIRFLOW-4215) Remove mock from the setup.py and move to internal unittest.mock

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-4215: -- Assignee: Chao-Han Tsai > Remove mock from the setup.py and move to internal

[jira] [Assigned] (AIRFLOW-4208) Replace @abstractproperty by @abstractmethod

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-4208: -- Assignee: Chao-Han Tsai > Replace @abstractproperty by @abstractmethod >

[jira] [Assigned] (AIRFLOW-4204) Update super() calls

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai reassigned AIRFLOW-4204: -- Assignee: Chao-Han Tsai > Update super() calls > - > >

[jira] [Updated] (AIRFLOW-4190) Add instrumentation of schedule delay

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4190: --- Summary: Add instrumentation of schedule delay (was: Add a schedule delay monitoring DAG)

[jira] [Updated] (AIRFLOW-4189) Airflow table retention

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4189: --- Description: Airflow scheduler cleans up records out of retention window in the Airflow

[jira] [Updated] (AIRFLOW-4189) Airflow table retention

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4189: --- Summary: Airflow table retention (was: Add an airflowdb retention DAG) > Airflow table

[jira] [Updated] (AIRFLOW-4191) Add stats about pool utilization

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4191: --- Summary: Add stats about pool utilization (was: Add a pool utilization instrument DAG) >

[jira] [Updated] (AIRFLOW-4191) Add stats about pool utilization

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4191: --- Description: Add stats about utilization of each pool (open_slots, used_slots,

[jira] [Updated] (AIRFLOW-4190) Add instrumentation of schedule delay

2019-04-02 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4190: --- Description: Measures the delay between the scheduled DAG start time (e.g.

[jira] [Updated] (AIRFLOW-4194) set dag_run state to failed when user terminate backfill

2019-03-31 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4194: --- Description: Reset dag_run state to failed if user terminate backfill. Otherwise the

[jira] [Commented] (AIRFLOW-4194) set dag_run state to failed when user terminate backfill

2019-03-31 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806071#comment-16806071 ] Chao-Han Tsai commented on AIRFLOW-4194: [~TaoFeng] I remember that you contributed something

[jira] [Created] (AIRFLOW-4194) set dag_run state to failed when user terminate backfill

2019-03-31 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4194: -- Summary: set dag_run state to failed when user terminate backfill Key: AIRFLOW-4194 URL: https://issues.apache.org/jira/browse/AIRFLOW-4194 Project: Apache

[jira] [Commented] (AIRFLOW-4190) Add a schedule delay monitoring DAG

2019-03-30 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805890#comment-16805890 ] Chao-Han Tsai commented on AIRFLOW-4190: [~TaoFeng] I am thinking that we can probably create

[jira] [Updated] (AIRFLOW-4138) [AIP] Introduce DAG manifest

2019-03-29 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4138: --- Summary: [AIP] Introduce DAG manifest (was: Introduce DAG manifest) > [AIP] Introduce DAG

[jira] [Closed] (AIRFLOW-4119) Instrument dagrun start time delay

2019-03-29 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai closed AIRFLOW-4119. -- Resolution: Won't Fix > Instrument dagrun start time delay >

[jira] [Updated] (AIRFLOW-4139) [AIP] DAG versioning

2019-03-29 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4139: --- Summary: [AIP] DAG versioning (was: DAG versioning) > [AIP] DAG versioning >

[jira] [Created] (AIRFLOW-4191) Add a pool utilization instrument DAG

2019-03-29 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4191: -- Summary: Add a pool utilization instrument DAG Key: AIRFLOW-4191 URL: https://issues.apache.org/jira/browse/AIRFLOW-4191 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-4190) Add a schedule delay monitoring DAG

2019-03-29 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4190: -- Summary: Add a schedule delay monitoring DAG Key: AIRFLOW-4190 URL: https://issues.apache.org/jira/browse/AIRFLOW-4190 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-4189) Add an airflowdb retention DAG

2019-03-29 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4189: -- Summary: Add an airflowdb retention DAG Key: AIRFLOW-4189 URL: https://issues.apache.org/jira/browse/AIRFLOW-4189 Project: Apache Airflow Issue Type:

[jira] [Resolved] (AIRFLOW-4118) Instrument dagrun duration

2019-03-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai resolved AIRFLOW-4118. Resolution: Fixed > Instrument dagrun duration > -- > >

[jira] [Updated] (AIRFLOW-4163) IntervalCheckOperator support relative difference ratio and can ignore zero

2019-03-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4163: --- Description: - IntervalCheckOperator takes max/min ratio of two values for a metric and

[jira] [Updated] (AIRFLOW-4163) IntervalCheckOperator support relative difference ratio and can ignore zero

2019-03-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4163: --- Summary: IntervalCheckOperator support relative difference ratio and can ignore zero

[jira] [Updated] (AIRFLOW-4163) IntervalCheckOperator support relative difference ratio

2019-03-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4163: --- Description: IntervalCheckOperator takes max/min ratio of two values for a metric and

[jira] [Updated] (AIRFLOW-4163) IntervalCheckOperator support relative difference ratio

2019-03-26 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4163: --- Summary: IntervalCheckOperator support relative difference ratio (was:

[jira] [Updated] (AIRFLOW-4139) DAG versioning

2019-03-22 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4139: --- Description: Currently, running DagRun will be impacted if we change the DAG file in the

[jira] [Commented] (AIRFLOW-4139) DAG versioning

2019-03-22 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799264#comment-16799264 ] Chao-Han Tsai commented on AIRFLOW-4139: I took a quick scan of

[jira] [Updated] (AIRFLOW-4139) DAG versioning

2019-03-22 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4139: --- Description: Currently, running DagRun will be impacted if we change the DAG file in the

[jira] [Updated] (AIRFLOW-4139) DAG versioning

2019-03-22 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4139: --- Description: Currently, running DagRun will be impacted if we change the DAG file in the

[jira] [Updated] (AIRFLOW-4139) DAG versioning

2019-03-22 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao-Han Tsai updated AIRFLOW-4139: --- Description: Currently, running DagRun will be impacted if we change the DAG file in the

[jira] [Commented] (AIRFLOW-4139) DAG versioning

2019-03-22 Thread Chao-Han Tsai (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799265#comment-16799265 ] Chao-Han Tsai commented on AIRFLOW-4139: I think I should better add more description as it

[jira] [Created] (AIRFLOW-4139) DAG versioning

2019-03-22 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4139: -- Summary: DAG versioning Key: AIRFLOW-4139 URL: https://issues.apache.org/jira/browse/AIRFLOW-4139 Project: Apache Airflow Issue Type: New Feature

[jira] [Created] (AIRFLOW-4138) Introduce DAG manifest

2019-03-22 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4138: -- Summary: Introduce DAG manifest Key: AIRFLOW-4138 URL: https://issues.apache.org/jira/browse/AIRFLOW-4138 Project: Apache Airflow Issue Type: New

[jira] [Created] (AIRFLOW-4119) Instrument dagrun start time delay

2019-03-18 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4119: -- Summary: Instrument dagrun start time delay Key: AIRFLOW-4119 URL: https://issues.apache.org/jira/browse/AIRFLOW-4119 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-4118) Instrument dagrun duration

2019-03-18 Thread Chao-Han Tsai (JIRA)
Chao-Han Tsai created AIRFLOW-4118: -- Summary: Instrument dagrun duration Key: AIRFLOW-4118 URL: https://issues.apache.org/jira/browse/AIRFLOW-4118 Project: Apache Airflow Issue Type: New

  1   2   >