[jira] [Created] (AIRFLOW-6013) Last heartbeat check is too precise

2019-11-18 Thread Alex (Jira)
Alex created AIRFLOW-6013: - Summary: Last heartbeat check is too precise Key: AIRFLOW-6013 URL: https://issues.apache.org/jira/browse/AIRFLOW-6013 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-6013) Last heartbeat check does not account for execution time of session.commit()

2019-11-18 Thread Alex (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex updated AIRFLOW-6013: -- Summary: Last heartbeat check does not account for execution time of session.commit() (was: Last heartbeat

[jira] [Created] (AIRFLOW-6014) Kubernetes executor - handle preempted deleted pods - queued tasks

2019-11-19 Thread afusr (Jira)
afusr created AIRFLOW-6014: -- Summary: Kubernetes executor - handle preempted deleted pods - queued tasks Key: AIRFLOW-6014 URL: https://issues.apache.org/jira/browse/AIRFLOW-6014 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6014) Kubernetes executor - handle preempted deleted pods - queued tasks

2019-11-19 Thread afusr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] afusr updated AIRFLOW-6014: --- Description: We have encountered an issue whereby when using the kubernetes executor, and using

[jira] [Commented] (AIRFLOW-6014) Kubernetes executor - handle preempted deleted pods - queued tasks

2019-11-19 Thread afusr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977392#comment-16977392 ] afusr commented on AIRFLOW-6014: The following PR has been raised as a temp to res

[jira] [Commented] (AIRFLOW-5060) Add support of CatalogId to AwsGlueCatalogHook

2019-11-19 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977628#comment-16977628 ] jack commented on AIRFLOW-5060: --- [~ash] any thoughts? > Add support of Catal

[jira] [Updated] (AIRFLOW-6014) Kubernetes executor - handle preempted deleted pods - queued tasks

2019-11-19 Thread afusr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] afusr updated AIRFLOW-6014: --- Description: We have encountered an issue whereby when using the kubernetes executor, and using

[jira] [Commented] (AIRFLOW-6014) Kubernetes executor - handle preempted deleted pods - queued tasks

2019-11-19 Thread afusr (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978151#comment-16978151 ] afusr commented on AIRFLOW-6014: I've created a PR which should catch thes

[jira] [Commented] (AIRFLOW-578) BaseJob does not check return code of a process

2019-11-19 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978161#comment-16978161 ] jack commented on AIRFLOW-578: -- [~lucafuji] are you still working on it? > BaseJ

[jira] [Updated] (AIRFLOW-4578) Set Container for Logs to Azure Blob Storage

2019-11-20 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated AIRFLOW-4578: Description: Currently it is possible to set the container that the logs to azure are written to when

[jira] [Issue Comment Deleted] (AIRFLOW-4938) next_execution_date is not a Pendulum object

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4938: -- Comment: was deleted (was: Related/duplicate to/of : https://issues.apache.org/jira/browse/AIRFLOW-4788

[jira] [Commented] (AIRFLOW-4938) next_execution_date is not a Pendulum object

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979371#comment-16979371 ] jack commented on AIRFLOW-4938: --- Was fixed in 1.10.4: https://issues.apache.org/

[jira] [Commented] (AIRFLOW-3185) Add chunking to DBAPI_hook by implementing fetchmany and pandas chunksize

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979489#comment-16979489 ] jack commented on AIRFLOW-3185: --- [~tomanizer] do you have a final version to PR? &

[jira] [Commented] (AIRFLOW-1717) AttributeError while clicking on dag on webUI

2019-11-21 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979495#comment-16979495 ] jack commented on AIRFLOW-1717: --- Had many releases since 1.8 clicking on DAG in th

[jira] [Commented] (AIRFLOW-6040) Airflow scheduler with kubernetes executor fails :- Unknown error in KubernetesJobWatcher

2019-11-22 Thread Max (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16980186#comment-16980186 ] Max commented on AIRFLOW-6040: -- We ran into this same issue. I believe this is actu

[jira] [Comment Edited] (AIRFLOW-6040) Airflow scheduler with kubernetes executor fails :- Unknown error in KubernetesJobWatcher

2019-11-22 Thread Max (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16980186#comment-16980186 ] Max edited comment on AIRFLOW-6040 at 11/22/19 7:15 PM: We

[jira] [Created] (AIRFLOW-6050) Missing an argument `null_marker` in GoogleCloudStorageToBigQueryOperator

2019-11-23 Thread gecko655 (Jira)
gecko655 created AIRFLOW-6050: - Summary: Missing an argument `null_marker` in GoogleCloudStorageToBigQueryOperator Key: AIRFLOW-6050 URL: https://issues.apache.org/jira/browse/AIRFLOW-6050 Project

[jira] [Commented] (AIRFLOW-6050) Missing an argument `null_marker` in GoogleCloudStorageToBigQueryOperator

2019-11-23 Thread gecko655 (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16980715#comment-16980715 ] gecko655 commented on AIRFLOW-6050: --- Uh... I found that I can use `null_ma

[jira] [Closed] (AIRFLOW-6050) Missing an argument `null_marker` in GoogleCloudStorageToBigQueryOperator

2019-11-23 Thread gecko655 (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gecko655 closed AIRFLOW-6050. - Resolution: Not A Problem > Missing an argument `null_marker` in GoogleCloudStorageToBigQueryOpera

[jira] [Created] (AIRFLOW-6067) [Airflow] pod_runtime_info_envs doesn't apply PodRuntimeInfoEnv class

2019-11-25 Thread JungraeKim (Jira)
JungraeKim created AIRFLOW-6067: --- Summary: [Airflow] pod_runtime_info_envs doesn't apply PodRuntimeInfoEnv class Key: AIRFLOW-6067 URL: https://issues.apache.org/jira/browse/AIRFLOW-6067 Pr

[jira] [Commented] (AIRFLOW-6067) [Airflow] pod_runtime_info_envs doesn't apply PodRuntimeInfoEnv class

2019-11-25 Thread JungraeKim (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982223#comment-16982223 ] JungraeKim commented on AIRFLOW-6067: - Closed by https://issues.apache.org/

[jira] [Created] (AIRFLOW-6068) [Airflow] Set coherence of KubernetesPodOperator args's behavior

2019-11-25 Thread JungraeKim (Jira)
JungraeKim created AIRFLOW-6068: --- Summary: [Airflow] Set coherence of KubernetesPodOperator args's behavior Key: AIRFLOW-6068 URL: https://issues.apache.org/jira/browse/AIRFLOW-6068 Project: A

[jira] [Closed] (AIRFLOW-6067) [Airflow] pod_runtime_info_envs doesn't apply PodRuntimeInfoEnv class

2019-11-25 Thread JungraeKim (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JungraeKim closed AIRFLOW-6067. --- Resolution: Incomplete > [Airflow] pod_runtime_info_envs doesn't apply PodRuntimeInfoE

[jira] [Updated] (AIRFLOW-6068) [Airflow] Set coherence of KubernetesPodOperator args's behavior

2019-11-26 Thread JungraeKim (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JungraeKim updated AIRFLOW-6068: Priority: Minor (was: Major) > [Airflow] Set coherence of KubernetesPodOperator args's

[jira] [Updated] (AIRFLOW-6068) [Airflow] Set coherence of KubernetesPodOperator args's behavior

2019-11-26 Thread JungraeKim (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JungraeKim updated AIRFLOW-6068: Issue Type: Wish (was: Bug) > [Airflow] Set coherence of KubernetesPodOperator args's

[jira] [Commented] (AIRFLOW-6067) [Airflow] pod_runtime_info_envs doesn't apply PodRuntimeInfoEnv class

2019-11-26 Thread JungraeKim (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982239#comment-16982239 ] JungraeKim commented on AIRFLOW-6067: - I didn't catch Optional in mast

[jira] [Updated] (AIRFLOW-6068) [Airflow] Set coherence of KubernetesPodOperator args's behavior

2019-11-26 Thread JungraeKim (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JungraeKim updated AIRFLOW-6068: Description: There are many class used by KubernetesPodOperator. - Port - Resource

[jira] [Updated] (AIRFLOW-6416) [AIRFLOW-6416] Sort default connection by conn_id

2020-01-01 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhongjiajie updated AIRFLOW-6416: - Summary: [AIRFLOW-6416] Sort default connection by conn_id (was: Remove DB provide_session

[jira] [Updated] (AIRFLOW-6416) [AIRFLOW-6416] Sort default connection by conn_id

2020-01-01 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhongjiajie updated AIRFLOW-6416: - Description: Sort default connection by conn_id * Sort create_default_connections by

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-01 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006528#comment-17006528 ] Zhidong commented on AIRFLOW-2516: -- Great work [~potiuk], I'll be testing it

[jira] [Created] (AIRFLOW-6422) Command line -D not working

2020-01-01 Thread xifeng (Jira)
xifeng created AIRFLOW-6422: --- Summary: Command line -D not working Key: AIRFLOW-6422 URL: https://issues.apache.org/jira/browse/AIRFLOW-6422 Project: Apache Airflow Issue Type: Bug

[jira] [Created] (AIRFLOW-6423) error messege

2020-01-01 Thread limseohyun (Jira)
limseohyun created AIRFLOW-6423: --- Summary: error messege Key: AIRFLOW-6423 URL: https://issues.apache.org/jira/browse/AIRFLOW-6423 Project: Apache Airflow Issue Type: Bug Components

[jira] [Comment Edited] (AIRFLOW-6422) Command line -D not working

2020-01-01 Thread xifeng (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006550#comment-17006550 ] xifeng edited comment on AIRFLOW-6422 at 1/2/20 3:1

[jira] [Commented] (AIRFLOW-6422) Command line -D not working

2020-01-01 Thread xifeng (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006550#comment-17006550 ] xifeng commented on AIRFLOW-6422: - Related to this https://stackoverflow.com/quest

[jira] [Updated] (AIRFLOW-6404) Add ANSI color support

2020-01-02 Thread ohad (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ohad updated AIRFLOW-6404: -- Description: Add ANSI color support in order to present colored logs in the airflow webUI {code:java} ESC

[jira] [Created] (AIRFLOW-6424) Creating a new Airflow operator to modify an existing EMR cluster.

2020-01-02 Thread Gavin (Jira)
Gavin created AIRFLOW-6424: -- Summary: Creating a new Airflow operator to modify an existing EMR cluster. Key: AIRFLOW-6424 URL: https://issues.apache.org/jira/browse/AIRFLOW-6424 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6424) Creating a new Airflow operator to modify an existing EMR cluster.

2020-01-02 Thread Gavin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gavin updated AIRFLOW-6424: --- Description: Airflow does not have an operator to change the properties of or modify an existing EMR

[jira] [Created] (AIRFLOW-6429) Add SalesForce connection to UI

2020-01-02 Thread Elad (Jira)
Elad created AIRFLOW-6429: - Summary: Add SalesForce connection to UI Key: AIRFLOW-6429 URL: https://issues.apache.org/jira/browse/AIRFLOW-6429 Project: Apache Airflow Issue Type: Improvement

[jira] [Created] (AIRFLOW-6431) docker operator and xcom

2020-01-02 Thread Harish (Jira)
Harish created AIRFLOW-6431: --- Summary: docker operator and xcom Key: AIRFLOW-6431 URL: https://issues.apache.org/jira/browse/AIRFLOW-6431 Project: Apache Airflow Issue Type: Bug

[jira] [Updated] (AIRFLOW-6431) docker operator and xcom

2020-01-02 Thread Harish (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish updated AIRFLOW-6431: Description: airflow with celery executor. a DockerOprator task that runs [the hello-world docker

[jira] [Updated] (AIRFLOW-6431) docker operator and xcom

2020-01-02 Thread Harish (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish updated AIRFLOW-6431: Description: airflow with celery executor. a DockerOprator task that runs [the hello-world docker

[jira] [Updated] (AIRFLOW-6431) docker operator and xcom

2020-01-02 Thread Harish (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish updated AIRFLOW-6431: Description: airflow with celery executor. a DockerOprator task that runs [the hello-world docker

[jira] [Commented] (AIRFLOW-6431) docker operator and xcom

2020-01-03 Thread Harish (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007696#comment-17007696 ] Harish commented on AIRFLOW-6431: - i can confirm if the fix addresses the issu

[jira] [Comment Edited] (AIRFLOW-6431) docker operator and xcom

2020-01-03 Thread Harish (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007696#comment-17007696 ] Harish edited comment on AIRFLOW-6431 at 1/3/20 8:49 PM:

[jira] [Created] (AIRFLOW-6457) Enhanced rest api for e2e tests

2020-01-04 Thread Valerii (Jira)
Valerii created AIRFLOW-6457: Summary: Enhanced rest api for e2e tests Key: AIRFLOW-6457 URL: https://issues.apache.org/jira/browse/AIRFLOW-6457 Project: Apache Airflow Issue Type: Improvement

[jira] [Commented] (AIRFLOW-884) SlackAPIPostOperator works inconsistently across two DAGs / Python scripts.

2020-01-04 Thread sophie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008240#comment-17008240 ] sophie commented on AIRFLOW-884: excuse me , have u found the cause ? And where is

[jira] [Commented] (AIRFLOW-522) Version issue when running CLI on master (after running python setup.py develop)

2020-01-04 Thread sophie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008246#comment-17008246 ] sophie commented on AIRFLOW-522: What`s your fresh workaround , can u specify

[jira] [Assigned] (AIRFLOW-6472) Some of the options we have are long options with single -

2020-01-05 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhongjiajie reassigned AIRFLOW-6472: Assignee: zhongjiajie > Some of the options we have are long options with sin

[jira] [Commented] (AIRFLOW-6472) Some of the options we have are long options with single -

2020-01-06 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008993#comment-17008993 ] zhongjiajie commented on AIRFLOW-6472: -- If you don't mind, I will create

[jira] [Assigned] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-06 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhidong reassigned AIRFLOW-2516: Assignee: Zhidong > Deadlock found when trying to update task_instance ta

[jira] [Assigned] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-06 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhidong reassigned AIRFLOW-2516: Assignee: Jarek Potiuk (was: Zhidong) > Deadlock found when trying to update task_insta

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-06 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009281#comment-17009281 ] Zhidong commented on AIRFLOW-2516: -- Hi [~potiuk], no new deadlock observed since

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-07 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009588#comment-17009588 ] Zhidong commented on AIRFLOW-2516: -- It says *SELECT ... FOR UPDATE* locks rows

[jira] [Created] (AIRFLOW-6499) WebUI logger - Auto reload

2020-01-07 Thread ohad (Jira)
ohad created AIRFLOW-6499: - Summary: WebUI logger - Auto reload Key: AIRFLOW-6499 URL: https://issues.apache.org/jira/browse/AIRFLOW-6499 Project: Apache Airflow Issue Type: New Feature

[jira] [Updated] (AIRFLOW-6499) WebUI logger - AJAX Auto reload

2020-01-07 Thread ohad (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ohad updated AIRFLOW-6499: -- Summary: WebUI logger - AJAX Auto reload (was: WebUI logger - Auto reload ) > WebUI logger - AJAX A

[jira] [Created] (AIRFLOW-6502) Support swarm networks in DockerSwarmOperator

2020-01-07 Thread Arseniy (Jira)
Arseniy created AIRFLOW-6502: Summary: Support swarm networks in DockerSwarmOperator Key: AIRFLOW-6502 URL: https://issues.apache.org/jira/browse/AIRFLOW-6502 Project: Apache Airflow Issue Type

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-07 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010233#comment-17010233 ] Zhidong commented on AIRFLOW-2516: -- The execution plans for *SELECT ... WHERE

[jira] [Commented] (AIRFLOW-5881) Dag gets stuck in "Scheduled" State when scheduling a large number of tasks

2020-01-10 Thread Nidhi (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013160#comment-17013160 ] Nidhi commented on AIRFLOW-5881: One of the solution to this problem is to switch

[jira] [Closed] (AIRFLOW-6264) Airflow not scheduling tasks after staying in Running state

2020-01-10 Thread Nidhi (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nidhi closed AIRFLOW-6264. -- Resolution: Fixed > Airflow not scheduling tasks after staying in Running st

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-12 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013946#comment-17013946 ] Zhidong commented on AIRFLOW-2516: -- No deadlock for 9 days, I will apply the patc

[jira] [Commented] (AIRFLOW-4209) Replace imp by importlib

2020-01-15 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015822#comment-17015822 ] zhongjiajie commented on AIRFLOW-4209: -- [~fokko] I could not close this ti

[jira] [Commented] (AIRFLOW-4375) Replace airflow.utils.file.TemporaryDirectory by native tempfile.TemporaryDirectory

2020-01-15 Thread zhongjiajie (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015828#comment-17015828 ] zhongjiajie commented on AIRFLOW-4375: -- [~basph] [~kaxilnaik] This ticke

[jira] [Created] (AIRFLOW-6570) Add dag tag for all example dag

2020-01-15 Thread zhongjiajie (Jira)
zhongjiajie created AIRFLOW-6570: Summary: Add dag tag for all example dag Key: AIRFLOW-6570 URL: https://issues.apache.org/jira/browse/AIRFLOW-6570 Project: Apache Airflow Issue Type

[jira] [Created] (AIRFLOW-6580) Killing or marking a task does not kill the Pod in the backend

2020-01-16 Thread Ram (Jira)
Ram created AIRFLOW-6580: Summary: Killing or marking a task does not kill the Pod in the backend Key: AIRFLOW-6580 URL: https://issues.apache.org/jira/browse/AIRFLOW-6580 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6580) Killing or marking a task as failed does not kill the Pod in the backend

2020-01-16 Thread Ram (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram updated AIRFLOW-6580: - Summary: Killing or marking a task as failed does not kill the Pod in the backend (was: Killing or marking a

[jira] [Created] (AIRFLOW-6581) Capture Pod details when using KubernetesPodOperator

2020-01-16 Thread Ram (Jira)
Ram created AIRFLOW-6581: Summary: Capture Pod details when using KubernetesPodOperator Key: AIRFLOW-6581 URL: https://issues.apache.org/jira/browse/AIRFLOW-6581 Project: Apache Airflow Issue Type

[jira] [Created] (AIRFLOW-6587) Docker opretaor to support PID mode

2020-01-17 Thread Harish (Jira)
Harish created AIRFLOW-6587: --- Summary: Docker opretaor to support PID mode Key: AIRFLOW-6587 URL: https://issues.apache.org/jira/browse/AIRFLOW-6587 Project: Apache Airflow Issue Type

[jira] [Updated] (AIRFLOW-6587) Docker operator to support PID mode

2020-01-18 Thread Harish (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish updated AIRFLOW-6587: Summary: Docker operator to support PID mode (was: Docker opretaor to support PID mode) > Doc

[jira] [Closed] (AIRFLOW-5397) upsteam_failed is missing from Graph/Tree Views

2020-01-19 Thread Elad (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elad closed AIRFLOW-5397. - Resolution: Duplicate I planed to fix it but I see that this was already fixed in  [https://github.com/apache

[jira] [Commented] (AIRFLOW-5328) EmrCreateJobFlowOperator success when EMR isn't ready

2020-01-19 Thread Elad (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018906#comment-17018906 ] Elad commented on AIRFLOW-5328: --- the sensor was modified to support all states [h

[jira] [Closed] (AIRFLOW-5328) EmrCreateJobFlowOperator success when EMR isn't ready

2020-01-19 Thread Elad (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elad closed AIRFLOW-5328. - Resolution: Duplicate > EmrCreateJobFlowOperator success when EMR isn'

[jira] [Created] (AIRFLOW-6606) dataflow operator task ID doesn't utilize UUID

2020-01-20 Thread Leah (Jira)
Leah created AIRFLOW-6606: - Summary: dataflow operator task ID doesn't utilize UUID Key: AIRFLOW-6606 URL: https://issues.apache.org/jira/browse/AIRFLOW-6606 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-20 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019874#comment-17019874 ] Zhidong commented on AIRFLOW-2516: -- Hi [~potiuk], bad

[jira] [Commented] (AIRFLOW-2516) Deadlock found when trying to update task_instance table

2020-01-21 Thread Zhidong (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020724#comment-17020724 ] Zhidong commented on AIRFLOW-2516: -- Mysql general log                   43848

[jira] [Assigned] (AIRFLOW-5974) Change import paths for "celery" modules

2020-01-21 Thread Anonymous (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anonymous reassigned AIRFLOW-5974: -- Assignee: (was: Yu Qian) > Change import paths for "celery&

[jira] [Commented] (AIRFLOW-5221) Add host alias support to the KubernetesPodOperator

2020-01-26 Thread kuromt (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024082#comment-17024082 ] kuromt commented on AIRFLOW-5221: - Hi, [~d_mink99] Can I help this improvement?

[jira] [Created] (AIRFLOW-6649) Google storage to Snowflake

2020-01-27 Thread nexoriv (Jira)
nexoriv created AIRFLOW-6649: Summary: Google storage to Snowflake Key: AIRFLOW-6649 URL: https://issues.apache.org/jira/browse/AIRFLOW-6649 Project: Apache Airflow Issue Type: New Feature

[jira] [Commented] (AIRFLOW-6163) BaseSensorOperator with soft_fail=True does not take into account downstream trigger_rule

2020-01-29 Thread Jared (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17026020#comment-17026020 ] Jared commented on AIRFLOW-6163: This is an issue for us too (we're on 1.1

[jira] [Commented] (AIRFLOW-6163) BaseSensorOperator with soft_fail=True does not take into account downstream trigger_rule

2020-01-29 Thread Jared (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17026081#comment-17026081 ] Jared commented on AIRFLOW-6163: Turns out this is intended behavior (althou

[jira] [Assigned] (AIRFLOW-5221) Add host alias support to the KubernetesPodOperator

2020-01-29 Thread kuromt (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kuromt reassigned AIRFLOW-5221: --- Assignee: kuromt (was: Derrick Mink) > Add host alias support to the KubernetesPodOpera

[jira] [Commented] (AIRFLOW-5221) Add host alias support to the KubernetesPodOperator

2020-01-29 Thread kuromt (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17026463#comment-17026463 ] kuromt commented on AIRFLOW-5221: - There is no response, so I am going to work on

[jira] [Assigned] (AIRFLOW-3488) PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL ARRAYs properly

2020-01-31 Thread Nicolas (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas reassigned AIRFLOW-3488: Assignee: Nicolas > PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQ

[jira] [Commented] (AIRFLOW-3488) PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL ARRAYs properly

2020-01-31 Thread Nicolas (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17027445#comment-17027445 ] Nicolas commented on AIRFLOW-3488: -- I've done the fix on a local branch, ho

[jira] [Created] (AIRFLOW-4314) List task Instance search for with state None

2019-04-14 Thread zhongjiajie (JIRA)
zhongjiajie created AIRFLOW-4314: Summary: List task Instance search for with state None Key: AIRFLOW-4314 URL: https://issues.apache.org/jira/browse/AIRFLOW-4314 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-3140) Add MongoDBToGoogleStorage Opearator

2019-04-14 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3140: -- Component/s: operators gcp Issue Type: Wish (was: Task) > Add MongoDBToGoogleStor

[jira] [Updated] (AIRFLOW-4314) List task Instance search for with state None

2019-04-15 Thread zhongjiajie (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhongjiajie updated AIRFLOW-4314: - Description: In the *List Task Instance* UI view, we could not search task with state `None

[jira] [Created] (AIRFLOW-4317) Add operator to update BigQuery table experationtime

2019-04-15 Thread jack (JIRA)
jack created AIRFLOW-4317: - Summary: Add operator to update BigQuery table experationtime Key: AIRFLOW-4317 URL: https://issues.apache.org/jira/browse/AIRFLOW-4317 Project: Apache Airflow Issue Type

[jira] [Closed] (AIRFLOW-4317) Add operator to update BigQuery table experationtime

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-4317. - Resolution: Invalid No need for this. [https://cloud.google.com/bigquery/docs/reference/standard-sql/data

[jira] [Commented] (AIRFLOW-3163) Add set table description operator to BigQuery operators

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16817922#comment-16817922 ] jack commented on AIRFLOW-3163: --- This no longer needed. Google introduced ALTER T

[jira] [Commented] (AIRFLOW-4017) query_params unable to pass value to SQL statement

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818692#comment-16818692 ] jack commented on AIRFLOW-4017: --- You are probably doing something wrong. Please

[jira] [Updated] (AIRFLOW-2925) gcp dataflow hook doesn't show traceback

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2925: -- Component/s: hooks gcp > gcp dataflow hook doesn't show t

[jira] [Updated] (AIRFLOW-3804) MySqlToGoogleCloudStorageOperator success when it should fail

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3804: -- Flags: (was: Important) Fix Version/s: 1.10.4 Component/s: operators

[jira] [Closed] (AIRFLOW-3269) mysql_hook replace depricated lib MySQLdb with PyMySQL

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-3269. - Resolution: Invalid > mysql_hook replace depricated lib MySQLdb with PyMy

[jira] [Updated] (AIRFLOW-3057) add macros that see only successful dags

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3057: -- Priority: Minor (was: Major) Fix Version/s: 1.10.4 Issue Type: Wish (was: Task) >

[jira] [Updated] (AIRFLOW-4195) Add Scylla hook

2019-04-15 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4195: -- Component/s: hooks contrib > Add Scylla hook > --- > >

[jira] [Created] (AIRFLOW-4329) DAG processsing speed is too slow

2019-04-16 Thread xushikun (JIRA)
xushikun created AIRFLOW-4329: - Summary: DAG processsing speed is too slow Key: AIRFLOW-4329 URL: https://issues.apache.org/jira/browse/AIRFLOW-4329 Project: Apache Airflow Issue Type

[jira] [Resolved] (AIRFLOW-4236) Operators uploading to GCS needs to handle googleapiclient.errors

2019-04-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack resolved AIRFLOW-4236. --- Resolution: Duplicate Will be fixed in https://issues.apache.org/jira/browse/AIRFLOW-4335 > Operat

[jira] [Updated] (AIRFLOW-4336) GoogleCloudStorageDownloadOperator allow not to save file to log

2019-04-16 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4336: -- Description: The operator has  {code:java} store_to_xcom_key {code} flag which allow the user to deiced if

[jira] [Created] (AIRFLOW-4336) GoogleCloudStorageDownloadOperator allow not to save file to log

2019-04-17 Thread jack (JIRA)
jack created AIRFLOW-4336: - Summary: GoogleCloudStorageDownloadOperator allow not to save file to log Key: AIRFLOW-4336 URL: https://issues.apache.org/jira/browse/AIRFLOW-4336 Project: Apache Airflow

[jira] [Created] (AIRFLOW-4339) Cleared backfill tasks do not get picked by the scheduler

2019-04-17 Thread Ignas (JIRA)
Ignas created AIRFLOW-4339: -- Summary: Cleared backfill tasks do not get picked by the scheduler Key: AIRFLOW-4339 URL: https://issues.apache.org/jira/browse/AIRFLOW-4339 Project: Apache Airflow

<    1   2   3   4   5   6   7   8   9   10   >