[jira] [Closed] (AIRFLOW-907) Ability to clear all task_instances for a dagrun in the UI
[ https://issues.apache.org/jira/browse/AIRFLOW-907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov closed AIRFLOW-907. --- Resolution: Duplicate > Ability to clear all task_instances for a dagrun in the UI > -- > > Key: AIRFLOW-907 > URL: https://issues.apache.org/jira/browse/AIRFLOW-907 > Project: Apache Airflow > Issue Type: New Feature > Components: webserver >Reporter: Dan Davydov > > Clicking the dagrun circle in the Airflow UI should provide an option to > clear all task_instances for that dagrun (or go to the dagrun's state as is > the current implementation). At Airbnb a lot of users resort to creating a > top-level task so that they can clear using that which isn't great. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AIRFLOW-908) Airflow run should print worker name at top of log
[ https://issues.apache.org/jira/browse/AIRFLOW-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Davydov updated AIRFLOW-908: Description: Airflow run should log the worker hostname at top of log. (was: Airflow run should print the worker hostname at top of log.) > Airflow run should print worker name at top of log > -- > > Key: AIRFLOW-908 > URL: https://issues.apache.org/jira/browse/AIRFLOW-908 > Project: Apache Airflow > Issue Type: New Feature >Reporter: Dan Davydov > Labels: beginner, starter > > Airflow run should log the worker hostname at top of log. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (AIRFLOW-1165) airflow webservice crashes on ubuntu16 - python3
[
https://issues.apache.org/jira/browse/AIRFLOW-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arthur Wiedmer reassigned AIRFLOW-1165:
---
Assignee: Arthur Wiedmer
> airflow webservice crashes on ubuntu16 - python3
> -
>
> Key: AIRFLOW-1165
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1165
> Project: Apache Airflow
> Issue Type: Bug
>Reporter: Hamed
>Assignee: Arthur Wiedmer
> Fix For: 1.8.1
>
>
> I am trying to run airflow webserver on ubuntu16, python3 and ran to this
> issue. Any idea?
> {code}
> [2017-05-02 16:36:34,789] [24096] {_internal.py:87} WARNING - * Debugger is
> active!
> [2017-05-02 16:36:34,790] [24096] {_internal.py:87} INFO - * Debugger PIN:
> 294-518-137
> Exception in thread Thread-1:
> Traceback (most recent call last):
> File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
> self.run()
> File "/usr/lib/python3.5/threading.py", line 862, in run
> self._target(*self._args, **self._kwargs)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 696, in inner
> fd=fd)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 590, in make_server
> passthrough_errors, ssl_context, fd=fd)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 525, in __init__
> self.socket = ssl_context.wrap_socket(sock, server_side=True)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 447, in wrap_socket
> ssl_version=self._protocol, **kwargs)
> File "/usr/lib/python3.5/ssl.py", line 1069, in wrap_socket
> ciphers=ciphers)
> File "/usr/lib/python3.5/ssl.py", line 680, in __init__
> raise ValueError("certfile must be specified for server-side "
> ValueError: certfile must be specified for server-side operations
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Resolved] (AIRFLOW-1165) airflow webservice crashes on ubuntu16 - python3
[
https://issues.apache.org/jira/browse/AIRFLOW-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arthur Wiedmer resolved AIRFLOW-1165.
-
Resolution: Fixed
Fix Version/s: 1.8.1
Resolved in master and the fix is in the current RC being voted on.
> airflow webservice crashes on ubuntu16 - python3
> -
>
> Key: AIRFLOW-1165
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1165
> Project: Apache Airflow
> Issue Type: Bug
>Reporter: Hamed
> Fix For: 1.8.1
>
>
> I am trying to run airflow webserver on ubuntu16, python3 and ran to this
> issue. Any idea?
> {code}
> [2017-05-02 16:36:34,789] [24096] {_internal.py:87} WARNING - * Debugger is
> active!
> [2017-05-02 16:36:34,790] [24096] {_internal.py:87} INFO - * Debugger PIN:
> 294-518-137
> Exception in thread Thread-1:
> Traceback (most recent call last):
> File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
> self.run()
> File "/usr/lib/python3.5/threading.py", line 862, in run
> self._target(*self._args, **self._kwargs)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 696, in inner
> fd=fd)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 590, in make_server
> passthrough_errors, ssl_context, fd=fd)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 525, in __init__
> self.socket = ssl_context.wrap_socket(sock, server_side=True)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 447, in wrap_socket
> ssl_version=self._protocol, **kwargs)
> File "/usr/lib/python3.5/ssl.py", line 1069, in wrap_socket
> ciphers=ciphers)
> File "/usr/lib/python3.5/ssl.py", line 680, in __init__
> raise ValueError("certfile must be specified for server-side "
> ValueError: certfile must be specified for server-side operations
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (AIRFLOW-1165) airflow webservice crashes on ubuntu16 - python3
[
https://issues.apache.org/jira/browse/AIRFLOW-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993681#comment-15993681
]
Arthur Wiedmer commented on AIRFLOW-1165:
-
This is a duplicate of https://issues.apache.org/jira/browse/AIRFLOW-832
It is fixed in the current master, and will be fixed in the next release.
The short term fix is the commands outlined here:
http://stackoverflow.com/a/40857607
> airflow webservice crashes on ubuntu16 - python3
> -
>
> Key: AIRFLOW-1165
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1165
> Project: Apache Airflow
> Issue Type: Bug
>Reporter: Hamed
>
> I am trying to run airflow webserver on ubuntu16, python3 and ran to this
> issue. Any idea?
> {code}
> [2017-05-02 16:36:34,789] [24096] {_internal.py:87} WARNING - * Debugger is
> active!
> [2017-05-02 16:36:34,790] [24096] {_internal.py:87} INFO - * Debugger PIN:
> 294-518-137
> Exception in thread Thread-1:
> Traceback (most recent call last):
> File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
> self.run()
> File "/usr/lib/python3.5/threading.py", line 862, in run
> self._target(*self._args, **self._kwargs)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 696, in inner
> fd=fd)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 590, in make_server
> passthrough_errors, ssl_context, fd=fd)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 525, in __init__
> self.socket = ssl_context.wrap_socket(sock, server_side=True)
> File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line
> 447, in wrap_socket
> ssl_version=self._protocol, **kwargs)
> File "/usr/lib/python3.5/ssl.py", line 1069, in wrap_socket
> ciphers=ciphers)
> File "/usr/lib/python3.5/ssl.py", line 680, in __init__
> raise ValueError("certfile must be specified for server-side "
> ValueError: certfile must be specified for server-side operations
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (AIRFLOW-1166) _change_state_for_tis_without_dagrun can take very long and end up in deadlocks
[ https://issues.apache.org/jira/browse/AIRFLOW-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993659#comment-15993659 ] Bolke de Bruin commented on AIRFLOW-1166: - [~saguziel] [~aoen] you probably want to be aware of this as it might turn up in single scheduler setups as well and besides the delay is significant. > _change_state_for_tis_without_dagrun can take very long and end up in > deadlocks > --- > > Key: AIRFLOW-1166 > URL: https://issues.apache.org/jira/browse/AIRFLOW-1166 > Project: Apache Airflow > Issue Type: Bug >Affects Versions: 1.8.1 >Reporter: Bolke de Bruin >Assignee: Bolke de Bruin > Labels: scheduler > Fix For: 1.8.2 > > > While testing multi-scheduler setups we've seen some serious delays (>8s, > with just one dag running) in _change_state_for_tis_without_dagrun. This can > also result in deadlocks in the db due to the fact the query in > _change_state_for_tis_without_dagrun is locking a significant amount of task > instances. This is unnecessary. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AIRFLOW-1166) _change_state_for_tis_without_dagrun can take very long and end up in deadlocks
Bolke de Bruin created AIRFLOW-1166: --- Summary: _change_state_for_tis_without_dagrun can take very long and end up in deadlocks Key: AIRFLOW-1166 URL: https://issues.apache.org/jira/browse/AIRFLOW-1166 Project: Apache Airflow Issue Type: Bug Affects Versions: 1.8.1 Reporter: Bolke de Bruin Assignee: Bolke de Bruin Fix For: 1.8.2 While testing multi-scheduler setups we've seen some serious delays (>8s, with just one dag running) in _change_state_for_tis_without_dagrun. This can also result in deadlocks in the db due to the fact the query in _change_state_for_tis_without_dagrun is locking a significant amount of task instances. This is unnecessary. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AIRFLOW-1165) airflow webservice crashes on ubuntu16 - python3
Hamed created AIRFLOW-1165:
--
Summary: airflow webservice crashes on ubuntu16 - python3
Key: AIRFLOW-1165
URL: https://issues.apache.org/jira/browse/AIRFLOW-1165
Project: Apache Airflow
Issue Type: Bug
Reporter: Hamed
I am trying to run airflow webserver on ubuntu16, python3 and ran to this
issue. Any idea?
{code}
[2017-05-02 16:36:34,789] [24096] {_internal.py:87} WARNING - * Debugger is
active!
[2017-05-02 16:36:34,790] [24096] {_internal.py:87} INFO - * Debugger PIN:
294-518-137
Exception in thread Thread-1:
Traceback (most recent call last):
File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
self.run()
File "/usr/lib/python3.5/threading.py", line 862, in run
self._target(*self._args, **self._kwargs)
File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line 696,
in inner
fd=fd)
File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line 590,
in make_server
passthrough_errors, ssl_context, fd=fd)
File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line 525,
in __init__
self.socket = ssl_context.wrap_socket(sock, server_side=True)
File "/usr/local/lib/python3.5/dist-packages/werkzeug/serving.py", line 447,
in wrap_socket
ssl_version=self._protocol, **kwargs)
File "/usr/lib/python3.5/ssl.py", line 1069, in wrap_socket
ciphers=ciphers)
File "/usr/lib/python3.5/ssl.py", line 680, in __init__
raise ValueError("certfile must be specified for server-side "
ValueError: certfile must be specified for server-side operations
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Comment Edited] (AIRFLOW-1137) Problem installing [all] subpackages python3
[
https://issues.apache.org/jira/browse/AIRFLOW-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992843#comment-15992843
]
Hamed edited comment on AIRFLOW-1137 at 5/2/17 2:17 PM:
thanks. yeah I saw that.
I would imagine it is a bug that stops other packages getting installed.
was (Author: hamedhsn):
thanks. yeah I saw that.
I would imagine it is a bug that stops other packages to get installed.
> Problem installing [all] subpackages python3
>
>
> Key: AIRFLOW-1137
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1137
> Project: Apache Airflow
> Issue Type: Bug
>Reporter: Hamed
>Priority: Minor
>
> I am installing all packages for airflow in python3 using:
> {noformat}pip3 install 'airflow[all]'{noformat} but it throws me the
> following error:
> {code:xml}
> Collecting cx_Oracle>=5.1.2 (from airflow[all])
> Downloading cx_Oracle-5.3.tar.gz (129kB)
> 100% || 133kB 5.9MB/s
> Complete output from command python setup.py egg_info:
> Traceback (most recent call last):
> File "", line 1, in
> File "/private/tmp/pip-build-5re1trj4/cx-Oracle/setup.py", line 174, in
>
> raise DistutilsSetupError("cannot locate an Oracle software " \
> distutils.errors.DistutilsSetupError: cannot locate an Oracle software
> installation
>
> {code}
> I dont want to use oracle subpackage but that blocks the installation of
> other packages.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (AIRFLOW-1137) Problem installing [all] subpackages python3
[
https://issues.apache.org/jira/browse/AIRFLOW-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992843#comment-15992843
]
Hamed commented on AIRFLOW-1137:
thanks. yeah I saw that.
I would imagine it is a bug that stops other packages to get installed.
> Problem installing [all] subpackages python3
>
>
> Key: AIRFLOW-1137
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1137
> Project: Apache Airflow
> Issue Type: Bug
>Reporter: Hamed
>Priority: Minor
>
> I am installing all packages for airflow in python3 using:
> {noformat}pip3 install 'airflow[all]'{noformat} but it throws me the
> following error:
> {code:xml}
> Collecting cx_Oracle>=5.1.2 (from airflow[all])
> Downloading cx_Oracle-5.3.tar.gz (129kB)
> 100% || 133kB 5.9MB/s
> Complete output from command python setup.py egg_info:
> Traceback (most recent call last):
> File "", line 1, in
> File "/private/tmp/pip-build-5re1trj4/cx-Oracle/setup.py", line 174, in
>
> raise DistutilsSetupError("cannot locate an Oracle software " \
> distutils.errors.DistutilsSetupError: cannot locate an Oracle software
> installation
>
> {code}
> I dont want to use oracle subpackage but that blocks the installation of
> other packages.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (AIRFLOW-1164) Do not create example Connections if load_examples is False
Niels Zeilemaker created AIRFLOW-1164: - Summary: Do not create example Connections if load_examples is False Key: AIRFLOW-1164 URL: https://issues.apache.org/jira/browse/AIRFLOW-1164 Project: Apache Airflow Issue Type: Bug Components: configuration Reporter: Niels Zeilemaker Assignee: Niels Zeilemaker If you specify load_examples to be False, and call `airflow initdb` the example DAGs are not imported into the database. The example Connections are imported. We should use the same mechanism to prevent those from being imported/created. While still being able to call initdb to perform database upgrades in a CI/CD workflow -- This message was sent by Atlassian JIRA (v6.3.15#6346)
