Repository: incubator-airflow
Updated Branches:
refs/heads/master 24f73c032 -> cb336464c
[AIRFLOW-XXX] Updating CHANGELOG, README, and UPDATING after 1.8.1 release
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-a
[
https://issues.apache.org/jira/browse/AIRFLOW-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003164#comment-16003164
]
ASF subversion and git services commented on AIRFLOW-1181:
--
Com
[
https://issues.apache.org/jira/browse/AIRFLOW-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Riccomini closed AIRFLOW-1181.
Resolution: Fixed
Fix Version/s: 1.9.0
> Enable delete and list function for Google
Repository: incubator-airflow
Updated Branches:
refs/heads/master ac9ccb151 -> 24f73c032
[AIRFLOW-1181] Add delete and list functionality to gcs_hook
Closes #2281 from mattuuh7/gcs-delete-list
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.ap
[
https://issues.apache.org/jira/browse/AIRFLOW-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003135#comment-16003135
]
ASF subversion and git services commented on AIRFLOW-1138:
--
Com
[
https://issues.apache.org/jira/browse/AIRFLOW-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003141#comment-16003141
]
ASF subversion and git services commented on AIRFLOW-970:
-
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003137#comment-16003137
]
ASF subversion and git services commented on AIRFLOW-1142:
--
Com
[
https://issues.apache.org/jira/browse/AIRFLOW-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003138#comment-16003138
]
ASF subversion and git services commented on AIRFLOW-1142:
--
Com
[
https://issues.apache.org/jira/browse/AIRFLOW-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003139#comment-16003139
]
ASF subversion and git services commented on AIRFLOW-492:
-
Commit
[
https://issues.apache.org/jira/browse/AIRFLOW-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003134#comment-16003134
]
ASF subversion and git services commented on AIRFLOW-1127:
--
Com
[
https://issues.apache.org/jira/browse/AIRFLOW-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003140#comment-16003140
]
ASF subversion and git services commented on AIRFLOW-492:
-
Commit
[AIRFLOW-1004][AIRFLOW-276] Fix `airflow webserver -D` to run in background
AIRFLOW-276 introduced a monitor process for gunicorn
to find new files in the dag folder, but it also changed
`airflow webserver -D`'s behavior to run in foreground.
This PR fixes that by running the monitor as a daemon
p
[
https://issues.apache.org/jira/browse/AIRFLOW-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003133#comment-16003133
]
ASF subversion and git services commented on AIRFLOW-1127:
--
Com
[AIRFLOW-1033][AIFRLOW-1033] Fix ti_deps for no schedule dags
DAGs that did not have a schedule (None or @once)
make the dependency
checker raise an exception as the previous
schedule will not exist.
Also activates all ti_deps tests.
Closes #2220 from bolkedebruin/AIRFLOW-1033
(cherry picked fr
[
https://issues.apache.org/jira/browse/AIRFLOW-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003136#comment-16003136
]
ASF subversion and git services commented on AIRFLOW-1138:
--
Com
[AIRFLOW-1011] Fix bug in BackfillJob._execute() for SubDAGs
BackfillJob._execute() checks that the next run
date is less than
or equal to the end date before creating a DAG run
and task
instances. For SubDAGs, the next run date is not
relevant,
i.e. schedule_interval can be anything other than
No
[AIRFLOW-1030][AIRFLOW-1] Fix hook import for HttpSensor
Closes #2180 from
pdambrauskas/fix/http_hook_import
(cherry picked from commit f2dae7d15623e2534e7c0dab3b5a7e02d4cff81d)
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf
[AIRFLOW-1142] Do not reset orphaned state for backfills
The scheduler could interfere with backfills when
it resets the state
of tasks that were considered orphaned. This patch
prevents the scheduler
from doing so and adds a guard in the backfill.
Closes #2260 from bolkedebruin/AIRFLOW-1142
(ch
[AIRFLOW-1001] Fix landing times if there is no following schedule
@once does not have a following schedule. This was
not checked for
and therefore the landing times page could bork.
Closes #2213 from bolkedebruin/AIRFLOW-1001
(cherry picked from commit 0371df4f1bd78e220e591d5cb23630d6a062f109)
[AIRFLOW-XXX] Fix merge issue with test/models.py by adding execution_date
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/d61af623
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/d6
Merge pull request #2195 from bolkedebruin/AIRFLOW-719
(cherry picked from commit 4a6bef69d1817a5fc3ddd6ffe14c2578eaa49cf0)
Signed-off-by: Bolke de Bruin
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commi
[AIRFLOW-858] Configurable database name for DB operators
Closes #2063 from s7anley/configurable-schema
(cherry picked from commit 94dc7fb0a6bb3c563d9df6566cd52a59bd0c4629)
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incu
[AIRFLOW-832] Let debug server run without SSL
Closes #2051 from gsakkis/fix-debug-server
(cherry picked from commit b0ae70d3a8e935dc9266b6853683ae5375a7390b)
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/
[AIRFLOW-XXX] Bump version to 1.8.1rc1+incubating
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/3c893983
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/3c893983
Diff: http://git-w
[AIRFLOW-989] Do not mark dag run successful if unfinished tasks
Dag runs could be marked successful if all root
tasks were successful,
even if some tasks did not run yet, ie. in case of
clearing. Now
we consider unfinished_tasks, before marking
successful.
Closes #2154 from bolkedebruin/AIRFLOW-
[AIRFLOW-111] Include queued tasks in scheduler concurrency check
The concurrency argument in dags appears to not be obeyed because the
scheduler does not check the concurrency properly when checking tasks.
The tasks do not run, but this leads to a lot of scheduler churn.
(cherry picked from comm
[AIRFLOW-1127] Move license notices to LICENSE
Closes #2250 from bolkedebruin/AIRFLOW-1127
(cherry picked from commit 659827639e256a668d669d0d229abf49d6010bb8)
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow
[AIRFLOW-906] Update Code icon from lightning bolt to file
Lightning bolts are not a visual metaphor for code
or files. Since Glyphicon doesn't have a code icon
(<>, for instance), we should use its file icon.
Dear Airflow Maintainers,
Please accept this PR that addresses the following
issues:
A
[AIRFLOW-1030][AIRFLOW-1] Fix hook import for HttpSensor
Closes #2180 from
pdambrauskas/fix/http_hook_import
(cherry picked from commit f2dae7d15623e2534e7c0dab3b5a7e02d4cff81d)
Signed-off-by: Bolke de Bruin
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://
[AIRFLOW-XXX] Set version to 1.8.1
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/0a105eed
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/0a105eed
Diff: http://git-wip-us.apache.or
[AIRFLOW-XXX] Set 1.8.1 version
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/58a0ee78
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/58a0ee78
Diff: http://git-wip-us.apache.org/r
[AIRFLOW-1035] Use binary exponential backoff
Closes #2196 from IvanVergiliev/exponential-
backoff
(cherry picked from commit 4ec932b551774bb394c5770c4d2660f565a4c592)
Signed-off-by: Bolke de Bruin
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us
[AIRFLOW-1120] Update version view to include Apache prefix
Closes #2244 from criccomini/AIRFLOW-1120
(cherry picked from commit 6684597d951cb9f2fea24576a3d19534d67c89ea)
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incuba
[AIRFLOW-1000] Rebrand distribution to Apache Airflow
Per Apache requirements Airflow should be branded
Apache Airflow.
It is impossible to provide a forward compatible
automatic update
path and users will be required to manually
upgrade.
Closes #2172 from bolkedebruin/AIRFLOW-1000
(cherry picke
[AIRFLOW-1062] Fix DagRun#find to return correct result
DagRun#find returns wrong result if
external_trigger=False is specified,
because adding filter is skipped on that
condition. This PR fixes it.
Closes #2210 from sekikn/AIRFLOW-1062
(cherry picked from commit e4494f85ed5593c99949b52e1e0044c2
Merge branch 'v1-8-test' into v1-8-stable
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/2b811c44
Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/2b811c44
Diff: http://git-wip-us.ap
[AIRFLOW-970] Load latest_runs on homepage async
The latest_runs column on the homepage loads
synchronously with an n+1
query. Homepage loads will be significantly faster
if this happens
asynchronously and as a batch.
Closes #2144 from saguziel/aguziel-latest-run-
async
(cherry picked from commi
[AIRFLOW-1054] Fix broken import in test_dag
Closes #2201 from
r39132/fix_broken_import_on_test_dag
(cherry picked from commit c64e876bd50eeb6c9e2600ac9d832c05eb5e9640)
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubato
[AIRFLOW-1124] Do not set all tasks to scheduled in backfill
Backfill is supposed to fill in the blanks and not
to reschedule
all tasks. This fixes a regression from 1.8.0.
Closes #2247 from bolkedebruin/AIRFLOW-1124
(cherry picked from commit 0406462dc91427793ba40d0f05f321e85dbc6f19)
Signed-off
Merge branch 'v1-8-stable' of
https://git-wip-us.apache.org/repos/asf/incubator-airflow into v1-8-stable
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/0d8509e7
Tree: http://git-wip-us.apache.org/repo
[AIRFLOW-1050] Do not count up_for_retry as not ready
up_for_retry tasks were incorrectly counted
towards not_ready
therefore marking a dag run deadlocked instead of
retrying.
Closes #2225 from bolkedebruin/AIRFLOW-1050
(cherry picked from commit 35e43f5067f4741640278b765c0e54e4fd45ffa3)
Signed-
[AIRFLOW-1138] Add missing licenses to files in scripts directory
Closes #2253 from criccomini/AIRFLOW-1138
(cherry picked from commit 94f9822ffd867e559fd71046124626fee6acedf7)
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip-us.apache.org/repos/asf/
[AIRFLOW-1121][AIRFLOW-1004] Fix `airflow webserver --pid` to write out pid file
After AIRFLOW-1004, --pid option is no longer
honored and
the pid file is not being written out. This PR
fixes it.
Closes #2249 from sekikn/AIRFLOW-1121
(cherry picked from commit 8d643897cf6171d110e7139fb31c3d4d47c
[AIRFLOW-111] Include queued tasks in scheduler concurrency check
The concurrency argument in dags appears to not be
obeyed because the
scheduler does not check the concurrency properly
when checking tasks.
The tasks do not run, but this leads to a lot of
scheduler churn.
Closes #2214 from saguzi
[AIRFLOW-969] Catch bad python_callable argument
Checks for callable when Operator is
created, not when it is run.
* added initial PythonOperator unit test, testing
run
* python_callable must be callable; added unit
test
Closes #2142 from abloomston/python-callable
(cherry picked from commit 12
[AIRFLOW-492] Make sure stat updates cannot fail a task
Previously a failed commit into the db for the statistics
could also fail a task. Secondly, the ui could display
out of date statistics.
This patch reworks DagStat so that failure to update the
statistics does not propagate. Next to that, it
[AIRFLOW-1085] Enhance the SparkSubmitOperator
- Allow the Spark home to be set on per connection
basis to obviate
the need for the spark-submit to be on the PATH,
and allows different
versions of Spark to be easily used.
- Enable the use of the --driver-memory parameter
on the spark-submit
Repository: incubator-airflow
Updated Branches:
refs/heads/v1-8-stable 8e7a55836 -> 0d8509e7e
[AIRFLOW-974] Fix mkdirs race condition
mkdirs congtained a race condition for when if the
directory is
created between the os.path.exists and the
os.makedirs calls,
the os.makedirs will fail with an
[AIRFLOW-1017] get_task_instance shouldn't throw exception when no TI
get_task_instance should return None instead of
throwing exception in the case where dagrun does not have the task
instance.
Closes #2178 from aoen/ddavydov--
one_instead_of_first_for_dagrun
(cherry picked from commit b2b9587c
Repository: incubator-airflow
Updated Tags: refs/tags/1.8.1 2b811c445 -> 0d8509e7e
Repository: incubator-airflow
Updated Tags: refs/tags/1.8.1 [created] 2b811c445
Author: criccomini
Date: Tue May 9 17:28:09 2017
New Revision: 19592
Log:
Airflow 1.8.1 release
Added:
release/incubator/airflow/1.8.1-incubating/
release/incubator/airflow/1.8.1-incubating/apache-airflow-1.8.1+incubating.tar.gz
(with props)
release/incubator/airflow/1.8.1-incub
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen closed AIRFLOW-1183.
Resolution: Fixed
> How to pass Spark URL for standalone cluster?
> --
[
https://issues.apache.org/jira/browse/AIRFLOW-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Riccomini closed AIRFLOW-1179.
Resolution: Fixed
Fix Version/s: 1.9.0
> Pandas 0.20 broke Google BigQuery hook
> -
Repository: incubator-airflow
Updated Branches:
refs/heads/master 4284e6485 -> ac9ccb151
[AIRFLOW-1179] Fix Pandas 0.2x breaking Google BigQuery change
Closes #2279 from NielsZeilemaker/AIRFLOW-1179
Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo
Commit: http://git-wip
[
https://issues.apache.org/jira/browse/AIRFLOW-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003006#comment-16003006
]
ASF subversion and git services commented on AIRFLOW-1179:
--
Com
[
https://issues.apache.org/jira/browse/AIRFLOW-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003005#comment-16003005
]
ASF subversion and git services commented on AIRFLOW-1179:
--
Com
Vianney FOUCAULT created AIRFLOW-1184:
-
Summary: Contrib Spark Submit Hook does not split argument and
argument value
Key: AIRFLOW-1184
URL: https://issues.apache.org/jira/browse/AIRFLOW-1184
Proj
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
[
https://issues.apache.org/jira/browse/AIRFLOW-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sam sen updated AIRFLOW-1183:
-
Description:
How can I pass my Spark URL? When I look in the logs I see `--master` is
pointed to "yarn.
sam sen created AIRFLOW-1183:
Summary: How to pass Spark URL for standalone cluster?
Key: AIRFLOW-1183
URL: https://issues.apache.org/jira/browse/AIRFLOW-1183
Project: Apache Airflow
Issue Type:
Vianney FOUCAULT created AIRFLOW-1182:
-
Summary: Contrib Spark Submit operator should template fields
Key: AIRFLOW-1182
URL: https://issues.apache.org/jira/browse/AIRFLOW-1182
Project: Apache Airfl
71 matches
Mail list logo