[airflow] tag nightly-master updated (42c5975 -> c7788a6)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from 42c5975 (commit)
to c7788a6 (commit)
from 42c5975 Update example SingularityOperator DAG (#8790)
add 791d1a7 Backport packages are renamed to include backport in their
name (#8767)
add 100f530 Fixed test-target command (#8795)
add db1b51d Make celery worker_prefetch_multiplier configurable (#8695)
add bc19778 [AIP-31] Implement XComArg to pass output from one operator
to the next (#8652)
add 7506c73 Add default `conf` parameter to Spark JDBC Hook (#8787)
add 5e1c33a Fix docs on creating CustomOperator (#8678)
add 21cc7d7 Document default timeout value for SSHOperator (#8744)
add cd635dd [AIRFLOW-5906] Add authenticator parameter to snowflake_hook
(#8642)
add c7788a6 Add imap_attachment_to_s3 example dag and system test (#8669)
No new revisions were added by this update.
Summary of changes:
CONTRIBUTING.rst | 10 +-
TESTING.rst| 8 +-
airflow/config_templates/config.yml| 13 ++
airflow/config_templates/default_airflow.cfg | 10 ++
airflow/config_templates/default_celery.py | 2 +-
airflow/models/baseoperator.py | 32 -
airflow/models/xcom_arg.py | 149 +++
...r_basic.py => example_imap_attachment_to_s3.py} | 39 +++--
.../apache/spark/example_dags/example_spark_dag.py | 2 -
airflow/providers/apache/spark/hooks/spark_jdbc.py | 2 +-
airflow/providers/snowflake/hooks/snowflake.py | 8 +-
airflow/providers/snowflake/operators/snowflake.py | 13 +-
airflow/providers/ssh/operators/ssh.py | 2 +-
backport_packages/setup_backport_packages.py | 8 +-
breeze | 2 +-
docs/howto/custom-operator.rst | 6 +-
.../operator/amazon/aws/imap_attachment_to_s3.rst | 70 +
docs/operators-and-hooks-ref.rst | 4 +-
scripts/ci/in_container/run_ci_tests.sh| 2 +-
.../in_container/run_test_package_installation.sh | 4 +-
tests/models/test_xcom_arg.py | 157 +
.../test_imap_attachment_to_s3_system.py} | 29 ++--
tests/providers/snowflake/hooks/test_snowflake.py | 6 +-
23 files changed, 508 insertions(+), 70 deletions(-)
create mode 100644 airflow/models/xcom_arg.py
copy
airflow/providers/amazon/aws/example_dags/{example_google_api_to_s3_transfer_basic.py
=> example_imap_attachment_to_s3.py} (50%)
create mode 100644 docs/howto/operator/amazon/aws/imap_attachment_to_s3.rst
create mode 100644 tests/models/test_xcom_arg.py
copy tests/providers/{http/operators/test_http_system.py =>
amazon/aws/operators/test_imap_attachment_to_s3_system.py} (53%)
[airflow] tag nightly-master updated (493b685 -> 7d69987)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 493b685 (commit) to 7d69987 (commit) from 493b685 Add separate example DAGs and system tests for google cloud speech (#8778) add bed1995 Avoid color info in response of /dag_stats & /task_stats (#8742) add b59adab Support cron presets in date_range function (#) add 5f3774a [AIRFLOW-6921] Fetch celery states in bulk (#7542) add d5c4001 Useful help information in test-target and docker-compose commands (#8796) add a6434a5 Fix bash command in performance test dag (#8812) add 0c3db84 [AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731) add 5ae76d8 Option to set end_date for performance testing dag. (#8817) add 2ec0130 [AIRFLOW-4549] Allow skipped tasks to satisfy wait_for_downstream (#7735) add 1fb9f07 Synchronize extras between airflow and providers (#8819) add d590e5e Add option to propagate tags in ECSOperator (#8811) add f410d64 Use fork when test relies on mock.patch in parent process. (#8794) add 3ad4f96 [AIRFLOW-1156] BugFix: Unpausing a DAG with catchup=False creates an extra DAG run (#8776) add 4375607 Fix typo. 'zobmies' => 'zombies'. (#8832) add 78a48db Add support for non-default orientation in `dag show` command (#8834) add 7533378 Access function to be pickled as attribute, not method, to avoid error. (#8823) add 1d12c34 Refactor BigQuery check operators (#8813) add 4b06fde Fix Flake8 errors (#8841) add 6911dfe Fix template fields in Google operators (#8840) add 01db738 Azure storage 0.37.0 is not installable any more (#8833) add 578fc51 [AIRFLOW-4543] Update slack operator to support slackclient v2 (#5519) add 7236862 [AIRFLOW-2310] Enable AWS Glue Job Integration (#6007) add 8b54919 Refactor BigQuery hook methods to use python library (#8631) add 7d69987 Remove duplicate code from perf_kit (#8843) No new revisions were added by this update. Summary of changes: BREEZE.rst | 36 +- CONTRIBUTING.rst | 22 +- IMAGES.rst |2 +- INSTALL| 14 +- LOCAL_VIRTUALENV.rst |2 +- UPDATING.md| 44 + airflow/api/common/experimental/mark_tasks.py | 38 +- airflow/executors/celery_executor.py | 225 +++-- airflow/jobs/scheduler_job.py | 13 +- airflow/models/baseoperator.py |6 +- airflow/models/taskinstance.py |4 +- airflow/providers/amazon/aws/hooks/ec2.py | 88 ++ airflow/providers/amazon/aws/hooks/glue.py | 178 .../amazon/aws/operators/ec2_start_instance.py | 72 ++ .../amazon/aws/operators/ec2_stop_instance.py | 72 ++ airflow/providers/amazon/aws/operators/ecs.py |5 +- airflow/providers/amazon/aws/operators/glue.py | 114 +++ .../amazon/aws/sensors/ec2_instance_state.py | 70 ++ airflow/providers/amazon/aws/sensors/glue.py | 65 ++ .../example_dags/example_bigquery_operations.py|6 +- .../cloud/example_dags/example_bigquery_queries.py |2 +- .../cloud/example_dags/example_bigquery_to_gcs.py |2 +- .../cloud/example_dags/example_presto_to_gcs.py|2 +- airflow/providers/google/cloud/hooks/bigquery.py | 886 + airflow/providers/google/cloud/hooks/functions.py |2 +- airflow/providers/google/cloud/operators/automl.py |2 +- .../providers/google/cloud/operators/bigquery.py | 168 ++-- .../marketing_platform/operators/display_video.py |2 +- airflow/providers/qubole/operators/qubole_check.py | 11 +- airflow/providers/slack/hooks/slack.py | 81 +- airflow/providers/slack/operators/slack.py | 35 +- airflow/secrets/local_filesystem.py|2 +- airflow/utils/dag_processing.py|3 +- airflow/utils/dates.py |2 + airflow/utils/dot_renderer.py |3 +- airflow/www/templates/airflow/dags.html|5 +- airflow/www/views.py | 20 +- backport_packages/setup_backport_packages.py |6 +- breeze | 104 +- breeze-complete| 25 +- dev/send_email.py |4 +- .../amazon/aws/_partials/prerequisite_tasks.rst|2 +- .../operator/gcp/_partials/prerequisite_tasks.rst |2 +- docs/howto/write-logs.rst |2 +- docs/installat
[airflow] tag nightly-master updated (c7788a6 -> 493b685)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from c7788a6 (commit)
to 493b685 (commit)
from c7788a6 Add imap_attachment_to_s3 example dag and system test (#8669)
add a715aa6 Correctly store non-default Nones in serialized tasks/dags
(#8772)
add 280f1f0 Correctly restore upstream_task_ids when deserializing
Operators (#8775)
add cbebed2 Allow passing backend_kwargs to AWS SSM client (#8802)
add 79ef8be Added Upload Multiple Entity Read Files to specified big
query dataset (#8610)
add e1cc17e Remove old airflow logger causing side effects in tests
(#8746)
add 9bb91ef Add comments to breeze scripts (#8797)
add 493b685 Add separate example DAGs and system tests for google cloud
speech (#8778)
No new revisions were added by this update.
Summary of changes:
.../amazon/aws/secrets/systems_manager.py | 13 +-
.../google/cloud/example_dags/example_gcs.py | 4 +-
...example_speech.py => example_speech_to_text.py} | 51 +
...example_speech.py => example_text_to_speech.py} | 57 ++
...ample_speech.py => example_translate_speech.py} | 46 ++---
.../example_dags/example_display_video.py | 36 ++--
.../marketing_platform/hooks/display_video.py | 24 ++-
airflow/serialization/serialized_objects.py| 27 ++-
breeze | 183 --
.../gcp/{speech.rst => speech_to_text.rst} | 60 +-
.../gcp/{speech.rst => text_to_speech.rst} | 58 +-
.../{translate-speech.rst => translate_speech.rst} | 26 +--
docs/operators-and-hooks-ref.rst | 6 +-
scripts/ci/_utils.sh | 214 -
scripts/ci/docker-compose/backend-sqlite.yml | 2 +-
.../amazon/aws/secrets/test_systems_manager.py | 18 ++
...ech_system.py => test_speech_to_text_system.py} | 12 +-
...ech_system.py => test_text_to_speech_system.py} | 10 +-
...h_system.py => test_translate_speech_system.py} | 12 +-
tests/secrets/test_secrets.py | 14 ++
tests/serialization/test_dag_serialization.py | 166 +++-
tests/test_logging_config.py | 35 +++-
tests/test_project_structure.py| 6 -
23 files changed, 601 insertions(+), 479 deletions(-)
copy airflow/providers/google/cloud/example_dags/{example_speech.py =>
example_speech_to_text.py} (61%)
copy airflow/providers/google/cloud/example_dags/{example_speech.py =>
example_text_to_speech.py} (51%)
rename airflow/providers/google/cloud/example_dags/{example_speech.py =>
example_translate_speech.py} (67%)
copy docs/howto/operator/gcp/{speech.rst => speech_to_text.rst} (58%)
rename docs/howto/operator/gcp/{speech.rst => text_to_speech.rst} (60%)
rename docs/howto/operator/gcp/{translate-speech.rst => translate_speech.rst}
(72%)
copy tests/providers/google/cloud/operators/{test_speech_system.py =>
test_speech_to_text_system.py} (80%)
copy tests/providers/google/cloud/operators/{test_speech_system.py =>
test_text_to_speech_system.py} (84%)
rename tests/providers/google/cloud/operators/{test_speech_system.py =>
test_translate_speech_system.py} (80%)
[airflow] tag nightly-master updated (7d69987 -> e61b9bb)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 7d69987 (commit) to e61b9bb (commit) from 7d69987 Remove duplicate code from perf_kit (#8843) add e1e833b Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816) add 8a94d18 Fix Environment Variable in perf/scheduler_dag_execution_timing.py (#8847) add ed3f513 Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845) add f1dc2e0 The librabbitmq library stopped installing for python3.7 (#8853) add c3af681 Convert tests/jobs/test_base_job.py to pytest (#8856) add 81fb9d6 Add metric for monitoring email notification failures (#8771) add 2878f17 Relax Flask-Appbuilder version to ~=2.3.4 (#8857) add e61b9bb Add AWS EMR System tests (#8618) No new revisions were added by this update. Summary of changes: Dockerfile.ci | 2 +- airflow/jobs/scheduler_job.py | 1 + .../example_emr_job_flow_automatic_steps.py| 18 - .../example_emr_job_flow_manual_steps.py | 18 - airflow/providers/amazon/aws/operators/athena.py | 2 +- .../providers/google/common/hooks/base_google.py | 5 +- docs/metrics.rst | 1 + requirements/requirements-python3.6.txt| 19 ++--- requirements/requirements-python3.7.txt| 19 ++--- requirements/setup-3.6.md5 | 2 +- requirements/setup-3.7.md5 | 2 +- scripts/perf/scheduler_dag_execution_timing.py | 2 +- setup.py | 11 ++- tests/jobs/test_base_job.py| 87 +++--- tests/jobs/test_scheduler_job.py | 4 +- .../providers/amazon/aws/operators/test_athena.py | 7 +- .../amazon/aws/operators/test_emr_system.py| 25 +++ .../google/common/hooks/test_base_google.py| 18 - tests/test_utils/amazon_system_helpers.py | 11 +++ 19 files changed, 156 insertions(+), 98 deletions(-) copy airflow/operators/dummy_operator.py => tests/providers/amazon/aws/operators/test_emr_system.py (61%)
[airflow] tag nightly-master updated (bd29ee3 -> 6e4f5fa)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from bd29ee3 (commit) to 6e4f5fa (commit) from bd29ee3 Ensure test_logging_config.test_reload_module works in spawn mode. (#8741) add d15839d Latest debian-buster release broke image build (#8758) add ff5b701 Add google_api_to_s3_transfer example dags and system tests (#8581) add 7c04604 Add google_api_to_s3_transfer docs howto link (#8761) add 723c52c Add documentation for SpannerDeployInstanceOperator (#8750) add 6e4f5fa [AIRFLOW-4568]The ExternalTaskSensor should be configurable to raise an Airflow Exception in case the poked external task reaches a disallowed state, such as f.i. failed (#8509) No new revisions were added by this update. Summary of changes: Dockerfile.ci | 1 + TESTING.rst| 16 +-- .../example_external_task_marker_dag.py| 14 ++ .../example_google_api_to_s3_transfer_advanced.py | 132 +++ .../example_google_api_to_s3_transfer_basic.py | 56 .../providers/google/cloud/operators/spanner.py| 4 + airflow/sensors/external_task_sensor.py| 68 -- backport_packages/setup_backport_packages.py | 7 + .../amazon/aws/google_api_to_s3_transfer.rst | 141 + docs/howto/operator/external_task_sensor.rst | 5 + docs/howto/operator/gcp/spanner.rst| 38 ++ docs/operators-and-hooks-ref.rst | 4 +- .../test_google_api_to_s3_transfer_system.py | 65 ++ tests/sensors/test_external_task_sensor.py | 58 - tests/test_utils/amazon_system_helpers.py | 83 15 files changed, 667 insertions(+), 25 deletions(-) create mode 100644 airflow/providers/amazon/aws/example_dags/example_google_api_to_s3_transfer_advanced.py create mode 100644 airflow/providers/amazon/aws/example_dags/example_google_api_to_s3_transfer_basic.py create mode 100644 docs/howto/operator/amazon/aws/google_api_to_s3_transfer.rst create mode 100644 tests/providers/amazon/aws/operators/test_google_api_to_s3_transfer_system.py create mode 100644 tests/test_utils/amazon_system_helpers.py
[airflow] tag nightly-master updated (bd29ee3 -> 6e4f5fa)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from bd29ee3 (commit) to 6e4f5fa (commit) from bd29ee3 Ensure test_logging_config.test_reload_module works in spawn mode. (#8741) add d15839d Latest debian-buster release broke image build (#8758) add ff5b701 Add google_api_to_s3_transfer example dags and system tests (#8581) add 7c04604 Add google_api_to_s3_transfer docs howto link (#8761) add 723c52c Add documentation for SpannerDeployInstanceOperator (#8750) add 6e4f5fa [AIRFLOW-4568]The ExternalTaskSensor should be configurable to raise an Airflow Exception in case the poked external task reaches a disallowed state, such as f.i. failed (#8509) No new revisions were added by this update. Summary of changes: Dockerfile.ci | 1 + TESTING.rst| 16 +-- .../example_external_task_marker_dag.py| 14 ++ .../example_google_api_to_s3_transfer_advanced.py | 132 +++ .../example_google_api_to_s3_transfer_basic.py | 56 .../providers/google/cloud/operators/spanner.py| 4 + airflow/sensors/external_task_sensor.py| 68 -- backport_packages/setup_backport_packages.py | 7 + .../amazon/aws/google_api_to_s3_transfer.rst | 141 + docs/howto/operator/external_task_sensor.rst | 5 + docs/howto/operator/gcp/spanner.rst| 38 ++ docs/operators-and-hooks-ref.rst | 4 +- .../test_google_api_to_s3_transfer_system.py | 65 ++ tests/sensors/test_external_task_sensor.py | 58 - tests/test_utils/amazon_system_helpers.py | 83 15 files changed, 667 insertions(+), 25 deletions(-) create mode 100644 airflow/providers/amazon/aws/example_dags/example_google_api_to_s3_transfer_advanced.py create mode 100644 airflow/providers/amazon/aws/example_dags/example_google_api_to_s3_transfer_basic.py create mode 100644 docs/howto/operator/amazon/aws/google_api_to_s3_transfer.rst create mode 100644 tests/providers/amazon/aws/operators/test_google_api_to_s3_transfer_system.py create mode 100644 tests/test_utils/amazon_system_helpers.py
[airflow] tag nightly-master updated (6e4f5fa -> 42c5975)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 6e4f5fa (commit) to 42c5975 (commit) from 6e4f5fa [AIRFLOW-4568]The ExternalTaskSensor should be configurable to raise an Airflow Exception in case the poked external task reaches a disallowed state, such as f.i. failed (#8509) add b7566e1 Add SQL query tracking for pytest (#8754) add 58aefb2 Added SDFtoGCSOperator (#8740) add b37ce29 Patch Pool.DEFAULT_POOL_NAME in BaseOperator (#8587) add 2bd3e76 Support same short flags for `create user` as 1.10 did for `user_create` (#8763) add 09770e4 Add WorldRemit as Airflow user (#8786) add a091c1f fix typing errors reported by dmypy (#8773) add 42c5975 Update example SingularityOperator DAG (#8790) No new revisions were added by this update. Summary of changes: README.md | 1 + TESTING.rst| 30 UPDATING.md| 10 ++ airflow/cli/cli_parser.py | 16 +- airflow/models/baseoperator.py | 4 +- airflow/plugins_manager.py | 2 +- .../providers/google/common/hooks/base_google.py | 22 ++- .../example_dags/example_display_video.py | 74 -- .../marketing_platform/hooks/display_video.py | 67 - .../marketing_platform/operators/display_video.py | 163 - .../marketing_platform/sensors/display_video.py| 59 +++- .../example_dags/example_singularity_operator.py | 59 docs/howto/operator/gcp/display_video.rst | 55 +++ scripts/perf/perf_kit/__init__.py | 2 +- scripts/perf/perf_kit/sqlalchemy.py| 91 +--- tests/conftest.py | 70 + .../marketing_platform/hooks/test_display_video.py | 151 ++- .../operators/test_display_video.py| 145 ++ .../operators/test_display_video_system.py | 11 +- .../sensors/test_display_video.py | 25 +++- tests/serialization/test_dag_serialization.py | 2 + 21 files changed, 942 insertions(+), 117 deletions(-)
[airflow] branch dependabot/pip/requirements/httplib2-0.18.0 created (now 834f2cd)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/pip/requirements/httplib2-0.18.0 in repository https://gitbox.apache.org/repos/asf/airflow.git. at 834f2cd Bump httplib2 from 0.17.3 to 0.18.0 in /requirements No new revisions were added by this update.
[airflow] branch dependabot/pip/requirements/httplib2-0.18.0 created (now 834f2cd)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/pip/requirements/httplib2-0.18.0 in repository https://gitbox.apache.org/repos/asf/airflow.git. at 834f2cd Bump httplib2 from 0.17.3 to 0.18.0 in /requirements No new revisions were added by this update.
[airflow] tag nightly-master updated (94a7673 -> f107338)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 94a7673 (commit) to f107338 (commit) from 94a7673 Pin google-cloud-datacatalog to <0.8 (#8957) add 9a4a2d1 [AIRFLOW-5262] Update timeout exception to include dag (#8466) add b055151 Add context to execution_date_fn in ExternalTaskSensor (#8702) add f107338 Add support for spark python and submit tasks in Databricks operator(#8846) No new revisions were added by this update. Summary of changes: .../providers/databricks/operators/databricks.py | 30 ++- airflow/sensors/base_sensor_operator.py| 7 +++- airflow/sensors/external_task_sensor.py| 22 ++- .../providers/databricks/hooks/test_databricks.py | 24 .../databricks/operators/test_databricks.py| 44 +- tests/sensors/test_external_task_sensor.py | 22 +++ 6 files changed, 143 insertions(+), 6 deletions(-)
[airflow] tag nightly-master updated (2121f49 -> 94a7673)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 2121f49 (commit) to 94a7673 (commit) from 2121f49 Avoid failure on transient requirements in CI image (#8892) add 841d816 Allow setting the pooling time in DLPHook (#8824) add dd57ec9 Fix task and dag stats on home page (#8865) add 375d1ca Release candidate 2 for backport packages 2020.05.20 (#8898) add bae5cc2 Fix race in Celery tests by pre-creating result tables (#8909) add 499493c [AIRFLOW-6586] Improvements to gcs sensor (#7197) add ce7fdea UX Fix: Prevent undesired text selection with DAG title selection in Chrome (#8912) add fef00e5 Use Debian's provided JRE from Buster (#8919) add 5360045 Fix incorrect Env Var to stop Scheduler from creating DagRuns (#8920) add 51d9557 Re-run all tests when Dockerfile or Github worflow change (#8924) add c6224e2 Remove unused self.max_threads argument in SchedulerJob (#8935) add 12c22e0 Added Greytip to Airflow Users list (#8887) add 8476c1e Hive/Hadoop minicluster needs JDK8 and JAVA_HOME to work (#8938) add f17b4bb Fix DagRun Prefix for Performance script (#8934) add a9dfd7d Remove side-effect of session in FAB (#8940) add f3f74c7 Add TaskInstance state to TI Tooltip to be colour-blind friendlier (#8910) add 8d3acd7 Fix docstring in DagFileProcessor._schedule_task_instances (#8948) add 47413d9 Remove singularity from CI images (#8945) add 16206cd Update example webserver_config.py to show correct CSRF config (#8944) add 97b6cc7 Add note in Updating.md about the removel of DagRun.ID_PREFIX (#8949) add 41481bb Python base images are stored in cache (#8943) add b26b3ca Don't hard-code constants in scheduler_dag_execution_timing (#8950) add 113982b Make scheduler_dag_execution_timing grok dynamic start date of elastic dag (#8952) add 90a07d8 Cache 1 10 ci images (#8955) add dd72040 Pin Version of Azure Cosmos to <4 (#8956) add 94a7673 Pin google-cloud-datacatalog to <0.8 (#8957) No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 14 +- BREEZE.rst | 45 ++-- CI.rst | 27 +- Dockerfile.ci | 44 +--- README.md | 1 + UPDATING.md| 47 airflow/cli/commands/webserver_command.py | 2 +- .../config_templates/default_webserver_config.py | 2 +- airflow/jobs/scheduler_job.py | 6 +- .../amazon/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/amazon/README.md | 8 + .../cassandra/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/apache/cassandra/README.md | 8 + .../apache/druid/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/apache/druid/README.md | 8 + .../apache/hdfs/PROVIDERS_CHANGES_2020.05.20.md| 1 + airflow/providers/apache/hdfs/README.md| 8 + .../apache/hive/PROVIDERS_CHANGES_2020.05.20.md| 1 + airflow/providers/apache/hive/README.md| 8 + .../apache/livy/PROVIDERS_CHANGES_2020.05.20.md| 1 + airflow/providers/apache/livy/README.md| 8 + .../apache/pig/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/apache/pig/README.md | 8 + .../apache/pinot/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/apache/pinot/README.md | 8 + .../apache/spark/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/apache/spark/README.md | 8 + .../apache/sqoop/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/apache/sqoop/README.md | 8 + .../celery/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/celery/README.md | 8 + .../cloudant/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/cloudant/README.md | 8 + .../kubernetes/PROVIDERS_CHANGES_2020.05.20.md | 24 -- airflow/providers/cncf/kubernetes/README.md| 139 -- .../databricks/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/databricks/README.md | 8 + .../datadog/PROVIDERS_CHANGES_2020.05.20.md| 1 + airflow/providers/datadog/README.md| 8 + .../dingding/PROVIDERS_CHANGES_2020.05.20.md | 1 + airflow/providers/dingding/README.md | 8 + .../discord/PROVIDERS_CHANGES_2020.05.20.md| 1 + airflow/providers/discord/README.md| 8 + .../docker/PROVIDERS_CHANGES_2020.05.20.md
[airflow] tag nightly-master updated (f107338 -> 427257c)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from f107338 (commit) to 427257c (commit) from f107338 Add support for spark python and submit tasks in Databricks operator(#8846) add e742ef7 Fix typo in test_project_structure (#8978) add 4d67704 Remove duplicate line from CONTRIBUTING.rst (#8981) add db70da2 Flush pending Sentry exceptions before exiting (#7232) add cf5cf45 Support YAML input for CloudBuildCreateOperator (#8808) add bdb8369 Add secrets to test_deprecated_packages (#8979) add f3456b1 Fix formatting code block in TESTING.rst (#8985) add f946f96 Old json boto compat removed from dynamodb_to_s3 operator (#8987) add 1d36b03 Fix references in docs (#8984) add 971cae3 Fix migration message (#8988) add 427257c Remove defunct code from setup.py (#8982) No new revisions were added by this update. Summary of changes: CONTRIBUTING.rst | 1 - TESTING.rst| 24 +++ airflow/hooks/dbapi_hook.py| 8 ++--- airflow/macros/__init__.py | 4 +-- airflow/macros/hive.py | 2 +- .../b3b105409875_add_root_dag_id_to_dag.py | 2 ++ airflow/models/dag.py | 2 +- airflow/operators/bash.py | 2 +- airflow/providers/amazon/aws/hooks/datasync.py | 2 +- airflow/providers/amazon/aws/hooks/sagemaker.py| 4 +-- airflow/providers/amazon/aws/hooks/sqs.py | 4 +-- .../amazon/aws/operators/dynamodb_to_s3.py | 4 +-- ...tes_operator.py => example_spark_kubernetes.py} | 2 +- ...yaml => example_spark_kubernetes_spark_pi.yaml} | 0 .../cncf/kubernetes/operators/kubernetes_pod.py| 2 +- airflow/providers/exasol/hooks/exasol.py | 8 ++--- airflow/providers/exasol/operators/exasol.py | 2 +- .../cloud/example_dags/example_cloud_build.py | 10 +++ .../cloud/example_dags/example_cloud_build.yaml} | 5 ++-- .../providers/google/cloud/hooks/cloud_build.py| 2 +- .../google/cloud/hooks/natural_language.py | 10 +++ airflow/providers/google/cloud/hooks/tasks.py | 8 ++--- airflow/providers/google/cloud/hooks/vision.py | 32 ++-- airflow/providers/google/cloud/operators/automl.py | 2 +- .../providers/google/cloud/operators/bigtable.py | 4 +-- .../google/cloud/operators/cloud_build.py | 35 +- .../providers/google/cloud/operators/cloud_sql.py | 2 +- .../providers/google/cloud/operators/dataproc.py | 2 +- .../google/cloud/operators/kubernetes_engine.py| 10 --- airflow/providers/google/cloud/operators/tasks.py | 8 ++--- airflow/providers/google/cloud/sensors/pubsub.py | 4 +-- .../google/cloud/utils/credentials_provider.py | 6 ++-- airflow/providers/imap/hooks/imap.py | 2 +- airflow/providers/jdbc/operators/jdbc.py | 2 +- .../providers/microsoft/mssql/operators/mssql.py | 2 +- airflow/providers/mysql/operators/mysql.py | 2 +- airflow/providers/oracle/operators/oracle.py | 2 +- airflow/providers/pagerduty/hooks/pagerduty.py | 2 +- airflow/providers/postgres/operators/postgres.py | 2 +- airflow/providers/qubole/sensors/qubole.py | 4 +-- airflow/providers/salesforce/hooks/salesforce.py | 10 +++ ...gularity_operator.py => example_singularity.py} | 0 airflow/providers/slack/hooks/slack.py | 11 ++- airflow/providers/snowflake/operators/snowflake.py | 2 +- airflow/providers/sqlite/operators/sqlite.py | 2 +- .../yandex/operators/yandexcloud_dataproc.py | 2 +- airflow/sensors/sql_sensor.py | 2 +- airflow/sentry.py | 9 ++ airflow/task/task_runner/standard_task_runner.py | 9 -- docs/best-practices.rst| 2 +- docs/build | 29 ++ docs/concepts.rst | 4 +-- docs/conf.py | 7 +++-- docs/executor/celery.rst | 2 +- docs/executor/debug.rst| 2 +- docs/exts/docroles.py | 2 +- docs/howto/connection/gcp_sql.rst | 10 +++ docs/howto/connection/index.rst| 4 +-- docs/howto/connection/mysql.rst| 2 +- docs/howto/connection/oracle.rst | 2 +- docs/howto/connection/postgres.rst | 2 +- docs/howto/connection/ssh.rst | 6 ++-- docs/howto/custom-ope
[airflow-site] branch asf-site updated: Update asf-site to output generated at c6fa911
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 8747e59 Update asf-site to output generated at c6fa911
8747e59 is described below
commit 8747e59cc9b755607f8ce7a79d469f93580e99f4
Author: potiuk
AuthorDate: Sun Aug 30 09:19:53 2020 +
Update asf-site to output generated at c6fa911
---
_gen/indexes/en/blog-index.json| 2 +-
_gen/indexes/en/blog-posts.json| 2 +-
blog/airflow-1.10.10/index.html| 4 +-
blog/airflow-1.10.12/index.html| 4 +-
blog/airflow-1.10.8-1.10.9/index.html | 4 +-
blog/airflow-survey/index.html | 4 +-
blog/announcing-new-website/index.html | 4 +-
blog/apache-airflow-for-newcomers/index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
blog/tags/community/index.html | 6 +-
blog/tags/community/index.xml | 4 +-
index.html | 28 +++---
search/index.html | 4 +-
sitemap.xml| 108 ++---
use-cases/adobe/index.html | 4 +-
use-cases/big-fish-games/index.html| 4 +-
use-cases/dish/index.html | 4 +-
use-cases/experity/index.html | 4 +-
use-cases/onefootball/index.html | 4 +-
23 files changed, 109 insertions(+), 109 deletions(-)
diff --git a/_gen/indexes/en/blog-index.json b/_gen/indexes/en/blog-index.json
index e2ee9a9..0c19dd4 100644
--- a/_gen/indexes/en/blog-index.json
+++ b/_gen/indexes/en/blog-index.json
@@ -1 +1 @@
-{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,2.014,1,0.802,2,0.092,3,0.384,4,0.474]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.097,4,0.323,5,1.373,6,0.675,7,1.373,8,0.834,9,0.675,10,0.675,11,0.675,12,0.547,13,1.373,14,0.547,15,1.373,16,0.136]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,1.023,17,1.265]],["content/It's a
\"Breeze\" to develop A [...]
\ No newline at end of file
+{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,2.079,1,0.714,2,0.032,3,0.372,4,0.473]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.032,4,0.307,5,1.35,6,0.686,7,1.35,8,0.686,9,0.686,10,0.565,11,0.686,12,0.565,13,1.35,14,0.464,15,1.35,16,0.068]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,1.098,17,1.341]],["content/It's a
\"Breeze\" to develop Apach [...]
\ No newline at end of file
diff --git a/_gen/indexes/en/blog-posts.json b/_gen/indexes/en/blog-posts.json
index cedabb1..d004e7a 100644
--- a/_gen/indexes/en/blog-posts.json
+++ b/_gen/indexes/en/blog-posts.json
@@ -1 +1 @@
-[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of productivity were. Even with the help of our client, who provided
us with a “homegrown” development environment it took us literally days to set
it up and learn some basics. [...]
\ No newline at end of file
+[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of productivity were. Even with the help of our client, who provided
us with a “homegrown” development environment it took us literally days to set
it up and learn some basics. [...]
\ No newline at end of file
diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html
index ccb39fc..
[airflow-site] branch asf-site updated: Update asf-site to output generated at ef70b5c
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new a7b Update asf-site to output generated at ef70b5c
a7b is described below
commit a7ba0ef9c6a6b765419cbacbc9ec7edb8498
Author: potiuk
AuthorDate: Sun Aug 30 09:50:51 2020 +
Update asf-site to output generated at ef70b5c
---
_gen/indexes/en/blog-posts.json| 2 +-
blog/airflow-1.10.10/index.html| 4 +-
blog/airflow-1.10.12/index.html| 4 +-
blog/airflow-1.10.8-1.10.9/index.html | 4 +-
blog/airflow-survey/index.html | 4 +-
blog/announcing-new-website/index.html | 14 +-
blog/apache-airflow-for-newcomers/index.html | 26 +--
.../index.html | 14 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 184 +
.../index.html | 6 +-
blog/index.html| 31
blog/index.xml | 66
.../index.html | 4 +-
blog/tags/community/index.html | 37 -
blog/tags/community/index.xml | 70 +++-
index.html | 24 +--
index.xml | 66
search/index.html | 4 +-
sitemap.xml| 113 +++--
use-cases/adobe/index.html | 4 +-
use-cases/big-fish-games/index.html| 4 +-
use-cases/dish/index.html | 4 +-
use-cases/experity/index.html | 4 +-
use-cases/onefootball/index.html | 4 +-
26 files changed, 471 insertions(+), 234 deletions(-)
diff --git a/_gen/indexes/en/blog-posts.json b/_gen/indexes/en/blog-posts.json
index d004e7a..08c0548 100644
--- a/_gen/indexes/en/blog-posts.json
+++ b/_gen/indexes/en/blog-posts.json
@@ -1 +1 @@
-[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of productivity were. Even with the help of our client, who provided
us with a “homegrown” development environment it took us literally days to set
it up and learn some basics. [...]
\ No newline at end of file
+[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of productivity were. Even with the help of our client, who provided
us with a “homegrown” development environment it took us literally days to set
it up and learn some basics. [...]
\ No newline at end of file
diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html
index de64c9e..4c1363c 100644
--- a/blog/airflow-1.10.10/index.html
+++ b/blog/airflow-1.10.10/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-1.10.12/index.html b/blog/airflow-1.10.12/index.html
index 4238ad4..b80953c 100644
--- a/blog/airflow-1.10.12/index.html
+++ b/blog/airflow-1.10.12/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-1.10.8-1.10.9/index.html
b/blog/airflow-1.10.8-1.10.9/index.html
index 50ecedc..2a51df5 100644
--- a/blog/airflow-1.10.8-1.10.9/index.html
+++ b/blog/airflow-1.10.8-1.10.9/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html
index c0ba782..da0fc8f 100644
--- a/blog/airflow-survey/index.html
+++ b/blog/airflow-survey/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/announcing-new-website/index.html
b/blog/announcing-new-website/index.html
index efda251..2d5e05b 100644
--- a/blog/announcing-new-website/index.html
+++ b/blog/announcing-new-website/index.html
@@ -36,13 +36,13 @@
-
+
-
+
@@ -606,13 +606,13 @@ and that its improved accessibility increases adoption
and use of Apache Airflow
-Fri, Nov 22, 2019
+Sat, Aug 15, 2020
-ApacheCon Europe 2019 —
Th
[airflow-site] branch asf-site updated: Update asf-site to output generated at 73e3138
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 048a9d4 Update asf-site to output generated at 73e3138
048a9d4 is described below
commit 048a9d4ef42b9143dc754201a49f74460cbe953b
Author: mik-laj
AuthorDate: Thu Sep 3 11:43:32 2020 +
Update asf-site to output generated at 73e3138
---
blog/airflow-1.10.10/index.html| 4 +-
blog/airflow-1.10.12/index.html| 4 +-
blog/airflow-1.10.8-1.10.9/index.html | 4 +-
blog/airflow-survey/index.html | 4 +-
blog/announcing-new-website/index.html | 4 +-
blog/apache-airflow-for-newcomers/index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
index.html | 32 +++---
search/index.html | 4 +-
sitemap.xml| 115 +++--
use-cases/adobe/index.html | 4 +-
use-cases/big-fish-games/index.html| 4 +-
use-cases/dish/index.html | 4 +-
use-cases/experity/index.html | 4 +-
use-cases/index.html | 22
use-cases/index.xml| 38 +++
use-cases/onefootball/index.html | 8 +-
use-cases/{onefootball => sift}/index.html | 51 -
usecase-logos/sift_logo.png| Bin 0 -> 42233 bytes
24 files changed, 202 insertions(+), 132 deletions(-)
diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html
index 247c1dd..6f7f2b4 100644
--- a/blog/airflow-1.10.10/index.html
+++ b/blog/airflow-1.10.10/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-1.10.12/index.html b/blog/airflow-1.10.12/index.html
index 6a43dbf..f7aee46 100644
--- a/blog/airflow-1.10.12/index.html
+++ b/blog/airflow-1.10.12/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-1.10.8-1.10.9/index.html
b/blog/airflow-1.10.8-1.10.9/index.html
index 0f57cde..c163dd3 100644
--- a/blog/airflow-1.10.8-1.10.9/index.html
+++ b/blog/airflow-1.10.8-1.10.9/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html
index d84a68e..3766a1b 100644
--- a/blog/airflow-survey/index.html
+++ b/blog/airflow-survey/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/announcing-new-website/index.html
b/blog/announcing-new-website/index.html
index ab8a10c..e3240bb 100644
--- a/blog/announcing-new-website/index.html
+++ b/blog/announcing-new-website/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/apache-airflow-for-newcomers/index.html
b/blog/apache-airflow-for-newcomers/index.html
index f90ddc3..74085a2 100644
--- a/blog/apache-airflow-for-newcomers/index.html
+++ b/blog/apache-airflow-for-newcomers/index.html
@@ -37,14 +37,14 @@ Authoring Workflow in Apache Airflow. Airflow makes it easy
to author workflows
-
+
-
+
diff --git
a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html
b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html
index 420e617..43f7b30 100644
---
a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html
+++
b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/documenting-using-local-development-environments/index.html
b/blog/documenting-using-local-development-environments/index.html
index 9f96d11..05382bf 100644
--- a/blog/documenting-using-local-development-environments/index.html
+++ b/blog/documenting-using-local-development-environments/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git
a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html
b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html
index a49f1ae..cfc3598 100644
---
a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html
+++
b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html
@@ -37,14 +37,14 @@ About Me I have been writing tech articles on medium as
well as my blog for the
-
+
-
+
[airflow] tag nightly-master updated (4e09cb5 -> 079d7b5)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from 4e09cb5 (commit)
to 079d7b5 (commit)
from 4e09cb5 Add packages to function names in bash (#10670) (#10696)
add 2f5bf8b Update INTHEWILD.md (#10703)
add a103280 Change the name of Static Check without pylint (#10690)
add 36aa88f Add jupytercmd and fix task failure when notify set as true
in qubole operator (#10599)
add 913397c Make Cloud Build system tests setup runnable (#10692)
add 9ac882e [AIRFLOW-5948] Replace SimpleDag with SerializedDag (#7694)
add f7fad67 Update DAG Serialization docs (#10711)
add 5b6464f Migrate speccy to spectral in OpenAPI linting. (#10351)
add a01d986 Don't commit when explicitly passed a session to TI.set_state
(#10710)
add de0d7d5 Make test_trigger_rule_dep tests re-runnable (#10712)
add 57fd479 Ensure we heartbeat the DagFileProcessorManager regularly.
(#10706)
add faaf179 Add Stacktrace when DagFileProcessorManager gets killed
(#10681)
add 6f96e81 Add Indeed to INTHEWILD.md (#10716)
add ab5235e Unify command names in CLI (#10720)
add 828f730 Add generate_yaml command to easily test KubernetesExecutor
before deploying pods (#10677)
add 3f7831c Relax requirement to allow latest version of flask-login
(#9990)
add 90c1505 Make grace_period_seconds option on K8sPodOperator (#10727)
add e4de728 Switches to better BATS asserts (#10718)
add 6e3d7b6 Add masterConfig parameter to
MLEngineStartTrainingJobOperator (#10578)
add 8cb4fc1 Add securitySchemes in openapi spec (#10652)
add 7b810b8 Fix docs for generate-dag-yaml cli command (#10735)
add 079d7b5 Enable more checks for pydocstyle (#10741)
No new revisions were added by this update.
Summary of changes:
.github/workflows/build-images-workflow-run.yml| 2 +-
.github/workflows/ci.yml | 6 +-
.pre-commit-config.yaml| 6 +-
INTHEWILD.md | 3 +-
UPDATING.md| 1 +
airflow/api_connexion/openapi/v1.yaml | 11 ++
airflow/cli/cli_parser.py | 33 -
airflow/cli/commands/dag_command.py| 46 +-
airflow/jobs/backfill_job.py | 2 +-
airflow/jobs/scheduler_job.py | 76 +-
airflow/models/taskinstance.py | 8 +-
.../cncf/kubernetes/operators/kubernetes_pod.py| 10 +-
.../providers/google/cloud/operators/mlengine.py | 11 ++
airflow/providers/qubole/hooks/qubole.py | 10 +-
airflow/providers/qubole/operators/qubole.py | 11 +-
airflow/utils/dag_processing.py| 162 +++--
docs/conf.py | 1 +
docs/dag-serialization.rst | 22 ++-
docs/executor/kubernetes.rst | 3 +
docs/img/serialized_dag_table.png | Bin 416085 -> 0 bytes
docs/spelling_wordlist.txt | 1 +
kubernetes_tests/test_kubernetes_pod_operator.py | 4 +-
scripts/ci/dockerfiles/bats/Dockerfile | 49 +++
.../ci/dockerfiles/bats}/build_and_push.sh | 17 ++-
.../ci/dockerfiles/bats/load.bash | 12 +-
scripts/ci/pre_commit/pre_commit_bat_tests.sh | 4 +-
.../{speccy_rules => spectral_rules}/connexion.yml | 10 +-
.../static_checks/{bat_tests.sh => bats_tests.sh} | 4 +-
setup.py | 2 +-
tests/bats/bats_utils.bash | 3 +-
tests/bats/test_breeze_params.bats | 60
tests/bats/test_empty_test.bats| 2 +-
tests/bats/test_local_mounts.bats | 8 +-
tests/cli/commands/test_dag_command.py | 18 ++-
tests/jobs/test_scheduler_job.py | 36 +++--
tests/models/test_dagrun.py| 1 +
.../operators/test_cloud_build_system_helper.py| 6 +-
.../google/cloud/operators/test_mlengine.py| 39 +
tests/providers/qubole/operators/test_qubole.py| 8 +
tests/ti_deps/deps/test_trigger_rule_dep.py| 4 +
tests/utils/logging_command_executor.py| 2 +-
tests/utils/test_dag_processing.py | 2 +-
42 files changed, 458 insertions(+), 258 deletions(-)
delete mode 100644 docs/img/serialized_dag_table.png
create mode 100644 scripts/ci/dockerfiles/bats/Dockerfile
copy {chart/dockerfiles/pgbouncer =>
scripts/ci/dockerfiles/bats}/build_and_push.sh (70%)
copy .hadolint.yaml => scripts/ci/dockerfiles/bats/load.bash (78%)
rename scripts/ci/{speccy_rules =&
[airflow] tag nightly-master updated (079d7b5 -> ba36f87)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 079d7b5 (commit) to ba36f87 (commit) from 079d7b5 Enable more checks for pydocstyle (#10741) add d84b62d Update node installation cmd (#10744) add 5b683f0 Improve test coverage for test_common_schema.py (#10740) add a1a312e Fix typo in test_dag_run_schema.py (#10739) add 7f0271f Improve test coverage for ConfObject in dag_run_schema (#10738) add 0faa710 Add black to STATIC_CODE_CHECKS.rst (#10737) add 4ce0a06 Remove duplicate entries from .mailmap (#10736) add 527ea81 Add docs for how airflow manages packages and imports (#10303) add ece685b Asynchronous execution of Dataproc jobs with a Sensor (#10673) add 28c21cf clean-logs script for Dockerfile: trim logs before sleep (#10685) add ba36f87 Make scripts/ci/openapi Google Shell Guide compatible (#10747) No new revisions were added by this update. Summary of changes: .mailmap | 3 - CONTRIBUTING.rst | 2 +- STATIC_CODE_CHECKS.rst | 2 + .../google/cloud/example_dags/example_dataproc.py | 16 ++ .../providers/google/cloud/operators/dataproc.py | 32 ++- airflow/providers/google/cloud/sensors/dataproc.py | 81 +++ docs/concepts.rst | 4 + docs/executor/celery.rst | 2 + docs/howto/custom-operator.rst | 1 + docs/howto/customize-state-colors-ui.rst | 5 + docs/howto/set-config.rst | 3 + docs/index.rst | 1 + docs/logging-monitoring/logging-tasks.rst | 1 + docs/logging-monitoring/metrics.rst| 2 + docs/modules_management.rst| 258 + docs/operators-and-hooks-ref.rst | 2 +- docs/plugins.rst | 3 + docs/security/api.rst | 2 + docs/spelling_wordlist.txt | 5 + docs/tutorial.rst | 3 + scripts/ci/openapi/client_codegen_diff.sh | 35 ++- scripts/in_container/prod/clean-logs.sh| 6 +- tests/api_connexion/schemas/test_common_schema.py | 8 +- tests/api_connexion/schemas/test_dag_run_schema.py | 6 +- .../google/cloud/operators/test_dataproc.py| 36 +++ .../google/cloud/sensors/test_dataproc.py | 128 ++ 26 files changed, 620 insertions(+), 27 deletions(-) create mode 100644 airflow/providers/google/cloud/sensors/dataproc.py create mode 100644 docs/modules_management.rst create mode 100644 tests/providers/google/cloud/sensors/test_dataproc.py
[airflow] tag nightly-master updated (079d7b5 -> ba36f87)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 079d7b5 (commit) to ba36f87 (commit) from 079d7b5 Enable more checks for pydocstyle (#10741) add d84b62d Update node installation cmd (#10744) add 5b683f0 Improve test coverage for test_common_schema.py (#10740) add a1a312e Fix typo in test_dag_run_schema.py (#10739) add 7f0271f Improve test coverage for ConfObject in dag_run_schema (#10738) add 0faa710 Add black to STATIC_CODE_CHECKS.rst (#10737) add 4ce0a06 Remove duplicate entries from .mailmap (#10736) add 527ea81 Add docs for how airflow manages packages and imports (#10303) add ece685b Asynchronous execution of Dataproc jobs with a Sensor (#10673) add 28c21cf clean-logs script for Dockerfile: trim logs before sleep (#10685) add ba36f87 Make scripts/ci/openapi Google Shell Guide compatible (#10747) No new revisions were added by this update. Summary of changes: .mailmap | 3 - CONTRIBUTING.rst | 2 +- STATIC_CODE_CHECKS.rst | 2 + .../google/cloud/example_dags/example_dataproc.py | 16 ++ .../providers/google/cloud/operators/dataproc.py | 32 ++- airflow/providers/google/cloud/sensors/dataproc.py | 81 +++ docs/concepts.rst | 4 + docs/executor/celery.rst | 2 + docs/howto/custom-operator.rst | 1 + docs/howto/customize-state-colors-ui.rst | 5 + docs/howto/set-config.rst | 3 + docs/index.rst | 1 + docs/logging-monitoring/logging-tasks.rst | 1 + docs/logging-monitoring/metrics.rst| 2 + docs/modules_management.rst| 258 + docs/operators-and-hooks-ref.rst | 2 +- docs/plugins.rst | 3 + docs/security/api.rst | 2 + docs/spelling_wordlist.txt | 5 + docs/tutorial.rst | 3 + scripts/ci/openapi/client_codegen_diff.sh | 35 ++- scripts/in_container/prod/clean-logs.sh| 6 +- tests/api_connexion/schemas/test_common_schema.py | 8 +- tests/api_connexion/schemas/test_dag_run_schema.py | 6 +- .../google/cloud/operators/test_dataproc.py| 36 +++ .../google/cloud/sensors/test_dataproc.py | 128 ++ 26 files changed, 620 insertions(+), 27 deletions(-) create mode 100644 airflow/providers/google/cloud/sensors/dataproc.py create mode 100644 docs/modules_management.rst create mode 100644 tests/providers/google/cloud/sensors/test_dataproc.py
[airflow] tag nightly-master updated (ba36f87 -> ddee0aa)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from ba36f87 (commit) to ddee0aa (commit) from ba36f87 Make scripts/ci/openapi Google Shell Guide compatible (#10747) add e3c750e Switch to downloaded pgbouncer_exporter (#10759) add 323319c Fix `breeze flags` command. (#10766) add 9f5b22f Move role guide to access control (#10755) add e3c83da Check all dockerfiles with hadolint (#10754) add 59f9a41 Add permission "extra_links" for Viewer role and above (#10719) add fbce92e The verbose functions will not exit immediately if not asked to (#10731) add ebb0a97 Make ci/scripts/pre-commit Google Shell Guide compatible (#10748) add ddee0aa Simplify load connection in LocalFilesystemBackend (#10638) No new revisions were added by this update. Summary of changes: .pre-commit-config.yaml| 2 +- airflow/secrets/local_filesystem.py| 38 -- airflow/www/security.py| 1 + breeze | 21 ++- chart/dockerfiles/pgbouncer-exporter/.gitignore| 1 + chart/dockerfiles/pgbouncer-exporter/Dockerfile| 41 ++ chart/dockerfiles/pgbouncer-exporter/README.md | 21 --- .../pgbouncer-exporter/build_and_push.sh | 96 ++ chart/dockerfiles/pgbouncer/Dockerfile | 18 ++- chart/dockerfiles/pgbouncer/build_and_push.sh | 2 +- chart/dockerfiles/statsd-exporter/Dockerfile | 3 +- .../dockerfiles/statsd-exporter/build_and_push.sh | 2 +- chart/values.yaml | 6 +- docs/howto/add-new-role.rst| 43 -- docs/howto/index.rst | 1 - docs/redirects.txt | 1 + docs/security/access-control.rst | 19 +++ scripts/ci/dockerfiles/bats/Dockerfile | 3 +- scripts/ci/dockerfiles/bats/build_and_push.sh | 2 +- scripts/ci/libraries/_build_images.sh | 22 +-- scripts/ci/libraries/_push_pull_remove_images.sh | 23 +--- scripts/ci/libraries/_start_end.sh | 5 +- scripts/ci/libraries/_verbosity.sh | 43 -- scripts/ci/pre_commit/pre_commit_bat_tests.sh | 6 +- .../ci/pre_commit/pre_commit_breeze_cmd_line.sh| 13 +- .../pre_commit_build_providers_dependencies.sh | 5 + .../ci/pre_commit/pre_commit_local_yml_mounts.sh | 10 +- scripts/ci/pre_commit/pre_commit_mermaid.sh| 27 ++-- scripts/ci/pre_commit/pre_commit_setup_cfg_file.sh | 24 +++- scripts/ci/static_checks/bats_tests.sh | 4 +- scripts/ci/static_checks/lint_dockerfile.sh| 16 +-- tests/secrets/test_local_filesystem.py | 147 - tests/www/test_views.py| 19 +++ 33 files changed, 434 insertions(+), 251 deletions(-) create mode 100644 chart/dockerfiles/pgbouncer-exporter/.gitignore create mode 100644 chart/dockerfiles/pgbouncer-exporter/Dockerfile delete mode 100644 chart/dockerfiles/pgbouncer-exporter/README.md create mode 100755 chart/dockerfiles/pgbouncer-exporter/build_and_push.sh delete mode 100644 docs/howto/add-new-role.rst
[airflow] tag nightly-master updated (ba36f87 -> ddee0aa)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from ba36f87 (commit) to ddee0aa (commit) from ba36f87 Make scripts/ci/openapi Google Shell Guide compatible (#10747) add e3c750e Switch to downloaded pgbouncer_exporter (#10759) add 323319c Fix `breeze flags` command. (#10766) add 9f5b22f Move role guide to access control (#10755) add e3c83da Check all dockerfiles with hadolint (#10754) add 59f9a41 Add permission "extra_links" for Viewer role and above (#10719) add fbce92e The verbose functions will not exit immediately if not asked to (#10731) add ebb0a97 Make ci/scripts/pre-commit Google Shell Guide compatible (#10748) add ddee0aa Simplify load connection in LocalFilesystemBackend (#10638) No new revisions were added by this update. Summary of changes: .pre-commit-config.yaml| 2 +- airflow/secrets/local_filesystem.py| 38 -- airflow/www/security.py| 1 + breeze | 21 ++- chart/dockerfiles/pgbouncer-exporter/.gitignore| 1 + chart/dockerfiles/pgbouncer-exporter/Dockerfile| 41 ++ chart/dockerfiles/pgbouncer-exporter/README.md | 21 --- .../pgbouncer-exporter/build_and_push.sh | 96 ++ chart/dockerfiles/pgbouncer/Dockerfile | 18 ++- chart/dockerfiles/pgbouncer/build_and_push.sh | 2 +- chart/dockerfiles/statsd-exporter/Dockerfile | 3 +- .../dockerfiles/statsd-exporter/build_and_push.sh | 2 +- chart/values.yaml | 6 +- docs/howto/add-new-role.rst| 43 -- docs/howto/index.rst | 1 - docs/redirects.txt | 1 + docs/security/access-control.rst | 19 +++ scripts/ci/dockerfiles/bats/Dockerfile | 3 +- scripts/ci/dockerfiles/bats/build_and_push.sh | 2 +- scripts/ci/libraries/_build_images.sh | 22 +-- scripts/ci/libraries/_push_pull_remove_images.sh | 23 +--- scripts/ci/libraries/_start_end.sh | 5 +- scripts/ci/libraries/_verbosity.sh | 43 -- scripts/ci/pre_commit/pre_commit_bat_tests.sh | 6 +- .../ci/pre_commit/pre_commit_breeze_cmd_line.sh| 13 +- .../pre_commit_build_providers_dependencies.sh | 5 + .../ci/pre_commit/pre_commit_local_yml_mounts.sh | 10 +- scripts/ci/pre_commit/pre_commit_mermaid.sh| 27 ++-- scripts/ci/pre_commit/pre_commit_setup_cfg_file.sh | 24 +++- scripts/ci/static_checks/bats_tests.sh | 4 +- scripts/ci/static_checks/lint_dockerfile.sh| 16 +-- tests/secrets/test_local_filesystem.py | 147 - tests/www/test_views.py| 19 +++ 33 files changed, 434 insertions(+), 251 deletions(-) create mode 100644 chart/dockerfiles/pgbouncer-exporter/.gitignore create mode 100644 chart/dockerfiles/pgbouncer-exporter/Dockerfile delete mode 100644 chart/dockerfiles/pgbouncer-exporter/README.md create mode 100755 chart/dockerfiles/pgbouncer-exporter/build_and_push.sh delete mode 100644 docs/howto/add-new-role.rst
[airflow] tag nightly-master updated (9b2efc6 -> 4476a09)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 9b2efc6 (commit) to 4476a09 (commit) from 9b2efc6 Improve logging & monitoring docs (#10618) add 11c00bc Fix typos: duplicated "the" (#10647) add 4476a09 Update INTHEWILD.md (#10649) No new revisions were added by this update. Summary of changes: INTHEWILD.md| 1 + airflow/providers/google/cloud/utils/field_validator.py | 2 +- airflow/providers/google/firebase/example_dags/example_firestore.py | 2 +- backport_packages/refactor_backport_packages.py | 2 +- tests/api/common/experimental/test_mark_tasks.py| 2 +- 5 files changed, 5 insertions(+), 4 deletions(-)
[airflow] tag nightly-master updated (9b2efc6 -> 4476a09)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 9b2efc6 (commit) to 4476a09 (commit) from 9b2efc6 Improve logging & monitoring docs (#10618) add 11c00bc Fix typos: duplicated "the" (#10647) add 4476a09 Update INTHEWILD.md (#10649) No new revisions were added by this update. Summary of changes: INTHEWILD.md| 1 + airflow/providers/google/cloud/utils/field_validator.py | 2 +- airflow/providers/google/firebase/example_dags/example_firestore.py | 2 +- backport_packages/refactor_backport_packages.py | 2 +- tests/api/common/experimental/test_mark_tasks.py| 2 +- 5 files changed, 5 insertions(+), 4 deletions(-)
[airflow] tag nightly-master updated (4476a09 -> f40ac9b)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from 4476a09 (commit)
to f40ac9b (commit)
from 4476a09 Update INTHEWILD.md (#10649)
add e4878e6 fix type hints for s3 hook read_key method (#10653)
add 0be1406 Adds pip-wheel metadata in .gitignore (#10657)
add c320d99 Small fixes in Breeze/Static check/docs documentation (#10658)
add 46c8d67 Implement Google Shell Conventions for breeze script …
(#10651)
add 596bc13 Adds 'cncf.kubernetes' package back to backport provider
packages. (#10659)
add e6a0a53 Display conf as a JSON in the DagRun list view (#10644)
add aa2db70 Unify error messages and complete type field in response
(#10333)
add 4fd81f5 Add howto doc for Salesforce connection (#10482)
add aff8c76 Add example on airflow users create --help (#10662)
add 901ecf7 Remove requirements from the project. (#10668)
add f40ac9b Add placement_strategy option (#9444)
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci.yml |2 +-
.gitignore |3 +
BREEZE.rst | 14 +-
STATIC_CODE_CHECKS.rst | 17 +-
.../api_connexion/endpoints/connection_endpoint.py | 21 +-
airflow/api_connexion/endpoints/dag_endpoint.py|4 +-
.../api_connexion/endpoints/dag_run_endpoint.py|7 +-
.../endpoints/import_error_endpoint.py |5 +-
airflow/api_connexion/exceptions.py| 113 +-
airflow/api_connexion/openapi/v1.yaml | 29 +
airflow/cli/cli_parser.py | 15 +-
airflow/providers/amazon/aws/hooks/s3.py |4 +-
airflow/providers/amazon/aws/operators/ecs.py |7 +
.../providers/cncf/kubernetes/ADDITIONAL_INFO.md |8 +-
airflow/www/extensions/init_views.py |4 +-
airflow/www/utils.py |9 +
airflow/www/views.py |1 +
.../PROVIDERS_README_TEMPLATE.md.jinja2|6 -
backport_packages/setup_backport_packages.py | 11 +-
breeze | 2567
breeze-complete| 20 +-
confirm|2 +-
docs/howto/connection/salesforce.rst | 73 +
docs/spelling_wordlist.txt | 64 +-
requirements/requirements-python3.6.txt| 400 ---
requirements/requirements-python3.7.txt| 393 ---
requirements/requirements-python3.8.txt| 394 ---
requirements/setup-3.6.md5 |1 -
requirements/setup-3.7.md5 |1 -
requirements/setup-3.8.md5 |1 -
.../ci_prepare_and_test_backport_packages.sh |2 -
.../ci_prepare_backport_packages.sh|4 -
.../ci_prepare_backport_readme.sh |4 -
...ci_test_backport_packages_import_all_classes.sh |4 -
...ci_test_backport_packages_install_separately.sh |4 -
scripts/ci/constraints/ci_branch_constraints.sh|4 -
scripts/ci/constraints/ci_commit_constraints.sh|4 -
scripts/ci/constraints/ci_generate_constraints.sh |4 -
scripts/ci/docs/ci_docs.sh |4 -
scripts/ci/images/ci_prepare_ci_image_on_ci.sh |1 -
scripts/ci/images/ci_prepare_prod_image_on_ci.sh |1 -
scripts/ci/images/ci_push_ci_images.sh |2 -
scripts/ci/images/ci_push_production_images.sh |2 -
scripts/ci/images/ci_wait_for_all_ci_images.sh | 26 +-
scripts/ci/images/ci_wait_for_all_prod_images.sh | 29 +-
.../ci/kubernetes/ci_deploy_app_to_kubernetes.sh | 12 +-
scripts/ci/kubernetes/ci_run_kubernetes_tests.sh | 11 +-
scripts/ci/libraries/_all_libs.sh | 10 +-
scripts/ci/libraries/_build_images.sh | 210 +-
scripts/ci/libraries/_initialization.sh| 251 +-
scripts/ci/libraries/_kind.sh | 56 +-
scripts/ci/libraries/_md5sum.sh|8 +-
scripts/ci/libraries/_push_pull_remove_images.sh | 37 +-
scripts/ci/libraries/_sanity_checks.sh | 25 +-
scripts/ci/libraries/_script_init.sh | 23 +-
scripts/ci/libraries/_start_end.sh |1 -
scripts/ci/libraries/{_pylint.sh => _traps.sh} | 35 +-
scripts/ci/libraries/_verbosity.sh | 48 +-
scripts/ci/openapi/client_codegen_diff.sh |1 -
.../ci/pre_commit/pre_commit_breeze_cmd_line.sh| 16 +
.../ci/pre_commit/pre_commit_check_integrations.sh |5 +-
scri
[airflow] branch constraints-master updated: Updating constraints. Build id:248490316
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 9682084 Updating constraints. Build id:248490316 9682084 is described below commit 96820846b5fc3d19ccf35e6934536637ebb6 Author: Automated Github Actions commit AuthorDate: Thu Sep 10 18:40:36 2020 + Updating constraints. Build id:248490316 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha b9dc3c51ba2cba1c61d327488cecf2623d6445b3. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 1 + constraints-3.7.txt | 1 + constraints-3.8.txt | 1 + 3 files changed, 3 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 2cddbd0..4045d5d 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -44,6 +44,7 @@ apipkg==1.5 apispec==3.3.1 appdirs==1.4.4 argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 95013b0..47cb349 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -44,6 +44,7 @@ apipkg==1.5 apispec==3.3.1 appdirs==1.4.4 argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 1c5e43f..2d3c236 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -44,6 +44,7 @@ apipkg==1.5 apispec==3.3.1 appdirs==1.4.4 argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10
[airflow] tag nightly-master updated (ddee0aa -> 3a4f517)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from ddee0aa (commit) to 3a4f517 (commit) from ddee0aa Simplify load connection in LocalFilesystemBackend (#10638) add 18b80f3 The scripts to run tests properly initialises constants (#10769) add 1959d6a Make static checks Google Shell Guide compatible (#10750) add c8ee455 Refactor DataprocCreateCluster operator to use simpler interface (#10403) add f14f379 [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773) add ef0d639 Fixes pre-commit failing on build step (#10785) add 3a4f517 fix task instance modal open performance issue (#10764) No new revisions were added by this update. Summary of changes: .../google/cloud/example_dags/example_dataproc.py | 42 ++-- airflow/providers/google/cloud/hooks/dataproc.py | 29 ++- .../providers/google/cloud/operators/dataproc.py | 216 --- .../google/cloud/transfers/bigquery_to_gcs.py | 38 ++-- airflow/www/templates/airflow/dag.html | 9 +- scripts/ci/libraries/_build_images.sh | 4 +- scripts/ci/static_checks/bats_tests.sh | 5 +- scripts/ci/static_checks/check_license.sh | 7 +- scripts/ci/static_checks/flake8.sh | 6 +- scripts/ci/static_checks/mypy.sh | 10 +- scripts/ci/static_checks/pylint.sh | 5 +- scripts/ci/static_checks/refresh_pylint_todo.sh| 2 +- scripts/ci/static_checks/run_static_checks.sh | 6 +- scripts/ci/testing/ci_run_airflow_testing.sh | 63 ++ scripts/in_container/_in_container_utils.sh| 2 +- .../providers/google/cloud/hooks/test_dataproc.py | 45 ++-- .../google/cloud/operators/test_dataproc.py| 239 ++--- .../google/cloud/operators/test_dataproc_system.py | 13 +- .../google/cloud/transfers/test_bigquery_to_gcs.py | 30 ++- tests/test_utils/gcp_system_helpers.py | 2 +- 20 files changed, 373 insertions(+), 400 deletions(-)
[airflow] tag nightly-master updated (ddee0aa -> 3a4f517)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from ddee0aa (commit) to 3a4f517 (commit) from ddee0aa Simplify load connection in LocalFilesystemBackend (#10638) add 18b80f3 The scripts to run tests properly initialises constants (#10769) add 1959d6a Make static checks Google Shell Guide compatible (#10750) add c8ee455 Refactor DataprocCreateCluster operator to use simpler interface (#10403) add f14f379 [AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773) add ef0d639 Fixes pre-commit failing on build step (#10785) add 3a4f517 fix task instance modal open performance issue (#10764) No new revisions were added by this update. Summary of changes: .../google/cloud/example_dags/example_dataproc.py | 42 ++-- airflow/providers/google/cloud/hooks/dataproc.py | 29 ++- .../providers/google/cloud/operators/dataproc.py | 216 --- .../google/cloud/transfers/bigquery_to_gcs.py | 38 ++-- airflow/www/templates/airflow/dag.html | 9 +- scripts/ci/libraries/_build_images.sh | 4 +- scripts/ci/static_checks/bats_tests.sh | 5 +- scripts/ci/static_checks/check_license.sh | 7 +- scripts/ci/static_checks/flake8.sh | 6 +- scripts/ci/static_checks/mypy.sh | 10 +- scripts/ci/static_checks/pylint.sh | 5 +- scripts/ci/static_checks/refresh_pylint_todo.sh| 2 +- scripts/ci/static_checks/run_static_checks.sh | 6 +- scripts/ci/testing/ci_run_airflow_testing.sh | 63 ++ scripts/in_container/_in_container_utils.sh| 2 +- .../providers/google/cloud/hooks/test_dataproc.py | 45 ++-- .../google/cloud/operators/test_dataproc.py| 239 ++--- .../google/cloud/operators/test_dataproc_system.py | 13 +- .../google/cloud/transfers/test_bigquery_to_gcs.py | 30 ++- tests/test_utils/gcp_system_helpers.py | 2 +- 20 files changed, 373 insertions(+), 400 deletions(-)
[airflow] tag nightly-master updated (87e7ad9 -> 22c6316)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 87e7ad9 (commit) to 22c6316 (commit) from 87e7ad9 fix bug where multiple volume mounts created (#10915) add 791f904 Adds the maintain-heart-rate to quarantine. (#10922) add d26830f Make vrious scripts Google Shell Guide compatible (#10812) add f696322 Make Clients Google Shell guide compatible (#10810) add b2dc346 Make breeeze-complete Google Shell Guide compatible (#10708) add ad4f232 Remove unknown pytest.ini setting (#10923) add 9e42a97 Mark task as failed when it fails sending in Celery (#10881) add 383a118 Add more type annotations to AWS hooks (#10671) add 7b4dc63 Add Formatted Stacktrace for Spelling Error (#10919) add e9add79 Fix Failing static tests on Master (#10927) add eaa49b2 Fix chain methods for XComArg (#10827) add 67402b7 Fix grammar in Bug Report Template (#10936) add 2832c95 Stop running Doc tests with Spelling tests (#10938) add 4e1f3a6 [AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655) add 5d6d5a2 Allow to specify path to kubeconfig in KubernetesHook (#10453) add d24b8f6 Add Examples and documentation for pod_template_file feature (#10916) add aab9599 Fix 'Tasks State' stats UI Overlap (#10939) add b628067 Minor refactor of the login methods in tests.www.test_views (#10918) add 83ed6bd Cache for kubernetes tests is updateable (#10945) add 9616518 Add CeleryKubernetesExecutor (#10901) add 23768f6 Proposal: remove -serviceaccount suffix from KSA names in helm chart (#10892) add 791a175 Fix the method defaults for _construct_volume (#10948) add d43bb75 Remove test dependency from TestApiKerberos (#10950) add 14f2763 Fixes retrieval of correct branch in non-master related builds (#10912) add 45272a8 Github repository can be overridden in command line by Breeze (#10943) add e4e316a Fix Kubernetes Executor logs for long dag names (#10942) add ce19657 Fix case of GitHub. (#10955) add f7da7d9 Fix ExternalTaskMarker serialized fields (#10924) add 905cdd5 Add a default for DagModel.default_view (#10897) add 22c6316 Fix more docs spellings (#10965) No new revisions were added by this update. Summary of changes: .github/ISSUE_TEMPLATE/bug_report.md | 2 +- .github/SECURITY.rst | 2 +- .github/workflows/build-images-workflow-run.yml| 36 ++- .github/workflows/ci.yml | 2 +- .pre-commit-config.yaml| 4 +- BREEZE.rst | 2 +- CHANGELOG.txt | 6 +- CI.rst | 10 +- CONTRIBUTING.rst | 16 +- IMAGES.rst | 10 +- STATIC_CODE_CHECKS.rst | 2 +- airflow/config_templates/config.yml| 18 +- airflow/config_templates/default_airflow.cfg | 13 +- airflow/example_dags/example_xcomargs.py | 18 +- airflow/executors/celery_executor.py | 6 +- airflow/executors/celery_kubernetes_executor.py| 158 +++ airflow/executors/executor_loader.py | 30 ++- .../dags_in_image_template.yaml| 84 ++ .../dags_in_volume_template.yaml | 81 ++ .../git_sync_template.yaml | 107 airflow/kubernetes/worker_configuration.py | 2 +- airflow/models/dag.py | 15 ++ airflow/models/taskinstance.py | 2 +- airflow/models/xcom_arg.py | 18 +- airflow/providers/amazon/aws/hooks/aws_dynamodb.py | 13 +- airflow/providers/amazon/aws/hooks/base_aws.py | 36 ++- airflow/providers/amazon/aws/hooks/ec2.py | 5 +- airflow/providers/amazon/aws/hooks/emr.py | 13 +- airflow/providers/amazon/aws/hooks/kinesis.py | 9 +- .../providers/amazon/aws/hooks/lambda_function.py | 15 +- airflow/providers/amazon/aws/hooks/logs.py | 19 +- airflow/providers/amazon/aws/hooks/redshift.py | 5 +- .../providers/amazon/aws/hooks/secrets_manager.py | 68 + airflow/providers/amazon/aws/hooks/sqs.py | 17 +- .../providers/amazon/aws/hooks/step_function.py| 5 +- .../providers/cncf/kubernetes/hooks/kubernetes.py | 55 +++- .../dingding/example_dags/example_dingding.py | 2 +- airflow/providers/google/cloud/hooks/bigquery.py | 2 +- .../providers/google/cloud/hooks/datacatalog.py| 2 +- airflow/providers/google/cloud/hooks/gdm.py| 2 +- .../google/cloud/operators
[airflow] tag nightly-master updated (87e7ad9 -> 22c6316)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 87e7ad9 (commit) to 22c6316 (commit) from 87e7ad9 fix bug where multiple volume mounts created (#10915) add 791f904 Adds the maintain-heart-rate to quarantine. (#10922) add d26830f Make vrious scripts Google Shell Guide compatible (#10812) add f696322 Make Clients Google Shell guide compatible (#10810) add b2dc346 Make breeeze-complete Google Shell Guide compatible (#10708) add ad4f232 Remove unknown pytest.ini setting (#10923) add 9e42a97 Mark task as failed when it fails sending in Celery (#10881) add 383a118 Add more type annotations to AWS hooks (#10671) add 7b4dc63 Add Formatted Stacktrace for Spelling Error (#10919) add e9add79 Fix Failing static tests on Master (#10927) add eaa49b2 Fix chain methods for XComArg (#10827) add 67402b7 Fix grammar in Bug Report Template (#10936) add 2832c95 Stop running Doc tests with Spelling tests (#10938) add 4e1f3a6 [AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655) add 5d6d5a2 Allow to specify path to kubeconfig in KubernetesHook (#10453) add d24b8f6 Add Examples and documentation for pod_template_file feature (#10916) add aab9599 Fix 'Tasks State' stats UI Overlap (#10939) add b628067 Minor refactor of the login methods in tests.www.test_views (#10918) add 83ed6bd Cache for kubernetes tests is updateable (#10945) add 9616518 Add CeleryKubernetesExecutor (#10901) add 23768f6 Proposal: remove -serviceaccount suffix from KSA names in helm chart (#10892) add 791a175 Fix the method defaults for _construct_volume (#10948) add d43bb75 Remove test dependency from TestApiKerberos (#10950) add 14f2763 Fixes retrieval of correct branch in non-master related builds (#10912) add 45272a8 Github repository can be overridden in command line by Breeze (#10943) add e4e316a Fix Kubernetes Executor logs for long dag names (#10942) add ce19657 Fix case of GitHub. (#10955) add f7da7d9 Fix ExternalTaskMarker serialized fields (#10924) add 905cdd5 Add a default for DagModel.default_view (#10897) add 22c6316 Fix more docs spellings (#10965) No new revisions were added by this update. Summary of changes: .github/ISSUE_TEMPLATE/bug_report.md | 2 +- .github/SECURITY.rst | 2 +- .github/workflows/build-images-workflow-run.yml| 36 ++- .github/workflows/ci.yml | 2 +- .pre-commit-config.yaml| 4 +- BREEZE.rst | 2 +- CHANGELOG.txt | 6 +- CI.rst | 10 +- CONTRIBUTING.rst | 16 +- IMAGES.rst | 10 +- STATIC_CODE_CHECKS.rst | 2 +- airflow/config_templates/config.yml| 18 +- airflow/config_templates/default_airflow.cfg | 13 +- airflow/example_dags/example_xcomargs.py | 18 +- airflow/executors/celery_executor.py | 6 +- airflow/executors/celery_kubernetes_executor.py| 158 +++ airflow/executors/executor_loader.py | 30 ++- .../dags_in_image_template.yaml| 84 ++ .../dags_in_volume_template.yaml | 81 ++ .../git_sync_template.yaml | 107 airflow/kubernetes/worker_configuration.py | 2 +- airflow/models/dag.py | 15 ++ airflow/models/taskinstance.py | 2 +- airflow/models/xcom_arg.py | 18 +- airflow/providers/amazon/aws/hooks/aws_dynamodb.py | 13 +- airflow/providers/amazon/aws/hooks/base_aws.py | 36 ++- airflow/providers/amazon/aws/hooks/ec2.py | 5 +- airflow/providers/amazon/aws/hooks/emr.py | 13 +- airflow/providers/amazon/aws/hooks/kinesis.py | 9 +- .../providers/amazon/aws/hooks/lambda_function.py | 15 +- airflow/providers/amazon/aws/hooks/logs.py | 19 +- airflow/providers/amazon/aws/hooks/redshift.py | 5 +- .../providers/amazon/aws/hooks/secrets_manager.py | 68 + airflow/providers/amazon/aws/hooks/sqs.py | 17 +- .../providers/amazon/aws/hooks/step_function.py| 5 +- .../providers/cncf/kubernetes/hooks/kubernetes.py | 55 +++- .../dingding/example_dags/example_dingding.py | 2 +- airflow/providers/google/cloud/hooks/bigquery.py | 2 +- .../providers/google/cloud/hooks/datacatalog.py| 2 +- airflow/providers/google/cloud/hooks/gdm.py| 2 +- .../google/cloud/operators
[airflow] branch constraints-master updated: Updating constraints. Build id:252511905
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6251945 Updating constraints. Build id:252511905 6251945 is described below commit 625194596587bd8b3ef54f1902b6060e4a0c187b Author: Automated Github Actions commit AuthorDate: Sun Sep 13 15:53:19 2020 + Updating constraints. Build id:252511905 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 12a652f5344c7f03c3d780556ca1829b235fdb2d. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 9 + constraints-3.7.txt | 9 + constraints-3.8.txt | 9 + 3 files changed, 27 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 4045d5d..5d4c0d2 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -55,8 +55,14 @@ aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 +azure-core==1.8.1 azure-cosmos==3.2.0 azure-datalake-store==0.0.49 +azure-identity==1.4.0 +azure-keyvault-certificates==4.2.1 +azure-keyvault-keys==4.2.0 +azure-keyvault-secrets==4.2.0 +azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 azure-mgmt-datalake-nspkg==3.0.1 @@ -228,6 +234,8 @@ mongomock==3.20.0 monotonic==1.5 more-itertools==8.4.0 moto==1.3.14 +msal-extensions==0.2.2 +msal==1.5.0 msgpack==1.0.0 msrest==0.6.18 msrestazure==0.6.4 @@ -265,6 +273,7 @@ pickleshare==0.7.5 pinotdb==0.1.1 pipdeptree==1.0.0 pluggy==0.13.1 +portalocker==1.7.1 pre-commit==2.6.0 presto-python-client==0.7.0 prison==0.1.3 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 47cb349..d3e8d18 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -55,8 +55,14 @@ aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 +azure-core==1.8.1 azure-cosmos==3.2.0 azure-datalake-store==0.0.49 +azure-identity==1.4.0 +azure-keyvault-certificates==4.2.1 +azure-keyvault-keys==4.2.0 +azure-keyvault-secrets==4.2.0 +azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 azure-mgmt-datalake-nspkg==3.0.1 @@ -224,6 +230,8 @@ mongomock==3.20.0 monotonic==1.5 more-itertools==8.4.0 moto==1.3.14 +msal-extensions==0.2.2 +msal==1.5.0 msgpack==1.0.0 msrest==0.6.18 msrestazure==0.6.4 @@ -260,6 +268,7 @@ pickleshare==0.7.5 pinotdb==0.1.1 pipdeptree==1.0.0 pluggy==0.13.1 +portalocker==1.7.1 pre-commit==2.6.0 presto-python-client==0.7.0 prison==0.1.3 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 2d3c236..5a9fda8 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -55,8 +55,14 @@ aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 +azure-core==1.8.1 azure-cosmos==3.2.0 azure-datalake-store==0.0.49 +azure-identity==1.4.0 +azure-keyvault-certificates==4.2.1 +azure-keyvault-keys==4.2.0 +azure-keyvault-secrets==4.2.0 +azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 azure-mgmt-datalake-nspkg==3.0.1 @@ -224,6 +230,8 @@ mongomock==3.20.0 monotonic==1.5 more-itertools==8.4.0 moto==1.3.14 +msal-extensions==0.2.2 +msal==1.5.0 msgpack==1.0.0 msrest==0.6.18 msrestazure==0.6.4 @@ -260,6 +268,7 @@ pickleshare==0.7.5 pinotdb==0.1.1 pipdeptree==1.0.0 pluggy==0.13.1 +portalocker==1.7.1 pre-commit==2.6.0 presto-python-client==0.7.0 prison==0.1.3
[airflow] branch constraints-master updated: Updating constraints. Build id:252511905
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6251945 Updating constraints. Build id:252511905 6251945 is described below commit 625194596587bd8b3ef54f1902b6060e4a0c187b Author: Automated Github Actions commit AuthorDate: Sun Sep 13 15:53:19 2020 + Updating constraints. Build id:252511905 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 12a652f5344c7f03c3d780556ca1829b235fdb2d. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 9 + constraints-3.7.txt | 9 + constraints-3.8.txt | 9 + 3 files changed, 27 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 4045d5d..5d4c0d2 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -55,8 +55,14 @@ aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 +azure-core==1.8.1 azure-cosmos==3.2.0 azure-datalake-store==0.0.49 +azure-identity==1.4.0 +azure-keyvault-certificates==4.2.1 +azure-keyvault-keys==4.2.0 +azure-keyvault-secrets==4.2.0 +azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 azure-mgmt-datalake-nspkg==3.0.1 @@ -228,6 +234,8 @@ mongomock==3.20.0 monotonic==1.5 more-itertools==8.4.0 moto==1.3.14 +msal-extensions==0.2.2 +msal==1.5.0 msgpack==1.0.0 msrest==0.6.18 msrestazure==0.6.4 @@ -265,6 +273,7 @@ pickleshare==0.7.5 pinotdb==0.1.1 pipdeptree==1.0.0 pluggy==0.13.1 +portalocker==1.7.1 pre-commit==2.6.0 presto-python-client==0.7.0 prison==0.1.3 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 47cb349..d3e8d18 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -55,8 +55,14 @@ aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 +azure-core==1.8.1 azure-cosmos==3.2.0 azure-datalake-store==0.0.49 +azure-identity==1.4.0 +azure-keyvault-certificates==4.2.1 +azure-keyvault-keys==4.2.0 +azure-keyvault-secrets==4.2.0 +azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 azure-mgmt-datalake-nspkg==3.0.1 @@ -224,6 +230,8 @@ mongomock==3.20.0 monotonic==1.5 more-itertools==8.4.0 moto==1.3.14 +msal-extensions==0.2.2 +msal==1.5.0 msgpack==1.0.0 msrest==0.6.18 msrestazure==0.6.4 @@ -260,6 +268,7 @@ pickleshare==0.7.5 pinotdb==0.1.1 pipdeptree==1.0.0 pluggy==0.13.1 +portalocker==1.7.1 pre-commit==2.6.0 presto-python-client==0.7.0 prison==0.1.3 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 2d3c236..5a9fda8 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -55,8 +55,14 @@ aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 +azure-core==1.8.1 azure-cosmos==3.2.0 azure-datalake-store==0.0.49 +azure-identity==1.4.0 +azure-keyvault-certificates==4.2.1 +azure-keyvault-keys==4.2.0 +azure-keyvault-secrets==4.2.0 +azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 azure-mgmt-datalake-nspkg==3.0.1 @@ -224,6 +230,8 @@ mongomock==3.20.0 monotonic==1.5 more-itertools==8.4.0 moto==1.3.14 +msal-extensions==0.2.2 +msal==1.5.0 msgpack==1.0.0 msrest==0.6.18 msrestazure==0.6.4 @@ -260,6 +268,7 @@ pickleshare==0.7.5 pinotdb==0.1.1 pipdeptree==1.0.0 pluggy==0.13.1 +portalocker==1.7.1 pre-commit==2.6.0 presto-python-client==0.7.0 prison==0.1.3
[airflow] tag nightly-master updated (f40ac9b -> 4e09cb5)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from f40ac9b (commit) to 4e09cb5 (commit) from f40ac9b Add placement_strategy option (#9444) add 804548d Add Dataprep operators (#10304) add cc551ba Add packages to function names in bash (#10670) add 70f05ac Add `log_id` field to log lines on ES handler (#10411) add 8ac6f29 Fix format of install commands (#10676) add 4c4a7a8 Improve getting started section (#10680) add 50c9411 Remove airflow-pr tool (#10675) add 805781b Update INTHEWILD.md (#10683) add 0d76b59 Remove redundant section from dev/README.md toc (#10689) add 72b2be7 [AIRFLOW-XXX] Add task execution process on Celery Execution diagram (#6961) add 9108cb5 docs: They added support for celltags to Jupyter Lab (#9141) add 0d9e421 Unify command names in CLI (#10669) add 338b412 Add on_kill support for the KubernetesPodOperator (#10666) add 9a10f83 Revert recent breeze changes (#10651 & #10670) (#10694) add 02b853b Fix failing black test (#10697) add 48ce4bd Fix missing dash in flag for statsd container (#10691) add e5785d4 Chart: Flower deployment should use Flower image (#10701) add 649ce4b Implement Google Shell Conventions for breeze script (#10695) add 4e09cb5 Add packages to function names in bash (#10670) (#10696) No new revisions were added by this update. Summary of changes: .pre-commit-config.yaml|6 +- BREEZE.rst |2 +- IMAGES.rst |4 +- INTHEWILD.md |1 + README.md |8 +- UPDATING.md| 75 +- airflow/cli/cli_parser.py | 16 +- airflow/cli/commands/legacy_commands.py|4 +- airflow/cli/commands/task_command.py |2 +- airflow/models/connection.py |2 +- .../cncf/kubernetes/operators/kubernetes_pod.py| 10 + .../providers/elasticsearch/log/es_task_handler.py |3 + .../google/cloud/example_dags/example_dataprep.py | 45 +- airflow/providers/google/cloud/hooks/dataprep.py | 76 +- .../providers/google/cloud/operators/dataprep.py | 76 +- breeze | 426 chart/templates/_helpers.yaml |2 +- chart/templates/statsd/statsd-deployment.yaml |2 +- dev/README.md | 85 +- dev/airflow-pr | 1036 dev/requirements.txt |4 +- docs/executor/celery.rst | 35 + docs/howto/operator/google/cloud/dataprep.rst | 76 +- docs/howto/operator/papermill.rst |3 - docs/img/run_task_on_celery_executor.png | Bin 0 -> 55939 bytes docs/img/run_task_on_celery_executor.puml | 77 ++ docs/security/secrets/fernet.rst |2 +- kubernetes_tests/test_kubernetes_pod_operator.py | 28 + .../ci_prepare_backport_packages.sh|6 +- .../ci_prepare_backport_readme.sh |6 +- ...ci_test_backport_packages_import_all_classes.sh |4 +- ...ci_test_backport_packages_install_separately.sh |4 +- scripts/ci/constraints/ci_generate_constraints.sh |6 +- scripts/ci/docs/ci_docs.sh |6 +- scripts/ci/images/ci_build_dockerhub.sh| 12 +- scripts/ci/images/ci_prepare_ci_image_on_ci.sh | 12 +- scripts/ci/images/ci_prepare_prod_image_on_ci.sh |8 +- scripts/ci/images/ci_push_ci_images.sh |4 +- scripts/ci/images/ci_push_production_images.sh |4 +- scripts/ci/images/ci_wait_for_all_ci_images.sh |4 +- scripts/ci/images/ci_wait_for_all_prod_images.sh |6 +- .../ci/kubernetes/ci_deploy_app_to_kubernetes.sh | 20 +- scripts/ci/kubernetes/ci_run_kubernetes_tests.sh |6 +- scripts/ci/libraries/_build_images.sh | 190 ++-- scripts/ci/libraries/_initialization.sh| 102 +- scripts/ci/libraries/_kind.sh | 48 +- scripts/ci/libraries/_local_mounts.sh |6 +- scripts/ci/libraries/_md5sum.sh| 44 +- scripts/ci/libraries/_parameters.sh|8 +- scripts/ci/libraries/_permissions.sh | 22 +- scripts/ci/libraries/_push_pull_remove_images.sh | 52 +- scripts/ci/libraries/_pylint.sh|2 +- scripts/ci/libraries/_runs.sh |8 +- scripts/ci/libraries/_sanity_ch
[airflow] tag nightly-master updated (3a4f517 -> 7dd7be3)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 3a4f517 (commit) to 7dd7be3 (commit) from 3a4f517 fix task instance modal open performance issue (#10764) add b746f33 Removes stable tests from quarantine (#10768) add 10ce311 Deprecate using global as the default region in Google Dataproc operators and hooks (#10772) add 2934220 Always return a list from S3Hook list methods (#10774) add 4de67a6 Move dev docker images to airflow registry (#9652) add 3c3342f Add unit test for AzureCosmosDocumentSensor (#10765) add 078bfaf Extract missing gcs_to_local example DAG from gcs example (#10767) add 961131d All files in providers package heve unit tests (#10799) add cd0cc4c Check that all pre-commits are synchronized code<>docs (#10789) add 417ab30 Add section for official source code (#10678) add aaf56f9 Refactor official source section to use bullets (#10801) add 43303f1 Make script/ci/images Google Shell Guide compatible (#10745) add 4f07463 Make script/ci/kubernetes Google Shell Guide Compatible (#10746) add 71e1d09 Fixed wrong "-e" on md5 file status check (#10803) add 3c6fdd8 Make ci/backport_packages Google Shell guide compliant (#10733) add c60fccc Fix integration tests being accidentally excluded (#10807) add 2811851 Move Impersonation test back to quarantine (#10809) add 7fd65d7 Don't include kubernetes_tests/ and backport_packages/ in our wheel (#10805) add ff41361 Add task logging handler to airflow info command (#10771) add ac943c9 [AIRFLOW-3964][AIP-17] Consolidate and de-dup sensor tasks using Smart Sensor (#5499) add 20481c3 Add pod_override setting for KubernetesExecutor (#10756) add 004e1d8 Update log exception to reflect rename of execute_helper (#10819) add 9549274 Upgrade black to 20.8b1 (#10818) add 7edfac9 Add connection caching to KubernetesHook (#10447) add 40939dc Make airflow testing Google Shell Guide compatible (#10813) add 409ebc1 Make scripts/ci/tools Google Shell Guide Compatible (#10811) add 7adae24 Add documentation for preparing database for Airflow (#10413) add a356656 Make dockerfiles Google Shell Guide Compliant (#10734) add 9f23407 Fix doc errors introduced in #10413 (#10832) add dfcb7af Fix typos in the stackdriver howto document (#10834) add 9528f15 Fix doc errors introduced in #10413 (#10833) add cc851c7 Fix grammar in UPDATING.md (#10841) add e1e0485 Remove k8s dependency from serialization (#10831) add 0d38cf1 Fix typo in docs/howto/operator/amazon/aws/emr.rst (#10844) add ee8b02a Add missing assert call in test_dbapi_hook.py (#10842) add f920957 Fix and remove some more typos from spelling_wordlist.txt (#10845) add ce66bc9 Add test for Health Endpoint when there is an exception (#10846) add eaf4f67 Add USC Graduate School to INTHEWILD.md (#10843) add ff72327 Move parse_once to quarantine (#10857) add 67af97a Rename "Beyond the Horizon" section and refactor content (#10802) add 63b6e53 Detect orphaned task instances by SchedulerJob id and heartbeat (#10729) add 1a95361 Fix and unquarantine TestDagFileProcessorAgent.test_parse_once (#10862) add e773f8b Refactor content to a markdown table (#10863) add 68cc727 Add on_kill method to DataprocSubmitJobOperator (#10847) add 59e8341 Add new lint check to now allow realtive imports (#10825) add b9dc3c5 Added Plexus as an Airflow provider (#10591) add c58d606 Update qubole_hook to not remove pool as an arg for qubole_operator (#10820) add 3e91da5 fix typo in firebase/example_filestore DAG (#10875) add 5cc8e98 Remove unused type comment that upsets mypy (#10877) add d93c1fd Disables --warn-unused-ignore flag for mypy (#10880) add 56bd9b7 Modify helm chart to use pod_template_file (#10872) add 41a6273 Add on_kill method to BigQueryInsertJobOperator (#10866) add 030582a Fix `breeze -i` error (#10887) add 47e592e Flag --start-airflow for breeze (#10837) add 7dd7be3 Bump prismjs from 1.20.0 to 1.21.0 in /airflow/www (#10234) No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 8 +- .pre-commit-config.yaml| 21 +- BREEZE.rst | 19 +- CHANGELOG.txt | 8 +- CONTRIBUTING.rst | 2 +- INSTALL| 2 +- INTHEWILD.md | 1 + README.md | 77 +
[airflow] tag nightly-master updated (3a4f517 -> 7dd7be3)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 3a4f517 (commit) to 7dd7be3 (commit) from 3a4f517 fix task instance modal open performance issue (#10764) add b746f33 Removes stable tests from quarantine (#10768) add 10ce311 Deprecate using global as the default region in Google Dataproc operators and hooks (#10772) add 2934220 Always return a list from S3Hook list methods (#10774) add 4de67a6 Move dev docker images to airflow registry (#9652) add 3c3342f Add unit test for AzureCosmosDocumentSensor (#10765) add 078bfaf Extract missing gcs_to_local example DAG from gcs example (#10767) add 961131d All files in providers package heve unit tests (#10799) add cd0cc4c Check that all pre-commits are synchronized code<>docs (#10789) add 417ab30 Add section for official source code (#10678) add aaf56f9 Refactor official source section to use bullets (#10801) add 43303f1 Make script/ci/images Google Shell Guide compatible (#10745) add 4f07463 Make script/ci/kubernetes Google Shell Guide Compatible (#10746) add 71e1d09 Fixed wrong "-e" on md5 file status check (#10803) add 3c6fdd8 Make ci/backport_packages Google Shell guide compliant (#10733) add c60fccc Fix integration tests being accidentally excluded (#10807) add 2811851 Move Impersonation test back to quarantine (#10809) add 7fd65d7 Don't include kubernetes_tests/ and backport_packages/ in our wheel (#10805) add ff41361 Add task logging handler to airflow info command (#10771) add ac943c9 [AIRFLOW-3964][AIP-17] Consolidate and de-dup sensor tasks using Smart Sensor (#5499) add 20481c3 Add pod_override setting for KubernetesExecutor (#10756) add 004e1d8 Update log exception to reflect rename of execute_helper (#10819) add 9549274 Upgrade black to 20.8b1 (#10818) add 7edfac9 Add connection caching to KubernetesHook (#10447) add 40939dc Make airflow testing Google Shell Guide compatible (#10813) add 409ebc1 Make scripts/ci/tools Google Shell Guide Compatible (#10811) add 7adae24 Add documentation for preparing database for Airflow (#10413) add a356656 Make dockerfiles Google Shell Guide Compliant (#10734) add 9f23407 Fix doc errors introduced in #10413 (#10832) add dfcb7af Fix typos in the stackdriver howto document (#10834) add 9528f15 Fix doc errors introduced in #10413 (#10833) add cc851c7 Fix grammar in UPDATING.md (#10841) add e1e0485 Remove k8s dependency from serialization (#10831) add 0d38cf1 Fix typo in docs/howto/operator/amazon/aws/emr.rst (#10844) add ee8b02a Add missing assert call in test_dbapi_hook.py (#10842) add f920957 Fix and remove some more typos from spelling_wordlist.txt (#10845) add ce66bc9 Add test for Health Endpoint when there is an exception (#10846) add eaf4f67 Add USC Graduate School to INTHEWILD.md (#10843) add ff72327 Move parse_once to quarantine (#10857) add 67af97a Rename "Beyond the Horizon" section and refactor content (#10802) add 63b6e53 Detect orphaned task instances by SchedulerJob id and heartbeat (#10729) add 1a95361 Fix and unquarantine TestDagFileProcessorAgent.test_parse_once (#10862) add e773f8b Refactor content to a markdown table (#10863) add 68cc727 Add on_kill method to DataprocSubmitJobOperator (#10847) add 59e8341 Add new lint check to now allow realtive imports (#10825) add b9dc3c5 Added Plexus as an Airflow provider (#10591) add c58d606 Update qubole_hook to not remove pool as an arg for qubole_operator (#10820) add 3e91da5 fix typo in firebase/example_filestore DAG (#10875) add 5cc8e98 Remove unused type comment that upsets mypy (#10877) add d93c1fd Disables --warn-unused-ignore flag for mypy (#10880) add 56bd9b7 Modify helm chart to use pod_template_file (#10872) add 41a6273 Add on_kill method to BigQueryInsertJobOperator (#10866) add 030582a Fix `breeze -i` error (#10887) add 47e592e Flag --start-airflow for breeze (#10837) add 7dd7be3 Bump prismjs from 1.20.0 to 1.21.0 in /airflow/www (#10234) No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 8 +- .pre-commit-config.yaml| 21 +- BREEZE.rst | 19 +- CHANGELOG.txt | 8 +- CONTRIBUTING.rst | 2 +- INSTALL| 2 +- INTHEWILD.md | 1 + README.md | 77 +
[airflow] tag nightly-master updated (7dd7be3 -> 87e7ad9)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from 7dd7be3 (commit)
to 87e7ad9 (commit)
from 7dd7be3 Bump prismjs from 1.20.0 to 1.21.0 in /airflow/www (#10234)
add f76ab1f Fix failing dependencies for FAB and Celery (#10828)
add 35840ff Removes snakebite kerberos dependency (#10865)
add d9920fa The entrypoints in Docker Image should be owned by Airflow
(#10853)
add 2e8b4ec Pass conf to subdags (#9956)
add b9f868b Remove errors raised during initialiation of virtualenv
(#10896)
add 106c0f5 Add pre-commit to sort INTHEWILD.md file automatically
(#10851)
add f383bb3 Fix separated strings in test_secrets_manager.py (#10900)
add 9c866cd Fix syntax error in Dockerfile 'maintainer' Label (#10899)
add ee42aae Fix typo in the word 'instance' (#10902)
add 92eafc0 Parameterize tests in hashicorp/hooks/test_vault.py (#10903)
add 6dd2a0d Update the name of static check without pylint in CI.rst
(#10909)
add 16b02df Add missing closing bracket in CI.rst (#10908)
add 75bbddf Make the usage of bash 'shift' consistent across Breeze
(#10907)
add d8237b8 Fix typos in BREEZE.rst (#10905)
add 76dc7ed Fix grammar in BREEZE.rst (#10904)
add f77a11d Add Secrets backend for Microsoft Azure Key Vault (#10898)
add 12a652f Fix parameter name collision in AutoMLBatchPredictOperator
#10723 (#10869)
add 69be4b8 Fix typos in scripts/ci/docker-compose/local.yml (#10906)
add 87e7ad9 fix bug where multiple volume mounts created (#10915)
No new revisions were added by this update.
Summary of changes:
.pre-commit-config.yaml| 6 +
BREEZE.rst | 13 +-
CI.rst | 4 +-
Dockerfile | 4 +-
INTHEWILD.md | 107 ---
STATIC_CODE_CHECKS.rst | 2 +
UPDATING.md| 11 ++
airflow/jobs/scheduler_job.py | 2 +-
airflow/operators/subdag_operator.py | 7 +-
.../providers/google/cloud/ADDITIONAL_INFO.md | 13 +-
airflow/providers/google/cloud/operators/automl.py | 12 +-
.../providers/microsoft/azure/secrets}/__init__.py | 0
.../microsoft/azure/secrets/azure_key_vault.py | 143 +
breeze | 25 +++-
breeze-complete| 1 +
chart/files/pod-template-file.yaml | 5 -
docs/autoapi_templates/index.rst | 1 +
.../azure-key-vault-secrets-backend.rst| 51
scripts/ci/docker-compose/local.yml| 4 +-
scripts/ci/dockerfiles/apache-rat/Dockerfile | 2 +-
scripts/ci/dockerfiles/krb5-kdc-server/Dockerfile | 2 +-
scripts/ci/dockerfiles/stress/Dockerfile | 2 +-
.../pre_commit_sort_in_the_wild.sh}| 14 +-
setup.py | 8 +-
tests/operators/test_subdag_operator.py| 31 +
.../amazon/aws/secrets/test_secrets_manager.py | 2 +-
.../google/cloud/hooks/test_cloud_memorystore.py | 4 +-
.../google/cloud/operators/test_automl.py | 1 +
tests/providers/hashicorp/hooks/test_vault.py | 126 +-
.../azure/secrets/test_azure_key_vault.py | 104 +++
30 files changed, 506 insertions(+), 201 deletions(-)
copy chart/dockerfiles/README.md =>
airflow/providers/google/cloud/ADDITIONAL_INFO.md (62%)
copy {tests/providers/zendesk/hooks =>
airflow/providers/microsoft/azure/secrets}/__init__.py (100%)
create mode 100644 airflow/providers/microsoft/azure/secrets/azure_key_vault.py
create mode 100644
docs/security/secrets/secrets-backend/azure-key-vault-secrets-backend.rst
copy scripts/ci/{docs/ci_docs.sh => pre_commit/pre_commit_sort_in_the_wild.sh}
(77%)
create mode 100644
tests/providers/microsoft/azure/secrets/test_azure_key_vault.py
[airflow] tag nightly-master updated (ff1ab97 -> 22c6a84)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from ff1ab97 (commit)
to 22c6a84 (commit)
from ff1ab97 Add operator link to access DAG triggered by
TriggerDagRunOperator (#11254)
add e89d384 The bats script for CI image is now placed in the docker
folder (#11262)
add 1b9e59c Limits CodeQL workflow to run only in the Apache Airflow repo
(#11264)
add 6dce7a6 Enable MySQL 8 CI jobs (#11247)
add a4478f5 Improve running and canceliling of the PR-triggered builds.
(#11268)
add 1180f1b Fix link to static checks in CONTRIBUTING.rst (#11271)
add fd682fd fix job deletion (#11272)
add b93b6c5 Allow labels in KubernetesPodOperator to be templated (#10796)
add c9efa56 Access task type via the property, not dundervars (#11274)
add baa980f When sending tasks to celery from a sub-process, reset signal
handlers (#11278)
add a33a919 Switched to Run Checks for Building Images. (#11276)
add 93475e9 Single/Multi-Namespace mode for helm chart (#11034)
add c51016b Add LocalToAzureDataLakeStorageOperator (#10814)
add 4847460 Add CeleryKubernetesExecutor to helm chart (#11288)
add 32b3cfb Strict type check for all hooks in amazon (#11250)
add 975558b Replaces depreated set-env with env file (#11292)
add 03e0ff2 Breeze start-airflow command wasn't able to initialize the db
in 1.10.x (#11207)
add 03ff067 Add type annotations to ZendeskHook, update unit test (#10888)
add dd98b21 Add acl_policy parameter to GCSToS3Operator (#10804) (#10829)
add 9514cfe add releasing airflow docs to dev readme (#11245)
add c803a27 Prevent race condition in trying to collect result from
DagFileProcessor (#11306)
add 4af7804 Bump tenacity to 6.2 (#11313)
add bbc3cea Move latest_only_operator.py to latest_only.py (#11178)
(#11304)
add 22c6a84 Adds --no-rbac-ui flag for Breeze airflow 1.10 installation
(#11315)
No new revisions were added by this update.
Summary of changes:
.dockerignore | 1 -
.github/workflows/build-images-workflow-run.yml| 69 -
.github/workflows/ci.yml | 6 +-
.github/workflows/codeql-analysis.yml | 1 +
.github/workflows/codeql-cancel.yml| 21 ++
.github/workflows/scheduled_quarantined.yml| 6 +-
BREEZE.rst | 10 +-
CONTRIBUTING.rst | 2 +-
Dockerfile.ci | 2 +-
README.md | 2 +-
airflow/example_dags/example_latest_only.py| 2 +-
.../example_latest_only_with_trigger.py| 2 +-
airflow/executors/celery_executor.py | 10 +-
airflow/jobs/scheduler_job.py | 38 ++-
airflow/models/baseoperator.py | 2 +-
airflow/models/dagrun.py | 2 +-
airflow/models/taskinstance.py | 4 +-
.../{latest_only_operator.py => latest_only.py}| 0
airflow/operators/latest_only_operator.py | 54 +---
airflow/providers/amazon/aws/hooks/aws_dynamodb.py | 2 +-
airflow/providers/amazon/aws/hooks/batch_client.py | 10 +-
.../providers/amazon/aws/hooks/batch_waiters.py| 4 +-
.../providers/amazon/aws/hooks/cloud_formation.py | 6 +-
airflow/providers/amazon/aws/hooks/datasync.py | 45 +--
airflow/providers/amazon/aws/hooks/glue_catalog.py | 17 +-
airflow/providers/amazon/aws/hooks/kinesis.py | 2 +-
airflow/providers/amazon/aws/hooks/sagemaker.py| 101 +--
airflow/providers/amazon/aws/hooks/sns.py | 11 +-
.../providers/amazon/aws/transfers/gcs_to_s3.py| 9 +-
.../cncf/kubernetes/operators/kubernetes_pod.py| 8 +-
.../azure/example_dags/example_local_to_adls.py} | 26 +-
.../microsoft/azure/hooks/azure_data_lake.py | 38 ++-
.../microsoft/azure/operators/azure_batch.py | 2 +-
.../microsoft/azure/transfers/local_to_adls.py | 103 +++
airflow/providers/zendesk/hooks/zendesk.py | 16 +-
breeze | 18 +-
breeze-complete| 3 +-
chart/README.md| 2 +-
chart/templates/NOTES.txt | 4 +-
chart/templates/_helpers.yaml | 6 +-
chart/templates/configmap.yaml | 2 +-
chart/templates/flower/flower-deployment.yaml | 2 +-
chart/templates/flower/flower-ingress.yaml | 2 +-
chart/templates/flower/flower-service.yaml | 2 +-
chart/templates/rbac/pod-launcher-role.yaml| 7 +
chart/templates/rbac/
[airflow] branch constraints-master updated: Updating constraints. Build id:292504122
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new cd22f8f Updating constraints. Build id:292504122 cd22f8f is described below commit cd22f8f30e5527c32ad0e23142942007f240f63c Author: Automated GitHub Actions commit AuthorDate: Wed Oct 7 02:12:23 2020 + Updating constraints. Build id:292504122 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 22c6a843d760d920f329fc97aa55f45d82682ab9. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 -- constraints-3.7.txt | 2 -- constraints-3.8.txt | 2 -- 3 files changed, 6 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index baa5d8f..44d1a60 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -236,7 +236,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -352,7 +351,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index e99fdad..9113a9d 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -346,7 +345,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 715057a..0f4df5b 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -345,7 +344,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1
[airflow] tag nightly-master updated (ff1ab97 -> 22c6a84)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from ff1ab97 (commit)
to 22c6a84 (commit)
from ff1ab97 Add operator link to access DAG triggered by
TriggerDagRunOperator (#11254)
add e89d384 The bats script for CI image is now placed in the docker
folder (#11262)
add 1b9e59c Limits CodeQL workflow to run only in the Apache Airflow repo
(#11264)
add 6dce7a6 Enable MySQL 8 CI jobs (#11247)
add a4478f5 Improve running and canceliling of the PR-triggered builds.
(#11268)
add 1180f1b Fix link to static checks in CONTRIBUTING.rst (#11271)
add fd682fd fix job deletion (#11272)
add b93b6c5 Allow labels in KubernetesPodOperator to be templated (#10796)
add c9efa56 Access task type via the property, not dundervars (#11274)
add baa980f When sending tasks to celery from a sub-process, reset signal
handlers (#11278)
add a33a919 Switched to Run Checks for Building Images. (#11276)
add 93475e9 Single/Multi-Namespace mode for helm chart (#11034)
add c51016b Add LocalToAzureDataLakeStorageOperator (#10814)
add 4847460 Add CeleryKubernetesExecutor to helm chart (#11288)
add 32b3cfb Strict type check for all hooks in amazon (#11250)
add 975558b Replaces depreated set-env with env file (#11292)
add 03e0ff2 Breeze start-airflow command wasn't able to initialize the db
in 1.10.x (#11207)
add 03ff067 Add type annotations to ZendeskHook, update unit test (#10888)
add dd98b21 Add acl_policy parameter to GCSToS3Operator (#10804) (#10829)
add 9514cfe add releasing airflow docs to dev readme (#11245)
add c803a27 Prevent race condition in trying to collect result from
DagFileProcessor (#11306)
add 4af7804 Bump tenacity to 6.2 (#11313)
add bbc3cea Move latest_only_operator.py to latest_only.py (#11178)
(#11304)
add 22c6a84 Adds --no-rbac-ui flag for Breeze airflow 1.10 installation
(#11315)
No new revisions were added by this update.
Summary of changes:
.dockerignore | 1 -
.github/workflows/build-images-workflow-run.yml| 69 -
.github/workflows/ci.yml | 6 +-
.github/workflows/codeql-analysis.yml | 1 +
.github/workflows/codeql-cancel.yml| 21 ++
.github/workflows/scheduled_quarantined.yml| 6 +-
BREEZE.rst | 10 +-
CONTRIBUTING.rst | 2 +-
Dockerfile.ci | 2 +-
README.md | 2 +-
airflow/example_dags/example_latest_only.py| 2 +-
.../example_latest_only_with_trigger.py| 2 +-
airflow/executors/celery_executor.py | 10 +-
airflow/jobs/scheduler_job.py | 38 ++-
airflow/models/baseoperator.py | 2 +-
airflow/models/dagrun.py | 2 +-
airflow/models/taskinstance.py | 4 +-
.../{latest_only_operator.py => latest_only.py}| 0
airflow/operators/latest_only_operator.py | 54 +---
airflow/providers/amazon/aws/hooks/aws_dynamodb.py | 2 +-
airflow/providers/amazon/aws/hooks/batch_client.py | 10 +-
.../providers/amazon/aws/hooks/batch_waiters.py| 4 +-
.../providers/amazon/aws/hooks/cloud_formation.py | 6 +-
airflow/providers/amazon/aws/hooks/datasync.py | 45 +--
airflow/providers/amazon/aws/hooks/glue_catalog.py | 17 +-
airflow/providers/amazon/aws/hooks/kinesis.py | 2 +-
airflow/providers/amazon/aws/hooks/sagemaker.py| 101 +--
airflow/providers/amazon/aws/hooks/sns.py | 11 +-
.../providers/amazon/aws/transfers/gcs_to_s3.py| 9 +-
.../cncf/kubernetes/operators/kubernetes_pod.py| 8 +-
.../azure/example_dags/example_local_to_adls.py} | 26 +-
.../microsoft/azure/hooks/azure_data_lake.py | 38 ++-
.../microsoft/azure/operators/azure_batch.py | 2 +-
.../microsoft/azure/transfers/local_to_adls.py | 103 +++
airflow/providers/zendesk/hooks/zendesk.py | 16 +-
breeze | 18 +-
breeze-complete| 3 +-
chart/README.md| 2 +-
chart/templates/NOTES.txt | 4 +-
chart/templates/_helpers.yaml | 6 +-
chart/templates/configmap.yaml | 2 +-
chart/templates/flower/flower-deployment.yaml | 2 +-
chart/templates/flower/flower-ingress.yaml | 2 +-
chart/templates/flower/flower-service.yaml | 2 +-
chart/templates/rbac/pod-launcher-role.yaml| 7 +
chart/templates/rbac/
[airflow] branch constraints-master updated: Updating constraints. Build id:292504122
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new cd22f8f Updating constraints. Build id:292504122 cd22f8f is described below commit cd22f8f30e5527c32ad0e23142942007f240f63c Author: Automated GitHub Actions commit AuthorDate: Wed Oct 7 02:12:23 2020 + Updating constraints. Build id:292504122 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 22c6a843d760d920f329fc97aa55f45d82682ab9. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 -- constraints-3.7.txt | 2 -- constraints-3.8.txt | 2 -- 3 files changed, 6 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index baa5d8f..44d1a60 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -236,7 +236,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -352,7 +351,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index e99fdad..9113a9d 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -346,7 +345,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 715057a..0f4df5b 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -345,7 +344,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1
[airflow] branch constraints-master updated: Updating constraints. Build id:295915963
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new acdb28b Updating constraints. Build id:295915963 acdb28b is described below commit acdb28b154eacf936e6986e0e957bdb914b0598b Author: Automated GitHub Actions commit AuthorDate: Thu Oct 8 18:12:50 2020 + Updating constraints. Build id:295915963 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 666e81ab4a468047b9f6869b9eaad6e92b5bc7dd. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 ++ constraints-3.7.txt | 2 ++ constraints-3.8.txt | 2 ++ 3 files changed, 6 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 44d1a60..baa5d8f 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -236,6 +236,7 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 +more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -351,6 +352,7 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 +sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 9113a9d..e99fdad 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -231,6 +231,7 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 +more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -345,6 +346,7 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 +sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 0f4df5b..715057a 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -231,6 +231,7 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 +more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -344,6 +345,7 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 +sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1
[airflow] branch constraints-master updated: Updating constraints. Build id:295915963
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new acdb28b Updating constraints. Build id:295915963 acdb28b is described below commit acdb28b154eacf936e6986e0e957bdb914b0598b Author: Automated GitHub Actions commit AuthorDate: Thu Oct 8 18:12:50 2020 + Updating constraints. Build id:295915963 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 666e81ab4a468047b9f6869b9eaad6e92b5bc7dd. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 ++ constraints-3.7.txt | 2 ++ constraints-3.8.txt | 2 ++ 3 files changed, 6 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 44d1a60..baa5d8f 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -236,6 +236,7 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 +more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -351,6 +352,7 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 +sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 9113a9d..e99fdad 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -231,6 +231,7 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 +more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -345,6 +346,7 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 +sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 0f4df5b..715057a 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -231,6 +231,7 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 +more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -344,6 +345,7 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 +sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1
[airflow] tag nightly-master updated (22c6a84 -> 11eb649)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 22c6a84 (commit) to 11eb649 (commit) from 22c6a84 Adds --no-rbac-ui flag for Breeze airflow 1.10 installation (#11315) add 18dcac8 Add remaining community guidelines to CONTRIBUTING.rst (#11312) add 47b05a8 Improve handling of job_id in BigQuery operators (#11287) add e2655f6 Prints nicer message in case of git push errors (#11320) add b0fcf67 Add AzureFileShareToGCSOperator (#10991) add d86cf37 Automatically upgrade old default navbar color (#11322) add fe59f26 Pin versions of "untrusted" 3rd-party GitHub Actions (#11319) add d404cb0 Moves Commiter's guide to CONTRIBUTING.rst (#11314) add b4baa2b Add environment variables documentation to cli-ref.rst. (#10970) add 2bac481 Update link for Announcement Page (#11337) add 5d007fd Strict type check for azure hooks (#11342) add de07d13 Adds --install-wheels flag to breeze command line (#11317) add 4d95d9c Improve code quality of SLA mechanism in SchedulerJob (#11257) add 625afa2 Improve Committer's guide docs (#11338) add 832a785 Add Azure Blob Storage to GCS transfer operator (#11321) add 9dc32a3 Better message when Building Image fails or gets cancelled. (#11333) add f67e6cb Revert "Adds --install-wheels flag to breeze command line (#11317)" (#11348) add ba60836 Fix command to run tmux with breeze in BREEZE.rst (#11340) add a1f8885 Improve instructions to install Airflow Version (#11339) add 4839a5b Reduce "start-up" time for tasks in LocalExecutor (#11327) add 666e81a Bump cache version for kubernetes tests (#11355) add f5b7bbc Better diagnostics when there are problems with Kerberos (#11353) add 11eb649 Fix to make y-axis of Tries chart visible (#10071) No new revisions were added by this update. Summary of changes: .github/boring-cyborg.yml | 2 +- .github/workflows/build-images-workflow-run.yml| 35 +++- .github/workflows/ci.yml | 8 +- .github/workflows/codeql-cancel.yml| 2 +- .github/workflows/delete_old_artifacts.yml | 2 +- BREEZE.rst | 2 +- CONTRIBUTING.rst | 34 +++- airflow/config_templates/config.yml| 10 ++ airflow/config_templates/default_airflow.cfg | 5 + airflow/configuration.py | 3 + airflow/executors/local_executor.py| 70 +++- airflow/jobs/scheduler_job.py | 22 ++- airflow/providers/dependencies.json| 1 + .../example_azure_fileshare_to_gcs.py} | 44 +++-- airflow/providers/google/cloud/hooks/bigquery.py | 14 +- airflow/providers/google/cloud/hooks/gcs.py| 10 ++ .../providers/google/cloud/operators/bigquery.py | 5 +- .../cloud/transfers/azure_fileshare_to_gcs.py | 182 + .../providers/google/cloud/transfers/s3_to_gcs.py | 12 +- .../example_dags/example_azure_blob_to_gcs.py | 68 airflow/providers/microsoft/azure/hooks/adx.py | 4 +- .../providers/microsoft/azure/hooks/azure_batch.py | 43 +++-- .../azure/hooks/azure_container_instance.py| 18 +- .../azure/hooks/azure_container_registry.py| 4 +- .../azure/hooks/azure_container_volume.py | 8 +- .../microsoft/azure/hooks/azure_cosmos.py | 47 -- .../microsoft/azure/hooks/azure_data_lake.py | 10 +- .../microsoft/azure/hooks/azure_fileshare.py | 85 -- airflow/providers/microsoft/azure/hooks/wasb.py| 27 ++- .../microsoft/azure/operators/azure_batch.py | 6 +- .../azure/transfers/azure_blob_to_gcs.py} | 118 +++-- airflow/settings.py| 8 + airflow/task/task_runner/standard_task_runner.py | 3 +- airflow/www/views.py | 2 + dev/README.md | 21 +-- docs/cli-and-env-variables-ref.rst | 85 ++ docs/cli-ref.rst | 37 - docs/configurations-ref.rst| 4 + .../google/transfer/azure_fileshare_to_gcs.rst | 54 ++ .../microsoft/transfer/blob_storage_to_gcs.rst | 61 +++ docs/howto/variable.rst| 2 + docs/index.rst | 2 +- docs/modules_management.rst| 2 + docs/operators-and-hooks-ref.rst | 10 ++ docs/plugins.rst | 19 +++ docs/redirects.txt
[airflow] tag nightly-master updated (22c6a84 -> 11eb649)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 22c6a84 (commit) to 11eb649 (commit) from 22c6a84 Adds --no-rbac-ui flag for Breeze airflow 1.10 installation (#11315) add 18dcac8 Add remaining community guidelines to CONTRIBUTING.rst (#11312) add 47b05a8 Improve handling of job_id in BigQuery operators (#11287) add e2655f6 Prints nicer message in case of git push errors (#11320) add b0fcf67 Add AzureFileShareToGCSOperator (#10991) add d86cf37 Automatically upgrade old default navbar color (#11322) add fe59f26 Pin versions of "untrusted" 3rd-party GitHub Actions (#11319) add d404cb0 Moves Commiter's guide to CONTRIBUTING.rst (#11314) add b4baa2b Add environment variables documentation to cli-ref.rst. (#10970) add 2bac481 Update link for Announcement Page (#11337) add 5d007fd Strict type check for azure hooks (#11342) add de07d13 Adds --install-wheels flag to breeze command line (#11317) add 4d95d9c Improve code quality of SLA mechanism in SchedulerJob (#11257) add 625afa2 Improve Committer's guide docs (#11338) add 832a785 Add Azure Blob Storage to GCS transfer operator (#11321) add 9dc32a3 Better message when Building Image fails or gets cancelled. (#11333) add f67e6cb Revert "Adds --install-wheels flag to breeze command line (#11317)" (#11348) add ba60836 Fix command to run tmux with breeze in BREEZE.rst (#11340) add a1f8885 Improve instructions to install Airflow Version (#11339) add 4839a5b Reduce "start-up" time for tasks in LocalExecutor (#11327) add 666e81a Bump cache version for kubernetes tests (#11355) add f5b7bbc Better diagnostics when there are problems with Kerberos (#11353) add 11eb649 Fix to make y-axis of Tries chart visible (#10071) No new revisions were added by this update. Summary of changes: .github/boring-cyborg.yml | 2 +- .github/workflows/build-images-workflow-run.yml| 35 +++- .github/workflows/ci.yml | 8 +- .github/workflows/codeql-cancel.yml| 2 +- .github/workflows/delete_old_artifacts.yml | 2 +- BREEZE.rst | 2 +- CONTRIBUTING.rst | 34 +++- airflow/config_templates/config.yml| 10 ++ airflow/config_templates/default_airflow.cfg | 5 + airflow/configuration.py | 3 + airflow/executors/local_executor.py| 70 +++- airflow/jobs/scheduler_job.py | 22 ++- airflow/providers/dependencies.json| 1 + .../example_azure_fileshare_to_gcs.py} | 44 +++-- airflow/providers/google/cloud/hooks/bigquery.py | 14 +- airflow/providers/google/cloud/hooks/gcs.py| 10 ++ .../providers/google/cloud/operators/bigquery.py | 5 +- .../cloud/transfers/azure_fileshare_to_gcs.py | 182 + .../providers/google/cloud/transfers/s3_to_gcs.py | 12 +- .../example_dags/example_azure_blob_to_gcs.py | 68 airflow/providers/microsoft/azure/hooks/adx.py | 4 +- .../providers/microsoft/azure/hooks/azure_batch.py | 43 +++-- .../azure/hooks/azure_container_instance.py| 18 +- .../azure/hooks/azure_container_registry.py| 4 +- .../azure/hooks/azure_container_volume.py | 8 +- .../microsoft/azure/hooks/azure_cosmos.py | 47 -- .../microsoft/azure/hooks/azure_data_lake.py | 10 +- .../microsoft/azure/hooks/azure_fileshare.py | 85 -- airflow/providers/microsoft/azure/hooks/wasb.py| 27 ++- .../microsoft/azure/operators/azure_batch.py | 6 +- .../azure/transfers/azure_blob_to_gcs.py} | 118 +++-- airflow/settings.py| 8 + airflow/task/task_runner/standard_task_runner.py | 3 +- airflow/www/views.py | 2 + dev/README.md | 21 +-- docs/cli-and-env-variables-ref.rst | 85 ++ docs/cli-ref.rst | 37 - docs/configurations-ref.rst| 4 + .../google/transfer/azure_fileshare_to_gcs.rst | 54 ++ .../microsoft/transfer/blob_storage_to_gcs.rst | 61 +++ docs/howto/variable.rst| 2 + docs/index.rst | 2 +- docs/modules_management.rst| 2 + docs/operators-and-hooks-ref.rst | 10 ++ docs/plugins.rst | 19 +++ docs/redirects.txt
[airflow] branch constraints-master updated: Updating constraints. Build id:296576853
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 3aba9ce Updating constraints. Build id:296576853 3aba9ce is described below commit 3aba9ce69266f325baa8e11a51191bd339523a81 Author: Automated GitHub Actions commit AuthorDate: Fri Oct 9 02:14:23 2020 + Updating constraints. Build id:296576853 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 11eb649d4acdbd3582fb0a77b5f5af3b75e2262c. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 -- constraints-3.7.txt | 2 -- constraints-3.8.txt | 2 -- 3 files changed, 6 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index baa5d8f..44d1a60 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -236,7 +236,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -352,7 +351,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index e99fdad..9113a9d 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -346,7 +345,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 715057a..0f4df5b 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -345,7 +344,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1
[airflow] branch constraints-master updated: Updating constraints. Build id:296576853
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 3aba9ce Updating constraints. Build id:296576853 3aba9ce is described below commit 3aba9ce69266f325baa8e11a51191bd339523a81 Author: Automated GitHub Actions commit AuthorDate: Fri Oct 9 02:14:23 2020 + Updating constraints. Build id:296576853 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 11eb649d4acdbd3582fb0a77b5f5af3b75e2262c. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 -- constraints-3.7.txt | 2 -- constraints-3.8.txt | 2 -- 3 files changed, 6 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index baa5d8f..44d1a60 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -236,7 +236,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -352,7 +351,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index e99fdad..9113a9d 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -346,7 +345,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 715057a..0f4df5b 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -231,7 +231,6 @@ mccabe==0.6.1 mock==4.0.2 mongomock==3.20.0 monotonic==1.5 -more-itertools==8.4.0 moreorless==0.3.0 moto==1.3.14 msal-extensions==0.2.2 @@ -345,7 +344,6 @@ sendgrid==6.4.7 sentinels==1.0.0 sentry-sdk==0.18.0 setproctitle==1.1.10 -sh==1.13.1 simple-salesforce==1.10.1 six==1.15.0 slackclient==2.9.1
[airflow] branch constraints-master updated: Updating constraints. Build id:308244654
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 0aa574f Updating constraints. Build id:308244654 0aa574f is described below commit 0aa574f873b2c47814cc510e74a59dd24b4eecca Author: Automated GitHub Actions commit AuthorDate: Thu Oct 15 09:58:49 2020 + Updating constraints. Build id:308244654 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 3447b55ba57a06c3820d1f754835e7d7f9a1fc68. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 4 ++-- constraints-3.7.txt | 6 +++--- constraints-3.8.txt | 7 --- 3 files changed, 9 insertions(+), 8 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index d6ecdfc..2b5fee9 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==2.0.0.dev0) +# Editable install with no version control (apache-airflow==2.0.0a1) Authlib==0.14.3 Babel==2.8.0 Flask-AppBuilder==3.1.0 @@ -301,7 +301,7 @@ pyflakes==2.2.0 pykerberos==1.2.1 pylint==2.5.3 pymongo==3.11.0 -pymssql==2.1.4 +pymssql==2.1.5 pyodbc==4.0.30 pyparsing==2.4.7 pypd==1.1.0 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 9f616e7..df46bf0 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==2.0.0.dev0) +# Editable install with no version control (apache-airflow==2.0.0a1) Authlib==0.14.3 Babel==2.8.0 Flask-AppBuilder==3.1.0 @@ -118,7 +118,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.15 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 @@ -296,7 +296,7 @@ pyflakes==2.2.0 pykerberos==1.2.1 pylint==2.5.3 pymongo==3.11.0 -pymssql==2.1.4 +pymssql==2.1.5 pyodbc==4.0.30 pyparsing==2.4.7 pypd==1.1.0 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 16950ef..a6d1f98 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==2.0.0.dev0) +# Editable install with no version control (apache-airflow==2.0.0a1) Authlib==0.14.3 Babel==2.8.0 Flask-AppBuilder==3.1.0 @@ -118,7 +118,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.15 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 @@ -296,6 +296,7 @@ pyflakes==2.2.0 pykerberos==1.2.1 pylint==2.5.3 pymongo==3.11.0 +pymssql==2.1.5 pyodbc==4.0.30 pyparsing==2.4.7 pypd==1.1.0 @@ -384,7 +385,7 @@ thrift-sasl==0.4.2 thrift==0.13.0 toml==0.10.1 toolz==0.10.0 -tornado==5.1.1 +tornado==6.0.4 tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1
[airflow] branch constraints-master updated: Updating constraints. Build id:308244654
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 0aa574f Updating constraints. Build id:308244654 0aa574f is described below commit 0aa574f873b2c47814cc510e74a59dd24b4eecca Author: Automated GitHub Actions commit AuthorDate: Thu Oct 15 09:58:49 2020 + Updating constraints. Build id:308244654 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 3447b55ba57a06c3820d1f754835e7d7f9a1fc68. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 4 ++-- constraints-3.7.txt | 6 +++--- constraints-3.8.txt | 7 --- 3 files changed, 9 insertions(+), 8 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index d6ecdfc..2b5fee9 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==2.0.0.dev0) +# Editable install with no version control (apache-airflow==2.0.0a1) Authlib==0.14.3 Babel==2.8.0 Flask-AppBuilder==3.1.0 @@ -301,7 +301,7 @@ pyflakes==2.2.0 pykerberos==1.2.1 pylint==2.5.3 pymongo==3.11.0 -pymssql==2.1.4 +pymssql==2.1.5 pyodbc==4.0.30 pyparsing==2.4.7 pypd==1.1.0 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 9f616e7..df46bf0 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==2.0.0.dev0) +# Editable install with no version control (apache-airflow==2.0.0a1) Authlib==0.14.3 Babel==2.8.0 Flask-AppBuilder==3.1.0 @@ -118,7 +118,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.15 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 @@ -296,7 +296,7 @@ pyflakes==2.2.0 pykerberos==1.2.1 pylint==2.5.3 pymongo==3.11.0 -pymssql==2.1.4 +pymssql==2.1.5 pyodbc==4.0.30 pyparsing==2.4.7 pypd==1.1.0 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 16950ef..a6d1f98 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==2.0.0.dev0) +# Editable install with no version control (apache-airflow==2.0.0a1) Authlib==0.14.3 Babel==2.8.0 Flask-AppBuilder==3.1.0 @@ -118,7 +118,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.15 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 @@ -296,6 +296,7 @@ pyflakes==2.2.0 pykerberos==1.2.1 pylint==2.5.3 pymongo==3.11.0 +pymssql==2.1.5 pyodbc==4.0.30 pyparsing==2.4.7 pypd==1.1.0 @@ -384,7 +385,7 @@ thrift-sasl==0.4.2 thrift==0.13.0 toml==0.10.1 toolz==0.10.0 -tornado==5.1.1 +tornado==6.0.4 tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1
[airflow-site] branch asf-site updated: Update asf-site to output generated at 22af1a2
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 8b3f3f3 Update asf-site to output generated at 22af1a2 8b3f3f3 is described below commit 8b3f3f35d896096c7f5eebc58aa24a18a403d5ac Author: ryw <4283+...@users.noreply.github.com> AuthorDate: Fri Oct 2 13:54:22 2020 + Update asf-site to output generated at 22af1a2 --- blog/airflow-1.10.10/index.html| 4 +- blog/airflow-1.10.12/index.html| 4 +- blog/airflow-1.10.8-1.10.9/index.html | 4 +- blog/airflow-survey/index.html | 4 +- blog/announcing-new-website/index.html | 4 +- blog/apache-airflow-for-newcomers/index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- ecosystem/index.html | 2 + index.html | 32 +++--- search/index.html | 4 +- sitemap.xml| 112 ++--- use-cases/adobe/index.html | 4 +- use-cases/big-fish-games/index.html| 4 +- use-cases/dish/index.html | 4 +- use-cases/experity/index.html | 4 +- use-cases/onefootball/index.html | 4 +- use-cases/sift/index.html | 4 +- 22 files changed, 112 insertions(+), 110 deletions(-) diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html index 61fc1bd..90a79b6 100644 --- a/blog/airflow-1.10.10/index.html +++ b/blog/airflow-1.10.10/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-1.10.12/index.html b/blog/airflow-1.10.12/index.html index 6a3fd5a..c85eccb 100644 --- a/blog/airflow-1.10.12/index.html +++ b/blog/airflow-1.10.12/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-1.10.8-1.10.9/index.html b/blog/airflow-1.10.8-1.10.9/index.html index e98ceda..48d80f2 100644 --- a/blog/airflow-1.10.8-1.10.9/index.html +++ b/blog/airflow-1.10.8-1.10.9/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html index 42575c8..86b9867 100644 --- a/blog/airflow-survey/index.html +++ b/blog/airflow-survey/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/announcing-new-website/index.html b/blog/announcing-new-website/index.html index 41c05a6..0e87449 100644 --- a/blog/announcing-new-website/index.html +++ b/blog/announcing-new-website/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/apache-airflow-for-newcomers/index.html b/blog/apache-airflow-for-newcomers/index.html index 717c475..3108fa9 100644 --- a/blog/apache-airflow-for-newcomers/index.html +++ b/blog/apache-airflow-for-newcomers/index.html @@ -37,14 +37,14 @@ Authoring Workflow in Apache Airflow. Airflow makes it easy to author workflows - + - + diff --git a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html index 0b2a994..fa58146 100644 --- a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html +++ b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/documenting-using-local-development-environments/index.html b/blog/documenting-using-local-development-environments/index.html index acdf0c1..1be6d7c 100644 --- a/blog/documenting-using-local-development-environments/index.html +++ b/blog/documenting-using-local-development-environments/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html index 92786f2..dcbfe40 100644 --- a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html +++ b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html @@ -37,14 +37,14 @@ About Me I have been writing tech articles on medium as well as my blog for the - + - + diff --git a/blog/experience-with-airflow-as-an-outreachy-intern/index.html b/blog/experience-with-airflow-as-an-out
[airflow] tag nightly-master updated (11eb649 -> d305876)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 11eb649 (commit) to d305876 (commit) from 11eb649 Fix to make y-axis of Tries chart visible (#10071) add 27e637f Bugfix: Error in SSHOperator when command is None (#11361) add 7541c88 Allways use Airlfow db in FAB (#11364) add 7f674c6 Use only-if-needed upgrade strategy for PRs (#11363) add 5605d10 Fix DagBag bug when a dag has invalid schedule_interval (#11344) add 422b61a Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701) add 8baf657 Fix regression in DataflowTemplatedJobStartOperator (#11167) add d2754ef Strict type check for Microsoft (#11359) add fe0bf6e Reduce "start-up" time for tasks in CeleryExecutor (#11372) add ff1a2aa Set start_date, end_date & duration for tasks failing without DagRun (#11358) add eb5fea7 Replace nuke with useful information on error page (#11346) add 49aad02 Users can specify sub-secrets and paths k8spodop (#11369) add 29a145c Add capability of adding service account annotations to Helm Chart (#11387) add e198077 Add pypirc initialization (#11386) add 73b9163 Fully support running more than one scheduler concurrently (#10956) add d752575 Revert "Revert "Adds --install-wheels flag to breeze command line (#11317)" (#11348)" (#11356) add 7b0a2f5 Replaced basestring with str in the Exasol hook (#11360) add 298052f [airflow/providers/cncf/kubernetes] correct hook methods name (#11008) add 3164025 Fix airflow_local_settings.py showing up as directory (#10999) add 39fc961 Fix case of JavaScript. (#10957) add 6fe020e Add tests for Custom cluster policy (#11381) add b7404b0 KubernetesPodOperator should retry log tailing in case of interruption (#11325) add 8640fb6 fix tests (#11368) add 0497390 Constraints and PIP packages can be installed from local sources (#11382) add 401a579 Push and schedule duplicates are not cancelled. (#11397) add 7507183 Remove redundant parentheses from Python files (#10967) add a34f5ee Fixes automated upgrade to latest constraints. (#11399) add 076fe88 Fixes cancelling of too many workflows. (#11403) add 0620aaa Fix spelling (#11401) add 7959df9 Fix spelling (#11404) add f95 Workarounds "unknown blob" issue by introducing retries (#11411) add 45d33db Add capability of customising PyPI sources (#11385) add 9416bed Moving the test to quarantine. (#11405) add bd204bb Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409) add 4de8f85 Fixes SHA used for cancel-workflow-action (#11400) add 5bc5994Split tests to more sub-types (#11402) add 686e0ee Fix incorrect typing, remove hardcoded argument values and improve code in AzureContainerInstancesOperator (#11408) add ce2f19d Fix constraints generation script (#11412) add b786327 Fix spelling in CeleryExecutor (#11407) add 7e40a32 Add more info about dag_concurrency (#11300) add 42a23d1 Update MySQLToS3Operator's s3_bucket to template_fields (#10778) add c3e3405 Change prefix of AwsDynamoDB hook module (#11209) add 1845cd1 Strict type check for google ads and cloud hooks (#11390) add 9a01ce0 Mutual SSL added in PGBouncer configuration in the Chart (#11384) add fb8b1e5 Merge Airflow and Backport Packages preparation instructions (#11310) add 2c7e343 Fix syntax highlightling for concurrency in configurations doc (#11438) add a155db1 Fix typo in airflow/utils/dag_processing.py (#11445) add 369bbf0 Selective tests - depends on files changed in the commit. (#11417) add eaaad31 Fix correct Sphinx return type for DagFileProcessorProcess.result (#11444) add d8d13fa Use augmented assignment (#11449) add d305876 Remove redundant None provided as default to dict.get() (#11448) No new revisions were added by this update. Summary of changes: .dockerignore |5 + .github/workflows/build-images-workflow-run.yml| 55 +- .github/workflows/ci.yml | 144 +- .github/workflows/codeql-cancel.yml|3 +- .gitignore |2 + BREEZE.rst | 77 +- CONTRIBUTING.rst |4 +- Dockerfile | 32 +- Dockerfile.ci |5 +- IMAGES.rst | 25 +- TESTING.rst| 57 +- airflow/api/common/experimental/tr
[airflow] tag nightly-master updated (11eb649 -> d305876)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 11eb649 (commit) to d305876 (commit) from 11eb649 Fix to make y-axis of Tries chart visible (#10071) add 27e637f Bugfix: Error in SSHOperator when command is None (#11361) add 7541c88 Allways use Airlfow db in FAB (#11364) add 7f674c6 Use only-if-needed upgrade strategy for PRs (#11363) add 5605d10 Fix DagBag bug when a dag has invalid schedule_interval (#11344) add 422b61a Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701) add 8baf657 Fix regression in DataflowTemplatedJobStartOperator (#11167) add d2754ef Strict type check for Microsoft (#11359) add fe0bf6e Reduce "start-up" time for tasks in CeleryExecutor (#11372) add ff1a2aa Set start_date, end_date & duration for tasks failing without DagRun (#11358) add eb5fea7 Replace nuke with useful information on error page (#11346) add 49aad02 Users can specify sub-secrets and paths k8spodop (#11369) add 29a145c Add capability of adding service account annotations to Helm Chart (#11387) add e198077 Add pypirc initialization (#11386) add 73b9163 Fully support running more than one scheduler concurrently (#10956) add d752575 Revert "Revert "Adds --install-wheels flag to breeze command line (#11317)" (#11348)" (#11356) add 7b0a2f5 Replaced basestring with str in the Exasol hook (#11360) add 298052f [airflow/providers/cncf/kubernetes] correct hook methods name (#11008) add 3164025 Fix airflow_local_settings.py showing up as directory (#10999) add 39fc961 Fix case of JavaScript. (#10957) add 6fe020e Add tests for Custom cluster policy (#11381) add b7404b0 KubernetesPodOperator should retry log tailing in case of interruption (#11325) add 8640fb6 fix tests (#11368) add 0497390 Constraints and PIP packages can be installed from local sources (#11382) add 401a579 Push and schedule duplicates are not cancelled. (#11397) add 7507183 Remove redundant parentheses from Python files (#10967) add a34f5ee Fixes automated upgrade to latest constraints. (#11399) add 076fe88 Fixes cancelling of too many workflows. (#11403) add 0620aaa Fix spelling (#11401) add 7959df9 Fix spelling (#11404) add f95 Workarounds "unknown blob" issue by introducing retries (#11411) add 45d33db Add capability of customising PyPI sources (#11385) add 9416bed Moving the test to quarantine. (#11405) add bd204bb Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409) add 4de8f85 Fixes SHA used for cancel-workflow-action (#11400) add 5bc5994Split tests to more sub-types (#11402) add 686e0ee Fix incorrect typing, remove hardcoded argument values and improve code in AzureContainerInstancesOperator (#11408) add ce2f19d Fix constraints generation script (#11412) add b786327 Fix spelling in CeleryExecutor (#11407) add 7e40a32 Add more info about dag_concurrency (#11300) add 42a23d1 Update MySQLToS3Operator's s3_bucket to template_fields (#10778) add c3e3405 Change prefix of AwsDynamoDB hook module (#11209) add 1845cd1 Strict type check for google ads and cloud hooks (#11390) add 9a01ce0 Mutual SSL added in PGBouncer configuration in the Chart (#11384) add fb8b1e5 Merge Airflow and Backport Packages preparation instructions (#11310) add 2c7e343 Fix syntax highlightling for concurrency in configurations doc (#11438) add a155db1 Fix typo in airflow/utils/dag_processing.py (#11445) add 369bbf0 Selective tests - depends on files changed in the commit. (#11417) add eaaad31 Fix correct Sphinx return type for DagFileProcessorProcess.result (#11444) add d8d13fa Use augmented assignment (#11449) add d305876 Remove redundant None provided as default to dict.get() (#11448) No new revisions were added by this update. Summary of changes: .dockerignore |5 + .github/workflows/build-images-workflow-run.yml| 55 +- .github/workflows/ci.yml | 144 +- .github/workflows/codeql-cancel.yml|3 +- .gitignore |2 + BREEZE.rst | 77 +- CONTRIBUTING.rst |4 +- Dockerfile | 32 +- Dockerfile.ci |5 +- IMAGES.rst | 25 +- TESTING.rst| 57 +- airflow/api/common/experimental/tr
[airflow] branch constraints-master updated: Updating constraints. Build id:303423721
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 1186b73 Updating constraints. Build id:303423721 1186b73 is described below commit 1186b734869c0b11f5380a6d1ef8df14f2df3660 Author: Automated GitHub Actions commit AuthorDate: Tue Oct 13 02:10:22 2020 + Updating constraints. Build id:303423721 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 2345cd1f0337f4f06a2f2595a1a59c30dc4a1535. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 4 ++-- constraints-3.7.txt | 2 +- constraints-3.8.txt | 6 +++--- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 9a9fa56..d6ecdfc 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -1,7 +1,7 @@ # Editable install with no version control (apache-airflow==2.0.0.dev0) Authlib==0.14.3 Babel==2.8.0 -Flask-AppBuilder==3.0.1 +Flask-AppBuilder==3.1.0 Flask-Babel==1.0.0 Flask-Bcrypt==0.7.1 Flask-Caching==1.9.0 @@ -119,7 +119,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.14.1 +ecdsa==0.15 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index e687171..9f616e7 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -1,7 +1,7 @@ # Editable install with no version control (apache-airflow==2.0.0.dev0) Authlib==0.14.3 Babel==2.8.0 -Flask-AppBuilder==3.0.1 +Flask-AppBuilder==3.1.0 Flask-Babel==1.0.0 Flask-Bcrypt==0.7.1 Flask-Caching==1.9.0 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 5b24d9e..16950ef 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -1,7 +1,7 @@ # Editable install with no version control (apache-airflow==2.0.0.dev0) Authlib==0.14.3 Babel==2.8.0 -Flask-AppBuilder==3.0.1 +Flask-AppBuilder==3.1.0 Flask-Babel==1.0.0 Flask-Bcrypt==0.7.1 Flask-Caching==1.9.0 @@ -118,7 +118,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.14.1 +ecdsa==0.15 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 @@ -384,7 +384,7 @@ thrift-sasl==0.4.2 thrift==0.13.0 toml==0.10.1 toolz==0.10.0 -tornado==6.0.4 +tornado==5.1.1 tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1
[airflow] branch constraints-master updated: Updating constraints. Build id:303423721
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 1186b73 Updating constraints. Build id:303423721 1186b73 is described below commit 1186b734869c0b11f5380a6d1ef8df14f2df3660 Author: Automated GitHub Actions commit AuthorDate: Tue Oct 13 02:10:22 2020 + Updating constraints. Build id:303423721 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 2345cd1f0337f4f06a2f2595a1a59c30dc4a1535. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 4 ++-- constraints-3.7.txt | 2 +- constraints-3.8.txt | 6 +++--- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 9a9fa56..d6ecdfc 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -1,7 +1,7 @@ # Editable install with no version control (apache-airflow==2.0.0.dev0) Authlib==0.14.3 Babel==2.8.0 -Flask-AppBuilder==3.0.1 +Flask-AppBuilder==3.1.0 Flask-Babel==1.0.0 Flask-Bcrypt==0.7.1 Flask-Caching==1.9.0 @@ -119,7 +119,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.14.1 +ecdsa==0.15 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index e687171..9f616e7 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -1,7 +1,7 @@ # Editable install with no version control (apache-airflow==2.0.0.dev0) Authlib==0.14.3 Babel==2.8.0 -Flask-AppBuilder==3.0.1 +Flask-AppBuilder==3.1.0 Flask-Babel==1.0.0 Flask-Bcrypt==0.7.1 Flask-Caching==1.9.0 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 5b24d9e..16950ef 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -1,7 +1,7 @@ # Editable install with no version control (apache-airflow==2.0.0.dev0) Authlib==0.14.3 Babel==2.8.0 -Flask-AppBuilder==3.0.1 +Flask-AppBuilder==3.1.0 Flask-Babel==1.0.0 Flask-Bcrypt==0.7.1 Flask-Caching==1.9.0 @@ -118,7 +118,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.14.1 +ecdsa==0.15 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 @@ -384,7 +384,7 @@ thrift-sasl==0.4.2 thrift==0.13.0 toml==0.10.1 toolz==0.10.0 -tornado==6.0.4 +tornado==5.1.1 tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1
[airflow] tag nightly-master updated (d305876 -> ee9bdff)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from d305876 (commit) to ee9bdff (commit) from d305876 Remove redundant None provided as default to dict.get() (#11448) add 1eca73c Fix spelling (#11453) add 02ce45c Refactor celery worker command (#11336) add 358e61d Move the test_process_dags_queries_count test to quarantine (#11455) add 06141d6 Google cloud operator strict type check (#11450) add 697465d Increase timeout for waiting for images (#11460) add b1fcac2 Add more testing methods to dev/README.md (#11458) add 9142eed Adds missing schema for kerberos sidecar configuration (#11413) add 32f2a45 Rename backport packages to provider packages (#11459) add da565c9 Add option to enable TCP keepalive for communication with Kubernetes API (#11406) add f124d3f Enables back duplicate cancelling on push/schedule (#11471) add 81a977b Fix typo in docker-context-files/README.md (#11473) add d38a0a7 added type hints for aws cloud formation (#11470) add 4e32546 Mask Password in Log table when using the CLI (#11468) add 045d68d Mount volumes and volumemounts into scheduler and workers (#11426) add c47383d Bump FAB to 3.1 (#11475) add 7b3a00d Allow multiple schedulers in helm chart (#11330) add 2345cd1 Fix Harcoded Airflow version (#11483) add b8cecf5 Add link on External Task Sensor to navigate to target dag (#11481) add 623d5cd Spend less time waiting for LocalTaskJob's subprocss process to finish (#11373) add 5772d4d Add endpoints for task instances (#9597) add 2c8d203 Enable serialization by default (#11491) add cb4cd91 Add missing values entries to Parameters in chart/README.md (#11477) add 760cd14 Rename "functional DAGs" to "Decorated Flows" (#11497) add f43d855 Prevent text-selection of scheduler interval when selecting DAG ID (#11503) add e3e8fd8 Mark Smart Sensor as an early-access feature (#11499) add 42b979d Fix spelling for Airbnb (#11505) add 16e7129 Added support for provider packages for Airflow 2.0 (#11487) add 095756c Airflow tutorial to use Decorated Flows (#11308) add 56b761b Bump to Airflow 2.0.0a1 (#11507) add bf9ece7 Update CONTRIBUTING.rst (#11461) add c604891 Change Airflow version to 2.0.0a1 in Updating.md (#11508) add 4551a5e Updated tutorial_decorated_flows.rst to add links (#11510) add 4297aba Combine back multiple test types into single jobs (#11504) add e9f7bdd Fix typo in scripts/ci/libraries/_initialization.sh (#11517) add d963467 Fix example in UPDATING.md (#11518) add bcf0557 Fixes remaining test-type strategy problems (#11522) add 6c8cf6a Add reset_dag_run option on dagrun_operator to clear existing dag run (#11484) add 2509d13 Minor improvements to dev/README.md (#11525) add 3163912 Remove flask-admin based Plugins (#11515) add 545ba8e Upgrade to pymssql 2.1.5 for Py 3.8 support (#11523) add 0646849 Add protocol_version to conn_config for Cassandrahook (#11036) add 7b7cc3c backport for add_xcom_sidecar (#11478) add c099e0a Fix documentation errors (#11536) add 765d29e Pymssql is maintained again (#11537) add 3447b55 More stable kubernetes port forwarding (#11538) add 03a632e Resolve MSSQL DAG serialization bug by changing datatype for execution date (#11512) add 1ddeddc Rename (confusing) dag.sub_dag to dag.partial_subset (#11542) add e7dc964 Adds capability of installing wheel packages in CI image (#11527) add 13959df Feature: Auto-refresh Graph view chart (#11534) add eee4e30 Add better debug logging to K8sexec and K8sPodOp (#11502) add 81a5b03 Visual tweaking of TI swatches, legend refactoring (#11550) add f7e01ab Create job for airflow migrations (#11533) add 89d4dd8 Auto-refresh default state (#11559) add 7ab6210 Prepend `DAG:` to dag permissions (#11189) add 8372ab1 Add/implement Webpack plugin to minify CSS files on-compile (#11564) add 5d4fbce Clarify breeze docs --install-airflow-version/-reference (#11570) add 6733f2d The scripts fixing ownership and cleaning tmp use docker run (#11569) add 3cddc11 Updated template_fields_rendereds for PostgresOperator and SimpleHttpOperator (#11555) add 399b81d Prevent pop-over elements from being cut off by hidden overflow (#11574) add df75610 Fix broken backtick usage in Timezone docs (#11575) add 8865d14 Strict type checking for provider google cloud (#11548) add 6f0bc0d Fixes dependencies to pre-release versions of apache-airflow (#11578) add 3163016 Guard against kubernetes not being installed (#11558) add 45d608
[airflow] branch constraints-master updated: Updating constraints. Build id:309733697
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 54e7ae3 Updating constraints. Build id:309733697 54e7ae3 is described below commit 54e7ae3c35aab7f2a31b59617d7dd59065913615 Author: Automated GitHub Actions commit AuthorDate: Fri Oct 16 02:37:30 2020 + Updating constraints. Build id:309733697 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 7ab62100af8a59694721e06b213a933869c6a1ed. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 2b5fee9..409ac48 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -119,7 +119,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.15 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1
[airflow] branch constraints-master updated: Updating constraints. Build id:309733697
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 54e7ae3 Updating constraints. Build id:309733697 54e7ae3 is described below commit 54e7ae3c35aab7f2a31b59617d7dd59065913615 Author: Automated GitHub Actions commit AuthorDate: Fri Oct 16 02:37:30 2020 + Updating constraints. Build id:309733697 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 7ab62100af8a59694721e06b213a933869c6a1ed. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 2b5fee9..409ac48 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -119,7 +119,7 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.15 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 elasticsearch-dsl==7.2.1 elasticsearch==7.5.1
[airflow] tag nightly-master updated (ee9bdff -> d93b6e5)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from ee9bdff (commit) to d93b6e5 (commit) from ee9bdff Minor doc improvements in blob_storage_to_gcs.rst (#11607) add 16ed974 Remove redundant code to serialized k8s.V1Pod (#11602) add f0f01d4 Replace old screenshots for managing Connections with new (#11608) add c77865b bump werkzeug version (#11610) add 925f761 Behaviour to install all airflow providers added (#11529) add bf468c7 Mention about .sh commands and templates in BashOperator docs (#11566) add 112f7d7 Add creating_job_id to DagRun table (#11396) add 90384b1 fix typo in 'Installing with Breeze' doc (#11611) add 7285182 Use permission constants (#11389) add f507180 Make DagRunType inherit from `str` too for easier use. (#11621) add 620d3a6 Add missing states in TaskGroup state (#11626) add e74b861 Expose flower and redis ports in breeze (#11624) add db3fe09 Teardown of webserver tests is not picky about processes. (#11616) add 66ced72 Name and optionally preserve data volumes in Breeze (#11628) add 49c5814 Strict type checking for provider Google (#11609) add 46a121f docs: Update Bigquery clustering docstrings (#11232) add 63a1633 Update order for pre-commits to fail fast (#11636) add 76dd8d0 Fix typo in BREEZE.rst (#11637) add f8ff217 Fix incorrect typing and move config args out of extra connection config to operator args (#11635) add 9237338 Optimizes CI builds heavily with selective checks (#11541) add 885db90 Fix minor typos in tests (#11638) add 4655409 Improves stability of K8S tests by caching binaries and repeats (#11634) add bf79578 Fix random kills during pre-commit image building (#11535) add 6fbb235 Fixed an error introduced in selective checks (#11640) add 4fcc71c Fixes selective tests in case of missing merge commits (#11641) add c06addf Revert "Fixes selective tests in case of missing merge commits (#11641)" (#11646) add 8ed2229 Revert "Fixed an error introduced in selective checks (#11640)" (#11647) add d93b6e5 Revert "Optimizes CI builds heavily with selective checks (#11541)" (#11648) No new revisions were added by this update. Summary of changes: .github/workflows/build-images-workflow-run.yml| 1 + .github/workflows/ci.yml | 11 ++ .pre-commit-config.yaml| 48 +++ BREEZE.rst | 63 +++- CONTRIBUTING.rst | 159 - Dockerfile | 3 + Dockerfile.ci | 10 +- IMAGES.rst | 18 ++- INSTALL| 18 +++ airflow/api_connexion/endpoints/config_endpoint.py | 3 +- .../api_connexion/endpoints/connection_endpoint.py | 11 +- airflow/api_connexion/endpoints/dag_endpoint.py| 8 +- .../api_connexion/endpoints/dag_run_endpoint.py| 37 - .../api_connexion/endpoints/dag_source_endpoint.py | 4 +- .../api_connexion/endpoints/event_log_endpoint.py | 5 +- .../api_connexion/endpoints/extra_link_endpoint.py | 8 +- .../endpoints/import_error_endpoint.py | 5 +- airflow/api_connexion/endpoints/log_endpoint.py| 6 +- airflow/api_connexion/endpoints/pool_endpoint.py | 11 +- airflow/api_connexion/endpoints/task_endpoint.py | 14 +- .../endpoints/task_instance_endpoint.py| 30 ++-- .../api_connexion/endpoints/variable_endpoint.py | 11 +- airflow/api_connexion/endpoints/xcom_endpoint.py | 16 +-- airflow/api_connexion/security.py | 9 +- airflow/jobs/backfill_job.py | 5 +- airflow/jobs/base_job.py | 9 ++ airflow/jobs/scheduler_job.py | 7 +- ... => 364159666cbd_add_job_id_to_dagrun_table.py} | 20 +-- airflow/models/dag.py | 14 +- airflow/models/dagrun.py | 13 +- airflow/operators/bash.py | 7 + airflow/providers/google/cloud/hooks/bigquery.py | 12 +- .../providers/google/cloud/operators/bigquery.py | 8 +- .../google/cloud/transfers/gcs_to_bigquery.py | 4 +- .../providers/google/common/hooks/base_google.py | 4 +- .../providers/google/common/hooks/discovery_api.py | 6 +- .../google/firebase/operators/firestore.py | 2 +- .../google/marketing_platform/hooks/analytics.py | 4 +- .../marketing_platform/hooks/campaign_manager.py | 6 +- .../marketing_platform/hooks/display_video.py | 4 +-
[airflow] tag nightly-master updated (ee9bdff -> d93b6e5)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from ee9bdff (commit) to d93b6e5 (commit) from ee9bdff Minor doc improvements in blob_storage_to_gcs.rst (#11607) add 16ed974 Remove redundant code to serialized k8s.V1Pod (#11602) add f0f01d4 Replace old screenshots for managing Connections with new (#11608) add c77865b bump werkzeug version (#11610) add 925f761 Behaviour to install all airflow providers added (#11529) add bf468c7 Mention about .sh commands and templates in BashOperator docs (#11566) add 112f7d7 Add creating_job_id to DagRun table (#11396) add 90384b1 fix typo in 'Installing with Breeze' doc (#11611) add 7285182 Use permission constants (#11389) add f507180 Make DagRunType inherit from `str` too for easier use. (#11621) add 620d3a6 Add missing states in TaskGroup state (#11626) add e74b861 Expose flower and redis ports in breeze (#11624) add db3fe09 Teardown of webserver tests is not picky about processes. (#11616) add 66ced72 Name and optionally preserve data volumes in Breeze (#11628) add 49c5814 Strict type checking for provider Google (#11609) add 46a121f docs: Update Bigquery clustering docstrings (#11232) add 63a1633 Update order for pre-commits to fail fast (#11636) add 76dd8d0 Fix typo in BREEZE.rst (#11637) add f8ff217 Fix incorrect typing and move config args out of extra connection config to operator args (#11635) add 9237338 Optimizes CI builds heavily with selective checks (#11541) add 885db90 Fix minor typos in tests (#11638) add 4655409 Improves stability of K8S tests by caching binaries and repeats (#11634) add bf79578 Fix random kills during pre-commit image building (#11535) add 6fbb235 Fixed an error introduced in selective checks (#11640) add 4fcc71c Fixes selective tests in case of missing merge commits (#11641) add c06addf Revert "Fixes selective tests in case of missing merge commits (#11641)" (#11646) add 8ed2229 Revert "Fixed an error introduced in selective checks (#11640)" (#11647) add d93b6e5 Revert "Optimizes CI builds heavily with selective checks (#11541)" (#11648) No new revisions were added by this update. Summary of changes: .github/workflows/build-images-workflow-run.yml| 1 + .github/workflows/ci.yml | 11 ++ .pre-commit-config.yaml| 48 +++ BREEZE.rst | 63 +++- CONTRIBUTING.rst | 159 - Dockerfile | 3 + Dockerfile.ci | 10 +- IMAGES.rst | 18 ++- INSTALL| 18 +++ airflow/api_connexion/endpoints/config_endpoint.py | 3 +- .../api_connexion/endpoints/connection_endpoint.py | 11 +- airflow/api_connexion/endpoints/dag_endpoint.py| 8 +- .../api_connexion/endpoints/dag_run_endpoint.py| 37 - .../api_connexion/endpoints/dag_source_endpoint.py | 4 +- .../api_connexion/endpoints/event_log_endpoint.py | 5 +- .../api_connexion/endpoints/extra_link_endpoint.py | 8 +- .../endpoints/import_error_endpoint.py | 5 +- airflow/api_connexion/endpoints/log_endpoint.py| 6 +- airflow/api_connexion/endpoints/pool_endpoint.py | 11 +- airflow/api_connexion/endpoints/task_endpoint.py | 14 +- .../endpoints/task_instance_endpoint.py| 30 ++-- .../api_connexion/endpoints/variable_endpoint.py | 11 +- airflow/api_connexion/endpoints/xcom_endpoint.py | 16 +-- airflow/api_connexion/security.py | 9 +- airflow/jobs/backfill_job.py | 5 +- airflow/jobs/base_job.py | 9 ++ airflow/jobs/scheduler_job.py | 7 +- ... => 364159666cbd_add_job_id_to_dagrun_table.py} | 20 +-- airflow/models/dag.py | 14 +- airflow/models/dagrun.py | 13 +- airflow/operators/bash.py | 7 + airflow/providers/google/cloud/hooks/bigquery.py | 12 +- .../providers/google/cloud/operators/bigquery.py | 8 +- .../google/cloud/transfers/gcs_to_bigquery.py | 4 +- .../providers/google/common/hooks/base_google.py | 4 +- .../providers/google/common/hooks/discovery_api.py | 6 +- .../google/firebase/operators/firestore.py | 2 +- .../google/marketing_platform/hooks/analytics.py | 4 +- .../marketing_platform/hooks/campaign_manager.py | 6 +- .../marketing_platform/hooks/display_video.py | 4 +-
[airflow] branch constraints-master updated: Updating constraints. Build id:317222594
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6929971 Updating constraints. Build id:317222594 6929971 is described below commit 69299717aa12bc23ce11ec403789eeec80385baa Author: Automated GitHub Actions commit AuthorDate: Tue Oct 20 09:58:01 2020 + Updating constraints. Build id:317222594 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 318f18f5a835f457c6a68426a476af89ace0c7e7. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 1 + constraints-3.7.txt | 1 + constraints-3.8.txt | 1 + 3 files changed, 3 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 409ac48..454fb69 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -266,6 +266,7 @@ paramiko==2.7.1 parso==0.7.1 pathspec==0.8.0 pbr==5.4.5 +pdpyras==4.1.2 pendulum==2.1.2 pep562==1.0 pexpect==4.8.0 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index df46bf0..2817e5f 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -262,6 +262,7 @@ paramiko==2.7.1 parso==0.7.1 pathspec==0.8.0 pbr==5.4.5 +pdpyras==4.1.2 pendulum==2.1.2 pexpect==4.8.0 pickleshare==0.7.5 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index a6d1f98..ad1d4cb 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -262,6 +262,7 @@ paramiko==2.7.1 parso==0.7.1 pathspec==0.8.0 pbr==5.4.5 +pdpyras==4.1.2 pendulum==2.1.2 pexpect==4.8.0 pickleshare==0.7.5
[airflow] branch constraints-master updated: Updating constraints. Build id:317222594
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6929971 Updating constraints. Build id:317222594 6929971 is described below commit 69299717aa12bc23ce11ec403789eeec80385baa Author: Automated GitHub Actions commit AuthorDate: Tue Oct 20 09:58:01 2020 + Updating constraints. Build id:317222594 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 318f18f5a835f457c6a68426a476af89ace0c7e7. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 1 + constraints-3.7.txt | 1 + constraints-3.8.txt | 1 + 3 files changed, 3 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 409ac48..454fb69 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -266,6 +266,7 @@ paramiko==2.7.1 parso==0.7.1 pathspec==0.8.0 pbr==5.4.5 +pdpyras==4.1.2 pendulum==2.1.2 pep562==1.0 pexpect==4.8.0 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index df46bf0..2817e5f 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -262,6 +262,7 @@ paramiko==2.7.1 parso==0.7.1 pathspec==0.8.0 pbr==5.4.5 +pdpyras==4.1.2 pendulum==2.1.2 pexpect==4.8.0 pickleshare==0.7.5 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index a6d1f98..ad1d4cb 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -262,6 +262,7 @@ paramiko==2.7.1 parso==0.7.1 pathspec==0.8.0 pbr==5.4.5 +pdpyras==4.1.2 pendulum==2.1.2 pexpect==4.8.0 pickleshare==0.7.5
[airflow] branch constraints-master updated: Updating constraints. Build id:297191668
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new aa2b8db Updating constraints. Build id:297191668 aa2b8db is described below commit aa2b8dbe039e6e0fc283abe0d95ab1cf39462f0c Author: Automated GitHub Actions commit AuthorDate: Fri Oct 9 10:42:26 2020 + Updating constraints. Build id:297191668 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha d2754ef76958f8df4dcb6974e2cd2c1edb17935e. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 220 - constraints-3.7.txt | 225 +- constraints-3.8.txt | 233 +--- 3 files changed, 331 insertions(+), 347 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 44d1a60..9a9fa56 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -12,7 +12,7 @@ Flask-OpenID==1.2.5 Flask-SQLAlchemy==2.4.4 Flask-WTF==0.14.3 Flask==1.1.2 -GitPython==3.1.9 +GitPython==3.1.7 HeapDict==1.0.1 JPype1==1.0.2 JayDeBeApi==1.2.3 @@ -25,7 +25,7 @@ PyJWT==1.7.1 PyNaCl==1.4.0 PySmbClient==0.1.5 PyYAML==5.3.1 -Pygments==2.7.1 +Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 SQLAlchemy-Utils==0.36.8 SQLAlchemy==1.3.19 @@ -36,28 +36,28 @@ Werkzeug==0.16.1 adal==1.2.4 aiohttp==3.6.2 alabaster==0.7.12 -alembic==1.4.3 -amqp==5.0.1 +alembic==1.4.2 +amqp==2.6.1 analytics-python==1.2.9 ansiwrap==0.8.4 apipkg==1.5 -apispec==3.3.2 +apispec==3.3.1 appdirs==1.4.4 -argcomplete==1.12.1 -arrow==0.17.0 +argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10 async-timeout==3.0.1 atlasclient==1.0.0 attrs==19.3.0 -aws-sam-translator==1.27.0 +aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 -azure-core==1.8.2 +azure-core==1.8.1 azure-cosmos==3.2.0 -azure-datalake-store==0.0.50 +azure-datalake-store==0.0.49 azure-identity==1.4.0 azure-keyvault-certificates==4.2.1 azure-keyvault-keys==4.2.0 @@ -65,11 +65,10 @@ azure-keyvault-secrets==4.2.0 azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 -azure-mgmt-core==1.2.1 azure-mgmt-datalake-nspkg==3.0.1 azure-mgmt-datalake-store==0.5.0 azure-mgmt-nspkg==3.0.2 -azure-mgmt-resource==15.0.0 +azure-mgmt-resource==10.2.0 azure-nspkg==3.0.2 azure-storage-blob==2.1.0 azure-storage-common==2.1.0 @@ -78,39 +77,38 @@ backcall==0.2.0 bcrypt==3.2.0 beautifulsoup4==4.7.1 billiard==3.6.3.0 -black==20.8b1 +black==19.10b0 blinker==1.4 -boto3==1.15.13 +boto3==1.14.44 boto==2.49.0 -botocore==1.18.13 -bowler==0.9.0 -cached-property==1.5.2 +botocore==1.17.44 +bowler==0.8.0 +cached-property==1.5.1 cachetools==4.1.1 cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.3 +cffi==1.14.2 cfgv==3.2.0 -cfn-lint==0.37.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 -clickclick==20.10.2 +clickclick==1.2.2 cloudant==2.14.0 cloudpickle==1.4.1 colorama==0.4.3 colorlog==4.0.2 connexion==2.7.0 contextvars==2.4 -coverage==5.3 +coverage==5.2.1 croniter==0.3.34 -cryptography==3.1.1 +cryptography==3.0 curlify==2.2.1 -cx-Oracle==8.0.1 -dask==2.30.0 -dataclasses==0.7 -datadog==0.39.0 +cx-Oracle==8.0.0 +dask==2.23.0 +datadog==0.38.0 decorator==4.4.2 defusedxml==0.6.0 dill==0.3.2 @@ -121,90 +119,89 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.16.0 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 -elasticsearch-dsl==7.3.0 +elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 email-validator==1.1.1 entrypoints==0.3 -eventlet==0.28.0 +eventlet==0.26.1 execnet==1.7.1 -facebook-business==8.0.5 -fastavro==1.0.0.post1 +facebook-business==8.0.0 +fastavro==0.24.1 filelock==3.0.12 fissix==20.8.0 flake8-colors==0.1.6 -flake8==3.8.4 +flake8==3.8.3 flaky==3.7.0 flask-swagger==0.2.13 flower==0.9.5 -freezegun==1.0.0 -fsspec==0.8.3 +freezegun==0.3.15 +fsspec==0.8.0 funcsigs==1.0.2 future-fstrings==1.2.0 future==0.18.2 -gcsfs==0.7.1 -gevent==20.9.0 +gcsfs==0.6.2 +gevent==20.6.2 gitdb==4.0.5 github3.py==1.3.0 google-ads==4.0.0 -google-api-core==1.22.4 -google-api-python-client==1.12.3 +google-api-core==1.22.1 +google-api-python-client==1.10.0 google-auth-httplib2==0.0.4 google-auth-oauthlib==0.4.1 -google-auth==1.22.1 +google-auth==1.20.1 google-cloud-automl==1.0.1 -google-cloud-bigquery-datatransfer==1.1.1 -google-cloud-bigquery-storage==2.0.0 -google-cloud-bigquery==2.0.0 -google-cloud
[airflow] branch constraints-master updated: Updating constraints. Build id:297191668
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new aa2b8db Updating constraints. Build id:297191668 aa2b8db is described below commit aa2b8dbe039e6e0fc283abe0d95ab1cf39462f0c Author: Automated GitHub Actions commit AuthorDate: Fri Oct 9 10:42:26 2020 + Updating constraints. Build id:297191668 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha d2754ef76958f8df4dcb6974e2cd2c1edb17935e. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 220 - constraints-3.7.txt | 225 +- constraints-3.8.txt | 233 +--- 3 files changed, 331 insertions(+), 347 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 44d1a60..9a9fa56 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -12,7 +12,7 @@ Flask-OpenID==1.2.5 Flask-SQLAlchemy==2.4.4 Flask-WTF==0.14.3 Flask==1.1.2 -GitPython==3.1.9 +GitPython==3.1.7 HeapDict==1.0.1 JPype1==1.0.2 JayDeBeApi==1.2.3 @@ -25,7 +25,7 @@ PyJWT==1.7.1 PyNaCl==1.4.0 PySmbClient==0.1.5 PyYAML==5.3.1 -Pygments==2.7.1 +Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 SQLAlchemy-Utils==0.36.8 SQLAlchemy==1.3.19 @@ -36,28 +36,28 @@ Werkzeug==0.16.1 adal==1.2.4 aiohttp==3.6.2 alabaster==0.7.12 -alembic==1.4.3 -amqp==5.0.1 +alembic==1.4.2 +amqp==2.6.1 analytics-python==1.2.9 ansiwrap==0.8.4 apipkg==1.5 -apispec==3.3.2 +apispec==3.3.1 appdirs==1.4.4 -argcomplete==1.12.1 -arrow==0.17.0 +argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10 async-timeout==3.0.1 atlasclient==1.0.0 attrs==19.3.0 -aws-sam-translator==1.27.0 +aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 -azure-core==1.8.2 +azure-core==1.8.1 azure-cosmos==3.2.0 -azure-datalake-store==0.0.50 +azure-datalake-store==0.0.49 azure-identity==1.4.0 azure-keyvault-certificates==4.2.1 azure-keyvault-keys==4.2.0 @@ -65,11 +65,10 @@ azure-keyvault-secrets==4.2.0 azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 -azure-mgmt-core==1.2.1 azure-mgmt-datalake-nspkg==3.0.1 azure-mgmt-datalake-store==0.5.0 azure-mgmt-nspkg==3.0.2 -azure-mgmt-resource==15.0.0 +azure-mgmt-resource==10.2.0 azure-nspkg==3.0.2 azure-storage-blob==2.1.0 azure-storage-common==2.1.0 @@ -78,39 +77,38 @@ backcall==0.2.0 bcrypt==3.2.0 beautifulsoup4==4.7.1 billiard==3.6.3.0 -black==20.8b1 +black==19.10b0 blinker==1.4 -boto3==1.15.13 +boto3==1.14.44 boto==2.49.0 -botocore==1.18.13 -bowler==0.9.0 -cached-property==1.5.2 +botocore==1.17.44 +bowler==0.8.0 +cached-property==1.5.1 cachetools==4.1.1 cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.3 +cffi==1.14.2 cfgv==3.2.0 -cfn-lint==0.37.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 -clickclick==20.10.2 +clickclick==1.2.2 cloudant==2.14.0 cloudpickle==1.4.1 colorama==0.4.3 colorlog==4.0.2 connexion==2.7.0 contextvars==2.4 -coverage==5.3 +coverage==5.2.1 croniter==0.3.34 -cryptography==3.1.1 +cryptography==3.0 curlify==2.2.1 -cx-Oracle==8.0.1 -dask==2.30.0 -dataclasses==0.7 -datadog==0.39.0 +cx-Oracle==8.0.0 +dask==2.23.0 +datadog==0.38.0 decorator==4.4.2 defusedxml==0.6.0 dill==0.3.2 @@ -121,90 +119,89 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.16.0 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 -elasticsearch-dsl==7.3.0 +elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 email-validator==1.1.1 entrypoints==0.3 -eventlet==0.28.0 +eventlet==0.26.1 execnet==1.7.1 -facebook-business==8.0.5 -fastavro==1.0.0.post1 +facebook-business==8.0.0 +fastavro==0.24.1 filelock==3.0.12 fissix==20.8.0 flake8-colors==0.1.6 -flake8==3.8.4 +flake8==3.8.3 flaky==3.7.0 flask-swagger==0.2.13 flower==0.9.5 -freezegun==1.0.0 -fsspec==0.8.3 +freezegun==0.3.15 +fsspec==0.8.0 funcsigs==1.0.2 future-fstrings==1.2.0 future==0.18.2 -gcsfs==0.7.1 -gevent==20.9.0 +gcsfs==0.6.2 +gevent==20.6.2 gitdb==4.0.5 github3.py==1.3.0 google-ads==4.0.0 -google-api-core==1.22.4 -google-api-python-client==1.12.3 +google-api-core==1.22.1 +google-api-python-client==1.10.0 google-auth-httplib2==0.0.4 google-auth-oauthlib==0.4.1 -google-auth==1.22.1 +google-auth==1.20.1 google-cloud-automl==1.0.1 -google-cloud-bigquery-datatransfer==1.1.1 -google-cloud-bigquery-storage==2.0.0 -google-cloud-bigquery==2.0.0 -google-cloud
[airflow] branch constraints-master updated: Updating constraints. Build id:297191668
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new aa2b8db Updating constraints. Build id:297191668 aa2b8db is described below commit aa2b8dbe039e6e0fc283abe0d95ab1cf39462f0c Author: Automated GitHub Actions commit AuthorDate: Fri Oct 9 10:42:26 2020 + Updating constraints. Build id:297191668 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha d2754ef76958f8df4dcb6974e2cd2c1edb17935e. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 220 - constraints-3.7.txt | 225 +- constraints-3.8.txt | 233 +--- 3 files changed, 331 insertions(+), 347 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 44d1a60..9a9fa56 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -12,7 +12,7 @@ Flask-OpenID==1.2.5 Flask-SQLAlchemy==2.4.4 Flask-WTF==0.14.3 Flask==1.1.2 -GitPython==3.1.9 +GitPython==3.1.7 HeapDict==1.0.1 JPype1==1.0.2 JayDeBeApi==1.2.3 @@ -25,7 +25,7 @@ PyJWT==1.7.1 PyNaCl==1.4.0 PySmbClient==0.1.5 PyYAML==5.3.1 -Pygments==2.7.1 +Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 SQLAlchemy-Utils==0.36.8 SQLAlchemy==1.3.19 @@ -36,28 +36,28 @@ Werkzeug==0.16.1 adal==1.2.4 aiohttp==3.6.2 alabaster==0.7.12 -alembic==1.4.3 -amqp==5.0.1 +alembic==1.4.2 +amqp==2.6.1 analytics-python==1.2.9 ansiwrap==0.8.4 apipkg==1.5 -apispec==3.3.2 +apispec==3.3.1 appdirs==1.4.4 -argcomplete==1.12.1 -arrow==0.17.0 +argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10 async-timeout==3.0.1 atlasclient==1.0.0 attrs==19.3.0 -aws-sam-translator==1.27.0 +aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 -azure-core==1.8.2 +azure-core==1.8.1 azure-cosmos==3.2.0 -azure-datalake-store==0.0.50 +azure-datalake-store==0.0.49 azure-identity==1.4.0 azure-keyvault-certificates==4.2.1 azure-keyvault-keys==4.2.0 @@ -65,11 +65,10 @@ azure-keyvault-secrets==4.2.0 azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 -azure-mgmt-core==1.2.1 azure-mgmt-datalake-nspkg==3.0.1 azure-mgmt-datalake-store==0.5.0 azure-mgmt-nspkg==3.0.2 -azure-mgmt-resource==15.0.0 +azure-mgmt-resource==10.2.0 azure-nspkg==3.0.2 azure-storage-blob==2.1.0 azure-storage-common==2.1.0 @@ -78,39 +77,38 @@ backcall==0.2.0 bcrypt==3.2.0 beautifulsoup4==4.7.1 billiard==3.6.3.0 -black==20.8b1 +black==19.10b0 blinker==1.4 -boto3==1.15.13 +boto3==1.14.44 boto==2.49.0 -botocore==1.18.13 -bowler==0.9.0 -cached-property==1.5.2 +botocore==1.17.44 +bowler==0.8.0 +cached-property==1.5.1 cachetools==4.1.1 cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.3 +cffi==1.14.2 cfgv==3.2.0 -cfn-lint==0.37.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 -clickclick==20.10.2 +clickclick==1.2.2 cloudant==2.14.0 cloudpickle==1.4.1 colorama==0.4.3 colorlog==4.0.2 connexion==2.7.0 contextvars==2.4 -coverage==5.3 +coverage==5.2.1 croniter==0.3.34 -cryptography==3.1.1 +cryptography==3.0 curlify==2.2.1 -cx-Oracle==8.0.1 -dask==2.30.0 -dataclasses==0.7 -datadog==0.39.0 +cx-Oracle==8.0.0 +dask==2.23.0 +datadog==0.38.0 decorator==4.4.2 defusedxml==0.6.0 dill==0.3.2 @@ -121,90 +119,89 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.16.0 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 -elasticsearch-dsl==7.3.0 +elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 email-validator==1.1.1 entrypoints==0.3 -eventlet==0.28.0 +eventlet==0.26.1 execnet==1.7.1 -facebook-business==8.0.5 -fastavro==1.0.0.post1 +facebook-business==8.0.0 +fastavro==0.24.1 filelock==3.0.12 fissix==20.8.0 flake8-colors==0.1.6 -flake8==3.8.4 +flake8==3.8.3 flaky==3.7.0 flask-swagger==0.2.13 flower==0.9.5 -freezegun==1.0.0 -fsspec==0.8.3 +freezegun==0.3.15 +fsspec==0.8.0 funcsigs==1.0.2 future-fstrings==1.2.0 future==0.18.2 -gcsfs==0.7.1 -gevent==20.9.0 +gcsfs==0.6.2 +gevent==20.6.2 gitdb==4.0.5 github3.py==1.3.0 google-ads==4.0.0 -google-api-core==1.22.4 -google-api-python-client==1.12.3 +google-api-core==1.22.1 +google-api-python-client==1.10.0 google-auth-httplib2==0.0.4 google-auth-oauthlib==0.4.1 -google-auth==1.22.1 +google-auth==1.20.1 google-cloud-automl==1.0.1 -google-cloud-bigquery-datatransfer==1.1.1 -google-cloud-bigquery-storage==2.0.0 -google-cloud-bigquery==2.0.0 -google-cloud
[airflow] branch constraints-master updated: Updating constraints. Build id:297191668
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new aa2b8db Updating constraints. Build id:297191668 aa2b8db is described below commit aa2b8dbe039e6e0fc283abe0d95ab1cf39462f0c Author: Automated GitHub Actions commit AuthorDate: Fri Oct 9 10:42:26 2020 + Updating constraints. Build id:297191668 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha d2754ef76958f8df4dcb6974e2cd2c1edb17935e. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 220 - constraints-3.7.txt | 225 +- constraints-3.8.txt | 233 +--- 3 files changed, 331 insertions(+), 347 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 44d1a60..9a9fa56 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -12,7 +12,7 @@ Flask-OpenID==1.2.5 Flask-SQLAlchemy==2.4.4 Flask-WTF==0.14.3 Flask==1.1.2 -GitPython==3.1.9 +GitPython==3.1.7 HeapDict==1.0.1 JPype1==1.0.2 JayDeBeApi==1.2.3 @@ -25,7 +25,7 @@ PyJWT==1.7.1 PyNaCl==1.4.0 PySmbClient==0.1.5 PyYAML==5.3.1 -Pygments==2.7.1 +Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 SQLAlchemy-Utils==0.36.8 SQLAlchemy==1.3.19 @@ -36,28 +36,28 @@ Werkzeug==0.16.1 adal==1.2.4 aiohttp==3.6.2 alabaster==0.7.12 -alembic==1.4.3 -amqp==5.0.1 +alembic==1.4.2 +amqp==2.6.1 analytics-python==1.2.9 ansiwrap==0.8.4 apipkg==1.5 -apispec==3.3.2 +apispec==3.3.1 appdirs==1.4.4 -argcomplete==1.12.1 -arrow==0.17.0 +argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10 async-timeout==3.0.1 atlasclient==1.0.0 attrs==19.3.0 -aws-sam-translator==1.27.0 +aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 -azure-core==1.8.2 +azure-core==1.8.1 azure-cosmos==3.2.0 -azure-datalake-store==0.0.50 +azure-datalake-store==0.0.49 azure-identity==1.4.0 azure-keyvault-certificates==4.2.1 azure-keyvault-keys==4.2.0 @@ -65,11 +65,10 @@ azure-keyvault-secrets==4.2.0 azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 -azure-mgmt-core==1.2.1 azure-mgmt-datalake-nspkg==3.0.1 azure-mgmt-datalake-store==0.5.0 azure-mgmt-nspkg==3.0.2 -azure-mgmt-resource==15.0.0 +azure-mgmt-resource==10.2.0 azure-nspkg==3.0.2 azure-storage-blob==2.1.0 azure-storage-common==2.1.0 @@ -78,39 +77,38 @@ backcall==0.2.0 bcrypt==3.2.0 beautifulsoup4==4.7.1 billiard==3.6.3.0 -black==20.8b1 +black==19.10b0 blinker==1.4 -boto3==1.15.13 +boto3==1.14.44 boto==2.49.0 -botocore==1.18.13 -bowler==0.9.0 -cached-property==1.5.2 +botocore==1.17.44 +bowler==0.8.0 +cached-property==1.5.1 cachetools==4.1.1 cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.3 +cffi==1.14.2 cfgv==3.2.0 -cfn-lint==0.37.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 -clickclick==20.10.2 +clickclick==1.2.2 cloudant==2.14.0 cloudpickle==1.4.1 colorama==0.4.3 colorlog==4.0.2 connexion==2.7.0 contextvars==2.4 -coverage==5.3 +coverage==5.2.1 croniter==0.3.34 -cryptography==3.1.1 +cryptography==3.0 curlify==2.2.1 -cx-Oracle==8.0.1 -dask==2.30.0 -dataclasses==0.7 -datadog==0.39.0 +cx-Oracle==8.0.0 +dask==2.23.0 +datadog==0.38.0 decorator==4.4.2 defusedxml==0.6.0 dill==0.3.2 @@ -121,90 +119,89 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.16.0 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 -elasticsearch-dsl==7.3.0 +elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 email-validator==1.1.1 entrypoints==0.3 -eventlet==0.28.0 +eventlet==0.26.1 execnet==1.7.1 -facebook-business==8.0.5 -fastavro==1.0.0.post1 +facebook-business==8.0.0 +fastavro==0.24.1 filelock==3.0.12 fissix==20.8.0 flake8-colors==0.1.6 -flake8==3.8.4 +flake8==3.8.3 flaky==3.7.0 flask-swagger==0.2.13 flower==0.9.5 -freezegun==1.0.0 -fsspec==0.8.3 +freezegun==0.3.15 +fsspec==0.8.0 funcsigs==1.0.2 future-fstrings==1.2.0 future==0.18.2 -gcsfs==0.7.1 -gevent==20.9.0 +gcsfs==0.6.2 +gevent==20.6.2 gitdb==4.0.5 github3.py==1.3.0 google-ads==4.0.0 -google-api-core==1.22.4 -google-api-python-client==1.12.3 +google-api-core==1.22.1 +google-api-python-client==1.10.0 google-auth-httplib2==0.0.4 google-auth-oauthlib==0.4.1 -google-auth==1.22.1 +google-auth==1.20.1 google-cloud-automl==1.0.1 -google-cloud-bigquery-datatransfer==1.1.1 -google-cloud-bigquery-storage==2.0.0 -google-cloud-bigquery==2.0.0 -google-cloud
[airflow] branch constraints-master updated: Updating constraints. Build id:297191668
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new aa2b8db Updating constraints. Build id:297191668 aa2b8db is described below commit aa2b8dbe039e6e0fc283abe0d95ab1cf39462f0c Author: Automated GitHub Actions commit AuthorDate: Fri Oct 9 10:42:26 2020 + Updating constraints. Build id:297191668 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha d2754ef76958f8df4dcb6974e2cd2c1edb17935e. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 220 - constraints-3.7.txt | 225 +- constraints-3.8.txt | 233 +--- 3 files changed, 331 insertions(+), 347 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 44d1a60..9a9fa56 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -12,7 +12,7 @@ Flask-OpenID==1.2.5 Flask-SQLAlchemy==2.4.4 Flask-WTF==0.14.3 Flask==1.1.2 -GitPython==3.1.9 +GitPython==3.1.7 HeapDict==1.0.1 JPype1==1.0.2 JayDeBeApi==1.2.3 @@ -25,7 +25,7 @@ PyJWT==1.7.1 PyNaCl==1.4.0 PySmbClient==0.1.5 PyYAML==5.3.1 -Pygments==2.7.1 +Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 SQLAlchemy-Utils==0.36.8 SQLAlchemy==1.3.19 @@ -36,28 +36,28 @@ Werkzeug==0.16.1 adal==1.2.4 aiohttp==3.6.2 alabaster==0.7.12 -alembic==1.4.3 -amqp==5.0.1 +alembic==1.4.2 +amqp==2.6.1 analytics-python==1.2.9 ansiwrap==0.8.4 apipkg==1.5 -apispec==3.3.2 +apispec==3.3.1 appdirs==1.4.4 -argcomplete==1.12.1 -arrow==0.17.0 +argcomplete==1.12.0 +arrow==0.16.0 asn1crypto==1.4.0 astroid==2.4.2 async-generator==1.10 async-timeout==3.0.1 atlasclient==1.0.0 attrs==19.3.0 -aws-sam-translator==1.27.0 +aws-sam-translator==1.26.0 aws-xray-sdk==2.6.0 azure-batch==9.0.0 azure-common==1.1.25 -azure-core==1.8.2 +azure-core==1.8.1 azure-cosmos==3.2.0 -azure-datalake-store==0.0.50 +azure-datalake-store==0.0.49 azure-identity==1.4.0 azure-keyvault-certificates==4.2.1 azure-keyvault-keys==4.2.0 @@ -65,11 +65,10 @@ azure-keyvault-secrets==4.2.0 azure-keyvault==4.1.0 azure-kusto-data==0.0.45 azure-mgmt-containerinstance==1.5.0 -azure-mgmt-core==1.2.1 azure-mgmt-datalake-nspkg==3.0.1 azure-mgmt-datalake-store==0.5.0 azure-mgmt-nspkg==3.0.2 -azure-mgmt-resource==15.0.0 +azure-mgmt-resource==10.2.0 azure-nspkg==3.0.2 azure-storage-blob==2.1.0 azure-storage-common==2.1.0 @@ -78,39 +77,38 @@ backcall==0.2.0 bcrypt==3.2.0 beautifulsoup4==4.7.1 billiard==3.6.3.0 -black==20.8b1 +black==19.10b0 blinker==1.4 -boto3==1.15.13 +boto3==1.14.44 boto==2.49.0 -botocore==1.18.13 -bowler==0.9.0 -cached-property==1.5.2 +botocore==1.17.44 +bowler==0.8.0 +cached-property==1.5.1 cachetools==4.1.1 cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.3 +cffi==1.14.2 cfgv==3.2.0 -cfn-lint==0.37.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 -clickclick==20.10.2 +clickclick==1.2.2 cloudant==2.14.0 cloudpickle==1.4.1 colorama==0.4.3 colorlog==4.0.2 connexion==2.7.0 contextvars==2.4 -coverage==5.3 +coverage==5.2.1 croniter==0.3.34 -cryptography==3.1.1 +cryptography==3.0 curlify==2.2.1 -cx-Oracle==8.0.1 -dask==2.30.0 -dataclasses==0.7 -datadog==0.39.0 +cx-Oracle==8.0.0 +dask==2.23.0 +datadog==0.38.0 decorator==4.4.2 defusedxml==0.6.0 dill==0.3.2 @@ -121,90 +119,89 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.16.0 +ecdsa==0.14.1 elasticsearch-dbapi==0.1.0 -elasticsearch-dsl==7.3.0 +elasticsearch-dsl==7.2.1 elasticsearch==7.5.1 email-validator==1.1.1 entrypoints==0.3 -eventlet==0.28.0 +eventlet==0.26.1 execnet==1.7.1 -facebook-business==8.0.5 -fastavro==1.0.0.post1 +facebook-business==8.0.0 +fastavro==0.24.1 filelock==3.0.12 fissix==20.8.0 flake8-colors==0.1.6 -flake8==3.8.4 +flake8==3.8.3 flaky==3.7.0 flask-swagger==0.2.13 flower==0.9.5 -freezegun==1.0.0 -fsspec==0.8.3 +freezegun==0.3.15 +fsspec==0.8.0 funcsigs==1.0.2 future-fstrings==1.2.0 future==0.18.2 -gcsfs==0.7.1 -gevent==20.9.0 +gcsfs==0.6.2 +gevent==20.6.2 gitdb==4.0.5 github3.py==1.3.0 google-ads==4.0.0 -google-api-core==1.22.4 -google-api-python-client==1.12.3 +google-api-core==1.22.1 +google-api-python-client==1.10.0 google-auth-httplib2==0.0.4 google-auth-oauthlib==0.4.1 -google-auth==1.22.1 +google-auth==1.20.1 google-cloud-automl==1.0.1 -google-cloud-bigquery-datatransfer==1.1.1 -google-cloud-bigquery-storage==2.0.0 -google-cloud-bigquery==2.0.0 -google-cloud
[airflow-site] branch asf-site updated: Update asf-site to output generated at b966fdd
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 3043365 Update asf-site to output generated at b966fdd
3043365 is described below
commit 3043365f6800ac21ba62dd757289c25c5ad0e26f
Author: potiuk
AuthorDate: Tue Oct 6 17:14:41 2020 +
Update asf-site to output generated at b966fdd
---
announcements/index.html | 18
blog/airflow-1.10.10/index.html| 4 +-
blog/airflow-1.10.12/index.html| 4 +-
blog/airflow-1.10.8-1.10.9/index.html | 4 +-
blog/airflow-survey/index.html | 4 +-
blog/announcing-new-website/index.html | 4 +-
blog/apache-airflow-for-newcomers/index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
index.html | 32 +++---
search/index.html | 4 +-
sitemap.xml| 112 ++---
use-cases/adobe/index.html | 4 +-
use-cases/big-fish-games/index.html| 4 +-
use-cases/dish/index.html | 4 +-
use-cases/experity/index.html | 4 +-
use-cases/onefootball/index.html | 4 +-
use-cases/sift/index.html | 4 +-
22 files changed, 128 insertions(+), 110 deletions(-)
diff --git a/announcements/index.html b/announcements/index.html
index be01cce..8d774ef 100644
--- a/announcements/index.html
+++ b/announcements/index.html
@@ -429,6 +429,24 @@ if (!doNotTrack) {
Note: Follow https://twitter.com/ApacheAirflow;
target="_blank">@ApacheAirflow on Twitter for the latest news and
announcements!
+October 6, 2020
+
+Weve just released Airflow Backport Provider Packages 2020.10.5.
+
+57 packages have been released.
+
+August 25, 2020
+
+Weve just released Airflow v1.10.12
+
+PyPI - https://pypi.org/project/apache-airflow/1.10.12/;
target="_blank">https://pypi.org/project/apache-airflow/1.10.12/
+
+Docs - https://airflow.apache.org/docs/1.10.12/;
target="_blank">https://airflow.apache.org/docs/1.10.12/
+
+ChangeLog - https://airflow.apache.org/docs/1.10.12/changelog.html;
target="_blank">https://airflow.apache.org/docs/1.10.12/changelog.html
+
+113 commits since 1.10.10 (5 New Features, 23 Improvements, 23 Bug Fixes,
and 14 doc changes)
+
July 20, 2020
Airflow PMC welcomes Leah Cole (https://github.com/leahecole; target="_blank">@leahecole) and
Ry Walker (https://github.com/ryw;
target="_blank">@ryw) as new Airflow Committers.
diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html
index bef7b82..61cab09 100644
--- a/blog/airflow-1.10.10/index.html
+++ b/blog/airflow-1.10.10/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-1.10.12/index.html b/blog/airflow-1.10.12/index.html
index 86091ba..eccfb7f 100644
--- a/blog/airflow-1.10.12/index.html
+++ b/blog/airflow-1.10.12/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-1.10.8-1.10.9/index.html
b/blog/airflow-1.10.8-1.10.9/index.html
index a7faedb..3a5f003 100644
--- a/blog/airflow-1.10.8-1.10.9/index.html
+++ b/blog/airflow-1.10.8-1.10.9/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html
index 2ea14ca..a10a212 100644
--- a/blog/airflow-survey/index.html
+++ b/blog/airflow-survey/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/announcing-new-website/index.html
b/blog/announcing-new-website/index.html
index 70780fb..a1ddfc1 100644
--- a/blog/announcing-new-website/index.html
+++ b/blog/announcing-new-website/index.html
@@ -36,13 +36,13 @@
-
+
-
+
diff --git a/blog/apache-airflow-for-newcomers/index.html
b/blog/apache-airflow-for-newcomers/index.html
index f41a569..cc7f242 100644
--- a/blog/apache-airflow-for-newcomers/index.html
+++ b/blog/apache-airflow-for-newcomers/index.html
@@ -37,14 +37,14 @@ Authoring Workflow in Apache Airflow. Airflow makes it easy
to author workflows
-
+
-
+
diff --git
a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html
b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html
index 0f72da8..5c75
[airflow] tag nightly-master updated (d93b6e5 -> 3970bfa)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from d93b6e5 (commit) to 3970bfa (commit) from d93b6e5 Revert "Optimizes CI builds heavily with selective checks (#11541)" (#11648) add 68f647a Dumps more logs in case of CI failure (#11614) add fd8b07c Remove usage of six (#11645) add 86725f4 fix cloudwatch and wasb taskhandler log path config (#11650) add 674368f Fixes MySQLToS3 float to int conversion (#10437) add 89e5acc Use Python 3 Style super calls (#11644) add 73b0991 Sourcing the profile file should be sufficient to update the PATH, re-login is not required. (#11588) add 86ed7dc Add ability to zoom into Graph view from selection in Tree View (#11553) add 7206fd7 Allow null schedule_interval in OpenAPI spec for DAGs (#11532) add 22f6db7 Add optional session argument to xcom_push. (#11485) add 91898e8 Add Plugins View in web UI (#10770) add ae06ad0 Fixes versioning for pre-release provider packages (#11586) add 2d854c3 Add service_account to Google ML Engine operator (#11619) add a4dc11f Change to pass all extra connection paramaters to psycopg2 (#11019) add 5c0ade4 Brings back GKEStartPodOperator to google provider. (#11664) add 73f6367 UX improvements of DAG tag filtering (#11661) add a221ccb Improvement: Populate 'Configuration JSON' form with DAG default params json in the Trigger-DAG UI (#10839) add 52b4733 Improvements for pod template file with git sync container (#11511) add 3970bfa Pod template file uses custom custom env variable (#11480) No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 39 +++-- BREEZE.rst | 5 +- airflow/api_connexion/openapi/v1.yaml | 1 + airflow/cli/commands/plugins_command.py| 1 + airflow/config_templates/airflow_local_settings.py | 4 +- airflow/example_dags/example_bash_operator.py | 3 +- airflow/models/taskinstance.py | 17 ++-- airflow/plugins_manager.py | 40 ++ .../providers/amazon/aws/transfers/mysql_to_s3.py | 3 +- .../providers/google/cloud/operators/mlengine.py | 13 +++ airflow/providers/postgres/hooks/postgres.py | 14 ++-- airflow/www/extensions/init_views.py | 1 + airflow/www/templates/airflow/dag.html | 46 +++ airflow/www/templates/airflow/dags.html| 36 +++-- .../www/templates/airflow/plugin.html | 42 +- airflow/www/views.py | 87 ++--- breeze | 17 +--- chart/files/pod-template-file.yaml | 7 +- chart/templates/_helpers.yaml | 8 ++ chart/tests/pod-template-file_test.yaml| 20 - chart/values.yaml | 4 + dev/README.md | 59 ++ docs/img/dags.png | Bin 338418 -> 297947 bytes provider_packages/refactor_provider_packages.py| 26 -- scripts/ci/libraries/_sanity_checks.sh | 8 +- scripts/ci/libraries/_start_end.sh | 27 ++- scripts/ci/libraries/_verbosity.sh | 1 + scripts/ci/mysql/conf.d/airflow.cnf| 1 + scripts/in_container/_in_container_utils.sh| 8 +- scripts/in_container/run_ci_tests.sh | 7 +- .../in_container/run_prepare_provider_packages.sh | 76 -- tests/api_connexion/endpoints/test_dag_endpoint.py | 29 +++ tests/jobs/test_scheduler_job.py | 3 +- tests/plugins/test_plugins_manager.py | 29 +++ .../amazon/aws/transfers/test_mysql_to_s3.py | 6 ++ tests/providers/exasol/hooks/test_exasol.py| 4 +- .../google/cloud/operators/test_mlengine.py| 2 + tests/providers/postgres/hooks/test_postgres.py| 8 ++ .../singularity/operators/test_singularity.py | 3 +- tests/sensors/test_smart_sensor_operator.py| 8 +- tests/test_utils/mock_operators.py | 2 +- tests/www/test_views.py| 86 +++- 42 files changed, 652 insertions(+), 149 deletions(-) copy license-templates/LICENSE.txt => airflow/www/templates/airflow/plugin.html (51%)
[airflow] tag nightly-master updated (d93b6e5 -> 3970bfa)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from d93b6e5 (commit) to 3970bfa (commit) from d93b6e5 Revert "Optimizes CI builds heavily with selective checks (#11541)" (#11648) add 68f647a Dumps more logs in case of CI failure (#11614) add fd8b07c Remove usage of six (#11645) add 86725f4 fix cloudwatch and wasb taskhandler log path config (#11650) add 674368f Fixes MySQLToS3 float to int conversion (#10437) add 89e5acc Use Python 3 Style super calls (#11644) add 73b0991 Sourcing the profile file should be sufficient to update the PATH, re-login is not required. (#11588) add 86ed7dc Add ability to zoom into Graph view from selection in Tree View (#11553) add 7206fd7 Allow null schedule_interval in OpenAPI spec for DAGs (#11532) add 22f6db7 Add optional session argument to xcom_push. (#11485) add 91898e8 Add Plugins View in web UI (#10770) add ae06ad0 Fixes versioning for pre-release provider packages (#11586) add 2d854c3 Add service_account to Google ML Engine operator (#11619) add a4dc11f Change to pass all extra connection paramaters to psycopg2 (#11019) add 5c0ade4 Brings back GKEStartPodOperator to google provider. (#11664) add 73f6367 UX improvements of DAG tag filtering (#11661) add a221ccb Improvement: Populate 'Configuration JSON' form with DAG default params json in the Trigger-DAG UI (#10839) add 52b4733 Improvements for pod template file with git sync container (#11511) add 3970bfa Pod template file uses custom custom env variable (#11480) No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 39 +++-- BREEZE.rst | 5 +- airflow/api_connexion/openapi/v1.yaml | 1 + airflow/cli/commands/plugins_command.py| 1 + airflow/config_templates/airflow_local_settings.py | 4 +- airflow/example_dags/example_bash_operator.py | 3 +- airflow/models/taskinstance.py | 17 ++-- airflow/plugins_manager.py | 40 ++ .../providers/amazon/aws/transfers/mysql_to_s3.py | 3 +- .../providers/google/cloud/operators/mlengine.py | 13 +++ airflow/providers/postgres/hooks/postgres.py | 14 ++-- airflow/www/extensions/init_views.py | 1 + airflow/www/templates/airflow/dag.html | 46 +++ airflow/www/templates/airflow/dags.html| 36 +++-- .../www/templates/airflow/plugin.html | 42 +- airflow/www/views.py | 87 ++--- breeze | 17 +--- chart/files/pod-template-file.yaml | 7 +- chart/templates/_helpers.yaml | 8 ++ chart/tests/pod-template-file_test.yaml| 20 - chart/values.yaml | 4 + dev/README.md | 59 ++ docs/img/dags.png | Bin 338418 -> 297947 bytes provider_packages/refactor_provider_packages.py| 26 -- scripts/ci/libraries/_sanity_checks.sh | 8 +- scripts/ci/libraries/_start_end.sh | 27 ++- scripts/ci/libraries/_verbosity.sh | 1 + scripts/ci/mysql/conf.d/airflow.cnf| 1 + scripts/in_container/_in_container_utils.sh| 8 +- scripts/in_container/run_ci_tests.sh | 7 +- .../in_container/run_prepare_provider_packages.sh | 76 -- tests/api_connexion/endpoints/test_dag_endpoint.py | 29 +++ tests/jobs/test_scheduler_job.py | 3 +- tests/plugins/test_plugins_manager.py | 29 +++ .../amazon/aws/transfers/test_mysql_to_s3.py | 6 ++ tests/providers/exasol/hooks/test_exasol.py| 4 +- .../google/cloud/operators/test_mlengine.py| 2 + tests/providers/postgres/hooks/test_postgres.py| 8 ++ .../singularity/operators/test_singularity.py | 3 +- tests/sensors/test_smart_sensor_operator.py| 8 +- tests/test_utils/mock_operators.py | 2 +- tests/www/test_views.py| 86 +++- 42 files changed, 652 insertions(+), 149 deletions(-) copy license-templates/LICENSE.txt => airflow/www/templates/airflow/plugin.html (51%)
[airflow] branch constraints-master updated: Updating constraints. Build id:223253846
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 1c6a36b Updating constraints. Build id:223253846 1c6a36b is described below commit 1c6a36b14c2eeb60cc21188ebddd0ee62377c247 Author: Automated Github Actions commit AuthorDate: Tue Aug 25 07:45:24 2020 + Updating constraints. Build id:223253846 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 133837c4807d0ba8896f35639ef3c0e25ae2d281. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 +++ 1 file changed, 3 insertions(+) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..93f4130 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,6 +212,7 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 +libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -264,6 +265,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 +proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -377,6 +379,7 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 +typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:220621823
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new a296ecf Updating constraints. Build id:220621823 a296ecf is described below commit a296ecf268816b4d5e8b26b7db11497744e3786c Author: Automated Github Actions commit AuthorDate: Sun Aug 23 10:55:48 2020 + Updating constraints. Build id:220621823 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha c8c3f8b8b4c24b5ae4f2fe42299b49b3432c1112. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 +++ 1 file changed, 3 insertions(+) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..93f4130 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,6 +212,7 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 +libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -264,6 +265,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 +proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -377,6 +379,7 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 +typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:224001561
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 2566bcd Updating constraints. Build id:224001561 2566bcd is described below commit 2566bcdf6aff452c12f9a669bf706cfd53d90e25 Author: Automated Github Actions commit AuthorDate: Tue Aug 25 17:36:49 2020 + Updating constraints. Build id:224001561 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha fdd9b6f65b608c516b8a062b058972d9a45ec9e3. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow-site] branch asf-site updated: Update asf-site to output generated at 006e929
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new ac97b6a Update asf-site to output generated at 006e929 ac97b6a is described below commit ac97b6a0267b44134f867cde9045d92ce7a89183 Author: kaxil AuthorDate: Mon Aug 17 21:26:55 2020 + Update asf-site to output generated at 006e929 --- blog/airflow-1.10.10/index.html| 4 +- blog/airflow-1.10.8-1.10.9/index.html | 4 +- blog/airflow-survey/index.html | 4 +- blog/announcing-new-website/index.html | 4 +- blog/apache-airflow-for-newcomers/index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- blog/tags/community/index.html | 6 +- blog/tags/community/index.xml | 4 +- index.html | 26 +++--- search/index.html | 4 +- sitemap.xml| 104 ++--- use-cases/adobe/index.html | 4 +- use-cases/big-fish-games/index.html| 4 +- use-cases/dish/index.html | 4 +- use-cases/experity/index.html | 4 +- use-cases/onefootball/index.html | 4 +- 20 files changed, 102 insertions(+), 102 deletions(-) diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html index 4c09195..15e3483 100644 --- a/blog/airflow-1.10.10/index.html +++ b/blog/airflow-1.10.10/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-1.10.8-1.10.9/index.html b/blog/airflow-1.10.8-1.10.9/index.html index cbdf365..b58851b 100644 --- a/blog/airflow-1.10.8-1.10.9/index.html +++ b/blog/airflow-1.10.8-1.10.9/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html index 6932210..138b35f 100644 --- a/blog/airflow-survey/index.html +++ b/blog/airflow-survey/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/announcing-new-website/index.html b/blog/announcing-new-website/index.html index 76fdce4..89a3cee 100644 --- a/blog/announcing-new-website/index.html +++ b/blog/announcing-new-website/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/apache-airflow-for-newcomers/index.html b/blog/apache-airflow-for-newcomers/index.html index e5b25ca..7c27874 100644 --- a/blog/apache-airflow-for-newcomers/index.html +++ b/blog/apache-airflow-for-newcomers/index.html @@ -37,14 +37,14 @@ Authoring Workflow in Apache Airflow. Airflow makes it easy to author workflows - + - + diff --git a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html index a339cc2..5a62a6e 100644 --- a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html +++ b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/documenting-using-local-development-environments/index.html b/blog/documenting-using-local-development-environments/index.html index 461..0cc344e 100644 --- a/blog/documenting-using-local-development-environments/index.html +++ b/blog/documenting-using-local-development-environments/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html index c4ef25a..bb8e744 100644 --- a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html +++ b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html @@ -37,14 +37,14 @@ About Me I have been writing tech articles on medium as well as my blog for the - + - + diff --git a/blog/implementing-stable-api-for-apache-airflow/index.html b/blog/implementing-stable-api-for-apache-airflow/index.html index 0b27ade..c95da00 100644 --- a/blog/implementing-stable-api-for-apache-airflow/index.html +++ b/blog/implementing-stable-api-for-apache-airflow/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/its-a-breeze-to-develop-apache-airflow/index.html b/blog/its-a-breeze-to-develop-apache-airflow/index.html index 6acf977..0b0f420 100644 --- a/blog/its
[airflow-site] branch asf-site updated: Update asf-site to output generated at 9db07f5
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 8df37fd Update asf-site to output generated at 9db07f5
8df37fd is described below
commit 8df37fd63b29d26956c0be04cab099b7dc6f5644
Author: potiuk
AuthorDate: Mon Aug 17 19:07:48 2020 +
Update asf-site to output generated at 9db07f5
---
_gen/indexes/en/blog-index.json| 2 +-
_gen/indexes/en/blog-posts.json| 2 +-
blog/Simple_dag.png| Bin 0 -> 66340 bytes
blog/airflow-1.10.10/index.html| 4 +-
blog/airflow-1.10.8-1.10.9/index.html | 4 +-
blog/airflow-survey/index.html | 4 +-
blog/airflow-ui.png| Bin 0 -> 179332 bytes
blog/announcing-new-website/index.html | 35 ++-
.../index.html | 277 ++---
.../index.html | 35 ++-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 48 +++-
blog/index.html| 31 +++
blog/index.xml | 166
.../index.html | 4 +-
blog/semicomplex.png | Bin 0 -> 109173 bytes
blog/tags/community/index.html | 39 ++-
blog/tags/community/index.xml | 172 -
index.html | 26 +-
index.xml | 166
search/index.html | 4 +-
sitemap.xml| 123 -
tags/index.html| 2 +-
tags/index.xml | 2 +-
use-cases/adobe/index.html | 4 +-
use-cases/big-fish-games/index.html| 4 +-
use-cases/dish/index.html | 4 +-
use-cases/experity/index.html | 4 +-
use-cases/onefootball/index.html | 4 +-
30 files changed, 973 insertions(+), 201 deletions(-)
diff --git a/_gen/indexes/en/blog-index.json b/_gen/indexes/en/blog-index.json
index 3bed3c5..1e0fc67 100644
--- a/_gen/indexes/en/blog-index.json
+++ b/_gen/indexes/en/blog-index.json
@@ -1 +1 @@
-{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,1.906,1,0.855,2,0.163,3,0.38,4,0.479]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.177,4,0.342,5,1.358,6,0.609,7,1.358,8,0.78,9,0.609,10,0.609,11,0.609,12,0.472,13,1.358,14,0.472,15,1.358,16,0.1]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,0.855,17,1.095]],["content/It's a
\"Breeze\" to develop Apach [...]
\ No newline at end of file
+{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,2.089,1,0.91,2,0.031,3,0.297,4,0.414]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.032,4,0.277,5,1.402,6,0.733,7,1.402,8,0.886,9,0.733,10,0.733,11,0.733,12,0.611,13,1.402,14,0.611,15,1.402,16,0.217]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,1.113,17,1.345]],["content/It's a
\"Breeze\" to develop Ap [...]
\ No newline at end of file
diff --git a/_gen/indexes/en/blog-posts.json b/_gen/indexes/en/blog-posts.json
index 41d118a..6901ad5 100644
--- a/_gen/indexes/en/blog-posts.json
+++ b/_gen/indexes/en/blog-posts.json
@@ -1 +1 @@
-[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of productivity were. Even with the help of our client, who provided
us with a “homegrown” development environment it took us literally days to set
it up and learn some basics. [...]
\ No newline at end of file
+[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this
[airflow-site] branch asf-site updated: Update asf-site to output generated at e7e5638
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 87a0b1b Update asf-site to output generated at e7e5638 87a0b1b is described below commit 87a0b1b54605b227450d00ef769f037f184e44e0 Author: mik-laj AuthorDate: Mon Aug 17 23:13:29 2020 + Update asf-site to output generated at e7e5638 --- blog/airflow-1.10.10/index.html| 4 +- blog/airflow-1.10.8-1.10.9/index.html | 4 +- blog/airflow-survey/index.html | 4 +- blog/announcing-new-website/index.html | 4 +- blog/apache-airflow-for-newcomers/index.html | 15 +-- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- blog/index.xml | 9 +- .../index.html | 4 +- blog/tags/community/index.xml | 9 +- index.html | 32 +++ index.xml | 9 +- search/index.html | 4 +- sitemap.xml| 104 ++--- use-cases/adobe/index.html | 4 +- use-cases/big-fish-games/index.html| 4 +- use-cases/dish/index.html | 4 +- use-cases/experity/index.html | 4 +- use-cases/onefootball/index.html | 4 +- 21 files changed, 105 insertions(+), 133 deletions(-) diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html index 15e3483..e559342 100644 --- a/blog/airflow-1.10.10/index.html +++ b/blog/airflow-1.10.10/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-1.10.8-1.10.9/index.html b/blog/airflow-1.10.8-1.10.9/index.html index b58851b..6a57a43 100644 --- a/blog/airflow-1.10.8-1.10.9/index.html +++ b/blog/airflow-1.10.8-1.10.9/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html index 138b35f..6477b71 100644 --- a/blog/airflow-survey/index.html +++ b/blog/airflow-survey/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/announcing-new-website/index.html b/blog/announcing-new-website/index.html index 89a3cee..5cdcde8 100644 --- a/blog/announcing-new-website/index.html +++ b/blog/announcing-new-website/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/apache-airflow-for-newcomers/index.html b/blog/apache-airflow-for-newcomers/index.html index 7c27874..c2448ec 100644 --- a/blog/apache-airflow-for-newcomers/index.html +++ b/blog/apache-airflow-for-newcomers/index.html @@ -37,15 +37,15 @@ Authoring Workflow in Apache Airflow. Airflow makes it easy to author workflows - + - - + + @@ -505,7 +505,7 @@ The metadata database is where the status of all tasks are recorded. The status necessary for the task to be executed. It should be noted that the scheduler wont trigger your tasks until the period it covers has ended. If a tasks schedule_interval is @daily, the scheduler triggers the task at the end of the day and not at the beginning. This is to ensure that the necessary data needed for the tasks -are ready. It is also possible trigger tasks manually on the UI. +are ready. It is also possible to trigger tasks manually on the UI. In the https://github.com/apache/airflow/blob/master/BREEZE.rst; target="_blank">Breeze environment, the scheduler is started by running the command airflow scheduler. It uses the configured production environment. The configuration can be specified in airflow.cfg @@ -583,13 +583,6 @@ Just like Operators, there are many predefined sensors in Airflow. These include A list of most of the available sensors can be found in this https://airflow.apache.org/docs/stable/_api/airflow/contrib/sensors/index.html?highlight=sensors#module-airflow.contrib.sensors; target="_blank">module -Breeze Environment - -The breeze environment is the development environment for Airflow where you can run tests, build images, -build documentations and so many other things. There are excellent -https://github.com/apache/airflow/blob/master/BREEZE.rst; target="_blank">documentation and video on Breeze environment. -Please check them out. - Contributing to Airflow Airflow is an open source project, everyone is welcome to contribute. It is easy to get started thanks diff --git a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committer
[airflow-site] branch asf-site updated: Update asf-site to output generated at 8b3b80c
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 887570e Update asf-site to output generated at 8b3b80c
887570e is described below
commit 887570e11461fd3002525106b7ff24cfdefde846
Author: potiuk
AuthorDate: Mon Aug 17 20:16:26 2020 +
Update asf-site to output generated at 8b3b80c
---
_gen/indexes/en/blog-index.json| 2 +-
_gen/indexes/en/blog-posts.json| 2 +-
blog/airflow-1.10.10/index.html| 4 +-
blog/airflow-1.10.8-1.10.9/index.html | 4 +-
blog/airflow-survey/index.html | 4 +-
blog/announcing-new-website/index.html | 6 +-
.../Simple_dag.png | Bin
.../airflow-ui.png | Bin
.../index.html | 8 +-
.../semicomplex.png| Bin
.../index.html | 6 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 8 +-
blog/index.html| 2 +-
blog/index.xml | 4 +-
.../index.html | 4 +-
blog/tags/community/index.html | 2 +-
blog/tags/community/index.xml | 4 +-
index.html | 26 ++---
index.xml | 4 +-
search/index.html | 4 +-
sitemap.xml| 106 ++---
use-cases/adobe/index.html | 4 +-
use-cases/big-fish-games/index.html| 4 +-
use-cases/dish/index.html | 4 +-
use-cases/experity/index.html | 4 +-
use-cases/onefootball/index.html | 4 +-
28 files changed, 114 insertions(+), 114 deletions(-)
diff --git a/_gen/indexes/en/blog-index.json b/_gen/indexes/en/blog-index.json
index 1e0fc67..1d49821 100644
--- a/_gen/indexes/en/blog-index.json
+++ b/_gen/indexes/en/blog-index.json
@@ -1 +1 @@
-{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,2.089,1,0.91,2,0.031,3,0.297,4,0.414]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.032,4,0.277,5,1.402,6,0.733,7,1.402,8,0.886,9,0.733,10,0.733,11,0.733,12,0.611,13,1.402,14,0.611,15,1.402,16,0.217]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,1.113,17,1.345]],["content/It's a
\"Breeze\" to develop Ap [...]
\ No newline at end of file
+{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,1.962,1,0.736,2,0.15,3,0.389,4,0.474]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.158,4,0.323,5,1.337,6,0.631,7,1.337,8,0.792,9,0.631,10,0.631,11,0.631,12,0.502,13,1.337,14,0.502,15,1.337,16,0.086]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,0.942,17,1.184]],["content/It's a
\"Breeze\" to develop Ap [...]
\ No newline at end of file
diff --git a/_gen/indexes/en/blog-posts.json b/_gen/indexes/en/blog-posts.json
index 6901ad5..5b9ded8 100644
--- a/_gen/indexes/en/blog-posts.json
+++ b/_gen/indexes/en/blog-posts.json
@@ -1 +1 @@
-[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of productivity were. Even with the help of our client, who provided
us with a “homegrown” development environment it took us literally days to set
it up and learn some basics. [...]
\ No newline at end of file
+[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of pro
[airflow] branch constraints-master updated: Updating constraints. GH run id:213752257
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new be37aa6 Updating constraints. GH run id:213752257 be37aa6 is described below commit be37aa60c6615fadf1ecd0a5ec86dc466d6ecec7 Author: Automated Github Actions commit AuthorDate: Tue Aug 18 15:06:37 2020 + Updating constraints. GH run id:213752257 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 083c3c129bc3458d410f5ff37d7f5a9a7ad548b7. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 40 ++-- constraints-3.7.txt | 39 ++- 2 files changed, 36 insertions(+), 43 deletions(-) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 9ace42c..180b795 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -28,8 +28,8 @@ PyYAML==5.3.1 Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 SQLAlchemy-Utils==0.36.8 -SQLAlchemy==1.3.18 -Sphinx==3.2.0 +SQLAlchemy==1.3.19 +Sphinx==3.2.1 Unidecode==1.1.1 WTForms==2.3.3 Werkzeug==0.16.1 @@ -67,14 +67,14 @@ azure-storage-blob==2.1.0 azure-storage-common==2.1.0 azure-storage==0.36.0 backcall==0.2.0 -bcrypt==3.1.7 +bcrypt==3.2.0 beautifulsoup4==4.7.1 billiard==3.6.3.0 black==19.10b0 blinker==1.4 -boto3==1.14.41 +boto3==1.14.44 boto==2.49.0 -botocore==1.17.41 +botocore==1.17.44 bowler==0.8.0 cached-property==1.5.1 cachetools==4.1.1 @@ -82,14 +82,14 @@ cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.1 +cffi==1.14.2 cfgv==3.2.0 -cfn-lint==0.34.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 clickclick==1.2.2 -cloudant==2.13.0 +cloudant==2.14.0 cloudpickle==1.4.1 colorama==0.4.3 colorlog==4.0.2 @@ -100,8 +100,7 @@ croniter==0.3.34 cryptography==3.0 curlify==2.2.1 cx-Oracle==8.0.0 -dask==2.22.0 -dataclasses==0.7 +dask==2.23.0 datadog==0.38.0 decorator==4.4.2 defusedxml==0.6.0 @@ -122,9 +121,9 @@ entrypoints==0.3 eventlet==0.26.1 execnet==1.7.1 facebook-business==8.0.0 -fastavro==0.24.0 +fastavro==0.24.1 filelock==3.0.12 -fissix==20.5.1 +fissix==20.8.0 flake8-colors==0.1.6 flake8==3.8.3 flaky==3.7.0 @@ -183,7 +182,7 @@ hmsclient==0.1.1 httplib2==0.18.1 humanize==2.6.0 hvac==0.10.5 -identify==1.4.25 +identify==1.4.28 idna-ssl==1.1.0 idna==2.10 imagesize==1.2.0 @@ -217,7 +216,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -253,7 +251,7 @@ oscrypto==1.2.1 packaging==20.4 pandas-gbq==0.13.2 pandas==1.1.0 -papermill==2.1.2 +papermill==2.1.3 parameterized==0.7.4 paramiko==2.7.1 parso==0.7.1 @@ -271,8 +269,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 -protobuf==3.12.4 +protobuf==3.13.0 psutil==5.7.2 psycopg2-binary==2.8.5 ptyprocess==0.6.0 @@ -301,12 +298,12 @@ pypd==1.1.0 pyrsistent==0.16.0 pysftp==0.2.9 pyspark==3.0.0 -pytest-cov==2.10.0 +pytest-cov==2.10.1 pytest-forked==1.3.0 pytest-instafail==0.4.2 pytest-rerunfailures==9.0 pytest-timeouts==1.2.1 -pytest-xdist==1.34.0 +pytest-xdist==2.0.0 pytest==6.0.1 python-daemon==2.2.4 python-dateutil==2.8.1 @@ -337,7 +334,7 @@ sasl==0.2.1 semver==2.10.2 sendgrid==6.4.5 sentinels==1.0.0 -sentry-sdk==0.16.4 +sentry-sdk==0.16.5 setproctitle==1.1.10 sh==1.13.1 simple-salesforce==1.10.1 @@ -386,7 +383,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 typing==3.7.4.3 tzlocal==1.5.1 unicodecsv==0.14.1 @@ -394,7 +390,7 @@ uritemplate==3.0.1 urllib3==1.25.10 vertica-python==0.11.0 vine==1.3.0 -virtualenv==20.0.30 +virtualenv==20.0.31 watchtower==0.7.3 wcwidth==0.2.5 websocket-client==0.57.0 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index d922c1e..3171bb0 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -28,8 +28,8 @@ PyYAML==5.3.1 Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 SQLAlchemy-Utils==0.36.8 -SQLAlchemy==1.3.18 -Sphinx==3.2.0 +SQLAlchemy==1.3.19 +Sphinx==3.2.1 Unidecode==1.1.1 WTForms==2.3.3 Werkzeug==0.16.1 @@ -67,14 +67,14 @@ azure-storage-blob==2.1.0 azure-storage-common==2.1.0 azure-storage==0.36.0 backcall==0.2.0 -bcrypt==3.1.7 +bcrypt==3.2.0 beautifulsoup4==4.7.1 billiard==3.6.3.0 black==19.10b0 blinker==1.4 -boto3==1.14.41 +boto3==1.14.44 boto==2.49.0 -botocore==1.17.41 +botocore==1.17.44 bowler==0.8.0 cached-property==1.5.1 cachetools==4.1.1 @@ -82,14 +82,14
[airflow] branch constraints-1-10 updated: Updating constraints. GH run id:213841848
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-1-10 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-1-10 by this push: new 66db1ca Updating constraints. GH run id:213841848 66db1ca is described below commit 66db1ca484803618d45c7cd1d068e241512371fa Author: Automated Github Actions commit AuthorDate: Tue Aug 18 17:37:29 2020 + Updating constraints. GH run id:213841848 This update in constraints is automatically committed by CI pushing reference 'refs/heads/v1-10-test' to apache/airflow with commit sha c44fddfafb5b9c58b40c8c4987102a049c26f1b9. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-2.7.txt | 24 constraints-3.5.txt | 30 +++--- constraints-3.6.txt | 38 +- constraints-3.7.txt | 35 --- constraints-3.8.txt | 37 + 5 files changed, 77 insertions(+), 87 deletions(-) diff --git a/constraints-2.7.txt b/constraints-2.7.txt index c2c30b5..fb14c41 100644 --- a/constraints-2.7.txt +++ b/constraints-2.7.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==1.10.11) +# Editable install with no version control (apache-airflow==1.10.12) Babel==2.8.0 Flask-Admin==1.5.4 Flask-AppBuilder==1.13.1 @@ -24,7 +24,7 @@ PySmbClient==0.1.5 PyYAML==5.3.1 Pygments==2.5.2 SQLAlchemy-JSONField==0.8.0 -SQLAlchemy==1.3.18 +SQLAlchemy==1.3.19 Sphinx==1.8.5 Unidecode==1.1.1 WTForms==2.3.3 @@ -69,18 +69,18 @@ beautifulsoup4==4.7.1 billiard==3.6.3.0 bleach==3.1.5 blinker==1.4 -boto3==1.14.42 +boto3==1.14.44 boto==2.49.0 -botocore==1.17.42 +botocore==1.17.44 cached-property==1.5.1 cachetools==3.1.1 cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.1 +cffi==1.14.2 cfgv==2.0.1 -cfn-lint==0.34.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 @@ -113,7 +113,7 @@ email-validator==1.1.1 entrypoints==0.3 enum34==1.1.10 execnet==1.7.1 -fastavro==0.24.0 +fastavro==0.24.1 filelock==3.0.12 flake8-colors==0.1.6 flake8==3.8.3 @@ -158,7 +158,7 @@ hmsclient==0.1.1 httplib2==0.18.1 humanize==1.0.0 hvac==0.10.5 -identify==1.4.25 +identify==1.4.28 idna==2.10 ijson==2.6.1 imagesize==1.2.0 @@ -233,7 +233,7 @@ presto-python-client==0.7.0 prison==0.1.0 prometheus-client==0.8.0 prompt-toolkit==1.0.18 -protobuf==3.12.4 +protobuf==3.13.0 psutil==5.7.2 psycopg2-binary==2.8.5 ptyprocess==0.6.0 @@ -254,7 +254,7 @@ pymssql==2.1.4 pyparsing==2.4.7 pyrsistent==0.16.0 pysftp==0.2.9 -pytest-cov==2.10.0 +pytest-cov==2.10.1 pytest-forked==1.3.0 pytest-instafail==0.4.2 pytest-rerunfailures==9.0 @@ -290,7 +290,7 @@ sasl==0.2.1 scandir==1.10.0 sendgrid==5.6.0 sentinels==1.0.0 -sentry-sdk==0.16.4 +sentry-sdk==0.16.5 setproctitle==1.1.10 simplegeneric==0.8.1 singledispatch==3.4.0.3 @@ -333,7 +333,7 @@ uritemplate==3.0.1 urllib3==1.25.10 vertica-python==0.11.0 vine==1.3.0 -virtualenv==20.0.30 +virtualenv==20.0.31 wcwidth==0.2.5 webencodings==0.5.1 websocket-client==0.57.0 diff --git a/constraints-3.5.txt b/constraints-3.5.txt index cf4a439..9182311 100644 --- a/constraints-3.5.txt +++ b/constraints-3.5.txt @@ -1,4 +1,4 @@ -# Editable install with no version control (apache-airflow==1.10.11) +# Editable install with no version control (apache-airflow==1.10.12) Babel==2.8.0 Flask-Admin==1.5.4 Flask-AppBuilder==1.13.1 @@ -24,8 +24,8 @@ PySmbClient==0.1.5 PyYAML==5.3.1 Pygments==2.6.1 SQLAlchemy-JSONField==0.9.0 -SQLAlchemy==1.3.18 -Sphinx==3.2.0 +SQLAlchemy==1.3.19 +Sphinx==3.2.1 Unidecode==1.1.1 WTForms==2.3.3 Werkzeug==0.16.1 @@ -60,18 +60,18 @@ bcrypt==3.1.7 beautifulsoup4==4.7.1 billiard==3.6.3.0 blinker==1.4 -boto3==1.14.42 +boto3==1.14.44 boto==2.49.0 -botocore==1.17.42 +botocore==1.17.44 cached-property==1.5.1 cachetools==4.1.1 cassandra-driver==3.20.2 cattrs==1.0.0 celery==4.4.7 certifi==2020.6.20 -cffi==1.14.1 +cffi==1.14.2 cfgv==2.0.1 -cfn-lint==0.34.1 +cfn-lint==0.35.0 cgroupspy==0.1.6 chardet==3.0.4 click==6.7 @@ -93,13 +93,13 @@ docker-pycreds==0.4.0 docker==3.7.3 docopt==0.6.2 docutils==0.16 -ecdsa==0.15 +ecdsa==0.14.1 elasticsearch-dsl==5.4.0 elasticsearch==5.5.3 email-validator==1.1.1 entrypoints==0.3 execnet==1.7.1 -fastavro==0.24.0 +fastavro==0.24.1 filelock==3.0.12 flake8-colors==0.1.6 flake8==3.8.3 @@ -144,7 +144,7 @@ hmsclient==0.1.1 httplib2==0.18.1 humanize==2.6.0 hvac==0.10.5 -identify==1.4.25 +identify==1.4.28 idna==2.10 imagesize==1.2.0 importlib-metadata==1.7.0 @@ -217,7 +217,7 @@ presto-python-client==0.7.0 prison==0.1.0 prometheus-client==0.8.0 prompt-toolkit==2.0.10 -protobuf
[airflow-site] branch asf-site updated: Update asf-site to output generated at bead826
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 134ef1b Update asf-site to output generated at bead826
134ef1b is described below
commit 134ef1b71feddbf8a69728db2d59872c96ecf0b8
Author: kaxil
AuthorDate: Wed Aug 26 18:02:58 2020 +
Update asf-site to output generated at bead826
---
_gen/indexes/en/blog-index.json| 2 +-
_gen/indexes/en/blog-posts.json| 2 +-
blog/airflow-1.10.10/index.html| 35 +++-
.../index.html | 219 -
blog/airflow-1.10.8-1.10.9/index.html | 35 +++-
blog/airflow-survey/index.html | 4 +-
blog/announcing-new-website/index.html | 4 +-
blog/apache-airflow-for-newcomers/index.html | 8 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
.../index.html | 4 +-
blog/index.html| 31 +++
blog/index.xml | 170
.../index.html | 4 +-
blog/tags/release/index.html | 33 +++-
blog/tags/release/index.xml| 172 +++-
index.html | 30 +--
index.xml | 170
search/index.html | 4 +-
sitemap.xml| 123 ++--
tags/index.html| 2 +-
tags/index.xml | 2 +-
use-cases/adobe/index.html | 4 +-
use-cases/big-fish-games/index.html| 4 +-
use-cases/dish/index.html | 4 +-
use-cases/experity/index.html | 4 +-
use-cases/onefootball/index.html | 4 +-
28 files changed, 922 insertions(+), 164 deletions(-)
diff --git a/_gen/indexes/en/blog-index.json b/_gen/indexes/en/blog-index.json
index 1d49821..e2ee9a9 100644
--- a/_gen/indexes/en/blog-index.json
+++ b/_gen/indexes/en/blog-index.json
@@ -1 +1 @@
-{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,1.962,1,0.736,2,0.15,3,0.389,4,0.474]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.158,4,0.323,5,1.337,6,0.631,7,1.337,8,0.792,9,0.631,10,0.631,11,0.631,12,0.502,13,1.337,14,0.502,15,1.337,16,0.086]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,0.942,17,1.184]],["content/It's a
\"Breeze\" to develop Ap [...]
\ No newline at end of file
+{"version":"2.3.8","fields":["title","description","author","content","tags","url"],"fieldVectors":[["title/It's
a \"Breeze\" to develop Apache
Airflow",[0,2.014,1,0.802,2,0.092,3,0.384,4,0.474]],["description/It's a
\"Breeze\" to develop Apache
Airflow",[2,0.097,4,0.323,5,1.373,6,0.675,7,1.373,8,0.834,9,0.675,10,0.675,11,0.675,12,0.547,13,1.373,14,0.547,15,1.373,16,0.136]],["author/It's
a \"Breeze\" to develop Apache Airflow",[11,1.023,17,1.265]],["content/It's a
\"Breeze\" to develop A [...]
\ No newline at end of file
diff --git a/_gen/indexes/en/blog-posts.json b/_gen/indexes/en/blog-posts.json
index 5b9ded8..cedabb1 100644
--- a/_gen/indexes/en/blog-posts.json
+++ b/_gen/indexes/en/blog-posts.json
@@ -1 +1 @@
-[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where the biggest bottlenecks and areas for improvement
in terms of productivity were. Even with the help of our client, who provided
us with a “homegrown” development environment it took us literally days to set
it up and learn some basics. [...]
\ No newline at end of file
+[{"content":"## The story behind the Airflow Breeze tool\nInitially, we
started contributing to this fantastic open-source project [Apache Airflow]
with a team of three which then grew to five. When we kicked it off a year ago,
I realized pretty soon where t
[airflow-site] branch asf-site updated: Update asf-site to output generated at a624457
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new e7705b5 Update asf-site to output generated at a624457 e7705b5 is described below commit e7705b53f2f9421fec593a501d23fbe85abf4b3d Author: kaxil AuthorDate: Wed Aug 26 18:13:18 2020 + Update asf-site to output generated at a624457 --- blog/airflow-1.10.10/index.html| 4 +- blog/airflow-1.10.12/index.html| 10 +- blog/airflow-1.10.8-1.10.9/index.html | 4 +- blog/airflow-survey/index.html | 4 +- blog/announcing-new-website/index.html | 4 +- blog/apache-airflow-for-newcomers/index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- blog/index.xml | 6 +- .../index.html | 4 +- blog/tags/community/index.html | 6 +- blog/tags/community/index.xml | 4 +- blog/tags/release/index.xml| 6 +- index.html | 28 +++--- index.xml | 6 +- search/index.html | 4 +- sitemap.xml| 108 ++--- use-cases/adobe/index.html | 4 +- use-cases/big-fish-games/index.html| 4 +- use-cases/dish/index.html | 4 +- use-cases/experity/index.html | 4 +- use-cases/onefootball/index.html | 4 +- 24 files changed, 119 insertions(+), 119 deletions(-) diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html index 38ec1e9..ccb39fc 100644 --- a/blog/airflow-1.10.10/index.html +++ b/blog/airflow-1.10.10/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-1.10.12/index.html b/blog/airflow-1.10.12/index.html index 559dda4..a3a228a 100644 --- a/blog/airflow-1.10.12/index.html +++ b/blog/airflow-1.10.12/index.html @@ -36,13 +36,13 @@ - + - + @@ -620,7 +620,7 @@ Airflow 1.10.* would be the last series to support Python 2. Use Airflow RBAC UI -Airflow 1.10.10 ships with 2 UIs, the default is non-RBAC Flask-admin based UI and Flask-appbuilder based UI. +Airflow 1.10.12 ships with 2 UIs, the default is non-RBAC Flask-admin based UI and Flask-appbuilder based UI. The Flask-AppBuilder (FAB) based UI allows Role-based Access Control and has more advanced features compared to the legacy Flask-admin based UI. This UI can be enabled by setting rbac=True in [webserver] section in @@ -634,11 +634,11 @@ for 1.10.* series but would no longer be available from Airflow 2.0 The Airflow Project has moved from https://issues.apache.org/jira/projects/AIRFLOW/issues; target="_blank">JIRA to https://github.com/apache/airflow/issues; target="_blank">Github for tracking issues. -So if you find any bugs in Airflow 1.10.10 please create a Github Issue for it. +So if you find any bugs in Airflow 1.10.12 please create a Github Issue for it. List of Contributors -According to git shortlog, the following people contributed to the 1.10.10 release. Thank you to all contributors! +According to git shortlog, the following people contributed to the 1.10.12 release. Thank you to all contributors! Alexander Sutcliffe, Andy, Aneesh Joseph, Ash Berlin-Taylor, Aviral Agrawal, BaoshanGu, Beni Ben zikry, Daniel Imberman, Daniel Standish, Danylo Baibak, Ephraim Anierobi, Felix Uellendall, Greg Neiheisel, diff --git a/blog/airflow-1.10.8-1.10.9/index.html b/blog/airflow-1.10.8-1.10.9/index.html index bbe84ff..a9972e3 100644 --- a/blog/airflow-1.10.8-1.10.9/index.html +++ b/blog/airflow-1.10.8-1.10.9/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html index adc4761..886ce3a 100644 --- a/blog/airflow-survey/index.html +++ b/blog/airflow-survey/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/announcing-new-website/index.html b/blog/announcing-new-website/index.html index d760ded..df61005 100644 --- a/blog/announcing-new-website/index.html +++ b/blog/announcing-new-website/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/apache-airflow-for-newcomers/index.html b/blog/apache-airflow-for-newcomers/index.html index 5edf8b5..baeea83 100644 --- a/blog/apache-airflow-for-newcomers/index.html +++ b/blog/ap
[airflow] branch constraints-master updated: Updating constraints. Build id:229205028
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new cc159ee Updating constraints. Build id:229205028 cc159ee is described below commit cc159ee8cfc5c8873c2efdc667066dc175916700 Author: Automated Github Actions commit AuthorDate: Fri Aug 28 20:40:36 2020 + Updating constraints. Build id:229205028 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha e495be9fd93d0f700f953fe5749260850ecd9b11. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 1 + constraints-3.7.txt | 1 + constraints-3.8.txt | 1 + 3 files changed, 3 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 180b795..2cddbd0 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -372,6 +372,7 @@ tableauserverclient==0.12 tabulate==0.8.7 tblib==1.7.0 tenacity==5.1.5 +termcolor==1.1.0 text-unidecode==1.3 textwrap3==0.9.2 thrift-sasl==0.4.2 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 3171bb0..95013b0 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -367,6 +367,7 @@ tableauserverclient==0.12 tabulate==0.8.7 tblib==1.7.0 tenacity==5.1.5 +termcolor==1.1.0 text-unidecode==1.3 textwrap3==0.9.2 thrift-sasl==0.4.2 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..1c5e43f 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -366,6 +366,7 @@ tableauserverclient==0.12 tabulate==0.8.7 tblib==1.7.0 tenacity==5.1.5 +termcolor==1.1.0 text-unidecode==1.3 textwrap3==0.9.2 thrift-sasl==0.4.2
[airflow] branch constraints-master updated: Updating constraints. Build id:229205028
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new cc159ee Updating constraints. Build id:229205028 cc159ee is described below commit cc159ee8cfc5c8873c2efdc667066dc175916700 Author: Automated Github Actions commit AuthorDate: Fri Aug 28 20:40:36 2020 + Updating constraints. Build id:229205028 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha e495be9fd93d0f700f953fe5749260850ecd9b11. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.6.txt | 1 + constraints-3.7.txt | 1 + constraints-3.8.txt | 1 + 3 files changed, 3 insertions(+) diff --git a/constraints-3.6.txt b/constraints-3.6.txt index 180b795..2cddbd0 100644 --- a/constraints-3.6.txt +++ b/constraints-3.6.txt @@ -372,6 +372,7 @@ tableauserverclient==0.12 tabulate==0.8.7 tblib==1.7.0 tenacity==5.1.5 +termcolor==1.1.0 text-unidecode==1.3 textwrap3==0.9.2 thrift-sasl==0.4.2 diff --git a/constraints-3.7.txt b/constraints-3.7.txt index 3171bb0..95013b0 100644 --- a/constraints-3.7.txt +++ b/constraints-3.7.txt @@ -367,6 +367,7 @@ tableauserverclient==0.12 tabulate==0.8.7 tblib==1.7.0 tenacity==5.1.5 +termcolor==1.1.0 text-unidecode==1.3 textwrap3==0.9.2 thrift-sasl==0.4.2 diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..1c5e43f 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -366,6 +366,7 @@ tableauserverclient==0.12 tabulate==0.8.7 tblib==1.7.0 tenacity==5.1.5 +termcolor==1.1.0 text-unidecode==1.3 textwrap3==0.9.2 thrift-sasl==0.4.2
[airflow] tag nightly-master updated (725bf33 -> e495be9)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 725bf33 (commit) to e495be9 (commit) from 725bf33 Revert Clean up DAG serializations based on last_updated (#7424) (#10613) add 3867f76 Update Google Cloud branding (#10615) add 5ae82a5 Fix Google DLP example and improve ops idempotency (#10608) add 5f403a8 Wrong key in DAGs Persistent Volume Claim (#10627) add 8969b71 Removed bad characters from AWS operator (#10590) add 1b533f6 Fix broken master - DLP (#10635) add 8e0d9f0 Add airflow cheat-sheet command (#10619) add 7200835 Improve output of check_environment.sh (#10631) add e495be9 Update scheduler deployment - dags volume mount (#10630) No new revisions were added by this update. Summary of changes: airflow/cli/cli_parser.py | 50 ++ airflow/cli/commands/cheat_sheet_command.py| 67 + airflow/config_templates/config.yml| 4 +- airflow/config_templates/default_airflow.cfg | 4 +- airflow/providers/amazon/aws/operators/athena.py | 2 +- airflow/providers/google/ads/hooks/ads.py | 2 +- .../_internal_client/secret_manager_client.py | 10 +- .../google/cloud/example_dags/example_dlp.py | 66 ++--- airflow/providers/google/cloud/hooks/bigquery.py | 8 +- .../providers/google/cloud/hooks/bigquery_dts.py | 12 ++- airflow/providers/google/cloud/hooks/bigtable.py | 10 +- .../providers/google/cloud/hooks/cloud_build.py| 2 +- .../google/cloud/hooks/cloud_memorystore.py| 22 ++--- airflow/providers/google/cloud/hooks/cloud_sql.py | 78 +++ .../cloud/hooks/cloud_storage_transfer_service.py | 14 +-- airflow/providers/google/cloud/hooks/compute.py| 14 +-- .../providers/google/cloud/hooks/datacatalog.py| 80 airflow/providers/google/cloud/hooks/dataflow.py | 20 ++-- airflow/providers/google/cloud/hooks/dlp.py| 32 +++ airflow/providers/google/cloud/hooks/functions.py | 6 +- airflow/providers/google/cloud/hooks/gcs.py| 2 +- .../providers/google/cloud/hooks/life_sciences.py | 4 +- airflow/providers/google/cloud/hooks/mlengine.py | 34 +++ airflow/providers/google/cloud/hooks/pubsub.py | 33 +++ airflow/providers/google/cloud/hooks/spanner.py| 58 ++- .../providers/google/cloud/hooks/stackdriver.py| 4 +- airflow/providers/google/cloud/hooks/tasks.py | 58 +-- .../providers/google/cloud/log/gcs_task_handler.py | 5 +- .../google/cloud/log/stackdriver_task_handler.py | 2 +- .../google/cloud/operators/bigquery_dts.py | 7 +- .../providers/google/cloud/operators/bigtable.py | 22 ++--- .../google/cloud/operators/cloud_memorystore.py| 26 ++--- .../providers/google/cloud/operators/cloud_sql.py | 16 ++-- .../operators/cloud_storage_transfer_service.py| 7 +- .../providers/google/cloud/operators/compute.py| 20 ++-- .../google/cloud/operators/datacatalog.py | 76 +++ .../providers/google/cloud/operators/dataflow.py | 12 +-- airflow/providers/google/cloud/operators/dlp.py| 40 .../providers/google/cloud/operators/functions.py | 2 +- airflow/providers/google/cloud/operators/gcs.py| 2 +- .../google/cloud/operators/kubernetes_engine.py| 2 +- .../providers/google/cloud/operators/mlengine.py | 35 --- airflow/providers/google/cloud/operators/pubsub.py | 40 .../providers/google/cloud/operators/spanner.py| 14 +-- .../google/cloud/operators/speech_to_text.py | 4 +- airflow/providers/google/cloud/operators/tasks.py | 54 +-- .../google/cloud/operators/text_to_speech.py | 4 +- .../google/cloud/operators/translate_speech.py | 4 +- airflow/providers/google/cloud/operators/vision.py | 24 ++--- .../google/cloud/secrets/secret_manager.py | 10 +- .../providers/google/cloud/sensors/bigquery_dts.py | 2 +- airflow/providers/google/cloud/sensors/bigtable.py | 2 +- .../sensors/cloud_storage_transfer_service.py | 2 +- airflow/providers/google/cloud/sensors/pubsub.py | 2 +- .../google/cloud/transfers/bigquery_to_mysql.py| 2 +- .../google/cloud/utils/credentials_provider.py | 26 ++--- .../google/cloud/utils/field_sanitizer.py | 8 +- .../google/cloud/utils/field_validator.py | 4 +- .../providers/google/common/hooks/base_google.py | 8 +- .../firebase/example_dags/example_firestore.py | 4 +- .../providers/google/firebase/hooks/firestore.py | 2 +- airflow/providers/google/suite/hooks/sheets.py | 2 +- .../hashicorp/_internal_client/vault_client.py | 4 +- airflow/providers/hashicorp
[airflow] tag nightly-master updated (725bf33 -> e495be9)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 725bf33 (commit) to e495be9 (commit) from 725bf33 Revert Clean up DAG serializations based on last_updated (#7424) (#10613) add 3867f76 Update Google Cloud branding (#10615) add 5ae82a5 Fix Google DLP example and improve ops idempotency (#10608) add 5f403a8 Wrong key in DAGs Persistent Volume Claim (#10627) add 8969b71 Removed bad characters from AWS operator (#10590) add 1b533f6 Fix broken master - DLP (#10635) add 8e0d9f0 Add airflow cheat-sheet command (#10619) add 7200835 Improve output of check_environment.sh (#10631) add e495be9 Update scheduler deployment - dags volume mount (#10630) No new revisions were added by this update. Summary of changes: airflow/cli/cli_parser.py | 50 ++ airflow/cli/commands/cheat_sheet_command.py| 67 + airflow/config_templates/config.yml| 4 +- airflow/config_templates/default_airflow.cfg | 4 +- airflow/providers/amazon/aws/operators/athena.py | 2 +- airflow/providers/google/ads/hooks/ads.py | 2 +- .../_internal_client/secret_manager_client.py | 10 +- .../google/cloud/example_dags/example_dlp.py | 66 ++--- airflow/providers/google/cloud/hooks/bigquery.py | 8 +- .../providers/google/cloud/hooks/bigquery_dts.py | 12 ++- airflow/providers/google/cloud/hooks/bigtable.py | 10 +- .../providers/google/cloud/hooks/cloud_build.py| 2 +- .../google/cloud/hooks/cloud_memorystore.py| 22 ++--- airflow/providers/google/cloud/hooks/cloud_sql.py | 78 +++ .../cloud/hooks/cloud_storage_transfer_service.py | 14 +-- airflow/providers/google/cloud/hooks/compute.py| 14 +-- .../providers/google/cloud/hooks/datacatalog.py| 80 airflow/providers/google/cloud/hooks/dataflow.py | 20 ++-- airflow/providers/google/cloud/hooks/dlp.py| 32 +++ airflow/providers/google/cloud/hooks/functions.py | 6 +- airflow/providers/google/cloud/hooks/gcs.py| 2 +- .../providers/google/cloud/hooks/life_sciences.py | 4 +- airflow/providers/google/cloud/hooks/mlengine.py | 34 +++ airflow/providers/google/cloud/hooks/pubsub.py | 33 +++ airflow/providers/google/cloud/hooks/spanner.py| 58 ++- .../providers/google/cloud/hooks/stackdriver.py| 4 +- airflow/providers/google/cloud/hooks/tasks.py | 58 +-- .../providers/google/cloud/log/gcs_task_handler.py | 5 +- .../google/cloud/log/stackdriver_task_handler.py | 2 +- .../google/cloud/operators/bigquery_dts.py | 7 +- .../providers/google/cloud/operators/bigtable.py | 22 ++--- .../google/cloud/operators/cloud_memorystore.py| 26 ++--- .../providers/google/cloud/operators/cloud_sql.py | 16 ++-- .../operators/cloud_storage_transfer_service.py| 7 +- .../providers/google/cloud/operators/compute.py| 20 ++-- .../google/cloud/operators/datacatalog.py | 76 +++ .../providers/google/cloud/operators/dataflow.py | 12 +-- airflow/providers/google/cloud/operators/dlp.py| 40 .../providers/google/cloud/operators/functions.py | 2 +- airflow/providers/google/cloud/operators/gcs.py| 2 +- .../google/cloud/operators/kubernetes_engine.py| 2 +- .../providers/google/cloud/operators/mlengine.py | 35 --- airflow/providers/google/cloud/operators/pubsub.py | 40 .../providers/google/cloud/operators/spanner.py| 14 +-- .../google/cloud/operators/speech_to_text.py | 4 +- airflow/providers/google/cloud/operators/tasks.py | 54 +-- .../google/cloud/operators/text_to_speech.py | 4 +- .../google/cloud/operators/translate_speech.py | 4 +- airflow/providers/google/cloud/operators/vision.py | 24 ++--- .../google/cloud/secrets/secret_manager.py | 10 +- .../providers/google/cloud/sensors/bigquery_dts.py | 2 +- airflow/providers/google/cloud/sensors/bigtable.py | 2 +- .../sensors/cloud_storage_transfer_service.py | 2 +- airflow/providers/google/cloud/sensors/pubsub.py | 2 +- .../google/cloud/transfers/bigquery_to_mysql.py| 2 +- .../google/cloud/utils/credentials_provider.py | 26 ++--- .../google/cloud/utils/field_sanitizer.py | 8 +- .../google/cloud/utils/field_validator.py | 4 +- .../providers/google/common/hooks/base_google.py | 8 +- .../firebase/example_dags/example_firestore.py | 4 +- .../providers/google/firebase/hooks/firestore.py | 2 +- airflow/providers/google/suite/hooks/sheets.py | 2 +- .../hashicorp/_internal_client/vault_client.py | 4 +- airflow/providers/hashicorp
[airflow] branch constraints-master updated: Updating constraints. Build id:218176956
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 51a9e33 Updating constraints. Build id:218176956 51a9e33 is described below commit 51a9e3309042b13bc90c3618c7f258e7bb690dc2 Author: Automated Github Actions commit AuthorDate: Fri Aug 21 10:20:36 2020 + Updating constraints. Build id:218176956 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 2f552233f5c99b206c8f4c2088fcc0c05e7e26dc. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 +++ 1 file changed, 3 insertions(+) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..93f4130 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,6 +212,7 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 +libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -264,6 +265,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 +proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -377,6 +379,7 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 +typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:218176956
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 51a9e33 Updating constraints. Build id:218176956 51a9e33 is described below commit 51a9e3309042b13bc90c3618c7f258e7bb690dc2 Author: Automated Github Actions commit AuthorDate: Fri Aug 21 10:20:36 2020 + Updating constraints. Build id:218176956 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 2f552233f5c99b206c8f4c2088fcc0c05e7e26dc. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 +++ 1 file changed, 3 insertions(+) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..93f4130 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,6 +212,7 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 +libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -264,6 +265,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 +proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -377,6 +379,7 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 +typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:219186797
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new a8d9dc7 Updating constraints. Build id:219186797 a8d9dc7 is described below commit a8d9dc75d470888d8b4d983208099317801137d1 Author: Automated Github Actions commit AuthorDate: Sat Aug 22 01:39:20 2020 + Updating constraints. Build id:219186797 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha c979de70bd6776b1766f62043e5f833cde0f8171. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:219186797
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new a8d9dc7 Updating constraints. Build id:219186797 a8d9dc7 is described below commit a8d9dc75d470888d8b4d983208099317801137d1 Author: Automated Github Actions commit AuthorDate: Sat Aug 22 01:39:20 2020 + Updating constraints. Build id:219186797 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha c979de70bd6776b1766f62043e5f833cde0f8171. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:219881018
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6ab3743 Updating constraints. Build id:219881018 6ab3743 is described below commit 6ab3743f20b606d67c1d3a0f761350fa93cea6e0 Author: Automated Github Actions commit AuthorDate: Sat Aug 22 17:31:54 2020 + Updating constraints. Build id:219881018 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 47c6657ce012f6db147fdcce3ca5e77f46a9e491. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 +++ 1 file changed, 3 insertions(+) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..93f4130 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,6 +212,7 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 +libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -264,6 +265,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 +proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -377,6 +379,7 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 +typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow-site] branch asf-site updated: Update asf-site to output generated at 5409822
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new dc0f9c5 Update asf-site to output generated at 5409822
dc0f9c5 is described below
commit dc0f9c544ef3e0b1780e5d5dcd3b9096f427bfeb
Author: potiuk
AuthorDate: Thu Aug 20 16:57:23 2020 +
Update asf-site to output generated at 5409822
---
404.html | 28 +++
announcements/index.html | 28 +++
blog/airflow-1.10.10/index.html| 32 ++-
blog/airflow-1.10.8-1.10.9/index.html | 32 ++-
blog/airflow-survey/index.html | 32 ++-
blog/announcing-new-website/index.html | 32 ++-
blog/apache-airflow-for-newcomers/index.html | 32 ++-
.../index.html | 32 ++-
.../index.html | 32 ++-
.../index.html | 32 ++-
.../index.html | 32 ++-
blog/index.html| 28 +++
.../index.html | 32 ++-
blog/tags/community/index.html | 28 +++
blog/tags/development/index.html | 28 +++
blog/tags/documentation/index.html | 28 +++
blog/tags/release/index.html | 28 +++
blog/tags/rest-api/index.html | 28 +++
blog/tags/survey/index.html| 28 +++
blog/tags/users/index.html | 28 +++
categories/index.html | 28 +++
community/index.html | 28 +++
{blog/tags/development => ecosystem}/index.html| 237 +
ecosystem/index.xml| 17 ++
index.html | 56 +++--
install/index.html | 28 +++
meetups/index.html | 28 +++
privacy-notice/index.html | 28 +++
roadmap/index.html | 28 +++
search/index.html | 32 ++-
sitemap.xml| 109 +-
tags/index.html| 28 +++
use-cases/adobe/index.html | 32 ++-
use-cases/big-fish-games/index.html| 32 ++-
use-cases/dish/index.html | 32 ++-
use-cases/experity/index.html | 32 ++-
use-cases/index.html | 28 +++
use-cases/onefootball/index.html | 32 ++-
38 files changed, 1206 insertions(+), 229 deletions(-)
diff --git a/404.html b/404.html
index e0425eb..7a74357 100644
--- a/404.html
+++ b/404.html
@@ -218,6 +218,20 @@ if (!doNotTrack) {
+
+
+
+
+
+
+
+Ecosystem
+
+
+
+
@@ -363,6 +377,20 @@ if (!doNotTrack) {
+
+
+
+
+
+
+
+Ecosystem
+
+
+
+
diff --git a/announcements/index.html b/announcements/index.html
index f9b5c9f..be01cce 100644
--- a/announcements/index.html
+++ b/announcements/index.html
@@ -220,6 +220,20 @@ if (!doNotTrack) {
+
+
+
+
+
+
+
+Ecosystem
+
+
+
+
@@ -365,6 +379,20 @@ if (!doNotTrack) {
+
+
+
+
+
+
+
+Ecosystem
+
+
+
+
diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html
index e559342..0082f77 100644
--- a/blog/airflow-1.10.10/index.html
+++ b/blog/airflow-1.10.10/index.html
@@ -36,13 +36
[airflow] branch constraints-master updated: Updating constraints. Build id:217643466
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 69ca469 Updating constraints. Build id:217643466 69ca469 is described below commit 69ca4699efa671a8b27882f5baf423d51849e53c Author: Automated Github Actions commit AuthorDate: Fri Aug 21 01:41:18 2020 + Updating constraints. Build id:217643466 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 88c7d2e526af4994066f65f830e2fa8edcbbce2e. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] tag nightly-master updated (276a15a -> 725bf33)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 276a15a (commit) to 725bf33 (commit) from 276a15a Add info about update mask to API doc introduction (#10572) add bb3e45c Add Airflow 1.10.12 & 'black' to breeze-complete (#10592) add 91ff31a Documentation for Google Cloud Data Loss Prevention (#8201) (#9651) add 2e56ee7 DockerOperator extra_hosts argument support added (#10546) add 900f15a URL encode execution date in the Last Run link (#10595) add e565368 Nightly tag push is not skipped in scheduled builds (#10597) add 246c8f2 Add Currency to INTHEWILD.md (#10607) add 540957d Made use of authentication consistent (#10610) add 775c220 Added a logging and monitoring architecture diagram and page (#10609) add 479d622 Fix downstream rendering in WebUI (#10612) add 725bf33 Revert Clean up DAG serializations based on last_updated (#7424) (#10613) No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 2 - BREEZE.rst | 10 +- INTHEWILD.md | 1 + airflow/config_templates/config.yml| 8 - airflow/config_templates/default_airflow.cfg | 4 - airflow/models/dagcode.py | 10 +- airflow/models/serialized_dag.py | 27 +- airflow/providers/docker/operators/docker.py | 3 + .../google/cloud/example_dags/example_dlp.py | 94 ++ airflow/providers/google/cloud/operators/dlp.py| 120 airflow/utils/dag_processing.py| 51 +--- airflow/www/templates/airflow/dags.html| 2 +- airflow/www/views.py | 2 +- breeze-complete| 2 + .../operator/google/cloud/data_loss_prevention.rst | 327 + docs/img/arch-diag-logging.png | Bin 0 -> 25843 bytes docs/logging-monitoring/logging-architecture.rst | 41 +++ docs/operators-and-hooks-ref.rst | 2 +- docs/security/api.rst | 6 +- docs/spelling_wordlist.txt | 3 + tests/models/test_dagcode.py | 20 +- tests/models/test_serialized_dag.py| 23 +- tests/providers/docker/operators/test_docker.py| 167 --- tests/utils/test_dag_processing.py | 24 -- 24 files changed, 703 insertions(+), 246 deletions(-) create mode 100644 docs/howto/operator/google/cloud/data_loss_prevention.rst create mode 100644 docs/img/arch-diag-logging.png create mode 100644 docs/logging-monitoring/logging-architecture.rst
[airflow] tag nightly-master updated (276a15a -> 725bf33)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from 276a15a (commit) to 725bf33 (commit) from 276a15a Add info about update mask to API doc introduction (#10572) add bb3e45c Add Airflow 1.10.12 & 'black' to breeze-complete (#10592) add 91ff31a Documentation for Google Cloud Data Loss Prevention (#8201) (#9651) add 2e56ee7 DockerOperator extra_hosts argument support added (#10546) add 900f15a URL encode execution date in the Last Run link (#10595) add e565368 Nightly tag push is not skipped in scheduled builds (#10597) add 246c8f2 Add Currency to INTHEWILD.md (#10607) add 540957d Made use of authentication consistent (#10610) add 775c220 Added a logging and monitoring architecture diagram and page (#10609) add 479d622 Fix downstream rendering in WebUI (#10612) add 725bf33 Revert Clean up DAG serializations based on last_updated (#7424) (#10613) No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 2 - BREEZE.rst | 10 +- INTHEWILD.md | 1 + airflow/config_templates/config.yml| 8 - airflow/config_templates/default_airflow.cfg | 4 - airflow/models/dagcode.py | 10 +- airflow/models/serialized_dag.py | 27 +- airflow/providers/docker/operators/docker.py | 3 + .../google/cloud/example_dags/example_dlp.py | 94 ++ airflow/providers/google/cloud/operators/dlp.py| 120 airflow/utils/dag_processing.py| 51 +--- airflow/www/templates/airflow/dags.html| 2 +- airflow/www/views.py | 2 +- breeze-complete| 2 + .../operator/google/cloud/data_loss_prevention.rst | 327 + docs/img/arch-diag-logging.png | Bin 0 -> 25843 bytes docs/logging-monitoring/logging-architecture.rst | 41 +++ docs/operators-and-hooks-ref.rst | 2 +- docs/security/api.rst | 6 +- docs/spelling_wordlist.txt | 3 + tests/models/test_dagcode.py | 20 +- tests/models/test_serialized_dag.py| 23 +- tests/providers/docker/operators/test_docker.py| 167 --- tests/utils/test_dag_processing.py | 24 -- 24 files changed, 703 insertions(+), 246 deletions(-) create mode 100644 docs/howto/operator/google/cloud/data_loss_prevention.rst create mode 100644 docs/img/arch-diag-logging.png create mode 100644 docs/logging-monitoring/logging-architecture.rst
[airflow] branch constraints-master updated: Updating constraints. Build id:221273724
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6ee8f62 Updating constraints. Build id:221273724 6ee8f62 is described below commit 6ee8f628ce4c41ab29c1cdf67c18d1047fc03079 Author: Automated Github Actions commit AuthorDate: Mon Aug 24 01:43:32 2020 + Updating constraints. Build id:221273724 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 3a53039fd10543f01d7d619bf3cbbf69f5896cbe. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:221273724
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 6ee8f62 Updating constraints. Build id:221273724 6ee8f62 is described below commit 6ee8f628ce4c41ab29c1cdf67c18d1047fc03079 Author: Automated Github Actions commit AuthorDate: Mon Aug 24 01:43:32 2020 + Updating constraints. Build id:221273724 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 3a53039fd10543f01d7d619bf3cbbf69f5896cbe. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:221800587
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new c43c37a Updating constraints. Build id:221800587 c43c37a is described below commit c43c37a8decccb3887d0c3b4b35f83f551aee451 Author: Automated Github Actions commit AuthorDate: Mon Aug 24 10:23:26 2020 + Updating constraints. Build id:221800587 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha b0598b5351d2d027286e2333231b6c0c0704dba2. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 +++ 1 file changed, 3 insertions(+) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..93f4130 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,6 +212,7 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 +libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -264,6 +265,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 +proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -377,6 +379,7 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 +typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:221800587
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new c43c37a Updating constraints. Build id:221800587 c43c37a is described below commit c43c37a8decccb3887d0c3b4b35f83f551aee451 Author: Automated Github Actions commit AuthorDate: Mon Aug 24 10:23:26 2020 + Updating constraints. Build id:221800587 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha b0598b5351d2d027286e2333231b6c0c0704dba2. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 +++ 1 file changed, 3 insertions(+) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index ff45298..93f4130 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,6 +212,7 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 +libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -264,6 +265,7 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 +proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -377,6 +379,7 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 +typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow-site] branch asf-site updated: Update asf-site to output generated at 604bdd9
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new c540678 Update asf-site to output generated at 604bdd9 c540678 is described below commit c54067866d25c0ef6fd36f5355afd42b7efae832 Author: turbaszek AuthorDate: Mon Aug 24 07:27:40 2020 + Update asf-site to output generated at 604bdd9 --- blog/airflow-1.10.10/index.html| 4 +- blog/airflow-1.10.8-1.10.9/index.html | 4 +- blog/airflow-survey/index.html | 4 +- blog/announcing-new-website/index.html | 4 +- blog/apache-airflow-for-newcomers/index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- index.html | 30 +++--- search/index.html | 4 +- sitemap.xml| 106 ++--- use-cases/adobe/index.html | 4 +- use-cases/big-fish-games/index.html| 4 +- use-cases/dish/index.html | 4 +- use-cases/experity/index.html | 4 +- use-cases/onefootball/index.html | 4 +- 18 files changed, 100 insertions(+), 100 deletions(-) diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html index 0082f77..7155a54 100644 --- a/blog/airflow-1.10.10/index.html +++ b/blog/airflow-1.10.10/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-1.10.8-1.10.9/index.html b/blog/airflow-1.10.8-1.10.9/index.html index be1e1b9..4184cf0 100644 --- a/blog/airflow-1.10.8-1.10.9/index.html +++ b/blog/airflow-1.10.8-1.10.9/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html index 332687e..fbe4a39 100644 --- a/blog/airflow-survey/index.html +++ b/blog/airflow-survey/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/announcing-new-website/index.html b/blog/announcing-new-website/index.html index 74f4a86..63e5de1 100644 --- a/blog/announcing-new-website/index.html +++ b/blog/announcing-new-website/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/apache-airflow-for-newcomers/index.html b/blog/apache-airflow-for-newcomers/index.html index 3b48744..940ded6 100644 --- a/blog/apache-airflow-for-newcomers/index.html +++ b/blog/apache-airflow-for-newcomers/index.html @@ -37,14 +37,14 @@ Authoring Workflow in Apache Airflow. Airflow makes it easy to author workflows - + - + diff --git a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html index 2db6e17..a6d5f3b 100644 --- a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html +++ b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/documenting-using-local-development-environments/index.html b/blog/documenting-using-local-development-environments/index.html index dabc7f4..f1ef96c 100644 --- a/blog/documenting-using-local-development-environments/index.html +++ b/blog/documenting-using-local-development-environments/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html index 838f129..5b7304f 100644 --- a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html +++ b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html @@ -37,14 +37,14 @@ About Me I have been writing tech articles on medium as well as my blog for the - + - + diff --git a/blog/implementing-stable-api-for-apache-airflow/index.html b/blog/implementing-stable-api-for-apache-airflow/index.html index 3d761d0..6b45012 100644 --- a/blog/implementing-stable-api-for-apache-airflow/index.html +++ b/blog/implementing-stable-api-for-apache-airflow/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/its-a-breeze-to-develop-apache-airflow/index.html b/blog/its-a-breeze-to-develop-apache-airflow/index.html index 8f3b148..70cfb02 100644 --- a/blog/its-a-breeze-to-develop-apache-airflow/index.html +++ b/blog/its-a-breeze-to-develop-apache-airflow/index.html @@ -36,13
[airflow-site] branch asf-site updated: Update asf-site to output generated at 3715af1
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 0116856 Update asf-site to output generated at 3715af1 0116856 is described below commit 0116856e5d07c0e9e629446441c534501d20abf0 Author: kaxil AuthorDate: Mon Aug 24 17:04:16 2020 + Update asf-site to output generated at 3715af1 --- blog/airflow-1.10.10/index.html| 4 +- blog/airflow-1.10.8-1.10.9/index.html | 4 +- blog/airflow-survey/index.html | 4 +- blog/announcing-new-website/index.html | 4 +- blog/apache-airflow-for-newcomers/index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- .../index.html | 4 +- blog/tags/community/index.html | 6 +- blog/tags/community/index.xml | 4 +- ecosystem/index.html | 2 +- index.html | 30 +++--- search/index.html | 4 +- sitemap.xml| 106 ++--- use-cases/adobe/index.html | 4 +- use-cases/big-fish-games/index.html| 4 +- use-cases/dish/index.html | 4 +- use-cases/experity/index.html | 4 +- use-cases/onefootball/index.html | 4 +- 21 files changed, 106 insertions(+), 106 deletions(-) diff --git a/blog/airflow-1.10.10/index.html b/blog/airflow-1.10.10/index.html index 7155a54..465e95a 100644 --- a/blog/airflow-1.10.10/index.html +++ b/blog/airflow-1.10.10/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-1.10.8-1.10.9/index.html b/blog/airflow-1.10.8-1.10.9/index.html index 4184cf0..1be8989 100644 --- a/blog/airflow-1.10.8-1.10.9/index.html +++ b/blog/airflow-1.10.8-1.10.9/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/airflow-survey/index.html b/blog/airflow-survey/index.html index fbe4a39..b4e81ca 100644 --- a/blog/airflow-survey/index.html +++ b/blog/airflow-survey/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/announcing-new-website/index.html b/blog/announcing-new-website/index.html index 63e5de1..6cb81f0 100644 --- a/blog/announcing-new-website/index.html +++ b/blog/announcing-new-website/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/apache-airflow-for-newcomers/index.html b/blog/apache-airflow-for-newcomers/index.html index 940ded6..8a15d67 100644 --- a/blog/apache-airflow-for-newcomers/index.html +++ b/blog/apache-airflow-for-newcomers/index.html @@ -37,14 +37,14 @@ Authoring Workflow in Apache Airflow. Airflow makes it easy to author workflows - + - + diff --git a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html index a6d5f3b..881fc8a 100644 --- a/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html +++ b/blog/apache-con-europe-2019-thoughts-and-insights-by-airflow-committers/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/documenting-using-local-development-environments/index.html b/blog/documenting-using-local-development-environments/index.html index f1ef96c..819cef4 100644 --- a/blog/documenting-using-local-development-environments/index.html +++ b/blog/documenting-using-local-development-environments/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html index 5b7304f..276d604 100644 --- a/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html +++ b/blog/experience-in-google-season-of-docs-2019-with-apache-airflow/index.html @@ -37,14 +37,14 @@ About Me I have been writing tech articles on medium as well as my blog for the - + - + diff --git a/blog/implementing-stable-api-for-apache-airflow/index.html b/blog/implementing-stable-api-for-apache-airflow/index.html index 6b45012..1b633d1 100644 --- a/blog/implementing-stable-api-for-apache-airflow/index.html +++ b/blog/implementing-stable-api-for-apache-airflow/index.html @@ -36,13 +36,13 @@ - + - + diff --git a/blog/its-a-breeze-to-develop-apache-airflow/index.html b/blog/its-a-breeze-to-develop-apache
[airflow] branch constraints-master updated: Updating constraints. Build id:222896670
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 119281a Updating constraints. Build id:222896670 119281a is described below commit 119281a9eca38eff43473deb0aa10cd12c67515e Author: Automated Github Actions commit AuthorDate: Tue Aug 25 01:45:10 2020 + Updating constraints. Build id:222896670 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 49cce8b9f5995178d714e26fa4afc60ee59ca702. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:222896670
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 119281a Updating constraints. Build id:222896670 119281a is described below commit 119281a9eca38eff43473deb0aa10cd12c67515e Author: Automated Github Actions commit AuthorDate: Tue Aug 25 01:45:10 2020 + Updating constraints. Build id:222896670 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha 49cce8b9f5995178d714e26fa4afc60ee59ca702. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] branch constraints-master updated: Updating constraints. Build id:220229846
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-master in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-master by this push: new 166c228 Updating constraints. Build id:220229846 166c228 is described below commit 166c228d1bfd14e387305576c7b0fde089c251c3 Author: Automated Github Actions commit AuthorDate: Sun Aug 23 01:41:37 2020 + Updating constraints. Build id:220229846 This update in constraints is automatically committed by the CI 'constraints-push' step based on HEAD of 'refs/heads/master' in 'apache/airflow' with commit sha ef8df17348e3c567e2d2f0aface641acae3896ba. All tests passed in this build so we determined we can push the updated constraints. See https://github.com/apache/airflow/blob/master/README.md#installing-from-pypi for details. --- constraints-3.8.txt | 3 --- 1 file changed, 3 deletions(-) diff --git a/constraints-3.8.txt b/constraints-3.8.txt index 93f4130..ff45298 100644 --- a/constraints-3.8.txt +++ b/constraints-3.8.txt @@ -212,7 +212,6 @@ kubernetes==11.0.0 kylinpy==2.8.4 lazy-object-proxy==1.5.1 ldap3==2.8 -libcst==0.3.9 lockfile==0.12.2 marshmallow-enum==1.5.1 marshmallow-oneofschema==2.0.1 @@ -265,7 +264,6 @@ presto-python-client==0.7.0 prison==0.1.3 prometheus-client==0.8.0 prompt-toolkit==3.0.6 -proto-plus==1.7.0 protobuf==3.12.4 psutil==5.7.2 psycopg2-binary==2.8.5 @@ -379,7 +377,6 @@ tqdm==4.48.2 traitlets==4.3.3 typed-ast==1.4.1 typing-extensions==3.7.4.2 -typing-inspect==0.6.0 tzlocal==1.5.1 unicodecsv==0.14.1 uritemplate==3.0.1
[airflow] tag nightly-master updated (e495be9 -> 9b2efc6)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/airflow.git. *** WARNING: tag nightly-master was modified! *** from e495be9 (commit) to 9b2efc6 (commit) from e495be9 Update scheduler deployment - dags volume mount (#10630) add 5e36152 Helm Chart is using 1.10.12 image by default (#10639) add 7431867 Exclude CSRF tokens in Log's attribute "extra" in database (#10640) add 934115b Move roles to CONTRIBUTING.rst (#10327) add 2ca615c Update Google Cloud branding (#10642) add 9b2efc6 Improve logging & monitoring docs (#10618) No new revisions were added by this update. Summary of changes: BREEZE.rst | 4 +- CONTRIBUTING.rst | 68 +++- TESTING.rst| 6 +- UPDATING.md| 24 ++--- .../providers/amazon/aws/transfers/gcs_to_s3.py| 6 +- airflow/providers/google/ads/operators/ads.py | 2 +- .../providers/google/ads/transfers/ads_to_gcs.py | 2 +- .../google/cloud/example_dags/example_bigtable.py | 2 +- .../google/cloud/example_dags/example_cloud_sql.py | 4 +- .../cloud/example_dags/example_cloud_sql_query.py | 2 +- .../google/cloud/example_dags/example_compute.py | 4 +- .../cloud/example_dags/example_compute_igm.py | 2 +- .../google/cloud/example_dags/example_spanner.py | 2 +- .../google/cloud/example_dags/example_tasks.py | 2 +- .../google/cloud/example_dags/example_translate.py | 2 +- .../google/cloud/example_dags/example_vision.py| 2 +- airflow/providers/google/cloud/hooks/bigquery.py | 3 +- airflow/providers/google/cloud/hooks/bigtable.py | 10 +- airflow/providers/google/cloud/hooks/cloud_sql.py | 6 +- airflow/providers/google/cloud/hooks/compute.py| 24 ++--- .../providers/google/cloud/hooks/datacatalog.py| 4 +- airflow/providers/google/cloud/hooks/dataflow.py | 2 +- airflow/providers/google/cloud/hooks/datafusion.py | 10 +- airflow/providers/google/cloud/hooks/dataproc.py | 26 ++--- airflow/providers/google/cloud/hooks/datastore.py | 18 ++-- airflow/providers/google/cloud/hooks/dlp.py| 60 +-- airflow/providers/google/cloud/hooks/gcs.py| 2 +- airflow/providers/google/cloud/hooks/gdm.py| 2 +- .../google/cloud/hooks/kubernetes_engine.py| 10 +- airflow/providers/google/cloud/hooks/pubsub.py | 2 +- airflow/providers/google/cloud/operators/automl.py | 26 ++--- .../providers/google/cloud/operators/bigquery.py | 57 +- .../google/cloud/operators/bigquery_dts.py | 6 +- .../providers/google/cloud/operators/bigtable.py | 12 +-- .../google/cloud/operators/cloud_build.py | 2 +- .../google/cloud/operators/cloud_memorystore.py| 22 ++-- .../providers/google/cloud/operators/cloud_sql.py | 38 +++ .../operators/cloud_storage_transfer_service.py| 23 ++-- .../providers/google/cloud/operators/compute.py| 38 +++ .../google/cloud/operators/datacatalog.py | 88 +++ .../providers/google/cloud/operators/dataflow.py | 8 +- .../providers/google/cloud/operators/datafusion.py | 10 +- .../providers/google/cloud/operators/dataproc.py | 22 ++-- .../providers/google/cloud/operators/datastore.py | 24 ++--- airflow/providers/google/cloud/operators/dlp.py| 118 ++--- .../providers/google/cloud/operators/functions.py | 10 +- airflow/providers/google/cloud/operators/gcs.py| 36 +++ .../google/cloud/operators/kubernetes_engine.py| 4 +- .../google/cloud/operators/life_sciences.py| 2 +- .../google/cloud/operators/natural_language.py | 8 +- airflow/providers/google/cloud/operators/pubsub.py | 14 +-- .../providers/google/cloud/operators/spanner.py| 12 +-- .../google/cloud/operators/speech_to_text.py | 6 +- airflow/providers/google/cloud/operators/tasks.py | 26 ++--- .../google/cloud/operators/text_to_speech.py | 6 +- .../google/cloud/operators/translate_speech.py | 6 +- .../google/cloud/operators/video_intelligence.py | 10 +- airflow/providers/google/cloud/operators/vision.py | 34 +++--- .../sensors/cloud_storage_transfer_service.py | 3 +- airflow/providers/google/cloud/sensors/pubsub.py | 2 +- .../google/cloud/transfers/adls_to_gcs.py | 6 +- .../google/cloud/transfers/bigquery_to_bigquery.py | 4 +- .../google/cloud/transfers/bigquery_to_gcs.py | 4 +- .../google/cloud/transfers/cassandra_to_gcs.py | 6 +- .../google/cloud/transfers/facebook_ads_to_gcs.py | 2 +- .../google/cloud/transfers/gcs_to_bigquery.py | 4 +- .../providers/google/cloud/transfers/gcs_to_gcs.py | 6 +- .../google/c
