This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch update-2-3-0-doc in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/update-2-3-0-doc by this push: new 9b2adc1e0 Remove references to python 3.6 from doc 9b2adc1e0 is described below commit 9b2adc1e02d1f5953046c3d3b91828397488ec98 Author: Ephraim Anierobi <splendidzig...@gmail.com> AuthorDate: Wed May 4 19:43:49 2022 +0100 Remove references to python 3.6 from doc --- .../2.3.0/_sources/extra-packages-ref.rst.txt | 2 +- .../2.3.0/_sources/howto/set-up-database.rst.txt | 2 +- .../_sources/installation/installing-from-pypi.rst.txt | 10 +++++----- .../2.3.0/_sources/installation/prerequisites.rst.txt | 2 +- .../apache-airflow/2.3.0/_sources/start/local.rst.txt | 4 ++-- .../2.3.0/_sources/upgrading-from-1-10/index.rst.txt | 2 ++ .../apache-airflow/2.3.0/_static/_gen/js/docs.js | 2 +- docs-archive/apache-airflow/2.3.0/build.rst | 12 ++++++------ .../apache-airflow/2.3.0/cli-and-env-variables-ref.html | 16 ++++++++-------- .../apache-airflow/2.3.0/extra-packages-ref.html | 2 +- .../apache-airflow/2.3.0/howto/set-up-database.html | 2 +- .../2.3.0/installation/installing-from-pypi.html | 10 +++++----- .../apache-airflow/2.3.0/installation/prerequisites.html | 2 +- docs-archive/apache-airflow/2.3.0/release_notes.html | 15 ++++++++++----- docs-archive/apache-airflow/2.3.0/searchindex.js | 2 +- docs-archive/apache-airflow/2.3.0/start/local.html | 4 ++-- .../apache-airflow/2.3.0/upgrading-from-1-10/index.html | 1 + 17 files changed, 49 insertions(+), 41 deletions(-) diff --git a/docs-archive/apache-airflow/2.3.0/_sources/extra-packages-ref.rst.txt b/docs-archive/apache-airflow/2.3.0/_sources/extra-packages-ref.rst.txt index d2adf1a6a..a75e1d87d 100644 --- a/docs-archive/apache-airflow/2.3.0/_sources/extra-packages-ref.rst.txt +++ b/docs-archive/apache-airflow/2.3.0/_sources/extra-packages-ref.rst.txt @@ -96,7 +96,7 @@ with a consistent set of dependencies based on constraint files provided by Airf :substitutions: pip install apache-airflow[google,amazon,apache.spark]==|version| \ - --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-3.6.txt" + --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-3.7.txt" Note, that this will install providers in the versions that were released at the time of Airflow |version| release. You can later upgrade those providers manually if you want to use latest versions of the providers. diff --git a/docs-archive/apache-airflow/2.3.0/_sources/howto/set-up-database.rst.txt b/docs-archive/apache-airflow/2.3.0/_sources/howto/set-up-database.rst.txt index 749ad7745..563d2efc6 100644 --- a/docs-archive/apache-airflow/2.3.0/_sources/howto/set-up-database.rst.txt +++ b/docs-archive/apache-airflow/2.3.0/_sources/howto/set-up-database.rst.txt @@ -86,7 +86,7 @@ You can make sure which version is used by the interpreter by running this check .. code-block:: bash root@b8a8e73caa2c:/opt/airflow# python - Python 3.6.12 (default, Nov 25 2020, 03:59:00) + Python 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 8.3.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import sqlite3 diff --git a/docs-archive/apache-airflow/2.3.0/_sources/installation/installing-from-pypi.rst.txt b/docs-archive/apache-airflow/2.3.0/_sources/installation/installing-from-pypi.rst.txt index ed59d21fb..bb6ba57f4 100644 --- a/docs-archive/apache-airflow/2.3.0/_sources/installation/installing-from-pypi.rst.txt +++ b/docs-archive/apache-airflow/2.3.0/_sources/installation/installing-from-pypi.rst.txt @@ -37,7 +37,7 @@ Typical command to install airflow from PyPI looks like below: .. code-block:: - pip install "apache-airflow[celery]==|version|" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-3.6.txt" + pip install "apache-airflow[celery]==|version|" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-3.7.txt" This is an example, see further for more explanation. @@ -142,7 +142,7 @@ in specific version. .. code-block:: bash PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)" - # For example: 3.6 + # For example: 3.7 CONSTRAINT_URL="https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-${PYTHON_VERSION}.txt" pip install "apache-airflow-providers-google" --constraint "${CONSTRAINT_URL}" @@ -151,7 +151,7 @@ You can also upgrade the providers to latest versions (you need to use main vers .. code-block:: bash PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)" - # For example: 3.6 + # For example: 3.7 CONSTRAINT_URL="https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-${PYTHON_VERSION}.txt" pip install "apache-airflow-providers-google" --upgrade --constraint "${CONSTRAINT_URL}" @@ -166,9 +166,9 @@ If you don't want to install any extra providers, initially you can use the comm AIRFLOW_VERSION=|version| PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)" - # For example: 3.6 + # For example: 3.7 CONSTRAINT_URL="https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-no-providers-${PYTHON_VERSION}.txt" - # For example: https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-no-providers-3.6.txt + # For example: https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-no-providers-3.7.txt pip install "apache-airflow==${AIRFLOW_VERSION}" --constraint "${CONSTRAINT_URL}" diff --git a/docs-archive/apache-airflow/2.3.0/_sources/installation/prerequisites.rst.txt b/docs-archive/apache-airflow/2.3.0/_sources/installation/prerequisites.rst.txt index 84b8535ff..e4a255a21 100644 --- a/docs-archive/apache-airflow/2.3.0/_sources/installation/prerequisites.rst.txt +++ b/docs-archive/apache-airflow/2.3.0/_sources/installation/prerequisites.rst.txt @@ -39,7 +39,7 @@ using the latest stable version of SQLite for local development. **Note**: Python v3.10 is not supported yet. For details, see `#19059 <https://github.com/apache/airflow/issues/19059>`__. -Starting with Airflow 2.1.2, Airflow is tested with Python 3.6, 3.7, 3.8, and 3.9. +Starting with Airflow 2.3.0, Airflow is tested with Python 3.7, 3.8, 3.9 and 3.10. The minimum memory required we recommend Airflow to run with is 4GB, but the actual requirements depends wildly on the deployment options you have diff --git a/docs-archive/apache-airflow/2.3.0/_sources/start/local.rst.txt b/docs-archive/apache-airflow/2.3.0/_sources/start/local.rst.txt index 0c786369e..b617d095f 100644 --- a/docs-archive/apache-airflow/2.3.0/_sources/start/local.rst.txt +++ b/docs-archive/apache-airflow/2.3.0/_sources/start/local.rst.txt @@ -49,9 +49,9 @@ constraint files to enable reproducible installation, so using ``pip`` and const # Install Airflow using the constraints file AIRFLOW_VERSION=|version| PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)" - # For example: 3.6 + # For example: 3.7 CONSTRAINT_URL="https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt" - # For example: https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-3.6.txt + # For example: https://raw.githubusercontent.com/apache/airflow/constraints-|version|/constraints-3.7.txt pip install "apache-airflow==${AIRFLOW_VERSION}" --constraint "${CONSTRAINT_URL}" # The Standalone command will initialise the database, make a user, diff --git a/docs-archive/apache-airflow/2.3.0/_sources/upgrading-from-1-10/index.rst.txt b/docs-archive/apache-airflow/2.3.0/_sources/upgrading-from-1-10/index.rst.txt index c9cfd8d64..334753e52 100644 --- a/docs-archive/apache-airflow/2.3.0/_sources/upgrading-from-1-10/index.rst.txt +++ b/docs-archive/apache-airflow/2.3.0/_sources/upgrading-from-1-10/index.rst.txt @@ -34,6 +34,8 @@ Airflow 1.10 was the last release series to support Python 2. Airflow 2.0.0 requires Python 3.6+ and has been tested with Python versions 3.6, 3.7 and 3.8. Python 3.9 support was added from Airflow 2.1.2. +Airflow 2.3.0 dropped support for Python 3.6. It's tested with Python 3.7, 3.8, 3.9 and 3.10. + If you have a specific task that still requires Python 2 then you can use the :class:`~airflow.operators.python.PythonVirtualenvOperator` or the ``KubernetesPodOperator`` for this. For a list of breaking changes between Python 2 and Python 3, please refer to this diff --git a/docs-archive/apache-airflow/2.3.0/_static/_gen/js/docs.js b/docs-archive/apache-airflow/2.3.0/_static/_gen/js/docs.js index 57efdbeca..90898d86d 100644 --- a/docs-archive/apache-airflow/2.3.0/_static/_gen/js/docs.js +++ b/docs-archive/apache-airflow/2.3.0/_static/_gen/js/docs.js @@ -1 +1 @@ -!function(r){var n={};function o(t){if(n[t])return n[t].exports;var e=n[t]={i:t,l:!1,exports:{}};return r[t].call(e.exports,e,e.exports,o),e.l=!0,e.exports}o.m=r,o.c=n,o.d=function(t,e,r){o.o(t,e)||Object.defineProperty(t,e,{enumerable:!0,get:r})},o.r=function(t){"undefined"!=typeof Symbol&&Symbol.toStringTag&&Object.defineProperty(t,Symbol.toStringTag,{value:"Module"}),Object.defineProperty(t,"__esModule",{value:!0})},o.t=function(e,t){if(1&t&&(e=o(e)),8&t)return e;if(4&t&&"object"==typ [...] \ No newline at end of file +!function(r){var n={};function o(t){if(n[t])return n[t].exports;var e=n[t]={i:t,l:!1,exports:{}};return r[t].call(e.exports,e,e.exports,o),e.l=!0,e.exports}o.m=r,o.c=n,o.d=function(t,e,r){o.o(t,e)||Object.defineProperty(t,e,{enumerable:!0,get:r})},o.r=function(t){"undefined"!=typeof Symbol&&Symbol.toStringTag&&Object.defineProperty(t,Symbol.toStringTag,{value:"Module"}),Object.defineProperty(t,"__esModule",{value:!0})},o.t=function(e,t){if(1&t&&(e=o(e)),8&t)return e;if(4&t&&"object"==typ [...] \ No newline at end of file diff --git a/docs-archive/apache-airflow/2.3.0/build.rst b/docs-archive/apache-airflow/2.3.0/build.rst index c34a9ff1a..fd938cd50 100644 --- a/docs-archive/apache-airflow/2.3.0/build.rst +++ b/docs-archive/apache-airflow/2.3.0/build.rst @@ -550,16 +550,16 @@ Building from PyPI packages This is the basic way of building the custom images from sources. -The following example builds the production image in version ``3.6`` with latest PyPI-released Airflow, -with default set of Airflow extras and dependencies. The ``2.0.2`` constraints are used automatically. +The following example builds the production image in version ``3.7`` with latest PyPI-released Airflow, +with default set of Airflow extras and dependencies. The latest PyPI-released Airflow constraints are used automatically. .. exampleinclude:: docker-examples/customizing/stable-airflow.sh :language: bash :start-after: [START build] :end-before: [END build] -The following example builds the production image in version ``3.7`` with default extras from ``2.0.2`` PyPI -package. The ``2.0.2`` constraints are used automatically. +The following example builds the production image in version ``3.7`` with default extras from ``2.3.0`` Airflow +package. The ``2.3.0`` constraints are used automatically. .. exampleinclude:: docker-examples/customizing/pypi-selected-version.sh :language: bash @@ -567,7 +567,7 @@ package. The ``2.0.2`` constraints are used automatically. :end-before: [END build] The following example builds the production image in version ``3.8`` with additional airflow extras -(``mssql,hdfs``) from ``2.0.2`` PyPI package, and additional dependency (``oauth2client``). +(``mssql,hdfs``) from ``2.3.0`` PyPI package, and additional dependency (``oauth2client``). .. exampleinclude:: docker-examples/customizing/pypi-extras-and-deps.sh :language: bash @@ -593,7 +593,7 @@ have more complex dependencies to build. Building optimized images ......................... -The following example the production image in version ``3.6`` with additional airflow extras from ``2.0.2`` +The following example the production image in version ``3.7`` with additional airflow extras from ``2.0.2`` PyPI package but it includes additional apt dev and runtime dependencies. The dev dependencies are those that require ``build-essential`` and usually need to involve recompiling diff --git a/docs-archive/apache-airflow/2.3.0/cli-and-env-variables-ref.html b/docs-archive/apache-airflow/2.3.0/cli-and-env-variables-ref.html index 20cfe7d10..09ec6193e 100644 --- a/docs-archive/apache-airflow/2.3.0/cli-and-env-variables-ref.html +++ b/docs-archive/apache-airflow/2.3.0/cli-and-env-variables-ref.html @@ -1869,14 +1869,14 @@ development and testing.</p> <div class="section" id="list"> <h6>list<a class="headerlink" href="#list" title="Permalink to this headline">¶</a></h6> <p>List options for the configuration</p> -<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">config</span> <span class="nb">list</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">auto</span><span class="p">,</span><span class="n">on</span><span class="p">,</span><span class="n">off [...] +<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">config</span> <span class="nb">list</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">off</span><span class="p">,</span><span class="n">auto</span><span class="p">,</span><span class="n">on [...] </pre></div> </div> <div class="section" id="Named Arguments_repeat4"> <h7>Named Arguments<a class="headerlink" href="#Named Arguments_repeat4" title="Permalink to this headline">¶</a></h7> <dl class="option-list"> <dt><kbd>--color</kbd></dt> -<dd><p>Possible choices: auto, on, off</p> +<dd><p>Possible choices: off, auto, on</p> <p>Do emit colored output (default: auto)</p> <p>Default: “auto”</p> </dd> @@ -1960,7 +1960,7 @@ development and testing.</p> <div class="section" id="delete"> <h6>delete<a class="headerlink" href="#delete" title="Permalink to this headline">¶</a></h6> <p>Delete a connection</p> -<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">connections</span> <span class="n">delete</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">auto</span><span class="p">,</span><span class="n">on</span><span class="p">,</span><span class=" [...] +<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">connections</span> <span class="n">delete</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">off</span><span class="p">,</span><span class="n">auto</span><span class="p">,</span><span class= [...] </pre></div> </div> <div class="section" id="Positional Arguments_repeat6"> @@ -1975,7 +1975,7 @@ development and testing.</p> <h7>Named Arguments<a class="headerlink" href="#Named Arguments_repeat6" title="Permalink to this headline">¶</a></h7> <dl class="option-list"> <dt><kbd>--color</kbd></dt> -<dd><p>Possible choices: auto, on, off</p> +<dd><p>Possible choices: off, auto, on</p> <p>Do emit colored output (default: auto)</p> <p>Default: “auto”</p> </dd> @@ -2028,7 +2028,7 @@ When exporting in <cite>env</cite> file format, you control whether URI format o <div class="section" id="get"> <h6>get<a class="headerlink" href="#get" title="Permalink to this headline">¶</a></h6> <p>Get a connection</p> -<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">connections</span> <span class="n">get</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">auto</span><span class="p">,</span><span class="n">on</span><span class="p">,</span><span class="n"> [...] +<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">connections</span> <span class="n">get</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">off</span><span class="p">,</span><span class="n">auto</span><span class="p">,</span><span class="n" [...] <span class="p">[</span><span class="o">-</span><span class="n">o</span> <span class="n">table</span><span class="p">,</span> <span class="n">json</span><span class="p">,</span> <span class="n">yaml</span><span class="p">,</span> <span class="n">plain</span><span class="p">]</span> <span class="p">[</span><span class="o">-</span><span class="n">v</span><span class="p">]</span> <span class="n">conn_id</span> </pre></div> @@ -2045,7 +2045,7 @@ When exporting in <cite>env</cite> file format, you control whether URI format o <h7>Named Arguments<a class="headerlink" href="#Named Arguments_repeat8" title="Permalink to this headline">¶</a></h7> <dl class="option-list"> <dt><kbd>--color</kbd></dt> -<dd><p>Possible choices: auto, on, off</p> +<dd><p>Possible choices: off, auto, on</p> <p>Do emit colored output (default: auto)</p> <p>Default: “auto”</p> </dd> @@ -3331,7 +3331,7 @@ To check if the local scheduler is still working properly, run:</p> <div class="section" id="get_repeat2"> <h6>get<a class="headerlink" href="#get_repeat2" title="Permalink to this headline">¶</a></h6> <p>Get detailed information about a provider</p> -<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">providers</span> <span class="n">get</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">auto</span><span class="p">,</span><span class="n">on</span><span class="p">,</span><span class="n">of [...] +<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">airflow</span> <span class="n">providers</span> <span class="n">get</span> <span class="p">[</span><span class="o">-</span><span class="n">h</span><span class="p">]</span> <span class="p">[</span><span class="o">--</span><span class="n">color</span> <span class="p">{</span><span class="n">off</span><span class="p">,</span><span class="n">auto</span><span class="p">,</span><span class="n">o [...] <span class="p">[</span><span class="o">-</span><span class="n">o</span> <span class="n">table</span><span class="p">,</span> <span class="n">json</span><span class="p">,</span> <span class="n">yaml</span><span class="p">,</span> <span class="n">plain</span><span class="p">]</span> <span class="p">[</span><span class="o">-</span><span class="n">v</span><span class="p">]</span> <span class="n">provider_name</span> </pre></div> @@ -3348,7 +3348,7 @@ To check if the local scheduler is still working properly, run:</p> <h7>Named Arguments<a class="headerlink" href="#Named Arguments_repeat45" title="Permalink to this headline">¶</a></h7> <dl class="option-list"> <dt><kbd>--color</kbd></dt> -<dd><p>Possible choices: auto, on, off</p> +<dd><p>Possible choices: off, auto, on</p> <p>Do emit colored output (default: auto)</p> <p>Default: “auto”</p> </dd> diff --git a/docs-archive/apache-airflow/2.3.0/extra-packages-ref.html b/docs-archive/apache-airflow/2.3.0/extra-packages-ref.html index 801016e32..cb6b3c803 100644 --- a/docs-archive/apache-airflow/2.3.0/extra-packages-ref.html +++ b/docs-archive/apache-airflow/2.3.0/extra-packages-ref.html @@ -784,7 +784,7 @@ for first time installation where you want to repeatably install version of depe </div></blockquote> <p>with a consistent set of dependencies based on constraint files provided by Airflow Community at the time 2.3.0 version was released.</p> <div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>pip install apache-airflow<span class="o">[</span>google,amazon,apache.spark<span class="o">]==</span><span class="m">2</span>.3.0 <span class="se">\</span> - --constraint <span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-3.6.txt"</span> + --constraint <span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-3.7.txt"</span> </pre></div> </div> <p>Note, that this will install providers in the versions that were released at the time of Airflow 2.3.0 release. You can later diff --git a/docs-archive/apache-airflow/2.3.0/howto/set-up-database.html b/docs-archive/apache-airflow/2.3.0/howto/set-up-database.html index 36783bada..5b1cb7402 100644 --- a/docs-archive/apache-airflow/2.3.0/howto/set-up-database.html +++ b/docs-archive/apache-airflow/2.3.0/howto/set-up-database.html @@ -756,7 +756,7 @@ the python interpreter used by Airflow might still use the older version availab <code class="docutils literal notranslate"><span class="pre">LD_LIBRARY_PATH</span></code> set for the python interpreter that is used to start Airflow.</p> <p>You can make sure which version is used by the interpreter by running this check:</p> <div class="highlight-bash notranslate"><div class="highlight"><pre><span></span>root@b8a8e73caa2c:/opt/airflow# python -Python <span class="m">3</span>.6.12 <span class="o">(</span>default, Nov <span class="m">25</span> <span class="m">2020</span>, <span class="m">03</span>:59:00<span class="o">)</span> +Python <span class="m">3</span>.8.10 <span class="o">(</span>default, Mar <span class="m">15</span> <span class="m">2022</span>, <span class="m">12</span>:22:08<span class="o">)</span> <span class="o">[</span>GCC <span class="m">8</span>.3.0<span class="o">]</span> on linux Type <span class="s2">"help"</span>, <span class="s2">"copyright"</span>, <span class="s2">"credits"</span> or <span class="s2">"license"</span> <span class="k">for</span> more information. >>> import sqlite3 diff --git a/docs-archive/apache-airflow/2.3.0/installation/installing-from-pypi.html b/docs-archive/apache-airflow/2.3.0/installation/installing-from-pypi.html index d1fc81497..fdf14d3d1 100644 --- a/docs-archive/apache-airflow/2.3.0/installation/installing-from-pypi.html +++ b/docs-archive/apache-airflow/2.3.0/installation/installing-from-pypi.html @@ -718,7 +718,7 @@ Installing via <code class="docutils literal notranslate"><span class="pre">Poet using those tools you should use the constraints and convert them to appropriate format and workflow that your tool requires.</p> <p>Typical command to install airflow from PyPI looks like below:</p> -<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">pip</span> <span class="n">install</span> <span class="s2">"apache-airflow[celery]==2.3.0"</span> <span class="o">--</span><span class="n">constraint</span> <span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-3.6.txt"</span> +<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">pip</span> <span class="n">install</span> <span class="s2">"apache-airflow[celery]==2.3.0"</span> <span class="o">--</span><span class="n">constraint</span> <span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-3.7.txt"</span> </pre></div> </div> <p>This is an example, see further for more explanation.</p> @@ -796,14 +796,14 @@ will be any incompatibilities, it will be captured as package dependencies.</p> <p>Note that “main” is just an example - you might need to choose a specific airflow version to install providers in specific version.</p> <div class="highlight-bash notranslate"><div class="highlight"><pre><span></span><span class="nv">PYTHON_VERSION</span><span class="o">=</span><span class="s2">"</span><span class="k">$(</span>python --version <span class="p">|</span> cut -d <span class="s2">" "</span> -f <span class="m">2</span> <span class="p">|</span> cut -d <span class="s2">"."</span> -f <span class="m">1</span>-2<span class="k">)</span><span class="s2">"</span> -<span class="c1"># For example: 3.6</span> +<span class="c1"># For example: 3.7</span> <span class="nv">CONSTRAINT_URL</span><span class="o">=</span><span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-</span><span class="si">${</span><span class="nv">PYTHON_VERSION</span><span class="si">}</span><span class="s2">.txt"</span> pip install <span class="s2">"apache-airflow-providers-google"</span> --constraint <span class="s2">"</span><span class="si">${</span><span class="nv">CONSTRAINT_URL</span><span class="si">}</span><span class="s2">"</span> </pre></div> </div> <p>You can also upgrade the providers to latest versions (you need to use main version of constraints for that):</p> <div class="highlight-bash notranslate"><div class="highlight"><pre><span></span><span class="nv">PYTHON_VERSION</span><span class="o">=</span><span class="s2">"</span><span class="k">$(</span>python --version <span class="p">|</span> cut -d <span class="s2">" "</span> -f <span class="m">2</span> <span class="p">|</span> cut -d <span class="s2">"."</span> -f <span class="m">1</span>-2<span class="k">)</span><span class="s2">"</span> -<span class="c1"># For example: 3.6</span> +<span class="c1"># For example: 3.7</span> <span class="nv">CONSTRAINT_URL</span><span class="o">=</span><span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-</span><span class="si">${</span><span class="nv">PYTHON_VERSION</span><span class="si">}</span><span class="s2">.txt"</span> pip install <span class="s2">"apache-airflow-providers-google"</span> --upgrade --constraint <span class="s2">"</span><span class="si">${</span><span class="nv">CONSTRAINT_URL</span><span class="si">}</span><span class="s2">"</span> </pre></div> @@ -814,9 +814,9 @@ pip install <span class="s2">"apache-airflow-providers-google"</span> <p>If you don’t want to install any extra providers, initially you can use the command set below.</p> <div class="highlight-bash notranslate"><div class="highlight"><pre><span></span><span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="m">2</span>.3.0 <span class="nv">PYTHON_VERSION</span><span class="o">=</span><span class="s2">"</span><span class="k">$(</span>python --version <span class="p">|</span> cut -d <span class="s2">" "</span> -f <span class="m">2</span> <span class="p">|</span> cut -d <span class="s2">"."</span> -f <span class="m">1</span>-2<span class="k">)</span><span class="s2">"</span> -<span class="c1"># For example: 3.6</span> +<span class="c1"># For example: 3.7</span> <span class="nv">CONSTRAINT_URL</span><span class="o">=</span><span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-</span><span class="si">${</span><span class="nv">AIRFLOW_VERSION</span><span class="si">}</span><span class="s2">/constraints-no-providers-</span><span class="si">${</span><span class="nv">PYTHON_VERSION</span><span class="si">}</span><span class="s2">.txt"</span> -<span class="c1"># For example: https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-no-providers-3.6.txt</span> +<span class="c1"># For example: https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-no-providers-3.7.txt</span> pip install <span class="s2">"apache-airflow==</span><span class="si">${</span><span class="nv">AIRFLOW_VERSION</span><span class="si">}</span><span class="s2">"</span> --constraint <span class="s2">"</span><span class="si">${</span><span class="nv">CONSTRAINT_URL</span><span class="si">}</span><span class="s2">"</span> </pre></div> </div> diff --git a/docs-archive/apache-airflow/2.3.0/installation/prerequisites.html b/docs-archive/apache-airflow/2.3.0/installation/prerequisites.html index bd5c87cfe..3c4f03a5c 100644 --- a/docs-archive/apache-airflow/2.3.0/installation/prerequisites.html +++ b/docs-archive/apache-airflow/2.3.0/installation/prerequisites.html @@ -692,7 +692,7 @@ running multiple schedulers – please see: <a class="reference internal" href=" <p><strong>Note:</strong> SQLite is used in Airflow tests. Do not use it in production. We recommend using the latest stable version of SQLite for local development.</p> <p><strong>Note</strong>: Python v3.10 is not supported yet. For details, see <a class="reference external" href="https://github.com/apache/airflow/issues/19059">#19059</a>.</p> -<p>Starting with Airflow 2.1.2, Airflow is tested with Python 3.6, 3.7, 3.8, and 3.9.</p> +<p>Starting with Airflow 2.3.0, Airflow is tested with Python 3.7, 3.8, 3.9 and 3.10.</p> <p>The minimum memory required we recommend Airflow to run with is 4GB, but the actual requirements depends wildly on the deployment options you have</p> <p><strong>Note</strong>: Airflow currently can be run on POSIX-compliant Operating Systems. For development it is regularly diff --git a/docs-archive/apache-airflow/2.3.0/release_notes.html b/docs-archive/apache-airflow/2.3.0/release_notes.html index 8b93b5a78..48b6639b6 100644 --- a/docs-archive/apache-airflow/2.3.0/release_notes.html +++ b/docs-archive/apache-airflow/2.3.0/release_notes.html @@ -357,7 +357,7 @@ <li class="toctree-l3"><a class="reference internal" href="#significant-changes">Significant Changes</a><ul> <li class="toctree-l4"><a class="reference internal" href="#passing-execution-date-to-xcom-set-xcom-clear-xcom-get-one-and-xcom-get-many-is-deprecated-19825">Passing <code class="docutils literal notranslate"><span class="pre">execution_date</span></code> to <code class="docutils literal notranslate"><span class="pre">XCom.set()</span></code>, <code class="docutils literal notranslate"><span class="pre">XCom.clear()</span></code> , <code class="docutils literal notranslate"><span class=" [...] <li class="toctree-l4"><a class="reference internal" href="#task-log-templates-are-now-read-from-the-metadata-database-instead-of-airflow-cfg-20165">Task log templates are now read from the metadata database instead of <code class="docutils literal notranslate"><span class="pre">airflow.cfg</span></code> (#20165)</a></li> -<li class="toctree-l4"><a class="reference internal" href="#minimum-kubernetes-version-bumped-from-3-0-0-to-21-7-0-20759">Minimum kubernetes version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)</a></li> +<li class="toctree-l4"><a class="reference internal" href="#minimum-kubernetes-library-version-bumped-from-3-0-0-to-21-7-0-20759">Minimum kubernetes library version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)</a></li> <li class="toctree-l4"><a class="reference internal" href="#xcom-now-defined-by-run-id-instead-of-execution-date-20975">XCom now defined by <code class="docutils literal notranslate"><span class="pre">run_id</span></code> instead of <code class="docutils literal notranslate"><span class="pre">execution_date</span></code> (#20975)</a></li> <li class="toctree-l4"><a class="reference internal" href="#non-json-serializable-params-deprecated-21135">Non-JSON-serializable params deprecated (#21135).</a></li> <li class="toctree-l4"><a class="reference internal" href="#you-must-use-postgresql-instead-of-postgres-in-sql-alchemy-conn-for-sqlalchemy-1-4-0-21205">You must use <code class="docutils literal notranslate"><span class="pre">postgresql://</span></code> instead of <code class="docutils literal notranslate"><span class="pre">postgres://</span></code> in <code class="docutils literal notranslate"><span class="pre">sql_alchemy_conn</span></code> for SQLAlchemy 1.4.0+ (#21205)</a></li> @@ -1185,7 +1185,7 @@ <li class="toctree-l3"><a class="reference internal" href="#significant-changes">Significant Changes</a><ul> <li class="toctree-l4"><a class="reference internal" href="#passing-execution-date-to-xcom-set-xcom-clear-xcom-get-one-and-xcom-get-many-is-deprecated-19825">Passing <code class="docutils literal notranslate"><span class="pre">execution_date</span></code> to <code class="docutils literal notranslate"><span class="pre">XCom.set()</span></code>, <code class="docutils literal notranslate"><span class="pre">XCom.clear()</span></code> , <code class="docutils literal notranslate"><span class=" [...] <li class="toctree-l4"><a class="reference internal" href="#task-log-templates-are-now-read-from-the-metadata-database-instead-of-airflow-cfg-20165">Task log templates are now read from the metadata database instead of <code class="docutils literal notranslate"><span class="pre">airflow.cfg</span></code> (#20165)</a></li> -<li class="toctree-l4"><a class="reference internal" href="#minimum-kubernetes-version-bumped-from-3-0-0-to-21-7-0-20759">Minimum kubernetes version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)</a></li> +<li class="toctree-l4"><a class="reference internal" href="#minimum-kubernetes-library-version-bumped-from-3-0-0-to-21-7-0-20759">Minimum kubernetes library version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)</a></li> <li class="toctree-l4"><a class="reference internal" href="#xcom-now-defined-by-run-id-instead-of-execution-date-20975">XCom now defined by <code class="docutils literal notranslate"><span class="pre">run_id</span></code> instead of <code class="docutils literal notranslate"><span class="pre">execution_date</span></code> (#20975)</a></li> <li class="toctree-l4"><a class="reference internal" href="#non-json-serializable-params-deprecated-21135">Non-JSON-serializable params deprecated (#21135).</a></li> <li class="toctree-l4"><a class="reference internal" href="#you-must-use-postgresql-instead-of-postgres-in-sql-alchemy-conn-for-sqlalchemy-1-4-0-21205">You must use <code class="docutils literal notranslate"><span class="pre">postgresql://</span></code> instead of <code class="docutils literal notranslate"><span class="pre">postgres://</span></code> in <code class="docutils literal notranslate"><span class="pre">sql_alchemy_conn</span></code> for SQLAlchemy 1.4.0+ (#21205)</a></li> @@ -2020,8 +2020,13 @@ <p>Previously, a task’s log is dynamically rendered from the <code class="docutils literal notranslate"><span class="pre">[core]</span> <span class="pre">log_filename_template</span></code> and <code class="docutils literal notranslate"><span class="pre">[elasticsearch]</span> <span class="pre">log_id_template</span></code> config values at runtime. This resulted in unfortunate characteristics, e.g. it is impractical to modify the config value after an Airflow instance is running for a w [...] <p>A new <code class="docutils literal notranslate"><span class="pre">log_template</span></code> table is introduced to solve this problem. This table is synchronized with the aforementioned config values every time Airflow starts, and a new field <code class="docutils literal notranslate"><span class="pre">log_template_id</span></code> is added to every DAG run to point to the format used by tasks (<code class="docutils literal notranslate"><span class="pre">NULL</span></code> indicates [...] </div> -<div class="section" id="minimum-kubernetes-version-bumped-from-3-0-0-to-21-7-0-20759"> -<h4>Minimum kubernetes version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)<a class="headerlink" href="#minimum-kubernetes-version-bumped-from-3-0-0-to-21-7-0-20759" title="Permalink to this headline">¶</a></h4> +<div class="section" id="minimum-kubernetes-library-version-bumped-from-3-0-0-to-21-7-0-20759"> +<h4>Minimum kubernetes library version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)<a class="headerlink" href="#minimum-kubernetes-library-version-bumped-from-3-0-0-to-21-7-0-20759" title="Permalink to this headline">¶</a></h4> +<div class="admonition note"> +<p class="admonition-title">Note</p> +<p>This is only about changing the <code class="docutils literal notranslate"><span class="pre">kubernetes</span></code> library, not the Kubernetes cluster. Airflow support for +Kubernetes version is described in <a class="reference external" href="https://airflow.apache.org/docs/apache-airflow/stable/installation/prerequisites.html">Installation prerequisites</a>.</p> +</div> <p>No change in behavior is expected. This was necessary in order to take advantage of a <a class="reference external" href="https://github.com/kubernetes-client/python-base/commit/70b78cd8488068c014b6d762a0c8d358273865b4">bugfix</a> concerning refreshing of Kubernetes API tokens with EKS, which enabled the removal of some <a class="reference external" href="https://github.com/apache/airflow/pull/20759">workaround code</a>.</p> </div> <div class="section" id="xcom-now-defined-by-run-id-instead-of-execution-date-20975"> @@ -12045,7 +12050,7 @@ It was not confirmed, but a workaround was found by changing the default back to <li><a class="reference internal" href="#significant-changes">Significant Changes</a><ul> <li><a class="reference internal" href="#passing-execution-date-to-xcom-set-xcom-clear-xcom-get-one-and-xcom-get-many-is-deprecated-19825">Passing <code class="docutils literal notranslate"><span class="pre">execution_date</span></code> to <code class="docutils literal notranslate"><span class="pre">XCom.set()</span></code>, <code class="docutils literal notranslate"><span class="pre">XCom.clear()</span></code> , <code class="docutils literal notranslate"><span class="pre">XCom.get_one() [...] <li><a class="reference internal" href="#task-log-templates-are-now-read-from-the-metadata-database-instead-of-airflow-cfg-20165">Task log templates are now read from the metadata database instead of <code class="docutils literal notranslate"><span class="pre">airflow.cfg</span></code> (#20165)</a></li> -<li><a class="reference internal" href="#minimum-kubernetes-version-bumped-from-3-0-0-to-21-7-0-20759">Minimum kubernetes version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)</a></li> +<li><a class="reference internal" href="#minimum-kubernetes-library-version-bumped-from-3-0-0-to-21-7-0-20759">Minimum kubernetes library version bumped from <code class="docutils literal notranslate"><span class="pre">3.0.0</span></code> to <code class="docutils literal notranslate"><span class="pre">21.7.0</span></code> (#20759)</a></li> <li><a class="reference internal" href="#xcom-now-defined-by-run-id-instead-of-execution-date-20975">XCom now defined by <code class="docutils literal notranslate"><span class="pre">run_id</span></code> instead of <code class="docutils literal notranslate"><span class="pre">execution_date</span></code> (#20975)</a></li> <li><a class="reference internal" href="#non-json-serializable-params-deprecated-21135">Non-JSON-serializable params deprecated (#21135).</a></li> <li><a class="reference internal" href="#you-must-use-postgresql-instead-of-postgres-in-sql-alchemy-conn-for-sqlalchemy-1-4-0-21205">You must use <code class="docutils literal notranslate"><span class="pre">postgresql://</span></code> instead of <code class="docutils literal notranslate"><span class="pre">postgres://</span></code> in <code class="docutils literal notranslate"><span class="pre">sql_alchemy_conn</span></code> for SQLAlchemy 1.4.0+ (#21205)</a></li> diff --git a/docs-archive/apache-airflow/2.3.0/searchindex.js b/docs-archive/apache-airflow/2.3.0/searchindex.js index 75923dac1..2c7dc6120 100644 --- a/docs-archive/apache-airflow/2.3.0/searchindex.js +++ b/docs-archive/apache-airflow/2.3.0/searchindex.js @@ -1 +1 @@ -Search.setIndex({docnames:["_api/airflow/exceptions/index","_api/airflow/executors/base_executor/index","_api/airflow/executors/celery_executor/index","_api/airflow/executors/celery_kubernetes_executor/index","_api/airflow/executors/dask_executor/index","_api/airflow/executors/debug_executor/index","_api/airflow/executors/executor_constants/index","_api/airflow/executors/executor_loader/index","_api/airflow/executors/index","_api/airflow/executors/kubernetes_executor/index","_api/airflow [...] \ No newline at end of file +Search.setIndex({docnames:["_api/airflow/exceptions/index","_api/airflow/executors/base_executor/index","_api/airflow/executors/celery_executor/index","_api/airflow/executors/celery_kubernetes_executor/index","_api/airflow/executors/dask_executor/index","_api/airflow/executors/debug_executor/index","_api/airflow/executors/executor_constants/index","_api/airflow/executors/executor_loader/index","_api/airflow/executors/index","_api/airflow/executors/kubernetes_executor/index","_api/airflow [...] \ No newline at end of file diff --git a/docs-archive/apache-airflow/2.3.0/start/local.html b/docs-archive/apache-airflow/2.3.0/start/local.html index 4e6d29d83..3b97ae6e2 100644 --- a/docs-archive/apache-airflow/2.3.0/start/local.html +++ b/docs-archive/apache-airflow/2.3.0/start/local.html @@ -679,9 +679,9 @@ constraint files to enable reproducible installation, so using <code class="docu <span class="c1"># Install Airflow using the constraints file</span> <span class="nv">AIRFLOW_VERSION</span><span class="o">=</span><span class="m">2</span>.3.0 <span class="nv">PYTHON_VERSION</span><span class="o">=</span><span class="s2">"</span><span class="k">$(</span>python --version <span class="p">|</span> cut -d <span class="s2">" "</span> -f <span class="m">2</span> <span class="p">|</span> cut -d <span class="s2">"."</span> -f <span class="m">1</span>-2<span class="k">)</span><span class="s2">"</span> -<span class="c1"># For example: 3.6</span> +<span class="c1"># For example: 3.7</span> <span class="nv">CONSTRAINT_URL</span><span class="o">=</span><span class="s2">"https://raw.githubusercontent.com/apache/airflow/constraints-</span><span class="si">${</span><span class="nv">AIRFLOW_VERSION</span><span class="si">}</span><span class="s2">/constraints-</span><span class="si">${</span><span class="nv">PYTHON_VERSION</span><span class="si">}</span><span class="s2">.txt"</span> -<span class="c1"># For example: https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-3.6.txt</span> +<span class="c1"># For example: https://raw.githubusercontent.com/apache/airflow/constraints-2.3.0/constraints-3.7.txt</span> pip install <span class="s2">"apache-airflow==</span><span class="si">${</span><span class="nv">AIRFLOW_VERSION</span><span class="si">}</span><span class="s2">"</span> --constraint <span class="s2">"</span><span class="si">${</span><span class="nv">CONSTRAINT_URL</span><span class="si">}</span><span class="s2">"</span> <span class="c1"># The Standalone command will initialise the database, make a user,</span> diff --git a/docs-archive/apache-airflow/2.3.0/upgrading-from-1-10/index.html b/docs-archive/apache-airflow/2.3.0/upgrading-from-1-10/index.html index 76f24419e..9b2c81a68 100644 --- a/docs-archive/apache-airflow/2.3.0/upgrading-from-1-10/index.html +++ b/docs-archive/apache-airflow/2.3.0/upgrading-from-1-10/index.html @@ -689,6 +689,7 @@ users to migrate from Airflow 1.10.x to Airflow 2</p> <p>Airflow 1.10 was the last release series to support Python 2. Airflow 2.0.0 requires Python 3.6+ and has been tested with Python versions 3.6, 3.7 and 3.8. Python 3.9 support was added from Airflow 2.1.2.</p> +<p>Airflow 2.3.0 dropped support for Python 3.6. It’s tested with Python 3.7, 3.8, 3.9 and 3.10.</p> <p>If you have a specific task that still requires Python 2 then you can use the <a class="reference internal" href="../_api/airflow/operators/python/index.html#airflow.operators.python.PythonVirtualenvOperator" title="airflow.operators.python.PythonVirtualenvOperator"><code class="xref py py-class docutils literal notranslate"><span class="pre">PythonVirtualenvOperator</span></code></a> or the <code class="docutils literal notranslate"><span class="pre">KubernetesPodOperator</span></cod [...] <p>For a list of breaking changes between Python 2 and Python 3, please refer to this <a class="reference external" href="https://blog.couchbase.com/tips-and-tricks-for-upgrading-from-python-2-to-python-3/">handy blog</a>