kapuza opened a new issue, #35268: URL: https://github.com/apache/airflow/issues/35268
### Apache Airflow version 2.7.2 ### What happened I am using [this](https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/executor/celery.html) docs. System: Ubuntu 22.04.3 LTS Python 3.10.12 Install like: ```bash pip install -U pip; \ PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)"; \ AIRFLOW_VERSION='2.7.2'; \ pip install wheel; \ pip install psycopg2-binary; \ pip install virtualenv; \ pip install "apache-airflow[celery,redis,postgres]==${AIRFLOW_VERSION}" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt";; ``` Installed ok, and work fine with LocalExecutor. But try: ```bash $ airflow celery flower Usage: airflow [-h] GROUP_OR_COMMAND ... Positional Arguments: GROUP_OR_COMMAND Groups config View configuration connections Manage connections dags Manage DAGs db Database operations jobs Manage jobs pools Manage pools providers Display providers roles Manage roles tasks Manage tasks users Manage users variables Manage variables Commands: cheat-sheet Display cheat sheet dag-processor Start a standalone Dag Processor instance info Show information about current Airflow and environment kerberos Start a kerberos ticket renewer plugins Dump information about loaded plugins rotate-fernet-key Rotate encrypted connection credentials and variables scheduler Start a scheduler instance standalone Run an all-in-one copy of Airflow sync-perm Update permissions for existing roles and optionally DAGs triggerer Start a triggerer instance version Show the version webserver Start a Airflow webserver instance Options: -h, --help show this help message and exit airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery' (choose from 'cheat-sheet', 'config', 'connections', 'dag-processor', 'dags', 'db', 'info', 'jobs', 'kerberos', 'plugins', 'pools', 'providers', 'roles', 'rotate-fernet-key', 'scheduler', 'standalone', 'sync-perm', 'tasks', 'triggerer', 'users', 'variables', 'version', 'webserver'), see help above. ``` Try: ```bash $ celery Usage: celery [OPTIONS] COMMAND [ARGS]... Celery command entrypoint. Options: -A, --app APPLICATION -b, --broker TEXT --result-backend TEXT --loader TEXT --config TEXT --workdir PATH -C, --no-color -q, --quiet --version --skip-checks Skip Django core checks on startup. Setting the SKIP_CHECKS environment variable to any non-empty string will have the same effect. --help Show this message and exit. Commands: amqp AMQP Administration Shell. beat Start the beat periodic task scheduler. call Call a task by name. control Workers remote control. events Event-stream utilities. flower Web based tool for monitoring and administrating Celery clusters. graph The ``celery graph`` command. inspect Inspect the worker at runtime. list Get info from broker. logtool The ``celery logtool`` command. migrate Migrate tasks from one broker to another. multi Start multiple worker instances. purge Erase all messages from all known task queues. report Shows information useful to include in bug-reports. result Print the return value for a given task id. shell Start shell session with convenient access to celery symbols. status Show list of workers that are online. upgrade Perform upgrade between versions. worker Start worker instance. ``` How i can use celery in airflow? ### What you think should happen instead [Documentation](https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/executor/celery.html) not work for this version. ### How to reproduce Just install not in docker and try run **airflow celery flower** ### Operating System Ubuntu 22.04.3 LTS ### Versions of Apache Airflow Providers aiohttp==3.8.6 aiosignal==1.3.1 alembic==1.12.0 amqp==5.1.1 annotated-types==0.6.0 anyio==4.0.0 apache-airflow==2.7.2 apache-airflow-providers-celery==3.3.4 apache-airflow-providers-common-sql==1.7.2 apache-airflow-providers-ftp==3.5.2 apache-airflow-providers-http==4.5.2 apache-airflow-providers-imap==3.3.2 apache-airflow-providers-sqlite==3.4.3 apispec==6.3.0 argcomplete==3.1.2 asgiref==3.7.2 async-timeout==4.0.3 attrs==23.1.0 Babel==2.13.0 backoff==1.10.0 billiard==4.1.0 blinker==1.6.3 cachelib==0.9.0 cattrs==23.1.2 celery==5.3.4 certifi==2023.7.22 cffi==1.16.0 charset-normalizer==3.3.0 click==8.1.7 click-didyoumean==0.3.0 click-plugins==1.1.1 click-repl==0.3.0 clickclick==20.10.2 colorama==0.4.6 colorlog==4.8.0 ConfigUpdater==3.1.1 connexion==2.14.2 cron-descriptor==1.4.0 croniter==1.4.1 cryptography==41.0.4 Deprecated==1.2.14 dill==0.3.1.1 distlib==0.3.7 dnspython==2.4.2 docutils==0.20.1 email-validator==1.3.1 exceptiongroup==1.1.3 filelock==3.13.0 Flask==2.2.5 Flask-AppBuilder==4.3.6 Flask-Babel==2.0.0 Flask-Caching==2.0.2 Flask-JWT-Extended==4.5.3 Flask-Limiter==3.5.0 Flask-Login==0.6.2 Flask-Session==0.5.0 Flask-SQLAlchemy==2.5.1 Flask-WTF==1.2.1 flower==2.0.1 frozenlist==1.4.0 google-re2==1.1 googleapis-common-protos==1.60.0 graphviz==0.20.1 greenlet==3.0.0 grpcio==1.59.0 gunicorn==21.2.0 h11==0.14.0 httpcore==0.16.3 httpx==0.23.3 humanize==4.8.0 idna==3.4 importlib-metadata==6.8.0 importlib-resources==6.1.0 inflection==0.5.1 itsdangerous==2.1.2 Jinja2==3.1.2 jsonschema==4.19.1 jsonschema-specifications==2023.7.1 kombu==5.3.2 lazy-object-proxy==1.9.0 limits==3.6.0 linkify-it-py==2.0.2 lockfile==0.12.2 Mako==1.2.4 Markdown==3.5 markdown-it-py==3.0.0 MarkupSafe==2.1.3 marshmallow==3.20.1 marshmallow-oneofschema==3.0.1 marshmallow-sqlalchemy==0.26.1 mdit-py-plugins==0.4.0 mdurl==0.1.2 multidict==6.0.4 opentelemetry-api==1.20.0 opentelemetry-exporter-otlp==1.20.0 opentelemetry-exporter-otlp-proto-common==1.20.0 opentelemetry-exporter-otlp-proto-grpc==1.20.0 opentelemetry-exporter-otlp-proto-http==1.20.0 opentelemetry-proto==1.20.0 opentelemetry-sdk==1.20.0 opentelemetry-semantic-conventions==0.41b0 ordered-set==4.1.0 packaging==23.2 pathspec==0.11.2 pendulum==2.1.2 platformdirs==3.11.0 pluggy==1.3.0 prison==0.2.1 prometheus-client==0.17.1 prompt-toolkit==3.0.39 protobuf==4.21.12 psutil==5.9.5 psycopg2-binary==2.9.9 pycparser==2.21 pydantic==2.4.2 pydantic_core==2.10.1 Pygments==2.16.1 PyJWT==2.8.0 python-daemon==3.0.1 python-dateutil==2.8.2 python-nvd3==0.15.0 python-slugify==8.0.1 pytz==2023.3.post1 pytzdata==2020.1 PyYAML==6.0.1 referencing==0.30.2 requests==2.31.0 requests-toolbelt==1.0.0 rfc3339-validator==0.1.4 rfc3986==1.5.0 rich==13.6.0 rich-argparse==1.3.0 rpds-py==0.10.4 setproctitle==1.3.3 six==1.16.0 sniffio==1.3.0 SQLAlchemy==1.4.49 SQLAlchemy-JSONField==1.0.1.post0 SQLAlchemy-Utils==0.41.1 sqlparse==0.4.4 tabulate==0.9.0 tenacity==8.2.3 termcolor==2.3.0 text-unidecode==1.3 tornado==6.3.3 typing_extensions==4.8.0 tzdata==2023.3 uc-micro-py==1.0.2 unicodecsv==0.14.1 urllib3==1.26.17 vine==5.0.0 virtualenv==20.24.6 wcwidth==0.2.8 Werkzeug==2.2.3 wrapt==1.15.0 WTForms==3.0.1 yarl==1.9.2 zipp==3.17.0 ### Deployment Other ### Deployment details ```bash pip install -U pip; \ PYTHON_VERSION="$(python --version | cut -d " " -f 2 | cut -d "." -f 1-2)"; \ AIRFLOW_VERSION='2.7.2'; \ pip install wheel; \ pip install psycopg2-binary; \ pip install virtualenv; \ pip install "apache-airflow[celery,redis,postgres]==${AIRFLOW_VERSION}" --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt";; ``` ### Anything else _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
