Jeoffreybauvin opened a new issue, #63948:
URL: https://github.com/apache/airflow/issues/63948

   ### Apache Airflow Provider(s)
   
   common-io
   
   ### Versions of Apache Airflow Providers
   
   ```
   airflow@28e9b513de07:/opt/airflow$ pip freeze | grep providers
   apache-airflow-providers-amazon==9.22.0
   apache-airflow-providers-celery==3.17.0
   apache-airflow-providers-cncf-kubernetes==10.13.0
   apache-airflow-providers-common-compat==1.14.0
   apache-airflow-providers-common-io==1.7.1
   apache-airflow-providers-common-messaging==2.0.2
   apache-airflow-providers-common-sql==1.32.0
   apache-airflow-providers-docker==4.5.2
   apache-airflow-providers-elasticsearch==6.5.0
   apache-airflow-providers-fab==3.4.0
   apache-airflow-providers-ftp==3.14.1
   apache-airflow-providers-git==0.2.4
   apache-airflow-providers-google==20.0.0
   apache-airflow-providers-grpc==3.9.2
   apache-airflow-providers-hashicorp==4.5.0
   apache-airflow-providers-http==6.0.0
   apache-airflow-providers-microsoft-azure==13.0.0
   apache-airflow-providers-mysql==6.5.0
   apache-airflow-providers-odbc==4.12.0
   apache-airflow-providers-openlineage==2.11.0
   apache-airflow-providers-postgres==6.6.0
   apache-airflow-providers-redis==4.4.2
   apache-airflow-providers-sendgrid==4.2.1
   apache-airflow-providers-sftp==5.7.0
   apache-airflow-providers-slack==9.7.0
   apache-airflow-providers-smtp==2.4.2
   apache-airflow-providers-snowflake==6.10.0
   apache-airflow-providers-ssh==4.3.1
   apache-airflow-providers-standard==1.12.0
   
   ```
   
   ### Apache Airflow version
   
   3.1.8
   
   ### Operating System
   
   Ubuntu 24.04
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   _No response_
   
   ### What happened
   
   I'm trying to store xcom into S3 : 
   
   ```
   airflow@28e9b513de07:/opt/airflow$ airflow config list |  grep -E 
"core|common|xcom"
   [core]
   xcom_backend = 
airflow.providers.common.io.xcom.backend.XComObjectStorageBackend
   [common.io]
   xcom_objectstorage_path = s3://s3_infra@prod-airflow01-logs/xcom
   xcom_objectstorage_threshold = -1
   xcom_objectstorage_compression = 
   ```
   
   Already using this **s3_infra** connection for logs storage, and it's 
working fine : 
   
   ```
   remote_logging = True
   remote_log_conn_id = s3_infra
   remote_base_log_folder = s3://prod-airflow01-logs/logs
   ```
   
   I can see logs in my bucket.
   
   But no xcom :(. When I launch a dag with xcom, nothing relevant in logs 
(even with debug), and I can see the  xcom stored in the database backend, and 
not S3 :(.
   
   What am I missing ?
   
   
   
   
   ### What you think should happen instead
   
   xcom should be stored in s3.
   
   ### How to reproduce
   
   Use the config above.
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to