gopidesupavan commented on code in PR #49173:
URL: https://github.com/apache/airflow/pull/49173#discussion_r2041539530
##########
providers/common/io/src/airflow/providers/common/io/xcom/backend.py:
##########
@@ -160,9 +160,16 @@ def deserialize_value(result) -> Any:
Compression is inferred from the file extension.
"""
- data = BaseXCom.deserialize_value(result)
+ base_xcom_deser_result = BaseXCom.deserialize_value(result)
+
+ # When XComObjectStorageBackend is used, xcom value will be serialized
using json.dumps
+ # likely, we need to deserialize it using json.loads
+ try:
+ data = json.loads(base_xcom_deser_result, cls=XComDecoder)
+ except (TypeError, ValueError):
+ data = base_xcom_deser_result
Review Comment:
I will keep the json.dumps conveted data for writing to object store, as its
convert that to bytes and to get the bytes size to compare with threshold. When
the threshold is less, then serialize with BaseXcom and return.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
