Re: [I] The PostCommit Python Xlang Gcp Direct job is flaky [beam]

[via GitHub]

Abacn commented on issue #35285:
URL: https://github.com/apache/beam/issues/35285#issuecomment-3402246645

   `AttributeError: 'FieldList' object has no attribute '_FieldList__field'`
   
   
   ```
   2025-10-14T12:09:48.6345176Z 
apache_beam/io/external/xlang_bigqueryio_it_test.py:220: in 
run_storage_write_test
   2025-10-14T12:09:48.6345887Z     p
   2025-10-14T12:09:48.6346362Z apache_beam/pvalue.py:139: in 
__or__
   2025-10-14T12:09:48.6347209Z     return 
self.pipeline.apply(ptransform, 
self)
   2025-10-14T12:09:48.6347982Z apache_beam/pipeline.py:826: in 
apply
   2025-10-14T12:09:48.6348985Z     pvalueish_result = 
self.runner.apply(transform, pvalueish, 
self._options)
   2025-10-14T12:09:48.6349885Z apache_beam/runners/runner.py:191: 
in apply
   2025-10-14T12:09:48.6350793Z     return 
self.apply_PTransform(transform, input, 
options)
   2025-10-14T12:09:48.6351709Z apache_beam/runners/runner.py:195: 
in apply_PTransform
   2025-10-14T12:09:48.6352618Z     return 
transform.expand(input)
   2025-10-14T12:09:48.6353336Z 
apache_beam/io/gcp/bigquery.py:2370: in expand
   2025-10-14T12:09:48.6354024Z     return pcoll | 
StorageWriteToBigQuery(
   2025-10-14T12:09:48.6354655Z apache_beam/pvalue.py:139: in 
__or__
   2025-10-14T12:09:48.6355640Z     return 
self.pipeline.apply(ptransform, 
self)
   2025-10-14T12:09:48.6356379Z apache_beam/pipeline.py:826: in 
apply
   2025-10-14T12:09:48.6357261Z     pvalueish_result = 
self.runner.apply(transform, pvalueish, 
self._options)
   2025-10-14T12:09:48.6358096Z apache_beam/runners/runner.py:191: 
in apply
   2025-10-14T12:09:48.6359021Z     return 
self.apply_PTransform(transform, input, 
options)
   2025-10-14T12:09:48.6360066Z apache_beam/runners/runner.py:195: 
in apply_PTransform
   2025-10-14T12:09:48.6360806Z     return 
transform.expand(input)
   2025-10-14T12:09:48.6361505Z 
apache_beam/io/gcp/bigquery.py:2678: in expand
   2025-10-14T12:09:48.6362076Z     input
   2025-10-14T12:09:48.6362809Z apache_beam/pvalue.py:139: in 
__or__
   2025-10-14T12:09:48.6363601Z     return 
self.pipeline.apply(ptransform, 
self)
   2025-10-14T12:09:48.6364480Z apache_beam/pipeline.py:731: in 
apply
   2025-10-14T12:09:48.6365119Z     return 
self.apply(
   2025-10-14T12:09:48.6365703Z apache_beam/pipeline.py:746: in 
apply
   2025-10-14T12:09:48.6366392Z     return 
self.apply(transform, pvalueish)
   2025-10-14T12:09:48.6367161Z apache_beam/pipeline.py:826: in 
apply
   2025-10-14T12:09:48.6368042Z     pvalueish_result = 
self.runner.apply(transform, pvalueish, 
self._options)
   2025-10-14T12:09:48.6369029Z apache_beam/runners/runner.py:191: 
in apply
   2025-10-14T12:09:48.6369918Z     return 
self.apply_PTransform(transform, input, 
options)
   2025-10-14T12:09:48.6370797Z apache_beam/runners/runner.py:195: 
in apply_PTransform
   2025-10-14T12:09:48.6371545Z     return 
transform.expand(input)
   2025-10-14T12:09:48.6372417Z 
apache_beam/io/gcp/bigquery.py:2787: in expand
   2025-10-14T12:09:48.6373209Z     | "Convert dict to 
Beam Row" >> beam.Map(
   2025-10-14T12:09:48.6373939Z 
apache_beam/transforms/core.py:2125: in Map
   2025-10-14T12:09:48.6374564Z     pardo = FlatMap(wrapper, *args, 
**kwargs)
   2025-10-14T12:09:48.6375185Z 
apache_beam/transforms/core.py:2067: in FlatMap
   2025-10-14T12:09:48.6375882Z     pardo = ParDo(CallableWrapperDoFn(fn), 
*args, **kwargs)
   2025-10-14T12:09:48.6376563Z 
apache_beam/transforms/core.py:1568: in __init__
   2025-10-14T12:09:48.6377040Z     
super().__init__(fn, *args, 
**kwargs)
   2025-10-14T12:09:48.6377506Z 
apache_beam/transforms/ptransform.py:878: in __init__
   2025-10-14T12:09:48.6378168Z     self.fn = 
pickler.loads(pickler.dumps(self.fn))
   2025-10-14T12:09:48.6378712Z 
apache_beam/internal/pickler.py:62: in loads
   2025-10-14T12:09:48.6379139Z     return 
desired_pickle_lib.loads(
   2025-10-14T12:09:48.6379601Z 
apache_beam/internal/cloudpickle_pickler.py:178: in loads
   2025-10-14T12:09:48.6380028Z     unpickled = 
cloudpickle.loads(s)
   ```
   
   (we should also disable color in output)
   
   failing since Oct 6th. However the first failing run does not show 
"AttributeError", and started from the second failing run. Nevertheless it 
appears related to Python 3.13 support


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@beam.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org