chunyang commented on pull request #17100:
URL: https://github.com/apache/beam/pull/17100#issuecomment-1075505398
The error appears to be due to the temp dataset being deleted before the
table schema is read. I can move the table schema retrieval back into
`_export_files` so that it returns the `schema, metadata_list` tuple again, for
example,
```python
self.export_schema, self.export_metadata_list = self._export_files(bq)
```
The problem here is that `self.export_schema` is not picklable.
```
[...]
apache_beam/coders/coder_impl.py:272: in decode_from_stream
return self._decoder(stream.read_all(nested))
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
_ _ _ _ _ _ _ _ _
self = [], sequence = [<TableFieldSchema
fields: []
mode: 'NULLABLE'
name: 'f0_'
type: 'INTEGER'>]
def extend(self, sequence):
"""Validate extension of list."""
> self.__field.validate(sequence)
E AttributeError: 'FieldList' object has no attribute
'_FieldList__field'
```
@aaltay I saw you ran into the same issue previously here?
https://github.com/google/apitools/pull/311 Did you have a workaround? AFAICT a
newer version of apitools was never released.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
