This is an automated email from the ASF dual-hosted git repository. yhu pushed a change to branch revert-30770-python-sdk-avro-beam-schema-conversion-bugfixes in repository https://gitbox.apache.org/repos/asf/beam.git
discard 0dfdcc2ca10 Revert "python sdk: fix several bugs regarding avto <-> beam schema conversio…" add 088c854d7a3 Fix :examples:java:twitter:execute task (#31103) add b33a8438ad3 Revert global snake_case convention for SchemaTransforms (#31109) add 15f7f02a79d Add UnboundedReaderMaxReadTimeMs to DataflowPipelineDebugOptions, deprecate UnboundedReaderMaxReadTimeSec (#31091) add 0b12b18a618 fix test added in previous commit add 2ed07b81dcb add trigger file This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (0dfdcc2ca10) \ N -- N -- N refs/heads/revert-30770-python-sdk-avro-beam-schema-conversion-bugfixes (2ed07b81dcb) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .../beam_PostCommit_Python_Xlang_Gcp_Direct.json | 2 +- ...er_ULR.json => beam_PostCommit_XVR_Direct.json} | 0 ..._Direct.json => beam_PostCommit_XVR_Samza.json} | 0 ..._Flink.json => beam_PostCommit_XVR_Spark3.json} | 0 examples/java/twitter/build.gradle | 1 + .../options/DataflowPipelineDebugOptions.java | 27 ++++- .../dataflow/worker/WorkerCustomSources.java | 5 +- .../dataflow/worker/WorkerCustomSourcesTest.java | 6 +- .../transforms/TypedSchemaTransformProvider.java | 36 ++---- .../TypedSchemaTransformProviderTest.java | 8 +- .../IcebergReadSchemaTransformProvider.java | 12 ++ .../IcebergWriteSchemaTransformProvider.java | 11 ++ .../KafkaReadSchemaTransformProviderTest.java | 16 +-- .../managed/ManagedSchemaTransformProvider.java | 12 +- .../ManagedSchemaTransformProviderTest.java | 12 +- .../ManagedSchemaTransformTranslationTest.java | 6 +- .../org/apache/beam/sdk/managed/ManagedTest.java | 2 +- .../managed/src/test/resources/test_config.yaml | 4 +- sdks/python/apache_beam/io/avroio.py | 132 ++++++++++++++++++--- sdks/python/apache_beam/io/avroio_test.py | 80 ++++++++++++- sdks/python/apache_beam/io/gcp/bigquery.py | 14 +-- sdks/python/apache_beam/io/gcp/bigtableio.py | 12 +- .../transforms/external_transform_provider.py | 35 +++++- .../external_transform_provider_it_test.py | 22 ++++ sdks/python/apache_beam/yaml/yaml_provider.py | 2 +- sdks/python/gen_xlang_wrappers.py | 21 +++- 26 files changed, 381 insertions(+), 97 deletions(-) rename .github/trigger_files/{beam_PostCommit_Java_ValidatesRunner_ULR.json => beam_PostCommit_XVR_Direct.json} (100%) rename .github/trigger_files/{beam_PostCommit_TransformService_Direct.json => beam_PostCommit_XVR_Samza.json} (100%) rename .github/trigger_files/{beam_PostCommit_XVR_Flink.json => beam_PostCommit_XVR_Spark3.json} (100%)