This is an automated email from the ASF dual-hosted git repository.
Amar3tto pushed a change to branch release-2.78
in repository https://gitbox.apache.org/repos/asf/beam.git
from 6e7ce70ffed Set Dataflow container to release version.
add 3b59922ae5f Updates Delta CDC read to fail when schemas are different
at... (#40868)
new fe2ba42066a Merge pull request #40877 from chamikaramj/release-2.78
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../beam_PostCommit_Java_Delta_IO_Dataflow.json | 2 +-
.../beam_PreCommit_Java_Delta_IO_Direct.json | 2 +-
.../beam/sdk/io/delta/CreateCDCReadTasksDoFn.java | 44 ++++-
.../java/org/apache/beam/sdk/io/delta/DeltaIO.java | 39 +++-
.../apache/beam/sdk/io/delta/DeltaSchemaUtils.java | 188 ++++++++++++++++++
.../org/apache/beam/sdk/io/delta/DeltaIOTest.java | 206 +++++++++++++++++++
.../beam/sdk/io/delta/DeltaSchemaUtilsTest.java | 220 +++++++++++++++++++++
.../beam/sdk/io/delta/DeltaWriteTestUtils.java | 125 ++++++++++++
8 files changed, 814 insertions(+), 12 deletions(-)
create mode 100644
sdks/java/io/delta/src/main/java/org/apache/beam/sdk/io/delta/DeltaSchemaUtils.java
create mode 100644
sdks/java/io/delta/src/test/java/org/apache/beam/sdk/io/delta/DeltaSchemaUtilsTest.java