This is an automated email from the ASF dual-hosted git repository.
boyuanz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 489ab66 [BEAM-11531] Allow pandas <1.3.0 (#13681)
new 816f297 Add transform translator for GroupIntoBatches in Java.
new 9b92f41 Fix checkStyle error; add a condition to disable autosharding
for JRH
new b4a9a99 Fail jobs that would otherwise fall back to the default
implementation of GIB
new 4a10c01 Fix failed test; update checkArgument logs.
new b56b61a Merge pull request #13805 from [BEAM-10475] Add transform
translator for GroupIntoBatches in Java.
The 30470 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
runners/core-construction-java/build.gradle | 1 +
.../construction/GroupIntoBatchesTranslation.java | 100 ++++++++++++++
.../core/construction/PTransformTranslation.java | 5 +
.../GroupIntoBatchesTranslationTest.java | 106 +++++++++++++++
.../beam/runners/dataflow/DataflowRunner.java | 31 ++---
.../runners/dataflow/GroupIntoBatchesOverride.java | 5 +-
.../dataflow/DataflowPipelineTranslatorTest.java | 146 +++++++++++++++++----
.../beam/runners/dataflow/DataflowRunnerTest.java | 11 +-
.../beam/sdk/transforms/GroupIntoBatches.java | 66 ++++++----
9 files changed, 403 insertions(+), 68 deletions(-)
create mode 100644
runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/GroupIntoBatchesTranslation.java
create mode 100644
runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/GroupIntoBatchesTranslationTest.java
