This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 05699c3 (commit)
to e542d1f (commit)
from 05699c3 [BEAM-12590] Automatically upgrading Dataflow Python
pipelines that use cross-language transforms to Runner v2 (#15079)
add f9b9ccc Merge pull request #14869 from [BEAM-12357] improve WithKeys
transform to take args, kwargs
add 410cad1 Generalize S3FileSystem to support multiple URI schemes.
add 5e26d3b Merge pull request #15036: [BEAM-12435] Generalize
S3FileSystem to support multiple URI schemes.
add bc742c8 [BEAM-12597] Add AppendingTransformer for reference.conf in
shade
add b97fe93 Merge pull request #15159: [BEAM-12597] Add
AppendingTransformer for reference.conf in shade
add b7201a9 [BEAM-11434]Make SpannerAccessor public (#13641)
add 3f9e1f3 [BEAM-12604] Do not expose Zookeeper client port in Kafka k8s
config
add f22868c Merge pull request #15164 from ihji/BEAM-12604
add f233725 Update Beam Go row coder to more completely handle schema
interfaces (#15154)
add 9215aea Fix broken package substitution in starter archetype
add f93a930 Merge pull request #15080 from
shabbyrobe/fix/starter-archetype-package
add e542d1f [BEAM-12556] Enable Go Build Tests in Samza Runner (#15167)
No new revisions were added by this update.
Summary of changes:
.github/PULL_REQUEST_TEMPLATE.md | 6 +-
.test-infra/jenkins/README.md | 1 +
...job_PostCommit_Go_ValidatesRunner_Samza.groovy} | 10 +-
.../kafka-cluster/03-zookeeper/30service.yml | 1 -
.../kafka-cluster/05-kafka/configmap-config.yaml | 6 +-
CHANGES.md | 1 +
README.md | 2 +-
.../beam/runners/samza/SamzaJobServerDriver.java | 5 +-
sdks/go/pkg/beam/core/graph/coder/iterable.go | 24 +-
sdks/go/pkg/beam/core/graph/coder/iterable_test.go | 6 +-
sdks/go/pkg/beam/core/graph/coder/map.go | 64 ++-
sdks/go/pkg/beam/core/graph/coder/map_test.go | 4 +-
sdks/go/pkg/beam/core/graph/coder/row_decoder.go | 125 +++--
sdks/go/pkg/beam/core/graph/coder/row_encoder.go | 130 +++--
sdks/go/pkg/beam/core/graph/coder/row_test.go | 219 ++++++++
.../runners/{flink/flink.go => samza/samza.go} | 10 +-
sdks/go/pkg/beam/x/beamx/run.go | 1 +
sdks/go/test/build.gradle | 25 +-
sdks/go/test/integration/integration.go | 8 +
.../test/integration/io/xlang/kafka/kafka_test.go | 1 +
.../test/integration/primitives/primitives_test.go | 1 +
.../test/integration/synthetic/synthetic_test.go | 1 +
.../test/integration/wordcount/wordcount_test.go | 1 +
sdks/go/test/integration/xlang/xlang_test.go | 1 +
sdks/go/test/regression/lperror_test.go | 1 +
sdks/go/test/regression/pardo_test.go | 1 +
sdks/go/test/run_validatesrunner_tests.sh | 14 +-
...ava => DefaultS3FileSystemSchemeRegistrar.java} | 13 +-
.../apache/beam/sdk/io/aws/s3/S3FileSystem.java | 63 +--
.../sdk/io/aws/s3/S3FileSystemConfiguration.java | 118 +++++
.../beam/sdk/io/aws/s3/S3FileSystemRegistrar.java | 24 +-
.../io/aws/s3/S3FileSystemSchemeRegistrar.java} | 22 +-
.../io/aws/s3/S3ReadableSeekableByteChannel.java | 11 +-
.../apache/beam/sdk/io/aws/s3/S3ResourceId.java | 60 ++-
.../beam/sdk/io/aws/s3/S3WritableByteChannel.java | 35 +-
.../beam/sdk/io/aws/s3/S3FileSystemTest.java | 573 +++++++++++++++++++--
.../beam/sdk/io/aws/s3/S3ResourceIdTest.java | 83 ++-
.../org/apache/beam/sdk/io/aws/s3/S3TestUtils.java | 71 ++-
.../sdk/io/aws/s3/S3WritableByteChannelTest.java | 86 +++-
.../beam/sdk/io/gcp/spanner/SpannerAccessor.java | 4 +-
.../apache/beam/sdk/io/gcp/GcpApiSurfaceTest.java | 11 +
.../src/main/resources/archetype-resources/pom.xml | 3 +
.../src/main/resources/archetype-resources/pom.xml | 3 +
.../src/main/java/StarterPipeline.java | 4 +-
sdks/python/apache_beam/pvalue.py | 1 +
sdks/python/apache_beam/transforms/core.py | 16 +-
sdks/python/apache_beam/transforms/util.py | 32 +-
sdks/python/apache_beam/transforms/util_test.py | 26 +
48 files changed, 1603 insertions(+), 325 deletions(-)
copy .test-infra/jenkins/{job_PostCommit_Go_ValidatesRunner_Spark.groovy =>
job_PostCommit_Go_ValidatesRunner_Samza.groovy} (83%)
copy sdks/go/pkg/beam/runners/{flink/flink.go => samza/samza.go} (84%)
copy
sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/{S3FileSystemRegistrar.java
=> DefaultS3FileSystemSchemeRegistrar.java} (77%)
create mode 100644
sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/S3FileSystemConfiguration.java
copy
sdks/java/{core/src/main/java/org/apache/beam/sdk/io/FileSystemRegistrar.java
=>
io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/S3FileSystemSchemeRegistrar.java}
(59%)
