[beam] branch nightly-refs/heads/master updated (f43789a -> 737be25)

2022-01-21 Thread github-bot
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from f43789a  Merge pull request #16514 from [BEAM-12164]: Add SDF for 
reading change stream records
 add 5d5ffad  Merge pull request #16540 from [BEAM-13678][Playground]Update 
Github Action To Deploy Examples
 add c54b4b3  Update GH Actions to use proper variables names and proper 
triggers
 add f850308  Merge pull request #16539 from [BEAM-13677][Playground]Update 
GitHub Actions to Build Playground Containers In Proper Way
 add 1d594f3  Merge pull request #16546 from [BEAM-13661] [BEAM-13704] 
[Playground] Update tags for examples/katas/unit-tests
 add a75ccc8  Merge pull request #16369 from [BEAM-13558] [Playground] Hide 
the Graph tab and SCIO from SDK options
 add 616f432  [BEAM-10206] Add key for fields in wrapper (#16583)
 add 2c5c4d8  Merge pull request #16530 from Adding JSON support in 
SpannerIO and Spanner schema parser
 add 6b26fbc  [BEAM-13687] Improved Spanner IO request count metrics
 add 29804a0  [BEAM-13687] Improved Spanner IO request count metrics
 add 737be25  [BEAM-13685] Enable users to specify cache directory under 
Interactive Beam options

No new revisions were added by this update.

Summary of changes:
 .github/workflows/build_playground_backend.yml | 52 -
 .github/workflows/build_playground_frontend.yml| 23 +++---
 .github/workflows/playground_deploy_examples.yml   | 27 +++
 .../apache/beam/examples/DebuggingWordCount.java   |  1 +
 .../org/apache/beam/examples/MinimalWordCount.java |  3 +-
 .../java/org/apache/beam/examples/WordCount.java   |  1 +
 .../apache/beam/examples/complete/TfIdfTest.java   |  1 -
 .../beam/examples/complete/game/GameStatsTest.java |  1 -
 .../examples/cookbook/DistinctExampleTest.java |  1 -
 .../commontransforms/aggregation/count/Task.java   |  1 -
 .../commontransforms/aggregation/max/Task.java |  1 -
 .../commontransforms/aggregation/mean/Task.java|  1 -
 .../commontransforms/aggregation/min/Task.java |  1 -
 .../commontransforms/aggregation/sum/Task.java |  1 -
 .../katas/commontransforms/filter/filter/Task.java |  1 -
 .../katas/commontransforms/filter/pardo/Task.java  |  1 -
 .../katas/commontransforms/withkeys/Task.java  |  1 -
 .../katas/coretransforms/branching/Task.java   |  1 -
 .../combine/binarycombinefnlambda/Task.java|  1 -
 .../combine/binarycombinefn/Task.java  |  1 -
 .../coretransforms/combine/combineperkey/Task.java |  1 -
 .../coretransforms/combine/combinefn/Task.java |  1 -
 .../katas/coretransforms/combine/simple/Task.java  |  1 -
 .../katas/coretransforms/composite/Task.java   |  1 -
 .../katas/coretransforms/flatten/Task.java |  1 -
 .../katas/coretransforms/groupbykey/Task.java  |  1 -
 .../coretransforms/map/flatmapelements/Task.java   |  1 -
 .../katas/coretransforms/map/mapelements/Task.java |  1 -
 .../coretransforms/map/pardoonetomany/Task.java|  1 -
 .../katas/coretransforms/map/pardo/Task.java   |  1 -
 .../katas/coretransforms/partition/Task.java   |  1 -
 .../katas/coretransforms/sideoutput/Task.java  |  1 -
 .../learning/katas/examples/wordcount/Task.java|  1 -
 .../beam/learning/katas/intro/hello/Task.java  |  2 +-
 .../learning/katas/windowing/fixedwindow/Task.java |  1 -
 .../Common Transforms/Aggregation/Count/task.py|  1 -
 .../Common Transforms/Aggregation/Largest/task.py  |  1 -
 .../Common Transforms/Aggregation/Mean/task.py |  1 -
 .../Common Transforms/Aggregation/Smallest/task.py |  1 -
 .../Common Transforms/Aggregation/Sum/task.py  |  1 -
 .../python/Common Transforms/Filter/Filter/task.py |  1 -
 .../python/Common Transforms/Filter/ParDo/task.py  |  1 -
 .../Common Transforms/WithKeys/WithKeys/task.py|  1 -
 .../Core Transforms/Branching/Branching/task.py|  1 -
 .../CoGroupByKey/CoGroupByKey/task.py  |  1 -
 .../Core Transforms/Combine/Combine PerKey/task.py |  1 -
 .../Core Transforms/Combine/CombineFn/task.py  |  1 -
 .../Combine/Simple Function/task.py|  1 -
 .../Composite Transform/task.py|  1 -
 .../python/Core Transforms/Flatten/Flatten/task.py |  1 -
 .../Core Transforms/GroupByKey/GroupByKey/task.py  |  1 -
 .../python/Core Transforms/Map/FlatMap/task.py |  1 -
 .../katas/python/Core Transforms/Map/Map/task.py   |  1 -
 .../Core Transforms/Map/ParDo OneToMany/task.py|  1 -
 .../katas/python/Core Transforms/Map/ParDo/task.py |  1 -
 .../Core Transforms/Partition/Partition/task.py|  1 -
 .../Core Transforms/Side Input/Side Input/task.py  |  1 -
 .../Side Output/Side Output/task.py|  1 -
 .../python/Examples/Word Count/Word Count/task.py  |  1 -
 .../Introduction/Hello Beam/Hello Beam/task.py |  2 +-
 .../Windowing/Adding Timesta

[beam] branch master updated (29804a0 -> 737be25)

2022-01-21 Thread ningk
This is an automated email from the ASF dual-hosted git repository.

ningk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 29804a0  [BEAM-13687] Improved Spanner IO request count metrics
 add 737be25  [BEAM-13685] Enable users to specify cache directory under 
Interactive Beam options

No new revisions were added by this update.

Summary of changes:
 .../runners/interactive/background_caching_job.py  |  9 +++-
 .../runners/interactive/cache_manager.py   |  1 +
 .../runners/interactive/cache_manager_test.py  | 50 
 .../runners/interactive/caching/streaming_cache.py |  1 +
 .../interactive/caching/streaming_cache_test.py| 53 ++
 .../runners/interactive/interactive_beam.py| 27 +++
 .../runners/interactive/interactive_environment.py | 15 --
 .../interactive/options/interactive_options.py |  1 +
 8 files changed, 152 insertions(+), 5 deletions(-)


[beam] branch master updated (2c5c4d8 -> 29804a0)

2022-01-21 Thread ningk
This is an automated email from the ASF dual-hosted git repository.

ningk pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 2c5c4d8  Merge pull request #16530 from Adding JSON support in 
SpannerIO and Spanner schema parser
 add 6b26fbc  [BEAM-13687] Improved Spanner IO request count metrics
 add 29804a0  [BEAM-13687] Improved Spanner IO request count metrics

No new revisions were added by this update.

Summary of changes:
 .../beam/sdk/io/gcp/spanner/BatchSpannerRead.java   | 11 ---
 .../org/apache/beam/sdk/io/gcp/spanner/SpannerIO.java   | 17 +++--
 2 files changed, 19 insertions(+), 9 deletions(-)


[beam] branch master updated (616f432 -> 2c5c4d8)

2022-01-21 Thread pabloem
This is an automated email from the ASF dual-hosted git repository.

pabloem pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 616f432  [BEAM-10206] Add key for fields in wrapper (#16583)
 add 2c5c4d8  Merge pull request #16530 from Adding JSON support in 
SpannerIO and Spanner schema parser

No new revisions were added by this update.

Summary of changes:
 .../beam/sdk/io/gcp/spanner/MutationSizeEstimator.java | 12 +++-
 .../apache/beam/sdk/io/gcp/spanner/SpannerSchema.java  |  3 +++
 .../sdk/io/gcp/spanner/MutationSizeEstimatorTest.java  | 18 ++
 .../beam/sdk/io/gcp/spanner/SpannerSchemaTest.java |  5 -
 4 files changed, 36 insertions(+), 2 deletions(-)


[beam] branch release-2.36.0 updated (d5d0bc3 -> a1f3f86)

2022-01-21 Thread emilyye
This is an automated email from the ASF dual-hosted git repository.

emilyye pushed a change to branch release-2.36.0
in repository https://gitbox.apache.org/repos/asf/beam.git.


from d5d0bc3  Merge pull request #16462 from ihji/cherry-pick-13599
 new 28ea3f8  Moving to 2.37.0-SNAPSHOT on master branch.
 new 12fbe03  Release website update for Beam 2.35.0 (#16115)
 new 0af3689  [BEAM-13430] Re-enable checkerframework for the project 
excluding the two classes it started to crash on. (#16389)
 new e2189b3  [adhoc] Use predefined min/max combiners in SQS reader to 
gather stats
 new d8784ac  Merge pull request #16390: [adhoc] Use predefined min/max 
combiners in SQS reader to gather stats
 new 52715c0  [BEAM-13009] Fix tests to ensure absence of duplicates only 
per request to avoid issues when running with low targetParellelism
 new fe456b7  Merge pull request #16367: [BEAM-13009] Fix tests to ensure 
absence of duplicates only per request
 new df26931  [BEAM-13430] Fix class not found error for example 
integration tests and dataflow postcommit (#16388)
 new eaacf70  [BEAM-13430] Re-enable dependency analysis for modules. 
(#16395)
 new 3a74728  Fix class not found in perf integration tests.
 new 598f444  Update 
buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
 new 2a9e8b6  Merge pull request #16398 from y1chi/perf-it
 new e55f54e  [BEAM-13484][Playground] Improve Terraform Scripts For Deploy 
Infrastructure (#16378)
 new 3ab26ce  [BEAM-13541] More intelligent caching of CoGBK values. 
(#16354)
 new 0e69485  Merge pull request #15769 from [BEAM-13031] [Playground] Code 
editor - Support Localization
 new 503adc0  [BEAM-13555] playground - quick fix for safari
 new 304680d  Merge pull request #16362 from [BEAM-13555] [Bugfix] 
[Playground] change html renderer for safari to fix freezes
 new bbcfa4f  [BEAM-13541] Fix spotbugs issue with DLS in tail (#16407)
 new b9e8a78  [BEAM-13588] Add missing module for PVR tests and also 
sickbay known broken test. (#16408)
 new fdbb90b  [BEAM-13575] Sickbay test that is flaky to restore precommit 
test signal (#16410)
 new 34118c6  [BEAM-12092] Bump jedis to version 3.8.0 (#16403)
 new 7487bf0  [BEAM-13498, BEAM-13522] Sickbay broken test and test 
category for Spark (#16411)
 new df8b83b  [BEAM-13587] Attempt to load AWS region from default provider 
chain in AwsOptions
 new 2cd5013  Merge pull request #16405: [BEAM-13587] Attempt to load AWS 
region from default provider chain in AwsOptions
 new 0fd6504  [BEAM-13509] Stop sharing SQS client between readers of same 
source.
 new c4fc398  Merge pull request #16368: [BEAM-13509] Stop sharing SQS 
client between readers of same source.
 new 17b62ad  Merge pull request #16404: [BEAM-13586] Fix NPE in 
DefaultS3ClientBuilderFactory
 new 36ce02b  [BEAM-13480] Sickbay 
PubSubIntegrationTest.test_streaming_data_only on Dataflow (#16255)
 new 3d272e7  Fix sdk_container_builder too many values to unpack error
 new 1636a3a  Merge pull request #16417 from y1chi/python_val
 new 43a17a3  [BEAM-13430] Swap to use "mainClass" instead of "main" since 
it was deprecated. (#16400)
 new e6c73b4  [BEAM-13430] Replace deprecated "appendix" with 
"archiveAppendix" (#16401)
 new 061533c  [BEAM-13591] Bump log4j2 version to 2.17.1
 new 5a11778  Merge pull request #16415 from deadwind4/BEAM-13591
 new 122ae34  [BEAM-13015] Add jamm as a java agent to the Java SDK harness 
container (#16412)
 new 2d4a17c  [BEAM-13430] Partially revert 
https://github.com/apache/beam/commit/eaacf709a861ea1c260e3856b720266348b1aecc 
(#16419)
 new 7b5c4cd  [BEAM-12391] update avro sink to close the opened file 
handle, instead of getting it by reference from the writer. This ensures that 
when we load the python writer implementation we don't run into an attribute 
error
 new f63451e  Merge pull request #16246: [BEAM-12391] update avro sink to 
close the opened file handle directly
 new 6045ee1  [BEAM-13482] Python fully qualified name external transforms.
 new d13c21f  Add Python expansion service entry point.
 new 0c2f5a5  Merge pull request #16266 [BEAM-13482] Python fully qualified 
name external transforms.
 new 818428f  Merge pull request #15863 from [BEAM-13184] Autosharding for 
JdbcIO.write* transforms
 new 9d2fcf3  Add Flink runner support for OrderedListState. This version 
reads the list entirely into memory, so will not work well for large lists.
 new b1341bc  Merge pull request #15984: [BEAM-2791] OrderedListState for 
Flink
 new 3220631  [BEAM-11936] Enable FloatingPointAssertionWithinEpsilon 
errorprone check (#16261)
 new 9973c4f  [BEAM-11936] Enable LockNotBeforeTry errorprone check (#16259)
 new 7eeffe0  [BEAM-11936] Enable errorprone unused checks (#16262)
 new 6b68536  Add Nexmark Query 14 (#16337)
 new 83e9218  [BEAM-13569

[beam] branch master updated (a75ccc8 -> 616f432)

2022-01-21 Thread lostluck
This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from a75ccc8  Merge pull request #16369 from [BEAM-13558] [Playground] Hide 
the Graph tab and SCIO from SDK options
 add 616f432  [BEAM-10206] Add key for fields in wrapper (#16583)

No new revisions were added by this update.

Summary of changes:
 sdks/go/pkg/beam/runners/universal/runnerlib/stage.go | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)