date:20230119

[beam] 01/01: Merge pull request #24145: Handle updates to table schema when using Storage API writes.

2023-01-19 Thread reuvenlax

This is an automated email from the ASF dual-hosted git repository.

reuvenlax pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit f5020e7ac2bdd3363619aafbf257f2ebf8e3fe2b
Merge: 428ec97e30c 7ad44c84585
Author: Reuven Lax 
AuthorDate: Thu Jan 19 23:53:33 2023 -0800

Merge pull request #24145: Handle updates to table schema when using 
Storage API writes.

 .../beam/sdk/io/gcp/bigquery/AppendClientInfo.java | 115 +--
 .../beam/sdk/io/gcp/bigquery/BigQueryIO.java   |  18 +-
 .../beam/sdk/io/gcp/bigquery/BigQueryServices.java |   8 +
 .../sdk/io/gcp/bigquery/BigQueryServicesImpl.java  |  11 ++
 .../beam/sdk/io/gcp/bigquery/BigQueryUtils.java|  29 ---
 .../sdk/io/gcp/bigquery/SplittingIterable.java |  61 +-
 .../bigquery/StorageApiDynamicDestinations.java|   2 +
 .../StorageApiDynamicDestinationsBeamRow.java  |   8 +-
 .../StorageApiDynamicDestinationsTableRow.java |  24 ++-
 .../beam/sdk/io/gcp/bigquery/StorageApiLoads.java  |  20 +-
 .../io/gcp/bigquery/StorageApiWritePayload.java|  25 ++-
 .../StorageApiWriteRecordsInconsistent.java|  12 +-
 .../bigquery/StorageApiWriteUnshardedRecords.java  | 146 +++---
 .../bigquery/StorageApiWritesShardedRecords.java   | 173 +++--
 .../io/gcp/bigquery/TableRowToStorageApiProto.java | 110 +--
 .../sdk/io/gcp/testing/FakeDatasetService.java |  63 +-
 .../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java   | 216 +
 .../bigquery/TableRowToStorageApiProtoTest.java|  95 -
 18 files changed, 958 insertions(+), 178 deletions(-)

[beam] branch master updated (428ec97e30c -> f5020e7ac2b)

2023-01-19 Thread reuvenlax

This is an automated email from the ASF dual-hosted git repository.

reuvenlax pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 428ec97e30c improve error message for mismatched pipelines (#24834)
 add 7ad44c84585 Handle schema updates in Storage API writes.
 new f5020e7ac2b Merge pull request #24145: Handle updates to table schema 
when using Storage API writes.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../beam/sdk/io/gcp/bigquery/AppendClientInfo.java | 115 +--
 .../beam/sdk/io/gcp/bigquery/BigQueryIO.java   |  18 +-
 .../beam/sdk/io/gcp/bigquery/BigQueryServices.java |   8 +
 .../sdk/io/gcp/bigquery/BigQueryServicesImpl.java  |  11 ++
 .../beam/sdk/io/gcp/bigquery/BigQueryUtils.java|  29 ---
 .../sdk/io/gcp/bigquery/SplittingIterable.java |  61 +-
 .../bigquery/StorageApiDynamicDestinations.java|   2 +
 .../StorageApiDynamicDestinationsBeamRow.java  |   8 +-
 .../StorageApiDynamicDestinationsTableRow.java |  24 ++-
 .../beam/sdk/io/gcp/bigquery/StorageApiLoads.java  |  20 +-
 .../io/gcp/bigquery/StorageApiWritePayload.java|  25 ++-
 .../StorageApiWriteRecordsInconsistent.java|  12 +-
 .../bigquery/StorageApiWriteUnshardedRecords.java  | 146 +++---
 .../bigquery/StorageApiWritesShardedRecords.java   | 173 +++--
 .../io/gcp/bigquery/TableRowToStorageApiProto.java | 110 +--
 .../sdk/io/gcp/testing/FakeDatasetService.java |  63 +-
 .../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java   | 216 +
 .../bigquery/TableRowToStorageApiProtoTest.java|  95 -
 18 files changed, 958 insertions(+), 178 deletions(-)

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 1a646ebfc26 Updating config from bot
1a646ebfc26 is described below

commit 1a646ebfc26f8856a86a39738e6bf4e4abee3ac1
Author: github-actions 
AuthorDate: Fri Jan 20 04:36:35 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index 19ed3c7488a..451f9fda0ee 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -4,7 +4,7 @@
 "lostluck": 1673948119348,
 "jrmccluskey": 1674155354299,
 "youngoli": 1657688896155,
-"damccorm": 1673845573921,
+"damccorm": 1674189390457,
 "riteshghorse": 1674103014589
   }
 }
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 4508e10a28e Updating config from bot
4508e10a28e is described below

commit 4508e10a28e2fff758e3ec1bb91c5edc5b283547
Author: github-actions 
AuthorDate: Fri Jan 20 04:36:32 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25095.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25095.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25095.json
new file mode 100644
index 000..2deda2c6f85
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25095.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"go": "damccorm"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch nightly-refs/heads/master updated (482c3107674 -> 428ec97e30c)

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 482c3107674 Merge pull request #25047: Properly synchronize pins
 add d9d322b5697 enabling public construction of typed schematransforms 
(#25010)
 add 55d8ecb2584 Add explicit error for PEP 585 type hints (#24986)
 add 9f423925e0e Updated Python Container Dependencies (#25042)
 add e9180b4 [ToB][Frontend] Display hints and solutions (#25020)
 add aba17525994 upgrade clickhouse jdbc driver 0.3.2-patch10 (#24424)
 add 312cbbde8ff Added documentation for SingleStoreIO (#24377)
 add d69dbd8b852 Adding watermark support to DebeziumIO transform (#24757)
 add f2594c6ecd5 Moving to 2.46.0-SNAPSHOT on master branch.
 add b5540403732 Fix typo in join explanation (#25049)
 add 6f87445a88b Add withDefaultHeaders to connection configuration for 
ElasticsearchIO
 add de21be6e180 Address PR comments, run spotless
 add a05a9c0d07a Fix copy/paste error in Javadoc, add example for usage of 
withDefaultHeaders
 add b50b801c442 Merge pull request #25024 from EgbertW/master
 add 3b23290c4a3 Fix error message (add proper spacing) (#25050)
 add 95874a70e70 Remove trailing whitespace from blog to fix precommit 
(#25055)
 add 187ba474fdb improve some errors from DoFnSignature (#25001)
 add 69a131341c5 Bump torch (#24977)
 add aa8dc4fab7e Set maxConnections optional in incoming schema for 
JdbcSchemaIOProvider (#25062)
 add 6daa6f41017 Document that yield and return shouldn't be mixed. (#25060)
 add 13a740b0091 [#25070] Remove Kafka jars from Beam Java SDK Container 
(#25072)
 add 1c4e4241c2a [Playground][Frontend] Run timer fix; CodeRunner and 
OutputType extraction. (#24871)
 add 876ce5bcafc Merge pull request #25073: Improves StorageWrite API error 
logging
 add 60a9382a67f Bump google.golang.org/api from 0.107.0 to 0.108.0 in 
/sdks (#25075)
 add 80d8d348a39 [Python] Fix input type for num_bytes (#25086)
 add 651773129bc Add Pyarrow support to Batched DoFn documentation (#23956)
 add 3e1291ca3c1 Tour of beam learning materials CI/CD refactoring and 
templating (#25080)
 add 6203e58919e Add support for using builtins typing (#25054)
 add 641b556958d Bump cloud.google.com/go/spanner from 1.42.0 to 1.43.0 in 
/sdks (#25090)
 add a99364cd7cf Increase timeout on 
test_dynamic_timer_clear_then_set_timer (#25009)
 add 76813c11372 Bump torch (#25089)
 add 148730e4ac5 Bump timeout for beam_PostCommit_Python_Examples_Dataflow 
to 3h (#25092)
 add fafeaa989a7 Add unit test to cover non built-in GenericAlias types 
(#25091)
 add 6b42bda1d06 [Website] update content of community case study page 
(#25023)
 add 1d4345a3434 Eliminate google-python-cloud-debugger dependency in 
base_image_requirements (#25088)
 add c1b840ae284 Bump httplib2 upper bound to 0.22.0. (#24573)
 add 428ec97e30c improve error message for mismatched pipelines (#24834)

No new revisions were added by this update.

Summary of changes:
 .../job_PostCommit_Python_Examples_Dataflow.groovy |   2 +-
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |   4 +-
 gradle.properties  |   4 +-
 .../backend/internal/fs_content/load.go| 156 ++--
 .../backend/internal/fs_content/load_test.go   |  67 
 .../samples/learning-content/content-info.yaml |   6 +
 .../learning-content/java/content-info.yaml|   4 -
 .../{python => }/module 1/group/group-info.yaml|   2 +
 .../group}/unit-challenge/description.md   |   0
 .../group}/unit-challenge/hint1.md |   0
 .../group}/unit-challenge/hint2.md |   0
 .../group}/unit-challenge/unit-info.yaml   |   2 +
 .../group}/unit-example/unit-info.yaml |   2 +
 .../module 1/intro-unit/unit-info.yaml |   2 +
 .../{java => }/module 1/module-info.yaml   |   6 +
 .../unit-challenge/description.md  |   0
 .../module 2 => module 1}/unit-challenge/hint1.md  |   0
 .../module 2 => module 1}/unit-challenge/hint2.md  |   0
 .../unit-challenge/unit-info.yaml  |   2 +
 .../group => module 1}/unit-example/unit-info.yaml |   2 +
 .../{java => }/module 2/module-info.yaml   |   2 +
 .../unit-challenge/description.md  |   0
 .../group => module 2}/unit-challenge/hint1.md |   0
 .../group => module 2}/unit-challenge/hint2.md |   0
 .../module 2/unit-challenge/unit-info.yaml |   2 +
 .../module 2/unit-example/unit-info.yaml   |   2 +
 .../learning-content/python/content-info.yaml  |   3 -
 .../python/module 1/module-info.yaml   |   7 -
 learning/tour-of-beam/frontend/assets/svg/hint.svg |  19 +
 .../tour-of-beam/frontend/assets/svg/solution.svg  |  20 +

[beam] branch dependabot/go_modules/sdks/cloud.google.com/go/storage-1.29.0 created (now ceb8607435a)

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/cloud.google.com/go/storage-1.29.0
in repository https://gitbox.apache.org/repos/asf/beam.git


  at ceb8607435a Bump cloud.google.com/go/storage from 1.28.1 to 1.29.0 in 
/sdks

No new revisions were added by this update.

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 512e0eb0f4c Updating config from bot
512e0eb0f4c is described below

commit 512e0eb0f4c42e92f9ff9acfe04a92f8b4ad3022
Author: github-actions 
AuthorDate: Fri Jan 20 03:59:03 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25094.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25094.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25094.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25094.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch tvalentyn-patch-3 updated (0fa965c68c6 -> 18075f5c2e0)

2023-01-19 Thread tvalentyn

This is an automated email from the ASF dual-hosted git repository.

tvalentyn pushed a change to branch tvalentyn-patch-3
in repository https://gitbox.apache.org/repos/asf/beam.git


omit 0fa965c68c6 Monkeypatch numpy instead.
omit 4b066adf0ac Update versions of numpy
omit 13c1feb15b3 Add a note.
omit 5f0181b0359 Replace the entire method with the working implementation..
omit cc8a798e85b Work around TRT incompatibility due to numpy/numpy#22607.
omit b4dd483ddf0 Add lower bound for tests
omit dac7a7b8e66 Update upper bound for numpy.
 add 93cc031aedb Bump qs from 6.5.2 to 6.5.3 in 
/sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel
 (#24545)
 add 606f52b023d Bump github.com/aws/aws-sdk-go-v2/config from 1.18.5 to 
1.18.6 in /sdks (#24714)
 add 4d1c43ba9ab [24664] Fix 
ProcessBundleBenchmarkTest.testStateWithCaching (#24669)
 add 0290315623d flaky -> flake (#24732)
 add 8dab5dcb3ce Support writing to BQ via Storage Write API with 
SchemaTransforms (#23988)
 add 310c5240828 Add some alphabet companies that make heavy use of Beam. 
(#24719)
 add 246c20cff16 [BigQueryIO] Pick provided schema if existing table has 
null schema (#24699)
 add 256433fbc57 Fix link to videos-and-podcasts page. (#24733)
 add e1587f8e8df DebeziumIO schema transform (#24629)
 add 62e5e58fd8d jamm on -javaagent instead of classpath
 add fde81f815cc Merge pull request #24738: jamm on -javaagent instead of 
classpath
 add 17cc0dcfa60 Bump actions/setup-java from 3.6.0 to 3.8.0 (#24559)
 add d6391231053 Fix some typos (#24736)
 add f30ad44761b Adding Setup python to Dataflow job in Java Tests (#24712)
 add 2b746d1d217 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in 
/sdks (#24740)
 add 642a16f9a61 Add a couple of well-known Google properties that use Beam 
extensively.
 add cef0cf74aba Merge pull request #24718 Add a couple of well-known 
Google properties that use Beam extensively.
 add 0917978677f Refactor focusing to contextLine (#24674)
 add b757ad035b9 Support SqlTypes Date in AvroUtils (#24756)
 add cb31ea2efcc Fix SingleStoreIO performance test job (#24753)
 add b877a6680ca Fix a small wrong url link in notebook (#24746)
 add 3b9ab77ef90 Exclude MultimapState related tests in Dataflow legacy 
worker validates runner tests (#24758)
 add ce5fcac379f [Website] delete 404 links #24745 (#24744)
 add 4764f0e2043 [Website] update links with 404 status code
 add 3f67b2c0769 Merge pull request #24635: [Website] update links with 404 
status code
 add f80ac005bfd [Release Tasks Migration] - Git Tag Workflow (#24418)
 add 46c77783b1e Fix POM of beam-sdks-java-core (closes #24675)
 add eb23b0a123e Merge pull request #24760: Fix POM of beam-sdks-java-core
 add 94c6212a38f Change Point Analysis (#23931)
 add 97d96558e23 change examples to licensed ones with mentions of autors 
and licenses (#24762)
 add 9810ff82b75 Implement PubsubWriteSchemaTransformProvider (#24443)
 add 28afd035271 [CdapIO] Complete examples for CDAP Hubspot plugins  
(#24568)
 add 2b6d9dcb425 Fix Permission denied error build beam locally (#24766)
 add baa8910694c fix typo: UnmarshallWindowFn should be UnmarshalWindowFn 
(#24771)
 add 820839fe86b Remove slow review label after processing commands to 
avoid race (#24765)
 add d72fdecfa3f [BigQueryIO] Don't update schema of destination table when 
no schema is provided (#24700)
 add ffdd8d47b78 [Playground] Python multifile examples (#24751)
 add 59946441269 [CdapIO] Complete examples for CDAP Salesforce plugins 
(#24567)
 add 44c9d0278c0 Make go vet and go staticcheck output visible in CI 
(#24786)
 add 96f4391cc61 [Go SDK] Fix multimap support for the direct runner 
(#24775)
 add bcfdb7b63cd [#24515] Ensure that Go pipelines on Dataflow are not 
allowed to opt out of runner v2. (#24767)
 add 07b4329b986 Update Java portable container for Dataflow (#24791)
 add 46a12bf423d [BigQuery] Extend timestamp precision to microseconds when 
writing with Beam Rows (Storage API) (#24784)
 add e28f6f79f2b [Spark Dataset runner] Trigger evaluation using write noop 
rather than using foreach (closes #24797) (#24565)
 add a43b834681f [Website] update check links, catch prod & staging links
 add 994f733a409 Merge pull request #1: [Website] update check-links
 add 873e0d0978d [#24292] Create Avro extension for Java SDK
 add 8b532db7db0 Address the review comments
 add 150877e6494 Apply #24454 changes
 add bab773fdcf1 Merge pull request #24294: Create Avro extension for Java 
SDK
 add 04694d8c886 Install sklearn < 1.20.0 for sklearn postcommit tests 
(#24788)
 add 645bf35056d [Spark Dataset runner] Skip unconsumed additional outputs 
of ParDo.MultiOutput to avoid caching if not necessary (resolves #24710) 
(#24711)
 add 1e763ad6d18 [Go SDK]: MongoDB IO

[beam] branch master updated: improve error message for mismatched pipelines (#24834)

2023-01-19 Thread tvalentyn

This is an automated email from the ASF dual-hosted git repository.

tvalentyn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 428ec97e30c improve error message for mismatched pipelines (#24834)
428ec97e30c is described below

commit 428ec97e30cc6587c2ae0f81d3ba44a8a9b34f93
Author: ZhengLin Li <63448884+zhenglin...@users.noreply.github.com>
AuthorDate: Thu Jan 19 16:53:30 2023 -0800

improve error message for mismatched pipelines (#24834)

Co-authored-by: tvalentyn 
---
 sdks/python/apache_beam/transforms/util.py | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/sdks/python/apache_beam/transforms/util.py 
b/sdks/python/apache_beam/transforms/util.py
index 5f99d680546..868dbe1361b 100644
--- a/sdks/python/apache_beam/transforms/util.py
+++ b/sdks/python/apache_beam/transforms/util.py
@@ -234,7 +234,8 @@ class _CoGBKImpl(PTransform):
 for pcoll in pcolls.values():
   self._check_pcollection(pcoll)
   if self.pipeline:
-assert pcoll.pipeline == self.pipeline
+assert pcoll.pipeline == self.pipeline, (
+'All input PCollections must belong to the same pipeline.')
 
 tags = list(pcolls.keys())

[beam-starter-typescript] branch dependabot/npm_and_yarn/typescript-4.9.4 updated (d093159 -> c9556f8)

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch dependabot/npm_and_yarn/typescript-4.9.4
in repository https://gitbox.apache.org/repos/asf/beam-starter-typescript.git


 discard d093159  Bump typescript from 4.7.3 to 4.9.4
 add e5d0b68  Fix typo in readme.
 add c418595  Use published apache-beam npm.
 add c9556f8  Bump typescript from 4.7.3 to 4.9.4

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (d093159)
\
 N -- N -- N   refs/heads/dependabot/npm_and_yarn/typescript-4.9.4 
(c9556f8)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 README.md |  4 ++--
 package-lock.json | 13 +++--
 package.json  |  2 +-
 3 files changed, 10 insertions(+), 9 deletions(-)

[beam-starter-typescript] branch main updated (e5d0b68 -> c418595)

2023-01-19 Thread robertwb

This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/beam-starter-typescript.git


from e5d0b68  Fix typo in readme.
 add c418595  Use published apache-beam npm.

No new revisions were added by this update.

Summary of changes:
 package-lock.json | 13 +++--
 package.json  |  2 +-
 2 files changed, 8 insertions(+), 7 deletions(-)

[beam-starter-typescript] branch main updated: Fix typo in readme.

2023-01-19 Thread robertwb

This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/beam-starter-typescript.git


The following commit(s) were added to refs/heads/main by this push:
 new e5d0b68  Fix typo in readme.
e5d0b68 is described below

commit e5d0b68f03477d1a946b8c92a627a8fc191f2c1a
Author: Robert Bradshaw 
AuthorDate: Thu Jan 19 16:13:55 2023 -0800

Fix typo in readme.
---
 README.md | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/README.md b/README.md
index 2be..da60dc5 100644
--- a/README.md
+++ b/README.md
@@ -51,9 +51,9 @@ To run this pipeline on another runner, simply set the 
`--runner` flag
 (along with any other parameters it requires).
 For example, to run on Flink you can execute the pipeline as
 
-sh
+```sh
 node dist/src/main.js --runner=flink [--flinkMaster=...]
-``
+```
 
 or to run it on dataflow execute the pipeline as

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 2d95bcdf583 Updating config from bot
2d95bcdf583 is described below

commit 2d95bcdf5838fbdb2da5dcdbdb018be7f7a09f99
Author: github-actions 
AuthorDate: Fri Jan 20 00:01:13 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25083.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25083.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25083.json
index 321b31c0f05..1854ee764c2 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-25083.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25083.json
@@ -4,7 +4,7 @@
 "python": "tvalentyn"
   },
   "nextAction": "Reviewers",
-  "stopReviewerNotifications": false,
+  "stopReviewerNotifications": true,
   "remindAfterTestsPass": [],
   "committerAssigned": false
 }
\ No newline at end of file

[beam] branch master updated: Bump httplib2 upper bound to 0.22.0. (#24573)

2023-01-19 Thread tvalentyn

This is an automated email from the ASF dual-hosted git repository.

tvalentyn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new c1b840ae284 Bump httplib2 upper bound to 0.22.0. (#24573)
c1b840ae284 is described below

commit c1b840ae2844a1a2202a7e16656ae8a2cf55d3b6
Author: Theodore Ni <3806110+t...@users.noreply.github.com>
AuthorDate: Thu Jan 19 15:25:14 2023 -0800

Bump httplib2 upper bound to 0.22.0. (#24573)

Closes https://github.com/apache/beam/issues/19929
---
 sdks/python/setup.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/sdks/python/setup.py b/sdks/python/setup.py
index f55b66f4005..45668104124 100644
--- a/sdks/python/setup.py
+++ b/sdks/python/setup.py
@@ -245,7 +245,7 @@ if __name__ == '__main__':
 'fasteners>=0.3,<1.0',
 'grpcio>=1.33.1,!=1.48.0,<2',
 'hdfs>=2.1.0,<3.0.0',
-'httplib2>=0.8,<0.21.0',
+'httplib2>=0.8,<0.22.0',
 'numpy>=1.14.3,<1.23.0',
 'objsize>=0.6.1,<0.7.0',
 'pymongo>=3.8.0,<4.0.0',

[beam] branch master updated: Eliminate google-python-cloud-debugger dependency in base_image_requirements (#25088)

2023-01-19 Thread yhu

This is an automated email from the ASF dual-hosted git repository.

yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 1d4345a3434 Eliminate google-python-cloud-debugger dependency in 
base_image_requirements (#25088)
1d4345a3434 is described below

commit 1d4345a3434acc3a78c12376f36fc8df87437221
Author: Yi Hu 
AuthorDate: Thu Jan 19 17:37:43 2023 -0500

Eliminate google-python-cloud-debugger dependency in 
base_image_requirements (#25088)
---
 sdks/python/container/base_image_requirements_manual.txt | 7 +++
 1 file changed, 3 insertions(+), 4 deletions(-)

diff --git a/sdks/python/container/base_image_requirements_manual.txt 
b/sdks/python/container/base_image_requirements_manual.txt
index fd311d8bb03..b3612fa6af3 100644
--- a/sdks/python/container/base_image_requirements_manual.txt
+++ b/sdks/python/container/base_image_requirements_manual.txt
@@ -29,18 +29,17 @@ bs4  # Commonly used HTML processing tool.
 # to upgrade. Use 0.xx for now.
 cython<1
 # future is no longer a Beam dependency, but is an implicit dependency in
-# some versions of libraries that lauch Beam pipelines, like 
tensorflow-transform.
+# some versions of libraries that launch Beam pipelines, like 
tensorflow-transform.
 # Leaving 'future' in our containers for now prevent breaking tft users.
 future
 # TODO: Remove the upper bound once Tensorflow 2.11 is released.
 # https://github.com/apache/beam/issues/23355
 google-cloud-profiler<4.0.0
-google-python-cloud-debugger;python_version<="3.9"
 guppy3  # Memory profiler
-mmh3  # Optimzes execution of some Beam codepaths. TODO: Make it Beam's 
dependency.
+mmh3  # Optimizes execution of some Beam codepaths. TODO: Make it Beam's 
dependency.
 nltk  # Commonly used for natural language processing.
 nose==1.3.7  # For Dataflow internal testing. TODO: remove this.
-python-snappy  # Optimzes execution of some Beam codepaths.
+python-snappy  # Optimizes execution of some Beam codepaths.
 scipy
 scikit-learn
 tensorflow

[beam] branch asf-site updated: Publishing website 2023/01/19 22:15:47 at commit 6b42bda

2023-01-19 Thread git-site-role

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 6ce8b7169b1 Publishing website 2023/01/19 22:15:47 at commit 6b42bda
6ce8b7169b1 is described below

commit 6ce8b7169b15c9c556d816ad91fe921ebdb55990
Author: jenkins 
AuthorDate: Thu Jan 19 22:15:48 2023 +

Publishing website 2023/01/19 22:15:47 at commit 6b42bda
---
 .../community/case-study/index.html|  5 +---
 website/generated-content/community/index.xml  |  5 +---
 website/generated-content/documentation/index.xml  | 31 ++
 .../documentation/programming-guide/index.html |  6 ++---
 website/generated-content/sitemap.xml  |  2 +-
 5 files changed, 37 insertions(+), 12 deletions(-)

diff --git a/website/generated-content/community/case-study/index.html 
b/website/generated-content/community/case-study/index.html
index b2c4a33d9b0..ef69abca03a 100644
--- a/website/generated-content/community/case-study/index.html
+++ b/website/generated-content/community/case-study/index.html
@@ -19,10 +19,7 @@
 function addPlaceholder(){$('input:text').attr('placeholder',"What are you 
looking for?");}
 function endSearch(){var 
search=document.querySelector(".searchBar");search.classList.add("disappear");var
 icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
 function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}CommunityJoin Beam communityIntegrationsmailto:d...@beam.apache.org?subject=Beam Website Add New Case 
Stud">Contact the community to get Case Study
-started!Add your logoWant to tell the world 
you are using Apache Beam? Just walk
+function openMenu(){addPlaceholder();blockScroll();}CommunityJoin Beam communityIntegrationshttps://github.com/apache/beam/tree/master/website/ADD_LOGO.md>this 
instruction and make it happen!The Apache Beam PMC reserves the 
right to remove logos of companies that are not deemed to be in good standing 
in the
 community.https://www.apache.org>The Apache Software Foundation
diff --git a/website/generated-content/community/index.xml 
b/website/generated-content/community/index.xml
index 3fe370d7973..77a7fd5a66b 100644
--- a/website/generated-content/community/index.xml
+++ b/website/generated-content/community/index.xml
@@ -399,10 +399,7 @@ limitations under the License.
 h1 id="case-study">Case Study/h1>
 p>Your company uses Apache Beam? There are several options to highlight it 
and make your company stand out!/p>
 h2 id="share-your-story">Share your story/h2>
-p>Sharing your story and making a Case Study out of it might have a 
significant impact on helping users with adopting
-Apache Beam. And, of course, gaining interest for your company.
-a href="mailto:d...@beam.apache.org?subject=Beam Website Add New Case 
Stud">Contact the community/a> to get Case Study
-started!/p>
+p>Sharing your story and making a Case Study out of it might have a 
significant impact on helping users with adopting Apache Beam. And, of course, 
gaining interest for your company. Please see a 
href="https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md;>how 
to add a new case study/a> for the next steps, templates and helpful tips. 
If you have any questions about adding a case study, please a 
href="mailto:d...@beam.apache.org?subject=Beam%20Website%20Add%20 [...]
 h2 id="add-your-logo">Add your logo/h2>
 p>Want to tell the world you are using Apache Beam? Just walk
 through a 
href="https://github.com/apache/beam/tree/master/website/ADD_LOGO.md;>this 
instruction/a> and make it happen!/p>
diff --git a/website/generated-content/documentation/index.xml 
b/website/generated-content/documentation/index.xml
index 29195b9966c..cc3524a0888 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -14269,6 +14269,37 @@ batch typehint – but Beam supports typehints from 
other libraries as well.
 /tr>
 /tbody>
 /table>
+h4 
id="pyarrowhttpsgithubcomapachebeamblobmastersdkspythonapache_beamtypehintsarrow_type_compatibilitypy">a
 
href="https://github.com/apache/beam/blob/master/sdks/python/apache_beam/typehints/arrow_type_compatibility.py;>pyarrow/a>/h4>
+table>
+thead>
+tr>
+th>Element Typehint/th>
+th>Batch Typehint/th>
+/tr>
+/thead>
+tbody>
+tr>
+td>Numeric types (code>int/code>, code>np.int32/code>, 
code>bool/code>, hellip;)/td>
+td>code>pd.Series/code>/td>
+/tr>
+tr>
+td>code>Any/code>/td>
+td>/td>
+/tr>
+tr>
+td>code>List/code>/td>
+td>/td>
+/tr>
+tr>
+td>code>Mapping/code>/td>
+td>/td>
+/tr>
+tr>
+td>a href="#schemas">Beam Schema Types/a>/td>
+td>code>pa.Table/code>/td>
+/tr>
+/tbody>
+/table>
 h4 id="other-types">Other types?/h4>
 p>If there are other batch types you would like to use with Batched DoFns, 
please
 a

[beam] branch master updated: [Website] update content of community case study page (#25023)

2023-01-19 Thread pabloem

This is an automated email from the ASF dual-hosted git repository.

pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 6b42bda1d06 [Website] update content of community case study page 
(#25023)
6b42bda1d06 is described below

commit 6b42bda1d062899f6c5571aaac4df2dc26fe77cd
Author: bullet03 
AuthorDate: Fri Jan 20 04:07:11 2023 +0600

[Website] update content of community case study page (#25023)
---
 website/www/site/content/en/community/case-study.md | 5 +
 1 file changed, 1 insertion(+), 4 deletions(-)

diff --git a/website/www/site/content/en/community/case-study.md 
b/website/www/site/content/en/community/case-study.md
index 3b14932a46a..c731abf744d 100644
--- a/website/www/site/content/en/community/case-study.md
+++ b/website/www/site/content/en/community/case-study.md
@@ -25,10 +25,7 @@ Your company uses Apache Beam? There are several options to 
highlight it and mak
 
 ## Share your story
 
-Sharing your story and making a Case Study out of it might have a significant 
impact on helping users with adopting
-Apache Beam. And, of course, gaining interest for your company.
-mailto:d...@beam.apache.org?subject=Beam Website Add New Case 
Stud">Contact the community to get Case Study
-started!
+Sharing your story and making a Case Study out of it might have a significant 
impact on helping users with adopting Apache Beam. And, of course, gaining 
interest for your company. Please see [how to add a new case 
study](https://github.com/apache/beam/blob/master/website/ADD_CASE_STUDY.md) 
for the next steps, templates and helpful tips. If you have any questions about 
adding a case study, please [contact the 
community](mailto:d...@beam.apache.org?subject=Beam%20Website%20Add%20New%20Case%
 [...]
 
 ## Add your logo

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 00a3bee419e Updating config from bot
00a3bee419e is described below

commit 00a3bee419ef41de4915e70d3b8fdcff6abeea2a
Author: github-actions 
AuthorDate: Thu Jan 19 21:52:37 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-24783.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-24783.json 
b/scripts/ci/pr-bot/state/pr-state/pr-24783.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-24783.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch master updated (148730e4ac5 -> fafeaa989a7)

2023-01-19 Thread jrmccluskey

This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 148730e4ac5 Bump timeout for beam_PostCommit_Python_Examples_Dataflow 
to 3h (#25092)
 add fafeaa989a7 Add unit test to cover non built-in GenericAlias types 
(#25091)

No new revisions were added by this update.

Summary of changes:
 sdks/python/apache_beam/typehints/typehints_test.py | 16 
 1 file changed, 16 insertions(+)

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 3edc1536614 Updating config from bot
3edc1536614 is described below

commit 3edc15366144ef5317676cf374228d844ea97e41
Author: github-actions 
AuthorDate: Thu Jan 19 20:56:39 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25009.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25009.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25009.json
index 6272b4e797d..789dd5fd2c1 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-25009.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25009.json
@@ -4,7 +4,7 @@
 "python": "AnandInguva"
   },
   "nextAction": "Reviewers",
-  "stopReviewerNotifications": false,
+  "stopReviewerNotifications": true,
   "remindAfterTestsPass": [],
   "committerAssigned": false
 }
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 4b0a14df11f Updating config from bot
4b0a14df11f is described below

commit 4b0a14df11f13b35193acf52405187faa0165a7a
Author: github-actions 
AuthorDate: Thu Jan 19 20:39:11 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25092.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25092.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25092.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25092.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch dependabot/pip/sdks/python/apache_beam/examples/ml-orchestration/kfp/components/preprocessing/torch-1.13.1 updated (f5fee2e7500 -> 2690b751a24)

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/pip/sdks/python/apache_beam/examples/ml-orchestration/kfp/components/preprocessing/torch-1.13.1
in repository https://gitbox.apache.org/repos/asf/beam.git


 discard f5fee2e7500 Bump torch
 add aa8dc4fab7e Set maxConnections optional in incoming schema for 
JdbcSchemaIOProvider (#25062)
 add 6daa6f41017 Document that yield and return shouldn't be mixed. (#25060)
 add 13a740b0091 [#25070] Remove Kafka jars from Beam Java SDK Container 
(#25072)
 add 1c4e4241c2a [Playground][Frontend] Run timer fix; CodeRunner and 
OutputType extraction. (#24871)
 add 876ce5bcafc Merge pull request #25073: Improves StorageWrite API error 
logging
 add 60a9382a67f Bump google.golang.org/api from 0.107.0 to 0.108.0 in 
/sdks (#25075)
 add 80d8d348a39 [Python] Fix input type for num_bytes (#25086)
 add 651773129bc Add Pyarrow support to Batched DoFn documentation (#23956)
 add 3e1291ca3c1 Tour of beam learning materials CI/CD refactoring and 
templating (#25080)
 add 6203e58919e Add support for using builtins typing (#25054)
 add 641b556958d Bump cloud.google.com/go/spanner from 1.42.0 to 1.43.0 in 
/sdks (#25090)
 add a99364cd7cf Increase timeout on 
test_dynamic_timer_clear_then_set_timer (#25009)
 add 76813c11372 Bump torch (#25089)
 add 148730e4ac5 Bump timeout for beam_PostCommit_Python_Examples_Dataflow 
to 3h (#25092)
 add 2690b751a24 Bump torch

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (f5fee2e7500)
\
 N -- N -- N   
refs/heads/dependabot/pip/sdks/python/apache_beam/examples/ml-orchestration/kfp/components/preprocessing/torch-1.13.1
 (2690b751a24)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .../job_PostCommit_Python_Examples_Dataflow.groovy |   2 +-
 .../backend/internal/fs_content/load.go| 156 ++--
 .../backend/internal/fs_content/load_test.go   |  67 
 .../samples/learning-content/content-info.yaml |   6 +
 .../learning-content/java/content-info.yaml|   4 -
 .../{python => }/module 1/group/group-info.yaml|   2 +
 .../group}/unit-challenge/description.md   |   0
 .../group}/unit-challenge/hint1.md |   0
 .../group}/unit-challenge/hint2.md |   0
 .../group}/unit-challenge/unit-info.yaml   |   2 +
 .../group}/unit-example/unit-info.yaml |   2 +
 .../module 1/intro-unit/unit-info.yaml |   2 +
 .../{java => }/module 1/module-info.yaml   |   6 +
 .../unit-challenge/description.md  |   0
 .../module 2 => module 1}/unit-challenge/hint1.md  |   0
 .../module 2 => module 1}/unit-challenge/hint2.md  |   0
 .../unit-challenge/unit-info.yaml  |   2 +
 .../group => module 1}/unit-example/unit-info.yaml |   2 +
 .../{java => }/module 2/module-info.yaml   |   2 +
 .../unit-challenge/description.md  |   0
 .../group => module 2}/unit-challenge/hint1.md |   0
 .../group => module 2}/unit-challenge/hint2.md |   0
 .../module 2/unit-challenge/unit-info.yaml |   2 +
 .../module 2/unit-example/unit-info.yaml   |   2 +
 .../learning-content/python/content-info.yaml  |   3 -
 .../python/module 1/module-info.yaml   |   7 -
 .../learning-content/{java => }/content-info.yaml  |   8 +-
 .../learning-content/go/content-info.yaml  |  22 --
 .../from-memory/description.md |  56 ---
 .../from-memory/unit-info.yaml |  22 --
 .../creating-collections/group-info.yaml   |  25 --
 .../reading-from-csv/unit-info.yaml|  22 --
 .../reading-from-text/description.md   |  41 --
 .../introduction-concepts/group-info.yaml  |  25 --
 .../creating-pipeline/description.md   |  36 --
 .../creating-pipeline/unit-info.yaml   |  22 --
 .../pipeline-concepts/group-info.yaml  |  25 --
 .../setting-pipeline/description.md|  71 
 .../runner-concepts/description.md |  60 ---
 .../introduction/introduction-guide/unit-info.yaml |  21 --
 .../introduction/introduction-terms/unit-info.yaml |  21 --
 .../from-memory/description.md |  33 +-
 .../from-memory/go-example}/from_memory.go |   0

[beam] branch dependabot/pip/sdks/python/apache_beam/examples/inference/online_clustering/clustering_pipeline/torch-1.13.1 updated (3707a1f5a63 -> 032fc31ef2b)

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/pip/sdks/python/apache_beam/examples/inference/online_clustering/clustering_pipeline/torch-1.13.1
in repository https://gitbox.apache.org/repos/asf/beam.git


omit 3707a1f5a63 Bump torch
 add aa8dc4fab7e Set maxConnections optional in incoming schema for 
JdbcSchemaIOProvider (#25062)
 add 6daa6f41017 Document that yield and return shouldn't be mixed. (#25060)
 add 13a740b0091 [#25070] Remove Kafka jars from Beam Java SDK Container 
(#25072)
 add 1c4e4241c2a [Playground][Frontend] Run timer fix; CodeRunner and 
OutputType extraction. (#24871)
 add 876ce5bcafc Merge pull request #25073: Improves StorageWrite API error 
logging
 add 60a9382a67f Bump google.golang.org/api from 0.107.0 to 0.108.0 in 
/sdks (#25075)
 add 80d8d348a39 [Python] Fix input type for num_bytes (#25086)
 add 651773129bc Add Pyarrow support to Batched DoFn documentation (#23956)
 add 3e1291ca3c1 Tour of beam learning materials CI/CD refactoring and 
templating (#25080)
 add 6203e58919e Add support for using builtins typing (#25054)
 add 641b556958d Bump cloud.google.com/go/spanner from 1.42.0 to 1.43.0 in 
/sdks (#25090)
 add a99364cd7cf Increase timeout on 
test_dynamic_timer_clear_then_set_timer (#25009)
 add 76813c11372 Bump torch (#25089)
 add 148730e4ac5 Bump timeout for beam_PostCommit_Python_Examples_Dataflow 
to 3h (#25092)
 add 032fc31ef2b Bump torch

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (3707a1f5a63)
\
 N -- N -- N   
refs/heads/dependabot/pip/sdks/python/apache_beam/examples/inference/online_clustering/clustering_pipeline/torch-1.13.1
 (032fc31ef2b)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .../job_PostCommit_Python_Examples_Dataflow.groovy |   2 +-
 .../backend/internal/fs_content/load.go| 156 ++--
 .../backend/internal/fs_content/load_test.go   |  67 
 .../samples/learning-content/content-info.yaml |   6 +
 .../learning-content/java/content-info.yaml|   4 -
 .../{python => }/module 1/group/group-info.yaml|   2 +
 .../group}/unit-challenge/description.md   |   0
 .../group}/unit-challenge/hint1.md |   0
 .../group}/unit-challenge/hint2.md |   0
 .../group}/unit-challenge/unit-info.yaml   |   2 +
 .../group}/unit-example/unit-info.yaml |   2 +
 .../module 1/intro-unit/unit-info.yaml |   2 +
 .../{java => }/module 1/module-info.yaml   |   6 +
 .../unit-challenge/description.md  |   0
 .../module 2 => module 1}/unit-challenge/hint1.md  |   0
 .../module 2 => module 1}/unit-challenge/hint2.md  |   0
 .../unit-challenge/unit-info.yaml  |   2 +
 .../group => module 1}/unit-example/unit-info.yaml |   2 +
 .../{java => }/module 2/module-info.yaml   |   2 +
 .../unit-challenge/description.md  |   0
 .../group => module 2}/unit-challenge/hint1.md |   0
 .../group => module 2}/unit-challenge/hint2.md |   0
 .../module 2/unit-challenge/unit-info.yaml |   2 +
 .../module 2/unit-example/unit-info.yaml   |   2 +
 .../learning-content/python/content-info.yaml  |   3 -
 .../python/module 1/module-info.yaml   |   7 -
 .../learning-content/{java => }/content-info.yaml  |   8 +-
 .../learning-content/go/content-info.yaml  |  22 --
 .../from-memory/description.md |  56 ---
 .../from-memory/unit-info.yaml |  22 --
 .../creating-collections/group-info.yaml   |  25 --
 .../reading-from-csv/unit-info.yaml|  22 --
 .../reading-from-text/description.md   |  41 --
 .../introduction-concepts/group-info.yaml  |  25 --
 .../creating-pipeline/description.md   |  36 --
 .../creating-pipeline/unit-info.yaml   |  22 --
 .../pipeline-concepts/group-info.yaml  |  25 --
 .../setting-pipeline/description.md|  71 
 .../runner-concepts/description.md |  60 ---
 .../introduction/introduction-guide/unit-info.yaml |  21 --
 .../introduction/introduction-terms/unit-info.yaml |  21 --
 .../from-memory/description.md |  33 +-
 .../from-memory/go-example}/from_memory.go |   0

[beam] branch master updated: Bump timeout for beam_PostCommit_Python_Examples_Dataflow to 3h (#25092)

2023-01-19 Thread yhu

This is an automated email from the ASF dual-hosted git repository.

yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 148730e4ac5 Bump timeout for beam_PostCommit_Python_Examples_Dataflow 
to 3h (#25092)
148730e4ac5 is described below

commit 148730e4ac5f22f7001c3599e405826df9b89000
Author: Yi Hu 
AuthorDate: Thu Jan 19 15:29:35 2023 -0500

Bump timeout for beam_PostCommit_Python_Examples_Dataflow to 3h (#25092)
---
 .test-infra/jenkins/job_PostCommit_Python_Examples_Dataflow.groovy | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/.test-infra/jenkins/job_PostCommit_Python_Examples_Dataflow.groovy 
b/.test-infra/jenkins/job_PostCommit_Python_Examples_Dataflow.groovy
index 402402504c9..3d2021f53b1 100644
--- a/.test-infra/jenkins/job_PostCommit_Python_Examples_Dataflow.groovy
+++ b/.test-infra/jenkins/job_PostCommit_Python_Examples_Dataflow.groovy
@@ -25,7 +25,7 @@ 
PostcommitJobBuilder.postCommitJob('beam_PostCommit_Python_Examples_Dataflow',
 
   description('Runs the Python Examples with DataflowRunner')
 
-  commonJobProperties.setTopLevelMainJobProperties(delegate, 'master', 120)
+  commonJobProperties.setTopLevelMainJobProperties(delegate, 'master', 180)
 
   // Publish all test results to Jenkins
   publishers {

[beam] branch master updated (a99364cd7cf -> 76813c11372)

2023-01-19 Thread jrmccluskey

This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from a99364cd7cf Increase timeout on 
test_dynamic_timer_clear_then_set_timer (#25009)
 add 76813c11372 Bump torch (#25089)

No new revisions were added by this update.

Summary of changes:
 .../python/apache_beam/examples/inference/runinference_metrics/setup.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[beam] branch master updated (641b556958d -> a99364cd7cf)

2023-01-19 Thread damccorm

This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 641b556958d Bump cloud.google.com/go/spanner from 1.42.0 to 1.43.0 in 
/sdks (#25090)
 add a99364cd7cf Increase timeout on 
test_dynamic_timer_clear_then_set_timer (#25009)

No new revisions were added by this update.

Summary of changes:
 sdks/python/apache_beam/transforms/userstate_test.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 6ea455afd29 Updating config from bot
6ea455afd29 is described below

commit 6ea455afd299764f6f8b8957b29fbae162fddfe3
Author: github-actions 
AuthorDate: Thu Jan 19 20:12:21 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25091.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25091.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25091.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25091.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch master updated (6203e58919e -> 641b556958d)

2023-01-19 Thread jrmccluskey

This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 6203e58919e Add support for using builtins typing (#25054)
 add 641b556958d Bump cloud.google.com/go/spanner from 1.42.0 to 1.43.0 in 
/sdks (#25090)

No new revisions were added by this update.

Summary of changes:
 sdks/go.mod | 4 ++--
 sdks/go.sum | 8 
 2 files changed, 6 insertions(+), 6 deletions(-)

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new aaf7875acde Updating config from bot
aaf7875acde is described below

commit aaf7875acde8b37d1fd012b93c409fcee49d3781
Author: github-actions 
AuthorDate: Thu Jan 19 19:09:27 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 4cbf78edfc1..c3c88bd3cb9 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -9,6 +9,6 @@
 "pabloem": 1674151632176,
 "y1chi": 1667002607045,
 "damccorm": 1674147936104,
-"jrmccluskey": 1674070935418
+"jrmccluskey": 1674155362431
   }
 }
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new bb40379c920 Updating config from bot
bb40379c920 is described below

commit bb40379c92086afa47a7d9d8639a63007e65d477
Author: github-actions 
AuthorDate: Thu Jan 19 19:09:24 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25089.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25089.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25089.json
new file mode 100644
index 000..959c289c017
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25089.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "jrmccluskey"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 80768f7f861 Updating config from bot
80768f7f861 is described below

commit 80768f7f86185a5e2fe183c249528677b731c6b9
Author: github-actions 
AuthorDate: Thu Jan 19 19:09:19 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-go.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-go.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
index b190ab2f4ee..19ed3c7488a 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-go.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-go.json
@@ -2,7 +2,7 @@
   "label": "go",
   "dateOfLastReviewAssignment": {
 "lostluck": 1673948119348,
-"jrmccluskey": 1673570949267,
+"jrmccluskey": 1674155354299,
 "youngoli": 1657688896155,
 "damccorm": 1673845573921,
 "riteshghorse": 1674103014589

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new d9ebe5c5550 Updating config from bot
d9ebe5c5550 is described below

commit d9ebe5c555006e9588f993119d47f4f073765679
Author: github-actions 
AuthorDate: Thu Jan 19 19:09:16 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25090.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25090.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25090.json
new file mode 100644
index 000..1c2c2e31975
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25090.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"go": "jrmccluskey"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch master updated: Add support for using builtins typing (#25054)

2023-01-19 Thread jrmccluskey

This is an automated email from the ASF dual-hosted git repository.

jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 6203e58919e Add support for using builtins typing (#25054)
6203e58919e is described below

commit 6203e58919eda6094bc301dbf9c2fb66930800d2
Author: David Katz <41651296+davidkatz...@users.noreply.github.com>
AuthorDate: Thu Jan 19 21:07:33 2023 +0200

Add support for using builtins typing (#25054)

* Add support for using builtins typing

* lint and formatting

* tests

* fix tests

* fix tests

* fix tests

* fix tests
---
 .../typehints/native_type_compatibility.py | 27 +
 .../typehints/native_type_compatibility_test.py| 42 +
 sdks/python/apache_beam/typehints/typehints.py | 16 
 .../python/apache_beam/typehints/typehints_test.py | 44 +++---
 4 files changed, 99 insertions(+), 30 deletions(-)

diff --git a/sdks/python/apache_beam/typehints/native_type_compatibility.py 
b/sdks/python/apache_beam/typehints/native_type_compatibility.py
index 153b9d4b458..0fa31bd70ee 100644
--- a/sdks/python/apache_beam/typehints/native_type_compatibility.py
+++ b/sdks/python/apache_beam/typehints/native_type_compatibility.py
@@ -37,6 +37,14 @@ _LOGGER = logging.getLogger(__name__)
 _TypeMapEntry = collections.namedtuple(
 '_TypeMapEntry', ['match', 'arity', 'beam_type'])
 
+_BUILTINS_TO_TYPING = {
+dict: typing.Dict,
+list: typing.List,
+tuple: typing.Tuple,
+set: typing.Set,
+frozenset: typing.FrozenSet,
+}
+
 
 def _get_args(typ):
   """Returns a list of arguments to the given type.
@@ -163,6 +171,22 @@ def is_forward_ref(typ):
 _type_var_cache = {}  # type: typing.Dict[int, typehints.TypeVariable]
 
 
+def convert_builtin_to_typing(typ):
+  """Convert recursively a given builtin to a typing object.
+
+  Args:
+typ (`builtins`): builtin object that exist in _BUILTINS_TO_TYPING.
+
+  Returns:
+type: The given builtins converted to a type.
+
+  """
+  if getattr(typ, '__origin__', None) in _BUILTINS_TO_TYPING:
+args = map(convert_builtin_to_typing, typ.__args__)
+typ = _BUILTINS_TO_TYPING[typ.__origin__].copy_with(tuple(args))
+  return typ
+
+
 def convert_to_beam_type(typ):
   """Convert a given typing type to a Beam type.
 
@@ -185,6 +209,9 @@ def convert_to_beam_type(typ):
   sys.version_info.minor >= 10) and (isinstance(typ, types.UnionType)):
 typ = typing.Union[typ]
 
+  if sys.version_info >= (3, 9) and isinstance(typ, types.GenericAlias):
+typ = convert_builtin_to_typing(typ)
+
   if isinstance(typ, typing.TypeVar):
 # This is a special case, as it's not parameterized by types.
 # Also, identity must be preserved through conversion (i.e. the same
diff --git 
a/sdks/python/apache_beam/typehints/native_type_compatibility_test.py 
b/sdks/python/apache_beam/typehints/native_type_compatibility_test.py
index b13df6c2062..8dcff9fc2d7 100644
--- a/sdks/python/apache_beam/typehints/native_type_compatibility_test.py
+++ b/sdks/python/apache_beam/typehints/native_type_compatibility_test.py
@@ -24,6 +24,7 @@ import typing
 import unittest
 
 from apache_beam.typehints import typehints
+from apache_beam.typehints.native_type_compatibility import 
convert_builtin_to_typing
 from apache_beam.typehints.native_type_compatibility import 
convert_to_beam_type
 from apache_beam.typehints.native_type_compatibility import 
convert_to_beam_types
 from apache_beam.typehints.native_type_compatibility import 
convert_to_typing_type
@@ -111,6 +112,47 @@ class NativeTypeCompatibilityTest(unittest.TestCase):
   converted_typing_type = convert_to_typing_type(converted_beam_type)
   self.assertEqual(converted_typing_type, typing_type, description)
 
+  def test_convert_to_beam_type_with_builtin_types(self):
+if sys.version_info >= (3, 9):
+  test_cases = [
+  ('builtin dict', dict[str, int], typehints.Dict[str, int]),
+  ('builtin list', list[str], typehints.List[str]),
+  ('builtin tuple', tuple[str], typehints.Tuple[str]),
+  ('builtin set', set[str], typehints.Set[str]),
+  (
+  'nested builtin',
+  dict[str, list[tuple[float]]],
+  typehints.Dict[str, typehints.List[typehints.Tuple[float]]]),
+  ]
+
+  for test_case in test_cases:
+description = test_case[0]
+builtins_type = test_case[1]
+expected_beam_type = test_case[2]
+converted_beam_type = convert_to_beam_type(builtins_type)
+self.assertEqual(converted_beam_type, expected_beam_type, description)
+
+  def test_convert_builtin_to_typing(self):
+if sys.version_info >= (3, 9):
+  test_cases = [
+  ('dict', dict[str, int], typing.Dict[str, int]),
+  ('list', list[str], typing.List[str]),
+

[beam] branch master updated (651773129bc -> 3e1291ca3c1)

2023-01-19 Thread damccorm

This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 651773129bc Add Pyarrow support to Batched DoFn documentation (#23956)
 add 3e1291ca3c1 Tour of beam learning materials CI/CD refactoring and 
templating (#25080)

No new revisions were added by this update.

Summary of changes:
 .../backend/internal/fs_content/load.go| 156 +
 .../backend/internal/fs_content/load_test.go   |  67 +
 .../samples/learning-content/content-info.yaml |   6 +
 .../learning-content/java/content-info.yaml|   4 -
 .../{python => }/module 1/group/group-info.yaml|   2 +
 .../group}/unit-challenge/description.md   |   0
 .../group}/unit-challenge/hint1.md |   0
 .../group}/unit-challenge/hint2.md |   0
 .../module 1/group/unit-challenge/unit-info.yaml   |   2 +
 .../group}/unit-example/unit-info.yaml |   2 +
 .../module 1/intro-unit/unit-info.yaml |   2 +
 .../{java => }/module 1/module-info.yaml   |   6 +
 .../unit-challenge/description.md  |   0
 .../module 2 => module 1}/unit-challenge/hint1.md  |   0
 .../module 2 => module 1}/unit-challenge/hint2.md  |   0
 .../module 1/unit-challenge/unit-info.yaml |   2 +
 .../group => module 1}/unit-example/unit-info.yaml |   2 +
 .../{java => }/module 2/module-info.yaml   |   2 +
 .../unit-challenge/description.md  |   0
 .../group => module 2}/unit-challenge/hint1.md |   0
 .../group => module 2}/unit-challenge/hint2.md |   0
 .../module 2/unit-challenge/unit-info.yaml |   2 +
 .../module 2/unit-example/unit-info.yaml   |   2 +
 .../learning-content/python/content-info.yaml  |   3 -
 .../python/module 1/module-info.yaml   |   7 -
 .../learning-content/{java => }/content-info.yaml  |   8 +-
 .../learning-content/go/content-info.yaml  |  22 ---
 .../from-memory/description.md |  56 
 .../from-memory/unit-info.yaml |  22 ---
 .../creating-collections/group-info.yaml   |  25 
 .../reading-from-csv/unit-info.yaml|  22 ---
 .../reading-from-text/description.md   |  41 --
 .../introduction-concepts/group-info.yaml  |  25 
 .../creating-pipeline/description.md   |  36 -
 .../creating-pipeline/unit-info.yaml   |  22 ---
 .../pipeline-concepts/group-info.yaml  |  25 
 .../setting-pipeline/description.md|  71 --
 .../runner-concepts/description.md |  60 
 .../introduction/introduction-guide/unit-info.yaml |  21 ---
 .../introduction/introduction-terms/unit-info.yaml |  21 ---
 .../from-memory/description.md |  33 -
 .../from-memory/go-example}/from_memory.go |   0
 .../from-memory/java-example}/from_memory.java |   0
 .../from-memory/python-example}/from_memory.py |   0
 .../from-memory/unit-info.yaml |   7 +-
 .../creating-collections/group-info.yaml   |   4 +
 .../reading-from-csv/description.md|   0
 .../reading-from-csv/go-example}/csvExample.go |   0
 .../reading-from-csv/java-example}/CSVExample.java |   0
 .../reading-from-csv/python-example}/csvExample.py |   0
 .../reading-from-csv/unit-info.yaml|   7 +-
 .../reading-from-text/description.md   |  26 +++-
 .../reading-from-text/go-example}/textIo.go|   0
 .../java-example}/TextIOExample.java   |   0
 .../reading-from-text/python-example}/textIo.py|   0
 .../reading-from-text/unit-info.yaml   |   8 +-
 .../introduction-concepts/group-info.yaml  |   4 +
 .../creating-pipeline/description.md   |  42 +-
 .../creating-pipeline/go-example}/main.go  |   0
 .../creating-pipeline/java-example}/Task.java  |   0
 .../creating-pipeline/python-example}/task.py  |   0
 .../creating-pipeline/unit-info.yaml   |   7 +-
 .../pipeline-concepts/group-info.yaml  |   4 +
 .../overview-pipeline/description.md   |   2 +
 .../overview-pipeline/unit-info.yaml   |   7 +-
 .../setting-pipeline/description.md|  96 +++--
 .../setting-pipeline/go-example}/main.go   |   0
 .../setting-pipeline/java-example}/Task.java   |   0
 .../setting-pipeline/python-example}/task.py   |   0
 .../setting-pipeline/unit-info.yaml|   7 +-
 .../runner-concepts/description.md | 129 +++--
 .../runner-concepts/unit-info.yaml |   7 +-
 .../introduction/introduction-guide/description.md |   0
 .../introduction/introduction-guide/unit-info.yaml |   6 +-
 .../introduction/introduction-terms/description.md |   0

[beam] branch master updated (80d8d348a39 -> 651773129bc)

2023-01-19 Thread bhulette

This is an automated email from the ASF dual-hosted git repository.

bhulette pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 80d8d348a39 [Python] Fix input type for num_bytes (#25086)
 add 651773129bc Add Pyarrow support to Batched DoFn documentation (#23956)

No new revisions were added by this update.

Summary of changes:
 website/www/site/content/en/documentation/programming-guide.md | 10 ++
 1 file changed, 10 insertions(+)

[beam] branch dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.43.0 created (now c9090beaf8d)

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.43.0
in repository https://gitbox.apache.org/repos/asf/beam.git


  at c9090beaf8d Bump cloud.google.com/go/spanner from 1.42.0 to 1.43.0 in 
/sdks

No new revisions were added by this update.

[beam] branch master updated (60a9382a67f -> 80d8d348a39)

2023-01-19 Thread riteshghorse

This is an automated email from the ASF dual-hosted git repository.

riteshghorse pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 60a9382a67f Bump google.golang.org/api from 0.107.0 to 0.108.0 in 
/sdks (#25075)
 add 80d8d348a39 [Python] Fix input type for num_bytes (#25086)

No new revisions were added by this update.

Summary of changes:
 sdks/python/apache_beam/ml/inference/sklearn_inference.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[beam] branch dependabot/pip/sdks/python/apache_beam/examples/inference/runinference_metrics/torch-1.13.1 created (now 6186b9f9dc4)

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch 
dependabot/pip/sdks/python/apache_beam/examples/inference/runinference_metrics/torch-1.13.1
in repository https://gitbox.apache.org/repos/asf/beam.git


  at 6186b9f9dc4 Bump torch

No new revisions were added by this update.

[beam] branch master updated: Bump google.golang.org/api from 0.107.0 to 0.108.0 in /sdks (#25075)

2023-01-19 Thread riteshghorse

This is an automated email from the ASF dual-hosted git repository.

riteshghorse pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 60a9382a67f Bump google.golang.org/api from 0.107.0 to 0.108.0 in 
/sdks (#25075)
60a9382a67f is described below

commit 60a9382a67fd06ca98c3d22141516fb3bb79144e
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
AuthorDate: Thu Jan 19 13:18:54 2023 -0500

Bump google.golang.org/api from 0.107.0 to 0.108.0 in /sdks (#25075)

Bumps 
[google.golang.org/api](https://github.com/googleapis/google-api-go-client) 
from 0.107.0 to 0.108.0.
- [Release 
notes](https://github.com/googleapis/google-api-go-client/releases)
- 
[Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- 
[Commits](https://github.com/googleapis/google-api-go-client/compare/v0.107.0...v0.108.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] 

Signed-off-by: dependabot[bot] 
Co-authored-by: dependabot[bot] 
<49699333+dependabot[bot]@users.noreply.github.com>
---
 sdks/go.mod | 2 +-
 sdks/go.sum | 4 ++--
 2 files changed, 3 insertions(+), 3 deletions(-)

diff --git a/sdks/go.mod b/sdks/go.mod
index 3c57d8f0fcc..825baf7a9b1 100644
--- a/sdks/go.mod
+++ b/sdks/go.mod
@@ -54,7 +54,7 @@ require (
golang.org/x/sync v0.1.0
golang.org/x/sys v0.4.0
golang.org/x/text v0.6.0
-   google.golang.org/api v0.107.0
+   google.golang.org/api v0.108.0
google.golang.org/genproto v0.0.0-20221227171554-f9683d7f8bef
google.golang.org/grpc v1.52.0
google.golang.org/protobuf v1.28.1
diff --git a/sdks/go.sum b/sdks/go.sum
index 91a5444ec86..f5d4ee311e1 100644
--- a/sdks/go.sum
+++ b/sdks/go.sum
@@ -1157,8 +1157,8 @@ google.golang.org/api v0.17.0/go.mod 
h1:BwFmGc8tA3vsd7r/7kR8DY7iEEGSU04BFxCo5jP/
 google.golang.org/api v0.18.0/go.mod 
h1:BwFmGc8tA3vsd7r/7kR8DY7iEEGSU04BFxCo5jP/sfE=
 google.golang.org/api v0.20.0/go.mod 
h1:BwFmGc8tA3vsd7r/7kR8DY7iEEGSU04BFxCo5jP/sfE=
 google.golang.org/api v0.22.0/go.mod 
h1:BwFmGc8tA3vsd7r/7kR8DY7iEEGSU04BFxCo5jP/sfE=
-google.golang.org/api v0.107.0 h1:I2SlFjD8ZWabaIFOfeEDg3pf0BHJDh6iYQ1ic3Yu/UU=
-google.golang.org/api v0.107.0/go.mod 
h1:2Ts0XTHNVWxypznxWOYUeI4g3WdP9Pk2Qk58+a/O9MY=
+google.golang.org/api v0.108.0 h1:WVBc/faN0DkKtR43Q/7+tPny9ZoLZdIiAyG5Q9vFClg=
+google.golang.org/api v0.108.0/go.mod 
h1:2Ts0XTHNVWxypznxWOYUeI4g3WdP9Pk2Qk58+a/O9MY=
 google.golang.org/appengine v1.1.0/go.mod 
h1:EbEs0AVv82hx2wNQdGPgUI5lhzA/G0D9YwlJXL52JkM=
 google.golang.org/appengine v1.4.0/go.mod 
h1:xpcJRLb0r/rnEns0DIKYYv+WjYCduHsrkT7/EB5XEv4=
 google.golang.org/appengine v1.5.0/go.mod 
h1:xpcJRLb0r/rnEns0DIKYYv+WjYCduHsrkT7/EB5XEv4=

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 4045d567337 Updating config from bot
4045d567337 is described below

commit 4045d5673373fd3b130916c7c9c0e9010b5d2f72
Author: github-actions 
AuthorDate: Thu Jan 19 18:07:19 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 4af49aabb16..4cbf78edfc1 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -6,7 +6,7 @@
 "TheNeuralBit": 1667896849319,
 "ryanthompson591": 1670002443548,
 "tvalentyn": 1674142787467,
-"pabloem": 1674068364957,
+"pabloem": 1674151632176,
 "y1chi": 1667002607045,
 "damccorm": 1674147936104,
 "jrmccluskey": 1674070935418

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 21e0f41c00c Updating config from bot
21e0f41c00c is described below

commit 21e0f41c00c998f30d38d63e6adaa3038ff4d073
Author: github-actions 
AuthorDate: Thu Jan 19 18:07:15 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25086.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25086.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25086.json
new file mode 100644
index 000..62db1666e3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25086.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "pabloem"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch master updated (1c4e4241c2a -> 876ce5bcafc)

2023-01-19 Thread reuvenlax

This is an automated email from the ASF dual-hosted git repository.

reuvenlax pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


from 1c4e4241c2a [Playground][Frontend] Run timer fix; CodeRunner and 
OutputType extraction. (#24871)
 add 876ce5bcafc Merge pull request #25073: Improves StorageWrite API error 
logging

No new revisions were added by this update.

Summary of changes:
 .../sdk/io/gcp/bigquery/StorageApiWriteUnshardedRecords.java  | 11 ---
 1 file changed, 8 insertions(+), 3 deletions(-)

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new f0c213a4427 Updating config from bot
f0c213a4427 is described below

commit f0c213a44275c6aba84adbe7e5c8c81ca46f4d7a
Author: github-actions 
AuthorDate: Thu Jan 19 17:59:03 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25088.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25088.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25088.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25088.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new dad92f17c8e Updating config from bot
dad92f17c8e is described below

commit dad92f17c8ec303abb59cef537082d1bc728f193
Author: github-actions 
AuthorDate: Thu Jan 19 17:34:18 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25084.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25084.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25084.json
index 88d1920a8bb..24d0e10a64c 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-25084.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25084.json
@@ -6,5 +6,5 @@
   "nextAction": "Reviewers",
   "stopReviewerNotifications": false,
   "remindAfterTestsPass": [],
-  "committerAssigned": false
+  "committerAssigned": true
 }
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new eda6b92ead4 Updating config from bot
eda6b92ead4 is described below

commit eda6b92ead4efefb9af61dd3d0fcfa650fc611ee
Author: github-actions 
AuthorDate: Thu Jan 19 17:28:25 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-23956.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-23956.json 
b/scripts/ci/pr-bot/state/pr-state/pr-23956.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-23956.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 94abca0a40d Updating config from bot
94abca0a40d is described below

commit 94abca0a40db9289ee6b1dee0a35655dcfadf675
Author: github-actions 
AuthorDate: Thu Jan 19 17:05:44 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 5ba57792582..4af49aabb16 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -8,7 +8,7 @@
 "tvalentyn": 1674142787467,
 "pabloem": 1674068364957,
 "y1chi": 1667002607045,
-"damccorm": 1674059312229,
+"damccorm": 1674147936104,
 "jrmccluskey": 1674070935418
   }
 }
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new c38e48281ba Updating config from bot
c38e48281ba is described below

commit c38e48281ba3c59ae4d92908faac8549237e5cfa
Author: github-actions 
AuthorDate: Thu Jan 19 17:05:40 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25084.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25084.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25084.json
new file mode 100644
index 000..88d1920a8bb
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25084.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "damccorm"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 456852f58d6 Updating config from bot
456852f58d6 is described below

commit 456852f58d607e62df4d2ea7e5c80679280d9b96
Author: github-actions 
AuthorDate: Thu Jan 19 16:12:31 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 46c59c17cea..5ba57792582 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -1,7 +1,7 @@
 {
   "label": "python",
   "dateOfLastReviewAssignment": {
-"AnandInguva": 1674034451840,
+"AnandInguva": 1674144734684,
 "yeandy": 1665802753763,
 "TheNeuralBit": 1667896849319,
 "ryanthompson591": 1670002443548,

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 0b07a72e6dc Updating config from bot
0b07a72e6dc is described below

commit 0b07a72e6dc3ddadd74950d1e337b243d93d625e
Author: github-actions 
AuthorDate: Thu Jan 19 16:12:22 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25081.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25081.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25081.json
new file mode 100644
index 000..6272b4e797d
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25081.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "AnandInguva"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 1e4cad89d12 Updating config from bot
1e4cad89d12 is described below

commit 1e4cad89d1255dada361b120cf3fca86386f7d0f
Author: github-actions 
AuthorDate: Thu Jan 19 15:40:01 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json 
b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
index 2310f4e253f..46c59c17cea 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json
@@ -5,7 +5,7 @@
 "yeandy": 1665802753763,
 "TheNeuralBit": 1667896849319,
 "ryanthompson591": 1670002443548,
-"tvalentyn": 1673992315886,
+"tvalentyn": 1674142787467,
 "pabloem": 1674068364957,
 "y1chi": 1667002607045,
 "damccorm": 1674059312229,

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new d332717eb8b Updating config from bot
d332717eb8b is described below

commit d332717eb8b6529005372285671278dfbcdae633
Author: github-actions 
AuthorDate: Thu Jan 19 15:39:54 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25083.json | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25083.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25083.json
new file mode 100644
index 000..321b31c0f05
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25083.json
@@ -0,0 +1,10 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {
+"python": "tvalentyn"
+  },
+  "nextAction": "Reviewers",
+  "stopReviewerNotifications": false,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch release-2.45.0 updated: [#25070] Remove Kafka jars from Beam Java SDK Container (#25072) (#25074)

2023-01-19 Thread johncasey

This is an automated email from the ASF dual-hosted git repository.

johncasey pushed a commit to branch release-2.45.0
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/release-2.45.0 by this push:
 new 696469fd2dc [#25070] Remove Kafka jars from Beam Java SDK Container 
(#25072) (#25074)
696469fd2dc is described below

commit 696469fd2dc5b447e58cd22de090abc8d7399833
Author: Luke Cwik 
AuthorDate: Thu Jan 19 06:22:55 2023 -0800

[#25070] Remove Kafka jars from Beam Java SDK Container (#25072) (#25074)

This was added as a temporary work-around when the XLang expansion service 
did not support returning additional dependencies. This removes that dependency 
prevent conflicts and allowing the user to control which Kafka dependency 
version they want to use.

For #25070
---
 sdks/java/container/Dockerfile| 5 -
 sdks/java/container/boot.go   | 2 --
 sdks/java/container/build.gradle  | 9 +
 sdks/java/container/common.gradle | 2 --
 4 files changed, 1 insertion(+), 17 deletions(-)

diff --git a/sdks/java/container/Dockerfile b/sdks/java/container/Dockerfile
index b941aee453d..5f25c1e65a9 100644
--- a/sdks/java/container/Dockerfile
+++ b/sdks/java/container/Dockerfile
@@ -28,11 +28,6 @@ ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
 ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
 ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
 
-# Required to run cross-language pipelines with KafkaIO
-# TODO May be removed once custom environments are supported
-ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
-ADD target/kafka-clients.jar /opt/apache/beam/jars/
-
 # Required to use jamm as a javaagent to get accurate object size measuring
 # COPY fails if file is not found, so use a wildcard for open-module-agent.jar
 # since it is only included in Java 9+ containers
diff --git a/sdks/java/container/boot.go b/sdks/java/container/boot.go
index 63dd1176d37..a5a42d4fb1e 100644
--- a/sdks/java/container/boot.go
+++ b/sdks/java/container/boot.go
@@ -141,8 +141,6 @@ func main() {
filepath.Join(jarsDir, "log4j-over-slf4j.jar"),
filepath.Join(jarsDir, "log4j-to-slf4j.jar"),
filepath.Join(jarsDir, "beam-sdks-java-harness.jar"),
-   filepath.Join(jarsDir, "beam-sdks-java-io-kafka.jar"),
-   filepath.Join(jarsDir, "kafka-clients.jar"),
}
 
var hasWorkerExperiment = strings.Contains(options, 
"use_staged_dataflow_worker_jar")
diff --git a/sdks/java/container/build.gradle b/sdks/java/container/build.gradle
index 98a62659560..133ef382f64 100644
--- a/sdks/java/container/build.gradle
+++ b/sdks/java/container/build.gradle
@@ -25,7 +25,6 @@ applyGoNature()
 applyPythonNature()
 
 evaluationDependsOn(":sdks:java:harness")
-evaluationDependsOn(":sdks:java:io:kafka")
 evaluationDependsOn(":sdks:java:io:jdbc")
 
 description = "Apache Beam :: SDKs :: Java :: Container"
@@ -42,10 +41,6 @@ dependencies {
   dockerDependency library.java.log4j_over_slf4j
   dockerDependency library.java.log4j2_to_slf4j
   dockerDependency project(path: ":sdks:java:harness", configuration: "shadow")
-  // For executing KafkaIO, e.g. as an external transform
-  dockerDependency project(":sdks:java:io:kafka")
-  // This dependency is set to 'provided' scope in :sdks:java:io:kafka
-  dockerDependency library.java.kafka_clients
   dockerDependency library.java.jamm
 }
 
@@ -58,9 +53,7 @@ goBuild {
 import com.github.jk1.license.render.*
 licenseReport {
   projects = [project,
-  project.rootProject.findProject(':sdks:java:harness'),
-  project.rootProject.findProject(':sdks:java:io:kafka'),
-  project.rootProject.findProject(':sdks:java:io:jdbc')]
+  project.rootProject.findProject(':sdks:java:harness')]
   excludeOwnGroup = true
   excludeGroups = ["beam.*"] // project dependencies do not match their maven 
coords
   configurations = ALL
diff --git a/sdks/java/container/common.gradle 
b/sdks/java/container/common.gradle
index 1ec0da0098b..d3f21096a62 100644
--- a/sdks/java/container/common.gradle
+++ b/sdks/java/container/common.gradle
@@ -55,8 +55,6 @@ task copyDockerfileDependencies(type: Copy) {
 rename 'beam-sdks-java-container-agent.*.jar', 'open-module-agent.jar'
 }
 rename 'beam-sdks-java-harness-.*.jar', 'beam-sdks-java-harness.jar'
-rename 'beam-sdks-java-io-kafka.*.jar', 'beam-sdks-java-io-kafka.jar'
-rename 'kafka-clients.*.jar', 'kafka-clients.jar'
 rename 'jamm.*.jar', 'jamm.jar'
 
 setDuplicatesStrategy(DuplicatesStrategy.INCLUDE)

[beam] branch master updated: [Playground][Frontend] Run timer fix; CodeRunner and OutputType extraction. (#24871)

2023-01-19 Thread damccorm

This is an automated email from the ASF dual-hosted git repository.

damccorm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
 new 1c4e4241c2a [Playground][Frontend] Run timer fix; CodeRunner and 
OutputType extraction. (#24871)
1c4e4241c2a is described below

commit 1c4e4241c2a4571c7d6c9f293133b114a9e00844
Author: Darkhan Nausharipov <31556582+naushari...@users.noreply.github.com>
AuthorDate: Thu Jan 19 19:59:31 2023 +0600

[Playground][Frontend] Run timer fix; CodeRunner and OutputType extraction. 
(#24871)

* timer fix rough draft (#24617)

* comments (#24617)

* comments (1) (#24617)

* cancel run on reset (#24617)

* regenerated mocks (#24617)

* runStopDate (#24617)

* OutputFilterTypeController (#24617)

* resetErrorMessageText (#24617)

Co-authored-by: alexeyinkin 

* resetErrorMessageText (#24617)

Co-authored-by: alexeyinkin 

* comments (#24617)

* missing license (#24617)

* a commit for re-running rat check on github

* deleted comment "a commit for re-running rat check on github"

* fixes after merge with master (#24617)

* merge fixes (#24617)

* regenerated yaml files (#24617)

* snippetEditingControllerGetter refinement (#24617)

Co-authored-by: darkhan.nausharipov 
Co-authored-by: alexeyinkin 
---
 .../shortcuts/constants/global_shortcuts.dart  |   2 +-
 .../widgets/close_listener.dart|   4 +-
 .../widgets/editor_textarea_wrapper.dart   |   7 +-
 playground/frontend/lib/utils/analytics_utils.dart |   2 +-
 .../playground_components/assets/symbols/go.g.yaml |  89 -
 .../assets/symbols/java.g.yaml | 415 +++--
 .../assets/symbols/python.g.yaml   |  36 +-
 .../lib/src/controllers/code_runner.dart   | 165 
 .../output_filter_type_controller.dart}|  24 +-
 .../lib/src/controllers/playground_controller.dart | 210 ++-
 .../lib/src/models/outputs.dart|   1 -
 .../lib/src/widgets/output/output_area.dart|  62 +--
 .../lib/src/widgets/output/output_tab.dart |  10 +-
 .../lib/src/widgets/output/output_tabs.dart|   5 +-
 .../src/widgets/output/result_filter_bubble.dart   |   6 +-
 .../src/widgets/output/result_filter_popover.dart  |   2 +-
 .../lib/src/widgets/periodic_builder.dart} |  42 ++-
 .../lib/src/widgets/run_button.dart| 142 ---
 .../lib/src/widgets/run_or_cancel_button.dart  |   8 +-
 .../examples_loader_test.mocks.dart| 301 +++
 .../controllers/playground_controller_test.dart|  19 +-
 21 files changed, 1006 insertions(+), 546 deletions(-)

diff --git 
a/playground/frontend/lib/modules/shortcuts/constants/global_shortcuts.dart 
b/playground/frontend/lib/modules/shortcuts/constants/global_shortcuts.dart
index 03797eaff3a..00687271773 100644
--- a/playground/frontend/lib/modules/shortcuts/constants/global_shortcuts.dart
+++ b/playground/frontend/lib/modules/shortcuts/constants/global_shortcuts.dart
@@ -40,7 +40,7 @@ final kClearOutputShortcut = BeamShortcut(
 onInvoke: (_) => Provider.of(
   context,
   listen: false,
-).clearOutput(),
+).codeRunner.clearResult(),
   ),
 );
 
diff --git 
a/playground/frontend/lib/pages/standalone_playground/widgets/close_listener.dart
 
b/playground/frontend/lib/pages/standalone_playground/widgets/close_listener.dart
index ba2a19a7ae2..0a370f1334c 100644
--- 
a/playground/frontend/lib/pages/standalone_playground/widgets/close_listener.dart
+++ 
b/playground/frontend/lib/pages/standalone_playground/widgets/close_listener.dart
@@ -36,7 +36,9 @@ class _CloseListenerState extends State {
   void initState() {
 WidgetsBinding.instance.addPostFrameCallback((timeStamp) {
   html.window.onBeforeUnload.listen((event) async {
-Provider.of(context, listen: false).cancelRun();
+Provider.of(context, listen: false)
+.codeRunner
+.cancelRun();
   });
 });
 super.initState();
diff --git 
a/playground/frontend/lib/pages/standalone_playground/widgets/editor_textarea_wrapper.dart
 
b/playground/frontend/lib/pages/standalone_playground/widgets/editor_textarea_wrapper.dart
index 86b6a5045d6..552064498ea 100644
--- 
a/playground/frontend/lib/pages/standalone_playground/widgets/editor_textarea_wrapper.dart
+++ 
b/playground/frontend/lib/pages/standalone_playground/widgets/editor_textarea_wrapper.dart
@@ -35,7 +35,8 @@ class CodeTextAreaWrapper extends StatelessWidget {
 
   @override
   Widget build(BuildContext context) {
-if (playgroundController.result?.errorMessage?.isNotEmpty ?? false) {
+if (playgroundController.codeRunner.result?.errorMessage?.isNotEmpty ??
+false) {

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new 0b150bf4dea Updating config from bot
0b150bf4dea is described below

commit 0b150bf4deaef69e5d9b9ab16ab6945938a43955
Author: github-actions 
AuthorDate: Thu Jan 19 13:26:07 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-24965.json | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-24965.json 
b/scripts/ci/pr-bot/state/pr-state/pr-24965.json
index 62db1666e3b..3bff16816a2 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-24965.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-24965.json
@@ -4,7 +4,7 @@
 "python": "pabloem"
   },
   "nextAction": "Reviewers",
-  "stopReviewerNotifications": false,
+  "stopReviewerNotifications": true,
   "remindAfterTestsPass": [],
   "committerAssigned": false
 }
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new d020fcb60a3 Updating config from bot
d020fcb60a3 is described below

commit d020fcb60a3b0f253136b1ae56e954870e50190b
Author: github-actions 
AuthorDate: Thu Jan 19 13:09:34 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25080.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25080.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25080.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25080.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

[beam] branch pr-bot-state updated: Updating config from bot

2023-01-19 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/pr-bot-state by this push:
 new bfe1c5d456a Updating config from bot
bfe1c5d456a is described below

commit bfe1c5d456a280abe8e2aa44577f2af415c056f0
Author: github-actions 
AuthorDate: Thu Jan 19 09:27:49 2023 +

Updating config from bot
---
 scripts/ci/pr-bot/state/pr-state/pr-25034.json | 8 
 1 file changed, 8 insertions(+)

diff --git a/scripts/ci/pr-bot/state/pr-state/pr-25034.json 
b/scripts/ci/pr-bot/state/pr-state/pr-25034.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-25034.json
@@ -0,0 +1,8 @@
+{
+  "commentedAboutFailingChecks": false,
+  "reviewersAssignedForLabels": {},
+  "nextAction": "Author",
+  "stopReviewerNotifications": true,
+  "remindAfterTestsPass": [],
+  "committerAssigned": false
+}
\ No newline at end of file

56 matches

Mail list logo