[beam] branch master updated (63c2d14b9ca -> c14a4cf8779)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 63c2d14b9ca [BEAM-14073] [CdapIO] CDAP IO for batch plugins: Read, Write. Unit tests included (#21765) add c14a4cf8779 [Fix #22151] Add fhirio.Deidentify transform (#22152) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/io/fhirio/common.go | 90 +++-- sdks/go/pkg/beam/io/fhirio/common_test.go | 68 ++ sdks/go/pkg/beam/io/fhirio/deidentify.go | 95 + sdks/go/pkg/beam/io/fhirio/deidentify_test.go | 56 sdks/go/pkg/beam/io/fhirio/execute_bundles_test.go | 6 +- sdks/go/pkg/beam/io/fhirio/read_test.go| 6 +- sdks/go/pkg/beam/io/fhirio/search_test.go | 11 +- sdks/go/pkg/beam/io/fhirio/utils_test.go | 33 +++-- sdks/go/test/integration/integration.go| 10 +- sdks/go/test/integration/io/fhirio/fhirio_test.go | 148 ++--- 10 files changed, 404 insertions(+), 119 deletions(-) create mode 100644 sdks/go/pkg/beam/io/fhirio/common_test.go create mode 100644 sdks/go/pkg/beam/io/fhirio/deidentify.go create mode 100644 sdks/go/pkg/beam/io/fhirio/deidentify_test.go
[beam] branch master updated: Fix #21977: Add Search transform to Go FhirIO (#21979)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 32efddcf6d7 Fix #21977: Add Search transform to Go FhirIO (#21979)
32efddcf6d7 is described below
commit 32efddcf6d716412ef3c4878ea95229d35bba5f5
Author: Lucas Nogueira
AuthorDate: Thu Jun 30 21:04:50 2022 -0400
Fix #21977: Add Search transform to Go FhirIO (#21979)
* parent 2574f9106c75e413310dcb7756952889da3fe7cd
author Lucas Nogueira 1655155614 +
committer Lucas Nogueira 1655882203 +
parent 2574f9106c75e413310dcb7756952889da3fe7cd
author Lucas Nogueira 1655155614 +
committer Lucas Nogueira 1655882058 +
squashed rebase conflict commits
add execute bundles transform with integration test
adjust import to follow convention
fix variable scope
adjust read unit tests
add comment to execute bundles transform
include error reason
make variable exported to fix integration test
adjust integration tests after merge
update license comment
add comment explaining the purpose of unexported transform function
remove unnecessary generic usage
remove coded mistakenly added
improve transaction vs batch bundle comment
use net/http constants instead of hardcoded values
adjust import spacing
improve error message
* add search transform
* extract content of lambda to function
* add integration tests
* improve naming and fix IDE warnings
* use more appropriate function to check for status
* add documentation and improve member variable name
* add unit tests
* use while loop style to shorten line
* run integration tests in same pipeline
* fix integration test on dataflow and make it cleaner
* add pagination test and improve test utils
* fix search request when resourceType is empty
* improve readability of pagination logic
* log upon nondetrimental errors
* add retry mechanism to prevent flaky test results
* remove backoff retry on read transform test since it should never be flaky
* add dummy content to resource to improve readability
* adjust spacing for consistency
---
sdks/go/data/fhir_bundles/transaction-success.json | 86 +--
sdks/go/pkg/beam/io/fhirio/common.go | 85 ++-
sdks/go/pkg/beam/io/fhirio/execute_bundles.go | 20 ++-
sdks/go/pkg/beam/io/fhirio/execute_bundles_test.go | 24 +--
sdks/go/pkg/beam/io/fhirio/read.go | 8 +-
sdks/go/pkg/beam/io/fhirio/read_test.go| 8 +-
sdks/go/pkg/beam/io/fhirio/search.go | 168 +
sdks/go/pkg/beam/io/fhirio/search_test.go | 106 +
sdks/go/pkg/beam/io/fhirio/utils_test.go | 63 +---
sdks/go/test/integration/io/fhirio/fhirio_test.go | 48 ++
10 files changed, 526 insertions(+), 90 deletions(-)
diff --git a/sdks/go/data/fhir_bundles/transaction-success.json
b/sdks/go/data/fhir_bundles/transaction-success.json
index c95e0b19344..a4946b36a2e 100644
--- a/sdks/go/data/fhir_bundles/transaction-success.json
+++ b/sdks/go/data/fhir_bundles/transaction-success.json
@@ -5,20 +5,48 @@
{
"request": {
"method": "POST",
-"url": "Patient"
+"url": "Organization"
},
"resource": {
-"name": [
+"resourceType": "Organization",
+"id": "b0e04623-b02c-3f8b-92ea-943fc4db60da",
+"identifier": [
{
-"use": "official",
-"given": [
- "John"
-]
+"system": "https://github.com/synthetichealth/synthea;,
+"value": "b0e04623-b02c-3f8b-92ea-943fc4db60da"
}
],
-"gender": "male",
-"birthDate": "1973-01-21",
-"resourceType": "Patient"
+"active": true,
+"type": [
+ {
+"coding": [
+ {
+"system":
"http://terminology.hl7.org/CodeSystem/organization-type;,
+"code": "prov",
+"display": "Healthcare Provider"
+ }
+],
+"text": "Healthcare Provider"
+ }
+],
+"name": "LOWELL GENERAL HOSPITAL",
+"t
[beam] 01/01: Merge pull request #22056: checkStlye Fix: remove redundant static and public in interface. camel naming
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 0c1809925b2b9a0fab83a39f7630f1d2c4408889 Merge: be211cbe3d5 764f4a3d311 Author: Daniel Oliveira AuthorDate: Fri Jun 24 16:01:48 2022 -0700 Merge pull request #22056: checkStlye Fix: remove redundant static and public in interface. camel naming checkStlye Fix: remove redundant static and public in interface. camel naming .../org/apache/beam/fn/harness/jmh/CombinerTableBenchmark.java | 8 .../org/apache/beam/fn/harness/PrecombineGroupingTable.java| 10 +- 2 files changed, 9 insertions(+), 9 deletions(-)
[beam] branch master updated (be211cbe3d5 -> 0c1809925b2)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from be211cbe3d5 Fix DEADLINE_EXCEEDED flakiness (#22035) add 764f4a3d311 checkStlye Fix: remove redundant static and public in interface. camel naming new 0c1809925b2 Merge pull request #22056: checkStlye Fix: remove redundant static and public in interface. camel naming The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../org/apache/beam/fn/harness/jmh/CombinerTableBenchmark.java | 8 .../org/apache/beam/fn/harness/PrecombineGroupingTable.java| 10 +- 2 files changed, 9 insertions(+), 9 deletions(-)
[beam] branch master updated: Add ExecuteBundles transform to Go FhirIO (#21840)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new b9d99405aba Add ExecuteBundles transform to Go FhirIO (#21840)
b9d99405aba is described below
commit b9d99405abaf74889eb9cf05eec4d67ea275a6b4
Author: Lucas Nogueira
AuthorDate: Tue Jun 21 20:30:22 2022 -0400
Add ExecuteBundles transform to Go FhirIO (#21840)
* squashed rebase conflict commits
* add execute bundles transform with integration test
* adjust import to follow convention
* fix variable scope
* adjust read unit tests
* fix bad status test case
* improve read unit test assertions and naming
* add unit tests
* add comment to execute bundles transform
* include error reason
* make variable exported to fix integration test
* adjust integration tests after merge
* update license comment
* unify unit test utilities in single file
* add comment explaining the purpose of unexported transform function
* remove unnecessary generic usage
* remove coded mistakenly added
* improve transaction vs batch bundle comment
* use net/http constants instead of hardcoded values
* return error instead of t.Fail inside helper function
* improve execute bundles DoFn identifier
* adjust import spacing
* improve error message
---
sdks/go/pkg/beam/io/fhirio/common.go | 56
sdks/go/pkg/beam/io/fhirio/execute_bundles.go | 146 +
sdks/go/pkg/beam/io/fhirio/execute_bundles_test.go | 82
sdks/go/pkg/beam/io/fhirio/fakes_test.go | 39 --
sdks/go/pkg/beam/io/fhirio/read.go | 45 +++
sdks/go/pkg/beam/io/fhirio/read_test.go| 55 ++--
sdks/go/pkg/beam/io/fhirio/utils_test.go | 107 +++
sdks/go/test/integration/io/fhirio/fhirio_test.go | 46 +--
8 files changed, 456 insertions(+), 120 deletions(-)
diff --git a/sdks/go/pkg/beam/io/fhirio/common.go
b/sdks/go/pkg/beam/io/fhirio/common.go
index 98bc10e3306..666f9d6f0e0 100644
--- a/sdks/go/pkg/beam/io/fhirio/common.go
+++ b/sdks/go/pkg/beam/io/fhirio/common.go
@@ -19,10 +19,16 @@
package fhirio
import (
+ "bytes"
"context"
+ "io"
"net/http"
+ "regexp"
+ "time"
+ "github.com/apache/beam/sdks/v2/go/pkg/beam"
"github.com/apache/beam/sdks/v2/go/pkg/beam/core"
+ "github.com/apache/beam/sdks/v2/go/pkg/beam/internal/errors"
"google.golang.org/api/healthcare/v1"
"google.golang.org/api/option"
)
@@ -32,8 +38,54 @@ const (
baseMetricPrefix = "fhirio/"
)
+func executeRequestAndRecordLatency(ctx context.Context, latencyMs
*beam.Distribution, requestSupplier func() (*http.Response, error))
(*http.Response, error) {
+ timeBeforeReadRequest := time.Now()
+ response, err := requestSupplier()
+ latencyMs.Update(ctx, time.Since(timeBeforeReadRequest).Milliseconds())
+ return response, err
+}
+
+func extractBodyFrom(response *http.Response) (string, error) {
+ if isBadStatusCode(response.Status) {
+ return "", errors.Errorf("response contains bad status: [%v]",
response.Status)
+ }
+
+ bodyBytes, err := io.ReadAll(response.Body)
+ if err != nil {
+ return "", err
+ }
+
+ return string(bodyBytes), nil
+}
+
+func isBadStatusCode(status string) bool {
+ // 2XXs are successes, otherwise failure.
+ isMatch, err := regexp.MatchString("^2\\d{2}", status)
+ if err != nil {
+ return true
+ }
+ return !isMatch
+}
+
+type fhirioFnCommon struct {
+ clientfhirStoreClient
+ resourcesErrorCount beam.Counter
+ resourcesSuccessCount beam.Counter
+ latencyMs beam.Distribution
+}
+
+func (fnc *fhirioFnCommon) setup(namespace string) {
+ if fnc.client == nil {
+ fnc.client = newFhirStoreClient()
+ }
+ fnc.resourcesErrorCount = beam.NewCounter(namespace,
baseMetricPrefix+"resource_error_count")
+ fnc.resourcesSuccessCount = beam.NewCounter(namespace,
baseMetricPrefix+"resource_success_count")
+ fnc.latencyMs = beam.NewDistribution(namespace,
baseMetricPrefix+"latency_ms")
+}
+
type fhirStoreClient interface {
readResource(resourcePath string) (*http.Response, error)
+ executeBundle(storePath string, bundle []byte) (*http.Response, error)
}
type fhirStoreClientImpl struct {
@@ -51,3 +103,7 @@ f
[beam] branch master updated: [BEAM-13806] Add x-lang BigQuery IO integration test to Go SDK. (#16818)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 080f54a144a [BEAM-13806] Add x-lang BigQuery IO integration test to Go
SDK. (#16818)
080f54a144a is described below
commit 080f54a144a5751c7ab43aadb2fb87b8d49970d0
Author: Daniel Oliveira
AuthorDate: Mon Jun 13 21:21:26 2022 -0700
[BEAM-13806] Add x-lang BigQuery IO integration test to Go SDK. (#16818)
* [BEAM-13806] Add x-lang BigQuery IO integration test to Go SDK.
Also includes piping in flags for BigQuery IO through integration test
script, and a small file for creating bigquery tables that expire after a day.
* [BEAM-13806] Splitting BigQuery IT into read and write pipelines.
Splits the integration test into two pipelines to run sequentially. Also
drops table after a successful test and logs table names.
* Fixup: Fix gradle build and undo VR script changes.
* Fixup: Add Query test and fix deterministic random element generation.
CreateRows wasn't creating the same elements in both read and write
pipelines after splitting the two pipelines. Adjusted it to use a consistent
seed in all pipelines.
* Fixup: Avoiding inline functions
* Workaround to coder issue, plus some debugging code
* Polishing workaround with documentation and removing debug prints.
* Move pipeline code to test file
* Split Query test from non-query test
Co-authored-by: Robert Burke
---
sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go | 7 +
sdks/go/test/build.gradle | 4 +
sdks/go/test/integration/flags.go | 5 +
sdks/go/test/integration/integration.go| 11 +
.../test/integration/io/xlang/bigquery/bigquery.go | 17 ++
.../integration/io/xlang/bigquery/bigquery_test.go | 270 +
.../go/test/integration/io/xlang/bigquery/table.go | 52
7 files changed, 366 insertions(+)
diff --git a/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go
b/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go
index 19f2d626a77..6bfc8939106 100644
--- a/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go
+++ b/sdks/go/pkg/beam/io/xlang/bigqueryio/bigquery.go
@@ -187,8 +187,15 @@ func FromTable(table string) readOption {
// FromQuery is a Read option that specifies a query to use for reading from
BigQuery. Uses the
// BigQuery Standard SQL dialect.
//
+// Important: When reading from a query, the schema of any source tables is
not used and the read
+// transform cannot detect which elements are Required, therefore every field
in the output type
+// will be a pointer (including fields within inner structs).
+//
// For more details see in the Java SDK:
//
org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO.Read.fromQuery(java.lang.String)
+//
+// BUG(https://github.com/apache/beam/issues/21784): Query read outputs
currently cannot be named
+// struct types. See link for workaround.
func FromQuery(query string) readOption {
return func(rc *readConfig) {
rc.cfg.Query =
diff --git a/sdks/go/test/build.gradle b/sdks/go/test/build.gradle
index 28e8c548285..4ea0c57f858 100644
--- a/sdks/go/test/build.gradle
+++ b/sdks/go/test/build.gradle
@@ -173,18 +173,22 @@ ext.goIoValidatesRunnerTask = { proj, name, scriptOpts,
pipelineOpts ->
dependsOn ":sdks:java:io:expansion-service:build"
dependsOn ":sdks:java:extensions:schemaio-expansion-service:build"
dependsOn ":sdks:java:io:debezium:expansion-service:build"
+dependsOn ":sdks:java:io:google-cloud-platform:expansion-service:build"
dependsOn ":sdks:java:testing:kafka-service:buildTestKafkaServiceJar"
doLast {
def ioExpJar =
project(":sdks:java:io:expansion-service").shadowJar.archivePath
def schemaIoExpJar =
project(":sdks:java:extensions:schemaio-expansion-service").shadowJar.archivePath
def debeziumIoExpJar =
project(":sdks:java:io:debezium:expansion-service").shadowJar.archivePath
+ def gcpIoExpJar =
project(":sdks:java:io:google-cloud-platform:expansion-service").shadowJar.archivePath
def kafkaJar =
project(":sdks:java:testing:kafka-service:").buildTestKafkaServiceJar.archivePath
def pipelineOptions = [ // Pipeline options piped directly to Go SDK
flags.
"--kafka_jar=${kafkaJar}",
"--expansion_jar=io:${ioExpJar}",
"--expansion_jar=schemaio:${schemaIoExpJar}",
"--expansion_jar=debeziumio:${debeziumIoExpJar}",
+ "--expansion_jar=gcpio:${gcpIoExpJar}",
+ "--bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp",
]
[beam] branch master updated (4c6c969a131 -> ca27853eb1c)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 4c6c969a131 Merge pull request #21823 from kileys/test_jenkins
add ca27853eb1c [BEAM-14532] Add integration testing to fhirio Read
transform (#17803)
No new revisions were added by this update.
Summary of changes:
.../data/fhir_bundles}/batch-success-failure.json | 0
.../data/fhir_bundles}/transaction-failure.json| 0
.../data/fhir_bundles}/transaction-success.json| 0
sdks/go/pkg/beam/io/fhirio/common.go | 4 +-
sdks/go/pkg/beam/io/fhirio/read_test.go| 17 +-
sdks/go/test/integration/integration.go| 10 +
sdks/go/test/integration/io/fhirio/fhirio_test.go | 212 +
7 files changed, 236 insertions(+), 7 deletions(-)
copy sdks/{java/io/google-cloud-platform/src/test/resources/BUNDLE_PARSE_TEST
=> go/data/fhir_bundles}/batch-success-failure.json (100%)
copy sdks/{java/io/google-cloud-platform/src/test/resources/BUNDLE_PARSE_TEST
=> go/data/fhir_bundles}/transaction-failure.json (100%)
copy sdks/{java/io/google-cloud-platform/src/test/resources/BUNDLE_PARSE_TEST
=> go/data/fhir_bundles}/transaction-success.json (100%)
create mode 100644 sdks/go/test/integration/io/fhirio/fhirio_test.go
[beam] branch master updated: [BEAM-14513] Add read transform and initial healthcare client (#17748)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 4e2565a2848 [BEAM-14513] Add read transform and initial healthcare
client (#17748)
4e2565a2848 is described below
commit 4e2565a2848f84a28746ace0287800af3e93a2e4
Author: Lucas Nogueira
AuthorDate: Wed Jun 1 17:20:56 2022 +
[BEAM-14513] Add read transform and initial healthcare client (#17748)
* initial fhirio go sdk commit - client + read transform
* add license comment
* improve error message
* rename import to follow convention
* add metrics
* follow import convention
* renames and simplify folder structure
* fix import to follow standard
* add comments
* improve variable naming
* adjust comment formatting
* remove unnecessary named import
* adjust naming for consistency
* use forward declarations for metrics
* improve error messages to follow go style
* improve metrics assertions
* simplify function signature
* use optimized register function
* rollback settings changes commit mistakenly
* use time.Since for staticcheck
---
sdks/go/pkg/beam/io/fhirio/common.go | 53 +
sdks/go/pkg/beam/io/fhirio/fakes_test.go | 39 +
sdks/go/pkg/beam/io/fhirio/read.go | 98
sdks/go/pkg/beam/io/fhirio/read_test.go | 90 +
4 files changed, 280 insertions(+)
diff --git a/sdks/go/pkg/beam/io/fhirio/common.go
b/sdks/go/pkg/beam/io/fhirio/common.go
new file mode 100644
index 000..8156b42ab35
--- /dev/null
+++ b/sdks/go/pkg/beam/io/fhirio/common.go
@@ -0,0 +1,53 @@
+// Licensed to the Apache Software Foundation (ASF) under one or more
+// contributor license agreements. See the NOTICE file distributed with
+// this work for additional information regarding copyright ownership.
+// The ASF licenses this file to You under the Apache License, Version 2.0
+// (the "License"); you may not use this file except in compliance with
+// the License. You may obtain a copy of the License at
+//
+//http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+// Package fhirio provides an API for reading and writing resources to Google
+// Cloud Healthcare Fhir stores.
+// Experimental.
+package fhirio
+
+import (
+ "context"
+ "net/http"
+
+ "github.com/apache/beam/sdks/v2/go/pkg/beam/core"
+ "google.golang.org/api/healthcare/v1"
+ "google.golang.org/api/option"
+)
+
+const (
+ baseMetricPrefix = "fhirio/"
+ userAgent= "apache-beam-io-google-cloud-platform-healthcare/" +
core.SdkVersion
+)
+
+type fhirStoreClient interface {
+ readResource(resourcePath string) (*http.Response, error)
+}
+
+type fhirStoreClientImpl struct {
+ fhirService *healthcare.ProjectsLocationsDatasetsFhirStoresFhirService
+}
+
+func newFhirStoreClient() *fhirStoreClientImpl {
+ healthcareService, err := healthcare.NewService(context.Background(),
option.WithUserAgent(userAgent))
+ if err != nil {
+ panic("Failed to initialize Google Cloud Healthcare Service.
Reason: " + err.Error())
+ }
+ return {fhirService:
healthcare.NewProjectsLocationsDatasetsFhirStoresFhirService(healthcareService)}
+}
+
+func (c *fhirStoreClientImpl) readResource(resourcePath string)
(*http.Response, error) {
+ return c.fhirService.Read(resourcePath).Do()
+}
diff --git a/sdks/go/pkg/beam/io/fhirio/fakes_test.go
b/sdks/go/pkg/beam/io/fhirio/fakes_test.go
new file mode 100644
index 000..4e1a51aeb23
--- /dev/null
+++ b/sdks/go/pkg/beam/io/fhirio/fakes_test.go
@@ -0,0 +1,39 @@
+// Licensed to the Apache Software Foundation (ASF) under one or more
+// contributor license agreements. See the NOTICE file distributed with
+// this work for additional information regarding copyright ownership.
+// The ASF licenses this file to You under the Apache License, Version 2.0
+// (the "License"); you may not use this file except in compliance with
+// the License. You may obtain a copy of the License at
+//
+//http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT
[beam] 01/01: Merge pull request #17751: Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 9dea7ebd8fc046364453261d916c9f902bb8ed56 Merge: 25039a8aea8 46ca24304b3 Author: Daniel Oliveira AuthorDate: Thu May 26 18:13:08 2022 -0700 Merge pull request #17751: Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks sdks/go.mod | 16 sdks/go.sum | 31 +++ 2 files changed, 31 insertions(+), 16 deletions(-)
[beam] branch master updated (25039a8aea8 -> 9dea7ebd8fc)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 25039a8aea8 Merge pull request #17423: Handle invalid rows in the Storage Api sink add 46ca24304b3 Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks new 9dea7ebd8fc Merge pull request #17751: Bump google.golang.org/api from 0.76.0 to 0.81.0 in /sdks The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/go.mod | 16 sdks/go.sum | 31 +++ 2 files changed, 31 insertions(+), 16 deletions(-)
[beam] branch master updated (45f2dd1e710 -> fd854635552)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 45f2dd1e710 Merge pull request #17720: Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks add 9bcc1ce0279 Fix 2.38.0 download page. add fd854635552 Merge pull request #17759: Fix 2.38.0 download page. No new revisions were added by this update. Summary of changes: website/www/site/content/en/get-started/downloads.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
[beam] 01/01: Merge pull request #17720: Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 45f2dd1e7100c6616aedc9b0c2c333a88ea30839 Merge: 4cf268e64c7 f450881f3f7 Author: Daniel Oliveira AuthorDate: Wed May 25 16:03:10 2022 -0700 Merge pull request #17720: Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks sdks/go.mod | 4 ++-- sdks/go.sum | 7 +-- 2 files changed, 7 insertions(+), 4 deletions(-)
[beam] branch master updated (4cf268e64c7 -> 45f2dd1e710)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 4cf268e64c7 Merge pull request #17568 [BEAM-14426] Allow skipping of any output when writing an empty PCollection. add f450881f3f7 Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks new 45f2dd1e710 Merge pull request #17720: Bump cloud.google.com/go/storage from 1.22.0 to 1.22.1 in /sdks The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/go.mod | 4 ++-- sdks/go.sum | 7 +-- 2 files changed, 7 insertions(+), 4 deletions(-)
[beam] branch master updated: [BEAM-14440] Add basic fuzz tests to the coders package (#17587)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 341a8364f36 [BEAM-14440] Add basic fuzz tests to the coders package
(#17587)
341a8364f36 is described below
commit 341a8364f361b7d4d5dbd3f8b9c7bf4bc02f52a4
Author: Jack McCluskey <34928439+jrmcclus...@users.noreply.github.com>
AuthorDate: Mon May 16 13:46:20 2022 -0400
[BEAM-14440] Add basic fuzz tests to the coders package (#17587)
* UTF8 fuzz test
* Ints fuzz tests
* Bytes fuzz tests
* Double fuzz test
* Move fuzz tests to standalone test file
---
.../pkg/beam/core/graph/coder/coder_fuzz_test.go | 129 +
1 file changed, 129 insertions(+)
diff --git a/sdks/go/pkg/beam/core/graph/coder/coder_fuzz_test.go
b/sdks/go/pkg/beam/core/graph/coder/coder_fuzz_test.go
new file mode 100644
index 000..11c516f7378
--- /dev/null
+++ b/sdks/go/pkg/beam/core/graph/coder/coder_fuzz_test.go
@@ -0,0 +1,129 @@
+// Licensed to the Apache Software Foundation (ASF) under one or more
+// contributor license agreements. See the NOTICE file distributed with
+// this work for additional information regarding copyright ownership.
+// The ASF licenses this file to You under the Apache License, Version 2.0
+// (the "License"); you may not use this file except in compliance with
+// the License. You may obtain a copy of the License at
+//
+//http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package coder
+
+import (
+ "bytes"
+ "math"
+ "strings"
+ "testing"
+
+ "github.com/google/go-cmp/cmp"
+)
+
+func FuzzEncodeDecodeBytes(f *testing.F) {
+ f.Add([]byte{10})
+ f.Fuzz(func(t *testing.T, b []byte) {
+ var buf bytes.Buffer
+ err := EncodeBytes(b, )
+ if err != nil {
+ return
+ }
+
+ got, err := DecodeBytes()
+ if err != nil {
+ t.Fatalf("failed to decode bytes, got %v", err)
+ }
+
+ if d := cmp.Diff(got, b); d != "" {
+ t.Errorf("decoded output does not match input: got %v,
want %v", got, b)
+ }
+ })
+}
+
+const floatPrecision = float64(0.001)
+
+func FuzzEncodeDecodeDouble(f *testing.F) {
+ f.Add(float64(3.141))
+ f.Fuzz(func(t *testing.T, a float64) {
+ var buf bytes.Buffer
+ err := EncodeDouble(a, )
+ if err != nil {
+ return
+ }
+
+ actual, err := DecodeDouble()
+ if err != nil {
+ t.Fatalf("DecodeDouble(%v) failed: %v", buf, err)
+ }
+ if math.Abs(actual-a) > floatPrecision {
+ t.Fatalf("got %f, want %f +/- %f", actual, a,
floatPrecision)
+ }
+ })
+}
+
+func FuzzEncodeDecodeUInt64(f *testing.F) {
+ f.Add(uint64(42))
+ f.Fuzz(func(t *testing.T, b uint64) {
+ var buf bytes.Buffer
+ err := EncodeUint64(b, )
+ if err != nil {
+ return
+ }
+
+ got, err := DecodeUint64()
+ if err != nil {
+ t.Fatalf("failed to decode bytes, got %v", err)
+ }
+
+ if got != b {
+ t.Errorf("decoded output does not match input: got %v,
want %v", got, b)
+ }
+ })
+}
+
+func FuzzEncodeDecodeInt32(f *testing.F) {
+ f.Add(int32(42))
+ f.Fuzz(func(t *testing.T, b int32) {
+ var buf bytes.Buffer
+ err := EncodeInt32(b, )
+ if err != nil {
+ return
+ }
+
+ got, err := DecodeInt32()
+ if err != nil {
+ t.Fatalf("failed to decode bytes, got %v", err)
+ }
+
+ if got != b {
+ t.Errorf("decoded output does not match input: got %v,
want %v", got, b)
+ }
+ })
+}
+
+func FuzzEncodeDecodeStringUTF8LP(f *testing.F) {
+ for _, s := range testValues {
+ f.Add(s)
+ }
+ f.Fuzz(func(t *testing.T, b string) {
+ var build strings.Builder
+
[beam] branch master updated (cb680295254 -> 39de4b2c3af)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from cb680295254 Merge pull request #17341 [BEAM-1754] Adds experimental Typescript Beam SDK add 099ff6317bc Delete tags.go add 39de4b2c3af Merge pull request #17541: [BEAM-14059] Delete tags.go No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/core/util/reflectx/tags.go | 89 - 1 file changed, 89 deletions(-) delete mode 100644 sdks/go/pkg/beam/core/util/reflectx/tags.go
[beam] annotated tag v2.38.0 updated (93fd177d43f -> bd837962ff8)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag v2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.38.0 was modified! *** from 93fd177d43f (commit) to bd837962ff8 (tag) tagging d20f07587aa9a267c4b01c60bf966d4108e0e466 (tag) length 161 bytes by Daniel Oliveira on Wed Apr 20 15:56:27 2022 -0700 - Log - Tag for 2.38.0 release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJgj64ACgkQxOay+Mcd dC+rOQ//aoxP+CWuKVq+lqXTFUjhRUENGieo/nyHl5ZODlAciOgLA7I6gawhSY1Q AN4e3714ETht5DqA6BnP/rBFN0LOZfx8fz4uduYVcjEcm1oHfPgz/dR1P1m8QxKn cA5kSWWJqgLuMJRUtMHcjUhnFvblnu90Z8/c4fDv3XfVRtNQuT+4BiAnegoqyiPz lbD7wUy7X1AuAxK4dVwlF5IYJ6ole4MnjZpiTEAcmodG+B6Oku0pdzyasqS0PieL ehO/cB1eA+GdE+WzFWx1Lu6KDeisFQQ+K0tn8jvHQL/iB5Fh/E8+jd0DHrCBx9/3 xytx+vxhakbcfTZjH6mveNTKOinvLDgd5KtltOa+E8hgOih3trV1re4Lt+dPk38+ 1nlZ049j3Z9aRLdsygqRE/P6KroudUYPJ+dBhz/m/kyGzkHQLNVSOfdwa7LXhUlE f72zIUGlLH3BvS4tFidH+a4bOa2CpbG+qPhxKkvX1eLB131HM461t5EtyQSCirR3 6UtEzTk5s1svinaCwSu3DFjDC/b7d2IfbNeIRZuLbuhRKZmd8VVoZyZzu+/OeQuU 84w4rPA3sAUTX9ILBG/4qKkPUeUZBQ1i6NvMi+4L4iqOB6mxonqUpj4M/fs6sskC 68qXpa5phqj5ItRt5N2BRdqnjm6K3uxWPS5J585XBtQDbzI+MIQ= =/Waz -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag sdks/v2.38.0 updated (93fd177d43f -> fd959998792)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag sdks/v2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag sdks/v2.38.0 was modified! *** from 93fd177d43f (commit) to fd959998792 (tag) tagging d20f07587aa9a267c4b01c60bf966d4108e0e466 (tag) length 161 bytes by Daniel Oliveira on Wed Apr 20 15:53:17 2022 -0700 - Log - Tag for Go 2.38.0 release -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJgjx8ACgkQxOay+Mcd dC/ZCg//XynjnSnGGDt6cTuAvcU6Wcmnpo7RjOBcmJV8W3n6wNLyHK91QxQypcsl n9dxY0euO6ySVkvEhpR2q1r4xxTu/k5ZMEkE5kcZ1/LFAP/MkIHILen4jkpZ1GGw INgrom9D4TpIOE3vUvwWrtMknIh4FsgX2U3IzHWHWPRScL37jyTnsGGjhed1Jqhg vXsjagwxdPW6us59/u5rV6GejbisBTdIRVkV7V9pm/A0hN+XqFu6vnq1eYGfIzp4 YuJtAPtGb10t/9MA660TgCrBnlAoDLUSUFm6rxHC7XnSX09ID/n9VEJNj2RZMXe9 6RWoy3O/H9BSQV7r0QaU4hTHG2M41iNN3fgzAe04Lg4nkPPll6OpZGpir3nMBS47 q7IH2hQ1S/Q40fvIXg9rBesvCaNiJe4tsj76Ohd68ytQfIBb9wX71dL+pOvZdbcU GYri81B1yldY+h7GNvWNjk7j4lCyziYSdZtX5zU3zfsauyE1u8xWRL/GKw2gBOP1 dOAtj8WylpF/SwkI+vaRBvuxaCFzJnhM+KiBgxX23SzeXXdZmvSDkhBSx71/BjY5 e5fuetcR5cVRwaKA6XrMH+d7CFhfpq/sC6KQRjLG01eSc2VuGXshaR9dNWKHmo8O vTz+AUZpkPlkZvhWV4ZdX4ftyfl90dkwTJJ5uel5P7qoNOiJgV4= =Vuf7 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
[beam] branch master updated: Update Beam website to release 2.38.0 (#17378)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 5a351bb5e93 Update Beam website to release 2.38.0 (#17378) 5a351bb5e93 is described below commit 5a351bb5e93661f65fd519751894be4e4e55d81d Author: Daniel Oliveira AuthorDate: Wed Apr 20 15:48:18 2022 -0700 Update Beam website to release 2.38.0 (#17378) Update Beam website to release 2.38.0 --- CHANGES.md | 15 +- website/www/site/config.toml | 2 +- website/www/site/content/en/blog/beam-2.38.0.md| 164 + .../www/site/content/en/get-started/downloads.md | 50 --- 4 files changed, 195 insertions(+), 36 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index 5dd1fde25a4..8168402c859 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -82,19 +82,11 @@ * ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). -# [2.38.0] - Unreleased - -## Highlights - -* New highly anticipated feature X added to Python SDK ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). -* New highly anticipated feature Y added to Java SDK ([BEAM-Y](https://issues.apache.org/jira/browse/BEAM-Y)). +# [2.38.0] - 2022-04-20 ## I/Os * Introduce projection pushdown optimizer to the Java SDK ([BEAM-12976](https://issues.apache.org/jira/browse/BEAM-12976)). The optimizer currently only works on the [BigQuery Storage API](https://beam.apache.org/documentation/io/built-in/google-bigquery/#storage-api), but more I/Os will be added in future releases. If you encounter a bug with the optimizer, please file a JIRA and disable the optimizer using pipeline option `--experiments=disable_projection_pushdown`. - * A new IO for Neo4j graph databases was added. ([BEAM-1857](https://issues.apache.org/jira/browse/BEAM-1857)) It has the ability to update nodes and relationships using UNWIND statements and to read data using cypher statements with parameters. - -* Support for X source added (Java/Python) ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). * `amazon-web-services2` has reached feature parity and is finally recommended over the earlier `amazon-web-services` and `kinesis` modules (Java). These will be deprecated in one of the next releases ([BEAM-13174](https://issues.apache.org/jira/browse/BEAM-13174)). * Long outstanding write support for `Kinesis` was added ([BEAM-13175](https://issues.apache.org/jira/browse/BEAM-13175)). * Configuration was simplified and made consistent across all IOs, including the usage of `AwsOptions` ([BEAM-13563](https://issues.apache.org/jira/browse/BEAM-13563), [BEAM-13663](https://issues.apache.org/jira/browse/BEAM-13663), [BEAM-13587](https://issues.apache.org/jira/browse/BEAM-13587)). @@ -119,7 +111,6 @@ * Beam 2.38.0 will be the last minor release to support Flink 1.11. * (`amazon-web-services2`) Client providers (`withXYZClientProvider()`) as well as IO specific `RetryConfiguration`s are deprecated, instead use `withClientConfiguration()` or `AwsOptions` to configure AWS IOs / clients. Custom implementations of client providers shall be replaced with a respective `ClientBuilderFactory` and configured through `AwsOptions` ([BEAM-13563](https://issues.apache.org/jira/browse/BEAM-13563)). -* X behavior is deprecated and will be removed in X versions ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). ## Bugfixes @@ -128,10 +119,6 @@ * This caused unnecessarily long pre-processing times before job submission for large complex pipelines. * Fix `pyarrow` version parsing (Python)([BEAM-14235](https://issues.apache.org/jira/browse/BEAM-14235)) -## Known Issues - -* ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). - # [2.37.0] - 2022-03-04 ## Highlights diff --git a/website/www/site/config.toml b/website/www/site/config.toml index e9d927ea84d..b4f036ee171 100644 --- a/website/www/site/config.toml +++ b/website/www/site/config.toml @@ -104,7 +104,7 @@ github_project_repo = "https://github.com/apache/beam; [params] description = "Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud service). Be [...] -release_latest = "2.37.0" +release_latest = "2.38.0" # The repository and branch where the files live in Github or Colab. This is used # to serve and stage from your local branch, but publish to the master branch. # e.g. https://gi
[beam] 01/01: Merge pull request #17405: [BEAM-1857] CHANGES.md entry for 2.38.0
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 02e53e3a44597c01f2a9bc977822b2fcbf78b4a3 Merge: 0c6d522f03f 5ecd5a5e2ff Author: Daniel Oliveira AuthorDate: Wed Apr 20 13:27:42 2022 -0700 Merge pull request #17405: [BEAM-1857] CHANGES.md entry for 2.38.0 [BEAM-1857] CHANGES.md entry for 2.38.0 CHANGES.md | 2 ++ 1 file changed, 2 insertions(+)
[beam] branch master updated (0c6d522f03f -> 02e53e3a445)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 0c6d522f03f [BEAM-14328] Tweaks to "Differences from pandas" page (#17413) add 5ecd5a5e2ff BEAM-1857 : CHANGES.md entry for 2.38.0 new 02e53e3a445 Merge pull request #17405: [BEAM-1857] CHANGES.md entry for 2.38.0 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: CHANGES.md | 2 ++ 1 file changed, 2 insertions(+)
svn commit: r53785 [2/2] - /dev/beam/2.38.0/python/
Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.asc == --- dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.asc (original) +++ dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.asc Wed Apr 13 01:03:28 2022 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJUeiAACgkQxOay+Mcd -dC988w/9E+LdL1nynmbO8KJzTRoIn1JYC/3HDqAi6oHYXTATWNHF0Kx/J+5LZIQS -yyHLKBmQqSb9sdfYgp7OYEtlBdTnVfgcd+zsNxCe/4vKHoON+J5/jJtmcS9osR6f -L1ZkzsB45uH3lNH5zKls9rRbIf5uqo9X1ZpBAowfNzCK4vdfpKupCTT/hYoqidDM -Dhjko4RCfwhy5YSwfugte/LWBd3oWS3HXFGOkEOmMizuhJbTNqhfMQvQzULj3nFp -g4uGr2xugb3b5zbv15qYnyGRpx1Qadk944BrSWSPJJpS0czYFLQmOyUHLr+T9td4 -yLsAalicn3OQAFygPMA6yXVGofoQu2AMl+nYVGfr2z8X54nI4E53/a/XZNFA0PXZ -BQz/FmiW1n6+rRczViMT5KnZiueHyca5QMfzCN76xwaeFjBNcQq27HZT6S1ONeCK -JWt4Ith+JYAajY4zdmx1oIbDlXQTDit5b1Eclm2zNhbk2Kl3Q0kv/gFf1fWrjOz9 -8Dtt/6QVdDssaJYbXFzVIrNHVklaSHQszdZ67odXi9MM9Pnr1uFMDFthCF+ZhxIZ -8X6NWWDAvL/Bv5wViZef1XW/74YZ+mkXK5bsBhn2SPXjnO4lyOG+mhagfSomiL4Y -fVqA/QFWglj0x+tKy3SKIxgPZSALgLDiqjlN9hDyr4qb/4/aQmI= -=WCNG +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJWH+8ACgkQxOay+Mcd +dC9UcQ//RYF+UBMvV3ESX7P8eR6DLSd6eQj0ziUAV8W1cwbqG57LGVTn/a9P7Xkl +VFYCjvWhzXzK9jt52jNKNC6NzUPbnu5b1VeeZfbaDjPS5hazMLc6BmWdluIOi645 +XaD86HSd3qKQoHy/obyGeKjVjYPJBPzYYuDGrFZwQdpsLItiq/B2iwqog8KGNdBU +fTZ7LV3m7+mXw5r7Cn5HWQOdIqHrJpcReHOMHdIedWVcSc6APps1s3HfvMaKhWwF +Em5a/Le0FWSOcKnUx1U5wmRF62kk+k2ma4duXIKtm21yFK7C/7YQFXjH/z5rYeVW +5vCnpWsFyrRRujKHRxtQKPhj/G4wzK332+C1BaVDiHDT+Vq24A63kCjzkd+Dcb6G +8gBFjMU+xts14Vg+kOGi2DT0RbItUPaqFraJ4BVaQLjJPOj2BhMsk2q8XqI5YLuG +5yMBMgMJMRr03oHwqLsJKkWcOtXSJDTmg0wwnoMpXTBpiaphfLDHflXvlJQ3ApBL +l85jvay81sB5KL6gA3FtPyZaoNSIsIkkhmjmOHXxcshBhxRHW9Pwu/3td2BYgzaS +6frhsU1laitLhq0MrxuvPD/S0HpCJJsO8goehRel9O3bJaSc209Om97B3MBfx97v +06OcjF8f9qQuYUTEwzUH1V0Ty84RVvqTgOdtZ/2fPIKkzO/xCeE= +=90yE -END PGP SIGNATURE- Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.sha512 == --- dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.sha512 (original) +++ dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.sha512 Wed Apr 13 01:03:28 2022 @@ -1 +1 @@ -32c4d41c89074e88b3829f484819b6728b2793a9c7b01702a878a7f0bde28bbcabf7b67467ae16b0498590ca24cd2eda788497a24ff9f247cfb45584d0f6d837 apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl +62fdbd48c118cadd21a4223dc2a3c668b469b98c0a9d9a3f148a666e15f8446a8c315b719c5ad1e6c7c0c4ff7812c49461a929255d3a517e6e0a2193066f6240 apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl == Binary files - no diff available. Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl.asc == --- dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl.asc (original) +++ dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl.asc Wed Apr 13 01:03:28 2022 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJUeiAACgkQxOay+Mcd -dC/kHQ/8CVhrwh1Ph0r2dD6jVaGYN7FoMeAEqxSiG0QTTObZehTNt1WDbWlvY/YE -E1PEOsNcrKPmE3fqUNo4dxGtgyFu8cCDN7M4KuCqI+aYe9/WfC4Q3UQgfFTfwPXU -h0X0qGbdqEzAuhdxE8zlgVu1y0Lx78wxFb094zm8S9w+/WBrkvH5KbNZJz1LUr3q -FF6AvR6Yl+UyDkE6qJ4tV7PGG3Dvaeqne7nXuG7TxrFT0wdY4s1AqcZnBCQlS/9t -bUc1ZTs8xffBstuFXCuQazspYwrCzu7aoftCee3Pvnc6buW0e5agsv7fGiKH1Gkx -tl2qei5D7Zx9moQMYmjqAqfHCZ2fh4fRf52OIkbAAUizJh6BOt9KGoRhFmHj69Ky -/1e+1PlLTnkdLQBlSP4p2QIDelFtj8GiekvqqPY/4GByPOuK8AxaABvGDMMDIQXR -PgkkfQVBV7y2Ph41ReZnhyJJxVLOx8TpIEhHvqU3dg6jD+++6B6u4jysJoOHJJYr -GA7o+lRnFtyyv+YsVYmnbRAzzHLMd7fhaz71DIQJbecoK15JIrJBMqptxcG0S4Ph -VBEYrXBNpMGEj2/lK8bvQC74By8mFST25ZPHFqb+27wJ8oxYwMnMyashP40li8qc -8ATXT8y2ryZ14OzWeVeB9glhJHFHsYzeEvr/bTs+Gd+86E/7B30= -=1i22 +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJWH+8ACgkQxOay+Mcd +dC8BeQ/+JrUtCZo9fkjvEZhpnliGWeto2B7CbEmLz3g4cB+aPtq1k2JlH5dIAGle +j2wak2rPhXDg1QKlTVAwu52Aug2uUITRjbMIe0snEXJ5rpm8DHFNJVWW4pHhhFwK +idH3+XYZ2T7JW/v961g1G7Vc97AxwKMc/vEmfTIiALtCZ5SXsmhcFkbvNvyRfTqO +CX7Uj3wJXRsoZGtt1fWfOSpvo45xp0b4dViu5TAjfpWuL8DPIfAXL80V3Fbyf5s/ +gbBl8VQbix/Ar3yhcWzB0O9C3Kb3V0QE2NSfqbVHadRkxqWzHKR1sWoJ3TVk1Pr8 +GxZtNfCJPRVyLA2eYwy2KRTAuQmKEwrfsPto3h84TbrLCr9hsSUrhiqqC33KeWA4 +APd1PR/wuHW/rvLLq+DPL0AHwayziF7nJLGAENLY3Yw6Zx9flhZW3b68BdQ8nCBT +ZSggQynYrLRFvF3xznPhR+p53EusLV5bK4aF3D+n0wg/z9btXgz9/L0kzl7ANPeq +1vwKiXgL2UWQstvdw2larltlmGJ70KPUzWy1JphjyJddRS+IuiVXvvGU3vrdgHlY +GiiykZV4BwJJOg3AKCAr7xaunacVz1cJf4SY8TaAAunQhvUDd8K5s+O9/C8ITB+e +T8286GsmmyhA8YCEBQK6GfwTiSD6NC9F9s0ZM8TdRf0fZ5mo3mo= +=orwM -END
svn commit: r53785 [1/2] - /dev/beam/2.38.0/python/
Author: danoliveira Date: Wed Apr 13 01:03:28 2022 New Revision: 53785 Log: Staging Python artifacts for Apache Beam 2.38.0 RC1 Modified: dev/beam/2.38.0/python/apache-beam-2.38.0.zip dev/beam/2.38.0/python/apache-beam-2.38.0.zip.asc dev/beam/2.38.0/python/apache-beam-2.38.0.zip.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam
svn commit: r53784 - in /dev/beam/2.38.0: apache-beam-2.38.0-source-release.zip apache-beam-2.38.0-source-release.zip.asc apache-beam-2.38.0-source-release.zip.sha512
Author: danoliveira Date: Tue Apr 12 22:17:56 2022 New Revision: 53784 Log: Staging Java artifacts for Apache Beam 2.38.0 RC1 Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip (with props) Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip == Binary file - no diff available. Propchange: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip -- svn:mime-type = application/octet-stream Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc (original) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc Tue Apr 12 22:17:56 2022 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJVLXQACgkQxOay+Mcd -dC/84w//bUcytSILRjus5gdNmiJYTlFR74qcsnHc/u9SEgvf9ceqtzBlgLOn6YWu -Pk8dbkKumMwrGL5I9TDpx4odl382p/uhs3thD4h+LygzOFMlj4W3B0f9a9X/hfSG -96jQrAfUdFTeGOnGm51F/IiO1rP6jJnni+oofnOnZoBPkLzYw8VskBNsugl9W09Q -NBkgX72wuP4wqFTAlIl+MDoGQYF0JLOPhYhqaIbqdEvNtmQUFK8lV8A5+M8bKx0a -2YBhsRF2O4I5eVvuODUt9xiUN//eczd3vba4eax4WJqPHSqS1cnVMTJBA74UnZLf -2WpJ02oLQg+CL0kJch+nganbsTPTimbLjt37HooqcRamhaP5ufUfGQeuW00rcTpp -ofJenc71lHKDIExBi2Lj+o5b2rk/3zwNl2NRh4UkOmsCe3BGrIjKJiVAt6dJSNv9 -WnzF4u5cNn58HLIlcSoJBTstcCufDuQYUhIO/Aq9AdjWkWMTUECCXt46pfkslUZz -hccaUO1hVfqlyvrdJsW3s+GI2Qk6FDgK6wUZD0qAH6XIIfTfOeHA1vEa2q69iDtH -sb+J4TFKsZDt0IXXG7i9qbBuE13tlq2Liy2Cjgn+o5EjL8aA3wvAnBINoXy8njyA -KJ8wxNLekM9PaHVA1/OYbY7Q7qB1w5pLSZKQAxN9hlce5mBWVsU= -=MA88 +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJV+oQACgkQxOay+Mcd +dC9y6Q//TkmSwszv/7kls0YbAOOtX/RDDI0IHf+G6RsAr/AXKEK034TfpTNQMnN2 +4XJdqA6VaOnoH8f+g3juUnPOS4sXeKlnCkDTbOg7FfHsnuOgZgpwC0NZCYzhJN4U +79FZ0IvXYI+pQYhFdJ9FoP8jQtNKTJ4aKwnH3KGHxj0Je4ccILDp8pjKXAshEdHJ +G6P2XCn0wgbiruwOgbgNRqJJiUxofWYrJLR66KNG4pwo1hcurjZ1ZgKdPW2SZzNn +ad9mm4633+7U7hmKlGcSHN37GiJEr0+b3UG05NXd4jnIVy0SKoyi7hkrPAitOdHI +3kGrOVDE5zknFTbNr0baN+2higabrvvYBW+j8O8/Kp7+8aIXNzH5EFLC9WFTi6dT +gp1TdF/7ekddPvmpctMnr0J5D4IzSKw0dyDN8ok9Y0T7PBIjK1CBO1HT3nyMcUa2 +ZNZR+rRH3386Z2ODGbGpWPC1R1u3s01QVbEdx9hI4MMK5Bu8XT8PlQHuDGWuzom/ +bshxqByjIanT5Y01cVWGsG+eB4tEzXel5wVTNkyBeEmjroZU86cgYWNMb/rqTL2e +oyR3BtQNpebtcoXCj44/98oGn1127sY55kZ4GnMGLax2p7EYjTw9KlBZtqnOVqCw +irOulQQLn//I6T0N9KgsJ2i16liRT4i9cpPBNeoWX2DSYmd/hfk= +=NL90 -END PGP SIGNATURE- Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 (original) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Tue Apr 12 22:17:56 2022 @@ -1 +1 @@ -9e18fcf7a95aaa8e9bba5051011c695b4c1aae888c379525e653e2e3a2b62e110be8a4f4cc80c663e671c1af49a6c4582a882329ae0ebbb79b1ed1cdcc46b25e apache-beam-2.38.0-source-release.zip +13ca8a902a5f3b7f44a5454e86c4f8244498c37c669dfcc5a5b7cb2abe09f947a641f1760dd6bdba8a22956d806a1b465b1d91fc638f172e6c80cf9fc1201c1c apache-beam-2.38.0-source-release.zip
[beam] annotated tag sdks/v2.38.0-RC1 updated (93fd177d43f -> 7fe6395aaea)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag sdks/v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag sdks/v2.38.0-RC1 was modified! *** from 93fd177d43f (commit) to 7fe6395aaea (tag) tagging 93fd177d43f42a6d92cc8825e058594d870ad449 (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Tue Apr 12 14:23:44 2022 -0700 - Log - Go SDK v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag v2.38.0-RC1 updated (93fd177d43f -> d20f07587aa)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.38.0-RC1 was modified! *** from 93fd177d43f (commit) to d20f07587aa (tag) tagging 93fd177d43f42a6d92cc8825e058594d870ad449 (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Tue Apr 12 14:23:44 2022 -0700 - Log - v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] branch release-2.38.0 updated: Re-raise exceptions swallowed in several Python I/O connectors
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch release-2.38.0
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/release-2.38.0 by this push:
new e67cc36bf24 Re-raise exceptions swallowed in several Python I/O
connectors
new 22d91bd78d3 Merge pull request #17330 from
chamikaramj/cherry_pick_pr_17329
e67cc36bf24 is described below
commit e67cc36bf24fd7f8778f19053e2c0c2aa87ddf48
Author: Chamikara Jayalath
AuthorDate: Sat Apr 9 00:26:10 2022 -0700
Re-raise exceptions swallowed in several Python I/O connectors
---
.../io/gcp/datastore/v1new/datastoreio.py | 2 +
.../io/gcp/datastore/v1new/datastoreio_test.py | 18 +
sdks/python/apache_beam/io/gcp/gcsio.py| 1 +
sdks/python/apache_beam/io/gcp/gcsio_test.py | 46 --
4 files changed, 57 insertions(+), 10 deletions(-)
diff --git a/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio.py
b/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio.py
index 4ac2803619d..dea51a0ce89 100644
--- a/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio.py
+++ b/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio.py
@@ -301,8 +301,10 @@ class ReadFromDatastore(PTransform):
except (ClientError, GoogleAPICallError) as e:
# e.code.value contains the numeric http status code.
service_call_metric.call(e.code.value)
+raise
except HttpError as e:
service_call_metric.call(e)
+raise
class _Mutate(PTransform):
diff --git a/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio_test.py
b/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio_test.py
index 603bcd018c3..8a7977e475c 100644
--- a/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio_test.py
+++ b/sdks/python/apache_beam/io/gcp/datastore/v1new/datastoreio_test.py
@@ -328,13 +328,17 @@ class DatastoreioTest(unittest.TestCase):
client_query.fetch.side_effect = [
exceptions.DeadlineExceeded("Deadline exceed")
]
- list(_query_fn.process(self._mock_query))
- self.verify_read_call_metric(
- self._PROJECT, self._NAMESPACE, "deadline_exceeded", 1)
- # Test success
- client_query.fetch.side_effect = [[]]
- list(_query_fn.process(self._mock_query))
- self.verify_read_call_metric(self._PROJECT, self._NAMESPACE, "ok", 1)
+ try:
+list(_query_fn.process(self._mock_query))
+ except Exception:
+self.verify_read_call_metric(
+self._PROJECT, self._NAMESPACE, "deadline_exceeded", 1)
+# Test success
+client_query.fetch.side_effect = [[]]
+list(_query_fn.process(self._mock_query))
+self.verify_read_call_metric(self._PROJECT, self._NAMESPACE, "ok", 1)
+ else:
+raise Exception('Excepted _query_fn.process call to raise an error')
def verify_read_call_metric(self, project_id, namespace, status, count):
"""Check if a metric was recorded for the Datastore IO read API call."""
diff --git a/sdks/python/apache_beam/io/gcp/gcsio.py
b/sdks/python/apache_beam/io/gcp/gcsio.py
index cc740c397e9..0caf4415247 100644
--- a/sdks/python/apache_beam/io/gcp/gcsio.py
+++ b/sdks/python/apache_beam/io/gcp/gcsio.py
@@ -642,6 +642,7 @@ class GcsDownloader(Downloader):
service_call_metric.call('ok')
except HttpError as e:
service_call_metric.call(e)
+ raise
@retry.with_exponential_backoff(
retry_filter=retry.retry_on_server_errors_and_timeout_filter)
diff --git a/sdks/python/apache_beam/io/gcp/gcsio_test.py
b/sdks/python/apache_beam/io/gcp/gcsio_test.py
index 1d2836a5614..2f867ffc528 100644
--- a/sdks/python/apache_beam/io/gcp/gcsio_test.py
+++ b/sdks/python/apache_beam/io/gcp/gcsio_test.py
@@ -103,10 +103,17 @@ class FakeGcsObjects(object):
# has to persist even past the deletion of the object.
self.last_generation = {}
self.list_page_tokens = {}
+self._fail_when_getting_metadata = []
+self._fail_when_reading = []
- def add_file(self, f):
+ def add_file(
+ self, f, fail_when_getting_metadata=False, fail_when_reading=False):
self.files[(f.bucket, f.object)] = f
self.last_generation[(f.bucket, f.object)] = f.generation
+if fail_when_getting_metadata:
+ self._fail_when_getting_metadata.append(f)
+if fail_when_reading:
+ self._fail_when_reading.append(f)
def get_file(self, bucket, obj):
return self.files.get((bucket, obj), None)
@@ -123,8 +130,12 @@ class FakeGcsObjects(object):
# Failing with an HTTP 404 if file does not exist.
raise HttpError({'status': 404}, None, None)
if download is None:
+ if f in self._fail_when_getting_metadata:
+raise HttpError({'status': 429}, None, None)
return f.get_metada
svn commit: r53769 - in /dev/beam/2.38.0: apache-beam-2.38.0-source-release.zip apache-beam-2.38.0-source-release.zip.asc apache-beam-2.38.0-source-release.zip.sha512
Author: danoliveira Date: Tue Apr 12 07:43:12 2022 New Revision: 53769 Log: Staging Java artifacts for Apache Beam 2.38.0 RC1 Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip (with props) Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip == Binary file - no diff available. Propchange: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip -- svn:mime-type = application/octet-stream Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc (original) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc Tue Apr 12 07:43:12 2022 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJTvbQACgkQxOay+Mcd -dC+k4g//XBYSekTFysq3/DGY5PX2jIahzsR47Lq9nBYg21ZkTDGFnS0hpMB65im8 -AAXGwwcJpEeX8LB/rg/enCL+UBndwY3IjydfjWx8+qFrg23Oq+XStoLHilXIHtLV -RbevlXtKFJiFKn1r87cYJx99IeR19OmV6tjcBucrj4DSBIRaG0wig5b3fMo60d55 -Hxl+uJJ1xIueZrAufaqH9xbkllZ77S+YGT0v5wVcywwoRLPg9onWR0ktbifzNGr3 -bae0LLjt5r41sb6k1m5wvF2J82cH0WxHoWQTfb5vyou7CgzTxtZtNxjlEtaFkz/c -LAbn+zn3uAjf3vSfbLMnrCQcwoenTMNrAlZaNlB7n0pJyNRws40uD01FokS5zu3Z -u10k2XcQUnQesol5Xoq3BPFVOxlAqLw6TQSGMSvfH82yL6Mp6hiuo1Ydgfw+7kJh -HIz2LLk2dmsWehHglgjzadxDNAu/MoeR6/g3GpEqtqUx89KU80YIJSD2lBUvCBcy -PlwE3Gr1aeTlVyCt0+p+eFA00JRAXDhAyvyqInAOmP/TT33lfkuQLbxlBmd26rXs -GAbJHOiQzhTee9xe7NrDsK5gq0JNuq3OqPg6ilLbFoS8y0U6bA3qrVQCW6YV9O7J -WW2mmmzJR3S2o8aaOBuu6WELoMJ3BZSp4x07itvlrBSJNqrBWTc= -=laVl +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJVLXQACgkQxOay+Mcd +dC/84w//bUcytSILRjus5gdNmiJYTlFR74qcsnHc/u9SEgvf9ceqtzBlgLOn6YWu +Pk8dbkKumMwrGL5I9TDpx4odl382p/uhs3thD4h+LygzOFMlj4W3B0f9a9X/hfSG +96jQrAfUdFTeGOnGm51F/IiO1rP6jJnni+oofnOnZoBPkLzYw8VskBNsugl9W09Q +NBkgX72wuP4wqFTAlIl+MDoGQYF0JLOPhYhqaIbqdEvNtmQUFK8lV8A5+M8bKx0a +2YBhsRF2O4I5eVvuODUt9xiUN//eczd3vba4eax4WJqPHSqS1cnVMTJBA74UnZLf +2WpJ02oLQg+CL0kJch+nganbsTPTimbLjt37HooqcRamhaP5ufUfGQeuW00rcTpp +ofJenc71lHKDIExBi2Lj+o5b2rk/3zwNl2NRh4UkOmsCe3BGrIjKJiVAt6dJSNv9 +WnzF4u5cNn58HLIlcSoJBTstcCufDuQYUhIO/Aq9AdjWkWMTUECCXt46pfkslUZz +hccaUO1hVfqlyvrdJsW3s+GI2Qk6FDgK6wUZD0qAH6XIIfTfOeHA1vEa2q69iDtH +sb+J4TFKsZDt0IXXG7i9qbBuE13tlq2Liy2Cjgn+o5EjL8aA3wvAnBINoXy8njyA +KJ8wxNLekM9PaHVA1/OYbY7Q7qB1w5pLSZKQAxN9hlce5mBWVsU= +=MA88 -END PGP SIGNATURE- Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 (original) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Tue Apr 12 07:43:12 2022 @@ -1 +1 @@ -64e465b1c4188deda35d4d481f5268c473268e66e9d0c43dac40184a50ee39ddd4c9cdc17cd36d6b64be0a0e7cbb5a6bbc2a04f1376af7f30769dbb8ec2a237d apache-beam-2.38.0-source-release.zip +9e18fcf7a95aaa8e9bba5051011c695b4c1aae888c379525e653e2e3a2b62e110be8a4f4cc80c663e671c1af49a6c4582a882329ae0ebbb79b1ed1cdcc46b25e apache-beam-2.38.0-source-release.zip
[beam] annotated tag sdks/v2.38.0-RC1 updated (5743d8a4d8d -> 5d81f51d7bd)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag sdks/v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag sdks/v2.38.0-RC1 was modified! *** from 5743d8a4d8d (commit) to 5d81f51d7bd (tag) tagging 5743d8a4d8d21c8caa4413ea620111bc6e79422b (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Mon Apr 11 19:11:04 2022 -0700 - Log - Go SDK v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag v2.38.0-RC1 updated (5743d8a4d8d -> deb7cffa55c)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.38.0-RC1 was modified! *** from 5743d8a4d8d (commit) to deb7cffa55c (tag) tagging 5743d8a4d8d21c8caa4413ea620111bc6e79422b (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Mon Apr 11 19:11:04 2022 -0700 - Log - v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] branch release-2.38.0 updated (3da922c91d0 -> 12bc0e0af30)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git from 3da922c91d0 Merge pull request #17332: [cherry-pick][release-2.38.0][BEAM-14172] Update tox.ini for pydocs (#17176) add 9211bb6d8bd Merge pull request #17343: [BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash. new 12bc0e0af30 Merge pull request #17345: [cherry-pick][release-2.38.0][BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: release/go-licenses/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] 01/01: Merge pull request #17345: [cherry-pick][release-2.38.0][BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash.
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 12bc0e0af30c87ad9d348f6703657d7666a0117b Merge: 3da922c91d0 9211bb6d8bd Author: Daniel Oliveira AuthorDate: Mon Apr 11 19:07:35 2022 -0700 Merge pull request #17345: [cherry-pick][release-2.38.0][BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash. [cherry-pick][release-2.38.0][BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash. release/go-licenses/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] 01/01: Merge pull request #17343: [BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash.
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 2e0f79ef2b924da3306d0e55dffd4728809b9f3d Merge: 49d530e739b 5439a91590f Author: Daniel Oliveira AuthorDate: Mon Apr 11 18:50:22 2022 -0700 Merge pull request #17343: [BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash. [BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash. release/go-licenses/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] branch master updated (49d530e739b -> 2e0f79ef2b9)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 49d530e739b Merge pull request #17312 from benWize/BEAM-14013 add 5439a91590f [BEAM-13538] Workaround to fix go-licenses crash. new 2e0f79ef2b9 Merge pull request #17343: [BEAM-13538][BEAM-14296] Workaround to fix go-licenses crash. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: release/go-licenses/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
svn commit: r53759 [2/2] - /dev/beam/2.38.0/python/
Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.asc == --- dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.asc (original) +++ dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.asc Mon Apr 11 18:58:30 2022 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJRA3QACgkQxOay+Mcd -dC/55g//YrAOkvurX+iTIPecGSyrsZzu2HqEtKEelXqCtR0wgnJiEJw5lOCMqG2N -AYoqAvRpzi1K9BuSgr/Mw2w9oApPuqgNM8PNbkp9ygSYe3qd4UjI809bvKdiM1/H -1ofugVWfFy06VY1ihvz4pzIVsCDIjHHTD7WGFRnJdrTJ1izPvrRk593kpNk5+opj -1vcbU2PoPDr+lJ2msSHJzGd7nIgf1M79MHg9cfvzpp0zn/Z7kNhsVErQG15LRSfO -D4DFWA11QEtb5h9hfO8uJ0JJ4KTcv+eadPj79owPomSvhAY+iRv1B7rCst+Xk3yj -Jcrv/oH/UDvWr6zWXIVAALHklyWCCEBx4UbUJuRtloj/b7E5UpeujTeOFehn/KJf -Yzch7F6Fq9qqyIifx0qm9Lb8lsEtDZ7UMkKUfccq4QS/YsyPujg4JFrTbG+yfWBw -zm+ulskLr9QkDgw3B7y6l+byAQWd6v+yKH2zKl+3B3c/dhzgsDBAHcpRaXbtKWmT -BcGBUt5X2vqRnRxancSeIk2S/SAziIE3xKWbkMr2y/o/svBfd/tEf7qCafnbI9f3 -XtXjNo9iqvk+GQiJe4lmuAsODLr5SxiEhBAPfc6JqSIYcvCLr2KcUI3hetAYbMIY -ac5Wtz0OD8BADy8Tu69nxsK3NsBu/tM5+lcqPs4WV0sQej4HaFQ= -=9kat +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJUeiAACgkQxOay+Mcd +dC988w/9E+LdL1nynmbO8KJzTRoIn1JYC/3HDqAi6oHYXTATWNHF0Kx/J+5LZIQS +yyHLKBmQqSb9sdfYgp7OYEtlBdTnVfgcd+zsNxCe/4vKHoON+J5/jJtmcS9osR6f +L1ZkzsB45uH3lNH5zKls9rRbIf5uqo9X1ZpBAowfNzCK4vdfpKupCTT/hYoqidDM +Dhjko4RCfwhy5YSwfugte/LWBd3oWS3HXFGOkEOmMizuhJbTNqhfMQvQzULj3nFp +g4uGr2xugb3b5zbv15qYnyGRpx1Qadk944BrSWSPJJpS0czYFLQmOyUHLr+T9td4 +yLsAalicn3OQAFygPMA6yXVGofoQu2AMl+nYVGfr2z8X54nI4E53/a/XZNFA0PXZ +BQz/FmiW1n6+rRczViMT5KnZiueHyca5QMfzCN76xwaeFjBNcQq27HZT6S1ONeCK +JWt4Ith+JYAajY4zdmx1oIbDlXQTDit5b1Eclm2zNhbk2Kl3Q0kv/gFf1fWrjOz9 +8Dtt/6QVdDssaJYbXFzVIrNHVklaSHQszdZ67odXi9MM9Pnr1uFMDFthCF+ZhxIZ +8X6NWWDAvL/Bv5wViZef1XW/74YZ+mkXK5bsBhn2SPXjnO4lyOG+mhagfSomiL4Y +fVqA/QFWglj0x+tKy3SKIxgPZSALgLDiqjlN9hDyr4qb/4/aQmI= +=WCNG -END PGP SIGNATURE- Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.sha512 == --- dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.sha512 (original) +++ dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl.sha512 Mon Apr 11 18:58:30 2022 @@ -1 +1 @@ -d0f0d82173ebcf69635a22ccb3525953bc1842fd7548f494f5f4a38543f06c3a00ec050088849daadfc7f7d419c6301f2331564ae896e819f1679b86f69f879d apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl +32c4d41c89074e88b3829f484819b6728b2793a9c7b01702a878a7f0bde28bbcabf7b67467ae16b0498590ca24cd2eda788497a24ff9f247cfb45584d0f6d837 apache_beam-2.38.0-cp39-cp39-manylinux1_x86_64.whl Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl == Binary files - no diff available. Modified: dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl.asc == --- dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl.asc (original) +++ dev/beam/2.38.0/python/apache_beam-2.38.0-cp39-cp39-manylinux2010_i686.whl.asc Mon Apr 11 18:58:30 2022 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJRA3QACgkQxOay+Mcd -dC+h2BAAmYECHEMy7EJhy9nUxqJbLbkdBsWz1SR10Y6S+g4By/O94ZZmQ8tXxzAS -2uhnP8DHqO3njOCM6izC8p1UD1iAGMoUC+HHALtQgHqKkGY3SI7TmZH4FLJZDIFp -He7q+0KqyohRktHe40oGgC0SFdoi0LUbanucEEY1MhpyvLtqbQ99AGvqYSwDsuVC -Xo8aiebiu+BzXuFBOUNZ+p81C1tFEhLQTlaW/pYYDE91dGDRKamkT94ukpK84tYg -2Thsn/8N3vQdenQxQyaJHAxtM7FmW4wwYD6jYkMiGc1aWywbEzSJfyK+bRxDvwYI -2t5tapA97HPjaAfL/vu2wDNV1I+PjkP7l+C3V63uxOQ9agr/mWF4/Z+1q71k79pI -oae7Sd37x73YwX4IyM9yrb6/kchhPJ2KzzU0mpFndRfrU30Ry8bNn09PFU2qQAR0 -Y7rrdqTw9FglNsOuvE2Mr/C6388blfP6Ja+hzAenlyriORw0tADvH5WC7+EMSNom -LI2EAb278cwMYJXO8PkYFODaAT3Vncz5/3c8cIfHxgQL2l6kB/vsCByw3Nhct+Wq -WWv8QWvdqjjVG6iu7vol/oL5uf4GWH8w3tbSW5NG1Yv6U8gvrmVWIlLznFzGJV7O -PlrArCZy8RM4UHxY8Jo6DiwSzPATwYtFtsDNJHBjdW6qNc814gs= -=gtbX +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJUeiAACgkQxOay+Mcd +dC/kHQ/8CVhrwh1Ph0r2dD6jVaGYN7FoMeAEqxSiG0QTTObZehTNt1WDbWlvY/YE +E1PEOsNcrKPmE3fqUNo4dxGtgyFu8cCDN7M4KuCqI+aYe9/WfC4Q3UQgfFTfwPXU +h0X0qGbdqEzAuhdxE8zlgVu1y0Lx78wxFb094zm8S9w+/WBrkvH5KbNZJz1LUr3q +FF6AvR6Yl+UyDkE6qJ4tV7PGG3Dvaeqne7nXuG7TxrFT0wdY4s1AqcZnBCQlS/9t +bUc1ZTs8xffBstuFXCuQazspYwrCzu7aoftCee3Pvnc6buW0e5agsv7fGiKH1Gkx +tl2qei5D7Zx9moQMYmjqAqfHCZ2fh4fRf52OIkbAAUizJh6BOt9KGoRhFmHj69Ky +/1e+1PlLTnkdLQBlSP4p2QIDelFtj8GiekvqqPY/4GByPOuK8AxaABvGDMMDIQXR +PgkkfQVBV7y2Ph41ReZnhyJJxVLOx8TpIEhHvqU3dg6jD+++6B6u4jysJoOHJJYr +GA7o+lRnFtyyv+YsVYmnbRAzzHLMd7fhaz71DIQJbecoK15JIrJBMqptxcG0S4Ph +VBEYrXBNpMGEj2/lK8bvQC74By8mFST25ZPHFqb+27wJ8oxYwMnMyashP40li8qc +8ATXT8y2ryZ14OzWeVeB9glhJHFHsYzeEvr/bTs+Gd+86E/7B30= +=1i22 -END
svn commit: r53759 [1/2] - /dev/beam/2.38.0/python/
Author: danoliveira Date: Mon Apr 11 18:58:30 2022 New Revision: 53759 Log: Staging Python artifacts for Apache Beam 2.38.0 RC1 Modified: dev/beam/2.38.0/python/apache-beam-2.38.0.zip dev/beam/2.38.0/python/apache-beam-2.38.0.zip.asc dev/beam/2.38.0/python/apache-beam-2.38.0.zip.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_x86_64.whl dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam
svn commit: r53741 - in /dev/beam/2.38.0: apache-beam-2.38.0-source-release.zip apache-beam-2.38.0-source-release.zip.asc apache-beam-2.38.0-source-release.zip.sha512
Author: danoliveira Date: Mon Apr 11 05:34:17 2022 New Revision: 53741 Log: Staging Java artifacts for Apache Beam 2.38.0 RC1 Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip (with props) Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip == Binary file - no diff available. Propchange: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip -- svn:mime-type = application/octet-stream Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc (original) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc Mon Apr 11 05:34:17 2022 @@ -1,16 +1,16 @@ -BEGIN PGP SIGNATURE- -iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJRAo4ACgkQxOay+Mcd -dC8CyQ//UHmas5ahuv8ZkvKCXJwSetDub4o47Lvum7JR8CiBIppH3UwK0UOjx8Ot -CdzNS//zkOhay2UQeEW4DLNBpiJ16IDZ3IGTnWmp3RILtxOd03zutZBFhGYoNsrb -DPEaz3vZrMnhhrw4QZd16cXCcH/vYyIU8sdmaJbKV7RFRaGYvfn4fVnzsZWXY5Qv -oyToUr3ceyWCOp+lJrUvi1g6D48ZVqKODehqfHWLf1NXUDppnoHaVI7Kqr1JohEi -KtYO9lw3zjWC21MexK3EQl1pi5nNhlY3NGKtRlgG6HrMOHLdc0XHo4QtIC3jjVzc -sChHkwnlSgGN3XqhQgEsNjxH6BffEo2EjPIkGQDu2jg6D89ndu09pGTZrwartAI6 -Fp3501qTCK68JJcXAz3nj/p/Pz7HIkGGtsaWcKvGA0lbqfWEfK3ivnrzdiSJ5v99 -SkJce0WvDxXnalyF7iv9H8rFVKavU6bOEo0DFfnFh8mAORX2l103UAL8CdU7CZMD -qQYp6aE1DoL7ksUxChc81IpmkdHI9YwfB9N6hIjncEmTi+deGSkYnBRsn5dRMjek -7BtcNiLAkFkcOJUTZPxYsDgwbOS5OdhPHf3iVvuSFwxKN9TDbi772UrB6Mi1hrgh -NvCrcSgMLiIFU4WZTrEpHJBVuv4N5xr5shRWIrmrG6CY0jzHrN4= -=zLP4 +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJTvbQACgkQxOay+Mcd +dC+k4g//XBYSekTFysq3/DGY5PX2jIahzsR47Lq9nBYg21ZkTDGFnS0hpMB65im8 +AAXGwwcJpEeX8LB/rg/enCL+UBndwY3IjydfjWx8+qFrg23Oq+XStoLHilXIHtLV +RbevlXtKFJiFKn1r87cYJx99IeR19OmV6tjcBucrj4DSBIRaG0wig5b3fMo60d55 +Hxl+uJJ1xIueZrAufaqH9xbkllZ77S+YGT0v5wVcywwoRLPg9onWR0ktbifzNGr3 +bae0LLjt5r41sb6k1m5wvF2J82cH0WxHoWQTfb5vyou7CgzTxtZtNxjlEtaFkz/c +LAbn+zn3uAjf3vSfbLMnrCQcwoenTMNrAlZaNlB7n0pJyNRws40uD01FokS5zu3Z +u10k2XcQUnQesol5Xoq3BPFVOxlAqLw6TQSGMSvfH82yL6Mp6hiuo1Ydgfw+7kJh +HIz2LLk2dmsWehHglgjzadxDNAu/MoeR6/g3GpEqtqUx89KU80YIJSD2lBUvCBcy +PlwE3Gr1aeTlVyCt0+p+eFA00JRAXDhAyvyqInAOmP/TT33lfkuQLbxlBmd26rXs +GAbJHOiQzhTee9xe7NrDsK5gq0JNuq3OqPg6ilLbFoS8y0U6bA3qrVQCW6YV9O7J +WW2mmmzJR3S2o8aaOBuu6WELoMJ3BZSp4x07itvlrBSJNqrBWTc= +=laVl -END PGP SIGNATURE- Modified: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 (original) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Mon Apr 11 05:34:17 2022 @@ -1 +1 @@ -56d156e07955241cc86c591b1146a931db6281517991efe0654b32d86076fe1b9ff68bd56ca4ab442dc9b1a157f6430302b4bcc59280ef20325acb17c139720c apache-beam-2.38.0-source-release.zip +64e465b1c4188deda35d4d481f5268c473268e66e9d0c43dac40184a50ee39ddd4c9cdc17cd36d6b64be0a0e7cbb5a6bbc2a04f1376af7f30769dbb8ec2a237d apache-beam-2.38.0-source-release.zip
[beam] annotated tag sdks/v2.38.0-RC1 updated (1a99867ccda -> 890e3e32f70)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag sdks/v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag sdks/v2.38.0-RC1 was modified! *** from 1a99867ccda (commit) to 890e3e32f70 (tag) tagging 1a99867ccdab2d074e2cf7e2ce6389b9f3d4ac44 (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Sun Apr 10 22:19:55 2022 -0700 - Log - Go SDK v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag v2.38.0-RC1 updated (1a99867ccda -> 971b1b40af6)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.38.0-RC1 was modified! *** from 1a99867ccda (commit) to 971b1b40af6 (tag) tagging 1a99867ccdab2d074e2cf7e2ce6389b9f3d4ac44 (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Sun Apr 10 22:19:55 2022 -0700 - Log - v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag v2.38.0-RC1 updated (d68e62e7465 -> 782829bd257)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.38.0-RC1 was modified! *** from d68e62e7465 (commit) to 782829bd257 (tag) tagging d68e62e7465a8361f55273616adbec43d56e4a20 (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Sun Apr 10 22:18:10 2022 -0700 - Log - v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] branch release-2.38.0 updated (93ac2a0db02 -> 3da922c91d0)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git from 93ac2a0db02 Merge pull request #17295: [cherry-pick][release-2.38.0][BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#17240) add 9cc9692466f [BEAM-14172] Update tox.ini for pydocs (#17176) new 3da922c91d0 Merge pull request #17332: [cherry-pick][release-2.38.0][BEAM-14172] Update tox.ini for pydocs (#17176) The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/python/tox.ini | 1 + 1 file changed, 1 insertion(+)
[beam] 01/01: Merge pull request #17332: [cherry-pick][release-2.38.0][BEAM-14172] Update tox.ini for pydocs (#17176)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 3da922c91d09af7558af396f7b363a91e33c5397 Merge: 93ac2a0db02 9cc9692466f Author: Daniel Oliveira AuthorDate: Sun Apr 10 22:05:48 2022 -0700 Merge pull request #17332: [cherry-pick][release-2.38.0][BEAM-14172] Update tox.ini for pydocs (#17176) [cherry-pick][release-2.38.0][BEAM-14172] Update tox.ini for pydocs (#17176) sdks/python/tox.ini | 1 + 1 file changed, 1 insertion(+)
svn commit: r53709 - /dev/beam/2.38.0/python/
Author: danoliveira Date: Sat Apr 9 03:55:41 2022 New Revision: 53709 Log: Staging Python artifacts for Apache Beam 2.38.0 RC1 Added: dev/beam/2.38.0/python/ dev/beam/2.38.0/python/apache-beam-2.38.0.zip (with props) dev/beam/2.38.0/python/apache-beam-2.38.0.zip.asc dev/beam/2.38.0/python/apache-beam-2.38.0.zip.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2010_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-manylinux2014_aarch64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win32.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp36-cp36m-win_amd64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux1_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_i686.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2010_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-manylinux2014_aarch64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win32.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp37-cp37m-win_amd64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-macosx_10_9_x86_64.whl.sha512 dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl (with props) dev/beam/2.38.0/python/apache_beam-2.38.0-cp38-cp38-manylinux1_i686.whl.asc dev/beam/2.38.0/python/apache_beam-2.38.0
svn commit: r53708 - in /dev/beam/2.38.0: ./ apache-beam-2.38.0-source-release.zip apache-beam-2.38.0-source-release.zip.asc apache-beam-2.38.0-source-release.zip.sha512
Author: danoliveira Date: Sat Apr 9 03:51:38 2022 New Revision: 53708 Log: Staging Java artifacts for Apache Beam 2.38.0 RC1 Added: dev/beam/2.38.0/ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip (with props) dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip == Binary file - no diff available. Propchange: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip -- svn:mime-type = application/octet-stream Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc (added) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.asc Sat Apr 9 03:51:38 2022 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEE0Oe2nZEa2jwEgrqhxOay+McddC8FAmJRAo4ACgkQxOay+Mcd +dC8CyQ//UHmas5ahuv8ZkvKCXJwSetDub4o47Lvum7JR8CiBIppH3UwK0UOjx8Ot +CdzNS//zkOhay2UQeEW4DLNBpiJ16IDZ3IGTnWmp3RILtxOd03zutZBFhGYoNsrb +DPEaz3vZrMnhhrw4QZd16cXCcH/vYyIU8sdmaJbKV7RFRaGYvfn4fVnzsZWXY5Qv +oyToUr3ceyWCOp+lJrUvi1g6D48ZVqKODehqfHWLf1NXUDppnoHaVI7Kqr1JohEi +KtYO9lw3zjWC21MexK3EQl1pi5nNhlY3NGKtRlgG6HrMOHLdc0XHo4QtIC3jjVzc +sChHkwnlSgGN3XqhQgEsNjxH6BffEo2EjPIkGQDu2jg6D89ndu09pGTZrwartAI6 +Fp3501qTCK68JJcXAz3nj/p/Pz7HIkGGtsaWcKvGA0lbqfWEfK3ivnrzdiSJ5v99 +SkJce0WvDxXnalyF7iv9H8rFVKavU6bOEo0DFfnFh8mAORX2l103UAL8CdU7CZMD +qQYp6aE1DoL7ksUxChc81IpmkdHI9YwfB9N6hIjncEmTi+deGSkYnBRsn5dRMjek +7BtcNiLAkFkcOJUTZPxYsDgwbOS5OdhPHf3iVvuSFwxKN9TDbi772UrB6Mi1hrgh +NvCrcSgMLiIFU4WZTrEpHJBVuv4N5xr5shRWIrmrG6CY0jzHrN4= +=zLP4 +-END PGP SIGNATURE- Added: dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 == --- dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 (added) +++ dev/beam/2.38.0/apache-beam-2.38.0-source-release.zip.sha512 Sat Apr 9 03:51:38 2022 @@ -0,0 +1 @@ +56d156e07955241cc86c591b1146a931db6281517991efe0654b32d86076fe1b9ff68bd56ca4ab442dc9b1a157f6430302b4bcc59280ef20325acb17c139720c apache-beam-2.38.0-source-release.zip
[beam] annotated tag v2.38.0-RC1 updated (eb75e743cd7 -> bb04e8f6ea7)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag v2.38.0-RC1 was modified! *** from eb75e743cd7 (commit) to bb04e8f6ea7 (tag) tagging eb75e743cd7e868b23a26433dcaeb42661c552b1 (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Thu Apr 7 16:55:20 2022 -0700 - Log - v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag sdks/v2.38.0-RC1 updated (eb75e743cd7 -> 408dd8dc7cc)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to annotated tag sdks/v2.38.0-RC1 in repository https://gitbox.apache.org/repos/asf/beam.git *** WARNING: tag sdks/v2.38.0-RC1 was modified! *** from eb75e743cd7 (commit) to 408dd8dc7cc (tag) tagging eb75e743cd7e868b23a26433dcaeb42661c552b1 (commit) replaces jupyterlab-sidepanel-v2.0.0 by Daniel Oliveira on Thu Apr 7 16:55:20 2022 -0700 - Log - Go SDK v2.38.0-RC1 --- No new revisions were added by this update. Summary of changes:
[beam] branch release-2.38.0 updated (47a9d8f3c42 -> 93ac2a0db02)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git from 47a9d8f3c42 Merge pull request #17241: [cherry-pick][release-2.38.0][BEAM-14179] Fix possibly null value add 49549098fd2 [BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#17240) new 93ac2a0db02 Merge pull request #17295: [cherry-pick][release-2.38.0][BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#17240) The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../harness/state/BeamFnStateGrpcClientCache.java | 105 ++--- .../state/BeamFnStateGrpcClientCacheTest.java | 81 +--- 2 files changed, 117 insertions(+), 69 deletions(-)
[beam] 01/01: Merge pull request #17295: [cherry-pick][release-2.38.0][BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#172
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 93ac2a0db020841c1b34736721adba731735cbca Merge: 47a9d8f3c42 49549098fd2 Author: Daniel Oliveira AuthorDate: Wed Apr 6 12:57:13 2022 -0700 Merge pull request #17295: [cherry-pick][release-2.38.0][BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#17240) [cherry-pick][release-2.38.0][BEAM-13519] Solve race issues when the server responds with an error before the GrpcStateClient finishes being constructed. (#17240) .../harness/state/BeamFnStateGrpcClientCache.java | 105 ++--- .../state/BeamFnStateGrpcClientCacheTest.java | 81 +--- 2 files changed, 117 insertions(+), 69 deletions(-)
[beam] 01/01: Merge pull request #17241: [cherry-pick][release-2.38.0][BEAM-14179] Fix possibly null value
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 47a9d8f3c4207cd2c8d5b761b5dfeb49192399a7 Merge: ede9921 ec199e9 Author: Daniel Oliveira AuthorDate: Fri Apr 1 13:18:09 2022 -0700 Merge pull request #17241: [cherry-pick][release-2.38.0][BEAM-14179] Fix possibly null value [cherry-pick][release-2.38.0][BEAM-14179] Fix possibly null value .../main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java| 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
[beam] branch release-2.38.0 updated (ede9921 -> 47a9d8f)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from ede9921 Merge pull request #17224: [rollback][release-2.38.0][BEAM-14116] Rollback of #17004: Chunk commit requests dynamically add ec199e9 Merge pull request #17228: [BEAM-14179] Fix possibly null value new 47a9d8f Merge pull request #17241: [cherry-pick][release-2.38.0][BEAM-14179] Fix possibly null value The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java| 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
[beam] 01/01: Merge pull request #17224: [rollback][release-2.38.0][BEAM-14116] Rollback of #17004: Chunk commit requests dynamically
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit ede9921c9408ac3ffe77f1584828d1550a00f677 Merge: 6cba8d5 ba19401 Author: Daniel Oliveira AuthorDate: Fri Apr 1 12:42:44 2022 -0700 Merge pull request #17224: [rollback][release-2.38.0][BEAM-14116] Rollback of #17004: Chunk commit requests dynamically [rollback][release-2.38.0][BEAM-14116] Rollback of #17004: Chunk commit requests dynamically .../worker/windmill/GrpcWindmillServer.java| 105 ++--- 1 file changed, 29 insertions(+), 76 deletions(-)
[beam] branch release-2.38.0 updated (6cba8d5 -> ede9921)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 6cba8d5 Merge pull request #17217: [cherry-pick][release-2.38.0][BEAM-14185]: remove the metadata table after the pipeline finishes for Spanner Change Streams Connector add ba19401 Revert "[BEAM-14116] Chunk commit requests dynamically (#17004)" new ede9921 Merge pull request #17224: [rollback][release-2.38.0][BEAM-14116] Rollback of #17004: Chunk commit requests dynamically The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../worker/windmill/GrpcWindmillServer.java| 105 ++--- 1 file changed, 29 insertions(+), 76 deletions(-)
[beam] branch release-2.38.0 updated (bfffcd9 -> 6cba8d5)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a change to branch release-2.38.0
in repository https://gitbox.apache.org/repos/asf/beam.git.
from bfffcd9 Merge pull request #17198: [cherry-pick][BEAM-14171] More
explicit asserts in CoGBKResult.
add b29daf2 Merge pull request #17182 from [BEAM-14185]: remove the
metadata table after the pipeline finishes for Spanner Change Streams Connector
add 6cba8d5 Merge pull request #17217:
[cherry-pick][release-2.38.0][BEAM-14185]: remove the metadata table after the
pipeline finishes for Spanner Change Streams Connector
No new revisions were added by this update.
Summary of changes:
.../apache/beam/sdk/io/gcp/spanner/SpannerIO.java | 21 ---
.../dofn/CleanUpReadChangeStreamDoFn.java} | 20 ++
.../changestreams/it/IntegrationTestEnv.java | 18 ++---
.../changestreams/it/SpannerChangeStreamIT.java| 44 +++---
...nnerChangeStreamOrderedWithinKeyGloballyIT.java | 2 +
.../it/SpannerChangeStreamOrderedWithinKeyIT.java | 2 +
6 files changed, 81 insertions(+), 26 deletions(-)
copy
sdks/java/{extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/transform/BeamSqlOutputToConsoleFn.java
=>
io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/changestreams/dofn/CleanUpReadChangeStreamDoFn.java}
(59%)
[beam] 01/01: Merge pull request #17198: [cherry-pick][BEAM-14171] More explicit asserts in CoGBKResult.
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit bfffcd9ebc96918ecbf938117f1d463588d1aff4 Merge: b9cb950 f4fff8d Author: Daniel Oliveira AuthorDate: Thu Mar 31 00:17:57 2022 -0700 Merge pull request #17198: [cherry-pick][BEAM-14171] More explicit asserts in CoGBKResult. [BEAM-14171] More explicit asserts in CoGBKResult. .../main/java/org/apache/beam/sdk/transforms/join/CoGbkResult.java | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
[beam] branch release-2.38.0 updated (b9cb950 -> bfffcd9)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from b9cb950 Merge pull request #17208: [cherry-pick][release-2.38.0][BEAM-14181] Make sure to evict connections from cache after closing them add f4fff8d [BEAM-14171] More explicit asserts in CoGBKResult. new bfffcd9 Merge pull request #17198: [cherry-pick][BEAM-14171] More explicit asserts in CoGBKResult. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../main/java/org/apache/beam/sdk/transforms/join/CoGbkResult.java | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
[beam] 01/01: Merge pull request #17208: [cherry-pick][release-2.38.0][BEAM-14181] Make sure to evict connections from cache after closing them
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit b9cb95056b3e80e34a21baad5d505998c70b249b Merge: 90f8ecd 8063330 Author: Daniel Oliveira AuthorDate: Thu Mar 31 00:15:42 2022 -0700 Merge pull request #17208: [cherry-pick][release-2.38.0][BEAM-14181] Make sure to evict connections from cache after closing them [cherry-pick][release-2.38.0][BEAM-14181] Make sure to evict connections from cache after closing them .../bigquery/StorageApiWriteUnshardedRecords.java | 40 +++--- 1 file changed, 27 insertions(+), 13 deletions(-)
[beam] branch release-2.38.0 updated (90f8ecd -> b9cb950)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 90f8ecd Merge pull request #17215: [release-2.38.0] [BEAM-14201] Ensure the removed option prebuild_sdk_container_base_image not used on its own. add 8063330 Merge pull request #17187: [BEAM-14181] Make sure to evict connections from cache after closing them new b9cb950 Merge pull request #17208: [cherry-pick][release-2.38.0][BEAM-14181] Make sure to evict connections from cache after closing them The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../bigquery/StorageApiWriteUnshardedRecords.java | 40 +++--- 1 file changed, 27 insertions(+), 13 deletions(-)
[beam] 01/01: Merge pull request #17215: [release-2.38.0] [BEAM-14201] Ensure the removed option prebuild_sdk_container_base_image not used on its own.
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 90f8ecd322ef1e6a538eee5c058541c9d619885e Merge: 34e88c9 b071bf6 Author: Daniel Oliveira AuthorDate: Wed Mar 30 21:38:44 2022 -0700 Merge pull request #17215: [release-2.38.0] [BEAM-14201] Ensure the removed option prebuild_sdk_container_base_image not used on its own. [release-2.38.0] [BEAM-14201] Ensure the removed option prebuild_sdk_container_base_image not used on its own. .../python/apache_beam/options/pipeline_options.py | 9 .../options/pipeline_options_validator.py | 12 +++ .../options/pipeline_options_validator_test.py | 25 ++ 3 files changed, 46 insertions(+)
[beam] branch release-2.38.0 updated (34e88c9 -> 90f8ecd)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 34e88c9 Merge pull request #17218: [cherry-pick][release-2.38.0][BEAM-14194]: Disallow autoscaling for SpannerIO.readChangeStream add b071bf6 Ensure the removed option prebuild_sdk_container_base_image not used on its own. new 90f8ecd Merge pull request #17215: [release-2.38.0] [BEAM-14201] Ensure the removed option prebuild_sdk_container_base_image not used on its own. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../python/apache_beam/options/pipeline_options.py | 9 .../options/pipeline_options_validator.py | 12 +++ .../options/pipeline_options_validator_test.py | 25 ++ 3 files changed, 46 insertions(+)
[beam] 01/01: Merge pull request #17218: [cherry-pick][release-2.38.0][BEAM-14194]: Disallow autoscaling for SpannerIO.readChangeStream
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 34e88c93ed53d5a0e54e5dc503c8edae8cee3ad2 Merge: f9aef19 4b80f8f Author: Daniel Oliveira AuthorDate: Wed Mar 30 20:19:28 2022 -0700 Merge pull request #17218: [cherry-pick][release-2.38.0][BEAM-14194]: Disallow autoscaling for SpannerIO.readChangeStream [cherry-pick][release-2.38.0][BEAM-14194]: Disallow autoscaling for SpannerIO.readChangeStream .../dataflow/DataflowPipelineTranslator.java | 27 + .../dataflow/DataflowPipelineTranslatorTest.java | 67 ++ 2 files changed, 94 insertions(+)
[beam] branch release-2.38.0 updated (f9aef19 -> 34e88c9)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from f9aef19 Merge pull request #17197: [cherry-pick][BEAM-14163] Fix typo in single core per container logic. add 4b80f8f Merge pull request #17202 from [BEAM-14194]: Disallow autoscaling for SpannerIO.readChangeStream new 34e88c9 Merge pull request #17218: [cherry-pick][release-2.38.0][BEAM-14194]: Disallow autoscaling for SpannerIO.readChangeStream The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../dataflow/DataflowPipelineTranslator.java | 27 + .../dataflow/DataflowPipelineTranslatorTest.java | 67 ++ 2 files changed, 94 insertions(+)
[beam] branch master updated (407a96f -> 2588694)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 407a96f Disallow the removed option
prebuild_sdk_container_base_image. #17204
add 2588694 Merge pull request #16819: [BEAM-13806] Adding test suite for
Go x-lang tests on Dataflow.
No new revisions were added by this update.
Summary of changes:
...CrossLanguageValidatesRunner_GoUsingJava_Dataflow.groovy} | 12 ++--
runners/google-cloud-dataflow-java/build.gradle | 4 +++-
2 files changed, 9 insertions(+), 7 deletions(-)
copy .test-infra/jenkins/{job_PostCommit_Java_ValidatesRunner_Samza.groovy =>
job_PostCommit_CrossLanguageValidatesRunner_GoUsingJava_Dataflow.groovy} (73%)
[beam] 01/01: Merge pull request #17197: [cherry-pick][BEAM-14163] Fix typo in single core per container logic.
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit f9aef19d6044b3f6d07c1cb773d58a19ed3f0135 Merge: 24982cf 05bdda7 Author: Daniel Oliveira AuthorDate: Tue Mar 29 16:54:11 2022 -0700 Merge pull request #17197: [cherry-pick][BEAM-14163] Fix typo in single core per container logic. [BEAM-14163] Fix typo in single core per container logic. sdks/python/apache_beam/runners/dataflow/internal/apiclient.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] branch release-2.38.0 updated (24982cf -> f9aef19)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 24982cf Merge pull request #17193: [cherry-pick][release-2.38.0][BEAM-14177] Fix GBK re-iteration caching for portable runners. add 05bdda7 [BEAM-14163] Fix typo in single core per container logic. new f9aef19 Merge pull request #17197: [cherry-pick][BEAM-14163] Fix typo in single core per container logic. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/python/apache_beam/runners/dataflow/internal/apiclient.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] 01/01: Merge pull request #17193: [cherry-pick][release-2.38.0][BEAM-14177] Fix GBK re-iteration caching for portable runners.
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 24982cf83e29750237ee08a61173496c32b91bcf Merge: 3027832 06be669 Author: Daniel Oliveira AuthorDate: Mon Mar 28 10:38:53 2022 -0700 Merge pull request #17193: [cherry-pick][release-2.38.0][BEAM-14177] Fix GBK re-iteration caching for portable runners. [cherry-pick][release-2.38.0][BEAM-14177] Fix GBK re-iteration caching for portable runners. .../beam/fn/harness/state/StateBackedIterable.java | 3 +- .../fn/harness/state/StateBackedIterableTest.java | 42 ++ 2 files changed, 44 insertions(+), 1 deletion(-)
[beam] branch release-2.38.0 updated (3027832 -> 24982cf)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 3027832 Set Dataflow container to release version. add 06be669 [BEAM-14177] Fix GBK re-iteration caching for portable runners. (#17184) new 24982cf Merge pull request #17193: [cherry-pick][release-2.38.0][BEAM-14177] Fix GBK re-iteration caching for portable runners. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../beam/fn/harness/state/StateBackedIterable.java | 3 +- .../fn/harness/state/StateBackedIterableTest.java | 42 ++ 2 files changed, 44 insertions(+), 1 deletion(-)
[beam] 01/01: Set Dataflow container to release version.
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch release-2.38.0
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 3027832754384520d24f364aad00be11bce97808
Author: Daniel Oliveira
AuthorDate: Wed Mar 23 18:12:22 2022 -0700
Set Dataflow container to release version.
---
runners/google-cloud-dataflow-java/build.gradle | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/runners/google-cloud-dataflow-java/build.gradle
b/runners/google-cloud-dataflow-java/build.gradle
index 558faa8..37dd1af 100644
--- a/runners/google-cloud-dataflow-java/build.gradle
+++ b/runners/google-cloud-dataflow-java/build.gradle
@@ -54,8 +54,8 @@ processResources {
filter org.apache.tools.ant.filters.ReplaceTokens, tokens: [
'dataflow.legacy_environment_major_version' : '8',
'dataflow.fnapi_environment_major_version' : '8',
-'dataflow.legacy_container_version' : 'beam-master-20220203',
-'dataflow.fnapi_container_version' : 'beam-master-20220216',
+'dataflow.legacy_container_version' : '2.38.0',
+'dataflow.fnapi_container_version' : '2.38.0',
'dataflow.container_base_repository' : 'gcr.io/cloud-dataflow/v1beta3',
]
}
[beam] branch release-2.38.0 created (now 3027832)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch release-2.38.0 in repository https://gitbox.apache.org/repos/asf/beam.git. at 3027832 Set Dataflow container to release version. This branch includes the following new commits: new 3027832 Set Dataflow container to release version. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[beam] branch master updated: Moving to 2.39.0-SNAPSHOT on master branch.
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 14862cc Moving to 2.39.0-SNAPSHOT on master branch.
14862cc is described below
commit 14862ccbdf2879574b6ce49149bdd7c9bf197322
Author: Daniel Oliveira
AuthorDate: Wed Mar 23 18:07:09 2022 -0700
Moving to 2.39.0-SNAPSHOT on master branch.
---
.../src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy| 2 +-
gradle.properties | 4 ++--
sdks/go/pkg/beam/core/core.go | 2 +-
sdks/python/apache_beam/version.py| 2 +-
4 files changed, 5 insertions(+), 5 deletions(-)
diff --git
a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
index cf6d0bb..59567d2 100644
--- a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+++ b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
@@ -381,7 +381,7 @@ class BeamModulePlugin implements Plugin {
// Automatically use the official release version if we are performing a
release
// otherwise append '-SNAPSHOT'
-project.version = '2.38.0'
+project.version = '2.39.0'
if (!isRelease(project)) {
project.version += '-SNAPSHOT'
}
diff --git a/gradle.properties b/gradle.properties
index 6fa7d05..1657c38 100644
--- a/gradle.properties
+++ b/gradle.properties
@@ -29,8 +29,8 @@ signing.gnupg.useLegacyGpg=true
# buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy.
# To build a custom Beam version make sure you change it in both places, see
# https://issues.apache.org/jira/browse/BEAM-14051.
-version=2.38.0-SNAPSHOT
-sdk_version=2.38.0.dev
+version=2.39.0-SNAPSHOT
+sdk_version=2.39.0.dev
javaVersion=1.8
diff --git a/sdks/go/pkg/beam/core/core.go b/sdks/go/pkg/beam/core/core.go
index b295ede..7a40dda 100644
--- a/sdks/go/pkg/beam/core/core.go
+++ b/sdks/go/pkg/beam/core/core.go
@@ -27,5 +27,5 @@ const (
// SdkName is the human readable name of the SDK for UserAgents.
SdkName = "Apache Beam SDK for Go"
// SdkVersion is the current version of the SDK.
- SdkVersion = "2.38.0.dev"
+ SdkVersion = "2.39.0.dev"
)
diff --git a/sdks/python/apache_beam/version.py
b/sdks/python/apache_beam/version.py
index b3d2e89..e449d62 100644
--- a/sdks/python/apache_beam/version.py
+++ b/sdks/python/apache_beam/version.py
@@ -17,4 +17,4 @@
"""Apache Beam SDK version information and utilities."""
-__version__ = '2.38.0.dev'
+__version__ = '2.39.0.dev'
[beam] branch master updated (b36a557 -> 6e196b2)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from b36a557 Merge pull request #17114 from ibzib/hdfs-typo add 6e196b2 [BEAM-13893] improved coverage of jobopts package (#17003) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/options/jobopts/options.go | 4 +- sdks/go/pkg/beam/options/jobopts/options_test.go | 131 +++ 2 files changed, 134 insertions(+), 1 deletion(-) create mode 100644 sdks/go/pkg/beam/options/jobopts/options_test.go
[beam] branch master updated (f8a7a18 -> 15e636f)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from f8a7a18 Merge pull request #17079 from [BEAM-13660] Add types and
queries in Spanner's Postgresql dialect
add 15e636f [BEAM-13888] Add unit testing to ioutilx (#17058)
No new revisions were added by this update.
Summary of changes:
sdks/go/pkg/beam/core/util/ioutilx/read_test.go| 94 ++
.../beam/core/util/ioutilx/write_test.go} | 40 +
2 files changed, 112 insertions(+), 22 deletions(-)
create mode 100644 sdks/go/pkg/beam/core/util/ioutilx/read_test.go
copy sdks/go/{test/regression/coders/fromyaml/fromyaml_test.go =>
pkg/beam/core/util/ioutilx/write_test.go} (58%)
[beam] branch master updated (0e9e340 -> 0d454e8)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0e9e340 Merge pull request #17068: [BEAM-13925] Fix import path add 66f9abd [BEAM-13925] Fix one more import path add 0d454e8 Merge pull request #17069: [BEAM-13925] Fix one more import path No new revisions were added by this update. Summary of changes: scripts/ci/pr-bot/shared/reviewerConfig.ts | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] branch master updated (c76a1c8 -> 0e9e340)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from c76a1c8 [BEAM-13925] Find and address prs that havent been reviewed in a week (#17001) add 5a2adff Fix import path add 0e9e340 Merge pull request #17068: [BEAM-13925] Fix import path No new revisions were added by this update. Summary of changes: scripts/ci/pr-bot/shared/commentStrings.ts | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] branch master updated (0d007a7 -> c76a1c8)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 0d007a7 Merge pull request #17065 from [BEAM-14079] [playground]
Improve accessibility
add c76a1c8 [BEAM-13925] Find and address prs that havent been reviewed
in a week (#17001)
No new revisions were added by this update.
Summary of changes:
.github/workflows/pr-bot-new-prs.yml | 2 +-
...ew-prs.yml => pr-bot-prs-needing-attention.yml} | 10 +-
scripts/ci/pr-bot/findPrsNeedingAttention.ts | 222 +
scripts/ci/pr-bot/package-lock.json| 8 +-
scripts/ci/pr-bot/package.json | 9 +-
scripts/ci/pr-bot/processPrUpdate.ts | 45 -
scripts/ci/pr-bot/shared/commentStrings.ts | 36 +++-
scripts/ci/pr-bot/shared/constants.ts | 2 +
scripts/ci/pr-bot/shared/reviewerConfig.ts | 3 +-
9 files changed, 319 insertions(+), 18 deletions(-)
copy .github/workflows/{pr-bot-new-prs.yml =>
pr-bot-prs-needing-attention.yml} (86%)
create mode 100644 scripts/ci/pr-bot/findPrsNeedingAttention.ts
[beam] branch master updated (2d1b023 -> eeccbb0)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 2d1b023 Merge pull request #16844 from [BEAM-12164]: allow for nanosecond precision add eeccbb0 [BEAM-13904] Increase unit testing in the reflectx package (#17024) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/core/util/reflectx/call_test.go | 125 +++ .../pkg/beam/core/util/reflectx/functions_test.go | 7 + .../go/pkg/beam/core/util/reflectx/structs_test.go | 67 sdks/go/pkg/beam/core/util/reflectx/types_test.go | 410 + 4 files changed, 609 insertions(+) create mode 100644 sdks/go/pkg/beam/core/util/reflectx/call_test.go create mode 100644 sdks/go/pkg/beam/core/util/reflectx/structs_test.go create mode 100644 sdks/go/pkg/beam/core/util/reflectx/types_test.go
[beam] branch master updated (f0e14fb -> 95a5c26)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from f0e14fb Merge pull request #17039 Update generated dataflow apitools messages. add 95a5c26 [BEAM-10976] Bundle finalization: Harness and some exec changes (#16980) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/core/runtime/exec/combine.go| 12 ++-- sdks/go/pkg/beam/core/runtime/exec/fn.go | 53 +++--- sdks/go/pkg/beam/core/runtime/exec/fn_test.go| 62 ++-- sdks/go/pkg/beam/core/runtime/exec/pardo.go | 9 +-- sdks/go/pkg/beam/core/runtime/exec/plan.go | 50 + sdks/go/pkg/beam/core/runtime/exec/util.go | 2 +- sdks/go/pkg/beam/core/runtime/harness/harness.go | 92 sdks/go/pkg/beam/runners/direct/buffer.go| 1 - 8 files changed, 238 insertions(+), 43 deletions(-)
[beam] branch master updated (0e4d501 -> 0ca5cfc)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0e4d501 [BEAM-13909] improve coverage of Provision package (#17014) add 665bd60 [BEAM-14050] Update taxi.go example instructions add 0ca5cfc Merge pull request #17019: [BEAM-14050] Update taxi.go example instructions No new revisions were added by this update. Summary of changes: sdks/go/examples/kafka/taxi.go | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
[beam] branch master updated (9833b7b -> 0e4d501)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 9833b7b BEAM-13765 missing PAssert methods (#16668) add 0e4d501 [BEAM-13909] improve coverage of Provision package (#17014) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/provision/provision_test.go | 56 1 file changed, 56 insertions(+)
[beam] branch master updated (efac0c6 -> e1f9910)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from efac0c6 Merge pull request #17007: [BEAM-11085] Test that windows are correctly observed in DoFns add 814e78f Give pr bot write permissions on pr update add e1f9910 Merge pull request #17031: [BEAM-13925] Give pr bot write permissions on pr update No new revisions were added by this update. Summary of changes: .github/workflows/pr-bot-pr-updates.yml | 11 +++ 1 file changed, 11 insertions(+)
[beam] branch master updated (efac0c6 -> e1f9910)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from efac0c6 Merge pull request #17007: [BEAM-11085] Test that windows are correctly observed in DoFns add 814e78f Give pr bot write permissions on pr update add e1f9910 Merge pull request #17031: [BEAM-13925] Give pr bot write permissions on pr update No new revisions were added by this update. Summary of changes: .github/workflows/pr-bot-pr-updates.yml | 11 +++ 1 file changed, 11 insertions(+)
[beam] branch master updated (efac0c6 -> e1f9910)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from efac0c6 Merge pull request #17007: [BEAM-11085] Test that windows are correctly observed in DoFns add 814e78f Give pr bot write permissions on pr update add e1f9910 Merge pull request #17031: [BEAM-13925] Give pr bot write permissions on pr update No new revisions were added by this update. Summary of changes: .github/workflows/pr-bot-pr-updates.yml | 11 +++ 1 file changed, 11 insertions(+)
[beam] 01/01: Merge pull request #17007: [BEAM-11085] Test that windows are correctly observed in DoFns
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit efac0c60b4675029617d2a41372e1ec33121f109 Merge: 58f8bef 93f453c Author: Daniel Oliveira AuthorDate: Mon Mar 7 11:57:25 2022 -0800 Merge pull request #17007: [BEAM-11085] Test that windows are correctly observed in DoFns [BEAM-11085] Test that windows are correctly observed in DoFns .../pkg/beam/core/runtime/exec/fullvalue_test.go | 20 +++ sdks/go/pkg/beam/core/runtime/exec/pardo_test.go | 69 ++ 2 files changed, 89 insertions(+)
[beam] branch master updated (58f8bef -> efac0c6)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 58f8bef [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985) add 93f453c [BEAM-11085] Test that windows are correctly observed in DoFns new efac0c6 Merge pull request #17007: [BEAM-11085] Test that windows are correctly observed in DoFns The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../pkg/beam/core/runtime/exec/fullvalue_test.go | 20 +++ sdks/go/pkg/beam/core/runtime/exec/pardo_test.go | 69 ++ 2 files changed, 89 insertions(+)
[beam] branch master updated: [BEAM-13925] Add ability to get metrics on pr-bot performance (#16985)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 58f8bef [BEAM-13925] Add ability to get metrics on pr-bot performance
(#16985)
58f8bef is described below
commit 58f8bef66f4da09202b2de9dc3166c7fa1f4fa4e
Author: Danny McCormick
AuthorDate: Sun Mar 6 23:55:28 2022 -0500
[BEAM-13925] Add ability to get metrics on pr-bot performance (#16985)
* Add script to get metrics on pr-bot performance
* Respond to feedback
* fix bad condition
---
scripts/ci/pr-bot/gatherMetrics.ts | 528 +
1 file changed, 528 insertions(+)
diff --git a/scripts/ci/pr-bot/gatherMetrics.ts
b/scripts/ci/pr-bot/gatherMetrics.ts
new file mode 100644
index 000..66d0854
--- /dev/null
+++ b/scripts/ci/pr-bot/gatherMetrics.ts
@@ -0,0 +1,528 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+const fs = require("fs");
+const github = require("./shared/githubUtils");
+const {
+ REPO_OWNER,
+ REPO,
+ PATH_TO_METRICS_CSV,
+ BOT_NAME,
+} = require("./shared/constants");
+
+interface PrStats {
+ firstTimeContribution: boolean;
+ timeToFirstReview: number;
+ timeFromCreationToCompletion: number;
+ timeFromReviewersMentionedToCompletion: { [key: string]: number };
+ mergedDate: Date;
+}
+
+interface AggregatedMetrics {
+ prsCompleted: number;
+ prsCompletedByNewContributors: number;
+ averageTimeToFirstReview: number;
+ averageTimeToNewContributorFirstReview: number;
+ averageTimeCreationToCompletion: number;
+ numUsersPerformingReviews: number;
+ numCommittersPerformingReviews: number;
+ numNonCommittersPerformingReviews: number;
+ giniIndexCommittersPerformingReviews: number;
+ averageTimeFromCommitterAssignmentToPrMerge: number;
+}
+
+async function getCompletedPullsFromLastYear(): Promise {
+ const cutoffDate = new Date();
+ cutoffDate.setFullYear(new Date().getFullYear() - 1);
+ console.log(`Getting PRs newer than ${cutoffDate}`);
+ const githubClient = github.getGitHubClient();
+ let result = await githubClient.rest.pulls.list({
+owner: REPO_OWNER,
+repo: REPO,
+state: "closed",
+per_page: 100, // max allowed
+ });
+ let page = 2;
+ let retries = 0;
+ let pulls = result.data;
+ while (
+result.data.length > 0 &&
+new Date(result.data[result.data.length - 1].created_at) > cutoffDate
+ ) {
+if (retries === 0) {
+ console.log(`Getting PRs, page: ${page}`);
+ console.log(
+`Current oldest PR = ${new Date(
+ result.data[result.data.length - 1].created_at
+)}`
+ );
+}
+try {
+ result = await githubClient.rest.pulls.list({
+owner: REPO_OWNER,
+repo: REPO,
+state: "closed",
+per_page: 100, // max allowed
+page: page,
+ });
+ pulls = pulls.concat(result.data);
+ page++;
+ retries = 0;
+} catch (err) {
+ if (retries >= 3) {
+throw err;
+ }
+ retries++;
+}
+ }
+ console.log("Got all PRs, moving to the processing stage");
+ return pulls;
+}
+
+// Rather than check the whole repo history (expensive),
+// we'll just look at the last year's worth of contributions to check if
they're a first time contributor.
+// If they contributed > 1 year ago, their experience is probably similar to a
first time contributor anyways.
+function checkIfFirstTimeContributor(
+ pull: any,
+ pullsFromLastYear: any[]
+): boolean {
+ return !pullsFromLastYear.some(
+(pullFromLastYear) =>
+ pullFromLastYear.created_at < pull.created_at &&
+ pullFromLastYear.user.login === pull.user.login
+ );
+}
+
+// Get time between pr creation and the first comment, approval, or merge that
isn't done by:
+// (a) the author
+// (b) automated tooling
+function getTimeToFirstReview(
+ pull: any,
+ comments: any[],
+ reviews: any[],
+ creationDate: Date,
+ mergedDate: Date
+): number {
+ let timeToFirstReview = mergedDa
[beam] branch master updated (31a0922 -> 3d71323)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 31a0922 [BEAM-14016] Fixed flaky postcommit test (#17009) add 4163124 [BEAM-13925] months in date constructor are 0 indexed add 3d71323 Merge pull request #17013: [BEAM-13925] months in date constructor are 0 indexed No new revisions were added by this update. Summary of changes: scripts/ci/pr-bot/processNewPrs.ts | 10 -- 1 file changed, 8 insertions(+), 2 deletions(-)
[beam] branch master updated (117123c -> 2aa4da0)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 117123c [BEAM-10652] Allow Clustering without Partition in BigQuery
(#16578)
add 2aa4da0 [BEAM-13857] Add K:V flags for expansion service jars and
addresses to Go ITs. (#16908)
No new revisions were added by this update.
Summary of changes:
sdks/go/test/integration/expansions.go | 119 ++
sdks/go/test/integration/expansions_test.go| 179 +
sdks/go/test/integration/flags.go | 86 +-
sdks/go/test/integration/internal/jars/jars.go | 64
.../go/test/integration/internal/jars/proc.go | 14 +-
.../cluster_unix.go => internal/jars/proc_unix.go} | 24 ++-
.../test/integration/internal/jars/run_nonunix.go | 54 +++
sdks/go/test/integration/internal/jars/run_unix.go | 65
.../integration/internal/ports/ports.go} | 18 ++-
9 files changed, 593 insertions(+), 30 deletions(-)
create mode 100644 sdks/go/test/integration/expansions.go
create mode 100644 sdks/go/test/integration/expansions_test.go
create mode 100644 sdks/go/test/integration/internal/jars/jars.go
copy learning/katas/go/introduction/hello_beam/hello_beam/pkg/task/task.go =>
sdks/go/test/integration/internal/jars/proc.go (83%)
copy sdks/go/test/integration/{io/xlang/kafka/cluster_unix.go =>
internal/jars/proc_unix.go} (66%)
create mode 100644 sdks/go/test/integration/internal/jars/run_nonunix.go
create mode 100644 sdks/go/test/integration/internal/jars/run_unix.go
copy sdks/go/{pkg/beam/core/util/protox/protox.go =>
test/integration/internal/ports/ports.go} (69%)
[beam] branch master updated (c094a12 -> ef70473)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from c094a12 Merge pull request #16759 from davidpr91/patch1 add 0abe2e8 [BEAM-13830] Properly shut down Debezium expansion service in IT script. add ef70473 Merge pull request #16797: [BEAM-13830] Properly shut down Debezium expansion service in IT script. No new revisions were added by this update. Summary of changes: sdks/go/test/run_validatesrunner_tests.sh | 3 +++ 1 file changed, 3 insertions(+)
[beam] branch master updated (f36b6e1 -> 06de99b)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from f36b6e1 Update CHANGES.md with Go SDK milestones. (#16787) add 5b9f6be [BEAM-13732] Switch x-lang BigQueryIO expansion service to GCP one. add 06de99b Merge pull request #16784: [BEAM-13732] Switch x-lang BigQueryIO expansion service. No new revisions were added by this update. Summary of changes: sdks/java/extensions/schemaio-expansion-service/build.gradle | 2 -- sdks/java/io/google-cloud-platform/expansion-service/build.gradle | 8 2 files changed, 8 insertions(+), 2 deletions(-)
[beam] branch master updated: [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)
This is an automated email from the ASF dual-hosted git repository.
danoliveira pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 6fe157a [BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)
6fe157a is described below
commit 6fe157aa3857dc44fc042bdb2d45a9fbf2dbaf1b
Author: Daniel Oliveira
AuthorDate: Tue Feb 8 17:42:59 2022 -0800
[BEAM-13732] Add example for Go BigQuery IO wrapper. (#16786)
Also does some polish and fixup to the Kafka taxi example to fix little
nits that were noticed while adding this new example.
---
sdks/go/examples/kafka/taxi.go | 47 +++---
sdks/go/examples/xlang/bigquery/wordcount.go | 220 +++
2 files changed, 245 insertions(+), 22 deletions(-)
diff --git a/sdks/go/examples/kafka/taxi.go b/sdks/go/examples/kafka/taxi.go
index 2c9c3c2..aeb539b 100644
--- a/sdks/go/examples/kafka/taxi.go
+++ b/sdks/go/examples/kafka/taxi.go
@@ -22,7 +22,9 @@
//
// Running this example requires a Kafka cluster accessible to the runner, and
// a cross-language expansion service that can expand Kafka read and write
-// transforms.
+// transforms. An address to a persistent expansion service can be provided as
+// a flag, or if none is specified then the SDK will attempt to automatically
+// start an appropriate expansion service.
//
// Setting Up a Kafka Cluster
//
@@ -34,22 +36,24 @@
//
// Running an Expansion Server
//
-// These instructions will cover running the Java IO Expansion Service, and
-// therefore requires a JDK installation in a version supported by Beam.
-// Depending on whether you are running this from a numbered Beam release, or a
-// development environment, there are two sources you may use for the Expansion
-// service.
+// If the automatic expansion service functionality is not available for your
+// environment, or if you want improved performance, you will need to start a
+// persistent expansion service. These instructions will cover running the Java
+// IO Expansion Service, and therefore requires a JDK installation in a version
+// supported by Beam. Depending on whether you are running this from a numbered
+// Beam release, or a development environment, there are two sources you may
+// use for the Expansion service.
//
// Numbered release: The expansion service jar is vendored as module
-// org.apache.beam:beam-sdks-java-io-expansion-service in Maven Repository.
-// This jar can be executed directly with the following command:
+// org.apache.beam:beam-sdks-java-io-expansion-service in Maven Repository.
+// This jar can be executed directly with the following command:
// `java -jar `
// Development env: This requires that the JAVA_HOME environment variable
-// points to your JDK installation. From the root `beam/` directory of the
-// Apache Beam repository, the jar can be built (or built and run) with the
-// following commands:
-// Build: ./gradlew :sdks:java:io:expansion-service:build
-// Build and Run: ./gradlew
:sdks:java:io:expansion-service:runExpansionService
-PconstructionService.port=
+// points to your JDK installation. From the root `beam/` directory of the
+// Apache Beam repository, the jar can be built (or built and run) with the
+// following commands:
+// Build: ./gradlew :sdks:java:io:expansion-service:build
+// Build and Run: ./gradlew
:sdks:java:io:expansion-service:runExpansionService
-PconstructionService.port=
//
// Running the Example on GCP
//
@@ -64,7 +68,7 @@
// export JOB_NAME="kafka-taxi-`date +%Y%m%d-%H%M%S`"
// export BOOTSTRAP_SERVERS="123.45.67.89:1234"
// export EXPANSION_ADDR="localhost:1234"
-// go run ./sdks/go/examples/kafka/types/types.go \
+// go run ./sdks/go/examples/kafka/taxi.go \
// --runner=DataflowRunner \
// --temp_location=$TEMP_LOCATION \
// --staging_location=$STAGING_LOCATION \
@@ -72,7 +76,6 @@
// --region=$REGION \
// --job_name="${JOB_NAME}" \
// --bootstrap_servers=$BOOTSTRAP_SERVER \
-// --experiments=use_portable_job_submission,use_runner_v2 \
// --expansion_addr=$EXPANSION_ADDR
//
// Running the Example From a Git Clone
@@ -91,9 +94,11 @@
// accessible locally.
//
// Additionally, you must provide the location of your custom container to the
-// pipeline with the --sdk_harness_container_image_override flag. For example:
+// pipeline with the --sdk_harness_container_image_override flag for Java, or
+// --environment_config flag for Go. For example:
//
-//
--sdk_harness_container_image_override=".*java.*,${DOCKER_ROOT}/beam_java8_sdk:latest"
+//
--sdk_harness_container_image_override=".*java.*,${DOCKER_ROOT}/beam_java8_sdk:latest"
\
+// --environment_config=${DOCKER_ROOT}/beam_go_sdk:latest
package main
import (
@@ -111,9 +116,10 @@ import (
)
[beam] branch master updated (b09f51a -> b14010d)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from b09f51a [BEAM-12914] Add missing 3.9 opcodes to type inference. (#16761) add b14010d [BEAM-13321] Initial BigQueryIO externalization. (#16489) No new revisions were added by this update. Summary of changes: .../schemaio-expansion-service/build.gradle| 2 + .../io/gcp/bigquery/BigQuerySchemaIOProvider.java | 216 + 2 files changed, 218 insertions(+) create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQuerySchemaIOProvider.java
[beam] branch master updated (1693483 -> 67d4b10)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 1693483 Merge pull request #16700 from [BEAM-13790][Playground] Change logic of receiving examples from the bucket on backend side add 67d4b10 [BEAM-13830] update dependency for debeziumio expansion service (#16743) No new revisions were added by this update. Summary of changes: sdks/java/io/expansion-service/build.gradle | 2 ++ 1 file changed, 2 insertions(+)
[beam] branch master updated (b9a7695 -> b4779eb)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from b9a7695 [BEAM-13574] Large Wordcount (#16455) add b4779eb [BEAM-13293] Refactor JDBC IO Go Wrapper (#16686) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/io/xlang/jdbcio/jdbc.go | 114 +++-- sdks/go/test/integration/integration.go| 8 ++ sdks/go/test/integration/io/xlang/jdbc/jdbc.go | 6 +- 3 files changed, 81 insertions(+), 47 deletions(-)
[beam] branch master updated (6d471c9 -> 38b7e47)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 6d471c9 Merge pull request #16524: [BEAM-10206] Clean up some simple staticcheck warnings in Go SDK add 38b7e47 [BEAM-13664] Fix Primitives hashing benchmark (#16523) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/core/runtime/exec/hash.go | 2 +- sdks/go/pkg/beam/core/runtime/exec/hash_test.go | 20 2 files changed, 13 insertions(+), 9 deletions(-)
[beam] branch master updated (a421b69 -> 6d471c9)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from a421b69 [BEAM-12621] - Update Jenkins VMs to modern Ubuntu version (#16457) add d88b492 Fix staticcheck errors in transforms directory add 7ce4aa9 Remove unnecessary fmt.Sprintf() in partition.go add 15c7d69 Replace bytes.Compare() with bytes.Equal() in test cases add 56a0b55 Replace string(buf.Bytes()) with buf.String() in coder_test.go add 235a9c3 Remove unnecessary blank identifier assignment in harness.go add 413be9b fix capitalized error strings in expansionx add 3a8fb56 Clean up string cast of bytes in vet.go and corresponding tests add f061f91 Remove unnecessary fmt call in universal.go add 6d471c9 Merge pull request #16524: [BEAM-10206] Clean up some simple staticcheck warnings in Go SDK No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/coder_test.go | 2 +- sdks/go/pkg/beam/core/runtime/harness/harness.go| 2 +- sdks/go/pkg/beam/core/runtime/xlangx/expansionx/download.go | 4 ++-- sdks/go/pkg/beam/core/runtime/xlangx/expansionx/process.go | 4 ++-- sdks/go/pkg/beam/external_test.go | 2 +- sdks/go/pkg/beam/pardo_test.go | 4 ++-- sdks/go/pkg/beam/partition.go | 2 +- sdks/go/pkg/beam/runners/universal/universal.go | 3 +-- sdks/go/pkg/beam/runners/vet/vet.go | 2 +- sdks/go/pkg/beam/runners/vet/vet_test.go| 2 +- sdks/go/pkg/beam/transforms/top/top.go | 5 ++--- 11 files changed, 15 insertions(+), 17 deletions(-)
[beam] branch master updated (e38c6ac -> 454ddba)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from e38c6ac Merge pull request #16528 Remove tab from source. add 205bafc [BEAM-10206] Resolve go vet errors in protox package add 454ddba Merge pull request #16520: [BEAM-10206] Resolve go vet errors in protox package No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/core/util/protox/any_test.go | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[beam] branch master updated (4d8d115 -> f0d6403)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 4d8d115 Merge pull request #16232 from [BEAM-13285][Playground] Add steps to playgroundPrecommit gradle tasks add f0d6403 [BEAM-13399] Add check for dev versions of JARs to download code (#16228) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/core/runtime/xlangx/expansionx/download.go | 5 + .../pkg/beam/core/runtime/xlangx/expansionx/download_test.go | 11 +++ 2 files changed, 16 insertions(+)
[beam] branch master updated (d185303 -> 112b3cd)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from d185303 [BEAM-13218] Sickbay PubSubIntegrationTest.test_streaming_with_attributes (#16251) add 112b3cd [BEAM-13399] Add infrastructure to start JARs from Go functions (#16214) No new revisions were added by this update. Summary of changes: .../beam/core/runtime/xlangx/expansionx/process.go | 71 ++ .../core/runtime/xlangx/expansionx/process_test.go | 85 ++ 2 files changed, 156 insertions(+) create mode 100644 sdks/go/pkg/beam/core/runtime/xlangx/expansionx/process.go create mode 100644 sdks/go/pkg/beam/core/runtime/xlangx/expansionx/process_test.go
[beam] branch master updated (d41ae47 -> 6a552dc)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from d41ae47 [BEAM-12976] Pipeline visitor to discover pushdown opportunities. (#16176) add a8bcfc2 [BEAM-13321] Pass TempLocation as pipeline option to Dataflow Go for xlang. add 6a552dc Merge pull request #16069: [BEAM-13321] Pass TempLocation as pipeline option to Dataflow Go for XLang. No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/runners/dataflow/dataflowlib/job.go | 17 +++-- 1 file changed, 11 insertions(+), 6 deletions(-)
[beam] 01/01: Merge pull request #16068: Minor Gradle Fixups: Removing unneeded dependency in expansion service.
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 89763b98388b14626ad7a0c7a1256e1c700962d4 Merge: ad56edb f21907a Author: Daniel Oliveira AuthorDate: Mon Dec 6 17:02:27 2021 -0800 Merge pull request #16068: Minor Gradle Fixups: Removing unneeded dependency in expansion service. Minor Gradle Fixups: Removing unneeded dependency in expansion service. sdks/java/extensions/schemaio-expansion-service/build.gradle | 6 ++ sdks/java/io/expansion-service/build.gradle | 2 -- 2 files changed, 6 insertions(+), 2 deletions(-)
[beam] branch master updated (ad56edb -> 89763b9)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from ad56edb Merge pull request #16135 from y1chi/BEAM-13380 add f21907a Minor Gradle Fixups: Removing unneeded dependency in expansion service. new 89763b9 Merge pull request #16068: Minor Gradle Fixups: Removing unneeded dependency in expansion service. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/java/extensions/schemaio-expansion-service/build.gradle | 6 ++ sdks/java/io/expansion-service/build.gradle | 2 -- 2 files changed, 6 insertions(+), 2 deletions(-)
[beam] branch master updated (975d71a -> 8c143ab)
This is an automated email from the ASF dual-hosted git repository. danoliveira pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 975d71a Test SetState addIfAbsent with no read (#15776) add 30d1191 Avoiding read-only Go module cache in Gradle config. add 8c143ab Merge pull request #15777: [BEAM-12830] Avoiding read-only Go module cache in Gradle config. No new revisions were added by this update. Summary of changes: sdks/go/build.gradle | 13 + sdks/go/container/build.gradle | 13 + sdks/go/examples/build.gradle | 13 + sdks/go/test/build.gradle | 14 ++ sdks/go/test/load/build.gradle | 13 + sdks/java/container/build.gradle | 13 + sdks/python/container/build.gradle | 13 + 7 files changed, 92 insertions(+)
