[beam] branch asf-site updated: Publishing website 2022/01/26 06:01:43 at commit 81006dd
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e851960 Publishing website 2022/01/26 06:01:43 at commit 81006dd
e851960 is described below
commit e85196059215526b2a5396e5fcbf9b8734052409
Author: jenkins
AuthorDate: Wed Jan 26 06:01:44 2022 +
Publishing website 2022/01/26 06:01:43 at commit 81006dd
---
website/generated-content/privacy_policy/index.html | 2 +-
website/generated-content/sitemap.xml | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/website/generated-content/privacy_policy/index.html
b/website/generated-content/privacy_policy/index.html
index 68c441d..5a67bd9 100644
--- a/website/generated-content/privacy_policy/index.html
+++ b/website/generated-content/privacy_policy/index.html
@@ -18,7 +18,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you
looking for?");}
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}Information about your use of this website is
collected using server access logs and a tracking cookie. The collected
information consists of the following:The IP address from which you
access the website;The type of browser and operating system you use to
access our site;The date and time you access our site;The
pages you visit; andThe addresses of p [...]
+function openMenu(){addPlaceholder();blockScroll();}Information about your use of this website is
collected using server access logs and a tracking cookie. The collected
information consists of the following:The IP address from which you
access the website;The type of browser and operating system you use to
access our site;The date and time you access our site;The
pages you visit; andThe addresses of p [...]
http://www.apache.org>The Apache Software Foundation
| Privacy Policy
| RSS FeedApache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index ff690e8..afb0369 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.35.0/2021-12-29T17:49:39-08:00/categories/blog/2021-12-29T17:49:39-08:00/blog/2021-12-29T17:49:39-08:00/categories/2021-12-29T17:49:39-08:00/blog/b
[...]
\ No newline at end of file
+http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.35.0/2021-12-29T17:49:39-08:00/categories/blog/2021-12-29T17:49:39-08:00/blog/2021-12-29T17:49:39-08:00/categories/2021-12-29T17:49:39-08:00/blog/b
[...]
\ No newline at end of file
[beam] branch nightly-refs/heads/master updated (abac2df -> 81006dd)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git. from abac2df Improved multi-language pipelines section of the programming guide (#16587) add 00208fb [BEAM-13510] Don't retry on invalid SQS receipt handles. add e1a3fdf Merge pull request #16478 from mosche/BEAM-13510-InvalidRetries add 1129d91 [BEAM-13736] Make lifting cache exact. (#16603) add 1c10de1 Merge pull request #16565 from [BEAM-13692][Playground] Implement method to receive Graph add 276c351 Merge pull request #16502 from [BEAM-13650][Playground] Add link for examples add 640e6c2 [BEAM-13310] remove call to get offset consumer config, which was rep… (#16588) add 305d943 [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID. add 93202b4 Merge pull request #16599: [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID. add 1566784 Privacy policy update regarding Apache Beam Playground add 81006dd Merge pull request #16594 from [BEAM-13710][Playground] Update the Apache Beam privacy policy with Playground note No new revisions were added by this update. Summary of changes: playground/api/v1/api.proto| 13 + playground/backend/cmd/server/controller.go| 15 + playground/backend/internal/api/v1/api.pb.go | 668 +++- playground/backend/internal/api/v1/api_grpc.pb.go | 38 + playground/backend/internal/cache/cache.go |3 + .../backend/internal/cache/redis/redis_cache.go|9 +- .../internal/cache/redis/redis_cache_test.go |9 + .../internal/code_processing/code_processing.go| 22 +- .../code_processing/code_processing_test.go|4 +- playground/frontend/lib/api/v1/api.pb.dart | 1112 +++- playground/frontend/lib/api/v1/api.pbgrpc.dart | 28 +- playground/frontend/lib/api/v1/api.pbjson.dart | 187 +--- playground/frontend/lib/constants/links.dart |2 +- .../components/playground_page_footer.dart |9 +- .../components/playground_privacy_policy.dart | 85 -- playground/infrastructure/cd_helper.py |1 + playground/infrastructure/config.py|1 + playground/infrastructure/helper.py|6 +- playground/infrastructure/test_cd_helper.py|6 +- playground/infrastructure/test_helper.py | 12 +- sdks/go/pkg/beam/core/runtime/exec/combine.go | 200 +++- sdks/go/pkg/beam/core/runtime/exec/combine_test.go | 196 sdks/java/io/amazon-web-services2/build.gradle |2 +- .../beam/sdk/io/aws2/sqs/SqsCheckpointMark.java| 33 +- .../beam/sdk/io/aws2/sqs/SqsUnboundedReader.java | 288 +++-- .../beam/sdk/io/aws2/sqs/EmbeddedSqsServer.java| 69 +- .../org/apache/beam/sdk/io/aws2/sqs/SqsIOTest.java | 15 +- .../sdk/io/aws2/sqs/SqsUnboundedReaderTest.java| 213 ++-- .../sdk/io/aws2/sqs/SqsUnboundedSourceTest.java| 22 +- .../sdk/io/gcp/bigquery/BigQueryServicesImpl.java |2 +- .../beam/sdk/io/kafka/KafkaCommitOffset.java |9 +- .../beam/sdk/io/kafka/KafkaCommitOffsetTest.java | 84 ++ .../www/site/content/en/privacy_policy/_index.md |2 + 33 files changed, 1770 insertions(+), 1595 deletions(-) delete mode 100644 playground/frontend/lib/pages/playground/components/playground_privacy_policy.dart create mode 100644 sdks/java/io/kafka/src/test/java/org/apache/beam/sdk/io/kafka/KafkaCommitOffsetTest.java
[beam] branch master updated: Privacy policy update regarding Apache Beam Playground
This is an automated email from the ASF dual-hosted git repository.
aizhamal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 1566784 Privacy policy update regarding Apache Beam Playground
new 81006dd Merge pull request #16594 from [BEAM-13710][Playground]
Update the Apache Beam privacy policy with Playground note
1566784 is described below
commit 15667849614691a11eb136e1d1d24a52f95e9798
Author: Artur Khanin
AuthorDate: Mon Jan 24 18:26:48 2022 +0300
Privacy policy update regarding Apache Beam Playground
---
playground/frontend/lib/constants/links.dart | 2 +-
.../components/playground_page_footer.dart | 9 +--
.../components/playground_privacy_policy.dart | 85 --
.../www/site/content/en/privacy_policy/_index.md | 2 +
4 files changed, 6 insertions(+), 92 deletions(-)
diff --git a/playground/frontend/lib/constants/links.dart
b/playground/frontend/lib/constants/links.dart
index 7db611b..e3b34eb 100644
--- a/playground/frontend/lib/constants/links.dart
+++ b/playground/frontend/lib/constants/links.dart
@@ -17,7 +17,7 @@
*/
const kReportIssueLink =
'https://issues.apache.org/jira/projects/BEAM/issues/';
-const kGooglePrivacyPolicyLink = 'https://policies.google.com/privacy';
+const kBeamPrivacyPolicyLink = 'https://beam.apache.org/privacy_policy/';
const kBeamPlaygroundGithubLink =
'https://github.com/apache/beam/tree/master/playground';
const kApacheBeamGithubLink = 'https://github.com/apache/beam';
diff --git
a/playground/frontend/lib/pages/playground/components/playground_page_footer.dart
b/playground/frontend/lib/pages/playground/components/playground_page_footer.dart
index b40256b..dbf8039 100644
---
a/playground/frontend/lib/pages/playground/components/playground_page_footer.dart
+++
b/playground/frontend/lib/pages/playground/components/playground_page_footer.dart
@@ -24,7 +24,6 @@ import 'package:playground/constants/links.dart';
import 'package:playground/constants/sizes.dart';
import 'package:playground/modules/analytics/analytics_service.dart';
import
'package:playground/pages/playground/components/feedback/playground_feedback.dart';
-import
'package:playground/pages/playground/components/playground_privacy_policy.dart';
import 'package:url_launcher/url_launcher.dart';
class PlaygroundPageFooter extends StatelessWidget {
@@ -62,11 +61,9 @@ class PlaygroundPageFooter extends StatelessWidget {
textStyle: const TextStyle(fontWeight: kNormalWeight),
),
onPressed: () {
-showDialog(
- context: context,
- builder: (BuildContext context) =>
- const PlaygroundPrivacyPolicy(),
-);
+AnalyticsService.get(context)
+.trackOpenLink(kBeamPrivacyPolicyLink);
+launch(kBeamPrivacyPolicyLink);
},
child: Text(appLocale.privacyPolicy),
),
diff --git
a/playground/frontend/lib/pages/playground/components/playground_privacy_policy.dart
b/playground/frontend/lib/pages/playground/components/playground_privacy_policy.dart
deleted file mode 100644
index 013bb1a..000
---
a/playground/frontend/lib/pages/playground/components/playground_privacy_policy.dart
+++ /dev/null
@@ -1,85 +0,0 @@
-/*
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements. See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership. The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License. You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-
-import 'package:flutter/gestures.dart';
-import 'package:flutter/material.dart';
-import 'package:playground/constants/colors.dart';
-import 'package:playground/constants/links.dart';
-import 'package:playground/modules/analytics/analytics_service.dart';
-import 'package:url_launcher/url_launcher.dart';
-
-const kPrivacyPolicyTextStart =
-'''Apache Beam Playground is a free, open source service to help
developers learn about the Apache Beam programming model. Source code entered
into Apache Beam Playground may be sent to servers running in Google Cloud
Platform to be analyzed for errors/warnings, compiled to Java, Golang, and
Scala, interpreted with Python and returned to the browser.
-
[beam] branch master updated (640e6c2 -> 93202b4)
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 640e6c2 [BEAM-13310] remove call to get offset consumer config, which was rep… (#16588) add 305d943 [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID. add 93202b4 Merge pull request #16599: [BEAM-13321] Fix exception with BigQuery StreamWriter TraceID. No new revisions were added by this update. Summary of changes: .../java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam] branch master updated (276c351 -> 640e6c2)
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 276c351 Merge pull request #16502 from [BEAM-13650][Playground] Add link for examples add 640e6c2 [BEAM-13310] remove call to get offset consumer config, which was rep… (#16588) No new revisions were added by this update. Summary of changes: .../beam/sdk/io/kafka/KafkaCommitOffset.java | 9 +-- .../beam/sdk/io/kafka/KafkaCommitOffsetTest.java | 84 ++ 2 files changed, 86 insertions(+), 7 deletions(-) create mode 100644 sdks/java/io/kafka/src/test/java/org/apache/beam/sdk/io/kafka/KafkaCommitOffsetTest.java
[beam] branch master updated (1c10de1 -> 276c351)
This is an automated email from the ASF dual-hosted git repository. pabloem pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 1c10de1 Merge pull request #16565 from [BEAM-13692][Playground] Implement method to receive Graph add 276c351 Merge pull request #16502 from [BEAM-13650][Playground] Add link for examples No new revisions were added by this update. Summary of changes: playground/infrastructure/cd_helper.py | 1 + playground/infrastructure/config.py | 1 + playground/infrastructure/helper.py | 6 +- playground/infrastructure/test_cd_helper.py | 6 -- playground/infrastructure/test_helper.py| 12 5 files changed, 19 insertions(+), 7 deletions(-)
[beam] branch master updated (1129d91 -> 1c10de1)
This is an automated email from the ASF dual-hosted git repository. pabloem pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 1129d91 [BEAM-13736] Make lifting cache exact. (#16603) add 1c10de1 Merge pull request #16565 from [BEAM-13692][Playground] Implement method to receive Graph No new revisions were added by this update. Summary of changes: playground/api/v1/api.proto| 13 + playground/backend/cmd/server/controller.go| 15 + playground/backend/internal/api/v1/api.pb.go | 668 +++- playground/backend/internal/api/v1/api_grpc.pb.go | 38 + playground/backend/internal/cache/cache.go |3 + .../backend/internal/cache/redis/redis_cache.go|9 +- .../internal/cache/redis/redis_cache_test.go |9 + .../internal/code_processing/code_processing.go| 22 +- .../code_processing/code_processing_test.go|4 +- playground/frontend/lib/api/v1/api.pb.dart | 1112 +++- playground/frontend/lib/api/v1/api.pbgrpc.dart | 28 +- playground/frontend/lib/api/v1/api.pbjson.dart | 187 +--- 12 files changed, 939 insertions(+), 1169 deletions(-)
[beam] branch master updated (e1a3fdf -> 1129d91)
This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from e1a3fdf Merge pull request #16478 from mosche/BEAM-13510-InvalidRetries add 1129d91 [BEAM-13736] Make lifting cache exact. (#16603) No new revisions were added by this update. Summary of changes: sdks/go/pkg/beam/core/runtime/exec/combine.go | 200 - sdks/go/pkg/beam/core/runtime/exec/combine_test.go | 196 2 files changed, 348 insertions(+), 48 deletions(-)
[beam] branch master updated: [BEAM-13510] Don't retry on invalid SQS receipt handles.
This is an automated email from the ASF dual-hosted git repository.
echauchot pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 00208fb [BEAM-13510] Don't retry on invalid SQS receipt handles.
new e1a3fdf Merge pull request #16478 from
mosche/BEAM-13510-InvalidRetries
00208fb is described below
commit 00208fbb62feb04260ac07d3ba64c9fd316aaeea
Author: Moritz Mack
AuthorDate: Wed Dec 29 15:40:42 2021 +0100
[BEAM-13510] Don't retry on invalid SQS receipt handles.
---
sdks/java/io/amazon-web-services2/build.gradle | 2 +-
.../beam/sdk/io/aws2/sqs/SqsCheckpointMark.java| 33 ++-
.../beam/sdk/io/aws2/sqs/SqsUnboundedReader.java | 288 +
.../beam/sdk/io/aws2/sqs/EmbeddedSqsServer.java| 69 +++--
.../org/apache/beam/sdk/io/aws2/sqs/SqsIOTest.java | 15 +-
.../sdk/io/aws2/sqs/SqsUnboundedReaderTest.java| 213 ---
.../sdk/io/aws2/sqs/SqsUnboundedSourceTest.java| 22 +-
7 files changed, 371 insertions(+), 271 deletions(-)
diff --git a/sdks/java/io/amazon-web-services2/build.gradle
b/sdks/java/io/amazon-web-services2/build.gradle
index 2fe845d..b8aa0ec 100644
--- a/sdks/java/io/amazon-web-services2/build.gradle
+++ b/sdks/java/io/amazon-web-services2/build.gradle
@@ -62,7 +62,7 @@ dependencies {
testImplementation library.java.mockito_core
testImplementation library.java.guava_testlib
testImplementation library.java.junit
- testImplementation 'org.elasticmq:elasticmq-rest-sqs_2.12:0.15.6'
+ testImplementation 'org.elasticmq:elasticmq-rest-sqs_2.12:0.15.6' // later
versions conflict with s3mock
testImplementation library.java.hamcrest
testImplementation library.java.powermock
testImplementation library.java.powermock_mockito
diff --git
a/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sqs/SqsCheckpointMark.java
b/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sqs/SqsCheckpointMark.java
index 2a9a630..823f96c 100644
---
a/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sqs/SqsCheckpointMark.java
+++
b/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/sqs/SqsCheckpointMark.java
@@ -21,6 +21,7 @@ import static
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Prec
import java.io.IOException;
import java.io.Serializable;
+import java.util.Collection;
import java.util.List;
import java.util.Optional;
import org.apache.beam.sdk.io.UnboundedSource;
@@ -35,28 +36,38 @@ import org.checkerframework.checker.nullness.qual.Nullable;
class SqsCheckpointMark implements UnboundedSource.CheckpointMark,
Serializable {
/**
- * If the checkpoint is for persisting: the reader who's snapshotted state
we are persisting. If
- * the checkpoint is for restoring: {@literal null}. Not persisted in
durable checkpoint. CAUTION:
- * Between a checkpoint being taken and {@link #finalizeCheckpoint()} being
called the 'true'
- * active reader may have changed.
+ * The reader this checkpoint was created from.
+ *
+ * Not persisted in durable checkpoint, {@code null} after
restoring the checkpoint.
+ *
+ * CAUTION:Between a checkpoint being taken and {@link
#finalizeCheckpoint()} being
+ * called the 'true' active reader may have changed.
*/
private transient Optional reader;
+
/**
- * If the checkpoint is for persisting: The ids of messages which have been
passed downstream
- * since the last checkpoint. If the checkpoint is for restoring: {@literal
null}. Not persisted
- * in durable checkpoint.
+ * Contains message ids that have been passed downstream since the last
checkpoint.
+ *
+ * Corresponding messages have to be purged from SQS when finalizing the
checkpoint to prevent
+ * re-delivery.
+ *
+ * Not persisted in durable checkpoint, {@code null} after
restoring the checkpoint.
*/
private @Nullable List safeToDeleteIds;
/**
- * If the checkpoint is for persisting: The receipt handles of messages
which have been received
- * from SQS but not yet passed downstream at the time of the snapshot. If
the checkpoint is for
- * restoring: Same, but recovered from durable storage.
+ * Contains receipt handles of messages which have been received from SQS,
but not yet passed
+ * downstream at the time of the snapshot.
+ *
+ * When restoring from a checkpoint, the visibility timeout of
corresponding messages is set to
+ * {@code 0} to trigger immediate re-delivery.
*/
@VisibleForTesting final List notYetReadReceipts;
SqsCheckpointMark(
- SqsUnboundedReader reader, List messagesToDelete, List
notYetReadReceipts) {
+ SqsUnboundedReader reader,
+ Collection messagesToDelete,
+ Collection notYetReadReceipts) {
this.reader = Optional.of(reader);
this.safeToDeleteIds = Immutabl
