(beam) branch master updated (365c2d92965 -> 0afb52d94c5)
This is an automated email from the ASF dual-hosted git repository. janl pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 365c2d92965 Support Kafka Managed IO (#31172) add 5ff55b1caf1 [flink] Add documentation for Flink runner versions updates add 0afb52d94c5 Merge pull request #31217: [flink] Add documentation for Flink runner versions updates No new revisions were added by this update. Summary of changes: .../actions/setup-default-test-properties/test-properties.json| 2 +- sdks/go/examples/wasm/README.md | 2 +- sdks/python/apache_beam/options/pipeline_options.py | 2 +- sdks/typescript/src/apache_beam/runners/flink.ts | 2 +- settings.gradle.kts | 8 website/www/site/content/en/documentation/runners/flink.md| 8 +++- 6 files changed, 19 insertions(+), 5 deletions(-)
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new f7e0803e9e4 Updating config from bot
f7e0803e9e4 is described below
commit f7e0803e9e41d3b0d512a80668e6401633758297
Author: github-actions
AuthorDate: Fri May 10 12:13:43 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-28763.json | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-28763.json
b/scripts/ci/pr-bot/state/pr-state/pr-28763.json
index 4d841dcb81c..e60e30c39af 100644
--- a/scripts/ci/pr-bot/state/pr-state/pr-28763.json
+++ b/scripts/ci/pr-bot/state/pr-state/pr-28763.json
@@ -1,8 +1,8 @@
{
"commentedAboutFailingChecks": false,
"reviewersAssignedForLabels": {
-"java": "Abacn",
-"io": "johnjcasey"
+"java": "kennknowles",
+"io": "ahmedabu98"
},
"nextAction": "Reviewers",
"stopReviewerNotifications": false,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 0537da2ede5 Updating config from bot 0537da2ede5 is described below commit 0537da2ede5fba05eb390f8535c68b7f4dbac56e Author: github-actions AuthorDate: Fri May 10 12:13:45 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json b/scripts/ci/pr-bot/state/reviewers-for-label-io.json index 4b46d20a9d3..4d592c158dc 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json @@ -5,7 +5,7 @@ "johnjcasey": 1715158075817, "pabloem": 1691787951165, "Abacn": 1714671274562, -"ahmedabu98": 1714565622680, +"ahmedabu98": 1715343222025, "bvolpato": 1712595969392, "manavgarg": 1690826779210, "damondouglas": 1714579854906,
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 075d3bba7fe Updating config from bot
075d3bba7fe is described below
commit 075d3bba7fe4ab439c254cc013b88ddff8c64a54
Author: github-actions
AuthorDate: Fri May 10 12:13:44 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/reviewers-for-label-java.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-java.json
b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
index 00cd6895e1e..0c1cdb8998a 100644
--- a/scripts/ci/pr-bot/state/reviewers-for-label-java.json
+++ b/scripts/ci/pr-bot/state/reviewers-for-label-java.json
@@ -2,7 +2,7 @@
"label": "java",
"dateOfLastReviewAssignment": {
"lukecwik": 1680701852535,
-"kennknowles": 1714599265290,
+"kennknowles": 1715343221607,
"robertwb": 1715106922025,
"kileys": 1674428678843,
"apilloud": 1678822446183,
(beam) branch master updated: Fix #31212 by removing the extra space in option string. (#31233)
This is an automated email from the ASF dual-hosted git repository. yhu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new cc1024cf164 Fix #31212 by removing the extra space in option string. (#31233) cc1024cf164 is described below commit cc1024cf16484b85fd1101edfa320bff4935f607 Author: Shunping Huang AuthorDate: Fri May 10 09:56:03 2024 -0400 Fix #31212 by removing the extra space in option string. (#31233) --- sdks/python/apache_beam/runners/dataflow/dataflow_runner.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py b/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py index b8837ce13c9..162ace3ca45 100644 --- a/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py +++ b/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py @@ -420,7 +420,7 @@ class DataflowRunner(PipelineRunner): for pcoll in self.proto_pipeline.components.pcollections.values()): if (not options.view_as(StandardOptions).streaming and not options.view_as(DebugOptions).lookup_experiment( - 'unsafely_attempt_to_process_unbounded_data_in_batch_mode ')): + 'unsafely_attempt_to_process_unbounded_data_in_batch_mode')): _LOGGER.info( 'Automatically inferring streaming mode ' 'due to unbounded PCollections.')
(beam) branch master updated: Avoid oversizing batch sizes with size estimation function (#31228)
This is an automated email from the ASF dual-hosted git repository.
jrmccluskey pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 2d53926542f Avoid oversizing batch sizes with size estimation function
(#31228)
2d53926542f is described below
commit 2d53926542f82a8b955eb541f13475f9bef091a7
Author: Danny McCormick
AuthorDate: Fri May 10 10:12:17 2024 -0400
Avoid oversizing batch sizes with size estimation function (#31228)
* Avoid oversizing batch sizes with size estimation function
* lint
---
sdks/python/apache_beam/transforms/util.py | 18 --
sdks/python/apache_beam/transforms/util_test.py | 33 ++---
2 files changed, 40 insertions(+), 11 deletions(-)
diff --git a/sdks/python/apache_beam/transforms/util.py
b/sdks/python/apache_beam/transforms/util.py
index edf79b7c798..750d98f0789 100644
--- a/sdks/python/apache_beam/transforms/util.py
+++ b/sdks/python/apache_beam/transforms/util.py
@@ -579,14 +579,15 @@ class _GlobalWindowsBatchingDoFn(DoFn):
self._batch_size_estimator.ignore_next_timing()
def process(self, element):
-self._batch.append(element)
-self._running_batch_size += self._element_size_fn(element)
-if self._running_batch_size >= self._target_batch_size:
+element_size = self._element_size_fn(element)
+if self._running_batch_size + element_size > self._target_batch_size:
with self._batch_size_estimator.record_time(self._running_batch_size):
yield window.GlobalWindows.windowed_value_at_end_of_window(self._batch)
self._batch = []
self._running_batch_size = 0
self._target_batch_size = self._batch_size_estimator.next_batch_size()
+self._batch.append(element)
+self._running_batch_size += element_size
def finish_bundle(self):
if self._batch:
@@ -621,15 +622,18 @@ class _WindowAwareBatchingDoFn(DoFn):
def process(self, element, window=DoFn.WindowParam):
batch = self._batches[window]
-batch.elements.append(element)
-batch.size += self._element_size_fn(element)
-if batch.size >= self._target_batch_size:
+element_size = self._element_size_fn(element)
+if batch.size + element_size > self._target_batch_size:
with self._batch_size_estimator.record_time(batch.size):
yield windowed_value.WindowedValue(
batch.elements, window.max_timestamp(), (window, ))
del self._batches[window]
self._target_batch_size = self._batch_size_estimator.next_batch_size()
-elif len(self._batches) > self._MAX_LIVE_WINDOWS:
+
+self._batches[window].elements.append(element)
+self._batches[window].size += element_size
+
+if len(self._batches) > self._MAX_LIVE_WINDOWS:
window, batch = max(
self._batches.items(),
key=lambda window_batch: window_batch[1].size)
diff --git a/sdks/python/apache_beam/transforms/util_test.py
b/sdks/python/apache_beam/transforms/util_test.py
index 53898d57998..74d9f438a5d 100644
--- a/sdks/python/apache_beam/transforms/util_test.py
+++ b/sdks/python/apache_beam/transforms/util_test.py
@@ -299,15 +299,40 @@ class BatchElementsTest(unittest.TestCase):
res = (
p
| beam.Create([
- 'a', 'a', 'aa', # First batch.
- 'aa', 'a', # Second batch.
- 'a', 'aaa', 'a', 'a' # Third batch.
+ 'a', 'a',# First batch.
+ 'aa',# Second batch.
+ 'a', 'a',# Third batch.
+ 'a', 'aaa', 'a', 'a' # Fourth batch.
], reshuffle=False)
| util.BatchElements(
min_batch_size=10, max_batch_size=10, element_size_fn=len)
| beam.Map(lambda batch: ''.join(batch))
| beam.Map(len))
- assert_that(res, equal_to([12, 11, 10]))
+ assert_that(res, equal_to([2, 10, 10, 10]))
+
+ def test_sized_windowed_batches(self):
+# Assumes a single bundle, in order...
+with TestPipeline() as p:
+ res = (
+ p
+ | beam.Create(range(1, 8), reshuffle=False)
+ | beam.Map(lambda t: window.TimestampedValue('a' * t, t))
+ | beam.WindowInto(window.FixedWindows(3))
+ | util.BatchElements(
+ min_batch_size=11,
+ max_batch_size=11,
+ element_size_fn=len,
+ clock=FakeClock())
+ | beam.Map(lambda batch: ''.join(batch)))
+ assert_that(
+ res,
+ equal_to([
+ 'a' * (1+2), # Elements in [1, 3)
+ 'a' * (3+4), # Elements in [3, 6)
+ 'a' * 5,
+ 'a' * 6, # Elements in [6, 9)
+ 'a' * 7,
+ ]))
def test_target_duration(self):
clock = FakeClock()
(beam) branch master updated: Add new BigQueryIO stress tests for AT_LEAST_ONCE writing method (#31241)
This is an automated email from the ASF dual-hosted git repository.
yhu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 602f088b38e Add new BigQueryIO stress tests for AT_LEAST_ONCE writing
method (#31241)
602f088b38e is described below
commit 602f088b38e366d5a9ec615dc137cc770a8230d3
Author: akashorabek <70029317+akashora...@users.noreply.github.com>
AuthorDate: Fri May 10 19:38:20 2024 +0500
Add new BigQueryIO stress tests for AT_LEAST_ONCE writing method (#31241)
* Add new BigQueryIO stress tests for AT_LEAST_ONCE writing method
* spotless
---
.../apache/beam/it/gcp/bigquery/BigQueryIOST.java | 28 ++
1 file changed, 24 insertions(+), 4 deletions(-)
diff --git
a/it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/bigquery/BigQueryIOST.java
b/it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/bigquery/BigQueryIOST.java
index 7a58fd04839..ad8595f8969 100644
---
a/it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/bigquery/BigQueryIOST.java
+++
b/it/google-cloud-platform/src/test/java/org/apache/beam/it/gcp/bigquery/BigQueryIOST.java
@@ -83,6 +83,7 @@ public final class BigQueryIOST extends IOStressTestBase {
private static final String READ_ELEMENT_METRIC_NAME = "read_count";
private static final String STORAGE_WRITE_API_METHOD = "STORAGE_WRITE_API";
+ private static final String STORAGE_API_AT_LEAST_ONCE_METHOD =
"STORAGE_API_AT_LEAST_ONCE";
private static BigQueryResourceManager resourceManager;
private static String tableName;
@@ -191,6 +192,20 @@ public final class BigQueryIOST extends IOStressTestBase {
runTest();
}
+ @Test
+ public void testAvroStorageAPIAtLeastOnce() throws IOException {
+configuration.writeFormat = WriteFormat.AVRO.name();
+configuration.writeMethod = STORAGE_API_AT_LEAST_ONCE_METHOD;
+runTest();
+ }
+
+ @Test
+ public void testJsonStorageAPIAtLeastOnce() throws IOException {
+configuration.writeFormat = WriteFormat.JSON.name();
+configuration.writeMethod = STORAGE_API_AT_LEAST_ONCE_METHOD;
+runTest();
+ }
+
/**
* Runs a stress test for BigQueryIO based on the specified configuration
parameters. The method
* initializes the stress test by determining the WriteFormat, configuring
the BigQueryIO. Write
@@ -222,7 +237,9 @@ public final class BigQueryIOST extends IOStressTestBase {
.withAvroFormatFunction(
new AvroFormatFn(
configuration.numColumns,
-
!(STORAGE_WRITE_API_METHOD.equalsIgnoreCase(configuration.writeMethod;
+
!(STORAGE_WRITE_API_METHOD.equalsIgnoreCase(configuration.writeMethod)
+||
STORAGE_API_AT_LEAST_ONCE_METHOD.equalsIgnoreCase(
+configuration.writeMethod;
break;
case JSON:
writeIO =
@@ -305,9 +322,12 @@ public final class BigQueryIOST extends IOStressTestBase {
getBeamMetricsName(PipelineMetricsType.COUNTER,
READ_ELEMENT_METRIC_NAME));
Long rowCount = resourceManager.getRowCount(tableName);
-// Assert that numRecords equals or greater than rowCount since there
might be
-// duplicates when testing big amount of data
-assertTrue(numRecords >= rowCount);
+// Depending on writing method there might be duplicates on different
sides (read or write).
+if (configuration.writeMethod.equals(STORAGE_API_AT_LEAST_ONCE_METHOD)) {
+ assertTrue(rowCount >= numRecords);
+} else {
+ assertTrue(numRecords >= rowCount);
+}
// export metrics
MetricsConfiguration metricsConfig =
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new a9605f86e04 Updating config from bot a9605f86e04 is described below commit a9605f86e0483f87a75b2ce366dcf587fcd48c3b Author: github-actions AuthorDate: Fri May 10 15:05:54 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index 7d3d14f863f..d27640b70d6 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -10,7 +10,7 @@ "y1chi": 1667002607045, "damccorm": 1715302155876, "jrmccluskey": 1715128207068, -"riteshghorse": 1715029565371, +"riteshghorse": 1715353551812, "liferoad": 1715304582820, "shunping": 1715308778682 }
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new d44166fc312 Updating config from bot
d44166fc312 is described below
commit d44166fc312529a285ee8b72ca4e85968cfe3455
Author: github-actions
AuthorDate: Fri May 10 15:05:52 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31246.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31246.json
b/scripts/ci/pr-bot/state/pr-state/pr-31246.json
new file mode 100644
index 000..c43704aa814
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31246.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "riteshghorse"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: Publish snapshots for Python 3.12 container images. (#31237)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 929f41aea34 Publish snapshots for Python 3.12 container images. (#31237) 929f41aea34 is described below commit 929f41aea347d230459ab40223161acabe08e686 Author: tvalentyn AuthorDate: Fri May 10 08:59:19 2024 -0700 Publish snapshots for Python 3.12 container images. (#31237) * Publish snapshots for Py3.12 container. * Add a license for a new dep. * fixup --- .github/workflows/beam_Publish_Beam_SDK_Snapshots.yml | 1 + sdks/python/container/license_scripts/dep_urls_py.yaml | 2 ++ 2 files changed, 3 insertions(+) diff --git a/.github/workflows/beam_Publish_Beam_SDK_Snapshots.yml b/.github/workflows/beam_Publish_Beam_SDK_Snapshots.yml index 0f9d22c3ff5..23b78c36d7b 100644 --- a/.github/workflows/beam_Publish_Beam_SDK_Snapshots.yml +++ b/.github/workflows/beam_Publish_Beam_SDK_Snapshots.yml @@ -70,6 +70,7 @@ jobs: - "python:container:py39" - "python:container:py310" - "python:container:py311" + - "python:container:py312" steps: - uses: actions/checkout@v4 - name: Setup repository diff --git a/sdks/python/container/license_scripts/dep_urls_py.yaml b/sdks/python/container/license_scripts/dep_urls_py.yaml index 36efb36c321..6fc5129e35c 100644 --- a/sdks/python/container/license_scripts/dep_urls_py.yaml +++ b/sdks/python/container/license_scripts/dep_urls_py.yaml @@ -133,6 +133,8 @@ pip_dependencies: license: "https://github.com/PiotrDabkowski/pyjsparser/blob/master/LICENSE"; pymongo: license: "https://raw.githubusercontent.com/mongodb/mongo-python-driver/master/LICENSE"; + pyproject_hooks: +license: "https://raw.githubusercontent.com/pypa/pyproject-hooks/main/LICENSE"; python-gflags: license: "https://raw.githubusercontent.com/google/python-gflags/master/COPYING"; pyvcf:
(beam) branch tvalentyn-gha deleted (was 5809f23fc72)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch tvalentyn-gha in repository https://gitbox.apache.org/repos/asf/beam.git was 5809f23fc72 fixup The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch master updated: Exclude a test that doesn't pass due to an upstream issue. (#31240)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 5ee63c0e04e Exclude a test that doesn't pass due to an upstream issue. (#31240) 5ee63c0e04e is described below commit 5ee63c0e04e433388943922b1578fa16fea0aaa4 Author: tvalentyn AuthorDate: Fri May 10 09:00:10 2024 -0700 Exclude a test that doesn't pass due to an upstream issue. (#31240) --- sdks/python/apache_beam/dataframe/frames_test.py | 4 1 file changed, 4 insertions(+) diff --git a/sdks/python/apache_beam/dataframe/frames_test.py b/sdks/python/apache_beam/dataframe/frames_test.py index 3ee9adc2bfe..b3ddfee95fc 100644 --- a/sdks/python/apache_beam/dataframe/frames_test.py +++ b/sdks/python/apache_beam/dataframe/frames_test.py @@ -15,6 +15,7 @@ # limitations under the License. import re +import sys import unittest import warnings from typing import Dict @@ -1447,6 +1448,9 @@ class DeferredFrameTest(_AbstractFrameTest): s = pd.Series(np.arange(1.0, 5.0), index=index) self._run_test(lambda s: s.unstack(level=0), s) + @unittest.skipIf( + sys.version_info >= (2, 12) and PD_VERSION < (2, 3), + 'https://github.com/pandas-dev/pandas/issues/58604') def test_unstack_pandas_example3(self): index = self._unstack_get_categorical_index() s = pd.Series(np.arange(1.0, 5.0), index=index)
(beam) branch master updated: Remove a deprecated test helper. (#31236)
This is an automated email from the ASF dual-hosted git repository.
tvalentyn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 0a58d7d2ff4 Remove a deprecated test helper. (#31236)
0a58d7d2ff4 is described below
commit 0a58d7d2ff4dc121acae461c18e9460f7ce6b117
Author: tvalentyn
AuthorDate: Fri May 10 09:42:23 2024 -0700
Remove a deprecated test helper. (#31236)
* Remove a deprecated test helper.
* yapf
---
sdks/python/apache_beam/options/pipeline_options_test.py | 4 ++--
sdks/python/apache_beam/testing/test_pipeline_test.py| 5 +++--
2 files changed, 5 insertions(+), 4 deletions(-)
diff --git a/sdks/python/apache_beam/options/pipeline_options_test.py
b/sdks/python/apache_beam/options/pipeline_options_test.py
index c7a56b4739b..61b227d9a24 100644
--- a/sdks/python/apache_beam/options/pipeline_options_test.py
+++ b/sdks/python/apache_beam/options/pipeline_options_test.py
@@ -205,7 +205,7 @@ class PipelineOptionsTest(unittest.TestCase):
@parameterized.expand(TEST_CASES)
def test_get_all_options_subclass(self, flags, expected, _):
options = PipelineOptionsTest.MockOptions(flags=flags)
-self.assertDictContainsSubset(expected, options.get_all_options())
+self.assertLessEqual(expected.items(), options.get_all_options().items())
self.assertEqual(
options.view_as(PipelineOptionsTest.MockOptions).mock_flag,
expected['mock_flag'])
@@ -219,7 +219,7 @@ class PipelineOptionsTest(unittest.TestCase):
@parameterized.expand(TEST_CASES)
def test_get_all_options(self, flags, expected, _):
options = PipelineOptions(flags=flags)
-self.assertDictContainsSubset(expected, options.get_all_options())
+self.assertLessEqual(expected.items(), options.get_all_options().items())
self.assertEqual(
options.view_as(PipelineOptionsTest.MockOptions).mock_flag,
expected['mock_flag'])
diff --git a/sdks/python/apache_beam/testing/test_pipeline_test.py
b/sdks/python/apache_beam/testing/test_pipeline_test.py
index c38b802dc90..06946c7a7ef 100644
--- a/sdks/python/apache_beam/testing/test_pipeline_test.py
+++ b/sdks/python/apache_beam/testing/test_pipeline_test.py
@@ -68,8 +68,9 @@ class TestPipelineTest(unittest.TestCase):
def test_create_test_pipeline_options(self):
test_pipeline = TestPipeline(argv=self.TEST_CASE['options'])
test_options = PipelineOptions(test_pipeline.get_full_options_as_args())
-self.assertDictContainsSubset(
-self.TEST_CASE['expected_dict'], test_options.get_all_options())
+self.assertLessEqual(
+self.TEST_CASE['expected_dict'].items(),
+test_options.get_all_options().items())
EXTRA_OPT_CASES = [{
'options': {
(beam) branch users/damccorm/batchElementsOvercount deleted (was bb40a22aaef)
This is an automated email from the ASF dual-hosted git repository. damccorm pushed a change to branch users/damccorm/batchElementsOvercount in repository https://gitbox.apache.org/repos/asf/beam.git was bb40a22aaef lint The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 10a62fdcbee Updating config from bot 10a62fdcbee is described below commit 10a62fdcbeecbd01de7fce7e3443874479d3dbf4 Author: github-actions AuthorDate: Fri May 10 17:34:50 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-io.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-io.json b/scripts/ci/pr-bot/state/reviewers-for-label-io.json index 4d592c158dc..10bf09ba745 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-io.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-io.json @@ -8,7 +8,7 @@ "ahmedabu98": 1715343222025, "bvolpato": 1712595969392, "manavgarg": 1690826779210, -"damondouglas": 1714579854906, +"damondouglas": 1715362487046, "shunping": 1714599265290 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 80e702dcaf7 Updating config from bot 80e702dcaf7 is described below commit 80e702dcaf7491f9fd675e3aaef8943ee3f59267 Author: github-actions AuthorDate: Fri May 10 17:34:49 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index d27640b70d6..dc3c83b2ece 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -9,7 +9,7 @@ "pabloem": 1681281324703, "y1chi": 1667002607045, "damccorm": 1715302155876, -"jrmccluskey": 1715128207068, +"jrmccluskey": 1715362487046, "riteshghorse": 1715353551812, "liferoad": 1715304582820, "shunping": 1715308778682
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 35f1b8723e7 Updating config from bot
35f1b8723e7 is described below
commit 35f1b8723e7c198892bfa9db39a8699bba15eb9b
Author: github-actions
AuthorDate: Fri May 10 17:34:48 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31247.json | 11 +++
1 file changed, 11 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31247.json
b/scripts/ci/pr-bot/state/pr-state/pr-31247.json
new file mode 100644
index 000..1268835aa53
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31247.json
@@ -0,0 +1,11 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "jrmccluskey",
+"io": "damondouglas"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch asf-site updated: Publishing website 2024/05/10 17:38:37 at commit 0a58d7d
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new b78fa438284 Publishing website 2024/05/10 17:38:37 at commit 0a58d7d b78fa438284 is described below commit b78fa438284d8980f645c55a09f20bccf0e6bb20 Author: runner AuthorDate: Fri May 10 17:38:37 2024 + Publishing website 2024/05/10 17:38:37 at commit 0a58d7d --- website/generated-content/sitemap.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index 29ff273fb4a..5efbe5b7071 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.56.0/2024-05-10T09:37:03+02:00/categories/blog/2024-05-10T09:37:03+02:00/blog/2024-05-10T09:37:03+02:00/categories/2024-05-10T09:37:03+02:00/catego [...] \ No newline at end of file +http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.56.0/2024-05-10T09:42:23-07:00/categories/blog/2024-05-10T09:42:23-07:00/blog/2024-05-10T09:42:23-07:00/categories/2024-05-10T09:42:23-07:00/catego [...] \ No newline at end of file
(beam) branch tvalentyn-patch-5 created (now c885fd41377)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch tvalentyn-patch-5 in repository https://gitbox.apache.org/repos/asf/beam.git at c885fd41377 Update version tag for dataflow dev containres. This branch includes the following new commits: new c885fd41377 Update version tag for dataflow dev containres. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(beam) 01/01: Update version tag for dataflow dev containres.
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch tvalentyn-patch-5 in repository https://gitbox.apache.org/repos/asf/beam.git commit c885fd413777f151448372b3d01e59330dedaaa9 Author: tvalentyn AuthorDate: Fri May 10 10:59:23 2024 -0700 Update version tag for dataflow dev containres. --- sdks/python/apache_beam/runners/dataflow/internal/names.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sdks/python/apache_beam/runners/dataflow/internal/names.py b/sdks/python/apache_beam/runners/dataflow/internal/names.py index 4870bcef5e5..bc2d1f5b403 100644 --- a/sdks/python/apache_beam/runners/dataflow/internal/names.py +++ b/sdks/python/apache_beam/runners/dataflow/internal/names.py @@ -34,6 +34,6 @@ SERIALIZED_SOURCE_KEY = 'serialized_source' # Unreleased sdks use container image tag specified below. # Update this tag whenever there is a change that # requires changes to SDK harness container or SDK harness launcher. -BEAM_DEV_SDK_CONTAINER_TAG = 'beam-master-20240417' +BEAM_DEV_SDK_CONTAINER_TAG = 'beam-master-20240510' DATAFLOW_CONTAINER_IMAGE_REPOSITORY = 'gcr.io/cloud-dataflow/v1beta3'
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new dcc07cade85 Updating config from bot
dcc07cade85 is described below
commit dcc07cade856337139e94aaf3ec627523d51b81f
Author: github-actions
AuthorDate: Fri May 10 18:01:03 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31248.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31248.json
b/scripts/ci/pr-bot/state/pr-state/pr-31248.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31248.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch master updated: Fix Python 3.12 python hinting errors on MacOS (#31246)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 8b5d0009a1d Fix Python 3.12 python hinting errors on MacOS (#31246) 8b5d0009a1d is described below commit 8b5d0009a1d2561d4d04df7d952d5c33655f7a15 Author: Jack McCluskey <34928439+jrmcclus...@users.noreply.github.com> AuthorDate: Fri May 10 14:03:24 2024 -0400 Fix Python 3.12 python hinting errors on MacOS (#31246) * Fix typo in Intrinsic Operations test * Fix load_fast_and_clear --- sdks/python/apache_beam/typehints/intrinsic_one_ops_test.py | 4 +--- sdks/python/apache_beam/typehints/opcodes.py| 2 +- 2 files changed, 2 insertions(+), 4 deletions(-) diff --git a/sdks/python/apache_beam/typehints/intrinsic_one_ops_test.py b/sdks/python/apache_beam/typehints/intrinsic_one_ops_test.py index 8291ef2df5b..adffc945baa 100644 --- a/sdks/python/apache_beam/typehints/intrinsic_one_ops_test.py +++ b/sdks/python/apache_beam/typehints/intrinsic_one_ops_test.py @@ -30,9 +30,7 @@ class IntrinsicOneOpsTest(unittest.TestCase): def test_unary_intrinsic_ops_are_in_the_same_order_as_in_cpython(self): if sys.version_info >= (3, 12): dis_order = dis.__dict__['_intrinsic_1_descs'] - beam_ops = [fn.__name_upper() for fn in intrinsic_one_ops.INT_ONE_OPS] - for fn in intrinsic_one_ops.INT_ONE_OPS: -beam_ops.append(fn.__name__.upper()) + beam_ops = [fn.__name__.upper() for fn in intrinsic_one_ops.INT_ONE_OPS] self.assertListEqual(dis_order, beam_ops) diff --git a/sdks/python/apache_beam/typehints/opcodes.py b/sdks/python/apache_beam/typehints/opcodes.py index 11e607543e9..62c7a8fadc3 100644 --- a/sdks/python/apache_beam/typehints/opcodes.py +++ b/sdks/python/apache_beam/typehints/opcodes.py @@ -471,7 +471,7 @@ load_fast_check = load_fast def load_fast_and_clear(state, arg): state.stack.append(state.vars[arg]) - del state.vars[arg] + state.vars[arg] = None def store_fast(state, arg):
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 07678e2f160 Updating config from bot 07678e2f160 is described below commit 07678e2f160f316fccaba335acd930c0d74efcbf Author: github-actions AuthorDate: Fri May 10 18:35:07 2024 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-31247.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31247.json b/scripts/ci/pr-bot/state/pr-state/pr-31247.json index 1268835aa53..ea4cef820a0 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-31247.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-31247.json @@ -7,5 +7,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 27bbbf4d92f Updating config from bot
27bbbf4d92f is described below
commit 27bbbf4d92f59fa75d15d8d54331dc9eedc3a1f8
Author: github-actions
AuthorDate: Fri May 10 19:05:46 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31249.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31249.json
b/scripts/ci/pr-bot/state/pr-state/pr-31249.json
new file mode 100644
index 000..321b31c0f05
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31249.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"python": "tvalentyn"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 0b817b25f98 Updating config from bot 0b817b25f98 is described below commit 0b817b25f988c404b3e2fef40466d367c7099de4 Author: github-actions AuthorDate: Fri May 10 19:05:48 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-python.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-python.json b/scripts/ci/pr-bot/state/reviewers-for-label-python.json index dc3c83b2ece..963f1e1309b 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-python.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-python.json @@ -5,7 +5,7 @@ "yeandy": 1665802753763, "TheNeuralBit": 1667896849319, "ryanthompson591": 1670002443548, -"tvalentyn": 1715180748178, +"tvalentyn": 1715367945090, "pabloem": 1681281324703, "y1chi": 1667002607045, "damccorm": 1715302155876,
(beam) branch master updated (8b5d0009a1d -> fbb3ae1ebef)
This is an automated email from the ASF dual-hosted git repository. riteshghorse pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git from 8b5d0009a1d Fix Python 3.12 python hinting errors on MacOS (#31246) add fbb3ae1ebef add retries for flaky test (#31247) No new revisions were added by this update. Summary of changes: sdks/python/apache_beam/io/requestresponse_test.py | 58 ++ 1 file changed, 37 insertions(+), 21 deletions(-)
(beam) branch master updated: Update version tag for dataflow dev containers. (#31248)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 45c730ad0c7 Update version tag for dataflow dev containers. (#31248) 45c730ad0c7 is described below commit 45c730ad0c706489ad435fc3210ae0fac606f07e Author: tvalentyn AuthorDate: Fri May 10 13:05:18 2024 -0700 Update version tag for dataflow dev containers. (#31248) --- sdks/python/apache_beam/runners/dataflow/internal/names.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sdks/python/apache_beam/runners/dataflow/internal/names.py b/sdks/python/apache_beam/runners/dataflow/internal/names.py index 4870bcef5e5..bc2d1f5b403 100644 --- a/sdks/python/apache_beam/runners/dataflow/internal/names.py +++ b/sdks/python/apache_beam/runners/dataflow/internal/names.py @@ -34,6 +34,6 @@ SERIALIZED_SOURCE_KEY = 'serialized_source' # Unreleased sdks use container image tag specified below. # Update this tag whenever there is a change that # requires changes to SDK harness container or SDK harness launcher. -BEAM_DEV_SDK_CONTAINER_TAG = 'beam-master-20240417' +BEAM_DEV_SDK_CONTAINER_TAG = 'beam-master-20240510' DATAFLOW_CONTAINER_IMAGE_REPOSITORY = 'gcr.io/cloud-dataflow/v1beta3'
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new b4315753edd Updating config from bot
b4315753edd is described below
commit b4315753edd87f6ec0fcacd99f32722ed6d2d81f
Author: github-actions
AuthorDate: Fri May 10 20:05:46 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31250.json | 10 ++
1 file changed, 10 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31250.json
b/scripts/ci/pr-bot/state/pr-state/pr-31250.json
new file mode 100644
index 000..b42821bc7d4
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31250.json
@@ -0,0 +1,10 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {
+"website": "liferoad"
+ },
+ "nextAction": "Reviewers",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new b7d9d77d3b6 Updating config from bot b7d9d77d3b6 is described below commit b7d9d77d3b6d753714ea97788b928981688a2e4f Author: github-actions AuthorDate: Fri May 10 20:05:47 2024 + Updating config from bot --- scripts/ci/pr-bot/state/reviewers-for-label-website.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/reviewers-for-label-website.json b/scripts/ci/pr-bot/state/reviewers-for-label-website.json index df37797b45f..d6b6fe60e77 100644 --- a/scripts/ci/pr-bot/state/reviewers-for-label-website.json +++ b/scripts/ci/pr-bot/state/reviewers-for-label-website.json @@ -4,7 +4,7 @@ "rszper": 1714695597172, "melap": 1715096060800, "damccorm": 1712687712177, -"liferoad": 1712623767447, +"liferoad": 1715371545298, "kennknowles": 1713380725141 } } \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 86653f82fc0 Updating config from bot
86653f82fc0 is described below
commit 86653f82fc0c02558207c1aa9821a9d59af270f6
Author: github-actions
AuthorDate: Fri May 10 20:24:00 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31156.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31156.json
b/scripts/ci/pr-bot/state/pr-state/pr-31156.json
new file mode 100644
index 000..9c2aa5aa212
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31156.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": false,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": true,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 4d7786ed89a Updating config from bot 4d7786ed89a is described below commit 4d7786ed89acc044ee2413ae5a9763560382ebc1 Author: github-actions AuthorDate: Fri May 10 20:34:46 2024 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-31250.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31250.json b/scripts/ci/pr-bot/state/pr-state/pr-31250.json index b42821bc7d4..e87ad43ad51 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-31250.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-31250.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch tvalentyn-gha created (now 0a827f31b7a)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch tvalentyn-gha in repository https://gitbox.apache.org/repos/asf/beam.git at 0a827f31b7a Include ML deps for coverage analysis. No new revisions were added by this update.
(beam) branch asf-site updated: Publishing website 2024/05/10 23:38:50 at commit 45c730a
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 12fc74cdc1b Publishing website 2024/05/10 23:38:50 at commit 45c730a 12fc74cdc1b is described below commit 12fc74cdc1b84e5c54f37d2c56041396608236ea Author: runner AuthorDate: Fri May 10 23:38:51 2024 + Publishing website 2024/05/10 23:38:50 at commit 45c730a --- website/generated-content/sitemap.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index 5efbe5b7071..76c76bf97cb 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.56.0/2024-05-10T09:42:23-07:00/categories/blog/2024-05-10T09:42:23-07:00/blog/2024-05-10T09:42:23-07:00/categories/2024-05-10T09:42:23-07:00/catego [...] \ No newline at end of file +http://www.sitemaps.org/schemas/sitemap/0.9"; xmlns:xhtml="http://www.w3.org/1999/xhtml";>/blog/beam-2.56.0/2024-05-10T13:05:18-07:00/categories/blog/2024-05-10T13:05:18-07:00/blog/2024-05-10T13:05:18-07:00/categories/2024-05-10T13:05:18-07:00/catego [...] \ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch pr-bot-state
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/pr-bot-state by this push:
new 5cf2def6e7d Updating config from bot
5cf2def6e7d is described below
commit 5cf2def6e7d8e671615f40dbf8948a26e6f56119
Author: github-actions
AuthorDate: Sat May 11 00:19:35 2024 +
Updating config from bot
---
scripts/ci/pr-bot/state/pr-state/pr-31256.json | 8
1 file changed, 8 insertions(+)
diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31256.json
b/scripts/ci/pr-bot/state/pr-state/pr-31256.json
new file mode 100644
index 000..242a48d7d3b
--- /dev/null
+++ b/scripts/ci/pr-bot/state/pr-state/pr-31256.json
@@ -0,0 +1,8 @@
+{
+ "commentedAboutFailingChecks": true,
+ "reviewersAssignedForLabels": {},
+ "nextAction": "Author",
+ "stopReviewerNotifications": false,
+ "remindAfterTestsPass": [],
+ "committerAssigned": false
+}
\ No newline at end of file
(beam) branch pr-bot-state updated: Updating config from bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch pr-bot-state in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/pr-bot-state by this push: new 77d2b070da3 Updating config from bot 77d2b070da3 is described below commit 77d2b070da392362180ed053d27c23222023479a Author: github-actions AuthorDate: Sat May 11 00:19:38 2024 + Updating config from bot --- scripts/ci/pr-bot/state/pr-state/pr-31249.json | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/ci/pr-bot/state/pr-state/pr-31249.json b/scripts/ci/pr-bot/state/pr-state/pr-31249.json index 321b31c0f05..7d1dfe55f2f 100644 --- a/scripts/ci/pr-bot/state/pr-state/pr-31249.json +++ b/scripts/ci/pr-bot/state/pr-state/pr-31249.json @@ -6,5 +6,5 @@ "nextAction": "Reviewers", "stopReviewerNotifications": false, "remindAfterTestsPass": [], - "committerAssigned": false + "committerAssigned": true } \ No newline at end of file
(beam) branch nightly-refs/heads/master updated (365c2d92965 -> 45c730ad0c7)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git from 365c2d92965 Support Kafka Managed IO (#31172) add 5ff55b1caf1 [flink] Add documentation for Flink runner versions updates add 0afb52d94c5 Merge pull request #31217: [flink] Add documentation for Flink runner versions updates add cc1024cf164 Fix #31212 by removing the extra space in option string. (#31233) add 2d53926542f Avoid oversizing batch sizes with size estimation function (#31228) add 602f088b38e Add new BigQueryIO stress tests for AT_LEAST_ONCE writing method (#31241) add 929f41aea34 Publish snapshots for Python 3.12 container images. (#31237) add 5ee63c0e04e Exclude a test that doesn't pass due to an upstream issue. (#31240) add 0a58d7d2ff4 Remove a deprecated test helper. (#31236) add 8b5d0009a1d Fix Python 3.12 python hinting errors on MacOS (#31246) add fbb3ae1ebef add retries for flaky test (#31247) add 45c730ad0c7 Update version tag for dataflow dev containers. (#31248) No new revisions were added by this update. Summary of changes: .../test-properties.json | 2 +- .../workflows/beam_Publish_Beam_SDK_Snapshots.yml | 1 + .../apache/beam/it/gcp/bigquery/BigQueryIOST.java | 28 +-- sdks/go/examples/wasm/README.md| 2 +- sdks/python/apache_beam/dataframe/frames_test.py | 4 ++ sdks/python/apache_beam/io/requestresponse_test.py | 58 ++ .../python/apache_beam/options/pipeline_options.py | 2 +- .../apache_beam/options/pipeline_options_test.py | 4 +- .../runners/dataflow/dataflow_runner.py| 2 +- .../apache_beam/runners/dataflow/internal/names.py | 2 +- .../apache_beam/testing/test_pipeline_test.py | 5 +- sdks/python/apache_beam/transforms/util.py | 18 --- sdks/python/apache_beam/transforms/util_test.py| 33 ++-- .../typehints/intrinsic_one_ops_test.py| 4 +- sdks/python/apache_beam/typehints/opcodes.py | 2 +- .../container/license_scripts/dep_urls_py.yaml | 2 + sdks/typescript/src/apache_beam/runners/flink.ts | 2 +- settings.gradle.kts| 8 +++ .../site/content/en/documentation/runners/flink.md | 8 ++- 19 files changed, 136 insertions(+), 51 deletions(-)
