This is an automated email from the ASF dual-hosted git repository.
Amar3tto pushed a change to branch update-grafana
in repository https://gitbox.apache.org/repos/asf/beam.git
discard af970dcd6e0 Fix Grafana alerting
omit a40768b53a1 Update Grafana version to 12.4.12
add 0b6d68278b8 [KafkaIO] Use consumer position and lag to estimate end
offsets in KafkaUnboundedReader (#39830)
add ac516686b9f Bump github.com/proullon/ramsql from 0.1.4 to 0.1.5 in
/sdks (#40425)
add c5c59f1da69 Bump cloud.google.com/go/storage from 1.68.0 to 1.69.0 in
/sdks (#40426)
add 63a3479229b Update self-hosted runner versions to meet GitHub's
minimum runner version (#40403)
add d803b846618 [Python] Remove leftover "### Labels" debug log in the
BigQuery source (#40430)
add b456c68217d [Go SDK] Use deterministic protobuf marshaling in protox
helpers (#40385)
add b1b914b8bd0 Update Grafana version to 12.4.12 (#40434)
add 6fe144b3768 [BEAM-40264] Fix Spark MapState and SetState isEmpty after
removals (#40398)
add 32d54e821a6 [Spark] Run ValidatesRunner tests serially, runner metrics
are JVM wide (#40428)
add dfc4d667cd9 [Spark 4] Support stateful ParDo in Structured Streaming
via transformWithState (#40281)
add c164b38e924 Add a security model for Beam (#40421)
new 2485e5dcfe9 Fix Grafana alerting
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (af970dcd6e0)
\
N -- N -- N refs/heads/update-grafana (2485e5dcfe9)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../arc/variables.tf | 4 +-
.../self-hosted-linux/docker/Dockerfile | 2 +-
.../beam_PostCommit_Java_PVR_Spark3_Streaming.json | 2 +-
.../beam_PostCommit_Java_PVR_Spark4_Batch.json | 3 +-
.../beam_PostCommit_Java_PVR_Spark4_Streaming.json | 3 +-
...Commit_Java_PVR_Spark4_StructuredStreaming.json | 2 +-
.../beam_PostCommit_Java_PVR_Spark_Batch.json | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Spark.json | 2 +-
...eam_PostCommit_Java_ValidatesRunner_Spark4.json | 2 +-
...a_ValidatesRunner_SparkStructuredStreaming.json | 4 +-
.../beam/runners/core/StateInternalsTest.java | 10 +
.../translation/PipelineTranslatorStreaming.java | 65 +++-
.../StatefulParDoStreamingTranslator.java | 86 ++++++
.../streaming/state/BeamStatefulProcessor.java | 330 +++++++++++++++++++++
.../io/streaming/TestUnboundedSource.java | 16 +-
.../PipelineTranslatorStreamingTest.java | 97 +++++-
.../streaming/StatefulParDoStreamingTest.java | 242 +++++++++++++++
runners/spark/job-server/spark_job_server.gradle | 5 +
runners/spark/spark_runner.gradle | 5 +
.../spark/stateful/SparkStateInternals.java | 90 ++++--
.../spark/stateful/SparkTimerInternals.java | 5 +
.../translation/batch/DoFnRunnerFactory.java | 15 +-
.../batch/StatefulDoFnGroupFunction.java | 118 +-------
.../translation/batch/StatefulTaskRunner.java | 145 +++++++++
sdks/go.mod | 8 +-
sdks/go.sum | 20 +-
sdks/go/pkg/beam/core/util/protox/any.go | 4 +-
sdks/go/pkg/beam/core/util/protox/any_test.go | 40 +++
sdks/go/pkg/beam/core/util/protox/base64.go | 2 +-
sdks/go/pkg/beam/core/util/protox/protox.go | 2 +-
.../beam/sdk/io/kafka/KafkaUnboundedReader.java | 181 +++++------
.../org/apache/beam/sdk/io/kafka/KafkaIOTest.java | 27 --
.../org/apache/beam/sdk/io/kafka/KafkaMocks.java | 37 ---
sdks/python/apache_beam/io/gcp/bigquery.py | 1 -
website/www/site/content/en/security/_index.md | 93 ++++--
.../content/en/security/{_index.md => archive.md} | 13 +-
36 files changed, 1325 insertions(+), 358 deletions(-)
create mode 100644
runners/spark/4/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/streaming/StatefulParDoStreamingTranslator.java
create mode 100644
runners/spark/4/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/streaming/state/BeamStatefulProcessor.java
create mode 100644
runners/spark/4/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/streaming/StatefulParDoStreamingTest.java
create mode 100644
runners/spark/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/StatefulTaskRunner.java
copy website/www/site/content/en/security/{_index.md => archive.md} (75%)
