This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.97.3
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 651f0fb0fc7 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
add 7ae7d248fa8 small dep upgrade to avoid vulns (#38091)
add 532dd85dab8 [ML] Add AnthropicModelHandler for direct Claude inference
(#37956)
add 46052504435 Fix NameError when pydot is not installed in Beam
Playground (#38074)
add 47031efee65 Make MinRowCountForPageSizeCheck available with
ValueProvider (#38114)
add a1f260be744 add AWS to IO expansion service (#38111)
add 923ed03ce5a Fix table-row benchmark argument file paths (#38128)
add 4d4da5723c7 Fix ML flakes (#38088)
add 5ee67c6c0bb Bump
go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp (#38112)
add 60c8a23b43d Improve the Javadoc for encode/decode methods in coder
methods in coder for better clarity on context behaviour
add 760905140cb Apply spotless formatting
add 18395a2a3cc Fix minimal javadoc wording for coder encode decode
add 88ebf83177f Fix serial warning in starter and example archetype
add 379a7f03acf add PicoWordCount Example (Minimal Beam wordcount pipeline)
add cf2eebe615a Fix formmatting (spotless)
add c632f800abb Remove unintended StarterPipeline changes from
PicoWordCount PR
add 78b770b920b Address review: use @Element instead of ProcessContext
add 357b7206f82 Merge pull request #38029 from
Subramanya-Veeregowda/pico-wordcount-example
add b296b40e3fc Revert "Fix NameError when pydot is not installed in Beam
Playground (#38074)" (#38134)
add bb06d9b7040 Fix flaky ViewTest which would fail encoding null value if
there were no elements between early trigger and on-time global window firing.
add 91e1b065749 Merge pull request #38129 from scwhittle/flaky_view
add f938385d471 Skip clean up versioned images (#38019)
add e82fc4713f3 Changes cleanup thread to forceExecute. (#38073)
add 6dd599cf3f6 Pin google-adk to 1.17.0 for YAML/Xlang precommit
dependency resolution (#38090)
add b4c45719fa6 Migrate self-hosted workflows from ubuntu-20.04 to
ubuntu-24.04 (#38133)
add 09c166b8c5c Improved comments and readability in minimal_wordcount
example (#37908)
add 379d2124e12 [ErrorProne] Enable JavaTimeDefaultTimeZone check (#37775)
add dfe6bf351fd fix preCommit Spotless rsync install (#38160)
add e1f02622f36 fixed redis tests with testcontainers (#38157)
add 53f8367adf6 Portable Date Type (Python changes) (#38078)
add d89dcacd7c2 migrate MongoDB IO tests from flapdoodle to Testcontainers
(#38161)
add cd384e28db3 fix use configured Python in pullLicenses script (#38162)
add 80c4c7a8dd0 Fix spotless in examples:java:iceberg (#38166)
add 549aa066a90 Add rsync to self-hosted ARC runner Docker image (#38164)
add 4ba599c3ffb [Drain] Expose drain to dofn processElement and onTimer -
add missing implementation for SDF and WindowExpiration processContext
add 3f5ce80418b Merge pull request #38119 from stankiewicz/fix_drain
add cd1a0998c52 Support annotationlib in native_type_compatibility (#38188)
add f3bd329bbf0 Update go version to 1.26.2 (#38131)
add 98f5b339bab Add mutable change stream in IntegrateionTestEnv.java for
postgresql (#38057)
add 5655186de73 Retry transient NOT_FOUND on Storage API default stream
add a056c5b4991 Merge pull request #38132 from
aIbrahiim/fix-gcp-io-default-stream
add 0471bb5e935 Change TriggerState finished bitset coder to a
SentinelBitSetCoder (#38139)
add 48a6ceb7a57 [Dataflow Streaming] Fix spammy log during
GrpcGetDataStream physical stream half-closing (#38158)
add 77ff67063f5 Install openssh-client
add 0bdc149b9b9 Merge pull request #38195 from apache/fix-flink-container
add e6c0796d2c2 Fix Lint PreCommit
add 56c8de59b13 skip spanner assignment too
add 09bc761f57b remove unused ignore
add 2e1edb08232 Merge pull request #38191 from jrmccluskey/assignmentSkip
add 4ee32cddb4c [Java Harness] Reapply optimization to use Caches.weigh on
objects within cached blocks (#37964)
add a60a71e238a [Iceberg AddFiles] Attach name-mapping to table (#38189)
add 9a9d241b341 [ErrorProne] Enable BigDecimalEquals check and fix
violations (#38193)
add c7e54f81e57 ErrorProne - enable NarrowCalculation check
add b2e97dee8c2 Merge pull request #38192 from
stankiewicz/errorprone_NarrowCalculation
add d6fd0698769 [Iceberg] Support nested column paths in keep/drop
configuration (#37516)
add ae536b6f0f8 fixed PythonDocker rerun matrix gating and gh setup
(#38199)
add 30690fcf82d ignore test temporarily as enabling metadata propagation
may break other tests.
add ff68119b42a Merge pull request #38213 from
stankiewicz/ignore_metadata_propagation_test
add 3a19ef136fb Enable error-prone checks: ClassInitializationDeadlock,
Finalize, NullableTypeParameter, ThreadPriorityCheck (#37788)
add 1f83bf05321 [yaml]: add kafka parameter explicitly and uncover kafka
test (#36603)
add fb48a421441 Increase timeout for BQ early rollout job (#38216)
add 688c692702b Bump pytest from 8.4.2 to 9.0.3 in
/sdks/python/container/py310 (#38180)
add c8ba2d875be Fix setup python environment
add 0e8953cb9cb Merge pull request #38217 from apache/fix-flink-cluster
add e71ba541497 Add ExceptionInfo type for with_exception_handling (#38173)
add a7c7786645c Migrate Common Linting Tooling to Rust-Based Packages
(#38107)
add 9766c4a126d Bump Pytest Bounds (#38218)
add 9ba9960bc6e Use verbose mode when uploading pypi artifacts (#38223)
add c166bbe066c Fix CVE-2026-34477 (#38210)
add e841064660a Bump protobufjs and google-gax in /sdks/typescript (#38224)
add 621354f992b [ErrorProne] Enable UndefinedEquals check (#38197)
add f300e59fff9 ClickHouseIO - Improve user agent (#37815)
add 4e24a9c69f1 [IcebergIO AddFiles] Apply name mapping at commit time
(#38232)
add 86ca83e81dd Exclude 3.14 ML containers from push314 (#38221)
add 1cb2a711aa6 Update Google BOM dependencies. (#38239)
add e5c4c1ed162 [Spark Runner] Prepare Spark 3 structured-streaming to
shared base, adopt Flink-style version overrides (#38233)
add 0f48ffcbb27 Bump nltk from 3.9.3 to 3.9.4 in
/sdks/python/container/ml/py312 (#38227)
add ac161e8d229 Pin numbus-jose-jwt to 9.37.4 (#38187)
add 00e825e71ea Update hbase version to fix netty CVEs. (#38241)
add ce20f7345b5 Remove widget state data in run_inference_gemma.ipynb
(#38248)
add 79fb3600f97 [Python] Expand SDF by default in PortableRunner (#37965)
add 2ee8b6b667d Improve Javadoc for Coder class and clarify Context usage
(#38235)
add cacf8f43fc9 Bump lodash from 4.17.23 to 4.18.1 in /sdks/typescript
(#38043)
add bc6dffee9d3 Bump flatted from 3.4.1 to 3.4.2 in /sdks/typescript
(#37906)
add e696acdfad0 Bump github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream
in /sdks (#38101)
add ac7704f068c Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (651f0fb0fc7)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/github.com/aws/aws-sdk-go-v2/service/s3-1.97.3
(ac7704f068c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.agent/skills/python-development/SKILL.md | 8 +-
.github/ACTIONS.md | 6 +-
.github/actions/rerun-job-action/action.yml | 6 +-
.../arc/environments/beam.env | 4 +-
.../arc/images/Dockerfile | 4 +-
.../IO_Iceberg_Integration_Tests.json | 2 +-
...am_PostCommit_Python_ValidatesRunner_Flink.json | 3 +-
...am_PostCommit_Python_ValidatesRunner_Spark.json | 3 +-
.../beam_PostCommit_Python_Xlang_Gcp_Dataflow.json | 2 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.json | 2 +-
.../beam_PostCommit_Python_Xlang_IO_Dataflow.json | 2 +-
.../beam_PostCommit_Python_Xlang_IO_Direct.json | 2 +-
.../trigger_files/beam_PostCommit_XVR_Flink.json | 3 +-
.../trigger_files/beam_PostCommit_XVR_Spark3.json | 4 +-
.../beam_PostCommit_Yaml_Xlang_Direct.json | 2 +-
.github/workflows/IO_Iceberg_Integration_Tests.yml | 2 +-
.../IO_Iceberg_Integration_Tests_Dataflow.yml | 2 +-
..._Iceberg_Managed_Integration_Tests_Dataflow.yml | 2 +-
.github/workflows/IO_Iceberg_Performance_Tests.yml | 2 +-
.github/workflows/IO_Iceberg_Unit_Tests.yml | 2 +-
.github/workflows/README.md | 12 +-
.github/workflows/beam_CancelStaleDataflowJobs.yml | 2 +-
.../workflows/beam_CleanUpDataprocResources.yml | 2 +-
.github/workflows/beam_CleanUpGCPResources.yml | 2 +-
.../workflows/beam_CleanUpPrebuiltSDKImages.yml | 2 +-
.../workflows/beam_CloudML_Benchmarks_Dataflow.yml | 2 +-
.../beam_IODatastoresCredentialsRotation.yml | 2 +-
.../beam_Inference_Python_Benchmarks_Dataflow.yml | 7 +-
.../beam_Infrastructure_PolicyEnforcer.yml | 2 +-
.../beam_Infrastructure_SecurityLogging.yml | 2 +-
.../beam_Infrastructure_ServiceAccountKeys.yml | 2 +-
.../beam_Infrastructure_UsersPermissions.yml | 2 +-
.github/workflows/beam_Java_JMH.yml | 2 +-
.../beam_Java_LoadTests_Combine_Smoke.yml | 2 +-
.../beam_LoadTests_Go_CoGBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_CoGBK_Flink_batch.yml | 6 +-
.../beam_LoadTests_Go_Combine_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_Combine_Flink_Batch.yml | 8 +-
.../beam_LoadTests_Go_GBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_GBK_Flink_Batch.yml | 6 +-
.../beam_LoadTests_Go_ParDo_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_ParDo_Flink_Batch.yml | 6 +-
.../beam_LoadTests_Go_SideInput_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Go_SideInput_Flink_Batch.yml | 6 +-
.../beam_LoadTests_Java_CoGBK_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Java_CoGBK_Dataflow_Streaming.yml | 2 +-
...s_Java_CoGBK_Dataflow_V2_Batch_JavaVersions.yml | 2 +-
...va_CoGBK_Dataflow_V2_Streaming_JavaVersions.yml | 2 +-
...s_Java_CoGBK_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_Combine_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Java_Combine_Dataflow_Streaming.yml | 2 +-
...Java_Combine_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_Batch.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Java_GBK_Dataflow_V2_Batch.yml | 2 +-
...LoadTests_Java_GBK_Dataflow_V2_Batch_Java17.yml | 2 +-
...am_LoadTests_Java_GBK_Dataflow_V2_Streaming.yml | 2 +-
...Tests_Java_GBK_Dataflow_V2_Streaming_Java17.yml | 2 +-
.../workflows/beam_LoadTests_Java_GBK_Smoke.yml | 2 +-
...sts_Java_GBK_SparkStructuredStreaming_Batch.yml | 2 +-
.../beam_LoadTests_Java_ParDo_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Java_ParDo_Dataflow_Streaming.yml | 2 +-
...s_Java_ParDo_Dataflow_V2_Batch_JavaVersions.yml | 2 +-
...va_ParDo_Dataflow_V2_Streaming_JavaVersions.yml | 2 +-
...s_Java_ParDo_SparkStructuredStreaming_Batch.yml | 2 +-
.github/workflows/beam_LoadTests_Java_PubsubIO.yml | 2 +-
.../beam_LoadTests_Python_CoGBK_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Python_CoGBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_CoGBK_Flink_Batch.yml | 2 +-
...eam_LoadTests_Python_Combine_Dataflow_Batch.yml | 2 +-
...LoadTests_Python_Combine_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_Combine_Flink_Batch.yml | 2 +-
...am_LoadTests_Python_Combine_Flink_Streaming.yml | 2 +-
...LoadTests_Python_FnApiRunner_Microbenchmark.yml | 2 +-
.../beam_LoadTests_Python_GBK_Dataflow_Batch.yml | 2 +-
...eam_LoadTests_Python_GBK_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_GBK_Flink_Batch.yml | 2 +-
...adTests_Python_GBK_reiterate_Dataflow_Batch.yml | 2 +-
...sts_Python_GBK_reiterate_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_ParDo_Dataflow_Batch.yml | 2 +-
...m_LoadTests_Python_ParDo_Dataflow_Streaming.yml | 2 +-
.../beam_LoadTests_Python_ParDo_Flink_Batch.yml | 2 +-
...beam_LoadTests_Python_ParDo_Flink_Streaming.yml | 2 +-
...m_LoadTests_Python_SideInput_Dataflow_Batch.yml | 2 +-
.github/workflows/beam_LoadTests_Python_Smoke.yml | 2 +-
.../workflows/beam_MetricsCredentialsRotation.yml | 2 +-
.github/workflows/beam_Metrics_Report.yml | 2 +-
.../workflows/beam_PerformanceTests_AvroIOIT.yml | 2 +-
.../beam_PerformanceTests_AvroIOIT_HDFS.yml | 2 +-
...PerformanceTests_BigQueryIO_Batch_Java_Avro.yml | 2 +-
...PerformanceTests_BigQueryIO_Batch_Java_Json.yml | 2 +-
..._PerformanceTests_BigQueryIO_Streaming_Java.yml | 2 +-
...eam_PerformanceTests_BiqQueryIO_Read_Python.yml | 2 +-
...formanceTests_BiqQueryIO_Write_Python_Batch.yml | 2 +-
.github/workflows/beam_PerformanceTests_Cdap.yml | 2 +-
.../beam_PerformanceTests_Compressed_TextIOIT.yml | 2 +-
...m_PerformanceTests_Compressed_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_HadoopFormat.yml | 2 +-
.github/workflows/beam_PerformanceTests_JDBC.yml | 2 +-
.../workflows/beam_PerformanceTests_Kafka_IO.yml | 2 +-
.../beam_PerformanceTests_ManyFiles_TextIOIT.yml | 2 +-
...am_PerformanceTests_ManyFiles_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_MongoDBIO_IT.yml | 2 +-
.../beam_PerformanceTests_ParquetIOIT.yml | 2 +-
.../beam_PerformanceTests_ParquetIOIT_HDFS.yml | 2 +-
...erformanceTests_PubsubIOIT_Python_Streaming.yml | 2 +-
...m_PerformanceTests_SQLBigQueryIO_Batch_Java.yml | 2 +-
.../beam_PerformanceTests_SingleStoreIO.yml | 2 +-
..._PerformanceTests_SpannerIO_Read_2GB_Python.yml | 2 +-
...manceTests_SpannerIO_Write_2GB_Python_Batch.yml | 2 +-
.../beam_PerformanceTests_SparkReceiver_IO.yml | 2 +-
.../beam_PerformanceTests_TFRecordIOIT.yml | 2 +-
.../beam_PerformanceTests_TFRecordIOIT_HDFS.yml | 2 +-
.../workflows/beam_PerformanceTests_TextIOIT.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_TextIOIT_Python.yml | 2 +-
...PerformanceTests_WordCountIT_PythonVersions.yml | 2 +-
.../workflows/beam_PerformanceTests_XmlIOIT.yml | 2 +-
.../beam_PerformanceTests_XmlIOIT_HDFS.yml | 2 +-
.../beam_PerformanceTests_xlang_KafkaIO_Python.yml | 2 +-
.github/workflows/beam_Playground_CI_Nightly.yml | 2 +-
.github/workflows/beam_Playground_Precommit.yml | 2 +-
.github/workflows/beam_PostCommit_Go.yml | 2 +-
.../workflows/beam_PostCommit_Go_Dataflow_ARM.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Flink.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Samza.yml | 2 +-
.github/workflows/beam_PostCommit_Go_VR_Spark.yml | 2 +-
.github/workflows/beam_PostCommit_Java.yml | 2 +-
.../beam_PostCommit_Java_Avro_Versions.yml | 2 +-
.../beam_PostCommit_Java_BigQueryEarlyRollout.yml | 4 +-
.../workflows/beam_PostCommit_Java_DataflowV1.yml | 2 +-
.../workflows/beam_PostCommit_Java_DataflowV2.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow_ARM.yml | 2 +-
...beam_PostCommit_Java_Examples_Dataflow_Java.yml | 2 +-
.../beam_PostCommit_Java_Examples_Dataflow_V2.yml | 2 +-
...m_PostCommit_Java_Examples_Dataflow_V2_Java.yml | 2 +-
.../beam_PostCommit_Java_Examples_Direct.yml | 2 +-
.../beam_PostCommit_Java_Examples_Flink.yml | 2 +-
.../beam_PostCommit_Java_Examples_Spark.yml | 2 +-
.../beam_PostCommit_Java_Hadoop_Versions.yml | 2 +-
.../beam_PostCommit_Java_IO_Performance_Tests.yml | 2 +-
.../beam_PostCommit_Java_InfluxDbIO_IT.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Dataflow.yml | 2 +-
...beam_PostCommit_Java_Jpms_Dataflow_Versions.yml | 2 +-
.../workflows/beam_PostCommit_Java_Jpms_Direct.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Direct_Versions.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Flink_Java11.yml | 2 +-
.../beam_PostCommit_Java_Jpms_Spark_Java11.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Dataflow.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Dataflow_V2.yml | 2 +-
...am_PostCommit_Java_Nexmark_Dataflow_V2_Java.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Direct.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Flink.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Spark.yml | 2 +-
.../beam_PostCommit_Java_PVR_Flink_Batch.yml | 2 +-
.../beam_PostCommit_Java_PVR_Flink_Streaming.yml | 2 +-
.../workflows/beam_PostCommit_Java_PVR_Samza.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark3_Streaming.yml | 2 +-
.../beam_PostCommit_Java_PVR_Spark_Batch.yml | 2 +-
.../beam_PostCommit_Java_SingleStoreIO_IT.yml | 2 +-
.../beam_PostCommit_Java_Tpcds_Dataflow.yml | 2 +-
.../workflows/beam_PostCommit_Java_Tpcds_Flink.yml | 2 +-
.../workflows/beam_PostCommit_Java_Tpcds_Spark.yml | 2 +-
...am_PostCommit_Java_ValidatesRunner_Dataflow.yml | 2 +-
..._Java_ValidatesRunner_Dataflow_JavaVersions.yml | 2 +-
...mit_Java_ValidatesRunner_Dataflow_Streaming.yml | 2 +-
...a_ValidatesRunner_Dataflow_Streaming_Engine.yml | 2 +-
...atesRunner_Dataflow_Streaming_TagEncodingV2.yml | 2 +-
...PostCommit_Java_ValidatesRunner_Dataflow_V2.yml | 2 +-
..._Java_ValidatesRunner_Dataflow_V2_Streaming.yml | 2 +-
...beam_PostCommit_Java_ValidatesRunner_Direct.yml | 2 +-
...it_Java_ValidatesRunner_Direct_JavaVersions.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 2 +-
...PostCommit_Java_ValidatesRunner_Flink_Java8.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_Samza.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_Spark.yml | 2 +-
...va_ValidatesRunner_SparkStructuredStreaming.yml | 2 +-
...PostCommit_Java_ValidatesRunner_Spark_Java8.yml | 2 +-
...am_PostCommit_Java_ValidatesRunner_Twister2.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_ULR.yml | 2 +-
.github/workflows/beam_PostCommit_Javadoc.yml | 2 +-
.../beam_PostCommit_PortableJar_Flink.yml | 2 +-
.../beam_PostCommit_PortableJar_Spark.yml | 2 +-
.../beam_PostCommit_Python_Nexmark_Direct.yml | 2 +-
.../beam_PostCommit_Python_Portable_Flink.yml | 2 +-
.github/workflows/beam_PostCommit_SQL.yml | 2 +-
.github/workflows/beam_PostCommit_Website_Test.yml | 2 +-
.../workflows/beam_PostRelease_NightlySnapshot.yml | 2 +-
.../workflows/beam_PreCommit_CommunityMetrics.yml | 2 +-
.../workflows/beam_PreCommit_Flink_Container.yml | 2 +-
.github/workflows/beam_PreCommit_GHA.yml | 2 +-
.github/workflows/beam_PreCommit_Go.yml | 2 +-
.github/workflows/beam_PreCommit_GoPortable.yml | 2 +-
.github/workflows/beam_PreCommit_GoPrism.yml | 2 +-
.github/workflows/beam_PreCommit_ItFramework.yml | 2 +-
.github/workflows/beam_PreCommit_Java.yml | 2 +-
...eCommit_Java_Amazon-Web-Services2_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Amqp_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Azure_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Cassandra_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Cdap_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Clickhouse_IO_Direct.yml | 9 +-
.../beam_PreCommit_Java_Csv_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Datadog_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Debezium_IO_Direct.yml | 2 +-
...beam_PreCommit_Java_ElasticSearch_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Examples_Dataflow.yml | 2 +-
...eam_PreCommit_Java_Examples_Dataflow_Java21.yml | 2 +-
...Commit_Java_File-schema-transform_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Flink_Versions.yml | 2 +-
.../beam_PreCommit_Java_GCP_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Google-ads_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_HBase_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_HCatalog_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Hadoop_IO_Direct.yml | 2 +-
.../workflows/beam_PreCommit_Java_IOs_Direct.yml | 2 +-
.../beam_PreCommit_Java_InfluxDb_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_JDBC_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Jms_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Kafka_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Kudu_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_MongoDb_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Mqtt_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Neo4j_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_PVR_Flink_Batch.yml | 2 +-
.../beam_PreCommit_Java_PVR_Flink_Docker.yml | 2 +-
.../beam_PreCommit_Java_PVR_Prism_Loopback.yml | 2 +-
.../beam_PreCommit_Java_Parquet_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Pulsar_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_RabbitMq_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Redis_IO_Direct.yml | 2 +-
...am_PreCommit_Java_RequestResponse_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_SingleStore_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Snowflake_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Solr_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Spark3_Versions.yml | 2 +-
.../beam_PreCommit_Java_Splunk_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Thrift_IO_Direct.yml | 2 +-
.../beam_PreCommit_Java_Tika_IO_Direct.yml | 2 +-
.../workflows/beam_PreCommit_Kotlin_Examples.yml | 2 +-
.github/workflows/beam_PreCommit_PythonDocker.yml | 5 +-
.github/workflows/beam_PreCommit_PythonDocs.yml | 2 +-
.../workflows/beam_PreCommit_PythonFormatter.yml | 2 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 2 +-
.github/workflows/beam_PreCommit_Python_Dill.yml | 2 +-
.github/workflows/beam_PreCommit_SQL.yml | 2 +-
.github/workflows/beam_PreCommit_SQL_Java17.yml | 2 +-
.github/workflows/beam_PreCommit_SQL_Java8.yml | 2 +-
.github/workflows/beam_PreCommit_Spotless.yml | 4 +-
.github/workflows/beam_PreCommit_Typescript.yml | 2 +-
.github/workflows/beam_PreCommit_Website.yml | 2 +-
.../workflows/beam_PreCommit_Website_Stage_GCS.yml | 2 +-
.../beam_PreCommit_Xlang_Generated_Transforms.yml | 2 +-
.../workflows/beam_PreCommit_Yaml_Xlang_Direct.yml | 2 +-
.github/workflows/beam_Prober_CommunityMetrics.yml | 2 +-
.github/workflows/beam_Publish_BeamMetrics.yml | 2 +-
.../workflows/beam_Publish_Docker_Snapshots.yml | 2 +-
.github/workflows/beam_Publish_Website.yml | 2 +-
.../beam_Python_CostBenchmarks_Dataflow.yml | 2 +-
.github/workflows/beam_Release_NightlySnapshot.yml | 2 +-
.../beam_Release_Python_NightlySnapshot.yml | 2 +-
.../workflows/beam_StressTests_Java_BigQueryIO.yml | 2 +-
.../workflows/beam_StressTests_Java_BigTableIO.yml | 2 +-
.../workflows/beam_StressTests_Java_KafkaIO.yml | 2 +-
.../workflows/beam_StressTests_Java_PubSubIO.yml | 2 +-
.../workflows/beam_StressTests_Java_SpannerIO.yml | 2 +-
.github/workflows/build_release_candidate.yml | 2 +-
.github/workflows/build_runner_image.yml | 2 +-
.github/workflows/build_wheels.yml | 18 +-
.../workflows/deploy_release_candidate_pypi.yaml | 4 +-
.github/workflows/finalize_release.yml | 6 +-
.github/workflows/flaky_test_detection.yml | 2 +-
.github/workflows/java_tests.yml | 4 +-
.github/workflows/python_tests.yml | 4 +-
.github/workflows/refresh_looker_metrics.yml | 2 +-
.github/workflows/run_perf_alert_tool.yml | 2 +-
.../run_rc_validation_java_mobile_gaming.yml | 2 +-
.../run_rc_validation_java_quickstart.yml | 2 +-
.../run_rc_validation_python_mobile_gaming.yml | 2 +-
.../workflows/run_rc_validation_python_yaml.yml | 2 +-
.github/workflows/typescript_tests.yml | 4 +-
.github/workflows/update_python_dependencies.yml | 4 +-
.pre-commit-config.yaml | 13 +-
.../tools/stale_dataflow_prebuilt_image_cleaner.sh | 4 +-
CHANGES.md | 5 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 25 +-
dev-support/docker/Dockerfile | 2 +-
.../iceberg/snippets/IcebergBeamSchemaAndRow.java | 5 +-
.../org/apache/beam/examples/PicoWordCount.java | 36 +-
.../notebooks/beam-ml/run_inference_gemma.ipynb | 698 -------------------
gradle.properties | 2 +
.../beam/it/gcp/artifacts/utils/ArtifactUtils.java | 4 +-
.../beam/it/gcp/datastore/DatastoreUtils.java | 4 +-
.../org/apache/beam/it/gcp/pubsub/PubsubUtils.java | 4 +-
.../apache/beam/it/gcp/bigquery/BigQueryIOLT.java | 4 +-
.../apache/beam/it/gcp/bigquery/BigQueryIOST.java | 4 +-
.../apache/beam/it/gcp/spanner/SpannerIOLT.java | 4 +-
.../apache/beam/it/gcp/spanner/SpannerIOST.java | 4 +-
.../apache/beam/it/gcp/storage/FileBasedIOLT.java | 4 +-
.../java/org/apache/beam/it/kafka/KafkaIOLT.java | 4 +-
.../java/org/apache/beam/it/kafka/KafkaIOST.java | 4 +-
.../core/serialization/SentinelBitSetCoder.java | 27 +-
.../core/triggers/TriggerStateMachineRunner.java | 4 +-
.../core/InMemoryMultimapSideInputViewTest.java | 13 +-
.../serialization/SentinelBitSetCoderTest.java | 75 ++-
.../beam/runners/direct/WatermarkManager.java | 5 +-
.../beam/runners/direct/DirectRegistrarTest.java | 4 +-
.../dataflow/DataflowPipelineRegistrarTest.java | 4 +-
.../dataflow/worker/ApplianceShuffleReader.java | 1 +
.../dataflow/worker/ApplianceShuffleWriter.java | 1 +
.../dataflow/worker/BatchDataflowWorker.java | 1 +
.../dataflow/worker/StreamingDataflowWorker.java | 21 +
.../worker/windmill/WindmillServerBase.java | 1 +
.../windmill/client/grpc/GrpcGetDataStream.java | 5 +-
.../work/processing/StreamingCommitFinalizer.java | 128 ++--
.../work/processing/StreamingWorkScheduler.java | 4 +-
.../runners/dataflow/worker/ShuffleSinkTest.java | 3 +-
.../worker/StreamingDataflowWorkerTest.java | 88 ++-
.../worker/UngroupedShuffleReaderTest.java | 2 +-
.../windmill/state/WindmillStateInternalsTest.java | 5 +-
.../processing/StreamingCommitFinalizerTest.java | 33 +-
.../artifact/ArtifactStagingServiceTest.java | 3 +-
.../beam/runners/prism/PrismRegistrarTest.java | 4 +-
.../runtime/SamzaTimerInternalsFactoryTest.java | 5 +-
.../beam/runners/samza/util/FutureUtilsTest.java | 9 +-
runners/spark/3/build.gradle | 2 +-
runners/spark/spark_runner.gradle | 112 +++-
.../SparkStructuredStreamingPipelineOptions.java | 0
.../SparkStructuredStreamingPipelineResult.java | 0
.../SparkStructuredStreamingRunner.java | 0
.../SparkStructuredStreamingRunnerRegistrar.java | 0
.../structuredstreaming/examples/WordCount.java | 0
.../io/BoundedDatasetFactory.java | 0
.../spark/structuredstreaming/io/package-info.java | 0
.../structuredstreaming/metrics/BeamMetricSet.java | 0
.../metrics/MetricsAccumulator.java | 0
.../metrics/SparkBeamMetric.java | 0
.../metrics/SparkBeamMetricSource.java | 0
.../metrics/WithMetricsSupport.java | 0
.../structuredstreaming/metrics/package-info.java | 0
.../metrics/sink/CodahaleCsvSink.java | 0
.../metrics/sink/CodahaleGraphiteSink.java | 0
.../metrics/sink/package-info.java | 0
.../spark/structuredstreaming/package-info.java | 0
.../translation/EvaluationContext.java | 0
.../translation/PipelineTranslator.java | 0
.../translation/SparkSessionFactory.java | 0
.../translation/SparkTransformOverrides.java | 0
.../translation/TransformTranslator.java | 0
.../translation/batch/Aggregators.java | 0
.../batch/CombineGloballyTranslatorBatch.java | 0
.../batch/CombineGroupedValuesTranslatorBatch.java | 0
.../batch/CombinePerKeyTranslatorBatch.java | 0
.../batch/DoFnPartitionIteratorFactory.java | 0
.../translation/batch/DoFnRunnerFactory.java | 0
.../translation/batch/DoFnRunnerWithMetrics.java | 0
.../translation/batch/FlattenTranslatorBatch.java | 0
.../translation/batch/GroupByKeyHelpers.java | 0
.../batch/GroupByKeyTranslatorBatch.java | 0
.../translation/batch/ImpulseTranslatorBatch.java | 0
.../translation/batch/ParDoTranslatorBatch.java | 0
.../translation/batch/PipelineTranslatorBatch.java | 0
.../batch/ReadSourceTranslatorBatch.java | 0
.../batch/ReshuffleTranslatorBatch.java | 0
.../batch/WindowAssignTranslatorBatch.java | 0
.../batch/functions/CachedSideInputReader.java | 0
.../GroupAlsoByWindowViaOutputBufferFn.java | 0
.../batch/functions/NoOpStepContext.java | 0
.../batch/functions/SideInputValues.java | 0
.../batch/functions/SparkSideInputReader.java | 0
.../translation/batch/functions/package-info.java | 0
.../translation/batch/package-info.java | 0
.../translation/helpers/CoderHelpers.java | 0
.../translation/helpers/EncoderFactory.java | 0
.../translation/helpers/EncoderHelpers.java | 0
.../translation/helpers/EncoderProvider.java | 0
.../translation/helpers/package-info.java | 0
.../translation/package-info.java | 0
.../translation/utils/ScalaInterop.java | 0
.../translation/utils/package-info.java | 0
.../runners/spark/SparkRunnerRegistrarTest.java | 4 +-
.../structuredstreaming/SparkSessionRule.java | 0
...parkStructuredStreamingRunnerRegistrarTest.java | 6 +-
.../StructuredStreamingPipelineStateTest.java | 0
.../aggregators/metrics/sink/InMemoryMetrics.java | 0
.../metrics/sink/InMemoryMetricsSinkRule.java | 0
.../metrics/sink/SparkMetricsSinkTest.java | 0
.../metrics/SparkBeamMetricTest.java | 0
.../translation/batch/AggregatorsTest.java | 0
.../translation/batch/CombineGloballyTest.java | 0
.../batch/CombineGroupedValuesTest.java | 0
.../translation/batch/CombinePerKeyTest.java | 0
.../translation/batch/ComplexSourceTest.java | 0
.../translation/batch/FlattenTest.java | 0
.../translation/batch/GroupByKeyTest.java | 0
.../translation/batch/ParDoTest.java | 0
.../translation/batch/SimpleSourceTest.java | 0
.../translation/batch/WindowAssignTest.java | 0
.../batch/functions/SideInputValuesTest.java | 0
.../translation/helpers/EncoderHelpersTest.java | 0
.../translation/streaming/SimpleSourceTest.java | 0
.../ValueAndCoderLazySerializableTest.java | 9 +-
sdks/go.mod | 40 +-
sdks/go.sum | 98 +--
.../minimal_wordcount/minimal_wordcount.go | 23 +
sdks/go/run_with_go_version.sh | 2 +-
.../container/license_scripts/dep_urls_java.yaml | 2 +-
.../container/license_scripts/license_script.sh | 20 +-
.../java/org/apache/beam/sdk/coders/Coder.java | 5 +
.../org/apache/beam/sdk/fn/data/WeightedList.java | 11 +-
.../org/apache/beam/sdk/io/UnboundedSource.java | 1 +
.../org/apache/beam/sdk/testing/StaticWindows.java | 3 +-
.../beam/sdk/transforms/reflect/DoFnSignature.java | 1 +
.../beam/sdk/util/RowJsonValueExtractors.java | 5 +-
.../util/UnboundedScheduledExecutorService.java | 12 +-
.../apache/beam/sdk/util/construction/Timer.java | 3 +-
.../apache/beam/sdk/values/PCollectionViews.java | 1 +
.../org/apache/beam/sdk/values/WindowedValues.java | 4 +-
.../beam/sdk/coders/SerializableCoderTest.java | 3 +-
.../beam/sdk/schemas/JavaBeanSchemaTest.java | 14 +-
.../beam/sdk/schemas/JavaFieldSchemaTest.java | 14 +-
.../beam/sdk/schemas/utils/TestJavaBeans.java | 5 +-
.../apache/beam/sdk/schemas/utils/TestPOJOs.java | 11 +-
.../sdk/transforms/MetadataPropagationTest.java | 2 +
.../org/apache/beam/sdk/transforms/ViewTest.java | 1 +
.../sdk/transforms/display/DisplayDataTest.java | 3 +-
.../beam/sdk/util/construction/TimerTest.java | 5 +-
.../java/org/apache/beam/sdk/values/RowTest.java | 30 +-
.../sdk/extensions/sbe/SbeLogicalTypesTest.java | 7 +-
.../sorter/BufferedExternalSorterTest.java | 4 +-
.../sql/impl/transform/agg/CovarianceFn.java | 2 +-
.../sql/impl/transform/agg/VarianceFn.java | 2 +-
.../sql/impl/schema/BeamSqlRowCoderTest.java | 7 +-
.../meta/provider/mongodb/MongoDbReadWriteIT.java | 44 +-
.../fn/harness/jmh/ProcessBundleBenchmark.java | 6 +-
.../java/org/apache/beam/fn/harness/Caches.java | 57 +-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 5 +
.../beam/fn/harness/PrecombineGroupingTable.java | 4 +-
.../SplittablePairWithRestrictionDoFnRunner.java | 6 +
.../fn/harness/state/StateFetchingIterators.java | 195 ++++--
.../beam/fn/harness/status/BeamFnStatusClient.java | 1 +
.../beam/fn/harness/WindowMergingFnRunnerTest.java | 8 +-
.../state/LazyCachingIteratorToIterableTest.java | 10 +-
.../harness/state/StateFetchingIteratorsTest.java | 39 ++
.../blobstore/AzureBlobStoreFileSystemTest.java | 3 +-
sdks/java/io/clickhouse/build.gradle | 2 +
.../beam/sdk/io/clickhouse/ClickHouseIO.java | 41 +-
.../{ClickHouseIOTest.java => ClickHouseIOIT.java} | 50 +-
.../beam/sdk/io/clickhouse/ClickHouseIOTest.java | 469 +------------
.../io/elasticsearch/ElasticsearchIOTestUtils.java | 3 +-
sdks/java/io/expansion-service/build.gradle | 10 +
.../io/fileschematransform/XmlRowValueTest.java | 14 +-
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 2 +-
.../bigquery/StorageApiWriteUnshardedRecords.java | 2 +-
.../gcp/bigquery/BeamRowToStorageApiProtoTest.java | 7 +-
.../changestreams/it/IntegrationTestEnv.java | 38 +-
.../it/SpannerChangeStreamPlacementTableIT.java | 3 +-
...pannerChangeStreamPlacementTablePostgresIT.java | 3 +-
.../it/SpannerChangeStreamPostgresIT.java | 3 +-
sdks/java/io/hbase/build.gradle | 2 +-
.../org/apache/beam/sdk/io/hbase/HBaseIOTest.java | 2 +-
sdks/java/io/iceberg/hive/build.gradle | 2 +-
.../org/apache/beam/sdk/io/iceberg/AddFiles.java | 12 +
.../beam/sdk/io/iceberg/IcebergScanConfig.java | 20 +-
.../apache/beam/sdk/io/iceberg/AddFilesTest.java | 13 +
.../beam/sdk/io/iceberg/IcebergIOReadTest.java | 30 +
.../sdk/io/iceberg/RecordWriterManagerTest.java | 2 +-
.../io/iceberg/catalog/hiveutils/ScriptRunner.java | 2 +-
.../apache/beam/sdk/io/influxdb/GenerateData.java | 10 +-
.../beam/sdk/io/jdbc/JdbcSchemaIOProviderTest.java | 3 +-
.../org/apache/beam/sdk/io/jdbc/JdbcUtilTest.java | 7 +-
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 1 +
sdks/java/io/mongodb/build.gradle | 2 +-
.../beam/sdk/io/mongodb/MongoDBGridFSIOTest.java | 66 +-
.../apache/beam/sdk/io/mongodb/MongoDbIOTest.java | 73 +-
.../org/apache/beam/sdk/io/parquet/ParquetIO.java | 36 +-
.../beam/sdk/io/rabbitmq/RabbitMqMessage.java | 4 +-
sdks/java/io/redis/build.gradle | 2 +-
.../org/apache/beam/sdk/io/redis/RedisIOTest.java | 60 +-
.../org/apache/beam/io/requestresponse/Cache.java | 4 +
.../sdk/io/solace/read/SolaceCheckpointMark.java | 6 +-
.../src/main/java/StarterPipeline.java | 19 +-
.../nexmark/sources/generator/GeneratorConfig.java | 2 +-
.../io/gcp/bigquery_change_history_test.py | 1 +
sdks/python/apache_beam/io/jdbc.py | 5 +
.../ml/inference/agent_development_kit.py | 1 +
.../ml/inference/anthropic_inference.py | 296 ++++++++
.../ml/inference/anthropic_inference_it_test.py | 215 ++++++
.../ml/inference/anthropic_inference_test.py | 351 ++++++++++
.../inference/anthropic_tests_requirements.txt} | 2 +-
.../apache_beam/ml/inference/pytorch_inference.py | 16 +-
.../ml/rag/enrichment/milvus_search_it_test.py | 9 +
.../ml/rag/ingestion/milvus_search_it_test.py | 12 +-
.../ml/rag/ingestion/spanner_it_test.py | 2 +-
sdks/python/apache_beam/ml/rag/test_utils.py | 58 +-
sdks/python/apache_beam/portability/common_urns.py | 1 +
.../runners/portability/portable_runner.py | 2 +-
.../runners/portability/portable_runner_test.py | 98 +++
sdks/python/apache_beam/transforms/core.py | 26 +-
sdks/python/apache_beam/transforms/core_test.py | 17 +-
.../transforms/managed_iceberg_it_test.py | 23 +-
.../typehints/native_type_compatibility.py | 7 +-
.../typehints/native_type_compatibility_test.py | 4 +
sdks/python/apache_beam/typehints/schemas.py | 29 +-
sdks/python/apache_beam/typehints/schemas_test.py | 2 +
.../python/apache_beam/typehints/typehints_test.py | 3 +-
.../yaml/extended_tests/messaging/kafka.yaml | 54 +-
sdks/python/apache_beam/yaml/integration_tests.py | 24 +-
sdks/python/apache_beam/yaml/standard_io.yaml | 1 +
sdks/python/apache_beam/yaml/yaml_provider.py | 3 +
sdks/python/container/build.gradle | 3 +-
.../container/ml/py312/gpu_image_requirements.txt | 2 +-
.../container/py310/base_image_requirements.txt | 2 +-
sdks/python/pytest.ini | 1 +
sdks/python/ruff.toml | 96 +++
sdks/python/scripts/run_pylint.sh | 7 +-
sdks/python/setup.py | 56 +-
sdks/python/test-suites/dataflow/common.gradle | 28 +
sdks/python/test-suites/tox/pycommon/build.gradle | 3 -
sdks/python/tox.ini | 29 +-
sdks/typescript/package-lock.json | 746 +++++++++++++++++----
sdks/typescript/package.json | 2 +-
523 files changed, 3624 insertions(+), 2438 deletions(-)
copy
plugins/beam-code-completion-plugin/src/test/testData/TestCompletions.java =>
examples/java/src/main/java/org/apache/beam/examples/PicoWordCount.java (56%)
copy sdks/java/core/src/main/java/org/apache/beam/sdk/coders/BitSetCoder.java
=>
runners/core-java/src/main/java/org/apache/beam/runners/core/serialization/SentinelBitSetCoder.java
(66%)
copy
sdks/java/core/src/test/java/org/apache/beam/sdk/coders/BitSetCoderTest.java =>
runners/core-java/src/test/java/org/apache/beam/runners/core/serialization/SentinelBitSetCoderTest.java
(52%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/SparkStructuredStreamingPipelineOptions.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/SparkStructuredStreamingPipelineResult.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/SparkStructuredStreamingRunner.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/SparkStructuredStreamingRunnerRegistrar.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/examples/WordCount.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/io/BoundedDatasetFactory.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/io/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/BeamMetricSet.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/MetricsAccumulator.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/SparkBeamMetric.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/SparkBeamMetricSource.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/WithMetricsSupport.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/sink/CodahaleCsvSink.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/sink/CodahaleGraphiteSink.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/sink/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/EvaluationContext.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/PipelineTranslator.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/SparkSessionFactory.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/SparkTransformOverrides.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/TransformTranslator.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/Aggregators.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/CombineGloballyTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/CombineGroupedValuesTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/CombinePerKeyTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/DoFnPartitionIteratorFactory.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/DoFnRunnerFactory.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/DoFnRunnerWithMetrics.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/FlattenTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/GroupByKeyHelpers.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/GroupByKeyTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/ImpulseTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/ParDoTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/PipelineTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/ReadSourceTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/ReshuffleTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/WindowAssignTranslatorBatch.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/functions/CachedSideInputReader.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/functions/GroupAlsoByWindowViaOutputBufferFn.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/functions/NoOpStepContext.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/functions/SideInputValues.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/functions/SparkSideInputReader.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/functions/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/helpers/CoderHelpers.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/helpers/EncoderFactory.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/helpers/EncoderHelpers.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/helpers/EncoderProvider.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/helpers/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/utils/ScalaInterop.java
(100%)
rename runners/spark/{3 =>
}/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/utils/package-info.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/SparkSessionRule.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/SparkStructuredStreamingRunnerRegistrarTest.java
(91%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/StructuredStreamingPipelineStateTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/aggregators/metrics/sink/InMemoryMetrics.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/aggregators/metrics/sink/InMemoryMetricsSinkRule.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/aggregators/metrics/sink/SparkMetricsSinkTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/metrics/SparkBeamMetricTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/AggregatorsTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/CombineGloballyTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/CombineGroupedValuesTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/CombinePerKeyTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/ComplexSourceTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/FlattenTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/GroupByKeyTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/ParDoTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/SimpleSourceTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/WindowAssignTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/functions/SideInputValuesTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/helpers/EncoderHelpersTest.java
(100%)
rename runners/spark/{3 =>
}/src/test/java/org/apache/beam/runners/spark/structuredstreaming/translation/streaming/SimpleSourceTest.java
(100%)
copy
sdks/java/io/clickhouse/src/test/java/org/apache/beam/sdk/io/clickhouse/{ClickHouseIOTest.java
=> ClickHouseIOIT.java} (93%)
create mode 100644 sdks/python/apache_beam/ml/inference/anthropic_inference.py
create mode 100644
sdks/python/apache_beam/ml/inference/anthropic_inference_it_test.py
create mode 100644
sdks/python/apache_beam/ml/inference/anthropic_inference_test.py
copy
sdks/python/apache_beam/{transforms/enrichment_handlers/feast_tests_requirements.txt
=> ml/inference/anthropic_tests_requirements.txt} (97%)
create mode 100644 sdks/python/ruff.toml
