This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/pip/sdks/python/container/ml/py312/xgrammar-0.1.32
in repository https://gitbox.apache.org/repos/asf/beam.git
omit 205fed74ed9 Bump xgrammar from 0.1.21 to 0.1.32 in
/sdks/python/container/ml/py312
add 57ab2b96113 [Dataflow Java Runner] Add support for sending logs
directly to Cloud Logging (#37662)
add 7d756c2e109 update container version (#37811)
add e6fcdd72ed6 [Java][Debezium] Fix NPE in debeziumRecordInstant for
DELETE events (#37795)
add 8e0736ab304 Loosen GRPC requirements. (#37817)
add 9829d6d3cf9 Merge pull request #37792: [ErrorProne] Fix
AutoValueBoxedValues warnings across the codebase
add edaeae93065 update python container tag (#37812)
add 2ebe33d976a fix non-breaking vulnerabilities (#37826)
add 9f5904b2b59 Support inferring schemas from Python dataclasses (#37728)
add 9d73d769ff0 Only pull license for selected tests and publishing
container (#37827)
add cf536ea06d6 Fix 36181 cloudml benchmarks job (#37803)
add a0674a97db6 [ErrorProne] Fix InvalidParam, InvalidInlineTag,
InvalidBlockTag, and InvalidLink checks (#37773)
add d6bc507d769 Skip intermediate python wheels on pull request trigger
(#37832)
add 630f32ada54 [Drain] Expose drain to dofn processElement and onTimer
(#37825)
add 87d7bba644f docs: Clarify JAVA_HOME setup and initial build
expectations for all OSes (#37415)
add 892fa0a9357 Fix Run in Colab thumbnails blocked by CSP (#37838)
add e497c1e9b43 Partly Revert #37832 (#37837)
add 0705b4376ec apt-get upgrade in container images to install security
fixes. (#37841)
add ab566197fd2 upgrade vllm for vuln (#37843)
add 02d8f56a1e8 [Dataflow Streaming] Remove rolled out Windmill isolated
channels flag (#37844)
add 3b41e8b4320 Remove rolled out Windmill separate heartbeat stream flag
(#37845)
add b92c436ee64 Use Python 3.11 and cibuildwheel 3.4.0 for wheel builds
(#37850)
add d6d2433827d Fix python postcommit 30513 (#37849)
add 5c5c710441c Revert "upgrade vllm for vuln" (#37856)
add 47bab7e7597 [SpannerIO] Add low-latency configuration in Spanner
Change Streams (#37718)
add 0f6c88e0d4b Pin zookeeper in expansion service (#37859)
add b9a7585d7f4 [ErrorProne] Enable StaticAssignmentInConstructor check
(#37786)
add 3b472aaa9d3 [ErrorProne] Enable UnsafeReflectiveConstructionCast check
(#37784)
add 914e425b26d Fix #21317: Replace colons with underscores in window
filenames for Windows compatibility (#37821)
add 85c1b88ce5a [Dataflow Streaming] Create a separate option to control
commit threads with direct path. (#37848)
add 9292e1d8140 [Dataflow Streaming] Prevent commit threads from sharing
commit streams (#37847)
add 487696c9fd1 [Dataflow Logging handler] Change @LazyInit to
AtomicBoolean (#37846)
add e1e2c3ba85c [DebeziumIO] Implement startOffset & offset persistence
for Kafka (#28248) (#37750)
add 4c95230392c [typescript] - fix rest of vulnerabilities (#37852)
add 39c7b46aecb Regenerate beam container image dependencies to include
newer version of grpc. (#37822)
add 4aff88ea91a Revert "[Dataflow Streaming] Prevent commit threads from
sharing commit streams" (#37873)
add 65179691f25 Fix maven archetype dependency for io-components
add 41b513e210c Merge pull request #37871 from Abacn/fix-maven-archtype
add 03e1939ab9d Bump xgrammar from 0.1.21 to 0.1.32 in
/sdks/python/container/ml/py312
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (205fed74ed9)
\
N -- N -- N
refs/heads/dependabot/pip/sdks/python/container/ml/py312/xgrammar-0.1.32
(03e1939ab9d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../gradle-command-self-hosted-action/action.yml | 2 +-
.github/workflows/beam_PreCommit_GoPortable.yml | 5 +-
.../beam_PreCommit_Java_Examples_Dataflow.yml | 1 +
...eam_PreCommit_Java_Examples_Dataflow_Java21.yml | 1 +
.github/workflows/beam_PreCommit_PythonDocker.yml | 3 +-
.../workflows/beam_Publish_Beam_SDK_Snapshots.yml | 1 +
.../workflows/beam_Publish_Docker_Snapshots.yml | 6 +-
.github/workflows/build_wheels.yml | 6 +-
.../beam_CloudML_Benchmarks_Dataflow_arguments.txt | 2 +-
CHANGES.md | 1 +
CONTRIBUTING.md | 5 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 8 +-
.../datatokenization/utils/CsvConverters.java | 6 +-
.../apache/beam/examples/webapis/ImageRequest.java | 2 +-
.../clickhouse/conditions/ClickHouseRowsCheck.java | 4 +-
.../datadog/conditions/DatadogLogEntriesCheck.java | 4 +-
.../java/org/apache/beam/it/gcp/LoadTestBase.java | 4 +-
.../gcp/bigquery/conditions/BigQueryRowsCheck.java | 4 +-
.../gcp/pubsub/conditions/PubsubMessagesCheck.java | 4 +-
.../beam/it/gcp/bigquery/BigQueryStreamingLT.java | 8 +-
.../apache/beam/it/gcp/bigtable/BigTableIOLT.java | 8 +-
.../apache/beam/it/gcp/storage/FileBasedIOLT.java | 2 +-
.../java/org/apache/beam/it/kafka/KafkaIOLT.java | 8 +-
.../mongodb/conditions/MongoDBDocumentsCheck.java | 4 +-
.../it/splunk/conditions/SplunkEventsCheck.java | 4 +-
.../apache/beam/runners/core/SimpleDoFnRunner.java | 15 +
.../beam/runners/core/StatefulDoFnRunner.java | 3 +-
.../beam/runners/direct/DirectTimerInternals.java | 4 +-
.../direct/BoundedReadEvaluatorFactoryTest.java | 11 +-
.../direct/UnboundedReadEvaluatorFactoryTest.java | 44 +-
.../runners/flink/streaming/StreamSources.java | 2 +-
.../wrappers/streaming/DoFnOperator.java | 4 +-
.../wrappers/streaming/DoFnOperator.java | 4 +-
.../runners/flink/streaming/StreamSources.java | 2 +-
.../wrappers/streaming/DoFnOperator.java | 4 +-
runners/google-cloud-dataflow-java/build.gradle | 6 +-
.../options/DataflowStreamingPipelineOptions.java | 16 +-
.../options/DataflowWorkerLoggingOptions.java | 74 +
.../google-cloud-dataflow-java/worker/build.gradle | 7 +-
.../worker/DataflowElementExecutionTracker.java | 8 +-
.../dataflow/worker/DataflowExecutionContext.java | 4 +-
.../MetricsToPerStepNamespaceMetricsConverter.java | 4 +-
.../dataflow/worker/StreamingDataflowWorker.java | 39 +-
.../runners/dataflow/worker/WorkUnitClient.java | 2 +-
.../logging/DataflowWorkerLoggingHandler.java | 779 +++++++--
.../logging/DataflowWorkerLoggingInitializer.java | 180 +-
.../JulHandlerPrintStreamAdapterFactory.java | 11 +-
.../windmill/client/AbstractWindmillStream.java | 6 +-
.../client/ResettableThrowingStreamObserver.java | 17 +-
.../windmill/client/grpc/GrpcDispatcherClient.java | 48 +-
.../windmill/client/grpc/GrpcWindmillServer.java | 3 +-
.../grpc/stubs/WindmillStubFactoryFactory.java | 2 +-
.../grpc/stubs/WindmillStubFactoryFactoryImpl.java | 19 +-
.../work/refresh/StreamPoolHeartbeatSender.java | 27 -
.../worker/StreamingDataflowWorkerTest.java | 7 +-
.../logging/DataflowWorkerLoggingHandlerTest.java | 504 +++++-
.../DataflowWorkerLoggingInitializerTest.java | 111 +-
.../JulHandlerPrintStreamAdapterFactoryTest.java | 4 +-
.../config/FixedGlobalConfigHandleTest.java | 5 +-
.../StreamingGlobalConfigHandleImplTest.java | 17 +-
.../FanOutStreamingEngineWorkerHarnessTest.java | 3 -
.../client/grpc/GrpcDispatcherClientTest.java | 141 --
.../testing/FakeWindmillStubFactoryFactory.java | 2 +-
.../refresh/StreamPoolHeartbeatSenderTest.java | 84 -
.../worker/windmill/src/main/proto/windmill.proto | 8 +-
.../artifact/ArtifactStagingService.java | 1 -
.../runners/fnexecution/wire/CommonCoderTest.java | 2 +-
.../apache/beam/runners/prism/PrismExecutor.java | 4 +-
.../beam/runners/prism/PrismPipelineResult.java | 2 +-
.../samza/runtime/ClassicBundleManager.java | 6 +-
.../translation/helpers/EncoderHelpers.java | 4 +-
.../aggregators/metrics/sink/InMemoryMetrics.java | 26 +-
.../spark/translation/GroupCombineFunctions.java | 2 +-
.../aggregators/metrics/sink/InMemoryMetrics.java | 26 +-
.../coders/SparkRunnerKryoRegistratorTest.java | 3 +-
sdks/go/pkg/beam/io/xlang/debeziumio/debezium.go | 40 +
.../apache/beam/sdk/io/DefaultFilenamePolicy.java | 11 +-
.../java/org/apache/beam/sdk/io/FileSystem.java | 4 +-
.../java/org/apache/beam/sdk/io/FileSystems.java | 4 +-
.../beam/sdk/metrics/MetricsEnvironment.java | 11 +-
.../GenerateSequenceSchemaTransformProvider.java | 12 +-
.../java/org/apache/beam/sdk/schemas/Schema.java | 10 +-
.../schemas/logicaltypes/UnknownLogicalType.java | 2 +-
.../apache/beam/sdk/schemas/transforms/Group.java | 4 +-
.../java/org/apache/beam/sdk/transforms/DoFn.java | 2 +-
.../org/apache/beam/sdk/transforms/Flatten.java | 2 +-
.../org/apache/beam/sdk/transforms/JsonToRow.java | 6 +-
.../org/apache/beam/sdk/transforms/MapKeys.java | 1 -
.../reflect/ByteBuddyDoFnInvokerFactory.java | 11 +
.../beam/sdk/transforms/reflect/DoFnInvoker.java | 15 +
.../beam/sdk/transforms/reflect/DoFnSignature.java | 28 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 10 +
.../beam/sdk/util/RowStringInterpolator.java | 8 +-
.../construction/SplittableParDoNaiveBounded.java | 5 +
.../sdk/util/construction/TransformUpgrader.java | 3 +-
.../sdk/util/construction/UnknownCoderWrapper.java | 2 +-
.../beam/sdk/schemas/AutoValueSchemaTest.java | 4 +-
.../apache/beam/sdk/schemas/SchemaCoderTest.java | 6 +-
.../beam/sdk/schemas/transforms/SelectTest.java | 8 +-
.../TypedSchemaTransformProviderTest.java | 4 +-
.../beam/sdk/transforms/ParDoSchemaTest.java | 8 +-
.../org/apache/beam/sdk/transforms/ToJsonTest.java | 6 +-
.../sdk/transforms/reflect/DoFnSignaturesTest.java | 34 +-
.../beam/sdk/util/SerializableUtilsTest.java | 3 +-
.../sdk/expansion/service/ExpansionService.java | 2 +-
.../expansion/service/ExpansionServiceTest.java | 2 +-
.../extensions/avro/schemas/utils/AvroUtils.java | 2 +-
.../avro/schemas/utils/AvroUtilsTest.java | 18 +-
.../sdk/extensions/gcp/util/GceMetadataUtil.java | 14 +-
.../beam/sdk/extensions/gcp/util/GcsUtil.java | 2 +-
.../beam/sdk/extensions/ml/DLPDeidentifyText.java | 4 +-
.../beam/sdk/extensions/ml/DLPInspectText.java | 4 +-
.../beam/sdk/extensions/ml/DLPReidentifyText.java | 4 +-
.../ml/RecommendationAIImportCatalogItems.java | 6 +-
.../ml/RecommendationAIImportUserEvents.java | 6 +-
.../ordered/OrderedProcessingHandler.java | 2 +-
.../ordered/OrderedEventProcessorTestBase.java | 2 +-
.../extensions/sql/impl/parser/SqlAlterTable.java | 2 +-
.../sql/impl/parser/SqlCreateExternalTable.java | 2 +-
.../sql/meta/catalog/CatalogManager.java | 4 +-
.../apache/beam/sdk/extensions/sql/TestUtils.java | 2 +-
.../beam/sdk/extensions/timeseries/FillGaps.java | 8 +-
.../zetasketch/ApproximateCountDistinct.java | 8 +-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 10 +
...littableSplitAndSizeRestrictionsDoFnRunner.java | 2 +-
.../sdk/io/aws2/common/AsyncBatchWriteHandler.java | 4 +-
.../apache/beam/sdk/io/aws2/kinesis/KinesisIO.java | 4 +-
.../sdk/io/aws2/dynamodb/testing/DynamoDBIOIT.java | 2 +-
.../sdk/io/aws2/kinesis/KinesisIOWriteTest.java | 10 +-
.../org/apache/beam/sdk/io/cdap/ConfigWrapper.java | 2 +-
.../io/cdap/PluginConfigInstantiationUtils.java | 4 +-
.../java/org/apache/beam/sdk/io/cdap/CdapIOIT.java | 2 +-
.../apache/beam/sdk/io/cdap/TestRowDBWritable.java | 6 +-
.../beam/sdk/io/common/SchemaAwareJavaBeans.java | 36 +-
.../org/apache/beam/sdk/io/common/TestRow.java | 10 +-
.../beam/sdk/io/datadog/DatadogEventPublisher.java | 10 +-
.../org/apache/beam/io/debezium/DebeziumIO.java | 76 +
.../DebeziumReadSchemaTransformProvider.java | 4 +-
.../io/debezium/DebeziumTransformRegistrar.java | 38 +
.../beam/io/debezium/FileSystemOffsetRetainer.java | 166 ++
.../apache/beam/io/debezium/KafkaConnectUtils.java | 27 +-
.../beam/io/debezium/KafkaSourceConsumerFn.java | 26 +-
.../apache/beam/io/debezium/OffsetRetainer.java | 69 +
.../apache/beam/io/debezium/DebeziumIOTest.java | 152 ++
.../io/debezium/FileSystemOffsetRetainerTest.java | 131 ++
.../beam/io/debezium/KafkaConnectSchemaTest.java | 41 +-
.../beam/sdk/io/elasticsearch/ElasticsearchIO.java | 14 +-
sdks/java/io/expansion-service/build.gradle | 3 +
.../FileReadSchemaTransformFormatProviderTest.java | 2 +-
.../AvroGenericRecordToStorageApiProto.java | 2 +-
.../io/gcp/bigquery/BeamRowToStorageApiProto.java | 2 +-
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 44 +-
.../sdk/io/gcp/bigquery/BigQueryIOTranslation.java | 40 +-
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 2 +-
.../io/gcp/bigquery/RowMutationInformation.java | 16 +-
.../io/gcp/bigquery/TableRowToStorageApiProto.java | 2 +-
.../beam/sdk/io/gcp/bigquery/WritePartition.java | 2 +-
.../beam/sdk/io/gcp/bigquery/WriteTables.java | 2 +-
.../beam/sdk/io/gcp/pubsub/PubsubClient.java | 2 +-
.../beam/sdk/io/gcp/pubsub/PubsubRowToMessage.java | 8 +-
.../sdk/io/gcp/pubsub/PubsubUnboundedSource.java | 2 +-
.../beam/sdk/io/gcp/spanner/ReadSpannerSchema.java | 2 +-
.../apache/beam/sdk/io/gcp/spanner/SpannerIO.java | 78 +-
.../changestreams/ChangeStreamsConstants.java | 9 +
.../changestreams/action/ActionFactory.java | 12 +-
.../action/HeartbeatRecordAction.java | 14 +-
.../action/QueryChangeStreamAction.java | 25 +-
.../spanner/changestreams/dofn/InitializeDoFn.java | 12 +-
.../dofn/ReadChangeStreamPartitionDoFn.java | 18 +-
.../beam/sdk/io/gcp/testing/BigqueryMatcher.java | 4 +-
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 2 +-
.../beam/sdk/io/gcp/bigtable/BigtableIOTest.java | 16 +-
.../action/HeartbeatRecordActionTest.java | 149 +-
.../action/QueryChangeStreamActionTest.java | 114 +-
.../changestreams/dofn/InitializeDoFnTest.java | 3 +-
.../dofn/ReadChangeStreamPartitionDoFnTest.java | 19 +-
.../sdk/io/hadoop/format/TestRowDBWritable.java | 6 +-
.../beam/sdk/io/hbase/HBaseRowMutationsCoder.java | 2 +-
.../org/apache/beam/sdk/io/hbase/HBaseIOIT.java | 2 +-
.../sdk/io/hcatalog/HiveDatabaseTestHelper.java | 17 +-
.../java/org/apache/beam/sdk/io/jdbc/JdbcIO.java | 4 +-
.../java/org/apache/beam/sdk/io/jdbc/JdbcUtil.java | 6 +-
.../java/org/apache/beam/sdk/io/jdbc/JdbcIOIT.java | 2 +-
.../java/org/apache/beam/sdk/io/jms/JmsIOTest.java | 10 +-
.../beam/sdk/io/kafka/KafkaSourceDescriptor.java | 4 +-
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 2 +-
.../org/apache/beam/sdk/io/kafka/KafkaIOIT.java | 2 +-
.../beam/sdk/io/rabbitmq/ExchangeTestPlan.java | 2 +-
.../org/apache/beam/io/requestresponse/Call.java | 53 +-
.../apache/beam/io/requestresponse/Monitoring.java | 170 +-
.../io/requestresponse/RequestResponseIOTest.java | 8 +-
.../beam/sdk/io/singlestore/SingleStoreIO.java | 4 +-
.../apache/beam/sdk/io/singlestore/TestHelper.java | 2 +-
.../io/snowflake/test/FakeSnowflakeDatabase.java | 10 +-
.../org/apache/beam/sdk/io/solace/data/Solace.java | 4 +-
.../sdk/io/sparkreceiver/SparkReceiverIOIT.java | 5 +-
.../beam/sdk/io/splunk/HttpEventPublisher.java | 4 +-
.../testing/TestSchemaTransformProvider.java | 6 +-
.../src/main/resources/archetype-resources/pom.xml | 6 +
.../src/main/resources/archetype-resources/pom.xml | 6 +
sdks/python/apache_beam/coders/coder_impl.py | 6 +-
sdks/python/apache_beam/io/debezium.py | 44 +-
.../ml/rag/embeddings/vertex_ai_test.py | 9 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
.../testing/benchmarks/cloudml/requirements.txt | 12 +-
.../typehints/native_type_compatibility.py | 5 +
sdks/python/apache_beam/typehints/row_type.py | 47 +-
sdks/python/apache_beam/typehints/row_type_test.py | 90 +
sdks/python/apache_beam/typehints/schemas.py | 3 +-
sdks/python/apache_beam/typehints/schemas_test.py | 61 +
sdks/python/container/Dockerfile | 1 +
.../container/license_scripts/dep_urls_py.yaml | 4 +-
.../container/license_scripts/pull_licenses_py.py | 2 +-
.../container/ml/py310/base_image_requirements.txt | 28 +-
.../container/ml/py310/gpu_image_requirements.txt | 24 +-
.../container/ml/py311/base_image_requirements.txt | 33 +-
.../container/ml/py311/gpu_image_requirements.txt | 29 +-
.../container/ml/py312/base_image_requirements.txt | 33 +-
.../container/ml/py312/gpu_image_requirements.txt | 29 +-
.../container/ml/py313/base_image_requirements.txt | 12 +-
.../container/py310/base_image_requirements.txt | 14 +-
.../container/py311/base_image_requirements.txt | 19 +-
.../container/py312/base_image_requirements.txt | 19 +-
.../container/py313/base_image_requirements.txt | 8 +-
sdks/python/pyproject.toml | 3 +
sdks/python/setup.py | 30 +-
sdks/typescript/package-lock.json | 1828 +++++++++++---------
sdks/typescript/package.json | 10 +-
sdks/typescript/test/primitives_test.ts | 12 +-
.../www/site/layouts/shortcodes/button-colab.html | 2 +-
website/www/site/static/images/colab/icon32.png | Bin 0 -> 1418 bytes
231 files changed, 4630 insertions(+), 2346 deletions(-)
delete mode 100644
runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/windmill/client/grpc/GrpcDispatcherClientTest.java
create mode 100644
sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/FileSystemOffsetRetainer.java
create mode 100644
sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/OffsetRetainer.java
create mode 100644
sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/FileSystemOffsetRetainerTest.java
create mode 100644 sdks/python/apache_beam/typehints/row_type_test.py
create mode 100644 website/www/site/static/images/colab/icon32.png
