This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/github_actions/actions/upload-artifact-3 in repository https://gitbox.apache.org/repos/asf/beam.git
omit 32d14374c69 Bump actions/upload-artifact from 2 to 3 add 448184e80e6 MLTransform transform catalog snippets (#27709) add a46a35b52fc Replace synthetic field this$0 by explicit instance (#27868) add feb1cf73a09 Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks (#28088) add 7a421c4356a [prism] support single external env pipelines. (#28083) add 6319d519c99 Loosen environment validation checks for RCs (#28100) add 01cd45390ba Pin hugging face docs (#28106) add 55638de40cd [BQ Python StorageWriteAPI] Enable writing rows with missing nullable fields (#28009) add c8afd9c2580 Bump google.golang.org/api from 0.137.0 to 0.138.0 in /sdks (#28056) add 6cae195d4ab Change GH Issue linked to ignored DICOM IT (#28097) add 99dfcef1427 Fix error condition checking (#28076) add cfd9662aebf Update `it` module. (#28113) add 395c4d15bb7 [Python] Get available python version and use it for Python SDK harness boot entry point (#28046) add 8f65ba03f78 Bump github.com/proullon/ramsql from 0.0.1 to 0.1.1 in /sdks (#28089) add 50b087cb81e Bump github.com/google/uuid from 1.3.0 to 1.3.1 in /sdks (#28087) add 5ceed8eaf09 use google form for feedback (#28013) add 632f7d0800a Add integration tests to exercise large model (#28121) add 52275ebddf7 Add type hint to CounterCell (#27522) add b2d1c60dc77 is_service_runner now returns false with dataflow_endpoint=localhost (#28128) add c5a9eef23a4 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#28117) add 095cf278b4e Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#28140) add 58ac71f5994 Update TF notebook example to auto-restart the runtime after dependency installation (#28132) add c5404a1c079 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#28138) add 0c6ef7dd478 Pass BQ coder to underlying avro source (#28143) add 6bfb4693acf Bump cloud.google.com/go/spanner from 1.47.0 to 1.49.0 in /sdks (#28144) add 6ca4110e16d Always proxy RunInference with large models (#27989) add d93200dde1e Free disk space before running build_release_candidate (#28123) add 2abff20dbe1 Add Java Neo4j IO Direct job (#28090) new 43118b47925 Bump actions/upload-artifact from 2 to 3 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (32d14374c69) \ N -- N -- N refs/heads/dependabot/github_actions/actions/upload-artifact-3 (43118b47925) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/README.md | 1 + ...yml => beam_PreCommit_Java_Neo4j_IO_Direct.yml} | 26 +- .github/workflows/build_release_candidate.yml | 2 + .../beam-ml/run_inference_tensorflow.ipynb | 383 ++++++++++----------- .../it/cassandra/CassandraResourceManager.java | 28 +- .../it/cassandra/CassandraResourceManagerTest.java | 3 + .../ElasticsearchResourceManager.java | 27 +- .../ElasticsearchResourceManagerTest.java | 3 + it/google-cloud-platform/build.gradle | 13 +- .../org/apache/beam/it/gcp/IOLoadTestBase.java | 2 +- .../java/org/apache/beam/it/gcp/LoadTestBase.java | 6 +- .../beam/it/gcp/artifacts/ArtifactClient.java | 8 + .../it/gcp/bigtable/BigtableResourceManager.java | 54 ++- .../it/gcp/dataflow/DefaultPipelineLauncher.java | 13 +- .../beam/it/gcp/datagenerator/DataGenerator.java | 4 +- .../beam/it/gcp/datagenerator/package-info.java | 1 + .../it/gcp/datastore/matchers/package-info.java | 1 + .../apache/beam/it/gcp/kms/KMSResourceManager.java | 4 +- .../beam/it/gcp/pubsub/PubsubResourceManager.java | 2 + .../beam/it/gcp/storage/GcsResourceManager.java | 8 +- .../apache/beam/it/gcp/bigquery/BigQueryIOLT.java | 6 +- .../gcp/bigquery/BigQueryResourceManagerTest.java | 3 +- .../gcp/bigtable/BigtableResourceManagerTest.java | 47 +-- .../it/gcp/dataflow/ClassicTemplateClientTest.java | 2 +- .../gcp/dataflow/DefaultPipelineLauncherTest.java | 2 +- .../it/gcp/dataflow/FlexTemplateClientTest.java | 2 +- .../gcp/datastore/DatastoreResourceManagerIT.java | 7 +- .../datastream/DatastreamResourceManagerTest.java | 3 +- .../beam/it/gcp/kms/KMSResourceManagerIT.java | 3 +- .../beam/it/gcp/kms/KMSResourceManagerTest.java | 3 +- .../it/gcp/spanner/SpannerResourceManagerTest.java | 18 - .../apache/beam/it/gcp/storage/FileBasedIOLT.java | 2 +- .../beam/it/jdbc/MSSQLResourceManagerTest.java | 2 + .../beam/it/jdbc/MySQLResourceManagerTest.java | 2 + .../beam/it/jdbc/OracleResourceManagerTest.java | 2 + .../beam/it/jdbc/PostgresResourceManagerTest.java | 2 + .../apache/beam/it/kafka/KafkaResourceManager.java | 3 +- .../java/org/apache/beam/it/kafka/KafkaIOLT.java | 2 +- .../beam/it/kafka/KafkaResourceManagerTest.java | 2 + .../it/mongodb/MongoDBResourceManagerTest.java | 2 + .../beam/it/neo4j/Neo4jResourceManagerTest.java | 2 + .../beam/it/splunk/conditions/package-info.java | 22 +- .../beam/it/splunk/matchers/package-info.java | 22 +- .../org/apache/beam/it/splunk/package-info.java | 22 +- .../beam/it/splunk/SplunkResourceManagerTest.java | 2 + .../it/splunk/SplunkResourceManagerUtilsTest.java | 2 +- .../TestContainerResourceManager.java | 7 +- .../TestContainerResourceManagerTest.java | 11 + .../runners/spark/SparkNativePipelineVisitor.java | 2 +- .../runners/spark/SparkRunnerDebuggerTest.java | 41 +++ sdks/go.mod | 44 +-- sdks/go.sum | 99 +++--- .../core/runtime/xlangx/expansionx/download.go | 15 +- .../runtime/xlangx/expansionx/download_test.go | 32 ++ sdks/go/pkg/beam/runners/prism/internal/execute.go | 18 +- .../apache/beam/sdk/transforms/MapElements.java | 4 + .../sdk/io/gcp/bigquery/BigQuerySourceBase.java | 28 +- ...ueryStorageWriteApiSchemaTransformProvider.java | 46 --- .../sdk/io/gcp/bigquery/BigQueryIOReadTest.java | 19 + .../gcp/bigquery/BigQueryIOStorageQueryTest.java | 13 + ...StorageWriteApiSchemaTransformProviderTest.java | 67 ---- .../beam/sdk/io/gcp/healthcare/DicomIOReadIT.java | 2 +- .../apache/beam/sdk/io/neo4j/Neo4jTestUtil.java | 3 +- .../inference/huggingface_language_modeling.py | 12 +- .../inference/pytorch_language_modeling.py | 10 +- .../inference/sklearn_mnist_classification.py | 10 +- .../inference/tensorflow_mnist_classification.py | 11 +- .../inference/xgboost_iris_classification.py | 10 +- .../snippets/transforms/elementwise/mltransform.py | 121 +++++++ .../transforms/elementwise/mltransform_test.py | 90 +++++ sdks/python/apache_beam/io/gcp/bigquery.py | 4 +- sdks/python/apache_beam/io/gcp/bigquery_tools.py | 27 +- .../apache_beam/io/gcp/bigquery_tools_test.py | 5 + sdks/python/apache_beam/metrics/cells.py | 7 +- sdks/python/apache_beam/ml/inference/base.py | 7 +- .../ml/inference/huggingface_inference.py | 4 + .../ml/inference/huggingface_inference_it_test.py | 35 ++ .../apache_beam/ml/inference/pytorch_inference.py | 1 + .../ml/inference/pytorch_inference_it_test.py | 35 ++ .../ml/inference/sklearn_inference_it_test.py | 32 ++ .../ml/inference/tensorflow_inference_it_test.py | 31 ++ .../ml/inference/xgboost_inference_it_test.py | 34 ++ .../options/pipeline_options_validator.py | 10 +- .../options/pipeline_options_validator_test.py | 12 +- .../apache_beam/runners/worker/bundle_processor.py | 13 +- .../runners/worker/bundle_processor_test.py | 20 ++ sdks/python/container/boot.go | 13 +- sdks/python/container/piputil.go | 19 +- sdks/python/expansion-service-container/boot.go | 9 +- sdks/python/tox.ini | 8 +- .../transforms/python/elementwise/mltransform.md | 119 +++++++ .../en/documentation/transforms/python/overview.md | 2 + website/www/site/layouts/partials/feedback.html | 2 +- .../partials/section-menu/en/documentation.html | 1 + 94 files changed, 1339 insertions(+), 602 deletions(-) copy .github/workflows/{beam_PreCommit_Java_JDBC_IO_Direct.yml => beam_PreCommit_Java_Neo4j_IO_Direct.yml} (80%) create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/elementwise/mltransform.py create mode 100644 sdks/python/apache_beam/examples/snippets/transforms/elementwise/mltransform_test.py create mode 100644 website/www/site/content/en/documentation/transforms/python/elementwise/mltransform.md