This is an automated email from the ASF dual-hosted git repository.
derrickaw pushed a change to branch 20260524_huggingFaceTry#3
in repository https://gitbox.apache.org/repos/asf/beam.git
omit 8cfac40736c revert integration test changes
omit 852df657555 adk as extra
omit cb5b8ba0ede Widen opentelemetry dependency version bounds in setup.py
to be compatible with container base requirement constraints
omit 5bdbdd73804 Fix pip backtracking resolution limit errors in
installYamlIntegrationTestDeps by defining p311/p312 ml extras without
datatable and correctly resolving constraints
omit ebc69dbb372 simplify condition again and try
omit e6a47326dc7 fix ml_test dependencies
omit 7fbe5fceffc try to fix dependency torch issue
omit 4d2c47a63e5 fix gemini comments
omit 204261160bb Fix installYamlIntegrationTestDeps to use constraint files
and prevent pip backtracking hangs
omit 33a05a37b06 update dependency logic
omit 78137c307ad add yaml huggingface test file
omit b1ae999155d huggingface model handler for yaml
add 852d0720ac0 Refactor _SharedCache to handle context vs non-context
ownership (#38620)
add d2a3cee22e3 Enforce binary-only constraints during early requirements
cache attempts (#38688)
add 5096e63ecae Bump docker/setup-qemu-action from 4.0.0 to 4.1.0 (#38718)
add 3cb68c9bd68 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#38719)
add 758042f0580 Bump google.golang.org/api from 0.281.0 to 0.282.0 in
/sdks (#38720)
add 789b278172c Bump github.com/aws/smithy-go from 1.25.1 to 1.26.0 in
/sdks (#38721)
add 54f7c7dd0d8 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#38722)
add 0302bf5529c Implemented MLTransform generate vocab Dataflow benchmark
(#38215)
add cd8b009d9fc [#38708] Add Flink 2.0 to SDK pipeline options validation
lists (#38726)
add a0494894c35 up timeout (#38732)
add 1ae1ec1c741 huggingface model handler for yaml
add 66841aa56d9 add yaml huggingface test file
add dc63a706740 update dependency logic
add 93804e2f21b Fix installYamlIntegrationTestDeps to use constraint files
and prevent pip backtracking hangs
add 7a71115db92 fix gemini comments
add 8a63448a04e try to fix dependency torch issue
add 0805e62a8be fix ml_test dependencies
add 73c744ee8da simplify condition again and try
add 51685855736 Fix pip backtracking resolution limit errors in
installYamlIntegrationTestDeps by defining p311/p312 ml extras without
datatable and correctly resolving constraints
add 378dfb9917e Widen opentelemetry dependency version bounds in setup.py
to be compatible with container base requirement constraints
add 3d52cb728a2 adk as extra
add 1c2d0d0d165 revert integration test changes
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (8cfac40736c)
\
N -- N -- N refs/heads/20260524_huggingFaceTry#3 (1c2d0d0d165)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../test-properties.json | 2 +-
.github/trigger_files/beam_PostCommit_Python.json | 2 +-
.../beam_Inference_Python_Benchmarks_Dataflow.yml | 12 +
.../beam_PostCommit_Yaml_Xlang_Direct.yml | 2 +-
.github/workflows/build_wheels.yml | 2 +-
..._Dataflow_MLTransform_Generate_Vocab_Batch.txt} | 35 +--
.test-infra/tools/refresh_looker_metrics.py | 3 +-
sdks/go.mod | 10 +-
sdks/go.sum | 20 +-
.../apache_beam/examples/ml_transform/README.md | 116 +++++++++
.../ml_transform/mltransform_generate_vocab.py | 265 +++++++++++++++++++++
.../mltransform_generate_vocab_requirements.txt} | 14 +-
.../mltransform_generate_vocab_test.py | 191 +++++++++++++++
.../python/apache_beam/options/pipeline_options.py | 2 +-
.../apache_beam/runners/portability/stager.py | 151 +++++++-----
.../mltransform_generate_vocab_benchmark.py | 56 +++++
.../testing/load_tests/dataflow_cost_benchmark.py | 28 ++-
sdks/python/apache_beam/utils/subprocess_server.py | 40 ++--
.../apache_beam/utils/subprocess_server_test.py | 57 ++++-
sdks/typescript/src/apache_beam/runners/flink.ts | 2 +-
website/www/site/content/en/performance/_index.md | 1 +
.../en/performance/mltransformvocab/_index.md | 37 +++
website/www/site/data/performance.yaml | 16 ++
23 files changed, 945 insertions(+), 119 deletions(-)
copy
.github/workflows/load-tests-pipeline-options/{beam_Inference_Python_Benchmarks_Dataflow_VLLM_Gemma_Batch.txt
=>
beam_Inference_Python_Benchmarks_Dataflow_MLTransform_Generate_Vocab_Batch.txt}
(66%)
create mode 100644 sdks/python/apache_beam/examples/ml_transform/README.md
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_generate_vocab.py
copy
sdks/python/apache_beam/{ml/inference/table_row_inference_requirements.txt =>
examples/ml_transform/mltransform_generate_vocab_requirements.txt} (70%)
create mode 100644
sdks/python/apache_beam/examples/ml_transform/mltransform_generate_vocab_test.py
create mode 100644
sdks/python/apache_beam/testing/benchmarks/inference/mltransform_generate_vocab_benchmark.py
create mode 100644
website/www/site/content/en/performance/mltransformvocab/_index.md
