This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 749e274ecd0 add note on spammy logs and mitigation (#35726)
add 4df9762a0f7 .github: remove `ubuntu-latest` environment from ml
add ac654fd7911 Merge pull request #35734 from
mohamedawnallah/revertUbuntuLatest
add 1e1c62a3627 Iobase streaming support in FileBasedSink, exposed in
TextIO (#35253)
add 480fcc87536 sdks/python/scripts: fix posargs for `run_pytest.sh`
(#35733)
add aee8edd9fa0 adapt to new np outputs (#35691) (#35741)
add 5dad7a6659c Fix PostCommit Python job (#35709)
add f117e93b0c8 Update Java beam-master container (#35732)
add 72ecb475fc1 sdks/python/scripts: capture `(...)` pytest marker group
(#35740)
add d493275bb09 [yaml] Fix ml embeddings issue (#35715)
add f2f088283c4 Add Terraform configuration and IAM management scripts for
GCP project (#35701)
add 1aa3592f2a6 [YAML] A Streaming Inference Pipeline - Taxi Fare
Estimation (#35568)
No new revisions were added by this update.
Summary of changes:
.github/trigger_files/beam_PostCommit_Python.json | 2 +-
.github/workflows/beam_PostCommit_Python.yml | 7 +-
.github/workflows/beam_PreCommit_Python_ML.yml | 7 +-
.github/workflows/beam_UserRoles.yml | 62 ++
CHANGES.md | 6 +-
infra/iam/.terraform.lock.hcl | 21 +
infra/iam/README.md | 63 ++
.../iam/config.auto.tfvars | 6 +-
infra/iam/generate.py | 212 ++++++
.../config_aliases.yaml => infra/iam/main.tf | 23 +-
.../iam/requirements.txt | 9 +-
infra/iam/users.tf | 60 ++
infra/iam/users.yml | 547 ++++++++++++++
runners/google-cloud-dataflow-java/build.gradle | 4 +-
sdks/python/apache_beam/dataframe/doctests.py | 2 +-
.../inference/gemini_text_classification.py | 7 +-
sdks/python/apache_beam/io/debezium.py | 2 +-
sdks/python/apache_beam/io/filebasedsink.py | 168 ++++-
sdks/python/apache_beam/io/textio.py | 62 +-
sdks/python/apache_beam/io/textio_test.py | 406 +++++++++++
sdks/python/apache_beam/ml/transforms/base.py | 28 +-
.../yaml/examples/testing/examples_test.py | 221 +++++-
.../yaml/examples/testing/input_data.py | 67 ++
.../ml/{sentiment_analysis => taxi_fare}/README.md | 57 +-
.../custom_nyc_taxifare_model_deployment.ipynb | 810 +++++++++++++++++++++
.../taxi_fare/streaming_taxifare_prediction.yaml | 276 +++++++
sdks/python/apache_beam/yaml/yaml_ml.py | 28 +-
sdks/python/apache_beam/yaml/yaml_ml_test.py | 32 +
sdks/python/scripts/run_pytest.sh | 97 ++-
sdks/python/setup.py | 1 +
30 files changed, 3129 insertions(+), 164 deletions(-)
create mode 100644 .github/workflows/beam_UserRoles.yml
create mode 100644 infra/iam/.terraform.lock.hcl
create mode 100644 infra/iam/README.md
copy sdks/python/apache_beam/internal/code_object_pickler.py =>
infra/iam/config.auto.tfvars (86%)
create mode 100644 infra/iam/generate.py
copy sdks/java/managed/src/main/resources/config_aliases.yaml =>
infra/iam/main.tf (67%)
copy sdks/python/apache_beam/internal/code_object_pickler.py =>
infra/iam/requirements.txt (82%)
create mode 100644 infra/iam/users.tf
create mode 100644 infra/iam/users.yml
copy sdks/python/apache_beam/yaml/examples/transforms/ml/{sentiment_analysis
=> taxi_fare}/README.md (56%)
create mode 100644
sdks/python/apache_beam/yaml/examples/transforms/ml/taxi_fare/custom_nyc_taxifare_model_deployment.ipynb
create mode 100644
sdks/python/apache_beam/yaml/examples/transforms/ml/taxi_fare/streaming_taxifare_prediction.yaml
