This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.84.1
in repository https://gitbox.apache.org/repos/asf/beam.git
discard ece23940bde Bump cloud.google.com/go/spanner from 1.83.0 to 1.84.1 in
/sdks
add 9d47a018781 adds .editorconfig (#35956)
add 5053aed99be Start pushing ml containers (#35595)
add a46c697fe4d Mark org.apache.beam.sdk.values.ShardedKey as deprecated
(#35823)
add 3aa27c366ea Fix dup client cache key for BigQueryIO streaming
STORAGE_WRITE (#35822)
add 4582b4f897c GCP IAM Custom Roles (#35107)
add f2b38cd5625 Fix lining breakage in pipeline_instrument_test.py (#35959)
add b723ba590b5 ci(workflow): re-enable XVR GoUsingJava Dataflow tests
(#35953)
add 0589b14812e Introduce Beartype Dependency for Type Checking (#35899)
add 2dcf5ff2406 Bump github.com/aws/aws-sdk-go-v2/config from 1.31.1 to
1.31.2 in /sdks (#35938)
add 0cee2e0cba8 Bump github.com/docker/go-connections from 0.5.0 to 0.6.0
in /sdks (#35906)
add bba4f936667 Add the readme link to new YAML examples (#35941)
add fa5f7d13adb Bump google.golang.org/api from 0.247.0 to 0.248.0 in
/sdks (#35969)
add 4c5cadad5a7 Remove mysql-connector-python dependency (#35932)
add 81e4db798b7 Fix typos and update test implementation from #35656
(#35958)
add cfd07bed1cb feat(mongodb): upgrade MongoDB Java driver to version
5.5.0 (#35946)
add 7f90455bb10 Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks
(#35974)
add 4c9799388c0 Bump google.golang.org/grpc from 1.74.2 to 1.75.0 in /sdks
(#35971)
add 62cbf83ac8f Override localhost endpoint when a worker is running in
docker on mac (#35964)
add 2bcca4811b3 fix(parquetio): handle missing nullable fields in row
conversion (#35948)
add 061191ff66e Bump cloud.google.com/go/storage from 1.56.0 to 1.56.1 in
/sdks (#35980)
add a7e2ac3db07 [Prism] Fix segv when docker container self-terminated.
(#35977)
add 09beeaadd14 add a jinja % include/import pipeline example to docs
(#35931)
add 45492145ae5 Bump github.com/aws/aws-sdk-go-v2/config from 1.31.2 to
1.31.3 in /sdks (#35983)
add 8c6ff9a21a1 Add a security GCP log analyzer (#35922)
add a7ec1ae5332 update py containers (#35982)
add ac008074fa5 [YAML]: add import jinja pipeline example (#35945)
add 8dd03dcad73 Remove leftover logic handling Java8 container (#35988)
add 8da08024895 Use requirements.txt instead of setup.py for juliaset
example
add 0670eb1bcec Fix PostCommit Python Arm job (#35962)
add 02a532b2ec8 Add TPU samples. (#35987)
add 5447d64b23c [bugFix] sdks/python: properly add Milvus as extra
dependency (#35920)
add d7d27b0b99f Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#35993)
add e20b27db8b4 Bump cloud.google.com/go/spanner from 1.83.0 to 1.84.1 in
/sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ece23940bde)
\
N -- N -- N
refs/heads/dependabot/go_modules/sdks/cloud.google.com/go/spanner-1.84.1
(e20b27db8b4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../site/i18n/feedback/en.yaml => .editorconfig | 23 +-
.github/trigger_files/beam_PostCommit_Python.json | 2 +-
.../trigger_files/beam_PostCommit_XVR_Direct.json | 2 +-
.../trigger_files/beam_PostCommit_XVR_Flink.json | 2 +-
... beam_PostCommit_XVR_GoUsingJava_Dataflow.json} | 0
...yml => beam_Infrastructure_SecurityLogging.yml} | 48 +-
.../beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 8 +-
.../workflows/beam_PreCommit_Python_Coverage.yml | 37 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 13 +-
.../notebooks/beam-ml/dataflow_tpu_examples.ipynb | 744 +++++++++++++
infra/iam/README.md | 123 +++
infra/iam/main.tf | 5 +
infra/iam/migrate_roles.py | 340 ++++++
infra/iam/roles/README.md | 75 ++
infra/iam/roles/beam_admin.role.yaml | 674 ++++++++++++
infra/iam/roles/beam_infra_manager.role.yaml | 848 +++++++++++++++
infra/iam/roles/beam_viewer.role.yaml | 1113 ++++++++++++++++++++
infra/iam/roles/beam_writer.role.yaml | 306 ++++++
infra/iam/roles/generate_roles.py | 277 +++++
infra/iam/{main.tf => roles/roles.tf} | 32 +-
infra/iam/roles/roles_config.yaml | 150 +++
infra/iam/roles/test_generate_roles.py | 82 ++
infra/security/README.md | 84 ++
infra/security/config.yml | 43 +
infra/security/log_analyzer.py | 333 ++++++
.../wordcount => infra/security}/requirements.txt | 5 +-
it/mongodb/build.gradle | 1 +
sdks/go.mod | 68 +-
sdks/go.sum | 140 +--
.../beam/runners/prism/internal/environments.go | 35 +-
.../beam/runners/prism/internal/jobservices/job.go | 2 +-
.../beam/runners/prism/internal/worker/worker.go | 35 +-
sdks/go/test/integration/expansions.go | 31 +-
sdks/go/test/integration/expansions_test.go | 3 +
sdks/go/test/run_validatesrunner_tests.sh | 27 +
sdks/java/container/Dockerfile | 2 +-
sdks/java/container/common.gradle | 36 +-
.../org/apache/beam/sdk/values/ShardedKey.java | 8 +-
sdks/java/extensions/sql/build.gradle | 4 +
.../meta/provider/mongodb/MongoDbReadWriteIT.java | 7 +-
.../bigquery/StorageApiWritesShardedRecords.java | 31 +-
.../bigquery/TwoLevelMessageConverterCache.java | 5 +
sdks/java/io/mongodb/build.gradle | 5 +-
.../org/apache/beam/sdk/io/mongodb/FindQuery.java | 5 +-
.../beam/sdk/io/mongodb/MongoDbGridFSIO.java | 153 +--
.../org/apache/beam/sdk/io/mongodb/MongoDbIO.java | 147 +--
.../apache/beam/sdk/io/mongodb/FindQueryTest.java | 5 +-
.../beam/sdk/io/mongodb/MongoDBGridFSIOTest.java | 114 +-
.../apache/beam/sdk/io/mongodb/MongoDbIOTest.java | 5 +-
.../complete/juliaset/juliaset/juliaset_test_it.py | 6 +-
.../examples/complete/juliaset/juliaset_main.py | 9 +-
.../examples/complete/juliaset}/requirements.txt | 5 +-
.../examples/complete/juliaset/setup.py | 128 ---
.../internal/code_object_pickler_test.py | 75 +-
sdks/python/apache_beam/io/parquetio.py | 7 +-
sdks/python/apache_beam/io/parquetio_test.py | 75 +-
.../apache_beam/ml/rag/enrichment/milvus_search.py | 8 +-
.../ml/rag/enrichment/milvus_search_it_test.py | 2 +-
.../apache_beam/runners/dataflow/internal/names.py | 2 +-
.../interactive/pipeline_instrument_test.py | 2 +-
sdks/python/apache_beam/typehints/typehints.py | 13 +-
sdks/python/apache_beam/yaml/examples/README.md | 11 +-
.../yaml/examples/testing/examples_test.py | 15 +-
.../yaml/examples/testing/input_data.py | 36 +-
.../transforms/jinja/{include => import}/README.md | 10 +-
.../jinja/import/macros/wordCountMacros.yaml | 64 ++
.../wordCountImport.yaml} | 15 +-
sdks/python/apache_beam/yaml/integration_tests.py | 33 +-
sdks/python/container/build.gradle | 7 +-
sdks/python/container/common.gradle | 2 +
sdks/python/container/distroless/build.gradle | 6 +-
.../container/{distroless => ml}/build.gradle | 16 +-
sdks/python/container/{ => ml}/common.gradle | 6 +-
.../py310/base_image_requirements.txt} | 34 +-
.../{distroless => ml}/py310/build.gradle | 0
.../py311/base_image_requirements.txt} | 34 +-
.../{distroless => ml}/py311/build.gradle | 0
.../py312/base_image_requirements.txt} | 34 +-
.../{distroless => ml}/py312/build.gradle | 0
.../{distroless => ml}/py313/build.gradle | 0
.../py39/base_image_requirements.txt} | 32 +-
.../container/{distroless => ml}/py39/build.gradle | 0
.../container/py310/base_image_requirements.txt | 28 +-
.../container/py311/base_image_requirements.txt | 28 +-
.../container/py312/base_image_requirements.txt | 28 +-
.../container/py313/base_image_requirements.txt | 28 +-
.../container/py39/base_image_requirements.txt | 28 +-
sdks/python/container/run_generate_requirements.sh | 9 +-
sdks/python/setup.py | 11 +-
.../www/site/content/en/documentation/sdks/yaml.md | 76 +-
90 files changed, 6306 insertions(+), 855 deletions(-)
copy website/www/site/i18n/feedback/en.yaml => .editorconfig (63%)
copy .github/trigger_files/{beam_PostCommit_Java.json =>
beam_PostCommit_XVR_GoUsingJava_Dataflow.json} (100%)
copy .github/workflows/{beam_Infrastructure_PolicyEnforcer.yml =>
beam_Infrastructure_SecurityLogging.yml} (59%)
create mode 100644 examples/notebooks/beam-ml/dataflow_tpu_examples.ipynb
create mode 100644 infra/iam/migrate_roles.py
create mode 100644 infra/iam/roles/README.md
create mode 100644 infra/iam/roles/beam_admin.role.yaml
create mode 100644 infra/iam/roles/beam_infra_manager.role.yaml
create mode 100644 infra/iam/roles/beam_viewer.role.yaml
create mode 100644 infra/iam/roles/beam_writer.role.yaml
create mode 100644 infra/iam/roles/generate_roles.py
copy infra/iam/{main.tf => roles/roles.tf} (53%)
create mode 100644 infra/iam/roles/roles_config.yaml
create mode 100644 infra/iam/roles/test_generate_roles.py
create mode 100644 infra/security/README.md
create mode 100644 infra/security/config.yml
create mode 100644 infra/security/log_analyzer.py
copy {sdks/python/apache_beam/testing/benchmarks/wordcount =>
infra/security}/requirements.txt (91%)
copy {learning/katas/python =>
sdks/python/apache_beam/examples/complete/juliaset}/requirements.txt (93%)
delete mode 100644 sdks/python/apache_beam/examples/complete/juliaset/setup.py
copy sdks/python/apache_beam/yaml/examples/transforms/jinja/{include =>
import}/README.md (91%)
create mode 100644
sdks/python/apache_beam/yaml/examples/transforms/jinja/import/macros/wordCountMacros.yaml
copy
sdks/python/apache_beam/yaml/examples/transforms/jinja/{include/wordCountInclude.yaml
=> import/wordCountImport.yaml} (75%)
copy sdks/python/container/{distroless => ml}/build.gradle (79%)
copy sdks/python/container/{ => ml}/common.gradle (96%)
rename sdks/python/container/{py310/ml_image_requirements.txt =>
ml/py310/base_image_requirements.txt} (94%)
copy sdks/python/container/{distroless => ml}/py310/build.gradle (100%)
rename sdks/python/container/{py311/ml_image_requirements.txt =>
ml/py311/base_image_requirements.txt} (94%)
copy sdks/python/container/{distroless => ml}/py311/build.gradle (100%)
rename sdks/python/container/{py312/ml_image_requirements.txt =>
ml/py312/base_image_requirements.txt} (94%)
copy sdks/python/container/{distroless => ml}/py312/build.gradle (100%)
copy sdks/python/container/{distroless => ml}/py313/build.gradle (100%)
rename sdks/python/container/{py39/ml_image_requirements.txt =>
ml/py39/base_image_requirements.txt} (94%)
copy sdks/python/container/{distroless => ml}/py39/build.gradle (100%)
