This is an automated email from the ASF dual-hosted git repository.
tvalentyn pushed a change to branch tvalentyn-patch-3
in repository https://gitbox.apache.org/repos/asf/beam.git
omit 0fa965c68c6 Monkeypatch numpy instead.
omit 4b066adf0ac Update versions of numpy
omit 13c1feb15b3 Add a note.
omit 5f0181b0359 Replace the entire method with the working implementation..
omit cc8a798e85b Work around TRT incompatibility due to numpy/numpy#22607.
omit b4dd483ddf0 Add lower bound for tests
omit dac7a7b8e66 Update upper bound for numpy.
add 93cc031aedb Bump qs from 6.5.2 to 6.5.3 in
/sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel
(#24545)
add 606f52b023d Bump github.com/aws/aws-sdk-go-v2/config from 1.18.5 to
1.18.6 in /sdks (#24714)
add 4d1c43ba9ab [24664] Fix
ProcessBundleBenchmarkTest.testStateWithCaching (#24669)
add 0290315623d flaky -> flake (#24732)
add 8dab5dcb3ce Support writing to BQ via Storage Write API with
SchemaTransforms (#23988)
add 310c5240828 Add some alphabet companies that make heavy use of Beam.
(#24719)
add 246c20cff16 [BigQueryIO] Pick provided schema if existing table has
null schema (#24699)
add 256433fbc57 Fix link to videos-and-podcasts page. (#24733)
add e1587f8e8df DebeziumIO schema transform (#24629)
add 62e5e58fd8d jamm on -javaagent instead of classpath
add fde81f815cc Merge pull request #24738: jamm on -javaagent instead of
classpath
add 17cc0dcfa60 Bump actions/setup-java from 3.6.0 to 3.8.0 (#24559)
add d6391231053 Fix some typos (#24736)
add f30ad44761b Adding Setup python to Dataflow job in Java Tests (#24712)
add 2b746d1d217 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#24740)
add 642a16f9a61 Add a couple of well-known Google properties that use Beam
extensively.
add cef0cf74aba Merge pull request #24718 Add a couple of well-known
Google properties that use Beam extensively.
add 0917978677f Refactor focusing to contextLine (#24674)
add b757ad035b9 Support SqlTypes Date in AvroUtils (#24756)
add cb31ea2efcc Fix SingleStoreIO performance test job (#24753)
add b877a6680ca Fix a small wrong url link in notebook (#24746)
add 3b9ab77ef90 Exclude MultimapState related tests in Dataflow legacy
worker validates runner tests (#24758)
add ce5fcac379f [Website] delete 404 links #24745 (#24744)
add 4764f0e2043 [Website] update links with 404 status code
add 3f67b2c0769 Merge pull request #24635: [Website] update links with 404
status code
add f80ac005bfd [Release Tasks Migration] - Git Tag Workflow (#24418)
add 46c77783b1e Fix POM of beam-sdks-java-core (closes #24675)
add eb23b0a123e Merge pull request #24760: Fix POM of beam-sdks-java-core
add 94c6212a38f Change Point Analysis (#23931)
add 97d96558e23 change examples to licensed ones with mentions of autors
and licenses (#24762)
add 9810ff82b75 Implement PubsubWriteSchemaTransformProvider (#24443)
add 28afd035271 [CdapIO] Complete examples for CDAP Hubspot plugins
(#24568)
add 2b6d9dcb425 Fix Permission denied error build beam locally (#24766)
add baa8910694c fix typo: UnmarshallWindowFn should be UnmarshalWindowFn
(#24771)
add 820839fe86b Remove slow review label after processing commands to
avoid race (#24765)
add d72fdecfa3f [BigQueryIO] Don't update schema of destination table when
no schema is provided (#24700)
add ffdd8d47b78 [Playground] Python multifile examples (#24751)
add 59946441269 [CdapIO] Complete examples for CDAP Salesforce plugins
(#24567)
add 44c9d0278c0 Make go vet and go staticcheck output visible in CI
(#24786)
add 96f4391cc61 [Go SDK] Fix multimap support for the direct runner
(#24775)
add bcfdb7b63cd [#24515] Ensure that Go pipelines on Dataflow are not
allowed to opt out of runner v2. (#24767)
add 07b4329b986 Update Java portable container for Dataflow (#24791)
add 46a12bf423d [BigQuery] Extend timestamp precision to microseconds when
writing with Beam Rows (Storage API) (#24784)
add e28f6f79f2b [Spark Dataset runner] Trigger evaluation using write noop
rather than using foreach (closes #24797) (#24565)
add a43b834681f [Website] update check links, catch prod & staging links
add 994f733a409 Merge pull request #22221: [Website] update check-links
add 873e0d0978d [#24292] Create Avro extension for Java SDK
add 8b532db7db0 Address the review comments
add 150877e6494 Apply #24454 changes
add bab773fdcf1 Merge pull request #24294: Create Avro extension for Java
SDK
add 04694d8c886 Install sklearn < 1.20.0 for sklearn postcommit tests
(#24788)
add 645bf35056d [Spark Dataset runner] Skip unconsumed additional outputs
of ParDo.MultiOutput to avoid caching if not necessary (resolves #24710)
(#24711)
add 1e763ad6d18 [Go SDK]: MongoDB IO connector (#24663)
add 177306792ce Better naming and inference for PythonCallable. (#24735)
add 208a14e05b5 [Spark Dataset runner] Reuse SparkSession when testing
using class rule. (#24812)
add 7c736e27b4f [#24515] Ensure that portable Java pipelines on Dataflow
are not able to opt out of runner v2. (#24805)
add 5b80a8141ff 24802 fix missing test resources (#24803)
add c8bf5d55fd1 Add Python xlang KafkaIO performance test (#24633)
add 598324a8847 Shard python precommit (#24204)
add ea6cf404b9f Implement sibling protocol for Typescript.
add c5c5b35c403 Merge pull request #23975 Implement sibling protocol for
Typescript.
add 80de3ef96d7 Refactor integration tests to use internal containers
package (#24823)
add ba3dcd1cb98 [#24789][Go SDK] Fix Minor race conditions (#24808)
add c38074ac024 Various cleanups to the typescript SDK: * Better errors
for bad serialization imports. * Semver-correct version for fake worker
package. * Package source into temporary directory. * Allow "latest" as a
xlang beam jar version for non-released SDKs. * Less verbose logging.
add 4f96e3594ef Add timeout to cross-language tests.
add 3f28d55dbe1 Merge pull request #24825 Various cleanups to the
typescript SDK.
add 0bba43969f6 [#24789] Spot fix fullvalue wrapping for SDF. (#24826)
add 5ab768bc6c1 Add gradle files for typescript containers and update the
version info.
add 5911ea20fc0 Fix issue with typescript sibling sdks.
add a67fc244f97 npm install before build
add 3bd5f780e83 Format go file.
add 889fd8bcdc9 Merge pull request #24827 Add gradle files for typescript
containers and update the version info.
add ad72baceaef Fix Cassandra read bug when user query has no where clause
(fixes #24829) (#24830)
add 3ee5b86a3f1 Retry create database in InfluxDbIOIT (#24800)
add 587e41eccef [Website] update links from absolute to relative in md
files
add 0f423dd6cc1 Merge pull request #24747: [Website] update links from
absolute to relative in md files
add 0d835cdc72f Support SqlTypes Date in AvroUtils (sync)
add 37358ff0196 Merge pull request #24854: Support SqlTypes Date in
AvroUtils (sync)
add b802c023b27 Revert "Shard python precommit (#24204)" (#24855)
add a4cf26fdc99 [Spark Dataset runner] Fix initialization of metrics
accumulator on driver (fixes #24809) (#24810)
add 1b1acb08baf Improve error message (#24843)
add 1fa97825e62 Playground Example CI fix for 24807 (#24819)
add 803bfa6e2b1 Bump github.com/tetratelabs/wazero from 1.0.0-pre.4 to
1.0.0-pre.7 in /sdks (#24858)
add 6d058d9ee47 Fix beam_CleanUpGCPResources job (#24770)
add f9fd293fff3 Set DELETE_BEFORE_DAY in accordance with release period
(#24867)
add 9a22bf68767 adding parameters flag to support schema based transforms
(#24864)
add 2898db97a45 Fix SQLIO Performance Test (#24824)
add 0b8f0b4db7a Reduce redundant Get API call when creating bq temp
dataset (#24831)
add c46c6d373d7 Disable sonarqube cron job (#24769)
add e1daf369e1f Saving empty output and log precompiled objects for
consistency (#24877)
add cf15a803fb5 Playground runners scala update (#24873)
add 0a1778842c2 [#24801] ValueState.read() should specify returning null
since it will if unset (#24869)
add 12f107249b7 Add links to colab/github repo in notebook (#24886)
add 9cd76eaa482 Remove trailing space breaking website blocks (#24875)
add a6e11d63673 Bump google.golang.org/api from 0.105.0 to 0.106.0 in
/sdks (#24891)
add 1f34e8ddb14 [#21391]Increase unit testing coverage in the exec package
(#24772)
add e23b373021b Load categories from BEAM_EXAMPLE_CATEGORIES in checker.py
(#24900)
add c49512298fa Reduce lock contention for metrics hashName hasher (#24881)
add f761b9db367 Bump golang.org/x/text from 0.5.0 to 0.6.0 in /sdks
(#24889)
add 037e9adfbb9 Bump golang.org/x/sys from 0.3.0 to 0.4.0 in /sdks (#24890)
add 884539b9096 Bump github.com/aws/aws-sdk-go from 1.30.19 to 1.33.0 in
/sdks (#24896)
add 174f93b7e7e Bump golang.org/x/net from 0.4.0 to 0.5.0 in /sdks (#24892)
add 691e247633d Print logical identifier in FieldType.toString (#24888)
add 3070160203c Fix PR number in 2.43.0 changelog (#24904)
add 37c7bee5602 Fix poorly formatted metadata (#24905)
add 0e9fe07ea38 Add static override for JDK TLS disabled/legacy algorithms
in Java container (#24619)
add 49dd2df027b Remove shuffle mode=appliance in tests (#24879)
add e7244250908 Sync script for grafana dashboard - github actions
postcommit workflows (#24073)
add f9d30c3fd55 Integration test to load the default example of the
default SDK and change the example (#24731)
add 07ba8f1c6c3 issue23923 emulated data indicator (#24708)
add be5bdbd26c6 Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks
(#24917)
add de3ebdb5bde issue23918 extract java symbols (#24588)
add 5096daafd11 Attempt deserialize all non-standard portable logical
types from proto (#24910)
add 6ad75405c97 TFT Criteo benchmarks (#24382)
add db1f9d23b5f Add thread prefix for StreamingDataflowWorker work executor
add e54871d76f0 Merge pull request #24646: Add thread prefix for
StreamingDataflowWorker work executor
add f9d5de34ae1 update Java version from 11 to 17 (#24839)
add de0cf60eb28 Modify windmill DirectStreamObserver to call isReady only
every 10 messages by default. This provides more output buffering which ensures
that output is not throttled on synchronization when message sizes exceed 32KB
grpc isready limit.
add c162f4c13de Merge pull request #24853: Modify windmill
DirectStreamObserver to call isReady only every 10 messages by default
add a388568da54 [#21384] Add unit tests to the sql package (#24811)
add 95e53916b6c [#24927] Ensure the SDK harness handles JCL/log4j/log4j2
messages. (#24928)
add e4ae50dc019 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in
/sdks (#24915)
add a8037892e6e update Beam GCP BOM (#24929)
add e0f463c69d0 [#24931][Go SDK] Make element checkpoints independant
(#24932)
add 2901af40f31 Update Kafka watermark based on policy when records poll
empty (#24205)
add 0718c5943bc Grafana dashboard - Github actions postcommit workflows
mapping (#24176)
add 1e2b3280b05 Shard Python PreCommit (#24866)
add 7d6d6ded7dc reapply single executor to storage write API writes
(#24950)
add 3838528fde3 [#21368] Clean-up and use the FixedExecutorProvider
(#24952)
add 3d006da5271 Add doLast on Playground integration tests (#24954)
(#24955)
add 8e31f7a5850 JDBC SchemaTransform implementation. Need to break out
into a separat… (#24918)
add 92223e3ea2f [WebSite] Add new Go quickstart (#24885)
add 5a57d3f75ce fix pinning bug in storage-api writes
add c0e689331c2 Merge pull request #24968: Fix pinning bug in storage-api
writes
add ed4cd6052f5 Improve Error Prone configuration
add 89f1b0ff6d4 Update comment
add 3a98ecbdbfa Merge pull request #24930 from cushon/errorprone
add 98aea03e5d0 Bump google.golang.org/grpc from 1.51.0 to 1.52.0 in /sdks
(#24969)
add c3a2aaca750 Bump github.com/containerd/containerd from 1.6.8 to 1.6.12
in /sdks (#24945)
add ad729f762ef [Playground] Add an option for Datastore namespace value
for ci_cd.py script (#24818)
add 9ec68dd3df1 Multifile examples on frontend (#24859) (#24865)
add 6de4d5fa8d0 Return only Playground examples in GetCatalog() (#24816)
add e21b5b79a25 [Website] add credit karma case-study card (#24970)
add ad4410aa23a [Playground] Fix for failing CI/CD in playground (#24984)
add d5d9afd37f7 Add missing dependencies to maven archetype
add 5c27e459e63 Merge pull request #24975 from kileys/maven
add c3d9238d2c7 Improve error message for unencodeable types (#24844)
add 705c151f483 Add single job to run python coverage (#24988)
add 1f02c23b538 Bump cloud.google.com/go/bigquery from 1.44.0 to 1.45.0 in
/sdks (#24913)
add 5cc5b196a40 Bump google.golang.org/api from 0.106.0 to 0.107.0 in
/sdks (#24989)
add a5efba6564d [ToB] [Frontend] Authentication, unit progress, complete
unit, SDK selection (#24457)
add 15f3717a43e Fix example checker validation for incomplete multifile
examples (#24993)
add ffb08ae659e Update beam-master version
add 4c13e14bd52 Merge branch 'master' of github.com:apache/beam into
beam-master
add d21c8b76378 Merge pull request #24990 from kileys/beam-master
add e94aa456fc3 Remove datastore intersphinx_dependency to fix docs job.
(#25000)
add ab4bb553a6c Use CC-BY image for custom remote inference notebook
(#25004)
add 4534904769b Fix kafka performance test write failing due to server
overwhelmed (#24964)
add 7ab334d807e Adding the registered trademark symbol to the Apache Beam
title on the browser tab
add a5e6d90081b Merge pull request #25008 from rszper/rszper-trademark
add 1aa5acc0627 [Spark Dataset runner] Fix SparkSessionFactory to better
support running on a cluster. (#24862)
add 9f7c55f40d3 Bump github.com/dustin/go-humanize from 1.0.0 to 1.0.1 in
/sdks (#25017)
add 39a348ef536 BEAM-13261 added max connections setting
add 351f40393e8 BEAM-13261 updated comment for max connection
add 869150cdd2e Merge pull request #24851: BEAM-13261 added max
connections setting
add 8d4c00ef2c0 Fix incorrect parsing of None value parameters. (#24948)
add bb7b64abac3 Fix PipelineOptionTest.test_display_data (#25007)
add 8cb5145e29d Fix Spark runner dependency (#25040)
add 9eff5f9003f Bump future from 0.18.2 to 0.18.3 in
/sdks/python/container/py39 (#25028)
add 7e370bfee2d Bump torch (#24944)
add 7fd25010bed Set allowDiskUse to true in MongoDB bucketAuto aggregation
(#25013)
add 8b3a0287eb9 Website updates for Beam 2.44.0 release
add 3dcb08510fd Merge pull request #24951: Update website metadata to
2.44.0 and blog post
add 120558cb9f7 add public qualifier
add 5a2a3a4dfb2 Merge pull request #25044: Add public qualifier to
FillGaps methods
add 3aa5d9c7ea9 Add kafka version to pom
add 219f4f1d984 Merge pull request #25043 from kileys/kafka
add f40057b7fb6 Bump json5 from 1.0.1 to 1.0.2 in
/sdks/python/apache_beam/runners/interactive/extensions/apache-beam-jupyterlab-sidepanel
(#24895)
add e22afb090fc Properly synchronize pins
add 6847255514d typo
add 482c3107674 Merge pull request #25047: Properly synchronize pins
add d9d322b5697 enabling public construction of typed schematransforms
(#25010)
add 55d8ecb2584 Add explicit error for PEP 585 type hints (#24986)
add 9f423925e0e Updated Python Container Dependencies (#25042)
add bbbbe9180b4 [ToB][Frontend] Display hints and solutions (#25020)
add aba17525994 upgrade clickhouse jdbc driver 0.3.2-patch10 (#24424)
add 312cbbde8ff Added documentation for SingleStoreIO (#24377)
add d69dbd8b852 Adding watermark support to DebeziumIO transform (#24757)
add f2594c6ecd5 Moving to 2.46.0-SNAPSHOT on master branch.
add b5540403732 Fix typo in join explanation (#25049)
add 6f87445a88b Add withDefaultHeaders to connection configuration for
ElasticsearchIO
add de21be6e180 Address PR comments, run spotless
add a05a9c0d07a Fix copy/paste error in Javadoc, add example for usage of
withDefaultHeaders
add b50b801c442 Merge pull request #25024 from EgbertW/master
add 3b23290c4a3 Fix error message (add proper spacing) (#25050)
add 95874a70e70 Remove trailing whitespace from blog to fix precommit
(#25055)
add 187ba474fdb improve some errors from DoFnSignature (#25001)
add 69a131341c5 Bump torch (#24977)
add aa8dc4fab7e Set maxConnections optional in incoming schema for
JdbcSchemaIOProvider (#25062)
add 6daa6f41017 Document that yield and return shouldn't be mixed. (#25060)
add 13a740b0091 [#25070] Remove Kafka jars from Beam Java SDK Container
(#25072)
add 1c4e4241c2a [Playground][Frontend] Run timer fix; CodeRunner and
OutputType extraction. (#24871)
add 876ce5bcafc Merge pull request #25073: Improves StorageWrite API error
logging
add 60a9382a67f Bump google.golang.org/api from 0.107.0 to 0.108.0 in
/sdks (#25075)
add 80d8d348a39 [Python] Fix input type for num_bytes (#25086)
add 651773129bc Add Pyarrow support to Batched DoFn documentation (#23956)
add 3e1291ca3c1 Tour of beam learning materials CI/CD refactoring and
templating (#25080)
add 6203e58919e Add support for using builtins typing (#25054)
add 641b556958d Bump cloud.google.com/go/spanner from 1.42.0 to 1.43.0 in
/sdks (#25090)
add a99364cd7cf Increase timeout on
test_dynamic_timer_clear_then_set_timer (#25009)
add 76813c11372 Bump torch (#25089)
add 148730e4ac5 Bump timeout for beam_PostCommit_Python_Examples_Dataflow
to 3h (#25092)
add fafeaa989a7 Add unit test to cover non built-in GenericAlias types
(#25091)
add 6b42bda1d06 [Website] update content of community case study page
(#25023)
add 1d4345a3434 Eliminate google-python-cloud-debugger dependency in
base_image_requirements (#25088)
add c1b840ae284 Bump httplib2 upper bound to 0.22.0. (#24573)
add 428ec97e30c improve error message for mismatched pipelines (#24834)
add 18075f5c2e0 Update upper bound for numpy.
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0fa965c68c6)
\
N -- N -- N refs/heads/tvalentyn-patch-3 (18075f5c2e0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/issue-rules.yml | 2 +-
.github/workflows/build_playground_backend.yml | 2 +-
.github/workflows/build_playground_frontend.yml | 2 +-
.github/workflows/git_tag_released_version.yml | 54 +
.github/workflows/go_tests.yml | 14 +-
.github/workflows/java_tests.yml | 74 +-
.github/workflows/playground_deploy_backend.yml | 2 +-
.github/workflows/playground_deploy_examples.yml | 14 +-
.../workflows/playground_examples_cd_reusable.yml | 1 +
.../workflows/playground_examples_ci_reusable.yml | 3 +-
.github/workflows/run_perf_alert_tool.yml | 59 +
.github/workflows/run_rc_validation.yml | 4 +-
.github/workflows/typescript_tests.yml | 1 +
.gitignore | 4 +-
.test-infra/jenkins/README.md | 23 +-
.../job_CloudMLBenchmarkTests_Python.groovy | 54 +
.../jenkins/job_LoadTests_Combine_Python.groovy | 3 +-
.../jenkins/job_LoadTests_GBK_Python.groovy | 3 +-
.../job_LoadTests_GBK_Python_reiterate.groovy | 3 +-
.../jenkins/job_LoadTests_ParDo_Python.groovy | 3 +-
.../jenkins/job_LoadTests_SideInput_Python.groovy | 3 +-
.../job_PerformanceTests_InfluxDBIO_IT.groovy | 56 -
.../jenkins/job_PerformanceTests_KafkaIO_IT.groovy | 11 +-
.../jenkins/job_PerformanceTests_SQLIO_Java.groovy | 8 +-
.../job_PerformanceTests_SingleStoreIO.groovy | 2 +-
...ob_PerformanceTests_xlang_KafkaIO_Python.groovy | 123 +
.../job_PostCommit_Java_InfluxDBIO_IT.groovy | 55 +
.../job_PostCommit_Python_Examples_Dataflow.groovy | 2 +-
.test-infra/jenkins/job_PreCommit_Python.groovy | 3 +
.test-infra/jenkins/job_PreCommit_PythonIT.groovy | 37 +
.../jenkins/job_PreCommit_Python_Coverage.groovy | 37 +
.../jenkins/job_PreCommit_Python_Dataframes.groovy | 40 +
.../jenkins/job_PreCommit_Python_Examples.groovy | 40 +
.../jenkins/job_PreCommit_Python_Runners.groovy | 40 +
.../jenkins/job_PreCommit_Python_Transforms.groovy | 40 +
.test-infra/jenkins/job_sonarqube_report.groovy | 4 +-
.../GA-Post-Commits_status_dashboard.json | 916 ++
.../Java_IO_IT_Tests_Dataflow.json | 70 +-
.../Python_IO_IT_Tests_Dataflow.json | 122 +
.test-infra/metrics/sync/github/sync_workflows.py | 187 +
.test-infra/tools/stale_bq_datasets_cleaner.sh | 22 +-
.../tools/stale_dataflow_prebuilt_image_cleaner.sh | 3 +-
CHANGES.md | 18 +-
CI.md | 6 +
build.gradle.kts | 13 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 61 +-
examples/java/cdap/README.md | 6 +-
examples/java/cdap/hubspot/build.gradle | 112 +
.../cdap/hubspot/CdapHubspotStreamingToTxt.java | 146 +
.../complete/cdap/hubspot/CdapHubspotToTxt.java | 141 +
.../beam/examples/complete/cdap/hubspot/README.md | 110 +
.../complete/cdap/hubspot/TxtToCdapHubspot.java | 128 +
.../cdap/hubspot/options/CdapHubspotOptions.java | 46 +
.../hubspot/options/CdapHubspotSinkOptions.java | 44 +
.../hubspot/options/CdapHubspotSourceOptions.java | 36 +
.../options/CdapHubspotStreamingSourceOptions.java | 38 +
.../cdap/hubspot/options/package-info.java | 20 +
.../complete/cdap/hubspot/package-info.java | 20 +
.../hubspot/transforms/FormatInputTransform.java | 94 +
.../hubspot/transforms/FormatOutputTransform.java | 53 +
.../cdap/hubspot/transforms/package-info.java | 20 +
.../cdap/hubspot/utils/GetOffsetUtils.java | 74 +
.../utils/PluginConfigOptionsConverter.java | 53 +
.../complete/cdap/hubspot/utils/package-info.java | 20 +
.../example-txt-to-cdap-hubspot-companies.txt | 20 +
examples/java/cdap/salesforce/build.gradle | 109 +
.../salesforce/CdapSalesforceStreamingToTxt.java | 154 +
.../cdap/salesforce/CdapSalesforceToTxt.java | 137 +
.../examples/complete/cdap/salesforce/README.md | 123 +
.../cdap/salesforce/TxtToCdapSalesforce.java | 151 +
.../salesforce/options/CdapSalesforceOptions.java | 66 +
.../options/CdapSalesforceSinkOptions.java | 86 +
.../options/CdapSalesforceSourceOptions.java | 44 +
.../CdapSalesforceStreamingSourceOptions.java | 45 +
.../cdap/salesforce/options/package-info.java | 20 +
.../complete/cdap/salesforce/package-info.java | 20 +
.../transforms/FormatInputTransform.java | 106 +
.../transforms/FormatOutputTransform.java | 54 +
.../cdap/salesforce/transforms/package-info.java | 20 +
.../cdap/salesforce/utils/CsvRecordCoder.java | 48 +
.../cdap/salesforce/utils/GetOffsetUtils.java | 80 +
.../utils/PluginConfigOptionsConverter.java | 100 +
.../cdap/salesforce/utils/package-info.java | 20 +
.../example-txt-to-cdap-salesforce-custom.txt | 20 +
examples/java/cdap/servicenow/build.gradle | 2 +-
.../examples/complete/cdap/servicenow/README.md | 6 +-
.../complete/cdap/utils/JsonElementCoder.java | 49 +
examples/java/cdap/zendesk/build.gradle | 2 +-
.../beam/examples/complete/cdap/zendesk/README.md | 6 +-
.../beam-ml/custom_remote_inference.ipynb | 37 +-
.../beam-ml/dataframe_api_preprocessing.ipynb | 16 +
.../notebooks/beam-ml/run_custom_inference.ipynb | 16 +
.../beam-ml/run_inference_multi_model.ipynb | 176 +-
.../notebooks/beam-ml/run_inference_pytorch.ipynb | 17 +
.../run_inference_pytorch_tensorflow_sklearn.ipynb | 17 +
.../notebooks/beam-ml/run_inference_sklearn.ipynb | 17 +
.../beam-ml/run_inference_tensorflow.ipynb | 19 +-
.../beam-ml/run_inference_tensorflow_hub.ipynb | 17 +
.../tour-of-beam/reading-and-writing-data.ipynb | 2 +-
gradle.properties | 4 +-
.../katas/python/IO/TextIO/ReadFromText/task.py | 4 +-
.../Streaming/Triggers/Early Triggers/task.py | 4 +-
.../Streaming/Triggers/Event Time Triggers/task.py | 20 +-
.../Triggers/Window Accumulation Modes/task.py | 4 +-
.../backend/internal/fs_content/load.go | 156 +-
.../backend/internal/fs_content/load_test.go | 67 +
.../samples/learning-content/content-info.yaml | 6 +
.../learning-content/java/content-info.yaml | 4 -
.../java/module 1/module-info.yaml | 7 -
.../java/module 1/unit-challenge/unit-info.yaml | 5 -
.../java/module 1/unit-example/unit-info.yaml | 3 -
.../java/module 2/module-info.yaml | 7 -
.../java/module 2/unit-challenge/unit-info.yaml | 5 -
.../java/module 2/unit-example/unit-info.yaml | 3 -
.../module 1/group/group-info.yaml | 9 +
.../group}/unit-challenge/description.md | 0
.../group}/unit-challenge/hint1.md | 0
.../group}/unit-challenge/hint2.md | 0
.../module 1/group/unit-challenge/unit-info.yaml | 7 +
.../module 1/group/unit-example/unit-info.yaml | 5 +
.../module 1/intro-unit/unit-info.yaml | 5 +
.../learning-content/module 1/module-info.yaml | 13 +
.../unit-challenge/description.md | 0
.../module 2 => module 1}/unit-challenge/hint1.md | 0
.../module 2 => module 1}/unit-challenge/hint2.md | 0
.../module 1/unit-challenge/unit-info.yaml | 7 +
.../module 1/unit-example/unit-info.yaml | 5 +
.../learning-content/module 2/module-info.yaml | 9 +
.../unit-challenge/description.md | 0
.../group => module 2}/unit-challenge/hint1.md | 0
.../group => module 2}/unit-challenge/hint2.md | 0
.../module 2/unit-challenge/unit-info.yaml | 7 +
.../module 2/unit-example/unit-info.yaml | 5 +
.../learning-content/python/content-info.yaml | 3 -
.../python/module 1/group/group-info.yaml | 7 -
.../module 1/group/unit-challenge/unit-info.yaml | 5 -
.../module 1/group/unit-example/unit-info.yaml | 3 -
.../python/module 1/intro-unit/unit-info.yaml | 3 -
.../python/module 1/module-info.yaml | 7 -
learning/tour-of-beam/frontend/README.md | 72 +-
learning/tour-of-beam/frontend/assets/svg/hint.svg | 19 +
.../tour-of-beam/frontend/assets/svg/solution.svg | 20 +
.../frontend/assets/translations/en.yaml | 2 +
.../frontend/lib/assets/assets.gen.dart | 6 +
.../tour-of-beam/frontend/lib/auth/notifier.dart | 45 +
.../tour-of-beam/frontend/lib/cache/cache.dart | 28 +
.../frontend/lib/cache/content_tree.dart | 17 +-
learning/tour-of-beam/frontend/lib/cache/sdk.dart | 13 +-
.../frontend/lib/cache/unit_content.dart | 14 +-
.../frontend/lib/cache/unit_progress.dart | 103 +
.../lib/components/builders/content_tree.dart | 6 +-
.../frontend/lib/components/builders/sdks.dart | 6 +-
.../frontend/lib/components/footer.dart | 6 +-
.../frontend/lib/components/login/button.dart | 46 +
.../frontend/lib/components/login/content.dart | 145 +
.../lib/components/login/login_button.dart | 54 -
.../lib/components/login/login_content.dart | 140 -
.../frontend/lib/components/profile/avatar.dart | 43 +-
.../lib/components/profile/profile_content.dart | 160 -
.../frontend/lib/components/profile/user_menu.dart | 174 +
.../frontend/lib/components/scaffold.dart | 53 +-
.../frontend/lib/components/sdk_dropdown.dart | 20 +-
.../tour-of-beam/frontend/lib/constants/sizes.dart | 2 +-
.../frontend/lib/constants/storage_keys.dart | 21 +
.../frontend/lib/enums/unit_completion.dart | 26 +
.../frontend/lib/firebase_options.dart | 63 +
learning/tour-of-beam/frontend/lib/locator.dart | 14 +-
learning/tour-of-beam/frontend/lib/main.dart | 5 +
.../frontend/lib/models/unit_content.dart | 27 +-
.../frontend/lib/models/unit_content.g.dart | 3 +
.../frontend/lib/models/unit_progress.dart | 35 +
.../frontend/lib/models/unit_progress.g.dart | 13 +
.../lib/pages/tour/controllers/content_tree.dart | 6 +
.../frontend/lib/pages/tour/controllers/unit.dart | 45 +
.../frontend/lib/pages/tour/screen.dart | 28 +-
.../frontend/lib/pages/tour/state.dart | 129 +-
.../lib/pages/tour/widgets/binary_progress.dart | 57 +
.../pages/tour/widgets/complete_unit_button.dart | 68 +
.../frontend/lib/pages/tour/widgets/content.dart | 112 -
.../lib/pages/tour/widgets/content_tree.dart | 1 +
.../lib/pages/tour/widgets/fraction_progress.dart | 51 +
.../lib/pages/tour/widgets/group_title.dart | 65 +-
.../frontend/lib/pages/tour/widgets/hints.dart | 86 +
.../pages/tour/widgets/markdown/code_builder.dart | 60 +
.../pages/tour/widgets/markdown/tob_markdown.dart | 52 +
.../lib/pages/tour/widgets/playground_demo.dart | 1 -
.../lib/pages/tour/widgets/solution_button.dart | 51 +
.../tour/widgets/tour_progress_indicator.dart | 50 -
.../frontend/lib/pages/tour/widgets/unit.dart | 16 +-
.../lib/pages/tour/widgets/unit_content.dart | 216 +-
.../frontend/lib/pages/welcome/screen.dart | 125 +-
.../frontend/lib/pages/welcome/state.dart | 24 +-
.../frontend/lib/repositories/client/client.dart | 5 +
.../client/cloud_functions_client.dart | 37 +
.../models/get_user_progress_response.dart | 33 +
.../models/get_user_progress_response.g.dart | 15 +
learning/tour-of-beam/frontend/lib/state.dart | 58 +
learning/tour-of-beam/frontend/pubspec.lock | 106 +-
learning/tour-of-beam/frontend/pubspec.yaml | 8 +-
.../frontend/test/common/test_screen_wrapper.dart | 40 -
learning/tour-of-beam/frontend/test/main_test.dart | 21 +
.../tour-of-beam/frontend/test/overflow_test.dart | 38 -
.../learning-content/content-info.yaml | 26 +
.../learning-content/go/content-info.yaml | 22 -
.../from-memory/description.md | 56 -
.../from-memory/unit-info.yaml | 22 -
.../creating-collections/group-info.yaml | 25 -
.../reading-from-csv/unit-info.yaml | 22 -
.../reading-from-text/description.md | 41 -
.../reading-from-text/unit-info.yaml | 22 -
.../introduction-concepts/group-info.yaml | 25 -
.../creating-pipeline/description.md | 36 -
.../creating-pipeline/unit-info.yaml | 22 -
.../pipeline-concepts/group-info.yaml | 25 -
.../overview-pipeline/description.md | 43 -
.../overview-pipeline/unit-info.yaml | 21 -
.../setting-pipeline/description.md | 71 -
.../setting-pipeline/unit-info.yaml | 22 -
.../runner-concepts/description.md | 60 -
.../runner-concepts/unit-info.yaml | 21 -
.../introduction/introduction-guide/unit-info.yaml | 21 -
.../introduction/introduction-terms/unit-info.yaml | 21 -
.../go/introduction/module-info.yaml | 27 -
.../from-memory/description.md | 91 +
.../from-memory/go-example}/from_memory.go | 0
.../from-memory/java-example}/from_memory.java | 0
.../from-memory/python-example}/from_memory.py | 0
.../from-memory/unit-info.yaml | 27 +
.../creating-collections/group-info.yaml | 31 +
.../reading-from-csv/description.md | 0
.../reading-from-csv/go-example}/csvExample.go | 0
.../reading-from-csv/java-example}/CSVExample.java | 0
.../reading-from-csv/python-example}/csvExample.py | 0
.../reading-from-csv/unit-info.yaml | 27 +
.../reading-from-text/description.md | 66 +
.../reading-from-text/go-example}/textIo.go | 0
.../java-example}/TextIOExample.java | 0
.../reading-from-text/python-example}/textIo.py | 0
.../reading-from-text/unit-info.yaml | 26 +
.../introduction-concepts/group-info.yaml | 31 +
.../creating-pipeline/description.md | 82 +
.../creating-pipeline/go-example}/main.go | 0
.../creating-pipeline/java-example}/Task.java | 0
.../creating-pipeline/python-example}/task.py | 0
.../creating-pipeline/unit-info.yaml | 27 +
.../pipeline-concepts/group-info.yaml | 29 +
.../overview-pipeline/description.md | 45 +
.../overview-pipeline/unit-info.yaml | 26 +
.../setting-pipeline/description.md | 182 +
.../setting-pipeline/go-example}/main.go | 0
.../setting-pipeline/java-example}/Task.java | 0
.../setting-pipeline/python-example}/task.py | 0
.../setting-pipeline/unit-info.yaml | 27 +
.../runner-concepts/description.md | 529 +
.../runner-concepts/unit-info.yaml | 26 +
.../introduction/introduction-guide/description.md | 0
.../introduction/introduction-guide/unit-info.yaml | 26 +
.../introduction/introduction-terms/description.md | 0
.../introduction/introduction-terms/unit-info.yaml | 26 +
.../learning-content/introduction/module-info.yaml | 30 +
.../learning-content/java/content-info.yaml | 22 -
.../from-memory/description.md | 60 -
.../from-memory/unit-info.yaml | 22 -
.../creating-collections/group-info.yaml | 27 -
.../reading-from-csv/description.md | 35 -
.../reading-from-csv/unit-info.yaml | 22 -
.../reading-from-text/description.md | 42 -
.../reading-from-text/unit-info.yaml | 22 -
.../introduction-concepts/group-info.yaml | 27 -
.../creating-pipeline/description.md | 36 -
.../creating-pipeline/unit-info.yaml | 22 -
.../pipeline-concepts/group-info.yaml | 25 -
.../overview-pipeline/description.md | 42 -
.../overview-pipeline/unit-info.yaml | 21 -
.../setting-pipeline/description.md | 102 -
.../setting-pipeline/unit-info.yaml | 22 -
.../runner-concepts/description.md | 416 -
.../runner-concepts/unit-info.yaml | 21 -
.../introduction/introduction-guide/description.md | 22 -
.../introduction/introduction-guide/unit-info.yaml | 22 -
.../introduction/introduction-terms/description.md | 38 -
.../introduction/introduction-terms/unit-info.yaml | 22 -
.../java/introduction/module-info.yaml | 26 -
.../learning-content/python/content-info.yaml | 22 -
.../from-memory/description.md | 52 -
.../from-memory/unit-info.yaml | 22 -
.../creating-collections/group-info.yaml | 27 -
.../reading-from-csv/description.md | 34 -
.../reading-from-csv/unit-info.yaml | 22 -
.../reading-from-text/description.md | 37 -
.../reading-from-text/unit-info.yaml | 22 -
.../introduction-concepts/group-info.yaml | 27 -
.../creating-pipeline/description.md | 46 -
.../creating-pipeline/unit-info.yaml | 22 -
.../pipeline-concepts/group-info.yaml | 25 -
.../overview-pipeline/description.md | 40 -
.../overview-pipeline/unit-info.yaml | 21 -
.../setting-pipeline/description.md | 88 -
.../setting-pipeline/unit-info.yaml | 22 -
.../runner-concepts/description.md | 127 -
.../runner-concepts/unit-info.yaml | 21 -
.../introduction/introduction-guide/description.md | 22 -
.../introduction/introduction-guide/unit-info.yaml | 22 -
.../introduction/introduction-terms/description.md | 38 -
.../introduction/introduction-terms/unit-info.yaml | 22 -
.../python/introduction/module-info.yaml | 27 -
playground/README.md | 63 +
playground/api/v1/api.proto | 4 +-
playground/backend/cmd/server/controller.go | 52 +-
playground/backend/cmd/server/controller_test.go | 50 +-
playground/backend/configs/SDK_JAVA.json | 1 +
playground/backend/containers/go/build.gradle | 1 +
playground/backend/internal/api/v1/api.pb.go | 863 +-
.../code_processing/code_processing_test.go | 22 +-
.../backend/internal/db/datastore/datastore_db.go | 55 +-
.../internal/db/datastore/datastore_db_test.go | 78 +-
playground/backend/internal/db/db.go | 2 +-
playground/backend/internal/db/entity/common.go | 25 -
playground/backend/internal/db/entity/snippet.go | 5 +
.../environment/environment_service_test.go | 6 +-
.../backend/internal/executors/executor_test.go | 4 +-
playground/backend/internal/fs_tool/fs.go | 18 +-
playground/backend/internal/fs_tool/fs_test.go | 4 +-
.../internal/preparers/java_preparers_test.go | 7 +-
.../setup_tools/life_cycle/life_cycle_setuper.go | 5 +-
.../life_cycle/life_cycle_setuper_test.go | 5 +-
.../backend/internal/tests/test_data/test_data.go | 31 +-
playground/buf.gen.yaml | 6 +
playground/frontend/README.md | 31 +
playground/frontend/assets/drag_horizontal.svg | 23 -
playground/frontend/assets/drag_vertical.svg | 23 -
playground/frontend/assets/streaming.svg | 20 +
playground/frontend/assets/translations/en.yaml | 1 +
playground/frontend/build.gradle | 140 +-
.../frontend/integration_test/common/common.dart | 39 +
.../integration_test/common/common_finders.dart | 99 +
.../miscellaneous_ui/description_test.dart | 47 +
.../miscellaneous_ui/enjoy_playground_test.dart | 102 +
.../miscellaneous_ui/output_placement_test.dart | 45 +
.../miscellaneous_ui/resize_output_test.dart | 103 +
.../miscellaneous_ui/shortcuts_modal_test.dart | 48 +
.../toggle_brightness_mode_test.dart | 41 +
.../standalone_change_example_sdk_run_test.dart | 174 +
.../standalone_miscellaneous_ui_test.dart | 45 +
.../lib/components/banner/banner_button.dart | 7 +-
.../dropdown_button/dropdown_button.dart | 4 +-
.../lib/components/logo/logo_component.dart | 13 +-
playground/frontend/lib/constants/assets.dart | 42 -
playground/frontend/lib/l10n/app_en.arb | 2 +-
playground/frontend/lib/main.dart | 2 +-
.../lib/modules/analytics/analytics_event.dart | 44 +
.../lib/modules/analytics/analytics_service.dart | 3 +
.../analytics/google_analytics_service.dart | 12 +
.../description_popover/description_popover.dart | 11 +-
.../example_list/example_item_actions.dart | 59 +-
.../example_list/expansion_panel_item.dart | 16 +-
.../examples/components/multi_file_icon.dart | 39 +
.../multifile_popover/multifile_popover.dart | 67 -
.../multifile_popover_button.dart | 94 -
.../output_header/output_placements.dart | 1 +
.../modules/output/models/output_placement.dart | 13 +-
.../lib/modules/sdk/components/sdk_selector.dart | 21 +-
.../modules/sdk/components/sdk_selector_row.dart | 5 +-
.../modules/shortcuts/components/shortcut_row.dart | 20 +-
.../shortcuts/components/shortcuts_modal.dart | 1 +
.../shortcuts/constants/global_shortcuts.dart | 2 +-
.../lib/pages/embedded_playground/screen.dart | 28 +-
.../widgets/embedded_actions.dart | 4 +-
.../widgets/embedded_appbar_title.dart | 9 +-
.../widgets/embedded_editor.dart | 3 +-
.../lib/pages/standalone_playground/screen.dart | 18 +-
.../widgets/close_listener.dart | 4 +-
.../widgets/editor_textarea_wrapper.dart | 113 +-
.../feedback/feedback_dropdown_content.dart | 10 +-
.../widgets/feedback/playground_feedback.dart | 18 +-
.../widgets/more_actions.dart | 19 +-
.../widgets/playground_page_body.dart | 27 +-
playground/frontend/lib/src/assets/assets.gen.dart | 127 +
playground/frontend/lib/utils/analytics_utils.dart | 2 +-
.../frontend/playground_components/CHANGELOG.md | 22 -
playground/frontend/playground_components/LICENSE | 407 -
.../frontend/playground_components/README.md | 28 +-
.../playground_components/analysis_options.yaml | 3 -
.../playground_components/assets/symbols/go.g.yaml | 104 +-
.../assets/symbols/java.g.yaml | 13704 +++++++++++++++++++
.../assets/symbols/python.g.yaml | 462 +-
.../playground_components/build.gradle.kts | 5 +
.../lib/playground_components.dart | 20 +-
.../lib/src/api/v1/api.pb.dart | 16 +
.../lib/src/api/v1/api.pbjson.dart | 6 +-
.../lib/src/assets/assets.gen.dart | 3 +
.../lib/src/cache/example_cache.dart | 23 +-
.../lib/src/constants/sizes.dart | 2 +
.../lib/src/controllers/code_runner.dart | 165 +
.../example_loaders/content_example_loader.dart | 2 +-
.../example_loaders/http_example_loader.dart | 5 +-
.../example_loaders/standard_example_loader.dart | 21 +-
.../controllers/output_filter_type_controller.dart | 30 +
.../lib/src/controllers/playground_controller.dart | 286 +-
.../lib/src/controllers/public_notifier.dart | 27 +
.../controllers/snippet_editing_controller.dart | 191 +-
.../snippet_file_editing_controller.dart | 151 +
.../lib/src/enums/emulator_type.dart | 21 +
.../lib/src/models/dataset.dart | 31 +
.../lib/src/models/example.dart | 19 +-
.../lib/src/models/example_base.dart | 9 +
.../content_example_loading_descriptor.dart | 18 +-
.../lib/src/models/example_view_options.dart | 8 +-
.../lib/src/models/outputs.dart | 1 -
.../lib/src/models/snippet_file.dart | 52 +
.../lib/src/models/snippet_file.g.dart | 20 +
.../repositories/code_client/grpc_code_client.dart | 12 +-
.../src/repositories/dataset_grpc_extension.dart | 41 +
.../repositories/emulator_type_grpc_extension.dart | 44 +
.../example_client/grpc_example_client.dart | 52 +-
.../lib/src/repositories/example_repository.dart | 5 +-
.../get_precompiled_object_code_response.dart | 6 +-
.../repositories/models/get_snippet_response.dart | 4 +-
.../src/repositories/models/run_code_request.dart | 12 +-
.../repositories/models/save_snippet_request.dart | 4 +-
.../lib/src/repositories/models/shared_file.dart | 29 -
.../models/snippet_file_grpc_extension.dart | 36 +
.../lib/src/repositories/sdk_grpc_extension.dart | 4 +-
.../lib/src/router/router_delegate.dart | 43 +
.../lib/src/services/symbols/loaders/map.dart | 12 +
.../playground_components/lib/src/theme/theme.dart | 16 +-
.../playground_components/lib/src/util/string.dart | 4 +
.../lib/src/widgets/complexity.dart | 5 +-
.../lib/src/widgets/dismissible_overlay.dart | 43 -
.../lib/src/widgets/editor_textarea.dart | 178 -
.../lib/src/widgets/output/output.dart | 10 +-
.../lib/src/widgets/output/output_area.dart | 62 +-
.../lib/src/widgets/output/output_tab.dart | 10 +-
.../lib/src/widgets/output/output_tabs.dart | 5 +-
.../src/widgets/output/result_filter_bubble.dart | 6 +-
.../src/widgets/output/result_filter_popover.dart | 2 +-
.../lib/src/widgets/overlay/body.dart | 36 +
.../lib/src/widgets/overlay/dismissible.dart | 43 +
.../lib/src/widgets/overlay/opener.dart | 39 +
.../lib/src/widgets/periodic_builder.dart | 61 +
.../lib/src/widgets/run_button.dart | 142 +-
.../lib/src/widgets/run_or_cancel_button.dart | 9 +-
.../lib/src/widgets/snippet_editor.dart | 64 +-
.../lib/src/widgets/snippet_file_editor.dart | 134 +
.../lib/src/widgets/split_view.dart | 20 +-
.../lib/src/widgets/tab_header.dart | 4 +-
.../lib/src/widgets/tabbed_snippet_editor.dart | 81 +
.../lib/src/widgets/tabs/tab_bar.dart | 42 +
.../lib/src/widgets/toasts/toast_listener.dart | 1 +
.../frontend/playground_components/pubspec.yaml | 5 +-
.../test/src/cache/example_cache_test.dart | 41 +-
.../test/src/common/categories.dart | 14 +-
.../test/src/common/descriptors.dart | 12 +-
.../test/src/common/example_cache.mocks.dart | 5 +-
.../test/src/common/example_repository_mock.dart | 17 +-
.../src/common/example_repository_mock.mocks.dart | 27 +-
.../test/src/common/examples.dart | 82 +-
.../test/src/common/requests.dart | 5 +-
.../src/controllers/example_loaders/common.dart | 3 +-
.../examples_loader_test.mocks.dart | 310 +-
.../example_loaders/http_example_loader_test.dart | 2 +-
.../http_example_loader_test.mocks.dart | 5 +-
.../user_shared_example_loader_test.dart | 3 +-
.../controllers/playground_controller_test.dart | 60 +-
.../playground_controller_test.mocks.dart | 5 +-
.../snippet_editing_controller_test.dart | 93 +-
.../content_example_loading_descriptor_test.dart | 9 +-
.../src/repositories/code_repository_test.dart | 4 +-
.../repositories/dataset_grpc_extension_test.dart | 47 +
.../emulator_type_grpc_extension_test.dart | 34 +
.../src/repositories/example_repository_test.dart | 25 +-
.../extract_symbols_java_test.dart | 94 +
.../tools/extract_symbols_java/java.golden.yaml | 13 +
.../sdk_mock/DefaultClass.java | 19 +
.../extract_symbols_java/sdk_mock/KotlinClass.kt | 21 +
.../sdk_mock/PrivateClass.java | 21 +
.../extract_symbols_java/sdk_mock/PublicClass.java | 29 +
.../tools/extract_symbols_java/sdk_mock/Test.java | 20 +
.../sdk_mock/directory/ExtendedPublicClass.java | 26 +
.../sdk_mock/directory/PublicClass.java | 32 +
.../sdk_mock/test/TestFolderPublicClass.java | 24 +
.../tools/extract_symbols_java/build.gradle | 47 +
.../com/playground/extract_symbols/ClassInfo.java | 38 +
.../java/com/playground/extract_symbols/Main.java | 124 +
.../frontend/playground_components_dev/README.md | 23 +
.../analysis_options.yaml | 0
.../lib/playground_components_dev.dart | 27 +
.../playground_components_dev/lib/src/code.dart | 32 +
.../lib/src/common_finders.dart | 66 +
.../lib/src/example_names.dart | 22 +
.../lib/src/example_outputs.dart | 26 +
.../lib/src/example_paths.dart | 29 +
.../lib/src/examples.dart | 35 +
.../playground_components_dev/lib/src/expect.dart | 36 +
.../playground_components_dev/lib/src/finder.dart | 41 +
.../playground_components_dev/lib/src/string.dart | 33 +
.../lib/src/widget_tester.dart | 53 +
.../playground_components_dev/pubspec.yaml | 35 +
playground/frontend/pubspec.lock | 65 +-
playground/frontend/pubspec.yaml | 8 +-
.../messages/models/set_content_message_test.dart | 35 +-
.../frontend/test_driver/integration_test.dart | 0
playground/infrastructure/api/v1/api_pb2.py | 620 +-
playground/infrastructure/api/v1/api_pb2.pyi | 378 +
playground/infrastructure/api/v1/api_pb2_grpc.py | 293 +-
playground/infrastructure/checker.py | 14 +-
playground/infrastructure/ci_cd.py | 25 +-
playground/infrastructure/config.py | 2 +-
playground/infrastructure/conftest.py | 36 +-
playground/infrastructure/datastore_client.py | 85 +-
playground/infrastructure/grpc_client.py | 23 +-
playground/infrastructure/helper.py | 45 +-
playground/infrastructure/models.py | 52 +-
playground/infrastructure/proxy/allow_list.py | 3 +-
playground/infrastructure/requirements.txt | 7 +-
playground/infrastructure/test_checker.py | 19 +-
playground/infrastructure/test_ci_cd.py | 6 +-
playground/infrastructure/test_datastore_client.py | 45 +-
playground/infrastructure/test_helper.py | 110 +-
playground/infrastructure/test_utils.py | 3 +-
playground/infrastructure/verify.py | 4 +-
release/src/main/scripts/set_version.sh | 2 +
runners/google-cloud-dataflow-java/build.gradle | 13 +-
.../beam/runners/dataflow/DataflowRunner.java | 21 +-
.../beam/runners/dataflow/DataflowRunnerTest.java | 57 +
.../dataflow/worker/StreamingDataflowWorker.java | 12 +-
.../options/StreamingDataflowWorkerOptions.java | 9 +
.../worker/windmill/DirectStreamObserver.java | 77 +-
.../worker/windmill/GrpcWindmillServer.java | 3 +-
.../worker/windmill/StreamObserverFactory.java | 12 +-
.../SparkStructuredStreamingPipelineResult.java | 54 +-
.../SparkStructuredStreamingRunner.java | 39 +-
.../metrics/MetricsAccumulator.java | 117 +-
.../MetricsContainerStepMapAccumulator.java | 65 -
.../metrics/SparkBeamMetric.java | 12 +-
.../metrics/SparkBeamMetricSource.java | 4 +-
.../metrics/SparkMetricsContainerStepMap.java | 43 -
.../translation/EvaluationContext.java | 8 +-
.../translation/PipelineTranslator.java | 7 +
.../translation/SparkSessionFactory.java | 104 +-
.../translation/TransformTranslator.java | 5 +
.../batch/DoFnPartitionIteratorFactory.java | 62 +-
.../translation/batch/DoFnRunnerWithMetrics.java | 31 +-
.../translation/batch/ParDoTranslatorBatch.java | 16 +-
.../structuredstreaming/SparkSessionRule.java | 20 +
.../translation/batch/CombineGloballyTest.java | 18 +-
.../batch/CombineGroupedValuesTest.java | 18 +-
.../translation/batch/CombinePerKeyTest.java | 18 +-
.../translation/batch/ComplexSourceTest.java | 17 +-
.../translation/batch/FlattenTest.java | 24 +-
.../translation/batch/GroupByKeyTest.java | 18 +-
.../translation/batch/ParDoTest.java | 69 +-
.../translation/batch/SimpleSourceTest.java | 18 +-
.../translation/batch/WindowAssignTest.java | 18 +-
runners/spark/spark_runner.gradle | 3 +
scripts/ci/pr-bot/processPrUpdate.ts | 19 +-
scripts/ci/pr-bot/shared/persistentState.ts | 12 +-
sdks/go.mod | 55 +-
sdks/go.sum | 117 +-
sdks/go/examples/wasm/wasm.go | 11 +-
sdks/go/pkg/beam/core/core.go | 2 +-
sdks/go/pkg/beam/core/metrics/metrics.go | 22 +-
sdks/go/pkg/beam/core/metrics/metrics_test.go | 38 +-
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 49 +-
.../pkg/beam/core/runtime/exec/datasource_test.go | 155 +-
sdks/go/pkg/beam/core/runtime/exec/plan.go | 25 +-
sdks/go/pkg/beam/core/runtime/exec/plan_test.go | 141 +
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 67 +-
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 30 +
.../pkg/beam/core/runtime/exec/translate_test.go | 198 +-
sdks/go/pkg/beam/core/runtime/exec/unit.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/unit_test.go | 14 +-
.../pkg/beam/core/runtime/exec/userstate_test.go | 65 +
sdks/go/pkg/beam/core/runtime/graphx/coder.go | 5 +-
sdks/go/pkg/beam/core/runtime/graphx/serialize.go | 5 +-
.../pkg/beam/core/runtime/graphx/serialize_test.go | 20 +
sdks/go/pkg/beam/core/runtime/harness/harness.go | 32 +-
sdks/go/pkg/beam/core/sdf/lock.go | 9 +-
sdks/go/pkg/beam/io/mongodbio/coder.go | 68 +
sdks/go/pkg/beam/io/mongodbio/coder_test.go | 160 +
sdks/go/pkg/beam/io/mongodbio/common.go | 73 +
sdks/go/pkg/beam/io/mongodbio/example_test.go | 180 +
sdks/go/pkg/beam/io/mongodbio/helper_test.go | 33 +
sdks/go/pkg/beam/io/mongodbio/read.go | 494 +
sdks/go/pkg/beam/io/mongodbio/read_option.go | 60 +
sdks/go/pkg/beam/io/mongodbio/read_option_test.go | 115 +
sdks/go/pkg/beam/io/mongodbio/read_test.go | 393 +
sdks/go/pkg/beam/io/mongodbio/write.go | 204 +
sdks/go/pkg/beam/io/mongodbio/write_option.go | 50 +
sdks/go/pkg/beam/io/mongodbio/write_option_test.go | 83 +
sdks/go/pkg/beam/io/mongodbio/write_test.go | 54 +
.../beam/io/rtrackers/offsetrange/offsetrange.go | 4 +
sdks/go/pkg/beam/log/log.go | 19 +-
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 65 +-
sdks/go/pkg/beam/runners/dataflow/dataflow_test.go | 159 +-
.../beam/runners/dataflow/dataflowlib/execute.go | 13 +-
.../pkg/beam/runners/dataflow/dataflowlib/job.go | 26 +-
sdks/go/pkg/beam/runners/direct/buffer.go | 17 +-
sdks/go/pkg/beam/runners/direct/direct_test.go | 30 +
sdks/go/pkg/beam/runners/direct/impulse.go | 4 +-
.../beam/runners/universal/extworker/extworker.go | 19 +-
sdks/go/pkg/beam/transforms/sql/sql_test.go | 96 +
sdks/go/pkg/beam/util/structx/struct.go | 19 +
sdks/go/pkg/beam/util/structx/struct_test.go | 60 +
sdks/go/test/build.gradle | 2 -
sdks/go/test/integration/integration.go | 1 +
.../integration/internal/containers/containers.go | 121 +
.../test/integration/io/mongodbio/helper_test.go | 123 +
.../integration/io/mongodbio/mongodbio_test.go | 237 +
.../integration/io/xlang/debezium/debezium_test.go | 44 +-
.../go/test/integration/io/xlang/jdbc/jdbc_test.go | 75 +-
.../test/integration/primitives/checkpointing.go | 2 -
sdks/go/test/run_validatesrunner_tests.sh | 16 +-
sdks/java/container/Dockerfile | 8 +-
sdks/java/container/boot.go | 5 +-
sdks/java/container/build.gradle | 12 +-
sdks/java/container/common.gradle | 11 +-
.../container/java11/java11-security.properties | 47 +
.../container/java11/option-java11-security.json | 9 +
.../container/java17/java17-security.properties | 47 +
.../container/java17/option-java17-security.json | 9 +
.../java/container/java8/java8-security.properties | 47 +
.../container/java8/option-java8-security.json | 9 +
.../container/license_scripts/dep_urls_java.yaml | 2 +-
sdks/java/core/build.gradle | 9 +-
.../org/apache/beam/sdk/io/BlockBasedSource.java | 4 +-
.../apache/beam/sdk/io/DefaultFilenamePolicy.java | 2 +-
.../beam/sdk/io/ReadAllViaFileBasedSource.java | 2 +-
.../java/org/apache/beam/sdk/schemas/Schema.java | 7 +
.../apache/beam/sdk/schemas/SchemaTranslation.java | 53 +-
.../apache/beam/sdk/schemas/utils/AvroUtils.java | 10 +-
.../java/org/apache/beam/sdk/state/ValueState.java | 12 +-
.../sdk/transforms/reflect/DoFnSignatures.java | 13 +-
.../main/java/org/apache/beam/sdk/values/Row.java | 7 +-
.../apache/beam/sdk/SdkHarnessEnvironmentTest.java | 130 +
.../beam/sdk/schemas/SchemaTranslationTest.java | 46 +
.../beam/sdk/schemas/utils/AvroUtilsTest.java | 20 +
.../org/apache/beam/sdk/testing/ExpectedLogs.java | 27 +-
sdks/java/extensions/avro/build.gradle | 56 +
.../beam/sdk/extensions/avro/coders/AvroCoder.java | 820 ++
.../extensions/avro/coders/AvroGenericCoder.java | 32 +
.../sdk/extensions/avro/coders/package-info.java | 29 +
.../apache/beam/sdk/extensions/avro/io/AvroIO.java | 2043 +++
.../extensions/avro/io/AvroSchemaIOProvider.java | 150 +
.../beam/sdk/extensions/avro/io/AvroSink.java | 161 +
.../beam/sdk/extensions/avro/io/AvroSource.java | 777 ++
.../avro/io/ConstantAvroDestination.java | 148 +
.../avro/io/DynamicAvroDestinations.java | 55 +
.../avro/io/SerializableAvroCodecFactory.java | 112 +
.../beam/sdk/extensions/avro/io/package-info.java | 26 +
.../extensions/avro/schemas/AvroRecordSchema.java | 64 +
.../io/payloads/AvroPayloadSerializerProvider.java | 44 +
.../avro/schemas/io/payloads/package-info.java | 27 +
.../sdk/extensions/avro/schemas/package-info.java | 29 +
.../avro/schemas/utils/AvroByteBuddyUtils.java | 142 +
.../extensions/avro/schemas/utils/AvroUtils.java | 1382 ++
.../avro/schemas/utils/package-info.java | 26 +
.../apache/beam/sdk/extensions/avro/io/user.avsc | 10 +
.../beam/sdk/extensions/avro/schemas/test.avsc | 30 +
.../sdk/extensions/avro/coders/AvroCoderTest.java | 1108 ++
.../extensions/avro/coders/AvroCoderTestPojo.java | 51 +
.../beam/sdk/extensions/avro/io/AvroIOTest.java | 1587 +++
.../avro/io/AvroSchemaIOProviderTest.java | 174 +
.../sdk/extensions/avro/io/AvroSourceTest.java | 846 ++
.../avro/io/SerializableAvroCodecFactoryTest.java | 93 +
.../extensions/avro/schemas/AvroSchemaTest.java | 497 +
.../io/AvroPayloadSerializerProviderTest.java | 64 +
.../avro/schemas/utils/AvroGenerators.java | 220 +
.../avro/schemas/utils/AvroUtilsTest.java | 915 ++
.../provider/bigquery/BigQueryIOPushDownIT.java | 11 +-
.../meta/provider/bigquery/BigQueryPerfTable.java | 7 +-
.../beam/sdk/extensions/timeseries/FillGaps.java | 8 +-
sdks/java/harness/jmh/build.gradle | 6 +-
.../fn/harness/jmh/ProcessBundleBenchmark.java | 29 +-
.../beam/sdk/bigqueryioperftests/BigQueryIOIT.java | 4 +-
.../org/apache/beam/sdk/io/cassandra/ReadFn.java | 5 +-
.../beam/sdk/io/cassandra/CassandraIOTest.java | 41 +-
sdks/java/io/clickhouse/build.gradle | 4 +-
.../beam/sdk/io/clickhouse/ClickHouseIO.java | 51 +-
.../beam/sdk/io/clickhouse/ClickHouseWriter.java | 51 +-
.../apache/beam/sdk/io/clickhouse/TableSchema.java | 61 +-
.../beam/sdk/io/clickhouse/AtomicInsertTest.java | 4 +-
.../beam/sdk/io/clickhouse/BaseClickHouseTest.java | 89 +-
.../beam/sdk/io/clickhouse/TableSchemaTest.java | 5 +-
sdks/java/io/debezium/build.gradle | 1 +
.../org/apache/beam/io/debezium/Connectors.java | 11 +-
.../org/apache/beam/io/debezium/DebeziumIO.java | 58 +-
.../DebeziumReadSchemaTransformProvider.java | 227 +
.../apache/beam/io/debezium/KafkaConnectUtils.java | 59 +
.../beam/io/debezium/KafkaSourceConsumerFn.java | 176 +-
.../io/debezium/DebeziumIOMySqlConnectorIT.java | 122 +
.../debezium/DebeziumIOPostgresSqlConnectorIT.java | 99 +-
.../debezium/DebeziumReadSchemaTransformTest.java | 214 +
.../beam/io/debezium/KafkaConnectSchemaTest.java | 11 +
.../io/debezium/KafkaSourceConsumerFnTest.java | 22 +-
.../apache/beam/io/debezium/OffsetTrackerTest.java | 9 +-
.../elasticsearch-tests-5/build.gradle | 14 +-
.../elasticsearch-tests-6/build.gradle | 14 +-
.../elasticsearch-tests-7/build.gradle | 14 +-
.../elasticsearch-tests-8/build.gradle | 14 +-
.../elasticsearch-tests-common/build.gradle | 14 +-
.../beam/sdk/io/elasticsearch/ElasticsearchIO.java | 62 +-
.../beam/sdk/io/gcp/bigquery/BatchLoads.java | 10 +-
.../io/gcp/bigquery/BeamRowToStorageApiProto.java | 4 +-
.../sdk/io/gcp/bigquery/BigQueryServicesImpl.java | 5 +
.../beam/sdk/io/gcp/bigquery/BigQueryUtils.java | 1 +
.../gcp/bigquery/DynamicDestinationsHelpers.java | 2 +-
.../bigquery/StorageApiWriteUnshardedRecords.java | 32 +-
.../bigquery/StorageApiWritesShardedRecords.java | 24 +-
.../io/gcp/bigquery/UpdateSchemaDestination.java | 9 +-
...ueryStorageWriteApiSchemaTransformProvider.java | 303 +
.../beam/sdk/io/gcp/pubsub/PubsubClient.java | 107 +
.../beam/sdk/io/gcp/pubsub/PubsubGrpcClient.java | 85 +
.../beam/sdk/io/gcp/pubsub/PubsubJsonClient.java | 42 +
.../beam/sdk/io/gcp/pubsub/PubsubRowToMessage.java | 17 +-
.../PubsubSchemaTransformWriteConfiguration.java | 104 -
.../beam/sdk/io/gcp/pubsub/PubsubTestClient.java | 81 +
.../PubsubWriteSchemaTransformConfiguration.java | 212 +
.../pubsub/PubsubWriteSchemaTransformProvider.java | 444 +
.../PubsubLiteWriteSchemaTransformProvider.java | 2 +-
.../gcp/bigquery/BeamRowToStorageApiProtoTest.java | 10 +-
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 57 +
...StorageWriteApiSchemaTransformProviderTest.java | 142 +
.../beam/sdk/io/gcp/pubsub/PubsubClientTest.java | 112 +
.../sdk/io/gcp/pubsub/PubsubGrpcClientTest.java | 168 +
.../sdk/io/gcp/pubsub/PubsubJsonClientTest.java | 100 +
.../sdk/io/gcp/pubsub/PubsubRowToMessageTest.java | 104 +-
.../beam/sdk/io/gcp/pubsub/PubsubSchemaIT.java | 167 +
.../PubsubWriteSchemaTransformProviderIT.java | 180 +
.../PubsubWriteSchemaTransformProviderTest.java | 786 ++
.../sdk/io/hadoop/format/HadoopFormatIOIT.java | 4 +-
.../apache/beam/sdk/io/influxdb/InfluxDbIOIT.java | 24 +-
.../java/org/apache/beam/sdk/io/jdbc/JdbcIO.java | 32 +-
.../io/jdbc/JdbcReadSchemaTransformProvider.java | 216 +
.../beam/sdk/io/jdbc/JdbcSchemaIOProvider.java | 8 +
.../io/jdbc/JdbcWriteSchemaTransformProvider.java | 226 +
.../java/org/apache/beam/sdk/io/jdbc/JdbcIOIT.java | 4 +-
.../jdbc/JdbcReadSchemaTransformProviderTest.java | 146 +
.../jdbc/JdbcWriteSchemaTransformProviderTest.java | 129 +
sdks/java/io/kafka/build.gradle | 9 +-
.../org/apache/beam/sdk/io/kafka/KafkaWriter.java | 9 +-
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 24 +-
.../org/apache/beam/sdk/io/kafka/KafkaIOIT.java | 101 +-
...ingleStoreSchemaTransformReadConfiguration.java | 2 +-
...ngleStoreSchemaTransformWriteConfiguration.java | 2 +-
sdks/java/maven-archetypes/examples/build.gradle | 1 +
.../src/main/resources/archetype-resources/pom.xml | 14 +
.../maven-archetypes/gcp-bom-examples/build.gradle | 1 +
.../src/main/resources/archetype-resources/pom.xml | 13 +
.../examples/complete/game/user_score.py | 5 +-
.../anomaly_detection_pipeline/setup.py | 2 +-
.../large_language_modeling/requirements.txt | 2 +-
.../inference/runinference_metrics/setup.py | 2 +-
.../apache_beam/examples/snippets/snippets.py | 2 +-
.../io/external/xlang_kafkaio_perf_test.py | 140 +
.../python/apache_beam/io/filebasedio_perf_test.py | 2 +
sdks/python/apache_beam/io/gcp/bigquery_test.py | 8 +
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 39 +-
.../apache_beam/ml/inference/sklearn_inference.py | 2 +-
.../apache_beam/ml/inference/tensorrt_inference.py | 4 +-
.../python/apache_beam/options/pipeline_options.py | 4 +
.../apache_beam/options/pipeline_options_test.py | 14 +-
.../apache-beam-jupyterlab-sidepanel/yarn.lock | 19 +-
.../python/apache_beam/testing/analyzers/README.md | 97 +
.../apache_beam/testing/analyzers}/__init__.py | 0
.../testing/analyzers/analyze_metric_data.ipynb | 172 +
.../apache_beam/testing/analyzers/constants.py | 68 +
.../testing/analyzers/github_issues_utils.py | 196 +
.../apache_beam/testing/analyzers/perf_analysis.py | 192 +
.../testing/analyzers/perf_analysis_test.py | 198 +
.../testing/analyzers/perf_analysis_utils.py | 214 +
.../testing/analyzers/tests_config.yaml | 37 +
.../testing/benchmarks/cloudml}/__init__.py | 0
.../cloudml/cloudml_benchmark_constants_lib.py | 29 +
.../benchmarks/cloudml/cloudml_benchmark_test.py | 90 +
.../benchmarks/cloudml/criteo_tft}/__init__.py | 0
.../benchmarks/cloudml/criteo_tft/criteo.py | 158 +
.../benchmarks/cloudml/pipelines}/__init__.py | 0
.../benchmarks/cloudml/pipelines/workflow.py | 215 +
.../testing/benchmarks/cloudml/requirements.txt | 19 +
.../testing/load_tests/load_test_metrics_utils.py | 56 +-
.../apache_beam/transforms/userstate_test.py | 2 +-
sdks/python/apache_beam/transforms/util.py | 4 +-
.../typehints/native_type_compatibility.py | 27 +
.../typehints/native_type_compatibility_test.py | 42 +
.../apache_beam/typehints/trivial_inference.py | 11 +-
.../typehints/trivial_inference_test.py | 7 +
sdks/python/apache_beam/typehints/typehints.py | 9 +-
.../python/apache_beam/typehints/typehints_test.py | 51 +
sdks/python/apache_beam/utils/python_callable.py | 13 +
.../apache_beam/utils/python_callable_test.py | 9 +
sdks/python/apache_beam/version.py | 2 +-
.../container/base_image_requirements_manual.txt | 7 +-
.../container/py310/base_image_requirements.txt | 68 +-
.../container/py37/base_image_requirements.txt | 73 +-
.../container/py38/base_image_requirements.txt | 78 +-
.../container/py39/base_image_requirements.txt | 77 +-
sdks/python/pytest.ini | 2 +
sdks/python/scripts/generate_pydoc.sh | 3 +-
sdks/python/scripts/run_integration_test.sh | 2 -
sdks/python/scripts/run_pytest.sh | 5 +
sdks/python/setup.py | 6 +-
sdks/python/test-suites/dataflow/build.gradle | 6 +
sdks/python/test-suites/dataflow/common.gradle | 34 +
sdks/python/test-suites/direct/common.gradle | 8 +
sdks/python/test-suites/gradle.properties | 3 +-
sdks/python/test-suites/tox/common.gradle | 19 +-
sdks/python/test-suites/tox/py37/build.gradle | 6 +-
sdks/python/test-suites/tox/py38/build.gradle | 75 +-
sdks/python/tox.ini | 8 +-
sdks/typescript/Dockerfile | 36 -
sdks/typescript/boot.go | 173 -
sdks/typescript/build.gradle | 67 +
sdks/typescript/build.sh | 5 +
sdks/typescript/build_container.sh | 24 -
sdks/typescript/container/Dockerfile | 33 +
sdks/typescript/container/boot.go | 183 +
sdks/typescript/container/build.gradle | 79 +
sdks/typescript/package-lock.json | 11 +-
sdks/typescript/package.json | 6 +-
.../src/apache_beam/internal/environments.ts | 8 +-
.../typescript/src/apache_beam/runners/dataflow.ts | 4 +-
sdks/typescript/src/apache_beam/runners/flink.ts | 2 +-
.../apache_beam/runners/portable_runner/runner.ts | 23 +-
sdks/typescript/src/apache_beam/utils/service.ts | 56 +-
sdks/typescript/src/apache_beam/version.ts | 26 -
sdks/typescript/src/apache_beam/worker/data.ts | 1 -
.../typescript/src/apache_beam/worker/operators.ts | 1 -
.../src/apache_beam/worker/worker_main.ts | 16 +-
settings.gradle.kts | 6 +
website/www/check-links.sh | 91 +-
website/www/site/assets/scss/_case_study.scss | 13 +
website/www/site/config.toml | 2 +-
website/www/site/content/en/_index.md | 2 +-
.../www/site/content/en/blog/ApachePlayground.md | 8 +-
.../content/en/blog/adding-data-sources-to-sql.md | 2 +-
website/www/site/content/en/blog/beam-2.21.0.md | 4 +-
website/www/site/content/en/blog/beam-2.25.0.md | 4 +-
website/www/site/content/en/blog/beam-2.32.0.md | 6 +-
website/www/site/content/en/blog/beam-2.38.0.md | 2 +-
website/www/site/content/en/blog/beam-2.42.0.md | 2 +-
website/www/site/content/en/blog/beam-2.43.0.md | 2 +-
website/www/site/content/en/blog/beam-2.44.0.md | 251 +
website/www/site/content/en/blog/beam-2.8.0.md | 2 +-
.../content/en/blog/beam-katas-kotlin-release.md | 4 +-
.../content/en/blog/beam-sql-with-notebooks.md | 8 +-
.../site/content/en/blog/beam-starter-projects.md | 2 +-
.../content/en/blog/beam-summit-europe-2019.md | 4 +-
.../en/blog/dataframe-api-preview-available.md | 6 +-
website/www/site/content/en/blog/go-2.40.md | 12 +-
website/www/site/content/en/blog/gsoc-19.md | 4 +-
website/www/site/content/en/blog/hop-web-cloud.md | 6 +-
.../content/en/blog/kafka-to-pubsub-example.md | 6 +-
website/www/site/content/en/blog/ml-resources.md | 8 +-
.../content/en/blog/python-improved-annotations.md | 4 +-
.../python-performance-runtime-type-checking.md | 2 +-
website/www/site/content/en/blog/python-typing.md | 4 +-
.../en/blog/review-input-streaming-connectors.md | 2 +-
website/www/site/content/en/blog/season-of-docs.md | 6 +-
.../en/blog/splittable-do-fn-is-available.md | 4 +-
.../www/site/content/en/case-studies/android.md | 18 +
website/www/site/content/en/case-studies/calico.md | 16 +
website/www/site/content/en/case-studies/chrome.md | 18 +
.../site/content/en/case-studies/creditKarma.md | 256 +
.../www/site/content/en/case-studies/deepmind.md | 16 +
website/www/site/content/en/case-studies/fitbit.md | 18 +
.../www/site/content/en/case-studies/googleplay.md | 18 +
website/www/site/content/en/case-studies/hop.md | 2 +-
website/www/site/content/en/case-studies/nest.md | 16 +
.../www/site/content/en/case-studies/paloalto.md | 14 +-
.../www/site/content/en/case-studies/ricardo.md | 4 +-
website/www/site/content/en/case-studies/seznam.md | 8 +-
.../www/site/content/en/case-studies/snowflake.md | 2 +-
website/www/site/content/en/case-studies/verily.md | 16 +
website/www/site/content/en/case-studies/waymo.md | 16 +
.../www/site/content/en/case-studies/youtube.md | 18 +
.../www/site/content/en/community/case-study.md | 5 +-
website/www/site/content/en/community/in-person.md | 2 +-
website/www/site/content/en/contribute/_index.md | 16 +-
.../en/contribute/get-started-contributing.md | 34 +-
.../content/en/contribute/postcommits-policies.md | 2 +-
.../en/contribute/precommit-triage-guide.md | 4 +-
.../site/content/en/contribute/release-guide.md | 4 +-
.../www/site/content/en/contribute/runner-guide.md | 2 +-
.../dsls/dataframes/differences-from-pandas.md | 8 +-
.../en/documentation/dsls/dataframes/overview.md | 8 +-
.../dsls/sql/extensions/create-external-table.md | 2 +-
.../content/en/documentation/io/built-in/cdap.md | 2 +-
.../en/documentation/io/built-in/singlestore.md | 223 +
.../en/documentation/io/built-in/snowflake.md | 16 +-
.../en/documentation/io/built-in/sparkreceiver.md | 2 +-
.../site/content/en/documentation/io/connectors.md | 21 +-
.../content/en/documentation/ml/data-processing.md | 4 +-
.../en/documentation/ml/large-language-modeling.md | 2 +-
.../en/documentation/ml/multi-model-pipelines.md | 6 +-
.../en/documentation/ml/online-clustering.md | 4 +-
.../content/en/documentation/ml/orchestration.md | 2 +-
.../site/content/en/documentation/ml/overview.md | 6 +-
.../en/documentation/ml/runinference-metrics.md | 2 +-
.../site/content/en/documentation/patterns/bqml.md | 2 +-
...lements-for-efficient-external-service-calls.md | 2 +-
.../content/en/documentation/programming-guide.md | 343 +-
.../content/en/documentation/runners/direct.md | 2 +-
.../site/content/en/documentation/runners/spark.md | 2 +-
.../site/content/en/documentation/runtime/model.md | 2 +-
.../sdks/java-multi-language-pipelines.md | 4 +-
.../documentation/sdks/python-machine-learning.md | 4 +-
.../sdks/python-pipeline-dependencies.md | 2 +-
.../en/documentation/sdks/python-streaming.md | 4 +-
.../java/aggregation/approximatequantiles.md | 2 +-
.../java/aggregation/approximateunique.md | 2 +-
.../transforms/java/aggregation/cogroupbykey.md | 2 +-
.../transforms/java/aggregation/combine.md | 2 +-
.../java/aggregation/combinewithcontext.md | 2 +-
.../transforms/java/aggregation/count.md | 2 +-
.../transforms/java/aggregation/distinct.md | 2 +-
.../transforms/java/aggregation/groupbykey.md | 2 +-
.../java/aggregation/groupintobatches.md | 2 +-
.../transforms/java/aggregation/hllcount.md | 2 +-
.../transforms/java/aggregation/latest.md | 2 +-
.../transforms/java/aggregation/max.md | 2 +-
.../transforms/java/aggregation/mean.md | 2 +-
.../transforms/java/aggregation/min.md | 2 +-
.../transforms/java/aggregation/sample.md | 2 +-
.../transforms/java/aggregation/sum.md | 2 +-
.../transforms/java/aggregation/top.md | 2 +-
.../transforms/java/elementwise/filter.md | 2 +-
.../transforms/java/elementwise/flatmapelements.md | 2 +-
.../transforms/java/elementwise/keys.md | 2 +-
.../transforms/java/elementwise/kvswap.md | 2 +-
.../transforms/java/elementwise/mapelements.md | 2 +-
.../transforms/java/elementwise/pardo.md | 2 +-
.../transforms/java/elementwise/partition.md | 2 +-
.../transforms/java/elementwise/regex.md | 2 +-
.../transforms/java/elementwise/reify.md | 2 +-
.../transforms/java/elementwise/tostring.md | 2 +-
.../transforms/java/elementwise/values.md | 2 +-
.../transforms/java/elementwise/withkeys.md | 2 +-
.../transforms/java/elementwise/withtimestamps.md | 2 +-
.../documentation/transforms/java/other/create.md | 2 +-
.../documentation/transforms/java/other/flatten.md | 2 +-
.../documentation/transforms/java/other/passert.md | 2 +-
.../en/documentation/transforms/java/other/view.md | 2 +-
.../documentation/transforms/java/other/window.md | 2 +-
.../transforms/python/elementwise/pardo.md | 2 +-
.../transforms/python/other/create.md | 2 +-
.../transforms/python/other/flatten.md | 2 +-
.../transforms/python/other/reshuffle.md | 2 +-
.../transforms/python/other/windowinto.md | 2 +-
.../www/site/content/en/get-started/downloads.md | 14 +-
.../www/site/content/en/get-started/from-spark.md | 4 +-
.../en/get-started/mobile-gaming-example.md | 2 +-
.../site/content/en/get-started/quickstart-go.md | 4 +-
.../site/content/en/get-started/quickstart-java.md | 2 +-
.../site/content/en/get-started/quickstart-py.md | 2 +-
.../site/content/en/get-started/quickstart/go.md | 193 +
.../site/content/en/get-started/quickstart/java.md | 10 +-
.../en/get-started/resources/learning-resources.md | 28 +-
.../get-started/resources/videos-and-podcasts.md | 1 +
.../site/content/en/get-started/tour-of-beam.md | 2 +-
.../site/content/en/get-started/try-apache-beam.md | 2 +-
.../content/en/get-started/wordcount-example.md | 4 +-
.../content/en/roadmap/connectors-multi-sdk.md | 4 +-
website/www/site/data/en/quotes.yaml | 7 +-
.../partials/section-menu/en/documentation.html | 4 +-
.../partials/section-menu/en/get-started.html | 3 +-
.../case-study/credit_karma/avneesh_pratap.jpeg | Bin 0 -> 58754 bytes
.../case-study/credit_karma/raj_katakam.jpeg | Bin 0 -> 55475 bytes
.../images/case-study/credit_karma/scheme-2.png | Bin 0 -> 33824 bytes
.../images/case-study/credit_karma/scheme-3.png | Bin 0 -> 20122 bytes
.../images/case-study/credit_karma/scheme-4.png | Bin 0 -> 17228 bytes
.../images/case-study/credit_karma/scheme-5.png | Bin 0 -> 38671 bytes
.../static/images/logos/powered-by/android.png | Bin 0 -> 16006 bytes
.../site/static/images/logos/powered-by/calico.png | Bin 0 -> 20705 bytes
.../site/static/images/logos/powered-by/chrome.png | Bin 0 -> 14345 bytes
.../images/logos/powered-by/credit-karma.png | Bin 0 -> 17972 bytes
.../static/images/logos/powered-by/deepmind.png | Bin 0 -> 12615 bytes
.../site/static/images/logos/powered-by/fitbit.png | Bin 0 -> 4274 bytes
.../static/images/logos/powered-by/googleplay.png | Bin 0 -> 7293 bytes
.../site/static/images/logos/powered-by/nest.png | Bin 0 -> 40723 bytes
.../site/static/images/logos/powered-by/verily.png | Bin 0 -> 13819 bytes
.../site/static/images/logos/powered-by/waymo.png | Bin 0 -> 13028 bytes
.../static/images/logos/powered-by/youtube.png | Bin 0 -> 5669 bytes
983 files changed, 55426 insertions(+), 9843 deletions(-)
create mode 100644 .github/workflows/git_tag_released_version.yml
create mode 100644 .github/workflows/run_perf_alert_tool.yml
create mode 100644 .test-infra/jenkins/job_CloudMLBenchmarkTests_Python.groovy
delete mode 100644
.test-infra/jenkins/job_PerformanceTests_InfluxDBIO_IT.groovy
create mode 100644
.test-infra/jenkins/job_PerformanceTests_xlang_KafkaIO_Python.groovy
create mode 100644 .test-infra/jenkins/job_PostCommit_Java_InfluxDBIO_IT.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_PythonIT.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_Python_Coverage.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_Python_Dataframes.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_Python_Examples.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_Python_Runners.groovy
create mode 100644 .test-infra/jenkins/job_PreCommit_Python_Transforms.groovy
create mode 100644
.test-infra/metrics/grafana/dashboards/GA-Post-Commits_status_dashboard.json
create mode 100644 .test-infra/metrics/sync/github/sync_workflows.py
create mode 100644 examples/java/cdap/hubspot/build.gradle
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/CdapHubspotStreamingToTxt.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/CdapHubspotToTxt.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/README.md
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/TxtToCdapHubspot.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/options/CdapHubspotOptions.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/options/CdapHubspotSinkOptions.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/options/CdapHubspotSourceOptions.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/options/CdapHubspotStreamingSourceOptions.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/options/package-info.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/package-info.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/transforms/FormatInputTransform.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/transforms/FormatOutputTransform.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/transforms/package-info.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/utils/GetOffsetUtils.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/utils/PluginConfigOptionsConverter.java
create mode 100644
examples/java/cdap/hubspot/src/main/java/org/apache/beam/examples/complete/cdap/hubspot/utils/package-info.java
create mode 100644
examples/java/cdap/hubspot/src/test/resources/example-txt-to-cdap-hubspot-companies.txt
create mode 100644 examples/java/cdap/salesforce/build.gradle
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/CdapSalesforceStreamingToTxt.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/CdapSalesforceToTxt.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/README.md
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/TxtToCdapSalesforce.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/options/CdapSalesforceOptions.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/options/CdapSalesforceSinkOptions.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/options/CdapSalesforceSourceOptions.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/options/CdapSalesforceStreamingSourceOptions.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/options/package-info.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/package-info.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/transforms/FormatInputTransform.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/transforms/FormatOutputTransform.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/transforms/package-info.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/utils/CsvRecordCoder.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/utils/GetOffsetUtils.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/utils/PluginConfigOptionsConverter.java
create mode 100644
examples/java/cdap/salesforce/src/main/java/org/apache/beam/examples/complete/cdap/salesforce/utils/package-info.java
create mode 100644
examples/java/cdap/salesforce/src/test/resources/example-txt-to-cdap-salesforce-custom.txt
create mode 100644
examples/java/cdap/src/main/java/org/apache/beam/examples/complete/cdap/utils/JsonElementCoder.java
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/content-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/java/content-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/java/module
1/module-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/java/module
1/unit-challenge/unit-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/java/module
1/unit-example/unit-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/java/module
2/module-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/java/module
2/unit-challenge/unit-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/java/module
2/unit-example/unit-info.yaml
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
1/group/group-info.yaml
rename learning/tour-of-beam/backend/samples/learning-content/{java/module 1
=> module 1/group}/unit-challenge/description.md (100%)
rename learning/tour-of-beam/backend/samples/learning-content/{java/module 1
=> module 1/group}/unit-challenge/hint1.md (100%)
rename learning/tour-of-beam/backend/samples/learning-content/{java/module 1
=> module 1/group}/unit-challenge/hint2.md (100%)
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
1/group/unit-challenge/unit-info.yaml
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
1/group/unit-example/unit-info.yaml
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
1/intro-unit/unit-info.yaml
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module 1/module-info.yaml
rename learning/tour-of-beam/backend/samples/learning-content/{java/module 2
=> module 1}/unit-challenge/description.md (100%)
rename learning/tour-of-beam/backend/samples/learning-content/{java/module 2
=> module 1}/unit-challenge/hint1.md (100%)
rename learning/tour-of-beam/backend/samples/learning-content/{java/module 2
=> module 1}/unit-challenge/hint2.md (100%)
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
1/unit-challenge/unit-info.yaml
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
1/unit-example/unit-info.yaml
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module 2/module-info.yaml
rename learning/tour-of-beam/backend/samples/learning-content/{python/module
1/group => module 2}/unit-challenge/description.md (100%)
rename learning/tour-of-beam/backend/samples/learning-content/{python/module
1/group => module 2}/unit-challenge/hint1.md (100%)
rename learning/tour-of-beam/backend/samples/learning-content/{python/module
1/group => module 2}/unit-challenge/hint2.md (100%)
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
2/unit-challenge/unit-info.yaml
create mode 100644
learning/tour-of-beam/backend/samples/learning-content/module
2/unit-example/unit-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/python/content-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/python/module
1/group/group-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/python/module
1/group/unit-challenge/unit-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/python/module
1/group/unit-example/unit-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/python/module
1/intro-unit/unit-info.yaml
delete mode 100644
learning/tour-of-beam/backend/samples/learning-content/python/module
1/module-info.yaml
create mode 100644 learning/tour-of-beam/frontend/assets/svg/hint.svg
create mode 100644 learning/tour-of-beam/frontend/assets/svg/solution.svg
create mode 100644 learning/tour-of-beam/frontend/lib/auth/notifier.dart
create mode 100644 learning/tour-of-beam/frontend/lib/cache/cache.dart
create mode 100644 learning/tour-of-beam/frontend/lib/cache/unit_progress.dart
create mode 100644
learning/tour-of-beam/frontend/lib/components/login/button.dart
create mode 100644
learning/tour-of-beam/frontend/lib/components/login/content.dart
delete mode 100644
learning/tour-of-beam/frontend/lib/components/login/login_button.dart
delete mode 100644
learning/tour-of-beam/frontend/lib/components/login/login_content.dart
delete mode 100644
learning/tour-of-beam/frontend/lib/components/profile/profile_content.dart
create mode 100644
learning/tour-of-beam/frontend/lib/components/profile/user_menu.dart
create mode 100644
learning/tour-of-beam/frontend/lib/constants/storage_keys.dart
create mode 100644
learning/tour-of-beam/frontend/lib/enums/unit_completion.dart
create mode 100644 learning/tour-of-beam/frontend/lib/firebase_options.dart
create mode 100644 learning/tour-of-beam/frontend/lib/models/unit_progress.dart
create mode 100644
learning/tour-of-beam/frontend/lib/models/unit_progress.g.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/controllers/unit.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/binary_progress.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/complete_unit_button.dart
delete mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/content.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/fraction_progress.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/hints.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/markdown/code_builder.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/markdown/tob_markdown.dart
create mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/solution_button.dart
delete mode 100644
learning/tour-of-beam/frontend/lib/pages/tour/widgets/tour_progress_indicator.dart
create mode 100644
learning/tour-of-beam/frontend/lib/repositories/models/get_user_progress_response.dart
create mode 100644
learning/tour-of-beam/frontend/lib/repositories/models/get_user_progress_response.g.dart
create mode 100644 learning/tour-of-beam/frontend/lib/state.dart
delete mode 100644
learning/tour-of-beam/frontend/test/common/test_screen_wrapper.dart
create mode 100644 learning/tour-of-beam/frontend/test/main_test.dart
delete mode 100644 learning/tour-of-beam/frontend/test/overflow_test.dart
create mode 100644 learning/tour-of-beam/learning-content/content-info.yaml
delete mode 100644 learning/tour-of-beam/learning-content/go/content-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/creating-collections/from-memory/description.md
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/creating-collections/from-memory/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/creating-collections/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/creating-collections/reading-from-csv/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/creating-collections/reading-from-text/description.md
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/creating-collections/reading-from-text/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/pipeline-concepts/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/runner-concepts/description.md
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-concepts/runner-concepts/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-guide/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/introduction-terms/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/go/introduction/module-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/creating-collections/from-memory/description.md
rename
learning/tour-of-beam/learning-content/{go/introduction/introduction-concepts/creating-collections/from-memory/example
=>
introduction/introduction-concepts/creating-collections/from-memory/go-example}/from_memory.go
(100%)
rename
learning/tour-of-beam/learning-content/{java/introduction/introduction-concepts/creating-collections/from-memory/example
=>
introduction/introduction-concepts/creating-collections/from-memory/java-example}/from_memory.java
(100%)
rename
learning/tour-of-beam/learning-content/{python/introduction/introduction-concepts/creating-collections/from-memory/example
=>
introduction/introduction-concepts/creating-collections/from-memory/python-example}/from_memory.py
(100%)
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/creating-collections/from-memory/unit-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/creating-collections/group-info.yaml
rename learning/tour-of-beam/learning-content/{go =>
}/introduction/introduction-concepts/creating-collections/reading-from-csv/description.md
(100%)
rename
learning/tour-of-beam/learning-content/{go/introduction/introduction-concepts/creating-collections/reading-from-csv/example
=>
introduction/introduction-concepts/creating-collections/reading-from-csv/go-example}/csvExample.go
(100%)
rename
learning/tour-of-beam/learning-content/{java/introduction/introduction-concepts/creating-collections/reading-from-csv/example
=>
introduction/introduction-concepts/creating-collections/reading-from-csv/java-example}/CSVExample.java
(100%)
rename
learning/tour-of-beam/learning-content/{python/introduction/introduction-concepts/creating-collections/reading-from-csv/example
=>
introduction/introduction-concepts/creating-collections/reading-from-csv/python-example}/csvExample.py
(100%)
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/creating-collections/reading-from-csv/unit-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/creating-collections/reading-from-text/description.md
rename
learning/tour-of-beam/learning-content/{go/introduction/introduction-concepts/creating-collections/reading-from-text/example
=>
introduction/introduction-concepts/creating-collections/reading-from-text/go-example}/textIo.go
(100%)
rename
learning/tour-of-beam/learning-content/{java/introduction/introduction-concepts/creating-collections/reading-from-text/example
=>
introduction/introduction-concepts/creating-collections/reading-from-text/java-example}/TextIOExample.java
(100%)
rename
learning/tour-of-beam/learning-content/{python/introduction/introduction-concepts/creating-collections/reading-from-text/example
=>
introduction/introduction-concepts/creating-collections/reading-from-text/python-example}/textIo.py
(100%)
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/creating-collections/reading-from-text/unit-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/group-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/description.md
rename
learning/tour-of-beam/learning-content/{go/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/example
=>
introduction/introduction-concepts/pipeline-concepts/creating-pipeline/go-example}/main.go
(100%)
rename
learning/tour-of-beam/learning-content/{java/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/example
=>
introduction/introduction-concepts/pipeline-concepts/creating-pipeline/java-example}/Task.java
(100%)
rename
learning/tour-of-beam/learning-content/{python/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/example
=>
introduction/introduction-concepts/pipeline-concepts/creating-pipeline/python-example}/task.py
(100%)
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/unit-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/pipeline-concepts/group-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/description.md
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/unit-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/description.md
rename
learning/tour-of-beam/learning-content/{go/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/example
=>
introduction/introduction-concepts/pipeline-concepts/setting-pipeline/go-example}/main.go
(100%)
rename
learning/tour-of-beam/learning-content/{java/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/example
=>
introduction/introduction-concepts/pipeline-concepts/setting-pipeline/java-example}/Task.java
(100%)
rename
learning/tour-of-beam/learning-content/{python/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/example
=>
introduction/introduction-concepts/pipeline-concepts/setting-pipeline/python-example}/task.py
(100%)
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/unit-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/runner-concepts/description.md
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-concepts/runner-concepts/unit-info.yaml
rename learning/tour-of-beam/learning-content/{go =>
}/introduction/introduction-guide/description.md (100%)
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-guide/unit-info.yaml
rename learning/tour-of-beam/learning-content/{go =>
}/introduction/introduction-terms/description.md (100%)
create mode 100644
learning/tour-of-beam/learning-content/introduction/introduction-terms/unit-info.yaml
create mode 100644
learning/tour-of-beam/learning-content/introduction/module-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/content-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/creating-collections/from-memory/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/creating-collections/from-memory/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/creating-collections/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/creating-collections/reading-from-csv/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/creating-collections/reading-from-csv/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/creating-collections/reading-from-text/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/creating-collections/reading-from-text/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/pipeline-concepts/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/runner-concepts/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-concepts/runner-concepts/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-guide/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-guide/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-terms/description.md
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/introduction-terms/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/java/introduction/module-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/content-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/creating-collections/from-memory/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/creating-collections/from-memory/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/creating-collections/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/creating-collections/reading-from-csv/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/creating-collections/reading-from-csv/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/creating-collections/reading-from-text/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/creating-collections/reading-from-text/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/pipeline-concepts/creating-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/pipeline-concepts/group-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/pipeline-concepts/overview-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/pipeline-concepts/setting-pipeline/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/runner-concepts/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-concepts/runner-concepts/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-guide/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-guide/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-terms/description.md
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/introduction-terms/unit-info.yaml
delete mode 100644
learning/tour-of-beam/learning-content/python/introduction/module-info.yaml
delete mode 100644 playground/backend/internal/db/entity/common.go
delete mode 100644 playground/frontend/assets/drag_horizontal.svg
delete mode 100644 playground/frontend/assets/drag_vertical.svg
create mode 100644 playground/frontend/assets/streaming.svg
create mode 100644 playground/frontend/integration_test/common/common.dart
create mode 100644
playground/frontend/integration_test/common/common_finders.dart
create mode 100644
playground/frontend/integration_test/miscellaneous_ui/description_test.dart
create mode 100644
playground/frontend/integration_test/miscellaneous_ui/enjoy_playground_test.dart
create mode 100644
playground/frontend/integration_test/miscellaneous_ui/output_placement_test.dart
create mode 100644
playground/frontend/integration_test/miscellaneous_ui/resize_output_test.dart
create mode 100644
playground/frontend/integration_test/miscellaneous_ui/shortcuts_modal_test.dart
create mode 100644
playground/frontend/integration_test/miscellaneous_ui/toggle_brightness_mode_test.dart
create mode 100644
playground/frontend/integration_test/standalone_change_example_sdk_run_test.dart
create mode 100644
playground/frontend/integration_test/standalone_miscellaneous_ui_test.dart
delete mode 100644 playground/frontend/lib/constants/assets.dart
create mode 100644
playground/frontend/lib/modules/analytics/analytics_event.dart
create mode 100644
playground/frontend/lib/modules/examples/components/multi_file_icon.dart
delete mode 100644
playground/frontend/lib/modules/examples/components/multifile_popover/multifile_popover.dart
delete mode 100644
playground/frontend/lib/modules/examples/components/multifile_popover/multifile_popover_button.dart
create mode 100644 playground/frontend/lib/src/assets/assets.gen.dart
delete mode 100644 playground/frontend/playground_components/CHANGELOG.md
delete mode 100644 playground/frontend/playground_components/LICENSE
create mode 100644
playground/frontend/playground_components/assets/symbols/java.g.yaml
create mode 100644
playground/frontend/playground_components/lib/src/controllers/code_runner.dart
create mode 100644
playground/frontend/playground_components/lib/src/controllers/output_filter_type_controller.dart
create mode 100644
playground/frontend/playground_components/lib/src/controllers/public_notifier.dart
create mode 100644
playground/frontend/playground_components/lib/src/controllers/snippet_file_editing_controller.dart
create mode 100644
playground/frontend/playground_components/lib/src/enums/emulator_type.dart
create mode 100644
playground/frontend/playground_components/lib/src/models/dataset.dart
create mode 100644
playground/frontend/playground_components/lib/src/models/snippet_file.dart
create mode 100644
playground/frontend/playground_components/lib/src/models/snippet_file.g.dart
create mode 100644
playground/frontend/playground_components/lib/src/repositories/dataset_grpc_extension.dart
create mode 100644
playground/frontend/playground_components/lib/src/repositories/emulator_type_grpc_extension.dart
delete mode 100644
playground/frontend/playground_components/lib/src/repositories/models/shared_file.dart
create mode 100644
playground/frontend/playground_components/lib/src/repositories/models/snippet_file_grpc_extension.dart
create mode 100644
playground/frontend/playground_components/lib/src/router/router_delegate.dart
delete mode 100644
playground/frontend/playground_components/lib/src/widgets/dismissible_overlay.dart
delete mode 100644
playground/frontend/playground_components/lib/src/widgets/editor_textarea.dart
create mode 100644
playground/frontend/playground_components/lib/src/widgets/overlay/body.dart
create mode 100644
playground/frontend/playground_components/lib/src/widgets/overlay/dismissible.dart
create mode 100644
playground/frontend/playground_components/lib/src/widgets/overlay/opener.dart
create mode 100644
playground/frontend/playground_components/lib/src/widgets/periodic_builder.dart
create mode 100644
playground/frontend/playground_components/lib/src/widgets/snippet_file_editor.dart
create mode 100644
playground/frontend/playground_components/lib/src/widgets/tabbed_snippet_editor.dart
create mode 100644
playground/frontend/playground_components/lib/src/widgets/tabs/tab_bar.dart
create mode 100644
playground/frontend/playground_components/test/src/repositories/dataset_grpc_extension_test.dart
create mode 100644
playground/frontend/playground_components/test/src/repositories/emulator_type_grpc_extension_test.dart
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/extract_symbols_java_test.dart
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/java.golden.yaml
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/DefaultClass.java
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/KotlinClass.kt
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/PrivateClass.java
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/PublicClass.java
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/Test.java
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/directory/ExtendedPublicClass.java
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/directory/PublicClass.java
create mode 100644
playground/frontend/playground_components/test/tools/extract_symbols_java/sdk_mock/test/TestFolderPublicClass.java
create mode 100644
playground/frontend/playground_components/tools/extract_symbols_java/build.gradle
create mode 100644
playground/frontend/playground_components/tools/extract_symbols_java/src/main/java/com/playground/extract_symbols/ClassInfo.java
create mode 100644
playground/frontend/playground_components/tools/extract_symbols_java/src/main/java/com/playground/extract_symbols/Main.java
create mode 100644 playground/frontend/playground_components_dev/README.md
copy {learning/tour-of-beam/frontend =>
playground/frontend/playground_components_dev}/analysis_options.yaml (100%)
create mode 100644
playground/frontend/playground_components_dev/lib/playground_components_dev.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/code.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/common_finders.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/example_names.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/example_outputs.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/example_paths.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/examples.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/expect.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/finder.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/string.dart
create mode 100644
playground/frontend/playground_components_dev/lib/src/widget_tester.dart
create mode 100644 playground/frontend/playground_components_dev/pubspec.yaml
copy {learning/tour-of-beam =>
playground}/frontend/test_driver/integration_test.dart (100%)
create mode 100644 playground/infrastructure/api/v1/api_pb2.pyi
delete mode 100644
runners/spark/3/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/MetricsContainerStepMapAccumulator.java
delete mode 100644
runners/spark/3/src/main/java/org/apache/beam/runners/spark/structuredstreaming/metrics/SparkMetricsContainerStepMap.java
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/plan_test.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/coder.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/coder_test.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/common.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/example_test.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/helper_test.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/read.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/read_option.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/read_option_test.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/read_test.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/write.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/write_option.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/write_option_test.go
create mode 100644 sdks/go/pkg/beam/io/mongodbio/write_test.go
create mode 100644 sdks/go/pkg/beam/transforms/sql/sql_test.go
create mode 100644 sdks/go/test/integration/internal/containers/containers.go
create mode 100644 sdks/go/test/integration/io/mongodbio/helper_test.go
create mode 100644 sdks/go/test/integration/io/mongodbio/mongodbio_test.go
create mode 100644 sdks/java/container/java11/java11-security.properties
create mode 100644 sdks/java/container/java11/option-java11-security.json
create mode 100644 sdks/java/container/java17/java17-security.properties
create mode 100644 sdks/java/container/java17/option-java17-security.json
create mode 100644 sdks/java/container/java8/java8-security.properties
create mode 100644 sdks/java/container/java8/option-java8-security.json
create mode 100644 sdks/java/extensions/avro/build.gradle
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoder.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/coders/AvroGenericCoder.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/coders/package-info.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroIO.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroSchemaIOProvider.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroSink.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroSource.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/ConstantAvroDestination.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/DynamicAvroDestinations.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/SerializableAvroCodecFactory.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/package-info.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/schemas/AvroRecordSchema.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/schemas/io/payloads/AvroPayloadSerializerProvider.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/schemas/io/payloads/package-info.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/schemas/package-info.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/schemas/utils/AvroByteBuddyUtils.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/schemas/utils/AvroUtils.java
create mode 100644
sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/schemas/utils/package-info.java
create mode 100644
sdks/java/extensions/avro/src/test/avro/org/apache/beam/sdk/extensions/avro/io/user.avsc
create mode 100644
sdks/java/extensions/avro/src/test/avro/org/apache/beam/sdk/extensions/avro/schemas/test.avsc
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoderTest.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoderTestPojo.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/AvroIOTest.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/AvroSchemaIOProviderTest.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/AvroSourceTest.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/SerializableAvroCodecFactoryTest.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/schemas/AvroSchemaTest.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/schemas/io/AvroPayloadSerializerProviderTest.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/schemas/utils/AvroGenerators.java
create mode 100644
sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/schemas/utils/AvroUtilsTest.java
create mode 100644
sdks/java/io/debezium/src/main/java/org/apache/beam/io/debezium/DebeziumReadSchemaTransformProvider.java
create mode 100644
sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/DebeziumReadSchemaTransformTest.java
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProvider.java
delete mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubSchemaTransformWriteConfiguration.java
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubWriteSchemaTransformConfiguration.java
create mode 100644
sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubWriteSchemaTransformProvider.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/providers/BigQueryStorageWriteApiSchemaTransformProviderTest.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubSchemaIT.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubWriteSchemaTransformProviderIT.java
create mode 100644
sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubWriteSchemaTransformProviderTest.java
create mode 100644
sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/JdbcReadSchemaTransformProvider.java
create mode 100644
sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/JdbcWriteSchemaTransformProvider.java
create mode 100644
sdks/java/io/jdbc/src/test/java/org/apache/beam/sdk/io/jdbc/JdbcReadSchemaTransformProviderTest.java
create mode 100644
sdks/java/io/jdbc/src/test/java/org/apache/beam/sdk/io/jdbc/JdbcWriteSchemaTransformProviderTest.java
create mode 100644
sdks/python/apache_beam/io/external/xlang_kafkaio_perf_test.py
create mode 100644 sdks/python/apache_beam/testing/analyzers/README.md
copy {.test-infra/jenkins/dependency_check =>
sdks/python/apache_beam/testing/analyzers}/__init__.py (100%)
create mode 100644
sdks/python/apache_beam/testing/analyzers/analyze_metric_data.ipynb
create mode 100644 sdks/python/apache_beam/testing/analyzers/constants.py
create mode 100644
sdks/python/apache_beam/testing/analyzers/github_issues_utils.py
create mode 100644 sdks/python/apache_beam/testing/analyzers/perf_analysis.py
create mode 100644
sdks/python/apache_beam/testing/analyzers/perf_analysis_test.py
create mode 100644
sdks/python/apache_beam/testing/analyzers/perf_analysis_utils.py
create mode 100644 sdks/python/apache_beam/testing/analyzers/tests_config.yaml
copy {.test-infra/jenkins/dependency_check =>
sdks/python/apache_beam/testing/benchmarks/cloudml}/__init__.py (100%)
create mode 100644
sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_constants_lib.py
create mode 100644
sdks/python/apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py
copy {.test-infra/jenkins/dependency_check =>
sdks/python/apache_beam/testing/benchmarks/cloudml/criteo_tft}/__init__.py
(100%)
create mode 100644
sdks/python/apache_beam/testing/benchmarks/cloudml/criteo_tft/criteo.py
copy {.test-infra/jenkins/dependency_check =>
sdks/python/apache_beam/testing/benchmarks/cloudml/pipelines}/__init__.py (100%)
create mode 100644
sdks/python/apache_beam/testing/benchmarks/cloudml/pipelines/workflow.py
create mode 100644
sdks/python/apache_beam/testing/benchmarks/cloudml/requirements.txt
delete mode 100644 sdks/typescript/Dockerfile
delete mode 100644 sdks/typescript/boot.go
create mode 100644 sdks/typescript/build.gradle
delete mode 100755 sdks/typescript/build_container.sh
create mode 100644 sdks/typescript/container/Dockerfile
create mode 100644 sdks/typescript/container/boot.go
create mode 100644 sdks/typescript/container/build.gradle
delete mode 100644 sdks/typescript/src/apache_beam/version.ts
create mode 100644 website/www/site/content/en/blog/beam-2.44.0.md
create mode 100644 website/www/site/content/en/case-studies/android.md
create mode 100644 website/www/site/content/en/case-studies/calico.md
create mode 100644 website/www/site/content/en/case-studies/chrome.md
create mode 100644 website/www/site/content/en/case-studies/creditKarma.md
create mode 100644 website/www/site/content/en/case-studies/deepmind.md
create mode 100644 website/www/site/content/en/case-studies/fitbit.md
create mode 100644 website/www/site/content/en/case-studies/googleplay.md
create mode 100644 website/www/site/content/en/case-studies/nest.md
create mode 100644 website/www/site/content/en/case-studies/verily.md
create mode 100644 website/www/site/content/en/case-studies/waymo.md
create mode 100644 website/www/site/content/en/case-studies/youtube.md
create mode 100644
website/www/site/content/en/documentation/io/built-in/singlestore.md
create mode 100644 website/www/site/content/en/get-started/quickstart/go.md
create mode 100644
website/www/site/static/images/case-study/credit_karma/avneesh_pratap.jpeg
create mode 100644
website/www/site/static/images/case-study/credit_karma/raj_katakam.jpeg
create mode 100644
website/www/site/static/images/case-study/credit_karma/scheme-2.png
create mode 100644
website/www/site/static/images/case-study/credit_karma/scheme-3.png
create mode 100644
website/www/site/static/images/case-study/credit_karma/scheme-4.png
create mode 100644
website/www/site/static/images/case-study/credit_karma/scheme-5.png
create mode 100644 website/www/site/static/images/logos/powered-by/android.png
create mode 100644 website/www/site/static/images/logos/powered-by/calico.png
create mode 100644 website/www/site/static/images/logos/powered-by/chrome.png
create mode 100644
website/www/site/static/images/logos/powered-by/credit-karma.png
create mode 100644 website/www/site/static/images/logos/powered-by/deepmind.png
create mode 100644 website/www/site/static/images/logos/powered-by/fitbit.png
create mode 100644
website/www/site/static/images/logos/powered-by/googleplay.png
create mode 100644 website/www/site/static/images/logos/powered-by/nest.png
create mode 100644 website/www/site/static/images/logos/powered-by/verily.png
create mode 100644 website/www/site/static/images/logos/powered-by/waymo.png
create mode 100644 website/www/site/static/images/logos/powered-by/youtube.png
