date:20211012

[beam] branch asf-site updated: Publishing website 2021/10/13 06:06:04 at commit 71d7213

2021-10-12 Thread git-site-role

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new d0596f6  Publishing website 2021/10/13 06:06:04 at commit 71d7213
d0596f6 is described below

commit d0596f6f645e53f75a02bf54291dd3807e323c46
Author: jenkins 
AuthorDate: Wed Oct 13 06:06:04 2021 +

Publishing website 2021/10/13 06:06:04 at commit 71d7213
---
 website/generated-content/documentation/index.xml  | 121 -
 .../documentation/programming-guide/index.html |  36 +++---
 website/generated-content/sitemap.xml  |   2 +-
 3 files changed, 138 insertions(+), 21 deletions(-)

diff --git a/website/generated-content/documentation/index.xml 
b/website/generated-content/documentation/index.xml
index e6c7c3d..73601a9 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -9600,12 +9600,17 @@ state. Merging windows are not currently supported when 
using state and timers.&
 care must be taken to remember that the elements in input PCollection have no 
guaranteed order and to ensure that the
 program logic is resilient to this. Unit tests written using the DirectRunner 
will shuffle the order of element
 processing, and are recommended to test for correctness.
-In Java DoFn declares states to be accessed by 
creating final StateSpec member variables representing each 
state. Each
+
In Java, DoFn declares states to be accessed by 
creating final StateSpec member variables representing each 
state. Each
 state must be named using the StateId annotation; this name 
is unique to a ParDo in the graph and has no relation
 to other nodes in the graph. A DoFn can declare multiple 
state variables.
-In Python DoFn declares states to be accessed by 
creating StateSpec class member variables representing each 
state. Each
+
In Python, DoFn declares states to be accessed by 
creating StateSpec class member variables representing each 
state. Each
 StateSpec is initialized with a name, this name is unique 
to a ParDo in the graph and has no relation
 to other nodes in the graph. A DoFn can declare multiple 
state variables.
+
+
+Note: The Beam SDK for Go does not yet support a 
State and Timer API. See BEAM-10660 to 
contribute.
+
+
 11.1. Types of state
 Beam provides several types of state:
 ValueState
@@ -9661,6 +9666,14 @@ accumulates the number of elements seen.
 | 'state 
pardo' >> beam.ParDo(ReadModifyWriteStateDoFn()))

CombiningState allows you to create a state object that is updated using a Beam combiner. For example, the previous ValueState example could be rewritten to use CombiningState

This is not [beam] tag nightly-master updated (c8e7a4c -> 1ce290b) 2021-10-12 Thread github-bot This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to tag nightly-master in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag nightly-master was modified! *** from c8e7a4c (commit) to 1ce290b (commit) from c8e7a4c Release 2.33 documentation update (#15543) add ef43645 Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work by executing ready elements instead of stages add 09b80c4 Merge pull request #15667 from [BEAM-12730] Add custom delimiters to Python TextIO reads add a75fe13 Merge pull request #15700 from [BEAM-12987] [Playground] Add page UI elements add 9a8595c Update Dataflow Python container tag add bb4c17c Merge pull request #15707 from ihji/update_python_container_tag add 767b329 Revert "[BEAM-10913] - Forcing update of YAML file by running kubectl apply (#15663)" add 4b11efd Merge pull request #15705 from apache/revert-15663-BEAM-10913 add c21f014 [BEAM-12997] Upgraded labextension to V3 add 8de36fe [BEAM-12997] Upgraded labextension to V3 add 98859fd [BEAM-7169] Fix singleton assertion in PAssert javadoc. add 1ce290b [BEAM-7169] Fix singleton assertion in PAssert javadoc. No new revisions were added by this update. Summary of changes: .test-infra/metrics/build.gradle |5 - CHANGES.md |1 + build.gradle.kts |3 + playground/frontend/analysis_options.yaml |1 + playground/frontend/assets/beam.png| Bin 0 -> 601 bytes playground/frontend/assets/github.svg |5 + playground/frontend/assets/output_bottom.svg |7 + playground/frontend/assets/output_left.svg |7 + playground/frontend/assets/output_right.svg|7 + playground/frontend/assets/reset.svg |5 + playground/frontend/assets/send_feedback.svg |5 + playground/frontend/assets/shortcuts.svg | 11 + playground/frontend/assets/theme.svg |8 + .../toggle_theme_button/toggle_theme_button.dart |7 +- playground/frontend/lib/config/theme.dart | 63 +- .../lib/constants/{sizes.dart => assets.dart} | 22 +- .../font_weight.dart} | 14 +- playground/frontend/lib/constants/sizes.dart |9 +- .../components/header_icon_button.dart}| 23 +- .../components/new_example_action.dart}| 18 +- .../components/reset_action.dart} | 21 +- .../components/{output_area.dart => output.dart} | 13 +- .../lib/modules/output/components/output_area.dart | 15 +- .../output_header.dart}| 25 +- .../output_header/output_placements.dart | 53 + .../output_tabs.dart} | 15 +- .../output_placement.dart} | 24 +- .../output/models/output_placement_state.dart} | 17 +- .../components/editor_textarea_wrapper.dart| 30 +- .../pages/playground/components/more_actions.dart | 123 + .../components/playground_page_body.dart | 70 + .../components/playground_page_footer.dart | 71 + .../components/playground_page_providers.dart |4 + .../lib/pages/playground/playground_page.dart | 44 +- .../pages/playground/states/playground_state.dart |6 + playground/frontend/pubspec.lock | 100 +- playground/frontend/pubspec.yaml |4 + .../playground/states/mocks/example_mock.dart} | 27 +- .../{ => states}/playground_state_test.dart| 25 + .../java/org/apache/beam/sdk/testing/PAssert.java |4 +- sdks/python/apache_beam/io/iobase.py | 12 +- sdks/python/apache_beam/io/textio.py | 39 +- sdks/python/apache_beam/io/textio_test.py | 38 +- .../apache_beam/runners/dataflow/internal/names.py |4 +- .../apache-beam-jupyterlab-sidepanel/.eslintrc.js | 28 +- .../.prettierrc.json |4 +- .../apache-beam-jupyterlab-sidepanel/package.json | 48 +- .../src/SidePanel.ts |4 +- .../src/__tests__/common/HtmlView.test.tsx |5 +- .../__tests__/inspector/InspectableView.test.tsx |5 +- .../inspector/InspectableViewModel.test.ts |6 +- .../src/__tests__/inspector/Inspectables.test.tsx | 12 +- .../inspector/InteractiveInspector.test.tsx| 14 +- .../kernel/InterruptKernelButton.test.tsx |2 +- .../src/__tests__/kernel/KernelModel.test.ts | 14 +- .../src/kernel/KernelModel.ts |4 +- .../apache-beam-jupyterlab-sidepanel/tsconfig.json |3 +- .../apache-beam-jupyterlab-sidepanel/yarn.lock | 5127 .../runners/portability/fn_api_runner/execution.py | 35 [beam] branch master updated (1ce290b -> 71d7213) 2021-10-12 Thread lostluck This is an automated email from the ASF dual-hosted git repository. lostluck pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 1ce290b [BEAM-7169] Fix singleton assertion in PAssert javadoc. add 71d7213 [BEAM-12513] Add JIRAs for missing Go SDK features (#15658) No new revisions were added by this update. Summary of changes: .../content/en/documentation/programming-guide.md | 67 +- 1 file changed, 64 insertions(+), 3 deletions(-) svn commit: r50385 - /dev/beam/2.33.0/ 2021-10-12 Thread altay Author: altay Date: Wed Oct 13 02:12:38 2021 New Revision: 50385 Log: Remove completed 2.33.0 release Removed: dev/beam/2.33.0/ svn commit: r50384 - in /release/beam: 2.31.0/ 2.32.0/ 2.33.0/ latest 2021-10-12 Thread altay Author: altay Date: Wed Oct 13 02:11:52 2021 New Revision: 50384 Log: Promote 2.33.0 release Added: release/beam/2.33.0/ - copied from r50383, dev/beam/2.33.0/ Removed: release/beam/2.31.0/ release/beam/2.32.0/ Modified: release/beam/latest Modified: release/beam/latest == --- release/beam/latest (original) +++ release/beam/latest Wed Oct 13 02:11:52 2021 @@ -1 +1 @@ -link 2.32.0 \ No newline at end of file +link 2.33.0/ \ No newline at end of file [beam] branch master updated (8de36fe -> 1ce290b) 2021-10-12 Thread lcwik This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 8de36fe [BEAM-12997] Upgraded labextension to V3 add 98859fd [BEAM-7169] Fix singleton assertion in PAssert javadoc. add 1ce290b [BEAM-7169] Fix singleton assertion in PAssert javadoc. No new revisions were added by this update. Summary of changes: sdks/java/core/src/main/java/org/apache/beam/sdk/testing/PAssert.java | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) [beam] branch master updated (4b11efd -> 8de36fe) 2021-10-12 Thread ningk This is an automated email from the ASF dual-hosted git repository. ningk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 4b11efd Merge pull request #15705 from apache/revert-15663-BEAM-10913 add c21f014 [BEAM-12997] Upgraded labextension to V3 add 8de36fe [BEAM-12997] Upgraded labextension to V3 No new revisions were added by this update. Summary of changes: .../apache-beam-jupyterlab-sidepanel/.eslintrc.js | 28 +- .../.prettierrc.json |4 +- .../apache-beam-jupyterlab-sidepanel/package.json | 48 +- .../src/SidePanel.ts |4 +- .../src/__tests__/common/HtmlView.test.tsx |5 +- .../__tests__/inspector/InspectableView.test.tsx |5 +- .../inspector/InspectableViewModel.test.ts |6 +- .../src/__tests__/inspector/Inspectables.test.tsx | 12 +- .../inspector/InteractiveInspector.test.tsx| 14 +- .../kernel/InterruptKernelButton.test.tsx |2 +- .../src/__tests__/kernel/KernelModel.test.ts | 14 +- .../src/kernel/KernelModel.ts |4 +- .../apache-beam-jupyterlab-sidepanel/tsconfig.json |3 +- .../apache-beam-jupyterlab-sidepanel/yarn.lock | 5127 sdks/python/tox.ini|4 +- 15 files changed, 4300 insertions(+), 980 deletions(-) [beam] branch master updated (bb4c17c -> 4b11efd) 2021-10-12 Thread ibzib This is an automated email from the ASF dual-hosted git repository. ibzib pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from bb4c17c Merge pull request #15707 from ihji/update_python_container_tag add 767b329 Revert "[BEAM-10913] - Forcing update of YAML file by running kubectl apply (#15663)" add 4b11efd Merge pull request #15705 from apache/revert-15663-BEAM-10913 No new revisions were added by this update. Summary of changes: .test-infra/metrics/build.gradle | 5 - 1 file changed, 5 deletions(-) [beam] branch release-2.34.0 updated: Merge pull request #15631 from TheNeuralBit/dataframe-changes-update 2021-10-12 Thread ibzib This is an automated email from the ASF dual-hosted git repository. ibzib pushed a commit to branch release-2.34.0 in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/release-2.34.0 by this push: new 1c0174e Merge pull request #15631 from TheNeuralBit/dataframe-changes-update new 2876f6b Merge pull request #15710 from TheNeuralBit/cp-dataframe-changes 1c0174e is described below commit 1c0174ecca4c917c2e50ce84d39fd507e7939d69 Author: Kyle Weaver AuthorDate: Fri Oct 8 13:35:05 2021 -0700 Merge pull request #15631 from TheNeuralBit/dataframe-changes-update Minor: Add DataFrame changes to CHANGES.md --- CHANGES.md | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index a7bf99b..44adea5 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -69,6 +69,10 @@ * X feature added (Java/Python) ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). * Upgrade to Calcite 1.26.0 ([BEAM-9379](https://issues.apache.org/jira/browse/BEAM-9379)). +* Added a new `dataframe` extra to the Python SDK that tracks `pandas` versions + we've verified compatibility with. We now recommend installing Beam with `pip + install apache-beam[dataframe]` when you intend to use the DataFrame API + ([BEAM-12906](https://issues.apache.org/jira/browse/BEAM-12906)). ## Breaking Changes @@ -84,8 +88,8 @@ ## Bugfixes * Fixed X (Java/Python) ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)). -* Fixed error while writing multiple DeferredFrames to csv (Python) -([BEAM-12701](https://issues.apache.org/jira/browse/BEAM-12701)). +* Fixed error while writing multiple DeferredFrames to csv (Python) ([BEAM-12701](https://issues.apache.org/jira/browse/BEAM-12701)). +* Fixed error when importing the DataFrame API with pandas 1.0.x installed ([BEAM-12945](https://issues.apache.org/jira/browse/BEAM-12945)). * Fixed top.SmallestPerKey implementation in the Go SDK ([BEAM-12946](https://issues.apache.org/jira/browse/BEAM-12946)). ## Known Issues [beam] branch master updated: Update Dataflow Python container tag 2021-10-12 Thread heejong This is an automated email from the ASF dual-hosted git repository. heejong pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 9a8595c Update Dataflow Python container tag new bb4c17c Merge pull request #15707 from ihji/update_python_container_tag 9a8595c is described below commit 9a8595c7c6b18071d5d284eb462d502d8b38b1fd Author: Heejong Lee AuthorDate: Mon Oct 11 17:13:06 2021 -0700 Update Dataflow Python container tag --- sdks/python/apache_beam/runners/dataflow/internal/names.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/sdks/python/apache_beam/runners/dataflow/internal/names.py b/sdks/python/apache_beam/runners/dataflow/internal/names.py index 7101a1e..3a76342 100644 --- a/sdks/python/apache_beam/runners/dataflow/internal/names.py +++ b/sdks/python/apache_beam/runners/dataflow/internal/names.py @@ -36,10 +36,10 @@ SERIALIZED_SOURCE_KEY = 'serialized_source' # Update this version to the next version whenever there is a change that will # require changes to legacy Dataflow worker execution environment. -BEAM_CONTAINER_VERSION = 'beam-master-20210920' +BEAM_CONTAINER_VERSION = 'beam-master-20211011' # Update this version to the next version whenever there is a change that # requires changes to SDK harness container or SDK harness launcher. -BEAM_FNAPI_CONTAINER_VERSION = 'beam-master-20210920' +BEAM_FNAPI_CONTAINER_VERSION = 'beam-master-20211011' DATAFLOW_CONTAINER_IMAGE_REPOSITORY = 'gcr.io/cloud-dataflow/v1beta3' [beam] branch master updated (09b80c4 -> a75fe13) 2021-10-12 Thread pabloem This is an automated email from the ASF dual-hosted git repository. pabloem pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 09b80c4 Merge pull request #15667 from [BEAM-12730] Add custom delimiters to Python TextIO reads add a75fe13 Merge pull request #15700 from [BEAM-12987] [Playground] Add page UI elements No new revisions were added by this update. Summary of changes: build.gradle.kts | 3 + playground/frontend/analysis_options.yaml | 1 + playground/frontend/assets/beam.png| Bin 0 -> 601 bytes playground/frontend/assets/github.svg | 5 + playground/frontend/assets/output_bottom.svg | 7 ++ playground/frontend/assets/output_left.svg | 7 ++ playground/frontend/assets/output_right.svg| 7 ++ playground/frontend/assets/reset.svg | 5 + playground/frontend/assets/send_feedback.svg | 5 + playground/frontend/assets/shortcuts.svg | 11 ++ playground/frontend/assets/theme.svg | 8 ++ .../toggle_theme_button/toggle_theme_button.dart | 7 +- playground/frontend/lib/config/theme.dart | 63 ++- .../lib/constants/{sizes.dart => assets.dart} | 22 ++-- .../font_weight.dart} | 14 +-- playground/frontend/lib/constants/sizes.dart | 9 +- .../components/header_icon_button.dart}| 23 +++- .../components/new_example_action.dart}| 18 ++- .../components/reset_action.dart} | 21 +++- .../components/{output_area.dart => output.dart} | 13 ++- .../lib/modules/output/components/output_area.dart | 15 ++- .../output_header.dart}| 25 - .../output_header/output_placements.dart | 53 + .../output_tabs.dart} | 15 ++- .../output_placement.dart} | 24 ++-- .../output/models/output_placement_state.dart} | 17 ++- .../components/editor_textarea_wrapper.dart| 30 - .../pages/playground/components/more_actions.dart | 123 + .../components/playground_page_body.dart | 70 .../components/playground_page_footer.dart | 71 .../components/playground_page_providers.dart | 4 + .../lib/pages/playground/playground_page.dart | 44 .../pages/playground/states/playground_state.dart | 6 + playground/frontend/pubspec.lock | 100 - playground/frontend/pubspec.yaml | 4 + .../playground/states/mocks/example_mock.dart} | 27 +++-- .../{ => states}/playground_state_test.dart| 25 + 37 files changed, 788 insertions(+), 114 deletions(-) create mode 100644 playground/frontend/assets/beam.png create mode 100644 playground/frontend/assets/github.svg create mode 100644 playground/frontend/assets/output_bottom.svg create mode 100644 playground/frontend/assets/output_left.svg create mode 100644 playground/frontend/assets/output_right.svg create mode 100644 playground/frontend/assets/reset.svg create mode 100644 playground/frontend/assets/send_feedback.svg create mode 100644 playground/frontend/assets/shortcuts.svg create mode 100644 playground/frontend/assets/theme.svg copy playground/frontend/lib/constants/{sizes.dart => assets.dart} (70%) copy playground/frontend/lib/{modules/output/components/output_area.dart => constants/font_weight.dart} (76%) copy playground/frontend/lib/modules/{output/components/output_area.dart => actions/components/header_icon_button.dart} (65%) copy playground/frontend/lib/modules/{output/components/output_area.dart => actions/components/new_example_action.dart} (62%) copy playground/frontend/lib/modules/{output/components/output_area.dart => actions/components/reset_action.dart} (60%) copy playground/frontend/lib/modules/output/components/{output_area.dart => output.dart} (69%) copy playground/frontend/lib/modules/output/components/{output_area.dart => output_header/output_header.dart} (58%) create mode 100644 playground/frontend/lib/modules/output/components/output_header/output_placements.dart copy playground/frontend/lib/modules/output/components/{output_area.dart => output_header/output_tabs.dart} (75%) copy playground/frontend/lib/modules/output/{components/output_area.dart => models/output_placement.dart} (66%) rename playground/frontend/{test/widget_test.dart => lib/modules/output/models/output_placement_state.dart} (68%) create mode 100644 playground/frontend/lib/pages/playground/components/more_actions.dart create mode 100644 playground/frontend/lib/pages/playground/components/playground_page_body.dart create mode 100644 playground/frontend/lib/pages/playground/components/playground_page_footer.dart copy playground/frontend/{lib/constants/sizes.dart => test/pages/p [beam] branch master updated (ef43645 -> 09b80c4) 2021-10-12 Thread pabloem This is an automated email from the ASF dual-hosted git repository. pabloem pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from ef43645 Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work by executing ready elements instead of stages add 09b80c4 Merge pull request #15667 from [BEAM-12730] Add custom delimiters to Python TextIO reads No new revisions were added by this update. Summary of changes: CHANGES.md| 1 + sdks/python/apache_beam/io/textio.py | 39 --- sdks/python/apache_beam/io/textio_test.py | 38 +- 3 files changed, 63 insertions(+), 15 deletions(-)

[beam] branch asf-site updated: Publishing website 2021/10/13 06:06:04 at commit 71d7213

11.1. Types of state

ValueState

CombiningState

[beam] tag nightly-master updated (c8e7a4c -> 1ce290b)

[beam] branch master updated (1ce290b -> 71d7213)

svn commit: r50385 - /dev/beam/2.33.0/

svn commit: r50384 - in /release/beam: 2.31.0/ 2.32.0/ 2.33.0/ latest

[beam] branch master updated (8de36fe -> 1ce290b)

[beam] branch master updated (4b11efd -> 8de36fe)

[beam] branch master updated (bb4c17c -> 4b11efd)

[beam] branch release-2.34.0 updated: Merge pull request #15631 from TheNeuralBit/dataframe-changes-update

[beam] branch master updated: Update Dataflow Python container tag

[beam] branch master updated (09b80c4 -> a75fe13)

[beam] branch master updated (ef43645 -> 09b80c4)

12 matches

Site Navigation

Mail list logo

Footer information