[beam] branch nightly-refs/heads/master updated (05cbe24 -> a4336c9)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git. from 05cbe24 Merge pull request #16293 from ibzib/flink-upgrade add c0921f7 Use a patched shadow 6.1.0 plugin using Log4j 2.16.0 (#16269) add 3fb40fe [BEAM-12830] Replace GoGradle plugin with Shell Scripts. (#16291) add a915161 [BEAM-13430] Start the process of upgrading the Gradle 7. (#16292) add ea47b1f [BEAM-13502]: fix loading example on embedded version add c970da3 Merge pull request #16305 from [BEAM-13502] [Playground] [Bugfix] showing a selected example on the embedded version of the playground add 4a356da [BEAM-13430] Introduce new testRuntimeMigration configuration that mirrors what testRuntime used to do. (#16307) add c03b4b5e [BEAM-13498] Sickbay portable Flink testProcessElementSkew. add c4dd8f4 Merge pull request #16295 from ibzib/BEAM-13498 add 97a1556 [BEAM-13499] Add warning about hcatalog to release notes and javadoc (#16297) add d845a00 [BEAM-13397] Bump numpy to 1.21 for M1 chip add 37428b3 re-generate requirements.txt add 59bc389 [BEAM-13397] Bump numpy to 1.21 for M1 chip #16227 add efa8983 Update flink cluster to use a supported dataproc version (1.2 -> 1.5) add b3ba7b5 Merge pull request #16310 from apache/aaltay-patch-1 add 2e72638 [BEAM-13430] Remove propdeps and replace with compileOnly (#16308) add c5fbe47 Merge pull request #16304 from [BEAM-13491] [Playground] Examples' catalog doesn't close after selecting example add 402bb56 Merge pull request #16283 from [BEAM-13448] [Playground] track run code time to the analytics add ec4c7ee Merge pull request #16244 from [BEAM-13463] [Playground] add retries to check status for run code add 38deb59 Merge pull request #16241 from [BEAM-13440] [Playground] Implement initialization of Cloud Logger add 45df0ac6 [BEAM-13399] Add integration test for Go SDK expansion service JAR pull/start-up (#16313) add a4336c9 [BEAM-13421] Fix bug with xs called with non-tuple key (#16258) No new revisions were added by this update. Summary of changes: .github/workflows/local_env_tests.yml | 9 +- .test-infra/dataproc/flink_cluster.sh | 4 +- .test-infra/metrics/build.gradle | 4 +- .test-infra/validate-runner/build.gradle | 28 ++-- CHANGES.md | 4 +- buildSrc/build.gradle.kts | 44 ++--- .../jarlibs/shadow-6.1.0-log4jfix-SNAPSHOT.jar | Bin 0 -> 5628292 bytes .../org/apache/beam/gradle/BeamModulePlugin.groovy | 174 ++- .../apache/beam/gradle/GrpcVendoring_1_36_0.groovy | 4 +- .../org/apache/beam/gradle/VendorJavaPlugin.groovy | 2 +- examples/java/build.gradle | 92 +-- examples/java/twitter/build.gradle | 32 ++-- examples/kotlin/build.gradle | 46 +++--- learning/katas/java/build.gradle | 30 ++-- learning/katas/kotlin/build.gradle | 32 ++-- model/fn-execution/build.gradle| 4 +- model/interactive/build.gradle | 4 +- model/job-management/build.gradle | 4 +- ownership/JAVA_DEPENDENCY_OWNERS.yaml | 5 - playground/backend/cmd/server/server.go| 3 + .../backend/internal/environment/application.go| 20 ++- .../internal/environment/application_test.go | 82 + .../internal/environment/environment_service.go| 7 +- .../environment/environment_service_test.go| 21 ++- .../internal/logger/cloud_logging_handler.go | 1 + playground/backend/internal/logger/logger.go | 51 +++--- playground/backend/internal/logger/logger_test.go | 4 +- playground/backend/internal/logger/std_handler.go | 78 + .../lib/modules/analytics/analytics_events.dart| 1 + .../lib/modules/analytics/analytics_service.dart | 16 +- .../components/pipeline_options_text_field.dart| 3 +- .../code_client/grpc_code_client.dart | 21 ++- .../code_repository/code_repository.dart | 12 +- .../code_repository/run_code_result.dart | 2 +- .../example_list/category_expansion_panel.dart | 10 +- .../components/example_list/example_list.dart | 6 + .../example_list/expansion_panel_item.dart | 16 +- .../lib/modules/examples/example_selector.dart | 18 +- .../components/embedded_editor.dart| 1 + .../components/editor_textarea_wrapper.dart| 12 +- .../components/playground_page_providers.dart | 8 +- .../pages/playground/states/playground_state.dart | 5 +- playground/frontend/lib/utils/run_with_retry.dart | 52 ++ .../frontend/test/utils/r
[beam] annotated tag v2.35.0-RC7 updated (4feddce -> 12933b8)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to annotated tag v2.35.0-RC7 in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag v2.35.0-RC7 was modified! *** from 4feddce (commit) to 12933b8 (tag) tagging 4feddce55c1a3ef255b1be90b9f8c0343964561e (commit) replaces jupyterlab-sidepanel-v2.0.0 by Valentyn Tymofieiev on Tue Dec 21 17:16:26 2021 -0800 - Log - v2.35.0-RC7 --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag sdks/v2.35.0-RC7 updated (4feddce -> e2f9e27)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to annotated tag sdks/v2.35.0-RC7 in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag sdks/v2.35.0-RC7 was modified! *** from 4feddce (commit) to e2f9e27 (tag) tagging 4feddce55c1a3ef255b1be90b9f8c0343964561e (commit) replaces jupyterlab-sidepanel-v2.0.0 by Valentyn Tymofieiev on Tue Dec 21 17:16:26 2021 -0800 - Log - Go SDK v2.35.0-RC7 --- No new revisions were added by this update. Summary of changes:
[beam] branch master updated (45df0ac6 -> a4336c9)
This is an automated email from the ASF dual-hosted git repository. bhulette pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 45df0ac6 [BEAM-13399] Add integration test for Go SDK expansion service JAR pull/start-up (#16313) add a4336c9 [BEAM-13421] Fix bug with xs called with non-tuple key (#16258) No new revisions were added by this update. Summary of changes: CHANGES.md | 2 ++ sdks/python/apache_beam/dataframe/frames.py | 14 ++ sdks/python/apache_beam/dataframe/frames_test.py | 15 +++ 3 files changed, 27 insertions(+), 4 deletions(-)
[beam] branch master updated: [BEAM-13399] Add integration test for Go SDK expansion service JAR pull/start-up (#16313)
This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 45df0ac6 [BEAM-13399] Add integration test for Go SDK expansion
service JAR pull/start-up (#16313)
45df0ac6 is described below
commit 45df0ac6a3cf28e5b8ebf8a6899e3640c520f09d
Author: Jack McCluskey <34928439+jrmcclus...@users.noreply.github.com>
AuthorDate: Tue Dec 21 18:04:32 2021 -0500
[BEAM-13399] Add integration test for Go SDK expansion service JAR
pull/start-up (#16313)
---
.../beam/core/runtime/xlangx/expansionx/process.go | 4 ++
sdks/go/test/integration/xlang/expansion_test.go | 68 ++
2 files changed, 72 insertions(+)
diff --git a/sdks/go/pkg/beam/core/runtime/xlangx/expansionx/process.go
b/sdks/go/pkg/beam/core/runtime/xlangx/expansionx/process.go
index 935aeff..fa94835 100644
--- a/sdks/go/pkg/beam/core/runtime/xlangx/expansionx/process.go
+++ b/sdks/go/pkg/beam/core/runtime/xlangx/expansionx/process.go
@@ -18,6 +18,7 @@ package expansionx
import (
"fmt"
"os/exec"
+ "time"
)
// ExpansionServiceRunner is a type that holds information required to
@@ -51,6 +52,9 @@ func (e *ExpansionServiceRunner) StartService() error {
if err != nil {
return err
}
+ // Start() is non-blocking so a brief sleep to let the JAR start up and
begin accepting
+ // connections is necessary.
+ time.Sleep(2 * time.Second)
if e.serviceCommand.ProcessState != nil {
return fmt.Errorf("process %v exited when it should still be
running", e.serviceCommand.Process)
}
diff --git a/sdks/go/test/integration/xlang/expansion_test.go
b/sdks/go/test/integration/xlang/expansion_test.go
new file mode 100644
index 000..070fccf
--- /dev/null
+++ b/sdks/go/test/integration/xlang/expansion_test.go
@@ -0,0 +1,68 @@
+// Licensed to the Apache Software Foundation (ASF) under one or more
+// contributor license agreements. See the NOTICE file distributed with
+// this work for additional information regarding copyright ownership.
+// The ASF licenses this file to You under the Apache License, Version 2.0
+// (the "License"); you may not use this file except in compliance with
+// the License. You may obtain a copy of the License at
+//
+//http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+
+package xlang
+
+import (
+ "os"
+ "os/exec"
+ "strings"
+ "testing"
+
+
"github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/xlangx/expansionx"
+ "github.com/apache/beam/sdks/v2/go/test/integration"
+)
+
+const (
+ // TODO(BEAN-13505): Select the most recent Beam release instead of a
hard-coded
+ // string.
+ beamVersion = "2.34.0"
+ gradleTarget = ":sdks:java:io:expansion-service:runExpansionService"
+ expansionPort = "8097"
+)
+
+func checkPort(t *testing.T, port string) {
+ ping := exec.Command("nc", "-vz", "localhost", port)
+ output, err := ping.CombinedOutput()
+ if err != nil {
+ t.Errorf("failed to run ping to localhost:%v", port)
+ }
+ outputStr := string(output)
+ if strings.Contains(outputStr, "failed") {
+ t.Errorf("failed to connect to localhost:%v, got err %v", port,
outputStr)
+ }
+}
+
+func TestAutomatedExpansionService(t *testing.T) {
+ integration.CheckFilters(t)
+ jarPath, err := expansionx.GetBeamJar(gradleTarget, beamVersion)
+ if err != nil {
+ t.Fatalf("failed to get JAR path, got %v", err)
+ }
+ t.Cleanup(func() { os.Remove(jarPath) })
+
+ serviceRunner := expansionx.NewExpansionServiceRunner(jarPath,
expansionPort)
+ err = serviceRunner.StartService()
+ if err != nil {
+ t.Errorf("failed to start expansion service JAR, got %v", err)
+ }
+
+ checkPort(t, expansionPort)
+
+ err = serviceRunner.StopService()
+ if err != nil {
+ t.Errorf("failed to stop expansion service JAR, got %v", err)
+ }
+}
[beam] branch master updated: Merge pull request #16241 from [BEAM-13440] [Playground] Implement initialization of Cloud Logger
This is an automated email from the ASF dual-hosted git repository.
pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 38deb59 Merge pull request #16241 from [BEAM-13440] [Playground]
Implement initialization of Cloud Logger
38deb59 is described below
commit 38deb59f3baf2d54f215ffd7a9900918419ec87b
Author: Pavel Avilov
AuthorDate: Wed Dec 22 01:54:44 2021 +0300
Merge pull request #16241 from [BEAM-13440] [Playground] Implement
initialization of Cloud Logger
* Implement initialization of Cloud Logger
* Edit SetupLogger method;
* Edit comments for methods
* Refactoring code;
Co-authored-by: daria-malkova
---
playground/backend/cmd/server/server.go| 3 +
.../backend/internal/environment/application.go| 20 +-
.../internal/environment/application_test.go | 82 ++
.../internal/environment/environment_service.go| 7 +-
.../environment/environment_service_test.go| 21 --
.../internal/logger/cloud_logging_handler.go | 1 +
playground/backend/internal/logger/logger.go | 51 +++---
playground/backend/internal/logger/logger_test.go | 4 +-
playground/backend/internal/logger/std_handler.go | 78
9 files changed, 233 insertions(+), 34 deletions(-)
diff --git a/playground/backend/cmd/server/server.go
b/playground/backend/cmd/server/server.go
index 143764b..4b47c78 100644
--- a/playground/backend/cmd/server/server.go
+++ b/playground/backend/cmd/server/server.go
@@ -36,6 +36,9 @@ func runServer() error {
if err != nil {
return err
}
+
+ logger.SetupLogger(ctx, envService.ApplicationEnvs.LaunchSite(),
envService.ApplicationEnvs.GoogleProjectId())
+
grpcServer := grpc.NewServer()
cacheService, err := setupCache(ctx, envService.ApplicationEnvs)
diff --git a/playground/backend/internal/environment/application.go
b/playground/backend/internal/environment/application.go
index 119f812..58665ea 100644
--- a/playground/backend/internal/environment/application.go
+++ b/playground/backend/internal/environment/application.go
@@ -90,14 +90,22 @@ type ApplicationEnvs struct {
// pipelineExecuteTimeout is timeout for code processing
pipelineExecuteTimeout time.Duration
+
+ // launchSite is a launch site of application
+ launchSite string
+
+ // projectId is the Google Сloud project id
+ projectId string
}
// NewApplicationEnvs constructor for ApplicationEnvs
-func NewApplicationEnvs(workingDir string, cacheEnvs *CacheEnvs,
pipelineExecuteTimeout time.Duration) *ApplicationEnvs {
+func NewApplicationEnvs(workingDir, launchSite, projectId string, cacheEnvs
*CacheEnvs, pipelineExecuteTimeout time.Duration) *ApplicationEnvs {
return &ApplicationEnvs{
workingDir: workingDir,
cacheEnvs: cacheEnvs,
pipelineExecuteTimeout: pipelineExecuteTimeout,
+ launchSite: launchSite,
+ projectId: projectId,
}
}
@@ -115,3 +123,13 @@ func (ae *ApplicationEnvs) CacheEnvs() *CacheEnvs {
func (ae *ApplicationEnvs) PipelineExecuteTimeout() time.Duration {
return ae.pipelineExecuteTimeout
}
+
+// LaunchSite returns launch site of application
+func (ae *ApplicationEnvs) LaunchSite() string {
+ return ae.launchSite
+}
+
+// GoogleProjectId returns Google Сloud project id
+func (ae *ApplicationEnvs) GoogleProjectId() string {
+ return ae.projectId
+}
diff --git a/playground/backend/internal/environment/application_test.go
b/playground/backend/internal/environment/application_test.go
index c023fcf..4c6d062 100644
--- a/playground/backend/internal/environment/application_test.go
+++ b/playground/backend/internal/environment/application_test.go
@@ -260,3 +260,85 @@ func TestApplicationEnvs_PipelineExecuteTimeout(t
*testing.T) {
})
}
}
+
+func TestApplicationEnvs_LaunchSite(t *testing.T) {
+ type fields struct {
+ workingDir string
+ cacheEnvs *CacheEnvs
+ pipelineExecuteTimeout time.Duration
+ launchSite string
+ googleProjectIdstring
+ }
+ tests := []struct {
+ name string
+ fields fields
+ want string
+ }{
+ {
+ // Test case with calling LaunchSite method.
+ // As a result, want to receive an expected launch site.
+ name: "get launch site",
+ fields: fields{
+ workingDir: "",
+ cacheEnvs: &CacheEnvs{},
+
[beam] branch master updated (402bb56 -> ec4c7ee)
This is an automated email from the ASF dual-hosted git repository. pabloem pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 402bb56 Merge pull request #16283 from [BEAM-13448] [Playground] track run code time to the analytics add ec4c7ee Merge pull request #16244 from [BEAM-13463] [Playground] add retries to check status for run code No new revisions were added by this update. Summary of changes: .../components/pipeline_options_text_field.dart| 3 +- .../code_client/grpc_code_client.dart | 21 +++-- .../code_repository/code_repository.dart | 12 ++- .../code_repository/run_code_result.dart | 2 +- .../components/playground_page_providers.dart | 8 +- playground/frontend/lib/utils/run_with_retry.dart | 52 .../frontend/test/utils/run_with_retry_test.dart | 95 ++ 7 files changed, 179 insertions(+), 14 deletions(-) create mode 100644 playground/frontend/lib/utils/run_with_retry.dart create mode 100644 playground/frontend/test/utils/run_with_retry_test.dart
[beam] branch master updated: Merge pull request #16283 from [BEAM-13448] [Playground] track run code time to the analytics
This is an automated email from the ASF dual-hosted git repository.
pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 402bb56 Merge pull request #16283 from [BEAM-13448] [Playground]
track run code time to the analytics
402bb56 is described below
commit 402bb56483148d8e09cdbc3fdd270493628a7cd4
Author: Aydar Farrakhov
AuthorDate: Wed Dec 22 01:46:01 2021 +0300
Merge pull request #16283 from [BEAM-13448] [Playground] track run code
time to the analytics
* [BEAM-13448]: playground - track run time
* [BEAM-13448]: remove pring
* [BEAM-13448]: fix tracking run time example name
---
.../frontend/lib/modules/analytics/analytics_events.dart | 1 +
.../lib/modules/analytics/analytics_service.dart | 16 ++--
.../playground/components/editor_textarea_wrapper.dart | 12 +++-
.../lib/pages/playground/states/playground_state.dart| 5 -
4 files changed, 30 insertions(+), 4 deletions(-)
diff --git a/playground/frontend/lib/modules/analytics/analytics_events.dart
b/playground/frontend/lib/modules/analytics/analytics_events.dart
index 0f747b8..cd68f24 100644
--- a/playground/frontend/lib/modules/analytics/analytics_events.dart
+++ b/playground/frontend/lib/modules/analytics/analytics_events.dart
@@ -32,4 +32,5 @@ const kOpenShortcutsModalEvent = 'open_shortcuts_modal';
const kOpenLinkEvent = 'open_link';
const kClickEnjoyPlaygroundEvent = 'click_enjoy_playground';
const kClickRunEvent = 'click_run';
+const kRunTimeEvent = 'run_time';
const kClickReportIssueEvent = 'click_report_issue';
diff --git a/playground/frontend/lib/modules/analytics/analytics_service.dart
b/playground/frontend/lib/modules/analytics/analytics_service.dart
index fc746ea..865191b 100644
--- a/playground/frontend/lib/modules/analytics/analytics_service.dart
+++ b/playground/frontend/lib/modules/analytics/analytics_service.dart
@@ -31,7 +31,7 @@ class AnalyticsService {
_analytics = AnalyticsHtml(kAnalyticsUA, 'beam', '1.0');
}
- static get(BuildContext context) {
+ static AnalyticsService get(BuildContext context) {
return Provider.of(context, listen: false);
}
@@ -99,12 +99,24 @@ class AnalyticsService {
);
}
- void safeSendEvent(String category, String action, {String? label}) {
+ void trackRunTimeEvent(String exampleName, int runTimeMs) {
+safeSendEvent(
+ kRunCodeCategory,
+ kRunTimeEvent,
+ label: exampleName,
+ value: runTimeMs,
+);
+ }
+
+ void safeSendEvent(String category, String action,
+ {String? label, int? value, Map? parameters}) {
try {
_analytics.sendEvent(
category,
action,
label: label,
+value: value,
+parameters: parameters,
);
} catch (e) {
// ignore analytics errors sync they don't affect app
diff --git
a/playground/frontend/lib/pages/playground/components/editor_textarea_wrapper.dart
b/playground/frontend/lib/pages/playground/components/editor_textarea_wrapper.dart
index 3e2e916..c5719ba 100644
---
a/playground/frontend/lib/pages/playground/components/editor_textarea_wrapper.dart
+++
b/playground/frontend/lib/pages/playground/components/editor_textarea_wrapper.dart
@@ -29,6 +29,7 @@ import
'package:playground/pages/playground/states/playground_state.dart';
import 'package:provider/provider.dart';
const kNotificationTitle = 'Run Code';
+const kUnknownExamplePrefix = 'Unknown Example';
class CodeTextAreaWrapper extends StatelessWidget {
const CodeTextAreaWrapper({Key? key}) : super(key: key);
@@ -67,7 +68,16 @@ class CodeTextAreaWrapper extends StatelessWidget {
child: RunButton(
isRunning: state.isCodeRunning,
runCode: () {
- state.runCode();
+ final stopwatch = Stopwatch()..start();
+ state.runCode(
+onFinish: () {
+ AnalyticsService.get(context).trackRunTimeEvent(
+state.selectedExample?.path ??
+'$kUnknownExamplePrefix, sdk
${state.sdk.displayName}',
+stopwatch.elapsedMilliseconds,
+ );
+},
+ );
AnalyticsService.get(context)
.trackClickRunEvent(state.selectedExample);
},
diff --git
a/playground/frontend/lib/pages/playground/states/playground_state.dart
b/playground/frontend/lib/pages/playground/states/playground_state.dart
index 93747b0..b2021ca 100644
--- a/playground/frontend/lib/pages/playground/states/playground_state.dart
+++ b/playground/frontend/lib/pages/playground/states/playground_state.dart
@@ -110,7 +110,7 @@ class PlaygroundState with ChangeNotifier {
[beam] branch master updated: Merge pull request #16304 from [BEAM-13491] [Playground] Examples' catalog doesn't close after selecting example
This is an automated email from the ASF dual-hosted git repository.
pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new c5fbe47 Merge pull request #16304 from [BEAM-13491] [Playground]
Examples' catalog doesn't close after selecting example
c5fbe47 is described below
commit c5fbe47101ce81502b7d9f842c20dcf9e396f3df
Author: Alexandr Zhuravlev
AuthorDate: Wed Dec 22 02:45:32 2021 +0400
Merge pull request #16304 from [BEAM-13491] [Playground] Examples' catalog
doesn't close after selecting example
* [BEAM-13491] Improved example catalog (now it's closing when you choose
an example)
* [BEAM-13491] Created closeDropdown function
---
.../example_list/category_expansion_panel.dart | 10 +-
.../examples/components/example_list/example_list.dart | 6 ++
.../components/example_list/expansion_panel_item.dart | 16 +++-
.../lib/modules/examples/example_selector.dart | 18 --
4 files changed, 42 insertions(+), 8 deletions(-)
diff --git
a/playground/frontend/lib/modules/examples/components/example_list/category_expansion_panel.dart
b/playground/frontend/lib/modules/examples/components/example_list/category_expansion_panel.dart
index f5e51a5..ec7278b4 100644
---
a/playground/frontend/lib/modules/examples/components/example_list/category_expansion_panel.dart
+++
b/playground/frontend/lib/modules/examples/components/example_list/category_expansion_panel.dart
@@ -26,11 +26,15 @@ import
'package:playground/modules/examples/components/example_list/expansion_pa
class CategoryExpansionPanel extends StatelessWidget {
final String categoryName;
final List examples;
+ final AnimationController animationController;
+ final OverlayEntry? dropdown;
const CategoryExpansionPanel({
Key? key,
required this.categoryName,
required this.examples,
+required this.animationController,
+required this.dropdown,
}) : super(key: key);
@override
@@ -70,7 +74,11 @@ class CategoryExpansionPanel extends StatelessWidget {
List items = [];
for (var example in examples) {
items.add(
-ExpansionPanelItem(example: example),
+ExpansionPanelItem(
+ example: example,
+ animationController: animationController,
+ dropdown: dropdown,
+),
);
}
return items;
diff --git
a/playground/frontend/lib/modules/examples/components/example_list/example_list.dart
b/playground/frontend/lib/modules/examples/components/example_list/example_list.dart
index 72c5172..e635181 100644
---
a/playground/frontend/lib/modules/examples/components/example_list/example_list.dart
+++
b/playground/frontend/lib/modules/examples/components/example_list/example_list.dart
@@ -23,10 +23,14 @@ import 'package:provider/provider.dart';
class ExampleList extends StatelessWidget {
final ScrollController controller;
+ final AnimationController animationController;
+ final OverlayEntry? dropdown;
const ExampleList({
Key? key,
required this.controller,
+required this.animationController,
+required this.dropdown,
}) : super(key: key);
@override
@@ -44,6 +48,8 @@ class ExampleList extends StatelessWidget {
itemBuilder: (context, index) => CategoryExpansionPanel(
categoryName: state.categories[index].name,
examples: state.categories[index].examples,
+animationController: animationController,
+dropdown: dropdown,
),
controller: controller,
shrinkWrap: true,
diff --git
a/playground/frontend/lib/modules/examples/components/example_list/expansion_panel_item.dart
b/playground/frontend/lib/modules/examples/components/example_list/expansion_panel_item.dart
index 5f2c041..fead89b 100644
---
a/playground/frontend/lib/modules/examples/components/example_list/expansion_panel_item.dart
+++
b/playground/frontend/lib/modules/examples/components/example_list/expansion_panel_item.dart
@@ -26,8 +26,15 @@ import 'package:provider/provider.dart';
class ExpansionPanelItem extends StatelessWidget {
final ExampleModel example;
+ final AnimationController animationController;
+ final OverlayEntry? dropdown;
- const ExpansionPanelItem({Key? key, required this.example}) : super(key:
key);
+ const ExpansionPanelItem({
+Key? key,
+required this.example,
+required this.animationController,
+required this.dropdown,
+ }) : super(key: key);
@override
Widget build(BuildContext context) {
@@ -37,6 +44,7 @@ class ExpansionPanelItem extends StatelessWidget {
child: GestureDetector(
onTap: () async {
if (playgroundState.selectedExample != example) {
+ closeDropdown(exampleState);
final exampleWithInfo = await exampleState.loadE
[beam] branch master updated: [BEAM-13430] Remove propdeps and replace with compileOnly (#16308)
This is an automated email from the ASF dual-hosted git repository.
bhulette pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new 2e72638 [BEAM-13430] Remove propdeps and replace with compileOnly
(#16308)
2e72638 is described below
commit 2e72638c6b08631bbb9a29e6c24f97043ffd0a31
Author: dpcollins-google <40498610+dpcollins-goo...@users.noreply.github.com>
AuthorDate: Tue Dec 21 17:02:12 2021 -0500
[BEAM-13430] Remove propdeps and replace with compileOnly (#16308)
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
* [BEAM-13430] Remove propdeps and replace with compileOnly
Still generate provided in the output POM
---
buildSrc/build.gradle.kts | 1 -
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 16 ++-
examples/java/build.gradle | 4 +--
examples/java/twitter/build.gradle | 4 +--
examples/kotlin/build.gradle | 2 +-
ownership/JAVA_DEPENDENCY_OWNERS.yaml | 5
runners/direct-java/build.gradle | 4 +--
runners/flink/flink_runner.gradle | 3 +-
.../worker/legacy-worker/build.gradle | 16 ---
.../dataflow/worker/status/DebugCapture.java | 4 +--
runners/java-fn-execution/build.gradle | 5 ++--
runners/spark/job-server/spark_job_server.gradle | 4 +--
runners/spark/spark_runner.gradle | 29 +---
sdks/java/container/build.gradle | 2 +-
sdks/java/core/build.gradle| 12
.../google-cloud-platform-core/build.gradle| 4 +--
sdks/java/extensions/ml/build.gradle | 2 +-
sdks/java/extensions/sorter/build.gradle | 6 ++--
sdks/java/extensions/sql/build.gradle | 32 --
sdks/java/extensions/sql/datacatalog/build.gradle | 14 --
sdks/java/extensions/sql/hcatalog/build.gradle | 7 +++--
.../provider/hcatalog/BeamSqlHiveSchemaTest.java | 5
sdks/java/extensions/sql/jdbc/build.gradle | 7 +
sdks/java/extensions/sql/zetasql/build.gradle | 2 +-
sdks/java/fn-execution/build.gradle| 2 +-
sdks/java/io/debezium/build.gradle | 2 +-
sdks/java/io/hadoop-common/build.gradle| 9 --
sdks/java/io/hadoop-file-system/build.gradle | 6 ++--
sdks/java/io/hadoop-format/build.gradle| 9 --
sdks/java/io/hbase/build.gradle| 2 +-
sdks/java/io/hcatalog/build.gradle | 13 +
sdks/java/io/kafka/build.gradle| 11
sdks/java/io/parquet/build.gradle | 3 +-
sdks/java/io/rabbitmq/build.gradle | 2 +-
sdks/java/testing/tpcds/build.gradle | 2 +-
35 files changed, 147 insertions(+), 104 deletions(-)
diff --git a/buildSrc/build.gradle.kts b/buildSrc/build.gradle.kts
index 47df89e..3339eba 100644
--- a/buildSrc/build.gradle.kts
+++ b/buildSrc/build.gradle.kts
@@ -43,7 +43,6 @@ dependencies {
runtimeOnly("net.ltgt.gradle:gradle-apt-plugin:0.21")
// Enable a Java annotation processor
runtimeOnly("com.google.protobuf:protobuf-gradle-plugin:0.8.13")
// Enable proto code generation
- runtimeOnly("io.spring.gradle:propdeps-plugin:0.0.9.RELEASE")
// Enable provided and optional configurations
runtimeOnly("com.commercehub.gradle.plugin:gradle-avro-plugin:0.11.0")
// Enable Avro code generation
runtimeOnly("com.diffplug.spotless:spotless-plugin-gradle:5.6.1")
// Enable a code formatting plugin
run
[beam] 01/01: Merge pull request #16310 from apache/aaltay-patch-1
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit b3ba7b5e93d768032f18ea6773df2e76d05dfaa2 Merge: 59bc389 efa8983 Author: Ahmet Altay AuthorDate: Tue Dec 21 13:03:29 2021 -0800 Merge pull request #16310 from apache/aaltay-patch-1 .test-infra/dataproc/flink_cluster.sh | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[beam] branch master updated (59bc389 -> b3ba7b5)
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 59bc389 [BEAM-13397] Bump numpy to 1.21 for M1 chip #16227 add efa8983 Update flink cluster to use a supported dataproc version (1.2 -> 1.5) new b3ba7b5 Merge pull request #16310 from apache/aaltay-patch-1 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .test-infra/dataproc/flink_cluster.sh | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[beam] 01/01: [release-2.35.0][BEAM-13499] Add warning about log4j to hcatalog javadoc #16311
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch release-2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 1ff38aac6b3232d8b8bc7c1dc1d2c4e5901515e8 Merge: 6106fbc f615f28 Author: tvalentyn AuthorDate: Tue Dec 21 11:56:53 2021 -0800 [release-2.35.0][BEAM-13499] Add warning about log4j to hcatalog javadoc #16311 .../extensions/sql/meta/provider/hcatalog/package-info.java | 11 ++- .../main/java/org/apache/beam/sdk/io/hcatalog/HCatalogIO.java | 7 +++ .../java/org/apache/beam/sdk/io/hcatalog/package-info.java| 11 ++- 3 files changed, 27 insertions(+), 2 deletions(-)
[beam] branch release-2.35.0 updated (6106fbc -> 1ff38aa)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch release-2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from 6106fbc [BEAM-13434] Pin transitive log4j dependencies to 2.17.0 in ...:hcatalog modules. #16302 add f615f28 Add warning to hcatalog javadoc new 1ff38aa [release-2.35.0][BEAM-13499] Add warning about log4j to hcatalog javadoc #16311 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../extensions/sql/meta/provider/hcatalog/package-info.java | 11 ++- .../main/java/org/apache/beam/sdk/io/hcatalog/HCatalogIO.java | 7 +++ .../java/org/apache/beam/sdk/io/hcatalog/package-info.java| 11 ++- 3 files changed, 27 insertions(+), 2 deletions(-)
[beam] branch master updated (97a1556 -> 59bc389)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 97a1556 [BEAM-13499] Add warning about hcatalog to release notes and javadoc (#16297) add d845a00 [BEAM-13397] Bump numpy to 1.21 for M1 chip add 37428b3 re-generate requirements.txt add 59bc389 [BEAM-13397] Bump numpy to 1.21 for M1 chip #16227 No new revisions were added by this update. Summary of changes: .../container/py36/base_image_requirements.txt | 26 - .../container/py37/base_image_requirements.txt | 34 +++--- .../container/py38/base_image_requirements.txt | 34 +++--- sdks/python/setup.py | 2 +- 4 files changed, 48 insertions(+), 48 deletions(-)
[beam] branch master updated (c4dd8f4 -> 97a1556)
This is an automated email from the ASF dual-hosted git repository. bhulette pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from c4dd8f4 Merge pull request #16295 from ibzib/BEAM-13498 add 97a1556 [BEAM-13499] Add warning about hcatalog to release notes and javadoc (#16297) No new revisions were added by this update. Summary of changes: CHANGES.md| 2 +- .../extensions/sql/meta/provider/hcatalog/package-info.java | 11 ++- .../main/java/org/apache/beam/sdk/io/hcatalog/HCatalogIO.java | 7 +++ .../java/org/apache/beam/sdk/io/hcatalog/package-info.java| 11 ++- 4 files changed, 28 insertions(+), 3 deletions(-)
[beam] branch master updated: [BEAM-13498] Sickbay portable Flink testProcessElementSkew.
This is an automated email from the ASF dual-hosted git repository. ibzib pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new c03b4b5e [BEAM-13498] Sickbay portable Flink testProcessElementSkew. new c4dd8f4 Merge pull request #16295 from ibzib/BEAM-13498 c03b4b5e is described below commit c03b4b5ef7d70f00082cbc42c64e281993fab2f8 Author: Kyle Weaver AuthorDate: Mon Dec 20 15:46:01 2021 -0800 [BEAM-13498] Sickbay portable Flink testProcessElementSkew. --- runners/flink/job-server/flink_job_server.gradle | 2 ++ 1 file changed, 2 insertions(+) diff --git a/runners/flink/job-server/flink_job_server.gradle b/runners/flink/job-server/flink_job_server.gradle index f00f244..41407e8 100644 --- a/runners/flink/job-server/flink_job_server.gradle +++ b/runners/flink/job-server/flink_job_server.gradle @@ -192,6 +192,8 @@ def portableValidatesRunnerTask(String name, Boolean streaming, Boolean checkpoi excludeTestsMatching 'org.apache.beam.sdk.testing.TestStreamTest.testLateDataAccumulating' // TODO(BEAM-12710) excludeTestsMatching 'org.apache.beam.sdk.testing.TestStreamTest.testFirstElementLate' + // TODO(BEAM-12498) + excludeTestsMatching 'org.apache.beam.sdk.transforms.ParDoTest$TimestampTests.testProcessElementSkew' }, ) }
[beam] branch aaltay-patch-1 created (now efa8983)
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to branch aaltay-patch-1 in repository https://gitbox.apache.org/repos/asf/beam.git. at efa8983 Update flink cluster to use a supported dataproc version (1.2 -> 1.5) No new revisions were added by this update.
[beam] branch master updated (c970da3 -> 4a356da)
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from c970da3 Merge pull request #16305 from [BEAM-13502] [Playground] [Bugfix] showing a selected example on the embedded version of the playground add 4a356da [BEAM-13430] Introduce new testRuntimeMigration configuration that mirrors what testRuntime used to do. (#16307) No new revisions were added by this update. Summary of changes: .test-infra/validate-runner/build.gradle | 2 +- .../org/apache/beam/gradle/BeamModulePlugin.groovy | 35 +- examples/java/build.gradle | 2 +- examples/java/twitter/build.gradle | 2 +- examples/kotlin/build.gradle | 2 +- runners/core-construction-java/build.gradle| 2 +- runners/direct-java/build.gradle | 10 +++ runners/flink/flink_runner.gradle | 4 +-- runners/flink/job-server/flink_job_server.gradle | 6 ++-- runners/google-cloud-dataflow-java/build.gradle| 12 .../examples-streaming/build.gradle| 2 +- .../examples/build.gradle | 2 +- .../google-cloud-dataflow-java/worker/build.gradle | 4 +-- .../worker/legacy-worker/build.gradle | 4 +-- runners/java-fn-execution/build.gradle | 2 +- runners/jet/build.gradle | 16 +- runners/portability/java/build.gradle | 6 ++-- runners/samza/build.gradle | 4 +-- runners/samza/job-server/build.gradle | 6 ++-- runners/spark/job-server/spark_job_server.gradle | 6 ++-- runners/spark/spark_runner.gradle | 8 ++--- runners/twister2/build.gradle | 2 +- sdks/java/extensions/ml/build.gradle | 3 +- sdks/java/extensions/sql/build.gradle | 7 +++-- sdks/java/extensions/sql/jdbc/build.gradle | 3 +- sdks/java/extensions/sql/perf-tests/build.gradle | 6 ++-- sdks/java/harness/build.gradle | 2 +- sdks/java/io/amazon-web-services/build.gradle | 5 ++-- sdks/java/io/amazon-web-services2/build.gradle | 5 ++-- sdks/java/io/bigquery-io-perf-tests/build.gradle | 12 sdks/java/io/cassandra/build.gradle| 2 +- sdks/java/io/debezium/build.gradle | 2 +- .../elasticsearch-tests-5/build.gradle | 4 +-- .../elasticsearch-tests-6/build.gradle | 4 +-- .../elasticsearch-tests-7/build.gradle | 4 +-- .../elasticsearch-tests-common/build.gradle| 2 +- sdks/java/io/elasticsearch/build.gradle| 2 +- sdks/java/io/file-based-io-tests/build.gradle | 11 --- sdks/java/io/google-cloud-platform/build.gradle| 8 ++--- sdks/java/io/hadoop-format/build.gradle| 16 +- sdks/java/io/hbase/build.gradle| 2 +- sdks/java/io/influxdb/build.gradle | 2 +- sdks/java/io/jdbc/build.gradle | 5 ++-- sdks/java/io/kafka/build.gradle| 5 ++-- sdks/java/io/kinesis/build.gradle | 2 +- sdks/java/io/kudu/build.gradle | 2 +- sdks/java/io/mongodb/build.gradle | 5 ++-- sdks/java/io/mqtt/build.gradle | 2 +- sdks/java/io/rabbitmq/build.gradle | 2 +- sdks/java/io/redis/build.gradle| 2 +- sdks/java/io/snowflake/build.gradle| 4 +-- sdks/java/testing/jpms-tests/build.gradle | 2 +- sdks/java/testing/nexmark/build.gradle | 4 +-- sdks/java/testing/tpcds/build.gradle | 2 +- 54 files changed, 151 insertions(+), 127 deletions(-)
[beam] branch master updated: [BEAM-13502]: fix loading example on embedded version
This is an automated email from the ASF dual-hosted git repository.
pabloem pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new ea47b1f [BEAM-13502]: fix loading example on embedded version
new c970da3 Merge pull request #16305 from [BEAM-13502] [Playground]
[Bugfix] showing a selected example on the embedded version of the playground
ea47b1f is described below
commit ea47b1fb2c4c2add48feb93f95cce3c30a4924d0
Author: Aydar Farrakhov
AuthorDate: Tue Dec 21 16:17:53 2021 +0300
[BEAM-13502]: fix loading example on embedded version
---
.../lib/pages/embedded_playground/components/embedded_editor.dart| 1 +
1 file changed, 1 insertion(+)
diff --git
a/playground/frontend/lib/pages/embedded_playground/components/embedded_editor.dart
b/playground/frontend/lib/pages/embedded_playground/components/embedded_editor.dart
index 624e300..1d97ced 100644
---
a/playground/frontend/lib/pages/embedded_playground/components/embedded_editor.dart
+++
b/playground/frontend/lib/pages/embedded_playground/components/embedded_editor.dart
@@ -28,6 +28,7 @@ class EmbeddedEditor extends StatelessWidget {
Widget build(BuildContext context) {
final state = Provider.of(context);
return EditorTextArea(
+ key: ValueKey(state.selectedExample),
enabled: true,
sdk: state.sdk,
example: state.selectedExample,
[beam] branch release-2.35.0 updated (af05662 -> 6106fbc)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch release-2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from af05662 [BEAM-13388] [BEAM-13052] Cherry-pick ProtoCoder implementation onto 2.35.0 release branch. #16301 add 2bb9eb3 Pin transitive log4j dependencies to 2.17.0 in :sdks:java:io:hcatalog and :sdks:java:extensions:sql:hcatalog new 6106fbc [BEAM-13434] Pin transitive log4j dependencies to 2.17.0 in ...:hcatalog modules. #16302 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/java/extensions/sql/hcatalog/build.gradle | 14 ++ sdks/java/io/hcatalog/build.gradle | 13 - 2 files changed, 22 insertions(+), 5 deletions(-)
[beam] 01/01: [BEAM-13434] Pin transitive log4j dependencies to 2.17.0 in ...:hcatalog modules. #16302
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch release-2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit 6106fbcdd16a14b7d0d968a935f53c2988ad1408 Merge: af05662 2bb9eb3 Author: tvalentyn AuthorDate: Tue Dec 21 00:50:06 2021 -0800 [BEAM-13434] Pin transitive log4j dependencies to 2.17.0 in ...:hcatalog modules. #16302 sdks/java/extensions/sql/hcatalog/build.gradle | 14 ++ sdks/java/io/hcatalog/build.gradle | 13 - 2 files changed, 22 insertions(+), 5 deletions(-)
[beam] 01/01: [BEAM-13388] [BEAM-13052] Cherry-pick ProtoCoder implementation onto 2.35.0 release branch. #16301
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch release-2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit af056629de1f92bf9a3ca4349c5ba6436a932b5a Merge: a45d570 282a673 Author: tvalentyn AuthorDate: Tue Dec 21 00:48:33 2021 -0800 [BEAM-13388] [BEAM-13052] Cherry-pick ProtoCoder implementation onto 2.35.0 release branch. #16301 sdks/python/apache_beam/coders/coder_impl.py | 14 sdks/python/apache_beam/coders/coders.py | 40 - sdks/python/apache_beam/coders/coders_test.py | 41 ++ .../apache_beam/coders/coders_test_common.py | 4 ++- sdks/python/apache_beam/coders/typecoders.py | 4 ++- sdks/python/setup.py | 1 + 6 files changed, 101 insertions(+), 3 deletions(-)
[beam] branch release-2.35.0 updated (a45d570 -> af05662)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch release-2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git. from a45d570 [BEAM-13496] [cp] Upgrade Flink runner to include log4j patches. #16300 add 282a673 [BEAM-13388] [BEAM-13052] Cherry-pick ProtoCoder implementation onto 2.35.0 release branch. new af05662 [BEAM-13388] [BEAM-13052] Cherry-pick ProtoCoder implementation onto 2.35.0 release branch. #16301 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: sdks/python/apache_beam/coders/coder_impl.py | 14 sdks/python/apache_beam/coders/coders.py | 40 - sdks/python/apache_beam/coders/coders_test.py | 41 ++ .../apache_beam/coders/coders_test_common.py | 4 ++- sdks/python/apache_beam/coders/typecoders.py | 4 ++- sdks/python/setup.py | 1 + 6 files changed, 101 insertions(+), 3 deletions(-)
