Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #517

See

[jira] [Updated] (BEAM-333) Support "stop" for streaming pipelines

[ https://issues.apache.org/jira/browse/BEAM-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emanuele Cesena updated BEAM-333: - Description: Run: {code} $ flink run -c org.apache.beam.runners.flink.examples.streaming.KafkaWindo

[jira] [Created] (BEAM-333) Support "stop" for streaming pipelines

Emanuele Cesena created BEAM-333: Summary: Support "stop" for streaming pipelines Key: BEAM-333 URL: https://issues.apache.org/jira/browse/BEAM-333 Project: Beam Issue Type: Bug Com

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #516

See

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323753#comment-15323753 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[1/3] incubator-beam git commit: Execute NeedsRunner tests in the Direct Runner

Repository: incubator-beam Updated Branches: refs/heads/master d53e96a0d -> 829121960 Execute NeedsRunner tests in the Direct Runner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9e797e3d Tree: http://g

[3/3] incubator-beam git commit: This closes #392

This closes #392 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/82912196 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/82912196 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[2/3] incubator-beam git commit: Use a DirectExecutor for Watermark Callbacks

Use a DirectExecutor for Watermark Callbacks This fixes a resource leak where the executor service is not properly shut down with the rest of the DirectRunner. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit

[GitHub] incubator-beam pull request #392: [BEAM-22][BEAM-243] Execute NeedsRunner te...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/392 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #515

See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #514

See

[GitHub] incubator-beam pull request #443: Expand set of dependencies to scan for Run...

Github user kennknowles closed the pull request at: https://github.com/apache/incubator-beam/pull/443 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[incubator-beam] Git Push Summary

Repository: incubator-beam Updated Branches: refs/heads/python-sdk [created] d53e96a0d

[GitHub] incubator-beam pull request #406: [BEAM-155] Use custom Assertions in Spark ...

Github user tgroh closed the pull request at: https://github.com/apache/incubator-beam/pull/406 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-155) Support asserting the contents of windows and panes in PAssert

[ https://issues.apache.org/jira/browse/BEAM-155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323470#comment-15323470 ] ASF GitHub Bot commented on BEAM-155: - Github user tgroh closed the pull request at:

[jira] [Resolved] (BEAM-317) Implement PAssert without using Side Inputs

[ https://issues.apache.org/jira/browse/BEAM-317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-317. -- Resolution: Fixed > Implement PAssert without using Side Inputs >

[GitHub] incubator-beam pull request #437: [BEAM-317] Base PAssert on GBK instead of ...

Github user kennknowles closed the pull request at: https://github.com/apache/incubator-beam/pull/437 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Commented] (BEAM-317) Implement PAssert without using Side Inputs

[ https://issues.apache.org/jira/browse/BEAM-317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323456#comment-15323456 ] ASF GitHub Bot commented on BEAM-317: - Github user kennknowles closed the pull request a

[2/4] incubator-beam git commit: Fix TriggerExampleTest

Fix TriggerExampleTest Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/77aa0938 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/77aa0938 Diff: http://git-wip-us.apache.org/repos/asf/incubator

[3/4] incubator-beam git commit: Switch Spark streaming tests to custom assertions

Switch Spark streaming tests to custom assertions The current use of PAssert in the streaming tests for the Spark runner work via coincidence. PAssert does not truly support non-global windowing. The switch from side inputs to GBK, with no change in semantics but hopefully an easier on-ramp for ne

[4/4] incubator-beam git commit: Base PAssert on GBK instead of side inputs

Base PAssert on GBK instead of side inputs Previously PAssert - hence all RunnableOnService/NeedsRunner tests - required side input support. This created a very steep on ramp for new runners. GroupByKey is a bit more fundamental and most backends will be able to group by key in the global window

[1/4] incubator-beam git commit: Spark runner: Assign windows when re-windowing into global window

Repository: incubator-beam Updated Branches: refs/heads/master d6adbbf96 -> d53e96a0d Spark runner: Assign windows when re-windowing into global window Previously, window assignment was elided when the window was the global window. But when the source windows are not the global window, this el

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #513

See

[GitHub] incubator-beam pull request #443: Expand set of dependencies to scan for Run...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/443 Expand set of dependencies to scan for RunnableOnService tests Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sur

[jira] [Created] (BEAM-332) Matcher(s) for TableRow

Kenneth Knowles created BEAM-332: Summary: Matcher(s) for TableRow Key: BEAM-332 URL: https://issues.apache.org/jira/browse/BEAM-332 Project: Beam Issue Type: New Feature Components

[GitHub] incubator-beam pull request #442: Add BigDecimalCoder and BigIntegerCoder

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/442 Add BigDecimalCoder and BigIntegerCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is forma

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #512

See

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323189#comment-15323189 ] ASF GitHub Bot commented on BEAM-22: Github user asfgit closed the pull request at:

[2/2] incubator-beam git commit: This closes #435

This closes #435 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d6adbbf9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d6adbbf9 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[GitHub] incubator-beam pull request #435: [BEAM-22] Shutdown the InProcessPipelineRu...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/435 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: Shutdown the InProcessPipelineRunner after Terminating Abnormally

Repository: incubator-beam Updated Branches: refs/heads/master 983d467a7 -> d6adbbf96 Shutdown the InProcessPipelineRunner after Terminating Abnormally Ensure that the executor service is shutdown, and the monitor is not rescheduled, after an exception is thrown. Project: http://git-wip-us.a

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #511

See

[jira] [Commented] (BEAM-331) WindowedWordCount.AddTimestampFn has nondeterministic timestamp bounds

[ https://issues.apache.org/jira/browse/BEAM-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15323056#comment-15323056 ] ASF GitHub Bot commented on BEAM-331: - GitHub user swegner opened a pull request: h

[GitHub] incubator-beam pull request #441: [BEAM-331] Make AddTimestampFn range deter...

GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/441 [BEAM-331] Make AddTimestampFn range deterministic Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title i

[jira] [Created] (BEAM-331) WindowedWordCount.AddTimestampFn has nondeterministic timestamp bounds

Scott Wegner created BEAM-331: - Summary: WindowedWordCount.AddTimestampFn has nondeterministic timestamp bounds Key: BEAM-331 URL: https://issues.apache.org/jira/browse/BEAM-331 Project: Beam Is

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #510

See

[GitHub] incubator-beam pull request #440: [BEAM-???] Modify range tracker to use fir...

GitHub user ianzhou1 opened a pull request: https://github.com/apache/incubator-beam/pull/440 [BEAM-???] Modify range tracker to use first response as start key Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make su

[jira] [Commented] (BEAM-330) Maven exec warning message on Dataflow WordCount Example

[ https://issues.apache.org/jira/browse/BEAM-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322954#comment-15322954 ] ASF GitHub Bot commented on BEAM-330: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #439: [BEAM-330] Disable exec-maven-plugin clean...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/439 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: [BEAM-330] Disable exec-maven-plugin cleanupDaemonThreads

[BEAM-330] Disable exec-maven-plugin cleanupDaemonThreads This closes #439 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/983d467a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/983d467a D

[1/2] incubator-beam git commit: Disable exec-maven-plugin cleanupDaemonThreads

Repository: incubator-beam Updated Branches: refs/heads/master 39da22c76 -> 983d467a7 Disable exec-maven-plugin cleanupDaemonThreads exec-maven-plugin has a bad interaction with DataflowPipelineRunner when waiting on daemon threads. When running example pipelines, Maven will emit a warning say

[jira] [Commented] (BEAM-159) Support fixed number of shards in custom sinks

[ https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322846#comment-15322846 ] ASF GitHub Bot commented on BEAM-159: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #436: Raise error rather than overwrite data whe...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/436 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: FileBasedSink: Detect bad shard name templates

Repository: incubator-beam Updated Branches: refs/heads/master 61d8cf2c4 -> 39da22c76 FileBasedSink: Detect bad shard name templates This is particularly relevant when TextIO.Write.withoutSharding() is used: [BEAM-159]. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Comm

[2/2] incubator-beam git commit: Closes #436

Closes #436 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/39da22c7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/39da22c7 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[jira] [Created] (BEAM-330) Maven exec warning message on Dataflow WordCount Example

Scott Wegner created BEAM-330: - Summary: Maven exec warning message on Dataflow WordCount Example Key: BEAM-330 URL: https://issues.apache.org/jira/browse/BEAM-330 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-330) Maven exec warning message on Dataflow WordCount Example

[ https://issues.apache.org/jira/browse/BEAM-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322745#comment-15322745 ] ASF GitHub Bot commented on BEAM-330: - GitHub user swegner opened a pull request: h

[GitHub] incubator-beam pull request #439: [BEAM-330] Disable exec-maven-plugin clean...

GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/439 [BEAM-330] Disable exec-maven-plugin cleanupDaemonThreads Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Created] (BEAM-329) README cluster example not working with HDFS input

Amit Sela created BEAM-329: -- Summary: README cluster example not working with HDFS input Key: BEAM-329 URL: https://issues.apache.org/jira/browse/BEAM-329 Project: Beam Issue Type: Bug Com

[jira] [Updated] (BEAM-329) README cluster example not working with HDFS input

[ https://issues.apache.org/jira/browse/BEAM-329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-329: --- Affects Version/s: 0.1.0-incubating > README cluster example not working with HDFS input > -

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #509

See

Jenkins build is back to normal : beam_PostCommit_MavenVerify #601

See

Jenkins build is back to normal : beam_PostCommit_MavenVerify » Apache Beam :: Runners :: Flink :: Core #601

See

Build failed in Jenkins: beam_PostCommit_MavenVerify #600

See -- [...truncated 6122 lines...] [INFO] Downloaded: https://repo.maven.apache.org/maven2/commons-daemon/commons-daemon/1.0.13/commons-daemon-1.0.13.jar (24 KB at 19.2 KB/sec) [INFO] Downlo

Build failed in Jenkins: beam_PostCommit_MavenVerify » Apache Beam :: Runners :: Flink :: Core #600

See -- [INFO] [INFO] --

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #508

See