[jira] [Closed] (BEAM-305) In Spark runner tests - When using Create.of use it's #withCoder method instead of the created PCollection's #setCoder

[ https://issues.apache.org/jira/browse/BEAM-305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-305. -- Resolution: Fixed > In Spark runner tests - When using Create.of use it's #withCoder method > instead of the crea

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301256#comment-15301256 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request: https:

[GitHub] incubator-beam pull request: [BEAM-22][BEAM-243] Execute NeedsRunn...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/392 [BEAM-22][BEAM-243] Execute NeedsRunner tests in the DirectRunner module Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #419

See

[jira] [Updated] (BEAM-117) Implement the API for Static Display Metadata

[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-117: -- Assignee: Scott Wegner (was: Ben Chambers) > Implement the API for Static Display Metadata >

[jira] [Resolved] (BEAM-117) Implement the API for Static Display Metadata

[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers resolved BEAM-117. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Implement the API for Static Display Metadata

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #418

See

[jira] [Commented] (BEAM-122) GlobalWindow and allowedLateness can cause inconsistent timer interpretation

[ https://issues.apache.org/jira/browse/BEAM-122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300969#comment-15300969 ] ASF GitHub Bot commented on BEAM-122: - GitHub user mshields822 opened a pull request:

[2/2] incubator-beam git commit: This closes #388

This closes #388 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d4c052c3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d4c052c3 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[jira] [Updated] (BEAM-32) Consider not emitting empty ON_TIME pane unless requested

[ https://issues.apache.org/jira/browse/BEAM-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-32: Assignee: Mark Shields (was: Kenneth Knowles) > Consider not emitting empty ON_TIME pane unless reques

[1/2] incubator-beam git commit: Clear PubsubUnboundedSource checkpoint state which is not needed for restore. Allows same checkpoint object to be passed to new reader without a serialize/deserialize

Repository: incubator-beam Updated Branches: refs/heads/master bde2a856f -> d4c052c32 Clear PubsubUnboundedSource checkpoint state which is not needed for restore. Allows same checkpoint object to be passed to new reader without a serialize/deserialize step. Project: http://git-wip-us.apach

[GitHub] incubator-beam pull request: [BEAM-122][BEAM-311] Add GC hold if h...

GitHub user mshields822 opened a pull request: https://github.com/apache/incubator-beam/pull/391 [BEAM-122][BEAM-311] Add GC hold if have data. Don't set timers beyond GlobalWindow.maxTim… R: @kennknowles You can merge this pull request into a Git repository by running: $ g

[jira] [Created] (BEAM-311) Add 'garbage collection' hold when receive late element

Mark Shields created BEAM-311: - Summary: Add 'garbage collection' hold when receive late element Key: BEAM-311 URL: https://issues.apache.org/jira/browse/BEAM-311 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-306) Make java-only PubsubIO work in InProcessRunner

[ https://issues.apache.org/jira/browse/BEAM-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300965#comment-15300965 ] ASF GitHub Bot commented on BEAM-306: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-306] Make sure PubsubUnboundedS...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/388 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Closed] (BEAM-240) Add display data link URLs for sources / sinks

[ https://issues.apache.org/jira/browse/BEAM-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-240. - Resolution: Won't Fix Closing this for now. Let's wait to get feedback from users on what the priority for

[jira] [Closed] (BEAM-249) Combine.GroupedValues re-wraps combineFn from Combine.PerKey and loses identity for DisplayData

[ https://issues.apache.org/jira/browse/BEAM-249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-249. - Resolution: Fixed Done > Combine.GroupedValues re-wraps combineFn from Combine.PerKey and loses > identity

[jira] [Closed] (BEAM-248) Register DisplayData from anonymous implementation PTransforms

[ https://issues.apache.org/jira/browse/BEAM-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-248. - Resolution: Fixed Done > Register DisplayData from anonymous implementation PTransforms > -

[jira] [Closed] (BEAM-238) Add link URLs for sources / sinks

[ https://issues.apache.org/jira/browse/BEAM-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-238. - Resolution: Fixed Closing this. > Add link URLs for sources / sinks > - > >

[jira] [Updated] (BEAM-117) Implement the API for Static Display Metadata

[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner updated BEAM-117: -- Assignee: Ben Chambers (was: Scott Wegner) > Implement the API for Static Display Metadata >

[jira] [Commented] (BEAM-117) Implement the API for Static Display Metadata

[ https://issues.apache.org/jira/browse/BEAM-117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300892#comment-15300892 ] Scott Wegner commented on BEAM-117: --- This can be closed. Assigning back to [~bchambers] >

[jira] [Closed] (BEAM-250) Exclude TextSource.minBundleSize default value from display data.

[ https://issues.apache.org/jira/browse/BEAM-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-250. - Resolution: Fixed Done > Exclude TextSource.minBundleSize default value from display data. > --

[jira] [Closed] (BEAM-251) Exclude PipelineOptions with @JsonIgnore from display data

[ https://issues.apache.org/jira/browse/BEAM-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-251. - Resolution: Fixed This is done. > Exclude PipelineOptions with @JsonIgnore from display data >

[1/2] incubator-beam git commit: Add NeedsRunner, annotate core SDK Tests

Repository: incubator-beam Updated Branches: refs/heads/master 9f97ea0a7 -> bde2a856f Add NeedsRunner, annotate core SDK Tests Core SDK tests that require a runner to run cannot be executed while building the Core SDK, as all runners depend on the Core SDK to be built. Instead, defer the execu

[GitHub] incubator-beam pull request: Add NeedsRunner, annotate core SDK Te...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/361 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: This closes #361

This closes #361 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bde2a856 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bde2a856 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #417

See

[jira] [Commented] (BEAM-305) In Spark runner tests - When using Create.of use it's #withCoder method instead of the created PCollection's #setCoder

[ https://issues.apache.org/jira/browse/BEAM-305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300863#comment-15300863 ] ASF GitHub Bot commented on BEAM-305: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-305] Replace usages of PCollect...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/386 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: [BEAM-305] Replace usages of PCollection.setCoder with Create.of().withCoder in Spark Runner

[BEAM-305] Replace usages of PCollection.setCoder with Create.of().withCoder in Spark Runner This closes #386 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f97ea0a Tree: http://git-wip-us.apache.org/repo

[1/2] incubator-beam git commit: Use Create.of withCoder instead of setCoder on the created PCollection

Repository: incubator-beam Updated Branches: refs/heads/master a3fc40aa3 -> 9f97ea0a7 Use Create.of withCoder instead of setCoder on the created PCollection One more left.. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incu

[2/2] incubator-beam git commit: This closes #390

This closes #390 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a3fc40aa Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a3fc40aa Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[1/2] incubator-beam git commit: Mark test PipelineOptions interface public

Repository: incubator-beam Updated Branches: refs/heads/master 78c8c528e -> a3fc40aa3 Mark test PipelineOptions interface public Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7abedfae Tree: http://git-w

[GitHub] incubator-beam pull request: [BEAM-308] Mark test PipelineOptions ...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/390 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300778#comment-15300778 ] ASF GitHub Bot commented on BEAM-308: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-308] Mark test PipelineOptions ...

GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/390 [BEAM-308] Mark test PipelineOptions interface public Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR titl

[jira] [Commented] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300644#comment-15300644 ] ASF GitHub Bot commented on BEAM-308: - GitHub user swegner opened a pull request: h

[jira] [Created] (BEAM-310) Exercise splitIntoBundles/generateInitialSplits in the Direct Runner

Thomas Groh created BEAM-310: Summary: Exercise splitIntoBundles/generateInitialSplits in the Direct Runner Key: BEAM-310 URL: https://issues.apache.org/jira/browse/BEAM-310 Project: Beam Issue

[jira] [Commented] (BEAM-306) Make java-only PubsubIO work in InProcessRunner

[ https://issues.apache.org/jira/browse/BEAM-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300583#comment-15300583 ] Kenneth Knowles commented on BEAM-306: -- I think there's a confusing ambiguity at [this

[jira] [Created] (BEAM-309) Need an UnboundedSourceFromHell to test runner's respect of its implied contract

Mark Shields created BEAM-309: - Summary: Need an UnboundedSourceFromHell to test runner's respect of its implied contract Key: BEAM-309 URL: https://issues.apache.org/jira/browse/BEAM-309 Project: Beam

[jira] [Commented] (BEAM-309) Need an UnboundedSourceFromHell to test runner's respect of its implied contract

[ https://issues.apache.org/jira/browse/BEAM-309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300573#comment-15300573 ] Kenneth Knowles commented on BEAM-309: -- I think step 1 here might be to take that impli

[jira] [Commented] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300563#comment-15300563 ] Scott Wegner commented on BEAM-308: --- PR with failing test cases: https://github.com/apach

[GitHub] incubator-beam pull request: Test case for package-private Pipelin...

GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/389 Test case for package-private PipelineOptions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is for

[jira] [Created] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

Scott Wegner created BEAM-308: - Summary: PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages Key: BEAM-308 URL: https://issues.apache.org/jira/browse/BEAM-308

[GitHub] incubator-beam pull request: [BEAM-306] Serialize/Deserialize chec...

GitHub user mshields822 opened a pull request: https://github.com/apache/incubator-beam/pull/388 [BEAM-306] Serialize/Deserialize checkpoints R: @dhalperi @tgroh The PubsubUnboundendSource implementation has an assertion to confirm the checkpoint from which a fresh reader

[jira] [Commented] (BEAM-306) Make java-only PubsubIO work in InProcessRunner

[ https://issues.apache.org/jira/browse/BEAM-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300312#comment-15300312 ] ASF GitHub Bot commented on BEAM-306: - GitHub user mshields822 opened a pull request:

[jira] [Commented] (BEAM-307) Upgrade/Test to Kafka 0.10

[ https://issues.apache.org/jira/browse/BEAM-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300250#comment-15300250 ] Jean-Baptiste Onofré commented on BEAM-307: --- Agree, as the KafkaIO uses version ra

[jira] [Commented] (BEAM-307) Upgrade/Test to Kafka 0.10

[ https://issues.apache.org/jira/browse/BEAM-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300147#comment-15300147 ] Aljoscha Krettek commented on BEAM-307: --- It might be that we have to create separate p

[jira] [Created] (BEAM-307) Upgrade/Test to Kafka 0.10

Jean-Baptiste Onofré created BEAM-307: - Summary: Upgrade/Test to Kafka 0.10 Key: BEAM-307 URL: https://issues.apache.org/jira/browse/BEAM-307 Project: Beam Issue Type: Task Comp