[GitHub] beam pull request #2434: [BEAM-846] Add WindowMappingFn to PCollectionView

2017-04-05 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2434 [BEAM-846] Add WindowMappingFn to PCollectionView Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Assigned] (BEAM-690) Backoff in the DirectRunner Monitor if no work is Available

2017-04-05 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-690: Assignee: (was: Thomas Groh) > Backoff in the DirectRunner Monitor if no work is Available >

[jira] [Commented] (BEAM-690) Backoff in the DirectRunner Monitor if no work is Available

2017-04-05 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957146#comment-15957146 ] Thomas Groh commented on BEAM-690: -- I'm not working on it - this mainly consists of adding

[jira] [Resolved] (BEAM-1590) DataflowRunner support for Fn API

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1590. --- Resolution: Fixed Fix Version/s: Not applicable Basic experimental support for executing

[jira] [Commented] (BEAM-1632) Current bigtable protos include google rpc generated classes in its jar

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957137#comment-15957137 ] Daniel Halperin commented on BEAM-1632: --- My understanding is the new version of Bigta

[jira] [Assigned] (BEAM-1632) Current bigtable protos include google rpc generated classes in its jar

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1632: - Assignee: (was: Daniel Halperin) > Current bigtable protos include google rpc generate

[jira] [Commented] (BEAM-690) Backoff in the DirectRunner Monitor if no work is Available

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957132#comment-15957132 ] Daniel Halperin commented on BEAM-690: -- (assigned to comment, then unassign if not work

[jira] [Assigned] (BEAM-690) Backoff in the DirectRunner Monitor if no work is Available

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-690: Assignee: (was: Daniel Halperin) > Backoff in the DirectRunner Monitor if no work is Avai

[jira] [Assigned] (BEAM-690) Backoff in the DirectRunner Monitor if no work is Available

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-690: Assignee: Thomas Groh > Backoff in the DirectRunner Monitor if no work is Available > ---

[jira] [Commented] (BEAM-1716) Using Instant type in TableRow should map to the right output format for TIMESTAMP in BigQuery

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957128#comment-15957128 ] Daniel Halperin commented on BEAM-1716: --- Would you like to send a PR with a test show

[jira] [Assigned] (BEAM-92) Data-dependent sinks

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-92: --- Assignee: Reuven Lax (was: Daniel Halperin) > Data-dependent sinks > > >

[jira] [Commented] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957130#comment-15957130 ] Ted Yu commented on BEAM-1773: -- [~kenn] [~j...@nanthrax.net]: Please provide your feedback. >

[jira] [Updated] (BEAM-1716) Using Instant type in TableRow should map to the right output format for TIMESTAMP in BigQuery

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1716: -- Labels: newbie starter (was: ) > Using Instant type in TableRow should map to the right output f

[jira] [Assigned] (BEAM-1703) Add support for local execution to PubsubIO using the google cloud emulator

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1703: - Assignee: (was: Daniel Halperin) > Add support for local execution to PubsubIO using t

[jira] [Assigned] (BEAM-1716) Using Instant type in TableRow should map to the right output format for TIMESTAMP in BigQuery

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1716: - Assignee: (was: Daniel Halperin) > Using Instant type in TableRow should map to the ri

[jira] [Updated] (BEAM-1703) Add support for local execution to PubsubIO using the google cloud emulator

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1703: -- Labels: newbie starter (was: ) > Add support for local execution to PubsubIO using the google cl

[jira] [Updated] (BEAM-1702) Add support for local execution to BigtableIO using the google cloud emulator

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1702: -- Labels: newbie starter (was: ) > Add support for local execution to BigtableIO using the google

[jira] [Assigned] (BEAM-1702) Add support for local execution to BigtableIO using the google cloud emulator

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1702: - Assignee: (was: Daniel Halperin) > Add support for local execution to BigtableIO using

[jira] [Updated] (BEAM-1703) Add support for local execution to PubsubIO using the google cloud emulator

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1703: -- Issue Type: New Feature (was: Wish) > Add support for local execution to PubsubIO using the goog

[jira] [Updated] (BEAM-1702) Add support for local execution to BigtableIO using the google cloud emulator

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1702: -- Issue Type: New Feature (was: Wish) > Add support for local execution to BigtableIO using the go

[jira] [Assigned] (BEAM-1734) Potentially unbox null pointer in AutoValue_BigQueryIO_Write

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1734: - Assignee: (was: Daniel Halperin) > Potentially unbox null pointer in AutoValue_BigQuer

[jira] [Updated] (BEAM-1734) Potentially unbox null pointer in AutoValue_BigQueryIO_Write

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1734: -- Labels: newbie starter (was: ) > Potentially unbox null pointer in AutoValue_BigQueryIO_Write >

[jira] [Commented] (BEAM-1734) Potentially unbox null pointer in AutoValue_BigQueryIO_Write

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957124#comment-15957124 ] Daniel Halperin commented on BEAM-1734: --- Hi [~te...@apache.org] -- thanks for this re

[jira] [Updated] (BEAM-1714) Null Pointer Exception when outputting a TableRow with a Null value for a key

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1714: -- Labels: newbie starter (was: ) > Null Pointer Exception when outputting a TableRow with a Null v

[jira] [Assigned] (BEAM-1714) Null Pointer Exception when outputting a TableRow with a Null value for a key

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1714: - Assignee: (was: Daniel Halperin) > Null Pointer Exception when outputting a TableRow w

[jira] [Commented] (BEAM-1714) Null Pointer Exception when outputting a TableRow with a Null value for a key

2017-04-05 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957121#comment-15957121 ] Daniel Halperin commented on BEAM-1714: --- Seems reasonable -- would you be able to sen

[jira] [Commented] (BEAM-1881) Exclude protobuf-lite everywhere

2017-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957113#comment-15957113 ] ASF GitHub Bot commented on BEAM-1881: -- GitHub user dhalperi opened a pull request:

[GitHub] beam pull request #2433: [BEAM-1881] Exclude protobuf-lite and replace with ...

2017-04-05 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2433 [BEAM-1881] Exclude protobuf-lite and replace with protobuf-java They are not compatible; protobuf-lite is only intended for use with Android. R: @iemejia Please take a look :) Y

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #2748

2017-04-05 Thread Apache Jenkins Server
See -- [...truncated 225.10 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted]

[jira] [Resolved] (BEAM-1842) Stop matching composite PCollectionView PTransforms

2017-04-05 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1842. --- Resolution: Fixed Fix Version/s: First stable release > Stop matching composite PCollectionView

[jira] [Commented] (BEAM-1842) Stop matching composite PCollectionView PTransforms

2017-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957105#comment-15957105 ] ASF GitHub Bot commented on BEAM-1842: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2373: [BEAM-1842] Add CreateViewWithViewFn PTransformMatc...

2017-04-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2373 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: This closes #2373

2017-04-05 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 646cbdb70 -> 645d0bba9 This closes #2373 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/645d0bba Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/645d0bba Diff: htt

[2/2] beam git commit: Add CreateViewWithViewFn PTransformMatcher

2017-04-05 Thread tgroh
Add CreateViewWithViewFn PTransformMatcher This matcher is to stop matching the composite View.asFoo PTransforms, as a PipelineRunner should support materialization of arbitrary PTransforms created with the CreatePCollectionView transform. Project: http://git-wip-us.apache.org/repos/asf/beam/rep

[jira] [Assigned] (BEAM-1886) Remove TextIO override in Flink runner

2017-04-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-1886: - Assignee: (was: Aljoscha Krettek) > Remove TextIO override in Flink runner > -

[jira] [Created] (BEAM-1886) Remove TextIO override in Flink runner

2017-04-05 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-1886: - Summary: Remove TextIO override in Flink runner Key: BEAM-1886 URL: https://issues.apache.org/jira/browse/BEAM-1886 Project: Beam Issue Type: Bug

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1743

2017-04-05 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2432: Update refcounts after pipeline reconstruction.

2017-04-05 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/2432 Update refcounts after pipeline reconstruction. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Commented] (BEAM-1612) Support real Bundle in Flink runner

2017-04-05 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15957028#comment-15957028 ] Kenneth Knowles commented on BEAM-1612: --- I don't have empirical opinions about the ap

Build failed in Jenkins: beam_PerformanceTests_Dataflow #272

2017-04-05 Thread Apache Jenkins Server
See Changes: [staslevin] [BEAM-1777] In certain circumstances PipelineEnforcement shades -- [...truncated 242.55 KB...] * [new ref] refs/pull/2308/he

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #1515

2017-04-05 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1737) Implement a Single-output ParDo as a Multi-output ParDo with a single output

2017-04-05 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956637#comment-15956637 ] Amit Sela commented on BEAM-1737: - Changed the title since the change will actually do just

[jira] [Updated] (BEAM-1737) Implement a Single-output ParDo as a Multi-output ParDo with a single output

2017-04-05 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-1737: Summary: Implement a Single-output ParDo as a Multi-output ParDo with a single output (was: Interpreting a S

[jira] [Assigned] (BEAM-1737) Interpreting a Single-output ParDo as a Multi-output ParDo with a single output causes serialization failures

2017-04-05 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela reassigned BEAM-1737: --- Assignee: Amit Sela > Interpreting a Single-output ParDo as a Multi-output ParDo with a single > outp

Build failed in Jenkins: beam_PostCommit_Python_Verify #1742

2017-04-05 Thread Apache Jenkins Server
See -- [...truncated 839.47 KB...] Collecting funcsigs>=1 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded /tmp/dataflow-requirements-cach

Build failed in Jenkins: beam_PostCommit_Python_Verify #1741

2017-04-05 Thread Apache Jenkins Server
See Changes: [staslevin] [BEAM-1777] In certain circumstances PipelineEnforcement shades -- [...truncated 829.62 KB...] File was already downloaded /tmp/da

[jira] [Comment Edited] (BEAM-1777) If PipelineEnforcement throws an exception after Pipeline.run() fails, it overwrites the original failure

2017-04-05 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956479#comment-15956479 ] Stas Levin edited comment on BEAM-1777 at 4/5/17 8:01 AM: -- [~tgroh

[jira] [Commented] (BEAM-1777) If PipelineEnforcement throws an exception after Pipeline.run() fails, it overwrites the original failure

2017-04-05 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956479#comment-15956479 ] Stas Levin commented on BEAM-1777: -- [~tgroh] Since I was unable to come up with a proper t

[jira] [Comment Edited] (BEAM-1777) If PipelineEnforcement throws an exception after Pipeline.run() fails, it overwrites the original failure

2017-04-05 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956479#comment-15956479 ] Stas Levin edited comment on BEAM-1777 at 4/5/17 8:00 AM: -- [~tgroh

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark #1514

2017-04-05 Thread Apache Jenkins Server
See Changes: [staslevin] [BEAM-1777] In certain circumstances PipelineEnforcement shades -- [...truncated 495.03 KB...] 2017-04-05T07:32:23.156 [

[2/2] beam git commit: This closes #2403

2017-04-05 Thread staslevin
This closes #2403 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/646cbdb7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/646cbdb7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/646cbdb7 Branch: refs/heads/maste

[jira] [Commented] (BEAM-1777) If PipelineEnforcement throws an exception after Pipeline.run() fails, it overwrites the original failure

2017-04-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15956435#comment-15956435 ] ASF GitHub Bot commented on BEAM-1777: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: [BEAM-1777] In certain circumstances PipelineEnforcement shades pipeline's exceptions.

2017-04-05 Thread staslevin
Repository: beam Updated Branches: refs/heads/master 6df661b0e -> 646cbdb70 [BEAM-1777] In certain circumstances PipelineEnforcement shades pipeline's exceptions. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d96a95c5 Tre

[GitHub] beam pull request #2403: [BEAM-1777] In certain circumstances PipelineEnforc...

2017-04-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2403 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

<    1   2   3