[jira] [Updated] (BEAM-521) Execute some bounded source reads via composite transform

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-521: - Component/s: runner-core > Execute some bounded source reads via composite transform > -

[jira] [Updated] (BEAM-683) Make BZIP compressed files splittable

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-683: - Component/s: sdk-py sdk-java-core > Make BZIP compressed files splittable > --

[jira] [Updated] (BEAM-494) All E2E Tests Run Against All Runners In Postcommit

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-494: - Component/s: testing > All E2E Tests Run Against All Runners In Postcommit > ---

[jira] [Updated] (BEAM-511) Fill in the contribute/technical-vision section of the website

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-511: - Component/s: website > Fill in the contribute/technical-vision section of the website >

[jira] [Updated] (BEAM-599) Return KafkaIO getWatermark log in debug mode

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-599: - Component/s: sdk-java-extensions > Return KafkaIO getWatermark log in debug mode > -

[jira] [Updated] (BEAM-444) Promote isBlockOnRun() to PipelineOptions.

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-444: - Component/s: sdk-java-core > Promote isBlockOnRun() to PipelineOptions. > --

[jira] [Updated] (BEAM-765) TriggerStateMachine does not need to be separate from OnceTriggerStateMachine

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-765: - Component/s: runner-core > TriggerStateMachine does not need to be separate from OnceTriggerStateMac

[jira] [Updated] (BEAM-792) In WC Walkthrough: Document how logging works on Apache Spark

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-792: - Component/s: website > In WC Walkthrough: Document how logging works on Apache Spark > -

[jira] [Updated] (BEAM-580) Add a Datastore delete example

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-580: - Component/s: sdk-java-gcp > Add a Datastore delete example > -- > >

[jira] [Updated] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-443: - Component/s: sdk-java-core > PipelineResult needs waitUntilFinish() and cancel() > -

[jira] [Updated] (BEAM-719) Run WindowedWordCount Integration Test in Spark

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-719: - Component/s: testing > Run WindowedWordCount Integration Test in Spark > ---

[jira] [Closed] (BEAM-444) Promote isBlockOnRun() to PipelineOptions.

2016-12-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-444. --- Resolution: Won't Fix Fix Version/s: Not applicable Obsolete given users can control blocking run with PipelineRe

[jira] [Assigned] (BEAM-719) Run WindowedWordCount Integration Test in Spark

2016-12-01 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-719: - Assignee: Mark Liu (was: Amit Sela) > Run WindowedWordCount Integration Test in Spark > --

[jira] [Closed] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

2016-12-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-443. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > PipelineResult needs waitUntilFinish() and cancel() > ---

[jira] [Closed] (BEAM-962) Fix games example pipeline options default values conflicts.

2016-12-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-962. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Fix games example pipeline options default values conflicts.

[jira] [Updated] (BEAM-990) KafkaIO does not commit offsets to Kafka

2016-12-01 Thread Alban Perillat-Merceroz (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alban Perillat-Merceroz updated BEAM-990: - Description: I use KafkaIO as a source, and I would like consumed offsets to be stor

[jira] [Closed] (BEAM-952) Dynamically load and register IOChannelFactory

2016-12-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-952. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Dynamically load and register IOChannelFactory >

[jira] [Closed] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

2016-12-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-894. --- Resolution: Won't Fix Fix Version/s: Not applicable > Using @Teardown to remove temp files from failed bundles in

[jira] [Commented] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

2016-12-01 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713239#comment-15713239 ] Pei He commented on BEAM-894: - Closed without the fix for the following reason: @Teardown doesn'

[jira] [Closed] (BEAM-895) Transport.newStorageClient requires credentials

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-895. Resolution: Fixed > Transport.newStorageClient requires credentials >

[2/2] incubator-beam git commit: This closes #1261

2016-12-01 Thread tgroh
This closes #1261 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/24fab9f5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/24fab9f5 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam

[1/2] incubator-beam git commit: Improve Splittable DoFn

2016-12-01 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master fd4b631f1 -> 24fab9f53 Improve Splittable DoFn Makes Splittable DoFn be more like a real DoFn: - Adds support for side inputs and outputs to SDF - Teaches `ProcessFn` to work with exploded windows inside the `KeyedWorkItem`. It w

[GitHub] incubator-beam pull request #1261: [BEAM-801, BEAM-787] Improvements to Spli...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[jira] [Commented] (BEAM-801) SplittableParDo must be a pseudo-primitive, not ParDo(OldDoFn)

2016-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713249#comment-15713249 ] ASF GitHub Bot commented on BEAM-801: - Github user asfgit closed the pull request at:

[3/3] incubator-beam-site git commit: Regenerate website

2016-12-01 Thread dhalperi
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/f439af09 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/tree/f439af09 Diff: http://git-wip-us.apache.org/repos/a

[1/3] incubator-beam-site git commit: Closes #97

2016-12-01 Thread dhalperi
Repository: incubator-beam-site Updated Branches: refs/heads/asf-site 1b458f102 -> f439af099 Closes #97 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/7e96f7b9 Tree: http://git-wip-us.apache.o

[2/3] incubator-beam-site git commit: [BEAM-506] Fill in the documentation/runners/flink portion of the website

2016-12-01 Thread dhalperi
[BEAM-506] Fill in the documentation/runners/flink portion of the website Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/ac0c4e06 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/t

[GitHub] incubator-beam-site pull request #97: [BEAM-506] Fill in the documentation/r...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam-site/pull/97 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fea

[jira] [Commented] (BEAM-506) Fill in the documentation/runners/flink portion of the website

2016-12-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713276#comment-15713276 ] ASF GitHub Bot commented on BEAM-506: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1484: Migrate TransformTreeNode to an Inner Cla...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1484 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[2/3] incubator-beam git commit: Reduce the visibility of TransformHierarchy Node Mutators

2016-12-01 Thread tgroh
Reduce the visibility of TransformHierarchy Node Mutators These mutators should not be accessible when visiting the nodes. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c5c7910 Tree: http://git-wip-us.apa

[3/3] incubator-beam git commit: Migrate TransformTreeNode to an Inner Class

2016-12-01 Thread tgroh
Migrate TransformTreeNode to an Inner Class TransformTreeNode requires access to the hierarchy it is contained within, and generally cannot be separated from TransformHierarchy. It is primarily an implementation detail of TransformHierarchy, so can be relocated to within it. Project: http://git-

[1/3] incubator-beam git commit: This closes #1484

2016-12-01 Thread tgroh
Repository: incubator-beam Updated Branches: refs/heads/master 24fab9f53 -> 63491bf21 This closes #1484 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/63491bf2 Tree: http://git-wip-us.apache.org/repos/as

[jira] [Created] (BEAM-1073) Staged websites have extra whitespace around links

2016-12-01 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1073: - Summary: Staged websites have extra whitespace around links Key: BEAM-1073 URL: https://issues.apache.org/jira/browse/BEAM-1073 Project: Beam Issue Type: B

[jira] [Updated] (BEAM-1073) Staged websites have extra whitespace around links

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1073: -- Description: cc [~davor] [~frances] e.g., http://apache-beam-website-pull-requests.storage.goog

[jira] [Commented] (BEAM-801) SplittableParDo must be a pseudo-primitive, not ParDo(OldDoFn)

2016-12-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15713305#comment-15713305 ] Eugene Kirpichov commented on BEAM-801: --- This can be closed. > SplittableParDo must b

[GitHub] incubator-beam pull request #1485: WIP - Beam test main session pickle

2016-12-01 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/incubator-beam/pull/1485 WIP - Beam test main session pickle Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted lik

[jira] [Resolved] (BEAM-801) SplittableParDo must be a pseudo-primitive, not ParDo(OldDoFn)

2016-12-01 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-801. -- Resolution: Fixed Fix Version/s: Not applicable > SplittableParDo must be a pseudo-primitiv

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #1965

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #1965

2016-12-01 Thread Apache Jenkins Server
See

[GitHub] incubator-beam pull request #1486: Adds a category for tests using splittabl...

2016-12-01 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/incubator-beam/pull/1486 Adds a category for tests using splittable DoFn Excludes the category in all runners except direct. You can merge this pull request into a Git repository by running: $ git pull https://gi

[GitHub] incubator-beam pull request #1487: Stop using Maps of Transforms in the Dire...

2016-12-01 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1487 Stop using Maps of Transforms in the DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[1/2] incubator-beam git commit: This closes #1486

2016-12-01 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 63491bf21 -> c0c580227 This closes #1486 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c0c58022 Tree: http://git-wip-us.apache.org/repos/as

[GitHub] incubator-beam pull request #1486: Adds a category for tests using splittabl...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1486 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[2/2] incubator-beam git commit: Category for tests using splittable DoFn

2016-12-01 Thread kenn
Category for tests using splittable DoFn Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/887b357f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/887b357f Diff: http://git-wip-us.apache.org/r

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Flink #976

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Flink #976

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Spark #288

2016-12-01 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-1068) Service Account Credentials File Specified via Pipeline Option Ignored

2016-12-01 Thread Frances Perry (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frances Perry updated BEAM-1068: Assignee: Ahmet Altay (was: Frances Perry) > Service Account Credentials File Specified via Pipeline

[jira] [Updated] (BEAM-1070) Service Account Based Authentication Broken

2016-12-01 Thread Frances Perry (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frances Perry updated BEAM-1070: Assignee: Ahmet Altay (was: Frances Perry) > Service Account Based Authentication Broken > -

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Spark #288

2016-12-01 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-995) Apache Pig DSL

2016-12-01 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15714000#comment-15714000 ] Neelesh Srinivas Salian commented on BEAM-995: -- Shall I take this as well? The

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #1967

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #1967

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #1705

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #1705

2016-12-01 Thread Apache Jenkins Server
See

[GitHub] incubator-beam pull request #1488: Fix pom syntax for excludedGroups for Spl...

2016-12-01 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/1488 Fix pom syntax for excludedGroups for SplittableParDo Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

Re: Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #1705

2016-12-01 Thread Kenneth Knowles
Fix is roll forwards via https://github.com/apache/incubator-beam/pull/1488 On Thu, Dec 1, 2016 at 8:57 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See RunnableOnService_Dataflow/1705/changes> > >

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #977

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #977

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Spark #289

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Spark #289

2016-12-01 Thread Apache Jenkins Server
See

[1/2] incubator-beam git commit: Fix pom syntax for excludedGroups for SplittableParDo

2016-12-01 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master c0c580227 -> 7ad787797 Fix pom syntax for excludedGroups for SplittableParDo Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ffa81edd Tree: h

[GitHub] incubator-beam pull request #1488: Fix pom syntax for excludedGroups for Spl...

2016-12-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[2/2] incubator-beam git commit: Closes #1488

2016-12-01 Thread dhalperi
Closes #1488 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7ad78779 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7ad78779 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #1706

2016-12-01 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #1706

2016-12-01 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-995) Apache Pig DSL

2016-12-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-995: - Assignee: Jean-Baptiste Onofré (was: James Malone) > Apache Pig DSL >

[jira] [Commented] (BEAM-995) Apache Pig DSL

2016-12-01 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15714351#comment-15714351 ] Jean-Baptiste Onofré commented on BEAM-995: --- Not sure we have a huge overlap. For

<    1   2