[GitHub] incubator-beam pull request #1368: [BEAM-498] Transmit new DoFn in Dataflow ...

2016-11-15 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/1368 [BEAM-498] Transmit new DoFn in Dataflow translator Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[jira] [Commented] (BEAM-498) Make DoFnWithContext the new DoFn

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669602#comment-15669602 ] ASF GitHub Bot commented on BEAM-498: - GitHub user kennknowles opened a pull request:

[1/2] incubator-beam git commit: Connect generated DoFnInvoker.invokerOnTimer to OnTimerInvoker

2016-11-15 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master dbbd5e448 -> dc94dbdd7 Connect generated DoFnInvoker.invokerOnTimer to OnTimerInvoker Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request #1307: [BEAM-27] Connect generated DoFnInvoker's...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1307 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #1307

2016-11-15 Thread kenn
This closes #1307 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dc94dbdd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/dc94dbdd Diff:

[jira] [Commented] (BEAM-27) Add user-ready API for interacting with timers

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-27?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669463#comment-15669463 ] ASF GitHub Bot commented on BEAM-27: Github user asfgit closed the pull request at:

Jenkins build is back to normal : beam_PostCommit_MavenVerify #1830

2016-11-15 Thread Apache Jenkins Server
See

[incubator-beam] Git Push Summary

2016-11-15 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/apex-runner [deleted] 99001575d

[jira] [Commented] (BEAM-943) Implement Datastore query splitter for python

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668812#comment-15668812 ] ASF GitHub Bot commented on BEAM-943: - Github user vikkyrk closed the pull request at:

[jira] [Resolved] (BEAM-983) Spark runner fails build on missing license and broken checkstyle.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-983. Resolution: Fixed Fix Version/s: 0.4.0-incubating > Spark runner fails build on missing license and

[jira] [Commented] (BEAM-983) Spark runner fails build on missing license and broken checkstyle.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668802#comment-15668802 ] ASF GitHub Bot commented on BEAM-983: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: [BEAM-983] Fix a bunch of precommit errors from #1332

2016-11-15 Thread amitsela
Repository: incubator-beam Updated Branches: refs/heads/master 201110222 -> dbbd5e448 [BEAM-983] Fix a bunch of precommit errors from #1332 Renames TestPipelineOptions to SparkTestPipelineOptions To avoid confusion with sdk.testing.TestPipelineOptions. Also, a couple of other minor fixes.

[GitHub] incubator-beam pull request #1364: [BEAM-983] Fixes after #1332

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1364 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1367: Declare archetype starter dependency on s...

2016-11-15 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/incubator-beam/pull/1367 Declare archetype starter dependency on slf4j Example failed log before this PR: https://api.travis-ci.org/jobs/176202650/log.txt?deansi=true R: @lukecwik You can merge this pull

[2/2] incubator-beam git commit: This closes #1364

2016-11-15 Thread amitsela
This closes #1364 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dbbd5e44 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/dbbd5e44 Diff:

[jira] [Created] (BEAM-988) Support for testing how soon output is emitted

2016-11-15 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-988: - Summary: Support for testing how soon output is emitted Key: BEAM-988 URL: https://issues.apache.org/jira/browse/BEAM-988 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-987) TestStream.advanceWatermarkToInfinity should perhaps also advance processing time

2016-11-15 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-987: - Summary: TestStream.advanceWatermarkToInfinity should perhaps also advance processing time Key: BEAM-987 URL: https://issues.apache.org/jira/browse/BEAM-987

[jira] [Commented] (BEAM-986) ReduceFnRunner doesn't batch prefetching pane firings

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668726#comment-15668726 ] ASF GitHub Bot commented on BEAM-986: - GitHub user scwhittle opened a pull request:

[GitHub] incubator-beam pull request #1366: [BEAM-986] Improve ReduceFnRunner prefetc...

2016-11-15 Thread scwhittle
GitHub user scwhittle opened a pull request: https://github.com/apache/incubator-beam/pull/1366 [BEAM-986] Improve ReduceFnRunner prefetching Hi @kennknowles , can you please take a look? This refactoring ensures that for batches of elements or timers we have at most 2

[jira] [Created] (BEAM-986) ReduceFnRunner doesn't batch prefetching pane firings

2016-11-15 Thread Sam Whittle (JIRA)
Sam Whittle created BEAM-986: Summary: ReduceFnRunner doesn't batch prefetching pane firings Key: BEAM-986 URL: https://issues.apache.org/jira/browse/BEAM-986 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-983) Spark runner fails build on missing license and broken checkstyle.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668713#comment-15668713 ] ASF GitHub Bot commented on BEAM-983: - Github user amitsela closed the pull request at:

[GitHub] incubator-beam pull request #1362: [BEAM-983] runners/spark/translation/stre...

2016-11-15 Thread amitsela
Github user amitsela closed the pull request at: https://github.com/apache/incubator-beam/pull/1362 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1365: Fix shared state across retry decorated f...

2016-11-15 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/incubator-beam/pull/1365 Fix shared state across retry decorated functions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[jira] [Updated] (BEAM-985) Retry decorator maintains state as uses an iterator

2016-11-15 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj updated BEAM-985: --- Description: https://github.com/apache/incubator-beam/commit/57c30c752a524a40c7074ea69541964c77f22748

[jira] [Updated] (BEAM-983) Spark runner fails build on missing license and broken checkstyle.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-983: --- Description: Pull request #1332 (https://github.com/apache/incubator-beam/pull/1332) is failing in

[jira] [Updated] (BEAM-983) Spark runner fails build on missing license and broken checkstyle.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-983: --- Assignee: Eugene Kirpichov (was: Amit Sela) > Spark runner fails build on missing license and broken

[jira] [Updated] (BEAM-983) Spark runner fails build on missing license and broken checkstyle.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-983: --- Summary: Spark runner fails build on missing license and broken checkstyle. (was:

[GitHub] incubator-beam pull request #1364: Fixes after #1332

2016-11-15 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/incubator-beam/pull/1364 Fixes after #1332 #1332 introduced a few precommit failures. This PR fixes them and makes a couple of other minor changes noticed while doing the fixes. R: @amitsela You can merge

[1/2] incubator-beam git commit: Query Splitter for Datastore v1

2016-11-15 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk d1fccbf5e -> 21b7844bb Query Splitter for Datastore v1 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c1126b70 Tree:

[2/2] incubator-beam git commit: Closes #1310

2016-11-15 Thread robertwb
Closes #1310 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/21b7844b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/21b7844b Diff:

[jira] [Created] (BEAM-985) Retry decorator maintains state as uses an iterator

2016-11-15 Thread Sourabh Bajaj (JIRA)
Sourabh Bajaj created BEAM-985: -- Summary: Retry decorator maintains state as uses an iterator Key: BEAM-985 URL: https://issues.apache.org/jira/browse/BEAM-985 Project: Beam Issue Type: Bug

Build failed in Jenkins: beam_PostCommit_MavenVerify #1828

2016-11-15 Thread Apache Jenkins Server
See Changes: [klk] Rename DoFn.ExtraContextFactory to DoFn.ArgumentProvider -- [EnvInject] - Mask passwords passed as build parameters. Started by an SCM change [EnvInject] - Loading

[jira] [Commented] (BEAM-498) Make DoFnWithContext the new DoFn

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668366#comment-15668366 ] ASF GitHub Bot commented on BEAM-498: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1360: [BEAM-498] Rename DoFn.ExtraContextFactor...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1360 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: This closes #1360

2016-11-15 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 503f26f44 -> 201110222 This closes #1360 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/20111022 Tree:

[2/2] incubator-beam git commit: Rename DoFn.ExtraContextFactory to DoFn.ArgumentProvider

2016-11-15 Thread kenn
Rename DoFn.ExtraContextFactory to DoFn.ArgumentProvider The prior name started in the right place, but the role has gradually morphed into a provider for all DoFn method arguments. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request #1363: Remove Pipeline#getFullNameForTesting

2016-11-15 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1363 Remove Pipeline#getFullNameForTesting Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Commented] (BEAM-983) runners/spark/translation/streaming/utils/TestPipelineOptions.java missing Apache license header.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668220#comment-15668220 ] Amit Sela commented on BEAM-983: Not your fault. Jenkins didn't run in PreCommit - it's kind of lost it for

[jira] [Commented] (BEAM-983) runners/spark/translation/streaming/utils/TestPipelineOptions.java missing Apache license header.

2016-11-15 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668207#comment-15668207 ] Stas Levin commented on BEAM-983: - [~jasonkuster] [~amitsela] Sorry about that, can these tests can be added

[jira] [Closed] (BEAM-915) Update /get-started/releases doc

2016-11-15 Thread Hadar Hod (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hadar Hod closed BEAM-915. -- Resolution: Fixed Fix Version/s: Not applicable Page renamed to get-started/downloads > Update

[jira] [Assigned] (BEAM-906) Fill in the get-started/downloads portion of the website

2016-11-15 Thread Hadar Hod (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hadar Hod reassigned BEAM-906: -- Assignee: Hadar Hod > Fill in the get-started/downloads portion of the website >

[2/3] incubator-beam git commit: Fix merge lint error

2016-11-15 Thread robertwb
Fix merge lint error Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8bf25269 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8bf25269 Diff:

Jenkins build is back to normal : beam_PostCommit_PythonVerify #713

2016-11-15 Thread Apache Jenkins Server
See

[1/3] incubator-beam git commit: Display Data for: PipelineOptions, combiners, more sources

2016-11-15 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 384fb5dc1 -> d1fccbf5e Display Data for: PipelineOptions, combiners, more sources Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[3/3] incubator-beam git commit: Closes #1264

2016-11-15 Thread robertwb
Closes #1264 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d1fccbf5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d1fccbf5 Diff:

Build failed in Jenkins: beam_PostCommit_PythonVerify #712

2016-11-15 Thread Apache Jenkins Server
See Changes: [robertwb] Add a couple of missing coder tests. [robertwb] Also check coder determinism. -- [...truncated 733 lines...] test_default_typed_hint

[jira] [Commented] (BEAM-983) runners/spark/translation/streaming/utils/TestPipelineOptions.java missing Apache license header.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667939#comment-15667939 ] ASF GitHub Bot commented on BEAM-983: - GitHub user amitsela opened a pull request:

[GitHub] incubator-beam pull request #1362: [BEAM-983] add missing license.

2016-11-15 Thread amitsela
GitHub user amitsela opened a pull request: https://github.com/apache/incubator-beam/pull/1362 [BEAM-983] add missing license. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[2/3] incubator-beam git commit: Add a couple of missing coder tests.

2016-11-15 Thread robertwb
Add a couple of missing coder tests. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ab02a1d6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ab02a1d6 Diff:

[GitHub] incubator-beam pull request #1326: Additional Coder tests

2016-11-15 Thread robertwb
Github user robertwb closed the pull request at: https://github.com/apache/incubator-beam/pull/1326 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Closed] (BEAM-984) rat plugin fails build because of a missing license.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-984. -- Resolution: Duplicate > rat plugin fails build because of a missing license. >

[jira] [Commented] (BEAM-983) runners/spark/translation/streaming/utils/TestPipelineOptions.java missing Apache license header.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667929#comment-15667929 ] Amit Sela commented on BEAM-983: I'll fix this now, thanks [~jasonkuster] >

[jira] [Created] (BEAM-984) rat plugin fails build because of a missing license.

2016-11-15 Thread Amit Sela (JIRA)
Amit Sela created BEAM-984: -- Summary: rat plugin fails build because of a missing license. Key: BEAM-984 URL: https://issues.apache.org/jira/browse/BEAM-984 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-983) runners/spark/translation/streaming/utils/TestPipelineOptions.java missing Apache license header.

2016-11-15 Thread Jason Kuster (JIRA)
Jason Kuster created BEAM-983: - Summary: runners/spark/translation/streaming/utils/TestPipelineOptions.java missing Apache license header. Key: BEAM-983 URL: https://issues.apache.org/jira/browse/BEAM-983

Re: Build failed in Jenkins: beam_PostCommit_MavenVerify #1827

2016-11-15 Thread Amit Sela
A new file is missing license. Weird... PreCommit passed. I'll open a ticket and fix this. On Tue, Nov 15, 2016 at 8:32 PM Jason Kuster wrote: > Investigating... > > On Tue, Nov 15, 2016 at 10:29 AM, Apache Jenkins Server < > jenk...@builds.apache.org> wrote: > >

Build failed in Jenkins: beam_PostCommit_MavenVerify #1827

2016-11-15 Thread Apache Jenkins Server
See Changes: [ansela] [BEAM-891] fix build occasionally fails on IndexOutOfBoundsException. -- [...truncated 5 lines...] Building remotely on beam3 (beam) in workspace

[1/2] incubator-beam git commit: [BEAM-891] fix build occasionally fails on IndexOutOfBoundsException.

2016-11-15 Thread amitsela
Repository: incubator-beam Updated Branches: refs/heads/master 47646d641 -> 503f26f44 [BEAM-891] fix build occasionally fails on IndexOutOfBoundsException. Moved "TestPipelineOptions#withTmpCheckpointDir" to TestPipelineOptionsForStreaming. Removed an unused member in

[jira] [Resolved] (BEAM-891) Flake in Spark metrics library?

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-891. Resolution: Fixed Fix Version/s: 0.4.0-incubating > Flake in Spark metrics library? >

[jira] [Commented] (BEAM-891) Flake in Spark metrics library?

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667833#comment-15667833 ] ASF GitHub Bot commented on BEAM-891: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1332: [BEAM-891] Trying to fix an occasionally ...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1332 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #1332

2016-11-15 Thread amitsela
This closes #1332 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/503f26f4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/503f26f4 Diff:

[GitHub] incubator-beam pull request #1330: Remove tox cache from previous workspace

2016-11-15 Thread vikkyrk
Github user vikkyrk closed the pull request at: https://github.com/apache/incubator-beam/pull/1330 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-930) Findbugs doesn't pass in MongoDB

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667693#comment-15667693 ] ASF GitHub Bot commented on BEAM-930: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1361: [BEAM-930] Fix findbugs and re-enable Mav...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1361 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (BEAM-981) Not possible to directly submit a pipeline on spark cluster

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-981: -- Summary: Not possible to directly submit a pipeline on spark cluster (was: Not possible

[jira] [Updated] (BEAM-981) Not possible to directly run pipeline on spark cluster

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-981: -- Summary: Not possible to directly run pipeline on spark cluster (was: Not possible to

[2/2] incubator-beam git commit: Closes #1304

2016-11-15 Thread robertwb
Closes #1304 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c4208a89 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c4208a89 Diff:

[jira] [Created] (BEAM-981) Not possible to directly run pipeline on spark

2016-11-15 Thread JIRA
Jean-Baptiste Onofré created BEAM-981: - Summary: Not possible to directly run pipeline on spark Key: BEAM-981 URL: https://issues.apache.org/jira/browse/BEAM-981 Project: Beam Issue

[1/2] incubator-beam git commit: Allow for passing format so that we can migrate to BQ Avro export later

2016-11-15 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 6ac6e420f -> c4208a899 Allow for passing format so that we can migrate to BQ Avro export later Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[1/2] incubator-beam git commit: Add IP configuration to Python SDK

2016-11-15 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 66f324b35 -> 6ac6e420f Add IP configuration to Python SDK Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/af6f4e90 Tree:

[2/2] incubator-beam git commit: Closes #1354

2016-11-15 Thread robertwb
Closes #1354 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6ac6e420 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6ac6e420 Diff:

[1/2] incubator-beam git commit: Use batch GCS operations during FileSink write finalization

2016-11-15 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 560fe79f8 -> 66f324b35 Use batch GCS operations during FileSink write finalization Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[2/2] incubator-beam git commit: Closes #1337

2016-11-15 Thread robertwb
Closes #1337 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/66f324b3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/66f324b3 Diff:

Jenkins build is back to normal : beam_PostCommit_MavenVerify #1824

2016-11-15 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-918) Let users set STORAGE_LEVEL via SparkPipelineOptions.

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667407#comment-15667407 ] Jean-Baptiste Onofré commented on BEAM-918: --- Cool, thanks ! > Let users set STORAGE_LEVEL via

[jira] [Created] (BEAM-980) Document how to configure the DAG created by Apex Runner

2016-11-15 Thread Thomas Weise (JIRA)
Thomas Weise created BEAM-980: - Summary: Document how to configure the DAG created by Apex Runner Key: BEAM-980 URL: https://issues.apache.org/jira/browse/BEAM-980 Project: Beam Issue Type: Task

[jira] [Commented] (BEAM-930) Findbugs doesn't pass in MongoDB

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667382#comment-15667382 ] ASF GitHub Bot commented on BEAM-930: - GitHub user jbonofre opened a pull request:

[GitHub] incubator-beam pull request #1361: [BEAM-930] Fix findbugs and re-enable Mav...

2016-11-15 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/1361 [BEAM-930] Fix findbugs and re-enable Maven plugin in MongoDbIO and MongoDbGridFSIO Be sure to do all of the following to help us incorporate your contribution quickly and easily:

Re: Build failed in Jenkins: beam_PostCommit_MavenVerify #1823

2016-11-15 Thread Dan Halperin
Not your fault -- merge race and stale precommit results. Thanks for solving the mystery! More details: * Added gridfs to mongodb-io https://github.com/apache/incubator-beam/pull/1324 * Fixed findbugs for a stale version of mongodb-io https://github.com/apache/incubator-beam/pull/1356 This is

Re: Build failed in Jenkins: beam_PostCommit_MavenVerify #1823

2016-11-15 Thread Jean-Baptiste Onofré
Actually, the problem comes from the merge of MongoDB GridFS write. I'm fixing it. Sorry again. Regards JB On 11/15/2016 03:27 PM, Dan Halperin wrote: Hmm, looks like heck that https://github.com/apache/incubator-beam/pull/1356 broke this

Re: Build failed in Jenkins: beam_PostCommit_MavenVerify #1823

2016-11-15 Thread Jean-Baptiste Onofré
H, let me check as well. Sorry about that. Regards JB On 11/15/2016 03:27 PM, Dan Halperin wrote: Hmm, looks like heck that https://github.com/apache/incubator-beam/pull/1356 broke this despite green precommit. Rolling back and

incubator-beam git commit: Revert "Closes #1356"

2016-11-15 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master deef3faf7 -> bb8887398 Revert "Closes #1356" This reverts commit deef3faf7df4885395417cb8f6b4aed6ec3d04e1, reversing changes made to 2bc66f903cdfa328c4bb3546befbaa0f58bdd6fa. Project:

Build failed in Jenkins: beam_PostCommit_MavenVerify #1823

2016-11-15 Thread Apache Jenkins Server
See Changes: [ansela] [BEAM-762] Unify spark-runner EvaluationContext and [dhalperi] [BEAM-930] Fix findbugs and re-enable Maven plugin in MongoDbIO -- [...truncated 4741 lines...]

[jira] [Commented] (BEAM-979) ConcurrentModificationException exception after hours of running

2016-11-15 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667018#comment-15667018 ] Stas Levin commented on BEAM-979: - I believe

[jira] [Comment Edited] (BEAM-979) ConcurrentModificationException exception after hours of running

2016-11-15 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666975#comment-15666975 ] Stas Levin edited comment on BEAM-979 at 11/15/16 12:24 PM: I think it may have

[jira] [Commented] (BEAM-979) ConcurrentModificationException exception after hours of running

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666994#comment-15666994 ] Amit Sela commented on BEAM-979: If this is indeed what happens, the exception is just a symptom.. What

[jira] [Resolved] (BEAM-930) Findbugs doesn't pass in MongoDB

2016-11-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-930. -- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Findbugs doesn't pass in MongoDB >

[jira] [Commented] (BEAM-979) ConcurrentModificationException exception after hours of running

2016-11-15 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666975#comment-15666975 ] Stas Levin commented on BEAM-979: - I think it may have to do with {StateSpecFunctions#mapSourceFunction}},

[GitHub] incubator-beam pull request #1356: [BEAM-930] Fix findbugs and re-enable Mav...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1356 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: [BEAM-930] Fix findbugs and re-enable Maven plugin in MongoDbIO

2016-11-15 Thread dhalperi
[BEAM-930] Fix findbugs and re-enable Maven plugin in MongoDbIO Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c87c662 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7c87c662 Diff:

[1/2] incubator-beam git commit: Closes #1356

2016-11-15 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 2bc66f903 -> deef3faf7 Closes #1356 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/deef3faf Tree:

[jira] [Commented] (BEAM-918) Let users set STORAGE_LEVEL via SparkPipelineOptions.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666959#comment-15666959 ] Amit Sela commented on BEAM-918: [~jbonofre] you're good to go ;) > Let users set STORAGE_LEVEL via

[jira] [Resolved] (BEAM-762) Use composition over inheritance in spark StreamingEvaluationContext if two contexts are necessary.

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-762. Resolution: Fixed Fix Version/s: 0.4.0-incubating > Use composition over inheritance in spark

[GitHub] incubator-beam pull request #1291: [BEAM-762] Unify spark-runner EvaluationC...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1291 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #1291

2016-11-15 Thread amitsela
This closes #1291 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2bc66f90 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2bc66f90 Diff:

[1/2] incubator-beam git commit: [BEAM-762] Unify spark-runner EvaluationContext and StreamingEvaluationContext

2016-11-15 Thread amitsela
Repository: incubator-beam Updated Branches: refs/heads/master 9c300cde8 -> 2bc66f903 [BEAM-762] Unify spark-runner EvaluationContext and StreamingEvaluationContext PR 1291 review changes. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Commented] (BEAM-762) Use composition over inheritance in spark StreamingEvaluationContext if two contexts are necessary.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666948#comment-15666948 ] ASF GitHub Bot commented on BEAM-762: - Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-979) ConcurrentModificationException exception after hours of running

2016-11-15 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666904#comment-15666904 ] Amit Sela commented on BEAM-979: [~staslev] what pipeline did you execute ? is there any other information

[jira] [Created] (BEAM-979) ConcurrentModificationException exception after hours of running

2016-11-15 Thread Stas Levin (JIRA)
Stas Levin created BEAM-979: --- Summary: ConcurrentModificationException exception after hours of running Key: BEAM-979 URL: https://issues.apache.org/jira/browse/BEAM-979 Project: Beam Issue Type:

[jira] [Updated] (BEAM-948) Add ability to write/sink results to MongoDBGridfs

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-948: -- Fix Version/s: 0.4.0-incubating > Add ability to write/sink results to MongoDBGridfs >

  1   2   >