[jira] [Created] (BEAM-1634) Flink: register IOChannelFactories on workers

2017-03-06 Thread Davor Bonaci (JIRA)
Davor Bonaci created BEAM-1634: -- Summary: Flink: register IOChannelFactories on workers Key: BEAM-1634 URL: https://issues.apache.org/jira/browse/BEAM-1634 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1634) Flink: register IOChannelFactories on workers

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898854#comment-15898854 ] ASF GitHub Bot commented on BEAM-1634: -- GitHub user davorbonaci opened a pull request:

[GitHub] beam pull request #2176: [BEAM-1634] Flink: register known IOChannelFactorie...

2017-03-06 Thread davorbonaci
GitHub user davorbonaci opened a pull request: https://github.com/apache/beam/pull/2176 [BEAM-1634] Flink: register known IOChannelFactories R: @aljoscha You can merge this pull request into a Git repository by running: $ git pull https://github.com/davorbonaci/beam flink-gcs-f

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #2832

2017-03-06 Thread Apache Jenkins Server
See

[2/2] beam git commit: This closes #2169

2017-03-06 Thread davor
This closes #2169 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1fd52f53 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1fd52f53 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1fd52f53 Branch: refs/heads/maste

[GitHub] beam pull request #2169: [BEAM-1556] Make PipelineOptions a lazy-singleton a...

2017-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2169 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: [BEAM-1556] Make PipelineOptions a lazy-singleton and init IOs as part of it.

2017-03-06 Thread davor
Repository: beam Updated Branches: refs/heads/master 410534b1f -> 1fd52f53c [BEAM-1556] Make PipelineOptions a lazy-singleton and init IOs as part of it. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4dda585c Tree: http://

[jira] [Commented] (BEAM-1556) Spark executors need to register IO factories

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898830#comment-15898830 ] ASF GitHub Bot commented on BEAM-1556: -- Github user asfgit closed the pull request at:

[jira] [Updated] (BEAM-1546) Specify exact version for Python in the SDK

2017-03-06 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated BEAM-1546: - Description: Python SDK currently supports Python-2.7 only. apache_beam package's init uses named componen

[jira] [Created] (BEAM-1633) Move .tox/ directory under target/ in Python SDK

2017-03-06 Thread Tibor Kiss (JIRA)
Tibor Kiss created BEAM-1633: Summary: Move .tox/ directory under target/ in Python SDK Key: BEAM-1633 URL: https://issues.apache.org/jira/browse/BEAM-1633 Project: Beam Issue Type: Improvement

[jira] [Comment Edited] (BEAM-1439) Beam Example(s) exploring public document datasets

2017-03-06 Thread SungJunyoung (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891773#comment-15891773 ] SungJunyoung edited comment on BEAM-1439 at 3/7/17 4:46 AM: Hel

[jira] [Commented] (BEAM-59) IOChannelFactory rethinking/redesign

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898601#comment-15898601 ] ASF GitHub Bot commented on BEAM-59: GitHub user peihe opened a pull request: https:

[GitHub] beam pull request #2175: [BEAM-59] Beam FileSystems: add match(), copy(), re...

2017-03-06 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2175 [BEAM-59] Beam FileSystems: add match(), copy(), rename(), delete() utilities. Be sure to do all of the following to help us incorporate your contribution quickly and easily: -

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #2831

2017-03-06 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #2830

2017-03-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1624) Unable to deserialize Coder in DataflowRunner

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898462#comment-15898462 ] ASF GitHub Bot commented on BEAM-1624: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2173: [BEAM-1624] Add tests for serialization of BigQuery...

2017-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2173 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Add tests for serialization of BigQueryIO.TableRowInfoCoder

2017-03-06 Thread kenn
Repository: beam Updated Branches: refs/heads/master 5d120bd3f -> 410534b1f Add tests for serialization of BigQueryIO.TableRowInfoCoder Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/57886246 Tree: http://git-wip-us.apache.

[2/2] beam git commit: This closes #2173: Add tests for serialization of BigQueryIO.TableRowInfoCoder

2017-03-06 Thread kenn
This closes #2173: Add tests for serialization of BigQueryIO.TableRowInfoCoder Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/410534b1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/410534b1 Diff: http://git-wip-us.apac

[jira] [Commented] (BEAM-1310) Add running integration tests for JdbcIO

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898457#comment-15898457 ] ASF GitHub Bot commented on BEAM-1310: -- GitHub user ssisk opened a pull request:

[GitHub] beam pull request #2174: [BEAM-1310] updates to JdbcIO k8 scripts & data loa...

2017-03-06 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2174 [BEAM-1310] updates to JdbcIO k8 scripts & data loading Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is form

[jira] [Commented] (BEAM-1624) Unable to deserialize Coder in DataflowRunner

2017-03-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898433#comment-15898433 ] Kenneth Knowles commented on BEAM-1624: --- Couldn't repro - possible that the jar was c

[jira] [Commented] (BEAM-1624) Unable to deserialize Coder in DataflowRunner

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898417#comment-15898417 ] ASF GitHub Bot commented on BEAM-1624: -- GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #2173: [BEAM-1624] Add tests for serialization of BigQuery...

2017-03-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2173 [BEAM-1624] Add tests for serialization of BigQueryIO.TableRowInfoCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sur

[jira] [Commented] (BEAM-970) Add side-input/side-output support to gearpump-runner

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898400#comment-15898400 ] ASF GitHub Bot commented on BEAM-970: - Github user manuzhang closed the pull request at:

[GitHub] beam pull request #1429: [BEAM-970] add side-input support to gearpump-runne...

2017-03-06 Thread manuzhang
Github user manuzhang closed the pull request at: https://github.com/apache/beam/pull/1429 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (BEAM-1624) Unable to deserialize Coder in DataflowRunner

2017-03-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898387#comment-15898387 ] Kenneth Knowles commented on BEAM-1624: --- False; the coder is serializable. The topmos

[GitHub] beam-site pull request #171: Typo fix in "Reading Data Into Your Pipeline" e...

2017-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/171 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[3/3] beam-site git commit: This closes #171

2017-03-06 Thread davor
This closes #171 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/dd1ca3fd Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/dd1ca3fd Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/dd1ca3fd Branc

[2/3] beam-site git commit: Regenerate website

2017-03-06 Thread davor
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/8b84da8a Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/8b84da8a Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/8b84da8a Bra

[1/3] beam-site git commit: Typo fix in "Reading Data Into Your Pipeline" example.

2017-03-06 Thread davor
Repository: beam-site Updated Branches: refs/heads/asf-site bbe028320 -> dd1ca3fd3 Typo fix in "Reading Data Into Your Pipeline" example. Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/c71edc8d Tree: http://git-wi

[jira] [Updated] (BEAM-1632) Current bigtable protos include google rpc generated classes in its jar

2017-03-06 Thread Vikas Kedigehalli (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1632: Description: bigtable-protos include generated classes like 'com.google.rpc.Code' in its jar

[jira] [Created] (BEAM-1632) Current bigtable protos includes google rpc generated classes that conflict with Datastore dependencies

2017-03-06 Thread Vikas Kedigehalli (JIRA)
Vikas Kedigehalli created BEAM-1632: --- Summary: Current bigtable protos includes google rpc generated classes that conflict with Datastore dependencies Key: BEAM-1632 URL: https://issues.apache.org/jira/browse/BE

[jira] [Updated] (BEAM-1632) Current bigtable protos include google rpc generated classes in its jar

2017-03-06 Thread Vikas Kedigehalli (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-1632: Summary: Current bigtable protos include google rpc generated classes in its jar (was: Curre

[GitHub] beam-site pull request #171: Typo fix in "Reading Data Into Your Pipeline" e...

2017-03-06 Thread mairbek
GitHub user mairbek opened a pull request: https://github.com/apache/beam-site/pull/171 Typo fix in "Reading Data Into Your Pipeline" example. You can merge this pull request into a Git repository by running: $ git pull https://github.com/mairbek/beam-site fix Alternatively y

[jira] [Commented] (BEAM-1631) Flink runner: submit job to a Flink-on-YARN cluster

2017-03-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898281#comment-15898281 ] Xu Mingmin commented on BEAM-1631: -- Do I understand correctly? I can submit a job with Fli

[jira] [Commented] (BEAM-1616) Gauge Metric type

2017-03-06 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898267#comment-15898267 ] Ben Chambers commented on BEAM-1616: I believe the other metrics have solved/documented

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #2829

2017-03-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1624) Unable to deserialize Coder in DataflowRunner

2017-03-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898227#comment-15898227 ] Kenneth Knowles commented on BEAM-1624: --- My guess is wrong: this is actually a legiti

[jira] [Commented] (BEAM-1631) Flink runner: submit job to a Flink-on-YARN cluster

2017-03-06 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898205#comment-15898205 ] Davor Bonaci commented on BEAM-1631: [~aljoscha], is this analysis correct? Am I off-ba

[jira] [Created] (BEAM-1631) Flink runner: submit job to a Flink-on-YARN cluster

2017-03-06 Thread Davor Bonaci (JIRA)
Davor Bonaci created BEAM-1631: -- Summary: Flink runner: submit job to a Flink-on-YARN cluster Key: BEAM-1631 URL: https://issues.apache.org/jira/browse/BEAM-1631 Project: Beam Issue Type: New Fe

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Dataflow #2482

2017-03-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

2017-03-06 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898151#comment-15898151 ] Xu Mingmin commented on BEAM-68: This's required by some runners. With this parameter, runner

[GitHub] beam pull request #2172: Revert "DataflowRunner: experimental support for is...

2017-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2172 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Revert "DataflowRunner: experimental support for issuing FnAPI based jobs"

2017-03-06 Thread kenn
Repository: beam Updated Branches: refs/heads/master 626bc38aa -> 5d120bd3f Revert "DataflowRunner: experimental support for issuing FnAPI based jobs" This reverts commit 131c9f916dae6345ec77a869112ae5901b568f23. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wi

[2/2] beam git commit: This closes #2172: Revert "DataflowRunner: experimental support for issuing FnAPI based jobs"

2017-03-06 Thread kenn
This closes #2172: Revert "DataflowRunner: experimental support for issuing FnAPI based jobs" Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5d120bd3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5d120bd3 Diff: http:/

[GitHub] beam pull request #2148: Fix tox warning for non-whitelisted find command

2017-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2148 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Fix tox warning for non-whitelisted find command

2017-03-06 Thread altay
Repository: beam Updated Branches: refs/heads/master 9cc8018b3 -> 626bc38aa Fix tox warning for non-whitelisted find command Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a4e8bef4 Tree: http://git-wip-us.apache.org/repos/a

[2/2] beam git commit: This closes #2148

2017-03-06 Thread altay
This closes #2148 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/626bc38a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/626bc38a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/626bc38a Branch: refs/heads/maste

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #2481

2017-03-06 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Spark #1153

2017-03-06 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2172: Revert "DataflowRunner: experimental support for is...

2017-03-06 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2172 Revert "DataflowRunner: experimental support for issuing FnAPI based jobs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make s

[jira] [Updated] (BEAM-632) Dataflow runner does not correctly flatten duplicate inputs

2017-03-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-632: - Priority: Critical (was: Major) > Dataflow runner does not correctly flatten duplicate inputs > ---

[jira] [Assigned] (BEAM-632) Dataflow runner does not correctly flatten duplicate inputs

2017-03-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-632: Assignee: Kenneth Knowles > Dataflow runner does not correctly flatten duplicate inputs > ---

[jira] [Commented] (BEAM-632) Dataflow runner does not correctly flatten duplicate inputs

2017-03-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897856#comment-15897856 ] Kenneth Knowles commented on BEAM-632: -- Bumping this because the test is wholly suppres

[GitHub] beam pull request #2171: [BEAM-1629] Make metrics/aggregators accumulators a...

2017-03-06 Thread aviemzur
GitHub user aviemzur opened a pull request: https://github.com/apache/beam/pull/2171 [BEAM-1629] Make metrics/aggregators accumulators available on driver Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[jira] [Commented] (BEAM-1629) Make metrics/aggregators accumulators available on driver

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897853#comment-15897853 ] ASF GitHub Bot commented on BEAM-1629: -- GitHub user aviemzur opened a pull request:

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Spark #1152

2017-03-06 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-1629) Make metrics/aggregators accumulators available on driver

2017-03-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1629: Description: Today aggregators and metrics accumulators are instantiated after pipeline is traversed, and so,

[jira] [Commented] (BEAM-1573) KafkaIO does not allow using Kafka serializers and deserializers

2017-03-06 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897824#comment-15897824 ] Raghu Angadi commented on BEAM-1573: New API ({{withKeySerializer() & withValueSerializ

[jira] [Comment Edited] (BEAM-1573) KafkaIO does not allow using Kafka serializers and deserializers

2017-03-06 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896948#comment-15896948 ] Raghu Angadi edited comment on BEAM-1573 at 3/6/17 6:40 PM: @pe

[jira] [Comment Edited] (BEAM-1573) KafkaIO does not allow using Kafka serializers and deserializers

2017-03-06 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896948#comment-15896948 ] Raghu Angadi edited comment on BEAM-1573 at 3/6/17 6:40 PM: @pe

[jira] [Commented] (BEAM-1624) Unable to deserialize Coder in DataflowRunner

2017-03-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897813#comment-15897813 ] Kenneth Knowles commented on BEAM-1624: --- Most likely the coder getting caught in an i

[jira] [Assigned] (BEAM-1624) Unable to deserialize Coder in DataflowRunner

2017-03-06 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1624: -- Assignee: Kenneth Knowles (was: Davor Bonaci) > Unable to deserialize Coder in DataflowRunner >

[jira] [Commented] (BEAM-1573) KafkaIO does not allow using Kafka serializers and deserializers

2017-03-06 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1589#comment-1589 ] Eugene Kirpichov commented on BEAM-1573: Yes, this would be a backward-incompatible

[jira] [Comment Edited] (BEAM-1573) KafkaIO does not allow using Kafka serializers and deserializers

2017-03-06 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897752#comment-15897752 ] peay edited comment on BEAM-1573 at 3/6/17 6:15 PM: [~rangadi] OK, that

[jira] [Updated] (BEAM-1573) KafkaIO does not allow using Kafka serializers and deserializers

2017-03-06 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peay updated BEAM-1573: --- Issue Type: Improvement (was: Bug) > KafkaIO does not allow using Kafka serializers and deserializers > --

[jira] [Commented] (BEAM-1573) KafkaIO does not allow using Kafka serializers and deserializers

2017-03-06 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897752#comment-15897752 ] peay commented on BEAM-1573: [~rangadi] OK, that makes sense. I was hoping to try and keep ever

[jira] [Created] (BEAM-1630) Add Splittable DoFn to Python SDK

2017-03-06 Thread Chamikara Jayalath (JIRA)
Chamikara Jayalath created BEAM-1630: Summary: Add Splittable DoFn to Python SDK Key: BEAM-1630 URL: https://issues.apache.org/jira/browse/BEAM-1630 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-1627) Composite/DisplayData structure changed

2017-03-06 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1627. --- Resolution: Fixed > Composite/DisplayData structure changed > --- >

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #2826

2017-03-06 Thread Apache Jenkins Server
See

[GitHub] beam pull request #1966: Proof-of-concept: Python dependency management

2017-03-06 Thread davorbonaci
Github user davorbonaci closed the pull request at: https://github.com/apache/beam/pull/1966 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1627) Composite/DisplayData structure changed

2017-03-06 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897720#comment-15897720 ] Davor Bonaci commented on BEAM-1627: [~tgroh], now that the offending PR is reverted, t

[jira] [Updated] (BEAM-649) Cache any PCollection implementation if accessed more than once

2017-03-06 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-649: -- Fix Version/s: 0.6.0 > Cache any PCollection implementation if accessed more than once > -

[jira] [Commented] (BEAM-1627) Composite/DisplayData structure changed

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897661#comment-15897661 ] ASF GitHub Bot commented on BEAM-1627: -- Github user asfgit closed the pull request at:

[3/3] beam git commit: This closes #2170

2017-03-06 Thread tgroh
This closes #2170 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9cc8018b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9cc8018b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9cc8018b Branch: refs/heads/maste

[GitHub] beam pull request #2170: [BEAM-1627] Revert "Implement Single-Output ParDo a...

2017-03-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2170 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/3] beam git commit: Revert "Implement Single-Output ParDo as a composite"

2017-03-06 Thread tgroh
Revert "Implement Single-Output ParDo as a composite" This reverts commit 6253abaac62979e8496a828c18c7d1aa7214be6a. The reverted commit breaks Dataflow DisplayData. The actual fix will include a Dataflow override for single-output ParDos. Project: http://git-wip-us.apache.org/repos/asf/beam/re

[1/3] beam git commit: Revert "Implement Single-Output ParDo as a composite"

2017-03-06 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 34b38ef95 -> 9cc8018b3 http://git-wip-us.apache.org/repos/asf/beam/blob/8766b03e/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/streaming/StreamingTransformTranslator.java ---

[jira] [Created] (BEAM-1629) Make metrics/aggregators accumulators available on driver

2017-03-06 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1629: --- Summary: Make metrics/aggregators accumulators available on driver Key: BEAM-1629 URL: https://issues.apache.org/jira/browse/BEAM-1629 Project: Beam Issue Type: Bug

[GitHub] beam pull request #2170: Revert "Implement Single-Output ParDo as a composit...

2017-03-06 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2170 Revert "Implement Single-Output ParDo as a composite" Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is format

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Spark #1149

2017-03-06 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Spark #1148

2017-03-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1556) Spark executors need to register IO factories

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897245#comment-15897245 ] ASF GitHub Bot commented on BEAM-1556: -- GitHub user amitsela opened a pull request:

[GitHub] beam pull request #2169: [BEAM-1556] Make PipelineOptions a lazy-singleton a...

2017-03-06 Thread amitsela
GitHub user amitsela opened a pull request: https://github.com/apache/beam/pull/2169 [BEAM-1556] Make PipelineOptions a lazy-singleton and init IOs as par… …t of it. Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[jira] [Commented] (BEAM-1582) ResumeFromCheckpointStreamingTest flakes with what appears as a second firing.

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897224#comment-15897224 ] ASF GitHub Bot commented on BEAM-1582: -- GitHub user amitsela opened a pull request:

[GitHub] beam pull request #2168: [BEAM-1582, BEAM-1562] Stop streaming tests on EOT ...

2017-03-06 Thread amitsela
GitHub user amitsela opened a pull request: https://github.com/apache/beam/pull/2168 [BEAM-1582, BEAM-1562] Stop streaming tests on EOT Watermark. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR titl

[jira] [Commented] (BEAM-1582) ResumeFromCheckpointStreamingTest flakes with what appears as a second firing.

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897223#comment-15897223 ] ASF GitHub Bot commented on BEAM-1582: -- Github user amitsela closed the pull request a

[GitHub] beam pull request #2159: [BEAM-1582, BEAM-1562] Stop streaming tests on EOT ...

2017-03-06 Thread amitsela
Github user amitsela closed the pull request at: https://github.com/apache/beam/pull/2159 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #2825

2017-03-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-425) Create Elasticsearch IO

2017-03-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897187#comment-15897187 ] Ismaël Mejía commented on BEAM-425: --- If not done yet, you should create a new JIRA for Ela

[jira] [Comment Edited] (BEAM-425) Create Elasticsearch IO

2017-03-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897187#comment-15897187 ] Ismaël Mejía edited comment on BEAM-425 at 3/6/17 12:15 PM: If n

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

2017-03-06 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897173#comment-15897173 ] Eugene Kirpichov commented on BEAM-68: -- This feels more runner-specific to me, because e

[jira] [Commented] (BEAM-1184) Add integration tests for ElasticsearchIO

2017-03-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897008#comment-15897008 ] Jean-Baptiste Onofré commented on BEAM-1184: Let me share with you what I alrea

[jira] [Assigned] (BEAM-1184) Add integration tests for ElasticsearchIO

2017-03-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-1184: -- Assignee: Jean-Baptiste Onofré (was: Etienne Chauchot) > Add integration tests

[jira] [Assigned] (BEAM-1184) Add integration tests for ElasticsearchIO

2017-03-06 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-1184: -- Assignee: Etienne Chauchot (was: Jean-Baptiste Onofré) > Add integration tests for Elas

[jira] [Assigned] (BEAM-425) Create Elasticsearch IO

2017-03-06 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-425: - Assignee: Etienne Chauchot (was: Jean-Baptiste Onofré) Will resume work started on ES 5 >

[jira] [Resolved] (BEAM-1623) Transform Reshuffle directly in Spark runner

2017-03-06 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1623. - Resolution: Fixed Fix Version/s: 0.6.0 > Transform Reshuffle directly in Spark runner >

[jira] [Commented] (BEAM-1623) Transform Reshuffle directly in Spark runner

2017-03-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896998#comment-15896998 ] ASF GitHub Bot commented on BEAM-1623: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #2160

2017-03-06 Thread amitsela
This closes #2160 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/34b38ef9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/34b38ef9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/34b38ef9 Branch: refs/heads/maste

  1   2   >