Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Gearpump #165

2017-03-29 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1829) MQTT message compression not working on Rapsberry Pi

2017-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948398#comment-15948398 ] Jean-Baptiste Onofré commented on BEAM-1829: By the way, the {{MqttIO}} doesn't explicitly

[jira] [Commented] (BEAM-1829) MQTT message compression not working on Rapsberry Pi

2017-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948391#comment-15948391 ] Jean-Baptiste Onofré commented on BEAM-1829: Happy to review ! > MQTT message compression not

[jira] [Assigned] (BEAM-1829) MQTT message compression not working on Rapsberry Pi

2017-03-29 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-1829: -- Assignee: Jean-Baptiste Onofré (was: Davor Bonaci) > MQTT message compression

[jira] [Commented] (BEAM-972) Add basic level of unit testing to gearpump runner

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948386#comment-15948386 ] ASF GitHub Bot commented on BEAM-972: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #2302: [BEAM-972] Add unit tests to Gearpump runner

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2302 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2302: Add unit tests to Gearpump runner

2017-03-29 Thread kenn
This closes #2302: Add unit tests to Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f4f23330 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f4f23330 Diff:

[1/2] beam git commit: [BEAM-972] Add unit tests to Gearpump runner

2017-03-29 Thread kenn
Repository: beam Updated Branches: refs/heads/gearpump-runner 555842a1a -> f4f233304 [BEAM-972] Add unit tests to Gearpump runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/eb0d333d Tree:

[jira] [Commented] (BEAM-1835) NPE in DirectRunner PubsubReader.ackBatch

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948290#comment-15948290 ] ASF GitHub Bot commented on BEAM-1835: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2368: [BEAM-1835] Make Pubsub ackBatch safer

2017-03-29 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2368 [BEAM-1835] Make Pubsub ackBatch safer Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-1835) NPE in DirectRunner PubsubReader.ackBatch

2017-03-29 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948285#comment-15948285 ] Thomas Groh commented on BEAM-1835: --- This is actually a bug in PubsubUnboundedSource or PubsubCheckpoint.

[1/2] beam git commit: Ensure that assert_that takes a PCollection as its first argument.

2017-03-29 Thread altay
Repository: beam Updated Branches: refs/heads/master 4d633bc5a -> 70aa0a4a4 Ensure that assert_that takes a PCollection as its first argument. This can avoid (silent) error such as with test_pipeline.TestPipeline() as p: bad_value = "Create0" >> beam.Create([1]) # Note missing "p

[GitHub] beam pull request #2214: Ensure that assert_that takes a PCollection as its ...

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2214 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1823) TimedOutException in postcommit

2017-03-29 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948173#comment-15948173 ] Mark Liu commented on BEAM-1823: We set ValidatesRunner test timeout here:

[GitHub] beam pull request #2366: Reopen BigQuery utils after #2271

2017-03-29 Thread ravwojdyla
GitHub user ravwojdyla opened a pull request: https://github.com/apache/beam/pull/2366 Reopen BigQuery utils after #2271 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Created] (BEAM-1836) Reopen BigQuery utils after #2271

2017-03-29 Thread Rafal Wojdyla (JIRA)
Rafal Wojdyla created BEAM-1836: --- Summary: Reopen BigQuery utils after #2271 Key: BEAM-1836 URL: https://issues.apache.org/jira/browse/BEAM-1836 Project: Beam Issue Type: Bug

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1668

2017-03-29 Thread Apache Jenkins Server
See

[jira] [Closed] (BEAM-1091) Python E2E WordCount test in Precommit

2017-03-29 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-1091. -- > Python E2E WordCount test in Precommit > -- > > Key: BEAM-1091

[jira] [Resolved] (BEAM-1687) Reduce Total Time of Running Python ValidatesRunner Tests in Postcommit

2017-03-29 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-1687. Resolution: Done Fix Version/s: Not applicable > Reduce Total Time of Running Python ValidatesRunner

[jira] [Resolved] (BEAM-1091) Python E2E WordCount test in Precommit

2017-03-29 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-1091. Resolution: Done Fix Version/s: Not applicable > Python E2E WordCount test in Precommit >

[jira] [Closed] (BEAM-1687) Reduce Total Time of Running Python ValidatesRunner Tests in Postcommit

2017-03-29 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-1687. -- > Reduce Total Time of Running Python ValidatesRunner Tests in Postcommit >

Build failed in Jenkins: beam_PerformanceTests_Dataflow #246

2017-03-29 Thread Apache Jenkins Server
See Changes: [tgroh] Update Dataflow Worker Image [tgroh] Remove View indicator classes [altay] Add first two mobile gaming examples to Python. --

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1434

2017-03-29 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2352: Add first two mobile gaming examples to Python

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2352 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Add first two mobile gaming examples to Python.

2017-03-29 Thread altay
Repository: beam Updated Branches: refs/heads/master 5d460d2e9 -> 4d633bc5a Add first two mobile gaming examples to Python. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d43391da Tree:

[2/2] beam git commit: This closes #2352

2017-03-29 Thread altay
This closes #2352 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4d633bc5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4d633bc5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4d633bc5 Branch:

[jira] [Commented] (BEAM-1835) NPE in DirectRunner PubsubReader.ackBatch

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948096#comment-15948096 ] ASF GitHub Bot commented on BEAM-1835: -- GitHub user ravwojdyla opened a pull request:

[GitHub] beam pull request #2365: [BEAM-1835] NPE pubsub

2017-03-29 Thread ravwojdyla
GitHub user ravwojdyla opened a pull request: https://github.com/apache/beam/pull/2365 [BEAM-1835] NPE pubsub Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-]

[jira] [Updated] (BEAM-1835) NPE in DirectRunner PubsubReader.ackBatch

2017-03-29 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated BEAM-1835: Summary: NPE in DirectRunner PubsubReader.ackBatch (was: NPE in DirectRunner ) > NPE in

[jira] [Created] (BEAM-1835) NPE in DirectRunner

2017-03-29 Thread Rafal Wojdyla (JIRA)
Rafal Wojdyla created BEAM-1835: --- Summary: NPE in DirectRunner Key: BEAM-1835 URL: https://issues.apache.org/jira/browse/BEAM-1835 Project: Beam Issue Type: Bug Components:

Build failed in Jenkins: beam_PostCommit_Python_Verify #1667

2017-03-29 Thread Apache Jenkins Server
See -- [...truncated 218.30 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted] (none)

[GitHub] beam pull request #2360: Remove View indicator classes

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2360 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2360

2017-03-29 Thread tgroh
This closes #2360 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5d460d2e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5d460d2e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5d460d2e Branch:

[1/2] beam git commit: Remove View indicator classes

2017-03-29 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 8fa115955 -> 5d460d2e9 Remove View indicator classes With the latest Dataflow Worker, these indicator classes have been replaced everywhere by referencing the available ViewFns. Project: http://git-wip-us.apache.org/repos/asf/beam/repo

[jira] [Commented] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Kevin Peterson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948060#comment-15948060 ] Kevin Peterson commented on BEAM-1834: -- Gotcha. Yes, I'd like to request the ability to set data

[jira] [Commented] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948040#comment-15948040 ] Daniel Halperin commented on BEAM-1834: --- Yeah, I meant "former". Sorry. We have tables, not schemas.

[jira] [Comment Edited] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948014#comment-15948014 ] Daniel Halperin edited comment on BEAM-1834 at 3/29/17 10:52 PM: - It sounds

[jira] [Resolved] (BEAM-1648) Replace gsutil calls with Cloud Storage API

2017-03-29 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1648. --- Resolution: Fixed Fix Version/s: First stable release [~dlebech] (Feel free to close issues

[jira] [Commented] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Kevin Peterson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948020#comment-15948020 ] Kevin Peterson commented on BEAM-1834: -- > The latter is explicitly not supported at this time.

[jira] [Commented] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948014#comment-15948014 ] Daniel Halperin commented on BEAM-1834: --- It sounds like this a feature request for BigQueryIO

[jira] [Assigned] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1834: - Assignee: (was: Daniel Halperin) > Bigquery Write validation doesn't work well with

[jira] [Resolved] (BEAM-1750) Refactor BigQueryIO.java into multiple files

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1750. --- Resolution: Fixed Fix Version/s: Not applicable > Refactor BigQueryIO.java into

[jira] [Assigned] (BEAM-437) Data-dependent BigQueryIO in batch

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-437: Assignee: Reuven Lax > Data-dependent BigQueryIO in batch >

[jira] [Commented] (BEAM-1269) BigtableIO should make more efficient use of connections

2017-03-29 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948013#comment-15948013 ] Solomon Duskis commented on BEAM-1269: -- BigtableIO should not set data channel pool counts for reads.

[jira] [Resolved] (BEAM-1530) BigQueryIO should support value-dependent windows

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1530. --- Resolution: Fixed Fix Version/s: First stable release > BigQueryIO should support

[jira] [Commented] (BEAM-1830) add 'withTopic()' api to KafkaIO Reader

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947985#comment-15947985 ] ASF GitHub Bot commented on BEAM-1830: -- GitHub user rangadi opened a pull request:

[GitHub] beam pull request #2364: [BEAM-1830] KafkaIO : Add withTopic() api that take...

2017-03-29 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/beam/pull/2364 [BEAM-1830] KafkaIO : Add withTopic() api that takes single topic. Overwhelming uses of KafkaIO consume just one topic. It would be nice to have `withTopic(topic)` rather than always requiring a

[jira] [Created] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Kevin Peterson (JIRA)
Kevin Peterson created BEAM-1834: Summary: Bigquery Write validation doesn't work well with ValueInSingleWindow Key: BEAM-1834 URL: https://issues.apache.org/jira/browse/BEAM-1834 Project: Beam

[jira] [Assigned] (BEAM-1833) Restructure Python pipeline construction to better follow the Runner API

2017-03-29 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1833: - Assignee: Sourabh Bajaj (was: Ahmet Altay) > Restructure Python pipeline construction to better

[jira] [Created] (BEAM-1833) Restructure Python pipeline construction to better follow the Runner API

2017-03-29 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-1833: - Summary: Restructure Python pipeline construction to better follow the Runner API Key: BEAM-1833 URL: https://issues.apache.org/jira/browse/BEAM-1833 Project: Beam

[jira] [Resolved] (BEAM-1826) Allow BigqueryIO to forward errors

2017-03-29 Thread Kevin Peterson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Peterson resolved BEAM-1826. -- Resolution: Duplicate Fix Version/s: Not applicable > Allow BigqueryIO to forward errors

[jira] [Commented] (BEAM-1826) Allow BigqueryIO to forward errors

2017-03-29 Thread Kevin Peterson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947938#comment-15947938 ] Kevin Peterson commented on BEAM-1826: -- Yep. https://github.com/apache/beam/pull/1609 looks like it

[jira] [Commented] (BEAM-1418) MapElements and FlatMapElements should comply with PTransform style guide

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947877#comment-15947877 ] ASF GitHub Bot commented on BEAM-1418: -- GitHub user jkff opened a pull request:

[GitHub] beam pull request #2363: [BEAM-1418] MapElements and FlatMapElements should ...

2017-03-29 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2363 [BEAM-1418] MapElements and FlatMapElements should comply with PTransform style guide For both of these classes, we change (Flat)MapElements.via(fn).withOutputType(td) to

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1433

2017-03-29 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2077: Improve documentation about Test Categories + Fix s...

2017-03-29 Thread iemejia
Github user iemejia closed the pull request at: https://github.com/apache/beam/pull/2077 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1425) Window should comply with PTransform style guide

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947823#comment-15947823 ] ASF GitHub Bot commented on BEAM-1425: -- GitHub user jkff opened a pull request:

[GitHub] beam pull request #2362: [BEAM-1425] Window should comply with PTransform st...

2017-03-29 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2362 [BEAM-1425] Window should comply with PTransform style guide Incompatible changes: - Window.Bound class is now simply Window: matters for users that were extracting the transform into a

[GitHub] beam pull request #2361: Update Dataflow Worker Image

2017-03-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2361 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2361

2017-03-29 Thread tgroh
This closes #2361 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8fa11595 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8fa11595 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/8fa11595 Branch:

[1/2] beam git commit: Update Dataflow Worker Image

2017-03-29 Thread tgroh
rs/google-cloud-dataflow-java/pom.xml +++ b/runners/google-cloud-dataflow-java/pom.xml @@ -33,7 +33,7 @@ jar - beam-master-20170328 + beam-master-20170329 1 6

[GitHub] beam pull request #2361: Update Dataflow Worker Image

2017-03-29 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2361 Update Dataflow Worker Image Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Assigned] (BEAM-1589) Add OnWindowExpiration method to Stateful DoFn

2017-03-29 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-1589: - Assignee: Kenneth Knowles > Add OnWindowExpiration method to Stateful DoFn >

[jira] [Commented] (BEAM-778) Make fileio._CompressedFile seekable.

2017-03-29 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947739#comment-15947739 ] Tibor Kiss commented on BEAM-778: - Thanks for the insights, [~katsia...@google.com] & [~chamikara]. As

[jira] [Commented] (BEAM-778) Make fileio._CompressedFile seekable.

2017-03-29 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947718#comment-15947718 ] Chamikara Jayalath commented on BEAM-778: - Currently this is not an issue since Beam FileBasedSoure

[jira] [Commented] (BEAM-447) Stop referring to types with Bound/Unbound

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947688#comment-15947688 ] Eugene Kirpichov commented on BEAM-447: --- Remaining instances: TextIO, AvroIO (handled by

[jira] [Assigned] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

2017-03-29 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-463: -- Assignee: (was: Aviem Zur) > BoundedHeapCoder should be a StandardCoder and not a CustomCoder >

[jira] [Commented] (BEAM-463) BoundedHeapCoder should be a StandardCoder and not a CustomCoder

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947666#comment-15947666 ] ASF GitHub Bot commented on BEAM-463: - Github user aviemzur closed the pull request at:

[GitHub] beam pull request #2108: [BEAM-463] [BEAM-464] [BEAM-466] BoundedHeapCoder, ...

2017-03-29 Thread aviemzur
Github user aviemzur closed the pull request at: https://github.com/apache/beam/pull/2108 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Closed] (BEAM-707) Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSink to use AutoValue to reduce boilerplate

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-707. - Resolution: Duplicate Fix Version/s: Not applicable > Migrate

[jira] [Closed] (BEAM-710) Migrate Read/Write to use AutoValue to reduce boilerplate

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-710. - Resolution: Won't Fix Fix Version/s: Not applicable Not worth it - Read and Write have only

[jira] [Closed] (BEAM-709) Migrate CountingSource/CountingInput to use AutoValue to reduce boilerplate

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-709. - Resolution: Duplicate Fix Version/s: Not applicable > Migrate CountingSource/CountingInput

[jira] [Closed] (BEAM-73) IO design pattern: Decouple Parsers and Coders

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-73?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-73. Resolution: Duplicate The only remaining instance of this is in KafkaIO, handled by BEAM-1573. > IO

[jira] [Updated] (BEAM-1269) BigtableIO should make more efficient use of connections

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1269: -- Labels: newbie starter (was: ) > BigtableIO should make more efficient use of connections >

[jira] [Resolved] (BEAM-717) Change KafkaIO API to be consistent with style guide

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov resolved BEAM-717. --- Resolution: Duplicate > Change KafkaIO API to be consistent with style guide >

[jira] [Reopened] (BEAM-717) Change KafkaIO API to be consistent with style guide

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reopened BEAM-717: --- It remains to also rid it of using Coder's for serialization. > Change KafkaIO API to be

[jira] [Commented] (BEAM-1269) BigtableIO should make more efficient use of connections

2017-03-29 Thread Solomon Duskis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947642#comment-15947642 ] Solomon Duskis commented on BEAM-1269: -- Cloud Bigtable client 0.9.6 was just released, and should be

Build failed in Jenkins: beam_PerformanceTests_Dataflow #245

2017-03-29 Thread Apache Jenkins Server
See Changes: [amitsela33] [BEAM-1827] Fix use of deprecated Spark APIs in the runner. -- [...truncated 272.66 KB...] * [new ref] refs/pull/928/head

[jira] [Commented] (BEAM-778) Make fileio._CompressedFile seekable.

2017-03-29 Thread Konstantinos Katsiapis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947589#comment-15947589 ] Konstantinos Katsiapis commented on BEAM-778: - In general the Beam programming model usually

[jira] [Commented] (BEAM-1829) MQTT message compression not working on Rapsberry Pi

2017-03-29 Thread Vassil Kolarov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947573#comment-15947573 ] Vassil Kolarov commented on BEAM-1829: -- [~davor], sure. I'll test on a Raspberry tomorrow and submit a

[jira] [Commented] (BEAM-778) Make fileio._CompressedFile seekable.

2017-03-29 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947561#comment-15947561 ] Tibor Kiss commented on BEAM-778: - I'm still working on seek() implementation and I have noticed that there

[GitHub] beam pull request #2360: Remove View indicator classes

2017-03-29 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2360 Remove View indicator classes Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[GitHub] beam pull request #2359: Needs runner

2017-03-29 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2359 Needs runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-]

[jira] [Commented] (BEAM-818) Remove Pipeline.getPipelineOptions

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947487#comment-15947487 ] ASF GitHub Bot commented on BEAM-818: - GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2358: [BEAM-818] Mark Pipeline#getPipelineOptions Experim...

2017-03-29 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2358 [BEAM-818] Mark Pipeline#getPipelineOptions Experimental Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-1308) Consider removing TimeDomain from user APIs

2017-03-29 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947481#comment-15947481 ] Kenneth Knowles commented on BEAM-1308: --- Marking backward-incompatible, but also intending for this

[jira] [Assigned] (BEAM-26) Model for validation of user state upon pipeline update

2017-03-29 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-26: --- Assignee: (was: Kenneth Knowles) > Model for validation of user state upon pipeline update

[jira] [Updated] (BEAM-1308) Consider removing TimeDomain from user APIs

2017-03-29 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1308: -- Labels: backward-incompatible (was: ) > Consider removing TimeDomain from user APIs >

[jira] [Assigned] (BEAM-1308) Consider removing TimeDomain from user APIs

2017-03-29 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-1308: - Assignee: (was: Kenneth Knowles) > Consider removing TimeDomain from user APIs >

[jira] [Commented] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-03-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947383#comment-15947383 ] Ted Yu commented on BEAM-1832: -- In the same class: {code} public static List getYarnDeployDependencies()

[jira] [Created] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-03-29 Thread Ted Yu (JIRA)
Ted Yu created BEAM-1832: Summary: Potentially unclosed OutputStream in ApexYarnLauncher Key: BEAM-1832 URL: https://issues.apache.org/jira/browse/BEAM-1832 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1831) Checking of containment in createdTables may have race condition in StreamingWriteFn

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1831: -- Component/s: (was: runner-dataflow) sdk-java-gcp > Checking of containment

[jira] [Assigned] (BEAM-190) Dead-letter drop for bad BigQuery records

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-190: Assignee: Reuven Lax > Dead-letter drop for bad BigQuery records >

[jira] [Commented] (BEAM-1826) Allow BigqueryIO to forward errors

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947374#comment-15947374 ] Daniel Halperin commented on BEAM-1826: --- This sounds like [BEAM-190] to me -- is that accurate? >

[jira] [Created] (BEAM-1831) Checking of containment in createdTables may have race condition in StreamingWriteFn

2017-03-29 Thread Ted Yu (JIRA)
Ted Yu created BEAM-1831: Summary: Checking of containment in createdTables may have race condition in StreamingWriteFn Key: BEAM-1831 URL: https://issues.apache.org/jira/browse/BEAM-1831 Project: Beam

[jira] [Comment Edited] (BEAM-1829) MQTT message compression not working on Rapsberry Pi

2017-03-29 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947334#comment-15947334 ] Davor Bonaci edited comment on BEAM-1829 at 3/29/17 3:23 PM: - [~vassil], do you

[jira] [Commented] (BEAM-1829) MQTT message compression not working on Rapsberry Pi

2017-03-29 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947334#comment-15947334 ] Davor Bonaci commented on BEAM-1829: [~vassil], do you perhaps want to submit a PR to fix this? Would

[jira] [Updated] (BEAM-1829) MQTT message compression not working on Rapsberry Pi

2017-03-29 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-1829: --- Component/s: (was: sdk-java-core) sdk-java-extensions > MQTT message compression

[jira] [Resolved] (BEAM-1827) Fix use of deprecated Spark APIs in the runner.

2017-03-29 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1827. - Resolution: Fixed Fix Version/s: First stable release > Fix use of deprecated Spark APIs in the

[jira] [Commented] (BEAM-1827) Fix use of deprecated Spark APIs in the runner.

2017-03-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947316#comment-15947316 ] ASF GitHub Bot commented on BEAM-1827: -- Github user asfgit closed the pull request at:

  1   2   >