[jira] [Commented] (BEAM-766) Trigger AST should use @AutoValue

2017-06-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055130#comment-16055130 ] Kenneth Knowles commented on BEAM-766: -- I think that you should apply {{@AutoValue}} to the subclasses.

[jira] [Assigned] (BEAM-2469) Handling Kinesis shards splits and merges

2017-06-19 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2469: -- Assignee: (was: Davor Bonaci) > Handling Kinesis shards splits and merges >

[jira] [Assigned] (BEAM-2467) KinesisIO watermark based on approximateArrivalTimestamp

2017-06-19 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2467: -- Assignee: (was: Davor Bonaci) > KinesisIO watermark based on approximateArrivalTimestamp >

[jira] [Commented] (BEAM-2468) Reading Kinesis records in the background

2017-06-19 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055114#comment-16055114 ] Davor Bonaci commented on BEAM-2468: [~pawel.kaczmarczyk], can you perhaps contribute a fix for this

[jira] [Assigned] (BEAM-2468) Reading Kinesis records in the background

2017-06-19 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2468: -- Assignee: (was: Davor Bonaci) > Reading Kinesis records in the background >

[jira] [Commented] (BEAM-2466) Add Kafka Streams runner

2017-06-19 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055111#comment-16055111 ] Davor Bonaci commented on BEAM-2466: Totally! > Add Kafka Streams runner > >

[jira] [Assigned] (BEAM-2466) Add Kafka Streams runner

2017-06-19 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2466: -- Assignee: (was: Davor Bonaci) > Add Kafka Streams runner > > >

[jira] [Created] (BEAM-2479) get MAX value from PCollection .apply(Combine.globally(Max.ofDoubles()))

2017-06-19 Thread liyuntian (JIRA)
liyuntian created BEAM-2479: --- Summary: get MAX value from PCollection .apply(Combine.globally(Max.ofDoubles())) Key: BEAM-2479 URL: https://issues.apache.org/jira/browse/BEAM-2479 Project: Beam

[jira] [Updated] (BEAM-2477) BeamAggregationRel should use Combine.perKey instead of GroupByKey

2017-06-19 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2477: - Labels: dsl_sql_merge (was: ) > BeamAggregationRel should use Combine.perKey instead of GroupByKey >

[jira] [Created] (BEAM-2478) Distinct Aggregates

2017-06-19 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-2478: -- Summary: Distinct Aggregates Key: BEAM-2478 URL: https://issues.apache.org/jira/browse/BEAM-2478 Project: Beam Issue Type: New Feature Components:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4149

2017-06-19 Thread Apache Jenkins Server
See -- [...truncated 3.37 MB...] [INFO] I/O exception (java.net.SocketException) caught when processing request to {s}->https://repo.maven.apache.org:443: Connection

[jira] [Commented] (BEAM-2477) BeamAggregationRel should use Combine.perKey instead of GroupByKey

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055029#comment-16055029 ] ASF GitHub Bot commented on BEAM-2477: -- GitHub user JingsongLi opened a pull request:

[GitHub] beam pull request #3398: [BEAM-2477] BeamAggregationRel should use Combine.p...

2017-06-19 Thread JingsongLi
GitHub user JingsongLi opened a pull request: https://github.com/apache/beam/pull/3398 [BEAM-2477] BeamAggregationRel should use Combine.perKey instead of GroupByKey Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Created] (BEAM-2477) BeamAggregationRel should use Combine.perKey instead of GroupByKey

2017-06-19 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-2477: -- Summary: BeamAggregationRel should use Combine.perKey instead of GroupByKey Key: BEAM-2477 URL: https://issues.apache.org/jira/browse/BEAM-2477 Project: Beam

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #154

2017-06-19 Thread Apache Jenkins Server
See Changes: [robertwb] Add dry run option to DataflowRunner [jbonofre] [BEAM-975] Improve default connection options, javadoc and style in [iemejia] Make HBaseIO tests faster by only

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #106

2017-06-19 Thread Apache Jenkins Server
See Changes: [robertwb] Add dry run option to DataflowRunner [jbonofre] [BEAM-975] Improve default connection options, javadoc and style in [iemejia]

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » OpenJDK 8 (on Ubuntu only),beam #106

2017-06-19 Thread Apache Jenkins Server
See Changes: [robertwb] Add dry run option to DataflowRunner [jbonofre] [BEAM-975] Improve default connection options, javadoc and style in

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3397

2017-06-19 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2476) Dataflow streaming runner fails SDF testWindowedSideInputWithCheckpoints

2017-06-19 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-2476: -- Summary: Dataflow streaming runner fails SDF testWindowedSideInputWithCheckpoints Key: BEAM-2476 URL: https://issues.apache.org/jira/browse/BEAM-2476 Project:

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2528

2017-06-19 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-766) Trigger AST should use @AutoValue

2017-06-19 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054958#comment-16054958 ] Innocent commented on BEAM-766: --- I thought about applying the @AutoValue annotation on the Trigger class in

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4148

2017-06-19 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268 -- [...truncated 1.05 MB...] 2017-06-19T23:40:51.478 [INFO]

[jira] [Commented] (BEAM-1348) Model the Fn Api

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054914#comment-16054914 ] ASF GitHub Bot commented on BEAM-1348: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3397: [BEAM-1348] Fix type error introduced into Python S...

2017-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3397 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268

2017-06-19 Thread lcwik
[BEAM-1348] Fix type error introduced into Python SDK because of PR/3268 This closes #3397 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2304972c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2304972c Diff:

[1/2] beam git commit: [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268

2017-06-19 Thread lcwik
Repository: beam Updated Branches: refs/heads/master c6c8d9ee6 -> 2304972c5 [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/595ca1ec Tree:

[jira] [Commented] (BEAM-940) ByteBuddyOnTimerInvokerFactory: key the cache with a (Class, id) tuple or OnTimerMethod

2017-06-19 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054908#comment-16054908 ] Innocent commented on BEAM-940: --- Do you mean LoadingCache> was renamed

[jira] [Updated] (BEAM-940) ByteBuddyOnTimerInvokerFactory: key the cache with a (Class, id) tuple or OnTimerMethod

2017-06-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-940: - Summary: ByteBuddyOnTimerInvokerFactory: key the cache with a (Class, id) tuple or OnTimerMethod

[GitHub] beam pull request #3397: [BEAM-1348] Fix type error introduced into Python S...

2017-06-19 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3397 [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[jira] [Commented] (BEAM-1348) Model the Fn Api

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054899#comment-16054899 ] ASF GitHub Bot commented on BEAM-1348: -- GitHub user lukecwik opened a pull request:

[jira] [Commented] (BEAM-940) OnTimerInvokers: key the cache with a (Class, id) tuple or OnTimerMethod

2017-06-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054898#comment-16054898 ] Kenneth Knowles commented on BEAM-940: -- Ah it has been renamed to {{ByteBuddyOnTimerInvokerFactory}}

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4147

2017-06-19 Thread Apache Jenkins Server
See Changes: [iemejia] Make HBaseIO tests faster by only using the core daemons needed by HBase -- [...truncated 3.24 MB...] root: INFO: start root:

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3396

2017-06-19 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #2404

2017-06-19 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #2527

2017-06-19 Thread Apache Jenkins Server
See Changes: [iemejia] Make HBaseIO tests faster by only using the core daemons needed by HBase -- [...truncated 584.71 KB...] } primitive_transform

[1/2] beam git commit: Make HBaseIO tests faster by only using the core daemons needed by HBase

2017-06-19 Thread iemejia
Repository: beam Updated Branches: refs/heads/master b400f4a6f -> c6c8d9ee6 Make HBaseIO tests faster by only using the core daemons needed by HBase Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6d272825 Tree:

[GitHub] beam pull request #3392: Make HBaseIO tests faster by only using the core da...

2017-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3392 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3392

2017-06-19 Thread iemejia
This closes #3392 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c6c8d9ee Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c6c8d9ee Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c6c8d9ee Branch:

Build failed in Jenkins: beam_PostCommit_Python_Verify #2526

2017-06-19 Thread Apache Jenkins Server
See -- [...truncated 584.74 KB...] } primitive_transform { id: "9" function_spec { id: "10" urn: "urn:org.apache.beam:sink:runner:0.1"

[jira] [Updated] (BEAM-2475) Add Jenkins Suite for Python Performance Test

2017-06-19 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-2475: --- Component/s: (was: sdk-py) > Add Jenkins Suite for Python Performance Test >

[jira] [Updated] (BEAM-1263) Add Jenkins Suites for Performance Tests

2017-06-19 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-1263: --- Issue Type: Task (was: Bug) > Add Jenkins Suites for Performance Tests >

[jira] [Updated] (BEAM-2475) Add Jenkins Suite for Python Performance Test

2017-06-19 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-2475: --- Issue Type: Task (was: Bug) > Add Jenkins Suite for Python Performance Test >

[jira] [Created] (BEAM-2475) Add Jenkins Suite for Python Performance Test

2017-06-19 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2475: -- Summary: Add Jenkins Suite for Python Performance Test Key: BEAM-2475 URL: https://issues.apache.org/jira/browse/BEAM-2475 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054697#comment-16054697 ] ASF GitHub Bot commented on BEAM-1542: -- GitHub user mairbek opened a pull request:

[GitHub] beam pull request #3395: [BEAM-1542] Cloud Spanner Source

2017-06-19 Thread mairbek
GitHub user mairbek opened a pull request: https://github.com/apache/beam/pull/3395 [BEAM-1542] Cloud Spanner Source Defines Cloud Spanner Source API, and a naive implementation, similar to JdbcIO. Also includes https://github.com/apache/beam/pull/3358 You can merge this

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4146

2017-06-19 Thread Apache Jenkins Server
See Changes: [jbonofre] [BEAM-975] Improve default connection options, javadoc and style in -- [...truncated 3.24 MB...] root: INFO: start root: INFO:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2403

2017-06-19 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #2525

2017-06-19 Thread Apache Jenkins Server
See Changes: [jbonofre] [BEAM-975] Improve default connection options, javadoc and style in -- [...truncated 585.90 KB...] } primitive_transform {

[jira] [Resolved] (BEAM-975) Issue with MongoDBIO

2017-06-19 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-975. --- Resolution: Fixed Fix Version/s: 2.1.0 > Issue with MongoDBIO >

[jira] [Commented] (BEAM-975) Issue with MongoDBIO

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054630#comment-16054630 ] ASF GitHub Bot commented on BEAM-975: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #3118: [BEAM-975] Improve default connection options, java...

2017-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3118 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-975] Improve default connection options, javadoc and style in MongoDbIO

2017-06-19 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master 1476f3412 -> b400f4a6f [BEAM-975] Improve default connection options, javadoc and style in MongoDbIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/87be64e9 Tree:

[2/2] beam git commit: [BEAM-975] This closes #3118

2017-06-19 Thread jbonofre
[BEAM-975] This closes #3118 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b400f4a6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b400f4a6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b400f4a6 Branch:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4145

2017-06-19 Thread Apache Jenkins Server
See Changes: [robertwb] Add dry run option to DataflowRunner -- [...truncated 3.24 MB...] root: INFO: start root: INFO: start root: INFO: start root:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3394

2017-06-19 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2474) Tests in DataflowSDK-examples should test code in DataflowSDK-examples

2017-06-19 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-2474: - Summary: Tests in DataflowSDK-examples should test code in DataflowSDK-examples Key: BEAM-2474 URL: https://issues.apache.org/jira/browse/BEAM-2474 Project: Beam

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4144

2017-06-19 Thread Apache Jenkins Server
See -- [...truncated 3.24 MB...] root: INFO: start root: INFO: start root: INFO: start root: INFO: start root: INFO: finish root: INFO: finish root: INFO: finish

[GitHub] beam pull request #3394: Retries http code 0 (usually network error)

2017-06-19 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3394 Retries http code 0 (usually network error) R: @lukecwik You can merge this pull request into a Git repository by running: $ git pull https://github.com/jkff/incubator-beam retry-0 Alternatively

Build failed in Jenkins: beam_PostCommit_Python_Verify #2524

2017-06-19 Thread Apache Jenkins Server
See Changes: [robertwb] Add dry run option to DataflowRunner -- [...truncated 584.71 KB...] } primitive_transform { id: "9" function_spec

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2402

2017-06-19 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2473) Dataflow runner should reject unsupported state & timers at construction time, and documentation should be more prominent

2017-06-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2473: - Summary: Dataflow runner should reject unsupported state & timers at construction time, and documentation should be more prominent Key: BEAM-2473 URL:

[jira] [Created] (BEAM-2472) Add documentation of state & timers for ParDo to the programming guide

2017-06-19 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2472: - Summary: Add documentation of state & timers for ParDo to the programming guide Key: BEAM-2472 URL: https://issues.apache.org/jira/browse/BEAM-2472 Project: Beam

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4142

2017-06-19 Thread Apache Jenkins Server
See Changes: [kirpichov] A few cleanups in CombineTest -- [...truncated 3.24 MB...] root: INFO: start root: INFO: start root: INFO: start root: INFO:

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #105

2017-06-19 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1348] Model the Fn State Api as per [chamikara] Python streaming Create override as a composite of Impulse and a DoFn

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #153

2017-06-19 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1348] Model the Fn State Api as per [chamikara] Python streaming Create override as a composite of Impulse and a DoFn [kirpichov] A few cleanups in

[GitHub] beam pull request #3393: Fix Dataflow runner test to call pipeline.run inste...

2017-06-19 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3393 Fix Dataflow runner test to call pipeline.run instead of runner.run Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4140

2017-06-19 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1348] Model the Fn State Api as per -- [...truncated 3.24 MB...] root: INFO: start root: INFO: start root: INFO: start

[GitHub] beam pull request #3385: Add dry run option to DataflowRunner in python SDK

2017-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3385 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (BEAM-2471) Add Amazon EMR DynamoDB example using HadoopInputFormatIO

2017-06-19 Thread Seshadri Raghunathan (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seshadri Raghunathan updated BEAM-2471: --- Description: To document an example to read from Amazon EMR DynamoDB using

[1/2] beam git commit: Closes #3385

2017-06-19 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 1fb430442 -> 1476f3412 Closes #3385 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1476f341 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1476f341 Diff:

[2/2] beam git commit: Add dry run option to DataflowRunner

2017-06-19 Thread robertwb
Add dry run option to DataflowRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c2683e87 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c2683e87 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c2683e87

Build failed in Jenkins: beam_PostCommit_Python_Verify #2523

2017-06-19 Thread Apache Jenkins Server
See Changes: [chamikara] Python streaming Create override as a composite of Impulse and a DoFn [kirpichov] A few cleanups in CombineTest -- [...truncated

[jira] [Created] (BEAM-2471) Add Amazon EMR DynamoDB example using HadoopInputFormatIO

2017-06-19 Thread Seshadri Raghunathan (JIRA)
Seshadri Raghunathan created BEAM-2471: -- Summary: Add Amazon EMR DynamoDB example using HadoopInputFormatIO Key: BEAM-2471 URL: https://issues.apache.org/jira/browse/BEAM-2471 Project: Beam

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4141

2017-06-19 Thread Apache Jenkins Server
See Changes: [chamikara] Python streaming Create override as a composite of Impulse and a DoFn -- [...truncated 1.05 MB...] 2017-06-19T17:52:14.028

Build failed in Jenkins: beam_PostCommit_Python_Verify #2522

2017-06-19 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1348] Model the Fn State Api as per -- [...truncated 585.18 KB...] step_name: "FlatMap(cross_product)/Write" }

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3393

2017-06-19 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3380: A few cleanups in CombineTest

2017-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3380 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3380: A few cleanups in CombineTest

2017-06-19 Thread jkff
This closes #3380: A few cleanups in CombineTest Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1fb43044 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1fb43044 Diff:

[1/2] beam git commit: Python streaming Create override as a composite of Impulse and a DoFn

2017-06-19 Thread chamikara
Repository: beam Updated Branches: refs/heads/master 2ab482d2b -> c12d6ba80 Python streaming Create override as a composite of Impulse and a DoFn Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bcd43964 Tree:

[1/2] beam git commit: A few cleanups in CombineTest

2017-06-19 Thread jkff
Repository: beam Updated Branches: refs/heads/master c12d6ba80 -> 1fb430442 A few cleanups in CombineTest Better error messages and IntelliJ warning cleanups. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cf654a0b Tree:

[jira] [Commented] (BEAM-2421) Migrate Dataflow to use impulse primitive as the only root primitive

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054394#comment-16054394 ] ASF GitHub Bot commented on BEAM-2421: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3349: [BEAM-2421] Python streaming Create override as a c...

2017-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3349 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3349

2017-06-19 Thread chamikara
This closes #3349 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c12d6ba8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c12d6ba8 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c12d6ba8 Branch:

[jira] [Commented] (BEAM-1348) Model the Fn Api

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054369#comment-16054369 ] ASF GitHub Bot commented on BEAM-1348: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3268: [BEAM-1348] Model the Fn State Api as per https://s...

2017-06-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3268 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-1348] Model the Fn State Api as per https://s.apache.org/beam-fn-state-api-and-bundle-processing

2017-06-19 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 0cabdf6e7 -> 2ab482d2b [BEAM-1348] Model the Fn State Api as per https://s.apache.org/beam-fn-state-api-and-bundle-processing Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[2/2] beam git commit: [BEAM-1348] Model the Fn State Api as per https://s.apache.org/beam-fn-state-api-and-bundle-processing

2017-06-19 Thread lcwik
[BEAM-1348] Model the Fn State Api as per https://s.apache.org/beam-fn-state-api-and-bundle-processing This closes #3268 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2ab482d2 Tree:

[jira] [Comment Edited] (BEAM-2451) writeProtos() should allow a user to specify message attributes

2017-06-19 Thread Keith Berkoben (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054303#comment-16054303 ] Keith Berkoben edited comment on BEAM-2451 at 6/19/17 4:47 PM: --- What values

[jira] [Commented] (BEAM-2451) writeProtos() should allow a user to specify message attributes

2017-06-19 Thread Keith Berkoben (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054303#comment-16054303 ] Keith Berkoben commented on BEAM-2451: -- What values are used for the timestamp and ID when

[jira] [Commented] (BEAM-2458) Move HashingFn from test -> main to make it more accessible

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054298#comment-16054298 ] ASF GitHub Bot commented on BEAM-2458: -- Github user ssisk closed the pull request at:

[GitHub] beam pull request #3382: [BEAM-2458] Move HashingFn from test -> main

2017-06-19 Thread ssisk
Github user ssisk closed the pull request at: https://github.com/apache/beam/pull/3382 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2465) Python Stream Runner

2017-06-19 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054286#comment-16054286 ] Ahmet Altay commented on BEAM-2465: --- Hi [~willfuks], this is the right place to report. But this is

[jira] [Resolved] (BEAM-2465) Python Stream Runner

2017-06-19 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-2465. --- Resolution: Duplicate Fix Version/s: Not applicable > Python Stream Runner >

[jira] [Updated] (BEAM-2470) Inconsistent behavior on the functioning of the dataflow templates?

2017-06-19 Thread Damien GOUYETTE (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien GOUYETTE updated BEAM-2470: -- Description: 0 down vote favorite When i create a dataflow template, the characteristics of

[jira] [Created] (BEAM-2470) Inconsistent behavior on the functioning of the dataflow templates?

2017-06-19 Thread Damien GOUYETTE (JIRA)
Damien GOUYETTE created BEAM-2470: - Summary: Inconsistent behavior on the functioning of the dataflow templates? Key: BEAM-2470 URL: https://issues.apache.org/jira/browse/BEAM-2470 Project: Beam

[jira] [Assigned] (BEAM-2359) SparkTimerInternals inputWatermarkTime does not get updated in cluster mode

2017-06-19 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2359: --- Assignee: Aviem Zur (was: Amit Sela) > SparkTimerInternals inputWatermarkTime does not get updated

[GitHub] beam pull request #3392: Make HBaseIO tests faster by only using the core da...

2017-06-19 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/3392 Make HBaseIO tests faster by only using the core daemons needed by HBase Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[jira] [Commented] (BEAM-2411) Make the write transform of HBaseIO simpler

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054014#comment-16054014 ] ASF GitHub Bot commented on BEAM-2411: -- GitHub user iemejia opened a pull request:

[GitHub] beam pull request #3391: [BEAM-2411] Make the write transform of HBaseIO sim...

2017-06-19 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/3391 [BEAM-2411] Make the write transform of HBaseIO simpler Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is

[jira] [Comment Edited] (BEAM-2455) Backlog size retrieval for Kinesis source

2017-06-19 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053943#comment-16053943 ] Paweł Kaczmarczyk edited comment on BEAM-2455 at 6/19/17 1:25 PM: --

  1   2   >