[1/2] beam git commit: [BEAM-2412] Update HBaseIO to use HBase client 1.2.6

2017-06-12 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master 32d55323c -> fe3d55403 [BEAM-2412] Update HBaseIO to use HBase client 1.2.6 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6859f804 Tree:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3350

2017-06-12 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2423) Abstract StateInternalsTest for the different state internals/Runners

2017-06-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047376#comment-16047376 ] ASF GitHub Bot commented on BEAM-2423: -- GitHub user JingsongLi opened a pull request:

[GitHub] beam pull request #3348: [BEAM-2423] Port state internals tests to the new b...

2017-06-12 Thread JingsongLi
GitHub user JingsongLi opened a pull request: https://github.com/apache/beam/pull/3348 [BEAM-2423] Port state internals tests to the new base class StateInternalsTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[1/2] beam git commit: Check for Deferral on Non-additional inputs

2017-06-12 Thread kenn
Repository: beam Updated Branches: refs/heads/master ce3dd4583 -> 32d55323c Check for Deferral on Non-additional inputs Because Side Inputs are represented within the expanded inputs, the check that the transform is a Combine with Side Inputs would never be hit. This ensures that we do not

[2/2] beam git commit: This closes #3347: Check for Deferral on Non-additional inputs

2017-06-12 Thread kenn
This closes #3347: Check for Deferral on Non-additional inputs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/32d55323 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/32d55323 Diff:

[jira] [Closed] (BEAM-2375) upgrade beam-version to 2.0.0

2017-06-12 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu closed BEAM-2375. -- Resolution: Fixed Fix Version/s: 2.1.0 > upgrade beam-version to 2.0.0 > - >

[jira] [Closed] (BEAM-2196) support UDF

2017-06-12 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu closed BEAM-2196. -- Resolution: Fixed Fix Version/s: 2.1.0 > support UDF > --- > > Key: BEAM-2196 >

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3349

2017-06-12 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-2194) JOIN: cross join

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reassigned BEAM-2194: Assignee: James Xu (was: Xu Mingmin) > JOIN: cross join > > >

[jira] [Closed] (BEAM-2433) unify SQL/Sql words in class name

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2433. Resolution: Fixed Fix Version/s: Not applicable > unify SQL/Sql words in class name >

[jira] [Updated] (BEAM-2289) add unit tests for BeamSQLFilterFn and BeamSQLProjectFn

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2289: - Labels: dsl_sql_merge (was: ) > add unit tests for BeamSQLFilterFn and BeamSQLProjectFn >

[jira] [Commented] (BEAM-2196) support UDF

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047298#comment-16047298 ] Xu Mingmin commented on BEAM-2196: -- [~xumingming] can you close this task? > support UDF > --- >

[jira] [Updated] (BEAM-2281) call SqlFunctions in operator implementation

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2281: - Labels: dsl_sql_merge (was: ) > call SqlFunctions in operator implementation >

[jira] [Updated] (BEAM-2282) logic in function accept in BeamSqlExpression

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2282: - Labels: dsl_sql_merge (was: ) > logic in function accept in BeamSqlExpression >

[jira] [Updated] (BEAM-2227) add a post to explain how Beam SQL works

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2227: - Labels: dsl_sql_merge (was: ) > add a post to explain how Beam SQL works >

[jira] [Commented] (BEAM-2375) upgrade beam-version to 2.0.0

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047295#comment-16047295 ] Xu Mingmin commented on BEAM-2375: -- [~xumingming] can you close this task? > upgrade beam-version to

[jira] [Updated] (BEAM-2424) CAST operator supporting numeric types

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2424: - Labels: dsl_sql_merge (was: ) > CAST operator supporting numeric types >

[jira] [Updated] (BEAM-2435) test BeamRelNode with DSL methods

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2435: - Labels: dsl_sql_merge (was: ) > test BeamRelNode with DSL methods > - > >

Jenkins build is back to normal : beam_PostCommit_Java_JDK_Versions_Test » OpenJDK 8 (on Ubuntu only),beam #78

2017-06-12 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2343

2017-06-12 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #126

2017-06-12 Thread Apache Jenkins Server
See Changes: [aljoscha.krettek] [BEAM-2423] Abstract StateInternalsTest for the different state [altay] Reverse removal of NativeWrite evaluator in Python DirectRunner [tgroh] Cleanup

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #78

2017-06-12 Thread Apache Jenkins Server
See Changes: [aljoscha.krettek] [BEAM-2423] Abstract StateInternalsTest for the different state [altay] Reverse removal of NativeWrite evaluator in

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #2342

2017-06-12 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2436) table is not regeisted in BeamSql.query

2017-06-12 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2436: - Labels: dsl_sql_merge (was: ) > table is not regeisted in BeamSql.query >

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2340

2017-06-12 Thread Apache Jenkins Server
See

[1/2] beam git commit: This closes #3345

2017-06-12 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 86e04893a -> ce3dd4583 This closes #3345 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ce3dd458 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ce3dd458 Diff:

[GitHub] beam pull request #3345: Cleanups to CombineTest

2017-06-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3345 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3346

2017-06-12 Thread altay
This closes #3346 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/86e04893 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/86e04893 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/86e04893 Branch:

[GitHub] beam pull request #3346: Reverse removal of NativeWrite evaluator in Python ...

2017-06-12 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3346 Reverse removal of NativeWrite evaluator in Python DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3313: [BEAM-2423] Abstract StateInternalsTest for the dif...

2017-06-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3313 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2423] Abstract StateInternalsTest for the different state internals

2017-06-12 Thread aljoscha
Repository: beam Updated Branches: refs/heads/master 1597f3ca6 -> f9d51aa5c [BEAM-2423] Abstract StateInternalsTest for the different state internals Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8362bdb9 Tree:

[GitHub] beam pull request #3344: Improves message when transitively serializing Pipe...

2017-06-12 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3344 Improves message when transitively serializing PipelineOptions R: @lukecwik You can merge this pull request into a Git repository by running: $ git pull https://github.com/jkff/incubator-beam

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #125

2017-06-12 Thread Apache Jenkins Server
See -- [...truncated 2.64 MB...] 2017-06-12T18:35:29.015 [INFO] Downloaded: https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip/1.8/gossip-1.8.pom

[jira] [Resolved] (BEAM-2405) Create a BigQuery sink for streaming using PTransform

2017-06-12 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj resolved BEAM-2405. - Resolution: Fixed Fix Version/s: 2.1.0 > Create a BigQuery sink for streaming using

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2338

2017-06-12 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » OpenJDK 8 (on Ubuntu only),beam #77

2017-06-12 Thread Apache Jenkins Server
See -- [...truncated 1016.28 KB...] 2017-06-12\T\18:12:20.864 [INFO] Excluding io.grpc:grpc-protobuf-nano:jar:1.2.0

[jira] [Commented] (BEAM-2433) unify SQL/Sql words in class name

2017-06-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046827#comment-16046827 ] ASF GitHub Bot commented on BEAM-2433: -- Github user XuMingmin closed the pull request at:

[GitHub] beam pull request #3340: [BEAM-2433] unify SQL/Sql words in class name

2017-06-12 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3340 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-06-12 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046824#comment-16046824 ] Stephen Sisk commented on BEAM-1323: can you elaborate on what exactly the SplittingFn would do? What

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Gearpump #174

2017-06-12 Thread Apache Jenkins Server
See Changes: [mingmxu] update JavaDoc for BoundedWindow [klk] Restore non-recursive globs in GcsUtil [dhalperi] [BEAM-1702] Document how to use BigtableIO with local emulator [klk]

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-06-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046784#comment-16046784 ] Jean-Baptiste Onofré commented on BEAM-1323: The idea is to allow user provide a Splitting Fn,

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-06-12 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046775#comment-16046775 ] Stephen Sisk commented on BEAM-1323: +1 to eugene's comment. I don't believe we can reliably do this in

[34/50] [abbrv] beam git commit: [BEAM-2410] Remove TransportClient from ElasticSearchIO to decouple IO and ES server versions

2017-06-12 Thread kenn
[BEAM-2410] Remove TransportClient from ElasticSearchIO to decouple IO and ES server versions Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7caea7a8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7caea7a8 Diff:

[14/50] [abbrv] beam git commit: This closes #3303

2017-06-12 Thread kenn
This closes #3303 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e066a9d6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e066a9d6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e066a9d6 Branch:

[41/50] [abbrv] beam git commit: Visit a Transform Hierarchy in Topological Order

2017-06-12 Thread kenn
Visit a Transform Hierarchy in Topological Order This reverts commit 6ad6433ec0c02aec8656e9e3b27f6e0f974f8ece. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/261e7df2 Tree:

[16/50] [abbrv] beam git commit: Expand all PValues to component PCollections always

2017-06-12 Thread kenn
Expand all PValues to component PCollections always Update the implementation of WriteView The PCollectionView is constructed within the composite override, but WriteView just produces a primitive PCollection which has no consumers. Track the ViewWriter within the Direct Runner, and utilize that

[05/50] [abbrv] beam git commit: [BEAM-2421] Swap to use an Impulse primitive + DoFn for Create when executing with the Fn API.

2017-06-12 Thread kenn
[BEAM-2421] Swap to use an Impulse primitive + DoFn for Create when executing with the Fn API. This closes #3312 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/caecac3b Tree:

[19/50] [abbrv] beam git commit: Refine Python DirectRunner watermark advancement behavior

2017-06-12 Thread kenn
Refine Python DirectRunner watermark advancement behavior This change helps prepare for streaming pipeline execution. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3e049020 Tree:

[27/50] [abbrv] beam git commit: Closes #3325

2017-06-12 Thread kenn
Closes #3325 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7c5a70ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7c5a70ed Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7c5a70ed Branch:

[46/50] [abbrv] beam git commit: Port DirectRunner WriteFiles override to SDK-agnostic APIs

2017-06-12 Thread kenn
Port DirectRunner WriteFiles override to SDK-agnostic APIs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ed6bd18b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ed6bd18b Diff:

[30/50] [abbrv] beam git commit: Slight debuggability improvements in BigtableIO

2017-06-12 Thread kenn
Slight debuggability improvements in BigtableIO - ByteKeyRangeTracker.splitAtPosition logs the "insane" case first. - BigtableIO logs the split position at INFO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/82a6cb61 Tree:

[25/50] [abbrv] beam git commit: This closes #3239: [BEAM-2371] Port DirectRunner override matchers to language-agnostic construction APIs

2017-06-12 Thread kenn
This closes #3239: [BEAM-2371] Port DirectRunner override matchers to language-agnostic construction APIs DirectRunner override matchers using Runner API Add Runner API oriented PTransformMatchers for DirectRunner overrides Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[11/50] [abbrv] beam git commit: [BEAM-1226] Make BytesCoder to be a known type

2017-06-12 Thread kenn
[BEAM-1226] Make BytesCoder to be a known type This closes #3316 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0a0a1bc7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0a0a1bc7 Diff:

[21/50] [abbrv] beam git commit: Raise entity limit per RPC to 9MB.

2017-06-12 Thread kenn
Raise entity limit per RPC to 9MB. This is closer to the API limit, while still leaving room for overhead. Brings the Java SDK into line with the Python SDK. Switch the unit test to use the size of each entity, which is what the connector is actually using, rather than the property size (which

[47/50] [abbrv] beam git commit: Port DirectRunner TestStream override to SDK-agnostic APIs

2017-06-12 Thread kenn
Port DirectRunner TestStream override to SDK-agnostic APIs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/eaaf45fa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/eaaf45fa Diff:

[42/50] [abbrv] beam git commit: Roll-forward Include Additional PTransform inputs in Transform Nodes

2017-06-12 Thread kenn
Roll-forward Include Additional PTransform inputs in Transform Nodes Update DirectGraph to have All and Non-Additional Inputs This reverts commit 247f9bc1581984d026764b3d433cb594e700bc21 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[13/50] [abbrv] beam git commit: Add coder info to pubsub io

2017-06-12 Thread kenn
Add coder info to pubsub io Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b5852d21 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b5852d21 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b5852d21 Branch:

[15/50] [abbrv] beam git commit: Expand all PValues to component PCollections always

2017-06-12 Thread kenn
http://git-wip-us.apache.org/repos/asf/beam/blob/ccf73448/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/StreamingViewOverrides.java -- diff --git

[02/50] [abbrv] beam git commit: This closes #2286

2017-06-12 Thread kenn
This closes #2286 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/609016d7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/609016d7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/609016d7 Branch:

[08/50] [abbrv] beam git commit: Remove support for NativeSinks from the Python DirectRunner

2017-06-12 Thread kenn
Remove support for NativeSinks from the Python DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f2e30886 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f2e30886 Diff:

[GitHub] beam pull request #3292: [BEAM-79] Merge master into gearpump-runner

2017-06-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3292 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[45/50] [abbrv] beam git commit: Port DirectGroupByKey to SDK-agnostic APIs

2017-06-12 Thread kenn
Port DirectGroupByKey to SDK-agnostic APIs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/02dbaefd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/02dbaefd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/02dbaefd

[49/50] [abbrv] beam git commit: Fix side input handling in DoFnFunction

2017-06-12 Thread kenn
Fix side input handling in DoFnFunction Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7653e7ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7653e7ed Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7653e7ed

[44/50] [abbrv] beam git commit: Port ViewOverrideFactory to SDK-agnostic APIs

2017-06-12 Thread kenn
Port ViewOverrideFactory to SDK-agnostic APIs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8c5b57ea Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8c5b57ea Diff:

[50/50] [abbrv] beam git commit: This closes #3292: Merge master into gearpump-runner

2017-06-12 Thread kenn
This closes #3292: Merge master into gearpump-runner Adjustments to gearpump-runner: Fix side input handling in DoFnFunction Respect WindowFn#getOutputTime in gearpump-runner Activate Gearpump local-validates-runner-tests in precommit Update against master changes Merged from master:

[39/50] [abbrv] beam git commit: Closes #3332

2017-06-12 Thread kenn
Closes #3332 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d2c4093e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d2c4093e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d2c4093e Branch:

[48/50] [abbrv] beam git commit: This closes #3338: [BEAM-2371] Port some DirectRunner overrides to SDK-agnostic APIs

2017-06-12 Thread kenn
This closes #3338: [BEAM-2371] Port some DirectRunner overrides to SDK-agnostic APIs Port DirectRunner TestStream override to SDK-agnostic APIs Port DirectRunner WriteFiles override to SDK-agnostic APIs Port DirectGroupByKey to SDK-agnostic APIs Port ViewOverrideFactory to SDK-agnostic

[17/50] [abbrv] beam git commit: Avoid flakiness in data channel for empty streams.

2017-06-12 Thread kenn
Avoid flakiness in data channel for empty streams. As empty stream is used as end-of-stream marker, don't ever send it as the data itself. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4ebebfdb Tree:

[20/50] [abbrv] beam git commit: This closes #3322

2017-06-12 Thread kenn
This closes #3322 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fdfc70ee Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fdfc70ee Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/fdfc70ee Branch:

[18/50] [abbrv] beam git commit: Avoid flakiness in data channel for empty streams.

2017-06-12 Thread kenn
Avoid flakiness in data channel for empty streams. This closes #3324 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d81ed217 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d81ed217 Diff:

[22/50] [abbrv] beam git commit: This closes #3302

2017-06-12 Thread kenn
This closes #3302 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b53e6f0d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b53e6f0d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b53e6f0d Branch:

[03/50] [abbrv] beam git commit: [BEAM-2421] Swap to use an Impulse primitive + DoFn for Create when executing with the Fn API.

2017-06-12 Thread kenn
[BEAM-2421] Swap to use an Impulse primitive + DoFn for Create when executing with the Fn API. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1cdb80cb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1cdb80cb Diff:

[35/50] [abbrv] beam git commit: [BEAM-2410] This closes #3328

2017-06-12 Thread kenn
[BEAM-2410] This closes #3328 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1c6861f2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1c6861f2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1c6861f2 Branch:

[24/50] [abbrv] beam git commit: Add Runner API oriented PTransformMatchers for DirectRunner overrides

2017-06-12 Thread kenn
Add Runner API oriented PTransformMatchers for DirectRunner overrides Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ca7b9c28 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ca7b9c28 Diff:

[10/50] [abbrv] beam git commit: Make BytesCoder to be a known type

2017-06-12 Thread kenn
Make BytesCoder to be a known type Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d94ac58e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d94ac58e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d94ac58e

[01/50] [abbrv] beam git commit: [BEAM-1779] Port UnboundedSourceWrapperTest to use Flink operator test harness

2017-06-12 Thread kenn
Repository: beam Updated Branches: refs/heads/gearpump-runner 99221e739 -> 559e3c341 [BEAM-1779] Port UnboundedSourceWrapperTest to use Flink operator test harness Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c1dc8f53

[12/50] [abbrv] beam git commit: Closes #3317

2017-06-12 Thread kenn
Closes #3317 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/86e1fab6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/86e1fab6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/86e1fab6 Branch:

[28/50] [abbrv] beam git commit: Implements HCatalogIO

2017-06-12 Thread kenn
Implements HCatalogIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/349898c4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/349898c4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/349898c4 Branch:

[09/50] [abbrv] beam git commit: This closes #3321

2017-06-12 Thread kenn
This closes #3321 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/66460cb2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/66460cb2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/66460cb2 Branch:

[43/50] [abbrv] beam git commit: This closes #3337: Include Additional PTransform Inputs in Transform Nodes

2017-06-12 Thread kenn
This closes #3337: Include Additional PTransform Inputs in Transform Nodes Roll-forward Include Additional PTransform inputs in Transform Nodes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b4c77167 Tree:

[29/50] [abbrv] beam git commit: This closes #3220: Implements HCatalogIO

2017-06-12 Thread kenn
This closes #3220: Implements HCatalogIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/911bfbde Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/911bfbde Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/911bfbde

[07/50] [abbrv] beam git commit: This closes #3294

2017-06-12 Thread kenn
This closes #3294 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/32f22b7d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/32f22b7d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/32f22b7d Branch:

[23/50] [abbrv] beam git commit: DirectRunner override matchers using Runner API

2017-06-12 Thread kenn
DirectRunner override matchers using Runner API Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d8d90878 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d8d90878 Diff:

[31/50] [abbrv] beam git commit: This closes #3331: Slight debuggability improvements in BigtableIO

2017-06-12 Thread kenn
This closes #3331: Slight debuggability improvements in BigtableIO Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bc2f97c7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bc2f97c7 Diff:

[jira] [Commented] (BEAM-2437) quickstart.py docs is missing the path to MANIFEST.in

2017-06-12 Thread Jonathan Bingham (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046749#comment-16046749 ] Jonathan Bingham commented on BEAM-2437: Works for me! > quickstart.py docs is missing the path to

[jira] [Commented] (BEAM-2437) quickstart.py docs is missing the path to MANIFEST.in

2017-06-12 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046742#comment-16046742 ] Ahmet Altay commented on BEAM-2437: --- Thank you [~j...@jbingham.com] for reporting this. We could change

[2/5] beam git commit: rename SQL to Sql in class name

2017-06-12 Thread lcwik
http://git-wip-us.apache.org/repos/asf/beam/blob/743f0b3b/dsls/sql/src/main/java/org/apache/beam/dsls/sql/transform/BeamSQLFilterFn.java -- diff --git

[5/5] beam git commit: [BEAM-2433] unify SQL/Sql words in class name

2017-06-12 Thread lcwik
[BEAM-2433] unify SQL/Sql words in class name This closes #3340 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e68badd4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e68badd4 Diff:

[3/5] beam git commit: rename SQL to Sql in class name

2017-06-12 Thread lcwik
http://git-wip-us.apache.org/repos/asf/beam/blob/743f0b3b/dsls/sql/src/main/java/org/apache/beam/dsls/sql/rel/BeamAggregationRel.java -- diff --git a/dsls/sql/src/main/java/org/apache/beam/dsls/sql/rel/BeamAggregationRel.java

[1/5] beam git commit: rename SQL to Sql in class name

2017-06-12 Thread lcwik
Repository: beam Updated Branches: refs/heads/DSL_SQL 5c1f2cbc6 -> e68badd4d http://git-wip-us.apache.org/repos/asf/beam/blob/743f0b3b/dsls/sql/src/test/java/org/apache/beam/dsls/sql/planner/BeamPlannerSubmitTest.java -- diff

[4/5] beam git commit: rename SQL to Sql in class name

2017-06-12 Thread lcwik
rename SQL to Sql in class name Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/743f0b3b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/743f0b3b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/743f0b3b Branch:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2337

2017-06-12 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-2409) Spark runner produces exactly twice the number of results in streaming mode when use triggers to re-window results on global window.

2017-06-12 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2409: --- Assignee: Amit Sela (was: Aviem Zur) > Spark runner produces exactly twice the number of results in

[GitHub] beam pull request #3343: [BEAM-2359] Fix watermark broadcasting to executors...

2017-06-12 Thread aviemzur
GitHub user aviemzur opened a pull request: https://github.com/apache/beam/pull/3343 [BEAM-2359] Fix watermark broadcasting to executors in Spark runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[jira] [Resolved] (BEAM-2429) Conflicting filesystems with used of HadoopFileSystem

2017-06-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Wagner resolved BEAM-2429. --- Resolution: Not A Bug Fix Version/s: 2.0.0 > Conflicting filesystems with used of

[jira] [Commented] (BEAM-2429) Conflicting filesystems with used of HadoopFileSystem

2017-06-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046511#comment-16046511 ] François Wagner commented on BEAM-2429: --- Hi Flavio, Thanks for your input, it worked right away when

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #124

2017-06-12 Thread Apache Jenkins Server
See -- [...truncated 2.64 MB...] 2017-06-12T12:35:01.971 [INFO] Downloading: https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip/1.8/gossip-1.8.pom

Jenkins build is back to normal : beam_PostCommit_Java_JDK_Versions_Test » OpenJDK 7 (on Ubuntu only),beam #76

2017-06-12 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #76

2017-06-12 Thread Apache Jenkins Server
See -- [...truncated 1.56 MB...] [javadoc] ^ [javadoc] symbol: class CompletableFuture [javadoc] location:

  1   2   >