svn commit: r16746 - /release/incubator/beam/0.3.0-incubating/

2016-10-31 Thread aljoscha
Author: aljoscha Date: Mon Oct 31 13:37:28 2016 New Revision: 16746 Log: Add Beam 0.3.0-incubating release artifacts Added: release/incubator/beam/0.3.0-incubating/ release/incubator/beam/0.3.0-incubating/apache-beam-0.3.0-incubating-source-release.zip (with props) release

[jira] [Created] (BEAM-864) Update to latest Apache Maven-Parent

2016-10-30 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-864: - Summary: Update to latest Apache Maven-Parent Key: BEAM-864 URL: https://issues.apache.org/jira/browse/BEAM-864 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-862) Flink PostCommit Fails On Jenkins

2016-10-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616689#comment-15616689 ] Aljoscha Krettek commented on BEAM-862: --- No problemo! > Flink PostCommit Fails On Jenk

[jira] [Closed] (BEAM-862) Flink PostCommit Fails On Jenkins

2016-10-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-862. - Resolution: Fixed > Flink PostCommit Fails On Jenk

[2/2] incubator-beam git commit: This closes #1207

2016-10-28 Thread aljoscha
-beam/diff/beccdc68 Branch: refs/heads/master Commit: beccdc6867a5e6bb2517bc4cb31c0cbee202beac Parents: e82c5d2 837bb2b Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Fri Oct 28 22:48:34 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Fri Oct

[1/2] incubator-beam git commit: [BEAM-862] Make Aggregator Creation Idempotent

2016-10-28 Thread aljoscha
ttp://git-wip-us.apache.org/repos/asf/incubator-beam/diff/837bb2b7 Branch: refs/heads/master Commit: 837bb2b71e515c9170fa2c031c86a618b085b249 Parents: e82c5d2 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Oct 27 15:31:20 2016 +0200 Committer: Aljoscha Krettek <a

[jira] [Created] (BEAM-862) Flink PostCommit Fails On Jenkins

2016-10-28 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-862: - Summary: Flink PostCommit Fails On Jenkins Key: BEAM-862 URL: https://issues.apache.org/jira/browse/BEAM-862 Project: Beam Issue Type: Bug

[GitHub] incubator-beam pull request #1207: Fix Failing Flink RunnableOnService Tests

2016-10-27 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1207 Fix Failing Flink RunnableOnService Tests The problem was that the DoFnInvoker was invoking createAggregatorForDoFn in the AggregatorFactory several times and Flink only allows

[jira] [Created] (BEAM-843) Use New DoFn Directly in Flink Runner

2016-10-27 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-843: - Summary: Use New DoFn Directly in Flink Runner Key: BEAM-843 URL: https://issues.apache.org/jira/browse/BEAM-843 Project: Beam Issue Type: Improvement

[GitHub] incubator-beam-site pull request #52: Add pointers to 0.3.0-incubating relea...

2016-10-24 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam-site/pull/52 Add pointers to 0.3.0-incubating release artifacts You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam-site

svn commit: r16664 - /dev/incubator/beam/0.3.0-incubating/

2016-10-24 Thread aljoscha
Author: aljoscha Date: Mon Oct 24 20:48:49 2016 New Revision: 16664 Log: Add Apache Beam 0.3.0-incubating RC1 Files Added: dev/incubator/beam/0.3.0-incubating/ dev/incubator/beam/0.3.0-incubating/apache-beam-0.3.0-incubating-source-release.zip (with props) dev/incubator/beam

incubator-beam git commit: [maven-release-plugin] rollback changes from release preparation of v0.3.0-incubating-RC1

2016-10-24 Thread aljoscha
nts: a4985be Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Oct 24 21:45:25 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Oct 24 21:45:25 2016 +0200 -- exampl

[incubator-beam] Git Push Summary

2016-10-24 Thread aljoscha
Repository: incubator-beam Updated Tags: refs/tags/v0.3.0-incubating-RC1 [created] 5d86ff7f0

incubator-beam git commit: [maven-release-plugin] prepare release v0.3.0-incubating-RC1

2016-10-24 Thread aljoscha
tor-beam/commit/a4985be4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a4985be4 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/a4985be4 Branch: refs/heads/release-0.3.0-incubating Commit: a4985be4a2ba7a6780e8f637d313518add8b2c11 Parents: e2d8a62 Author: Aljos

[incubator-beam] Git Push Summary [forced push!] [Forced Update!]

2016-10-24 Thread aljoscha
Repository: incubator-beam Updated Branches: refs/heads/release-0.3.0-incubating 564bbcc4b -> e2d8a62e3 (forced update)

[incubator-beam] Git Push Summary

2016-10-24 Thread aljoscha
Repository: incubator-beam Updated Tags: refs/tags/v0.3.0-incubating-RC1 [deleted] 47447b7e0

incubator-beam git commit: [maven-release-plugin] prepare release v0.3.0-incubating-RC1

2016-10-24 Thread aljoscha
tor-beam/commit/564bbcc4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/564bbcc4 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/564bbcc4 Branch: refs/heads/release-0.3.0-incubating Commit: 564bbcc4bc0ef12933302fa3e63c6942d4ee94dc Parents: e2d8a62 Author: Aljos

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15602937#comment-15602937 ] Aljoscha Krettek commented on BEAM-696: --- Just a clarification, the Flink runner does not pre combine

incubator-beam git commit: Manually change archetype versions to 0.3.0-incubating [Forced Update!]

2016-10-24 Thread aljoscha
hor: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Oct 24 21:04:37 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Oct 24 21:04:37 2016 +0200 -- .../examples/src/main/reso

[jira] [Updated] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-806: -- Priority: Blocker (was: Major) > Maven Release Plugin Does Not Set Archetype Versi

[jira] [Created] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2016-10-24 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-806: - Summary: Maven Release Plugin Does Not Set Archetype Versions Key: BEAM-806 URL: https://issues.apache.org/jira/browse/BEAM-806 Project: Beam Issue Type

[incubator-beam] Git Push Summary

2016-10-24 Thread aljoscha
Repository: incubator-beam Updated Tags: refs/tags/v0.3.0-incubating-RC1 [created] 47447b7e0

incubator-beam git commit: [maven-release-plugin] rollback changes from release preparation of v0.3.0-incubating-RC1

2016-10-24 Thread aljoscha
nts: 7a9ce4a Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Oct 24 18:54:22 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Oct 24 18:54:22 2016 +0200 -- exampl

incubator-beam git commit: [maven-release-plugin] prepare release v0.3.0-incubating-RC1

2016-10-24 Thread aljoscha
tor-beam/commit/7a9ce4a4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7a9ce4a4 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/7a9ce4a4 Branch: refs/heads/release-0.3.0-incubating Commit: 7a9ce4a40e39b8afd66039434607c7cb2c0df4eb Parents: c26b63b Author: Aljos

[incubator-beam] Git Push Summary

2016-10-24 Thread aljoscha
Repository: incubator-beam Updated Branches: refs/heads/release-0.3.0-incubating [created] c26b63bae

incubator-beam git commit: [maven-release-plugin] prepare for next development iteration

2016-10-24 Thread aljoscha
mit/8dfadbf0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8dfadbf0 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/8dfadbf0 Branch: refs/heads/master Commit: 8dfadbf01acc4fed6f604fe531e87730bab2b2bc Parents: c26b63b Author: Aljoscha Krettek <aljoscha.kret...@gma

incubator-beam git commit: [maven-release-plugin] prepare branch release-0.3.0-incubating

2016-10-24 Thread aljoscha
mit/c26b63ba Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c26b63ba Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/c26b63ba Branch: refs/heads/master Commit: c26b63baecde9105d32e3ba03874eb782162ecda Parents: 69ae8bd Author: Aljoscha Krettek <aljoscha.kret...@gma

[jira] [Closed] (BEAM-633) Be able to import Beam codebase in Eclipse and support m2e

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-633. - Resolution: Duplicate Fix Version/s: (was: 0.3.0-incubating

[jira] [Reopened] (BEAM-633) Be able to import Beam codebase in Eclipse and support m2e

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened BEAM-633: --- Reopening to close as non-resolved so that it doesn't show up in the release notes. > Be a

[jira] [Updated] (BEAM-102) Support Side Inputs in Flink Streaming Runner

2016-10-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-102: -- Summary: Support Side Inputs in Flink Streaming Runner (was: Side Inputs for Streaming

[GitHub] incubator-beam pull request #1166: Fixes for Javadoc and ReduceFnRunner

2016-10-24 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1166 Fixes for Javadoc and ReduceFnRunner Not sure if this is really wrong in `ReduceFnRunner`, was just a hunch. R: @kennknowles You can merge this pull request into a Git

svn commit: r16619 - /release/incubator/beam/KEYS

2016-10-21 Thread aljoscha
Author: aljoscha Date: Fri Oct 21 16:55:14 2016 New Revision: 16619 Log: Add aljoscha to incubator/beam/KEYS Modified: release/incubator/beam/KEYS Modified: release/incubator/beam/KEYS == --- release/incubator/beam

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-12 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569001#comment-15569001 ] Aljoscha Krettek commented on BEAM-696: --- Flink doesn't use bundles but it just keeps all the elements

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2016-10-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565001#comment-15565001 ] Aljoscha Krettek commented on BEAM-696: --- Just to make it clear what the Flink runner does

[jira] [Updated] (BEAM-720) Running WindowedWordCount Integration Test in Flink

2016-10-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-720: -- Component/s: runner-flink > Running WindowedWordCount Integration Test in Fl

[GitHub] incubator-beam pull request #1021: [BEAM-615] Add Support for Processing-Tim...

2016-09-28 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1021 [BEAM-615] Add Support for Processing-Time Timers in FlinkRunner This adds support for processing-time timers that are checkpointed. There are no tests for this yet but I ran

[jira] [Assigned] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-28 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-615: - Assignee: Aljoscha Krettek (was: Kenneth Knowles) > Add Support for Processing-T

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522966#comment-15522966 ] Aljoscha Krettek commented on BEAM-644: --- [~kenn] I was referring to "two clusters of elements fro

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515875#comment-15515875 ] Aljoscha Krettek commented on BEAM-644: --- Yes, as a replacement for {{outputWithTimestamp

[jira] [Commented] (BEAM-638) Add a Window function to create a bounded PCollection from an unbounded one

2016-09-20 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507706#comment-15507706 ] Aljoscha Krettek commented on BEAM-638: --- I don't think it's possible to provide such a function. What

[jira] [Commented] (BEAM-260) Know the getSideInputWindow upper bound so can gc side input state

2016-09-17 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498458#comment-15498458 ] Aljoscha Krettek commented on BEAM-260: --- The doc looks good, I'm not sure how many people will see

[jira] [Resolved] (BEAM-616) Update Flink Runner to 1.1.2

2016-09-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-616. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Update Flink Runner to 1.

[1/4] incubator-beam git commit: [BEAM-616] Update Flink Runner to Flink 1.1.2

2016-09-08 Thread aljoscha
ttp://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c66caf33 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/c66caf33 Branch: refs/heads/master Commit: c66caf3364ae5c20bdf0fbf41a8ef61d4e53c495 Parents: f33296c Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored:

[GitHub] incubator-beam pull request #922: Fix shaded imports in Flink Runner

2016-09-08 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/incubator-beam/pull/922 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[2/4] incubator-beam git commit: Merge branch 'flink-1.1.2'

2016-09-08 Thread aljoscha
-us.apache.org/repos/asf/incubator-beam/diff/31d09eb4 Branch: refs/heads/master Commit: 31d09eb45c4fcd5f88012145e64734785fe4c022 Parents: f33296c c66caf3 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Sep 8 10:11:02 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@

[3/4] incubator-beam git commit: Fix shaded imports in Flink Runner

2016-09-08 Thread aljoscha
/asf/incubator-beam/diff/27259599 Branch: refs/heads/master Commit: 2725959996d131b6d189f7f62df3d05e0d361ba0 Parents: 31d09eb Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Sep 5 10:50:14 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed:

[4/4] incubator-beam git commit: Merge branch 'flink-fix-imports'

2016-09-08 Thread aljoscha
-us.apache.org/repos/asf/incubator-beam/diff/fb322cc7 Branch: refs/heads/master Commit: fb322cc73aac6ed42b45371751388270d4f0db16 Parents: 31d09eb 2725959 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu Sep 8 10:12:15 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@

[GitHub] incubator-beam pull request #921: [FLINK-616] Update Flink Runner to Flink 1...

2016-09-08 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/incubator-beam/pull/921 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-beam pull request #922: Fix shaded imports in Flink Runner

2016-09-06 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/922 Fix shaded imports in Flink Runner R: @mxm for review You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam flink-fix

[GitHub] incubator-beam pull request #921: [FLINK-616] Update Flink Runner to Flink 1...

2016-09-06 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/921 [FLINK-616] Update Flink Runner to Flink 1.1.2 R: @mxm for review You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator

[jira] [Created] (BEAM-616) Update Flink Runner to 1.1.2

2016-09-06 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-616: - Summary: Update Flink Runner to 1.1.2 Key: BEAM-616 URL: https://issues.apache.org/jira/browse/BEAM-616 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-615) Add Support for Processing-Time Timers in FlinkRunner Window Operator

2016-09-02 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-615: - Summary: Add Support for Processing-Time Timers in FlinkRunner Window Operator Key: BEAM-615 URL: https://issues.apache.org/jira/browse/BEAM-615 Project: Beam

incubator-beam git commit: Fix condition in FlinkStreamingPipelineTranslator

2016-08-31 Thread aljoscha
ttp://git-wip-us.apache.org/repos/asf/incubator-beam/tree/98da6e8f Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/98da6e8f Branch: refs/heads/master Commit: 98da6e8fb014d2a93b7441f6b2b131968d874ab6 Parents: 1dc1f25 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Auth

[2/2] incubator-beam git commit: Merge branch 'flink-fixes'

2016-08-31 Thread aljoscha
-us.apache.org/repos/asf/incubator-beam/diff/1dc1f25b Branch: refs/heads/master Commit: 1dc1f25b64eed7679e5d30309d5634052d187814 Parents: 33d747e cae9638 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Wed Aug 31 11:05:18 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@

[1/2] incubator-beam git commit: Address comments of Flink Side-Input PR

2016-08-31 Thread aljoscha
wip-us.apache.org/repos/asf/incubator-beam/tree/cae96380 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/cae96380 Branch: refs/heads/master Commit: cae96380f15fc293d00b444148e5d08c3f14d909 Parents: 33d747e Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Thu

[GitHub] incubator-beam pull request #883: Address comments of Flink Side-Input PR

2016-08-31 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/incubator-beam/pull/883 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[jira] [Commented] (BEAM-485) Can't set Flink runner in code

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438508#comment-15438508 ] Aljoscha Krettek commented on BEAM-485: --- Hi [~ecesena], could you check whether this bug is still

[jira] [Resolved] (BEAM-253) Unify Flink Operator Wrappers

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-253. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating Implemented here: https://github.com

[jira] [Resolved] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-315. --- Resolution: Fixed > Flink Runner compares keys unencoded which may produce incorrect resu

[jira] [Resolved] (BEAM-102) Side Inputs for Streaming

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-102. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating Implemented here:https://github.com

[jira] [Commented] (BEAM-286) Reorganize flink runner directories

2016-08-25 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436708#comment-15436708 ] Aljoscha Krettek commented on BEAM-286: --- Now that the PR is in I think the reorganization/cleanup can

[GitHub] incubator-beam pull request #883: Address comments of Flink Side-Input PR

2016-08-25 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/883 Address comments of Flink Side-Input PR R: @mxm You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam flink-fixes

[jira] [Created] (BEAM-581) Support Verifiers in TestFlinkRunner

2016-08-24 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-581: - Summary: Support Verifiers in TestFlinkRunner Key: BEAM-581 URL: https://issues.apache.org/jira/browse/BEAM-581 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402815#comment-15402815 ] Aljoscha Krettek commented on BEAM-321: --- I think we agreed a while back to only put the "fix ve

[jira] [Commented] (BEAM-322) Compare encoded keys in streaming mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402355#comment-15402355 ] Aljoscha Krettek commented on BEAM-322: --- The fix for this is included in this commit of my side-input

[jira] [Commented] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402329#comment-15402329 ] Aljoscha Krettek commented on BEAM-321: --- This was fixed a while ago in master and is part of the 0.2.0

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-08-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Fix Version/s: (was: 0.3.0-incubating) 0.2.0-incubating > Hash enco

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-07-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Fix Version/s: (was: 0.2.0-incubating) > Hash encoded keys in Flink batch m

[jira] [Updated] (BEAM-322) Compare encoded keys in streaming mode

2016-07-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-322: -- Fix Version/s: (was: 0.2.0-incubating) > Compare encoded keys in streaming m

[GitHub] incubator-beam pull request #737: Add Side-Input Support in Flink Streaming ...

2016-07-26 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/737 Add Side-Input Support in Flink Streaming Runner This does several things in somewhat isolated steps: - Unify the operator wrappers. Before there where 4 different DoFn/Window

[jira] [Assigned] (BEAM-322) Compare encoded keys in streaming mode

2016-07-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-322: - Assignee: Aljoscha Krettek > Compare encoded keys in streaming m

[jira] [Commented] (BEAM-242) Enable Checkstyle check and Javadoc build for the Flink Runner

2016-07-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382327#comment-15382327 ] Aljoscha Krettek commented on BEAM-242: --- The weekend before last weekend I worked on some stuff

[jira] [Assigned] (BEAM-253) Unify Flink Operator Wrappers

2016-07-18 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-253: - Assignee: Aljoscha Krettek > Unify Flink Operator Wrapp

[1/2] incubator-beam git commit: Allow for custom timestamp/watermark function in FlinkPipelineRunner

2016-07-13 Thread aljoscha
master Commit: 9000d95d2b34ab45f799aedb140710986ff19452 Parents: ee1a3bc Author: David Desberg <david.desb...@uber.com> Authored: Mon Jul 11 12:24:18 2016 -0700 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Wed J

[jira] [Commented] (BEAM-438) Rename one of PTransform.apply and PInput.apply

2016-07-12 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372575#comment-15372575 ] Aljoscha Krettek commented on BEAM-438: --- +1 I've seen people do the former several times. > Ren

[jira] [Closed] (BEAM-300) Upgrade to Flink 1.0.3

2016-07-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-300. - Resolution: Duplicate Fix Version/s: 0.2.0-incubating Flink was updated to 1.0.3 a while

[1/2] incubator-beam git commit: Use native Flink rebalance for Reshuffle Transform

2016-07-04 Thread aljoscha
ree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b58a19ce Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/b58a19ce Branch: refs/heads/master Commit: b58a19cebebddbfb5bc8ebe9cc2766c5eccbda59 Parents: 56c5277 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Auth

[2/2] incubator-beam git commit: This closes #483

2016-07-04 Thread aljoscha
/diff/9adbecb6 Branch: refs/heads/master Commit: 9adbecb6aa9bd752a6e6e39f41f80a31128d0918 Parents: 56c5277 b58a19c Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Mon Jul 4 16:56:47 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Mon Ju

[jira] [Resolved] (BEAM-392) Update flink runner to use flink version 1.0.3

2016-07-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-392. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Update flink runner to use fl

[1/3] incubator-beam git commit: [BEAM-392] Rename missing references to FlinkPipelineRunner

2016-06-30 Thread aljoscha
ored: Wed Jun 29 23:12:06 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Fri Jul 1 07:50:35 2016 +0200 -- .../main/java/org/apache/beam/examples/MinimalWordCount.java | 6 +++--- .../java/

[2/3] incubator-beam git commit: [BEAM-392] Update flink dependency to the most recent stable version

2016-06-30 Thread aljoscha
: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/2d3d0f4c Branch: refs/heads/master Commit: 2d3d0f4c2bbfddaf36e6b1068739c9ea48587d6d Parents: df1d5f6 Author: Ismaël Mejía <ieme...@gmail.com> Authored: Wed Jun 29 23:00:02 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@

[jira] [Resolved] (BEAM-321) Hash encoded keys in Flink batch mode

2016-06-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-321. --- Resolution: Fixed Fix Version/s: (was: 0.1.0-incubating) 0.2.0

[2/2] incubator-beam git commit: This closes #409

2016-06-19 Thread aljoscha
/diff/0e4d0a9a Branch: refs/heads/master Commit: 0e4d0a9ae0250863d7144ffdcc6c4e9cc099611f Parents: 69a4141 93ca508 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Sun Jun 19 11:35:19 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Sun Jun

[1/2] incubator-beam git commit: [BEAM-321] Fix Flink Comparators

2016-06-19 Thread aljoscha
ttp://git-wip-us.apache.org/repos/asf/incubator-beam/tree/93ca508b Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/93ca508b Branch: refs/heads/master Commit: 93ca508bbdf558772e909df099148a9d03a1e6d4 Parents: 69a4141 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored

[GitHub] incubator-beam pull request #483: Use native Flink rebalance for Reshuffle T...

2016-06-17 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/483 Use native Flink rebalance for Reshuffle Transform R: @mxm You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/incubator-beam

[jira] [Resolved] (BEAM-297) version typo at README.md of flink runner

2016-06-07 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-297. --- Resolution: Fixed Fix Version/s: (was: 0.1.0-incubating) 0.2.0

[2/2] incubator-beam git commit: This closes #370

2016-06-07 Thread aljoscha
/diff/5dc46357 Branch: refs/heads/master Commit: 5dc46357c44f4c296c4a00dea47c7ff0e00f9aaa Parents: 43c8f83 782c7b7 Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Tue Jun 7 10:33:02 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Tue Ju

[1/2] incubator-beam git commit: [BEAM-297] Update Flink README.md to 0.2.0-incubating-SNAPSHOT

2016-06-07 Thread aljoscha
ok.com> Authored: Sat May 21 18:32:29 2016 +0800 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Tue Jun 7 10:32:37 2016 +0200 -- runners/flink/README.md | 6 +++--- 1 file changed, 3 insertions(

[jira] [Commented] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-06-02 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312560#comment-15312560 ] Aljoscha Krettek commented on BEAM-315: --- Thanks for the updates! I'll keep investigating. > Fl

[GitHub] incubator-beam pull request #409: [BEAM-321] Fix Flink Comparators

2016-06-01 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/409 [BEAM-321] Fix Flink Comparators `KvCoderComparator` and `CoderComparator` were hashing the key directly while doing comparisons on the encoded form. This lead to inconsistencies

[jira] [Updated] (BEAM-322) Compare encoded keys in streaming mode

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-322: -- Description: Right now, hashing of keys happens on the value itself not on the encoded

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Description: Right now, hashing of keys happens on the value itself not on the encoded

[jira] [Updated] (BEAM-321) Hash encoded keys in Flink batch mode

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-321: -- Summary: Hash encoded keys in Flink batch mode (was: Compare encoded keys in batch mode) > H

[jira] [Commented] (BEAM-315) Flink Runner compares keys unencoded which may produce incorrect results

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310277#comment-15310277 ] Aljoscha Krettek commented on BEAM-315: --- I think we should make this issue into two issues. Leave

[jira] [Resolved] (BEAM-295) Flink Create Functions call Collector.close()

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-295. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Flink Create Functions c

[2/2] incubator-beam git commit: This closes #347

2016-06-01 Thread aljoscha
/diff/e9c0d8d0 Branch: refs/heads/master Commit: e9c0d8d056a7ecfba447ea9bfeda4366ff44dcff Parents: a829d9c 971ea4d Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Wed Jun 1 12:07:07 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Wed Ju

[GitHub] incubator-beam pull request: [BEAM-295] Remove erroneous close() calls in Fl...

2016-06-01 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/incubator-beam/pull/347 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[1/2] incubator-beam git commit: [BEAM-295] Remove erroneous close() calls in Flink Create Sources

2016-06-01 Thread aljoscha
mit: 971ea4de225f6efdd9ff862a6ff74ed05299f8a4 Parents: a829d9c Author: Aljoscha Krettek <aljoscha.kret...@gmail.com> Authored: Wed May 18 17:46:34 2016 +0200 Committer: Aljoscha Krettek <aljoscha.kret...@gmail.com> Committed: Wed Jun 1 12:0

[jira] [Commented] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly in batch mode of FlinkPipelineRunner

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309976#comment-15309976 ] Aljoscha Krettek commented on BEAM-315: --- I played around this morning and finally found the problem

[jira] [Assigned] (BEAM-315) GroupByKey/CoGroupByKey doesn't group correctly in batch mode of FlinkPipelineRunner

2016-06-01 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-315: - Assignee: Aljoscha Krettek > GroupByKey/CoGroupByKey doesn't group correctly in batch m

<    1   2   3   >