[2/2] beam git commit: This closes #3845

-runner Commit: 2cef54ea2562c679d68ff6faed5598fc74b9811a Parents: b6f22aa 71b5e7c Author: Pei He <p...@apache.org> Authored: Wed Nov 8 14:29:21 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Wed Nov 8 14:29:2

[1/2] beam git commit: mr-runner: use SerializablePipelineOptions to serde PipelineOptions

git-wip-us.apache.org/repos/asf/beam/tree/71b5e7c4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/71b5e7c4 Branch: refs/heads/mr-runner Commit: 71b5e7c45d1501030717cbfd608bfae36641de79 Parents: b6f22aa Author: huafengw <fvunic...@gmail.com> Authored: Wed Sep 13 10:24:24 2017 +0800 Commi

[2/2] beam git commit: This closes #3846

/jstorm-runner Commit: cd9c548b6e1ee57f3a202da64e5e55bc6704b67f Parents: ef70031 03cc311 Author: Pei He <p...@apache.org> Authored: Thu Sep 14 19:29:31 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Thu Sep 14 19:29:3

[1/2] beam git commit: JStorm-runner: Remove unnecessary WARN log, which might case confusion.

Repository: beam Updated Branches: refs/heads/jstorm-runner ef70031b7 -> cd9c548b6 JStorm-runner: Remove unnecessary WARN log, which might case confusion. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/03cc311c Tree:

[2/2] beam git commit: This closes #3841

/master Commit: fa4ecea26713244a83521ce1ca2864f4ad4409c8 Parents: 50532f0 31f51d2 Author: Pei He <p...@apache.org> Authored: Thu Sep 14 17:21:09 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Thu Sep 14 17:21:0

[1/2] beam git commit: flink-runner: constructs exception string only when neccessary, it reduces per-element expensive calls(String.format and getSimpleName) in FlinkAssignContext.

hor: Pei He <p...@apache.org> Authored: Tue Sep 12 17:26:28 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Thu Sep 14 17:20:54 2017 +0800 -- .../translation/functions/FlinkAssignContext.java | 17 --

[jira] [Created] (BEAM-2942) DOCUMENTATION in header becomes too long, and needs redesign

Pei He created BEAM-2942: Summary: DOCUMENTATION in header becomes too long, and needs redesign Key: BEAM-2942 URL: https://issues.apache.org/jira/browse/BEAM-2942 Project: Beam Issue Type: Bug

[2/4] beam git commit: jstorm-runner: support distribution metrics, this is required by nexmark.

-us.apache.org/repos/asf/beam/diff/0c388447 Branch: refs/heads/jstorm-runner Commit: 0c388447813a93ab9afc45af591417a82f8c4b1b Parents: 56ad7a8 Author: Pei He <p...@apache.org> Authored: Wed Sep 6 11:05:05 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Fri Sep 8 14:42:2

[1/4] beam git commit: jstorm-runner: saves MetricResults in local JStormRunnerResult after cancelling.

a85 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/56ad7a85 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/56ad7a85 Branch: refs/heads/jstorm-runner Commit: 56ad7a852acf66ebd1061e276317481629b270c4 Parents: d2b2851 Author: Pei He <p...@apache.org> Authored: Wed Sep 6 11:05:51 2

[3/4] beam git commit: jstorm-runner: support SourceMetrics.

Branch: refs/heads/jstorm-runner Commit: fec423e51148d26495fb8e6d17ac204b161f3069 Parents: 0c38844 Author: Pei He <p...@apache.org> Authored: Wed Sep 6 12:37:21 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Fri Sep 8 14:42:2

[4/4] beam git commit: This closes #3812

/jstorm-runner Commit: ef70031b7b0e48ae5750725f8ff6a9cd71f37431 Parents: d2b2851 fec423e Author: Pei He <p...@apache.org> Authored: Fri Sep 8 14:43:37 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Fri Sep 8 14:43:3

[2/2] beam git commit: This closes #3819

/jstorm-runner Commit: d2b2851227ae47f985f0c7d3ff6f198cf9f725b7 Parents: d24d283 4349200 Author: Pei He <p...@apache.org> Authored: Fri Sep 8 14:24:01 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Fri Sep 8 14:24:0

[1/2] beam git commit: JStorm-runner: Performance improvement 1. remove some logs on critical path 2. register "TimestampedValue" in Kryo to reduce the serialized size of event value

Repository: beam Updated Branches: refs/heads/jstorm-runner d24d2831d -> d2b285122 JStorm-runner: Performance improvement 1. remove some logs on critical path 2. register "TimestampedValue" in Kryo to reduce the serialized size of event value Project:

[2/2] beam git commit: This closes #3816

/jstorm-runner Commit: d24d2831d1529e4d81a024e2deb5dd31482a09c2 Parents: 80bd7f8 6a0d389 Author: Pei He <p...@apache.org> Authored: Thu Sep 7 19:09:58 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Thu Sep 7 19:09:5

[1/2] beam git commit: JStorm-runner: Implementation of processing timer

wip-us.apache.org/repos/asf/beam/tree/6a0d3896 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6a0d3896 Branch: refs/heads/jstorm-runner Commit: 6a0d389667369ec7d4f85469e6954d47097b7b68 Parents: 80bd7f8 Author: basti.lj <basti...@alibaba-inc.com> Authored: Thu Sep 7 18:42:10 2017 +0800 Committer:

[2/2] beam git commit: This closes #3806

/jstorm-runner Commit: 80bd7f8becf870a49cf930d6ffe5b64dec2104eb Parents: 7a28bf1 34bf5af Author: Pei He <p...@apache.org> Authored: Thu Sep 7 14:13:17 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Thu Sep 7 14:13:1

[1/2] beam git commit: jstorm-runner: handle UserCodeException in TestJStormRunner, and wraps in PipelineExecutionException if receives a checked Exception.

ttp://git-wip-us.apache.org/repos/asf/beam/commit/34bf5af9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/34bf5af9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/34bf5af9 Branch: refs/heads/jstorm-runner Commit: 34bf5af9b19c2fb90f2301823b698d06f21879a1 Parents: 7a28bf1 Author: Pei He

[jira] [Assigned] (BEAM-2846) Support SplittableParDo in MapReduce runner

[ https://issues.apache.org/jira/browse/BEAM-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2846: Assignee: (was: Pei He) > Support SplittableParDo in MapReduce run

[jira] [Created] (BEAM-2846) Support SplittableParDo in MapReduce runner

Pei He created BEAM-2846: Summary: Support SplittableParDo in MapReduce runner Key: BEAM-2846 URL: https://issues.apache.org/jira/browse/BEAM-2846 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-2845) Support TimersInParDo in MapReduce runner

Pei He created BEAM-2845: Summary: Support TimersInParDo in MapReduce runner Key: BEAM-2845 URL: https://issues.apache.org/jira/browse/BEAM-2845 Project: Beam Issue Type: New Feature

[4/4] beam git commit: This closes #3792

/jstorm-runner Commit: 7a28bf1af44bb498b5702031e64edd3d918245a6 Parents: 9148899 6f40506 Author: Pei He <p...@apache.org> Authored: Mon Sep 4 12:58:50 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Mon Sep 4 12:58:5

[3/4] beam git commit: [BEAM-2824] Uses PipelineResult in TestJStormRunner.

/diff/6f40506a Branch: refs/heads/jstorm-runner Commit: 6f40506a979bdcac3d1125bbe809b092d497a2f6 Parents: df75d80 Author: Pei He <p...@apache.org> Authored: Wed Aug 30 14:50:20 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Mon Sep 4 12:57:5

[2/4] beam git commit: [BEAM-2824] support PipelineResult.waitUntilFinish() in jstorm local mode.

-us.apache.org/repos/asf/beam/diff/df75d807 Branch: refs/heads/jstorm-runner Commit: df75d8074d7067bf6078289f1f2dfa36548fcd5e Parents: cda4e62 Author: Pei He <p...@apache.org> Authored: Tue Aug 29 20:10:06 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Mon Sep 4 12:57:5

[1/4] beam git commit: [BEAM-2824] support gauge and PipelineResults.metrics() in local mode.

ttp://git-wip-us.apache.org/repos/asf/beam/tree/cda4e629 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/cda4e629 Branch: refs/heads/jstorm-runner Commit: cda4e6293a13d387cee5c2920335b6bd053574d7 Parents: 9148899 Author: Pei He <p...@apache.org> Authored: Wed Aug 30 15:16:44 2017 +0800

[jira] [Created] (BEAM-2839) MR runner: add runner users guide under documentation/runners

Pei He created BEAM-2839: Summary: MR runner: add runner users guide under documentation/runners Key: BEAM-2839 URL: https://issues.apache.org/jira/browse/BEAM-2839 Project: Beam Issue Type: Task

[jira] [Created] (BEAM-2838) MR runner: update the capability matrix with the current status.

Pei He created BEAM-2838: Summary: MR runner: update the capability matrix with the current status. Key: BEAM-2838 URL: https://issues.apache.org/jira/browse/BEAM-2838 Project: Beam Issue Type

[jira] [Created] (BEAM-2835) Support executing MapReduce jobs in parallel.

Pei He created BEAM-2835: Summary: Support executing MapReduce jobs in parallel. Key: BEAM-2835 URL: https://issues.apache.org/jira/browse/BEAM-2835 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-2830) Main thread needs to re-throw worker exceptions for ValidatesRunner tests that expects exceptions.

Pei He created BEAM-2830: Summary: Main thread needs to re-throw worker exceptions for ValidatesRunner tests that expects exceptions. Key: BEAM-2830 URL: https://issues.apache.org/jira/browse/BEAM-2830

[jira] [Assigned] (BEAM-2783) Support Counters/Metrics and run ValidatesRunner tests

[ https://issues.apache.org/jira/browse/BEAM-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-2783: Assignee: Pei He > Support Counters/Metrics and run ValidatesRunner te

[3/3] beam git commit: This closes #3789

/jstorm-runner Commit: 9148899254ea873b4a2c5f3314fa30c3b633cea9 Parents: e00e0e8 c952686 Author: Pei He <p...@apache.org> Authored: Wed Aug 30 14:57:48 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Wed Aug 30 14:57:4

[2/3] beam git commit: jstorm-runner: Fix incorrect updating of counter metrics

/diff/c9526869 Branch: refs/heads/jstorm-runner Commit: c95268691f78a629866f722df1a3f7ef5e76a256 Parents: 557d703 Author: basti.lj <basti...@alibaba-inc.com> Authored: Wed Aug 30 10:45:45 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Wed Aug 30 14:55:1

[1/3] beam git commit: jstorm-runner: Fix the bug that max waiting time is missing on local mode

5:17 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Wed Aug 30 14:55:15 2017 +0800 -- .../java/org/apache/beam/runners/jstorm/JStormRunnerResult.java | 5 +++-- 1 file changed, 3 insertions(

[jira] [Created] (BEAM-2824) Support PipelineResult in JStormRunner

Pei He created BEAM-2824: Summary: Support PipelineResult in JStormRunner Key: BEAM-2824 URL: https://issues.apache.org/jira/browse/BEAM-2824 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146547#comment-16146547 ] Pei He commented on BEAM-1763: -- Do we require runners to quiesce when bounded data was processed? Otherwise

[jira] [Closed] (BEAM-2757) Link to Jenkins view is dead

[ https://issues.apache.org/jira/browse/BEAM-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-2757. Resolution: Fixed Assignee: Pei He (was: Jason Kuster) Fix Version/s: Not applicable I think

[jira] [Closed] (BEAM-2126) Add JStorm runner to "Conbribute > Technical References > Ongoing Projects"

[ https://issues.apache.org/jira/browse/BEAM-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-2126. Resolution: Fixed Fix Version/s: Not applicable > Add JStorm runner to "Conbribute > Technical

[jira] [Updated] (BEAM-2783) Support Counters/Metrics and run ValidatesRunner tests

[ https://issues.apache.org/jira/browse/BEAM-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2783: - Issue Type: New Feature (was: Bug) > Support Counters/Metrics and run ValidatesRunner te

[jira] [Created] (BEAM-2783) Support Counters/Metrics and run ValidatesRunner tests

Pei He created BEAM-2783: Summary: Support Counters/Metrics and run ValidatesRunner tests Key: BEAM-2783 URL: https://issues.apache.org/jira/browse/BEAM-2783 Project: Beam Issue Type: Bug

[18/53] [abbrv] beam git commit: jstorm-runner: remove top level classes RunnerUtils and SingletonKeyedWorkItem.

-us.apache.org/repos/asf/beam/diff/74ceac61 Branch: refs/heads/jstorm-runner Commit: 74ceac6173f78c76247b9ea4cb8179ca1ed9f62d Parents: 8265353 Author: Pei He <p...@apache.org> Authored: Fri Jul 14 15:40:23 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[33/53] [abbrv] beam git commit: jstorm-runner: Throw AssertionError instead of RuntimeException when pipeline encounter exception

: http://git-wip-us.apache.org/repos/asf/beam/diff/af5221c0 Branch: refs/heads/jstorm-runner Commit: af5221c001678e36de6492fa20b3fc4026f486e8 Parents: dc6f63c Author: basti.lj <basti...@alibaba-inc.com> Authored: Tue Jul 18 14:50:19 2017 +0800 Committer: Pei He <p...@apache.org> Committed

[27/53] [abbrv] beam git commit: jstorm-runner: move jstorm state implementations to JStormStateInternals inner classes.

-wip-us.apache.org/repos/asf/beam/diff/9abbbd06 Branch: refs/heads/jstorm-runner Commit: 9abbbd064e878a961ff3e8fc62d96ea650fd7570 Parents: 8cdd41b Author: Pei He <p...@apache.org> Authored: Fri Jul 14 16:10:29 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[22/53] [abbrv] beam git commit: jstorm-runner: move most classes to translation package and reduece their visibility to package private.

http://git-wip-us.apache.org/repos/asf/beam/blob/82653534/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/runtime/MultiOutputDoFnExecutor.java -- diff --git

[03/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/runtime/state/JStormMapState.java -- diff --git

[21/53] [abbrv] beam git commit: jstorm-runner: move most classes to translation package and reduece their visibility to package private.

http://git-wip-us.apache.org/repos/asf/beam/blob/82653534/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/translator/ParDoBoundMultiTranslator.java -- diff --git

[25/53] [abbrv] beam git commit: jstorm-runner: move most classes to translation package and reduece their visibility to package private.

Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/82653534 Branch: refs/heads/jstorm-runner Commit: 82653534b0b738ee84ed94a67f9344393778d033 Parents: 9309ac4 Author: Pei He <p...@apache.org> Authored: Fri Jul 14 15:28:53 2017 +0800 Committer: Pei He <p...@apache.org> Committed: S

[14/53] [abbrv] beam git commit: jstorm-runner: fix checkstyles.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa251a4a/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/StormPipelineTranslator.java -- diff --git

[11/53] [abbrv] beam git commit: jstorm-runner: fix checkstyles.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa251a4a/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/translator/ParDoBoundMultiTranslator.java -- diff --git

[29/53] [abbrv] beam git commit: jstorm-runner: update test runner of integration test in POM

/beam/diff/df154de2 Branch: refs/heads/jstorm-runner Commit: df154de20a216de4b997e0821dcf64cd553965ac Parents: 9abbbd0 Author: basti.lj <basti...@alibaba-inc.com> Authored: Fri Jul 14 16:53:08 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[53/53] [abbrv] beam git commit: This closes #3734

/jstorm-runner Commit: e00e0e841e19d427377bd576f26b7fbf62c3b9fb Parents: 0a05de3 26bcdf3 Author: Pei He <p...@apache.org> Authored: Sun Aug 20 22:59:43 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sun Aug 20 22:59:4

[40/53] [abbrv] beam git commit: jstorm-runner: VM crashs during ValidatesRunner tests disable reuse forked VM.

-us.apache.org/repos/asf/beam/diff/4d634ecf Branch: refs/heads/jstorm-runner Commit: 4d634ecf008e7fe6d1a99770da8bb66f7513b7e0 Parents: 588a698 Author: Pei He <p...@apache.org> Authored: Wed Jul 19 14:36:30 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[45/53] [abbrv] beam git commit: jstorm-runner: Fix duplicated update of metric counter

/diff/240f61bc Branch: refs/heads/jstorm-runner Commit: 240f61bc6baab9e698b2b6144688853a8371658f Parents: 61e9fa6 Author: basti.lj <basti...@alibaba-inc.com> Authored: Wed Aug 9 16:03:50 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[31/53] [abbrv] beam git commit: jstorm-runner: upgrade to Beam version 2.1.0-SNAPSHOT.

/diff/a5af6d2f Branch: refs/heads/jstorm-runner Commit: a5af6d2f420adebaf18f0a9e7367d392327b60e2 Parents: 30f3eda Author: Pei He <p...@apache.org> Authored: Tue Jul 18 14:29:19 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[30/53] [abbrv] beam git commit: jstorm-runner: support deleteTimer in JStormTimerInternals.

/beam/diff/18198330 Branch: refs/heads/jstorm-runner Commit: 18198330d42a13d3d8dd96cccdbd07ba077b9408 Parents: af5221c Author: Pei He <p...@apache.org> Authored: Tue Jul 18 20:07:19 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[01/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

Repository: beam Updated Branches: refs/heads/jstorm-runner 0a05de365 -> e00e0e841 http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/test/java/org/apache/beam/runners/jstorm/translation/translator/CoGroupByKeyTest.java

[06/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/main/java/com/alibaba/jstorm/beam/translation/translator/ParDoBoundMultiTranslator.java -- diff --git

[35/53] [abbrv] beam git commit: jstorm-runner: 1. Add kryo serializer for Collections.SingletonLists 2. Fix concurrent problem of elementIndex of JStormBagState

/asf/beam/tree/201ef722 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/201ef722 Branch: refs/heads/jstorm-runner Commit: 201ef722ec36b0ffa8197722fdf898fb9978803c Parents: 1bf3224 Author: basti.lj <basti...@alibaba-inc.com> Authored: Wed Jul 19 20:15:56 2017 +0800 Committer: Pei

[42/53] [abbrv] beam git commit: jstorm-runner: Support multiple copies of Flatten

/1178f9fb Branch: refs/heads/jstorm-runner Commit: 1178f9fb957c7e6cf1b277696ff63dc0e29a6d5e Parents: 52913b7 Author: basti.lj <basti...@alibaba-inc.com> Authored: Thu Jul 20 20:04:24 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[41/53] [abbrv] beam git commit: jstorm-runner: Fixup for review comments

Branch: refs/heads/jstorm-runner Commit: 90ed2ef344d19ca730429e9eb7c71779f995fc47 Parents: 6078cbc Author: basti.lj <basti...@alibaba-inc.com> Authored: Mon Aug 14 16:20:03 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[37/53] [abbrv] beam git commit: jstorm-runner: support Flatten with empty inputs.

/aca16cc9 Branch: refs/heads/jstorm-runner Commit: aca16cc9b2224b9bfce98719c6ef2abbad94f7df Parents: 4d634ec Author: Pei He <p...@apache.org> Authored: Wed Jul 19 15:34:56 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[49/53] [abbrv] beam git commit: jstorm-runner: move jstorm ahead to get build result earlier.

/beam/diff/26bcdf34 Branch: refs/heads/jstorm-runner Commit: 26bcdf3492feae15cae61aa5325b07c44ce2a310 Parents: 00b9c5c Author: Pei He <p...@apache.org> Authored: Fri Aug 18 17:26:53 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[36/53] [abbrv] beam git commit: jstorm-runner: Fix the failure of session window test cases in CombineTest

-us.apache.org/repos/asf/beam/diff/52913b7e Branch: refs/heads/jstorm-runner Commit: 52913b7e2b01b4e6c65d96a10d745dd3e6739c83 Parents: 201ef72 Author: basti.lj <basti...@alibaba-inc.com> Authored: Thu Jul 20 14:37:29 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[43/53] [abbrv] beam git commit: ReshuffleTest: replace Iterable equal tests with matchers.

/beam/diff/e182cf75 Branch: refs/heads/jstorm-runner Commit: e182cf75eb3d5a4701a98a2f5687cf0ea9d51774 Parents: 1178f9f Author: Pei He <p...@apache.org> Authored: Wed Jul 19 20:38:49 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[09/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

/repos/asf/beam/diff/aa654b3f Branch: refs/heads/jstorm-runner Commit: aa654b3f15a242221727d021cf4be676c49bd49b Parents: 6ff07fc Author: Pei He <p...@apache.org> Authored: Thu Jul 13 17:02:21 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 02:40:2

[08/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/main/java/com/alibaba/jstorm/beam/translation/TranslationContext.java -- diff --git

[46/53] [abbrv] beam git commit: jstorm-runner: 1. Generate execution DAG for runtime 2. Restructure Kryo serializers

http://git-wip-us.apache.org/repos/asf/beam/blob/6078cbc6/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/serialization/UnmodifiableCollectionsSerializer.java -- diff --git

[17/53] [abbrv] beam git commit: jstorm-runner: remove ValidatesRunner tests and dead code from jstorm module.

-us.apache.org/repos/asf/beam/diff/4ff42cbc Branch: refs/heads/jstorm-runner Commit: 4ff42cbc65452ae6259d90f07f2f80423eeb69df Parents: aa251a4 Author: Pei He <p...@apache.org> Authored: Thu Jul 13 18:38:49 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[32/53] [abbrv] beam git commit: jstorm-runner: disable validates runner tests with TestStream and Metrics.

-us.apache.org/repos/asf/beam/diff/dc6f63ca Branch: refs/heads/jstorm-runner Commit: dc6f63cafa9c91535f48aa483d316bb9a0d12a41 Parents: a5af6d2 Author: Pei He <p...@apache.org> Authored: Tue Jul 18 14:48:25 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[28/53] [abbrv] beam git commit: jstorm-runner: 1. Use the TupleTag of "PCollection expand" when getting input tags and output tags 2. Check the exception record when asserting of unit test

55:01 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:58 2017 +0800 -- .../beam/runners/jstorm/TestJStormRunner.java | 9 + .../runners/jstorm/translation/DoFnExecutor.java|

[12/53] [abbrv] beam git commit: jstorm-runner: fix checkstyles.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa251a4a/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/runtime/UnboundedSourceSpout.java -- diff --git

[13/53] [abbrv] beam git commit: jstorm-runner: fix checkstyles.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa251a4a/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/runtime/ExecutorsBolt.java -- diff --git

[07/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/main/java/com/alibaba/jstorm/beam/translation/runtime/StatefulDoFnExecutor.java -- diff --git

[23/53] [abbrv] beam git commit: jstorm-runner: move most classes to translation package and reduece their visibility to package private.

http://git-wip-us.apache.org/repos/asf/beam/blob/82653534/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/UnboundedSourceSpout.java -- diff --git

[34/53] [abbrv] beam git commit: jstorm-runner: update jstorm runner pacakge name in logback config.

/repos/asf/beam/diff/1bf32247 Branch: refs/heads/jstorm-runner Commit: 1bf3224708b6b2a9c195eddf65a7bfb279d6806d Parents: aca16cc Author: Pei He <p...@apache.org> Authored: Wed Jul 19 16:14:14 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[19/53] [abbrv] beam git commit: jstorm-runner: remove AdaptorBasicBolt and AdaptorBasicSpout.

/beam/diff/9309ac49 Branch: refs/heads/jstorm-runner Commit: 9309ac49d81e1d6dfd694ec885cdb12a3db53483 Parents: 5a15d54 Author: Pei He <p...@apache.org> Authored: Fri Jul 14 14:50:47 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[50/53] [abbrv] beam git commit: jstorm-runner: Add Kryo serializer for UnmodifiableIterable

/beam/diff/9e808730 Branch: refs/heads/jstorm-runner Commit: 9e8087306b5562fdecf678979b9f2d49dfaf368f Parents: 90ed2ef Author: basti.lj <basti...@alibaba-inc.com> Authored: Wed Aug 16 19:01:48 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[48/53] [abbrv] beam git commit: jstorm-runner: Add maven repository for JStorm dependency

/beam/diff/00b9c5c8 Branch: refs/heads/jstorm-runner Commit: 00b9c5c867a57c291c43caa2b554dda9bb3228ba Parents: 87aaa6e Author: basti.lj <basti...@alibaba-inc.com> Authored: Thu Aug 17 19:13:50 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[51/53] [abbrv] beam git commit: jstorm-runner: Add job file to run ValidatesRunner tests of JStorm runner

-us.apache.org/repos/asf/beam/diff/cb1c3f46 Branch: refs/heads/jstorm-runner Commit: cb1c3f4694a777b2f5a19959561e388bda36a972 Parents: 9e80873 Author: basti.lj <basti...@alibaba-inc.com> Authored: Wed Aug 16 19:03:38 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:0

[04/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/runtime/ExecutorContext.java -- diff --git

[10/53] [abbrv] beam git commit: jstorm-runner: fix checkstyles.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa251a4a/runners/jstorm/src/test/java/org/apache/beam/runners/jstorm/translation/runtime/state/JStormStateInternalsTest.java -- diff --git

[44/53] [abbrv] beam git commit: jstorm-runner: add missing "apache license" header for some files.

apache.org/repos/asf/beam/diff/61e9fa65 Branch: refs/heads/jstorm-runner Commit: 61e9fa6581377dcb50edb4e4b48bac353cb3ba0d Parents: e182cf7 Author: basti.lj <basti...@alibaba-inc.com> Authored: Mon Jul 24 13:00:37 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug

[38/53] [abbrv] beam git commit: jstorm-runner: minor update for exception handling of TestJStormRunner

/repos/asf/beam/diff/ad046483 Branch: refs/heads/jstorm-runner Commit: ad046483e6d2341a4a2156e0db15f213c7f7feea Parents: 1819833 Author: basti.lj <basti...@alibaba-inc.com> Authored: Wed Jul 19 10:57:40 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[52/53] [abbrv] beam git commit: jstorm-runner: The failure of testing "SDK Python" blocked the validation of JStorm runner, so comment out "SDK Python" module temporarily. After the validation of JSt

hor: basti.lj <basti...@alibaba-inc.com> Authored: Thu Aug 17 17:12:28 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:03:01 2017 +0800 -- sdks/pom.xml | 2 +- 1 file cha

[47/53] [abbrv] beam git commit: jstorm-runner: 1. Generate execution DAG for runtime 2. Restructure Kryo serializers

-us.apache.org/repos/asf/beam/diff/6078cbc6 Branch: refs/heads/jstorm-runner Commit: 6078cbc6bd5ca6e48e237c652c532b189acef2b7 Parents: 240f61b Author: basti.lj <basti...@alibaba-inc.com> Authored: Wed Aug 9 16:48:42 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 1

[39/53] [abbrv] beam git commit: jstorm-runner: add SdkRepackImmutableMapSerializer.

/588a6981 Branch: refs/heads/jstorm-runner Commit: 588a6981855b68b9733a1b0f368dce0ad5cfe837 Parents: ad04648 Author: Pei He <p...@apache.org> Authored: Wed Jul 19 11:13:04 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[02/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/util/DefaultStepContext.java -- diff --git

[20/53] [abbrv] beam git commit: jstorm-runner: Fix checkstyle error

Branch: refs/heads/jstorm-runner Commit: 5a15d5488f9438695948e72af08ada4c263471d7 Parents: 78a5076 Author: basti.lj <basti...@alibaba-inc.com> Authored: Fri Jul 14 14:14:49 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[05/53] [abbrv] beam git commit: jstorm-runner: rename the package to org.apache.beam.runners.jstorm.

http://git-wip-us.apache.org/repos/asf/beam/blob/aa654b3f/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/serialization/ImmutableListSerializer.java -- diff --git

[15/53] [abbrv] beam git commit: jstorm-runner: fix checkstyles.

: refs/heads/jstorm-runner Commit: aa251a4a4d2850310f5dfd9db4d605cce41bba13 Parents: f3df3a2 Author: Pei He <p...@apache.org> Authored: Thu Jul 13 17:37:51 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:4

[16/53] [abbrv] beam git commit: jstorm-runner: fix compilation error and remove obsolete method.

/asf/beam/diff/78a5076a Branch: refs/heads/jstorm-runner Commit: 78a5076a6951a697922aceaabc1e32dd20c8de36 Parents: 4ff42cb Author: basti.lj <basti...@alibaba-inc.com> Authored: Fri Jul 14 10:29:00 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[26/53] [abbrv] beam git commit: jstorm-runner: remove code that was commented out.

/8cdd41b1 Branch: refs/heads/jstorm-runner Commit: 8cdd41b1d4c7cd5aaf96f3f9c6c2fd203c047e02 Parents: 74ceac6 Author: Pei He <p...@apache.org> Authored: Fri Jul 14 15:51:22 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Sat Aug 19 12:02:5

[24/53] [abbrv] beam git commit: jstorm-runner: move most classes to translation package and reduece their visibility to package private.

http://git-wip-us.apache.org/repos/asf/beam/blob/82653534/runners/jstorm/src/main/java/org/apache/beam/runners/jstorm/translation/JStormStateInternals.java -- diff --git

[jira] [Closed] (BEAM-1612) Support real Bundle in Flink runner

[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-1612. Resolution: Fixed > Support real Bundle in Flink run

[2/2] beam git commit: This closes #3368

/master Commit: 724eda37ea1e54aac089d89c711ca3cee14a4603 Parents: 3a8b0b6 ceec7ce Author: Pei He <p...@apache.org> Authored: Wed Aug 16 11:46:49 2017 +0800 Committer: Pei He <p...@apache.org> Committed: Wed Aug 16 11:46:4

[1/2] beam git commit: [BEAM-1612] Support real Bundle in Flink runner

pos/asf/beam/tree/ceec7ce5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ceec7ce5 Branch: refs/heads/master Commit: ceec7ce5ba287ab40ee1f7c87129b72d4db1c1c7 Parents: 3a8b0b6 Author: JingsongLi <lzljs3620...@aliyun.com> Authored: Thu Jun 15 17:48:59 2017 +0800 Committer: Pei He <p..

[jira] [Updated] (BEAM-2709) Add TezRunner

[ https://issues.apache.org/jira/browse/BEAM-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2709: - Component/s: runner-tez > Add TezRunner > - > > Key: BEAM-2709 >

[jira] [Assigned] (BEAM-165) Add Hadoop MapReduce runner

[ https://issues.apache.org/jira/browse/BEAM-165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-165: --- Assignee: Pei He (was: Jean-Baptiste Onofré) Component/s: runner-mapreduce Issue Type: New Feature

[jira] [Commented] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112072#comment-16112072 ] Pei He commented on BEAM-2714: -- Just to clarify: with runner API, there will be no view transform (neither

[jira] [Comment Edited] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111016#comment-16111016 ] Pei He edited comment on BEAM-2714 at 8/2/17 2:38 PM: -- I use TransformHierarchy.Node

[jira] [Comment Edited] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111016#comment-16111016 ] Pei He edited comment on BEAM-2714 at 8/2/17 2:37 PM: -- I use TransformHierarchy.Node

[jira] [Updated] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2714: - Attachment: view-tag.png I use TransformHierarchy.Node getInputs() and getOutputs() to setup this diagram

  1   2   >