GitHub user manuzhang reopened a pull request: https://github.com/apache/incubator-gearpump/pull/136
merge master into akka-streams branch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. You can merge this pull request into a Git repository by running: $ git pull https://github.com/manuzhang/incubator-gearpump akka-streams Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-gearpump/pull/136.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #136 ---- commit 66017ab7bf5166ec312684f0e3e49e7219b4c24d Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-10-09T00:52:00Z [GEARPUMP-23] add window dsl The PR is opened for early review and the work is in progress with following todos. - [x] basic window dsl support with `WindowedWordCount` example - [x] improve `ReduceFunction` to not emit intermediate results - [x] add unit tests - [ ] add comments and update documentation - [ ] support different types of computation (e.g. monoid which doesn't require input elements to be held in the window) Author: manuzhang <owenzhang1...@gmail.com> Closes #85 from manuzhang/window_dsl. commit 9b879456d6ff03e961aca97857903082be189084 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-10-10T04:42:16Z [GEARPUMP-218] add shaded library as transitive dependencies Author: manuzhang <owenzhang1...@gmail.com> Closes #92 from manuzhang/add_shaded_pom. commit 1b9889121c0d776c9423544b76e27292838d1300 Author: darionyaphet <darion.yap...@gmail.com> Date: 2016-10-10T22:10:33Z GEARPUMP-215 Gearpump Redis Integration - RedisSink [Gearpump Redis Integration - RedisStorage](https://issues.apache.org/jira/browse/GEARPUMP-215) Author: darionyaphet <darion.yap...@gmail.com> Closes #93 from darionyaphet/GEARPUMP-215. commit a01809b2588a5dd1038b7afa8dca5148729e634c Author: huafengw <fvunic...@gmail.com> Date: 2016-10-12T08:06:15Z [GEARPUMP-222] remove DFSJarStore from gearpump-daemon Author: huafengw <fvunic...@gmail.com> Closes #96 from huafengw/jarclass. commit c3d5eb63f1d0c6c542268e21fe8356e042dfa232 Author: huafengw <fvunic...@gmail.com> Date: 2016-10-14T11:55:05Z [GEARPUMP-224] merge gearpump-daemon to gearpump-core Author: huafengw <fvunic...@gmail.com> Closes #98 from huafengw/merge. commit fb37ce809b2917a12cc64d4337418cbb72265fda Author: huafengw <fvunic...@gmail.com> Date: 2016-10-24T03:31:41Z [GEARPUMP-225] move partitioner to module gearpump-streaming Author: huafengw <fvunic...@gmail.com> Closes #99 from huafengw/partitioner. commit 7bc5fba5b5c5166992e04218071a3da4931e47a9 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-10-29T23:12:34Z [GEARPUMP-227] remove unneeded licenses After replacing Jekyll with Mkdocs in https://github.com/apache/incubator-gearpump/pull/88, some licenses are no longer needed Author: manuzhang <owenzhang1...@gmail.com> Closes #101 from manuzhang/rm_licenses. commit cbf59fb77834914116657a135b30899b91a7408d Author: Christoph Seifert <christoph.seifer...@googlemail.com> Date: 2016-11-02T12:01:07Z [GEARPUMP-230] Removed unused code from AppMasterService Hello, Seems there is some unused code in AppMasterService. This pull request removes it. Regards Christoph Author: Christoph Seifert <christoph.seifer...@googlemail.com> Closes #103 from christophse/fix. commit 0b56de39919452787b2533ac3d10ac1dd46b2f9d Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-11-11T05:10:51Z [GEARPUMP-226] refactor build files Refactored build files as follows 1. break `Build.scala` into parts for different module categories, e.g. `BuildExternals`, `BuildDashboard`. 2. libraries to shade are now added as managed dependencies, shaded with their depending projects and finally assembled to a uber jar. For example, `gearpump-core-$version.jar` will now contain both the gearpump sources and shaded libraries, whose package names are both `org.apache.gearpump`. The original dependencies are excluded from `pack`. 3. package names in the codebase are changed as needed by 2 4. `gearpump-core` is now `provided` for `gearpump-streaming` and won't be transitive dependencies for projects depending on`gearpump-streaming`. `gearpump-core` needs to be explicitly included as `provided` dependency so I add it to the published pom files for users. Author: manuzhang <owenzhang1...@gmail.com> Closes #108 from manuzhang/fix_build. commit e281c4a35f6ec1a1d27655b0636bf8a9bbf4bb83 Author: Kam Kasravi <kamkasr...@yahoo.com> Date: 2016-11-12T03:54:46Z Fixes GEARPUMP-234 Update LICENSE and related files for 0.8.2-incubat⦠â¦ing binary release Author: Kam Kasravi <kamkasr...@yahoo.com> Closes #109 from kkasravi/GEARPUMP-234. commit aec49f5b6bbd7b3501f6f6e15aacbc9fb2286f41 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-11-15T20:28:32Z [GEARPUMP-237] remove manually downloading sbt launcher jar on travis Author: manuzhang <owenzhang1...@gmail.com> Closes #110 from manuzhang/fix_resolver. commit cf3e2e0a04b1751940a904b0410efd5757d70232 Author: Kam Kasravi <kamkasr...@yahoo.com> Date: 2016-11-15T22:14:00Z [GEARPUMP-238] Correct release naming and packaging Author: Kam Kasravi <kamkasr...@yahoo.com> Closes #111 from kkasravi/GEARPUMP-238. commit e852b6fb85b1687d5e78dc1252883d9a5f6de602 Author: Kam Kasravi <kamkasr...@yahoo.com> Date: 2016-11-16T08:22:08Z [GEARPUMP-239] Correct binary and source licenses subdirectory Author: Kam Kasravi <kamkasr...@yahoo.com> Closes #112 from kkasravi/GEARPUMP-239. commit f0a02aece5fdff46f929f2f721d8c6fe0d2bbecf Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-11-16T15:32:35Z [GEARPUMP-240] Correct licenses Author: manuzhang <owenzhang1...@gmail.com> Closes #113 from manuzhang/fix_license. commit 0cfd3233019c25552c5528c80830a0d3f1c4fc6e Author: Kam Kasravi <kamkasr...@yahoo.com> Date: 2016-11-16T21:33:38Z [GEARPUMP-241] Update CHANGELOG.md to reflect all JIRA's Author: Kam Kasravi <kamkasr...@yahoo.com> Closes #114 from kkasravi/GEARPUMP-241. commit e87abbf24697bf783ad9823c46aba07128482db1 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-01T00:37:05Z Add 0.8.2 release notes and bump up version Author: manuzhang <owenzhang1...@gmail.com> Closes #115 from manuzhang/0.8.2-release. commit 9834490cecad3255e0b5fabe3ebd005d4ed2bc98 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-03T13:20:23Z [GEARPUMP-243] Add missing license headers and DISCLAIMER As pointed out in the voting [comments](http://apache-incubator-general.996316.n3.nabble.com/VOTE-Apache-Gearpump-incubating-0-8-2-RC2-tp52569p52638.html) Author: manuzhang <owenzhang1...@gmail.com> Closes #116 from manuzhang/GEARPUMP-243. commit f70359dc23276fbd570bb237b287934e56e813e0 Author: Willem Jiang <willem.ji...@gmail.com> Date: 2016-12-05T08:09:07Z GEARPUMP-244 Fixed the broken link of IDE setup guide Author: Willem Jiang <willem.ji...@gmail.com> Closes #117 from WillemJiang/branch_GEARPUMP-244. commit 5cf79bfd37577029f41a745346787c964e59931e Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-06T08:03:31Z [GEARPUMP-229] Add GitHub pull request template Author: manuzhang <owenzhang1...@gmail.com> Closes #118 from manuzhang/add_gh_template. commit 791f45a0cd789bf2b2190167f701800fc4315be0 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-08T03:45:06Z [GEARPUMP-245] Invoke GroupByFunction.apply in JavaStream DSL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. Author: manuzhang <owenzhang1...@gmail.com> Closes #119 from manuzhang/GEARPUMP-246. commit 794e3dd7b054c0010b88cd05279a9ab3c5b4d514 Author: huafengw <fvunic...@gmail.com> Date: 2016-12-08T03:50:06Z [GEARPUMP-246] clean up 'examples/target' when invoking 'sbt clean' Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. Author: huafengw <fvunic...@gmail.com> Closes #120 from huafengw/fixClean. commit d0997e19e3f57dd03a47f4b4a10aed6847719984 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-09T02:37:08Z [GEARPUMP-248] Change release badge to maven central Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. Author: manuzhang <owenzhang1...@gmail.com> Closes #121 from manuzhang/badge. commit 914eb9008882835fbafd126085f3ebe73bd87c9f Author: Roshanson <736781...@qq.com> Date: 2016-12-09T08:37:03Z [GEARPUMP-233]Add hbase-example Author: Roshanson <736781...@qq.com> Closes #107 from Roshanson/HBase. commit 6677b6a118b03b8b79fc342768d7cd79fbcc178d Author: huafengw <fvunic...@gmail.com> Date: 2016-12-14T04:44:39Z fix GEARPUMP-144 make the user for HDFS and Yarn configurable in yarn⦠â¦client Author: huafengw <fvunic...@gmail.com> Closes #90 from huafengw/fix_144. commit 215531cd822f5a07dd6925220f962a3b64d4aebd Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-14T04:45:48Z [GEARPUMP-245] Apply groupBy and fix group implementations Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. Author: manuzhang <owenzhang1...@gmail.com> Closes #122 from manuzhang/GEARPUMP-245. commit 1bf6a9ba8fa774b985fcd90a5d6bef129a4fb9a5 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-14T11:12:52Z [GEARPUMP-249] Fix function chains to enforce execution Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. Author: manuzhang <owenzhang1...@gmail.com> Closes #123 from manuzhang/GEARPUMP-249. commit 177a1d4436dc88ade5283efcd483e5fdd6128f00 Author: manuzhang <owenzhang1...@gmail.com> Date: 2016-12-19T13:59:51Z [GEARPUMP-255] Return application id when submitting application in J⦠â¦ava DSL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. Author: manuzhang <owenzhang1...@gmail.com> Closes #124 from manuzhang/GEARPUMP-255. commit eaf5b6cb27d4f3c0961dd9336671c10ef3e86174 Author: darionyaphet <darion.yap...@gmail.com> Date: 2016-12-26T12:33:17Z [GEARPUMP-256] Camel-Case as variable name [Camel-Case as variable name](https://issues.apache.org/jira/browse/GEARPUMP-256) HBaseSink's naming and using Camel-Case as the variable name. Author: darionyaphet <darion.yap...@gmail.com> Closes #125 from darionyaphet/GEARPUMP-256. commit 2783559dbf1fe0dd5f090cece152bef65251d5b8 Author: gan...@thedatateam.in <gan...@thedatateam.in> Date: 2016-12-28T22:26:29Z Gearpump 257 remote application submit https://issues.apache.org/jira/browse/GEARPUMP-257 `[GEARPUMP-Gearpump 257] Client context should throw an exception when client tries to submit an application with jar file that does not exist. Previously it used to upload an empty stream and master used to fail with file not found exception. Author: gan...@thedatateam.in <gan...@thedatateam.in> Closes #126 from th3iedkid/GEARPUMP-257_Remote_application_submit_. commit 956d52a35193fe1da116f65264db0cf138b39665 Author: manuzhang <owenzhang1...@gmail.com> Date: 2017-01-04T04:53:33Z [GEARPUMP-249] Force eager evaluation on chained operations Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the commit message is formatted like: `[GEARPUMP-<Jira issue #>] Meaningful description of pull request` - [x] Make sure tests pass via `sbt clean test`. - [x] Make sure old documentation affected by the pull request has been updated and new documentation added for new functionality. Author: manuzhang <owenzhang1...@gmail.com> Closes #127 from manuzhang/eager-eval. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---