[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077824#comment-16077824 ]
ASF GitHub Bot commented on BEAM-79: ------------------------------------ GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/3515 [BEAM-79] Sync gearpump-runner with master and upgrade to gearpump 0.8.4 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-<Jira issue #>] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/manuzhang/beam sync-master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3515.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3515 ---- commit 7b8cd6401cb5ed6e184ed36571a89d3ae324dd5f Author: Jeremie Lenfant-Engelmann <jeremi...@google.com> Date: 2017-06-29T01:32:56Z Properly convert milliseconds whether there's less than 3/more than 9 digits. TimeUtil did not properly convert (and returned null) when the number of digits for fractions of seconds was less than 3 digits or more than 9 digits. The solution is to pad with zeros when there is less than 3 digits and to truncate when there is more than 3. commit f75dfe711b357800762a93dc5059d9a19da9ee61 Author: Luke Cwik <lc...@google.com> Date: 2017-06-30T16:00:13Z Properly convert milliseconds whether there's less than 3/more than 9 digits. This closes #3469 commit 56cb6c51748fde6ad56522733ab10edca062e802 Author: Kenneth Knowles <k...@google.com> Date: 2017-06-13T17:29:50Z Add support for PipelineOptions parameters This is a step towards eliminating catch-all context parameters and making DoFns express their fine-grained data needs. commit 0e429b33ff85eba08da5018c9febd0b99b44f720 Author: Kenneth Knowles <k...@google.com> Date: 2017-06-30T22:39:20Z This closes #3355: Add support for PipelineOptions parameters commit f99ab1a472868e4ce175a86e5d76823b1c09c10b Author: Kenneth Knowles <k...@google.com> Date: 2017-07-01T04:42:17Z Fix DoFn javadoc: StateSpec does not require a key commit ce4e51747501111ae2c4b1691c6994bd0f92e161 Author: Ismaël Mejía <ieme...@apache.org> Date: 2017-06-04T20:55:05Z Make modules that depend on Hadoop and Spark use the same version property commit 11010cf08ec9ca90a843cc15ea8f0fd4910f7fab Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2017-07-03T07:26:40Z This closes #3291 commit 75475ef3dc23a09fa9bbba478d6fdbc468f7dd2e Author: Ismaël Mejía <ieme...@gmail.com> Date: 2017-06-28T14:58:55Z [BEAM-2530] Fix compilation of modules with Java 9 that depend on jdk.tools commit 0bd47c07659909c6b3c2d04fbdb96cc30a6e0243 Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2017-07-03T12:23:18Z [BEAM-2530] This closes #3460 commit 68f1fb64fd2565e287e322d715ca778d01e7137b Author: Ahmet Altay <al...@google.com> Date: 2017-07-01T00:37:33Z For GCS operations use an http client with a default timeout value. commit b8ac32641183b06a87517a169c8ecc5371996aed Author: Ahmet Altay <al...@google.com> Date: 2017-07-04T18:07:31Z This closes #3486 commit 51877a3405dbf778c3bb88f19bb194e54c3b3def Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2017-07-05T14:47:29Z [maven-release-plugin] prepare branch release-2.1.0 commit 7f0723cf7fd587c4f8dbe8a8b1c9d298a7b1e5e3 Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2017-07-05T14:47:38Z [maven-release-plugin] prepare for next development iteration commit 14fa7f79f0830739122b7573e032ad0aea172a98 Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2017-07-05T14:52:48Z Update Python SDK version commit 06897b1cc142f658437ac7779c849e5182e331f1 Author: Jason Kuster <jasonkus...@google.com> Date: 2017-06-09T08:39:15Z Website Mergebot Job Signed-off-by: Jason Kuster <jasonkus...@google.com> commit f0549b464737d0d11ae1da8e0534622b10247208 Author: Thomas Groh <tg...@google.com> Date: 2017-07-05T16:22:20Z This closes #3485 commit 6ca410a908f1f4e7ac1e141ee1335f7a537bb150 Author: Luke Cwik <lc...@google.com> Date: 2017-07-05T17:38:44Z [BEAM-2553] Update Maven exec plugin to 1.6.0 to incorporate messaging improvements commit 39c80f640749fed5f55a0c8f25c849e5f7c3d179 Author: Luke Cwik <lc...@google.com> Date: 2017-07-05T19:26:28Z [BEAM-2553] Update Maven exec plugin to 1.6.0 to incorporate messaging improvements This closes #3494 commit 29c2bca4649317f2ebb1c89f92bf97fbb27602ca Author: Thomas Groh <tg...@google.com> Date: 2017-07-05T21:16:50Z Disallow Combiner Lifting for multi-window WindowFns commit 63f66d6d81652dba5a7804648cde0e7debffd0f6 Author: Kenneth Knowles <k...@google.com> Date: 2017-07-05T22:00:09Z This closes #3489: Fix DoFn javadoc: StateSpec does not require a key commit 23e385faa193a00f9b10e3f8f0afe832087bff06 Author: Ahmet Altay <al...@google.com> Date: 2017-07-05T21:34:07Z Update SDK dependencies commit ea9f7fbdde5ede5e5f5060da5dfe2749992a2fa7 Author: Ahmet Altay <al...@google.com> Date: 2017-07-05T23:11:46Z This closes #3497 commit e8fdd373c7b86652fda94ff76ef7246357e6288c Author: Kenneth Knowles <k...@google.com> Date: 2017-07-05T23:41:16Z This closes #3496: Disallow Combiner Lifting for multi-window WindowFns commit a75202f344f22be5c5fdf62b3eb54a151ad29af6 Author: Charles Chen <c...@google.com> Date: 2017-07-05T23:18:51Z Fix PValue input in _PubSubReadEvaluator commit bf6dda32047e0bfba18de5aa27b1b6a593f86fc9 Author: Ahmet Altay <al...@google.com> Date: 2017-07-06T01:09:05Z This closes #3499 commit 2259c309c5b81a5d1e32732dd35e1102766401fa Author: Raghu Angadi <rang...@google.com> Date: 2017-06-28T19:07:06Z [BEAM-2534] Handle offset gaps in Kafka messages. KafkaIO logged a warning when there is a gap in offstes for messages. Kafka also support 'KV' store style topics where some of the messages are deleted leading gaps in offsets. This PR removes the log and accounts for offset gaps in backlog estimate. commit 85a99e29448670ae6728a8ee2e4cd3ef95877c3e Author: JingsongLi <lzljs3620...@aliyun.com> Date: 2017-07-06T16:48:36Z This closes #3461 commit 526037b6786315b9f9fdca6edb636baeb6f83e3f Author: Raghu Angadi <rang...@google.com> Date: 2017-07-04T06:54:10Z Add timeout to initialization of partition in KafkaIO commit b8f8d18ae2cdbb4874d9a0f45038037ecc2381d1 Author: Kenneth Knowles <k...@google.com> Date: 2017-07-06T18:59:18Z This closes #3492: [BEAM-2551] KafkaIO reader blocks indefinitely in case of network issues Add timeout to initialization of partition in KafkaIO commit bd631b89a8434f0756e1596875e89013fb623ab5 Author: Kenneth Knowles <k...@google.com> Date: 2017-06-23T01:09:11Z Ignore processing time timers in expired windows ---- > Gearpump runner > --------------- > > Key: BEAM-79 > URL: https://issues.apache.org/jira/browse/BEAM-79 > Project: Beam > Issue Type: New Feature > Components: runner-gearpump > Reporter: Tyler Akidau > Assignee: Manu Zhang > > Intel is submitting Gearpump (http://www.gearpump.io) to ASF > (https://wiki.apache.org/incubator/GearpumpProposal). Appears to be a mix of > low-level primitives a la MillWheel, with some higher level primitives like > non-merging windowing mixed in. Seems like it would make a nice Beam runner. -- This message was sent by Atlassian JIRA (v6.4.14#64029)