[
https://issues.apache.org/jira/browse/EAGLE-794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15700672#comment-15700672
]
ASF GitHub Bot commented on EAGLE-794:
--------------------------------------
GitHub user garrettlish opened a pull request:
https://github.com/apache/incubator-eagle/pull/687
EAGLE-794: enable publish bolt parallelism
Currently the publish is using shuffle grouping, we cannot enable
parallelism for publish since we may have local cache which is unavailable
across the storm cluster. We are going to use field group function to partition
streams for publish bolt parallelism.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/garrettlish/incubator-eagle eagle794
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-eagle/pull/687.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #687
----
commit 505a32ae576689e9012a80346c6f005c3082de42
Author: Xiancheng Li <[email protected]>
Date: 2016-11-25T01:47:41Z
EAGLE-794: enable publish bolt parallelism
----
> Enable publish bolt parallelism
> -------------------------------
>
> Key: EAGLE-794
> URL: https://issues.apache.org/jira/browse/EAGLE-794
> Project: Eagle
> Issue Type: Improvement
> Affects Versions: v0.5.0
> Reporter: Garrett Li
> Assignee: Garrett Li
> Fix For: v0.5.0
>
>
> Currently the publish is using shuffle grouping, we cannot enable parallelism
> for publish since we may have local cache which is unavailable across the
> storm cluster.
> We are going to use the same strategy as router bolts to alert bolts, which
> is using field grouping (define empty list of field) and dispatch tuple
> according to group by fields hashing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
