[
https://issues.apache.org/jira/browse/STORM-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated STORM-2423:
--------------------------------
Fix Version/s: (was: 1.x)
1.1.0
> Join Bolt : Use explicit instead of default window anchoring of emitted tuples
> ------------------------------------------------------------------------------
>
> Key: STORM-2423
> URL: https://issues.apache.org/jira/browse/STORM-2423
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-core
> Affects Versions: 2.0.0, 1.x
> Reporter: Roshan Naik
> Assignee: Roshan Naik
> Priority: Critical
> Fix For: 2.0.0, 1.1.0
>
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> Default anchoring will anchor each emitted tuple to every tuple in current
> window. This requires a very large numbers of ACKs from any downstream bolt.
> If topology.debug is enabled, it also worsens the load on the system
> significantly.
> Letting the topo run in this mode (in particular with max.spout.pending
> disabled), could lead to the worker running out of memory and crashing.
> Fix: Join Bolt should avoid using default window anchoring, and explicitly
> anchor each emitted tuple with the exact matching tuples form each inputs
> streams. This reduces the complexity of the tuple trees and consequently the
> reduces burden on the ACKing & messaging subsystems.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
