[
https://issues.apache.org/jira/browse/STORM-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984368#comment-15984368
]
wangkui commented on STORM-2489:
--------------------------------
[~arunmahadevan] Eh, it still lose data, following is one test result, and you
can see that the 15073 is lost:
Timestamp_start-end=1493195565070-1493195570070
expired=
get=1...3757
new=1...3757
Recived=3757,RecivedTotal=3757
Timestamp_start-end=1493195570070-1493195575070
expired=1...3757
get=3758...7579
new=3758...7579
Recived=3822,RecivedTotal=7579
Timestamp_start-end=1493195575070-1493195580070
expired=3758...7579
get=7580...11276
new=7580...11276
Recived=3697,RecivedTotal=11276
Timestamp_start-end=1493195580070-1493195585070
expired=7580...11276
get=11277...15072
new=11277...15072
Recived=3796,RecivedTotal=15072
SendTotal=15162
Timestamp_start-end=1493195585070-1493195590070
expired=11277...15073
get=15074...15162
new=15074...15162
Recived=89,RecivedTotal=15161
> Overlap and data loss on WindowedBolt based on Duration
> -------------------------------------------------------
>
> Key: STORM-2489
> URL: https://issues.apache.org/jira/browse/STORM-2489
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-core
> Affects Versions: 1.0.2
> Environment: windows 10, eclipse, jdk1.7
> Reporter: wangkui
> Assignee: Arun Mahadevan
> Attachments: TumblingWindowIssue.java
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> The attachment is my test script, one of my test results is:
> ```
> expired=1...55
> get=56...4024
> new=56...4024
> Recived=3969,RecivedTotal=3969
> expired=56...4020
> get=4021...8191
> new=4025...8191
> Recived=4171,RecivedTotal=8140
> SendTotal=12175
> expired=4021...8188
> get=8189...12175
> new=8192...12175
> Recived=3987,RecivedTotal=12127
> ```
> This test result shows that some tuples appear in the expired list directly,
> we lost these data if we just use get() to get tuples, this is the first bug.
> The second: the tuples of get() has overlap, the getNew() seems alright.
> The problem not happen definitely, may need to try several times.
> Actually, I'm newbie about storm, so I'm not sure this is a bug indeed, or, I
> use it in wrong way?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
