[jira] [Created] (KAFKA-4876) WindowStore.fetch(key, 0, Long.MaxValue) is very slow

[JIRA]

Xavier Léauté created KAFKA-4876:
------------------------------------

             Summary: WindowStore.fetch(key, 0, Long.MaxValue) is very slow
                 Key: KAFKA-4876
                 URL: https://issues.apache.org/jira/browse/KAFKA-4876
             Project: Kafka
          Issue Type: Bug
          Components: streams
    Affects Versions: 0.10.2.0, 0.10.1.0
            Reporter: Xavier Léauté


Relates to KAFKA-4851

Querying a window store over the entire time range (i.e. {{\[0, 
Long.MAX_VALUE\]}} is extremely slow.

Here's a simple benchmark that shows it takes about 400ms to query just a 
single key with a timestamp as of today's date.

https://github.com/xvrl/kafka/commit/045b94d4c70d730d10ed492efeb0fd85a70757ae#diff-46a87bcb14bccc04c8ad716a043fc78eR150

{code}
Benchmark                                    Mode  Cnt    Score    Error   Units
RocksDBWindowStoreTest.benchmarkStoreFetch   avgt   20  401.635 ± 46.130   ms/op
{code}

Using timestamps far out in the future (e.g. 0x7a00000000000000L) the fetch 
operation essentially never completes.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)