[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773750#comment-16773750
]
ASF GitHub Bot commented on KAFKA-7933:
---
mjsax commented on pull request #6292: KAFKA-7933: Switch from persistent to
in-memory store in KTableKTablLeftJoinTest
URL: https://github.com/apache/kafka/pull/6292
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772127#comment-16772127
]
ASF GitHub Bot commented on KAFKA-7933:
---
mjsax commented on pull request #6292: KAFKA-7933: Switch from persistent to
in-memory store in KTableKTablLeftJoinTest
URL: https://github.com/apache/kafka/pull/6292
Local test runtime drops from 15 sec to about 1 second for
`shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions()`
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772119#comment-16772119
]
Matthias J. Sax commented on KAFKA-7933:
Create https://issues.apache.org/jira/browse/KAFKA-7952 a follow up. Local test
runtime dropped from 15 second to less than 100ms switching to in-memory stores.
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772101#comment-16772101
]
Matthias J. Sax commented on KAFKA-7933:
Interesting. I'll do a PR to switch to an in-memory store for this test. Let's
see if it fixes the issue.
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771836#comment-16771836
]
Ismael Juma commented on KAFKA-7933:
Good point [~chia7712], that could be it.
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771829#comment-16771829
]
Chia-Ping Tsai commented on KAFKA-7933:
---
Is this jira related to hardware env?
shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions flush rocksdb for
each "input data". I profile the test on my local with normal hdd. It take 0.1
second to complete the flush. Hence, it needs 0.1 s * 1000 (loop) * 23 (inputs)
= 38 minutes to complete
shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions. By contrast,
completing the test only took 5 minutes on my ssd.
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771504#comment-16771504
]
Matthias J. Sax commented on KAFKA-7933:
PR for troubleshooting: https://github.com/apache/kafka/pull/6287
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770617#comment-16770617
]
Matthias J. Sax commented on KAFKA-7933:
Maybe one more instance:
https://github.com/apache/kafka/pull/6279#issuecomment-464420791
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Assignee: Matthias J. Sax
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769918#comment-16769918
]
Matthias J. Sax commented on KAFKA-7933:
One more:
https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/19503/consoleFull
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769638#comment-16769638
]
Matthias J. Sax commented on KAFKA-7933:
Happende again:
https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/19484/consoleFull
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams, unit tests
>Reporter: Viktor Somogyi-Vass
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7933) KTableKTableLeftJoinTest takes an hour to finish
[
https://issues.apache.org/jira/browse/KAFKA-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769385#comment-16769385
]
Viktor Somogyi commented on KAFKA-7933:
---
For now I only saw this at one instance:
https://builds.apache.org/job/kafka-pr-jdk11-scala2.12/2394
> KTableKTableLeftJoinTest takes an hour to finish
>
>
> Key: KAFKA-7933
> URL: https://issues.apache.org/jira/browse/KAFKA-7933
> Project: Kafka
> Issue Type: Improvement
> Components: streams
>Affects Versions: 2.2.0
>Reporter: Viktor Somogyi
>Priority: Major
> Attachments: jenkins-output-one-hour-test.log
>
>
> PRs might time out as
> {{KTableKTableLeftJoinTest.shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions}}
> took one hour to complete.
> {noformat}
> 11:57:45 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions STARTED
> 12:53:35
> 12:53:35 org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest
> > shouldNotThrowIllegalStateExceptionWhenMultiCacheEvictions PASSED
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
