[
https://issues.apache.org/jira/browse/PHOENIX-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17045921#comment-17045921
]
Istvan Toth commented on PHOENIX-5699:
--------------------------------------
[~elserj] The test waiting for chore issue is not present when running with
HBase 2.0.1 (the default before my last patch), the behaviour changed sometime
between 2.0.1 and 2.0.4 (Note that when you explicitly specify
-Dhbase.profile=2.0, then you'll get HBase 2.0.4 instead of 2.0.1 by default)
I could not reproduce Richard's numbers either, though the difference is
significant:
2.0.1 (matching your results):
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 44.893 s
- in org.apache.phoenix.end2end.index.MutableIndexSplitForwardScanIT
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.134 s
- in org.apache.phoenix.end2end.index.MutableIndexSplitReverseScanIT
2.2.3 without patch:
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 215.262
s - in org.apache.phoenix.end2end.index.MutableIndexSplitForwardScanIT
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 215.415
s - in org.apache.phoenix.end2end.index.MutableIndexSplitReverseScanIT
2.2.3 with patch:
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.782 s
- in org.apache.phoenix.end2end.index.MutableIndexSplitReverseScanIT
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.417 s
- in org.apache.phoenix.end2end.index.MutableIndexSplitForwardScanIT
IIRC Richard has found another affected test, and included the run times from
that one as well, but forgot to note that in his results.
> Investigate reducing chore intervals in MiniCluster to speed up tests
> ---------------------------------------------------------------------
>
> Key: PHOENIX-5699
> URL: https://issues.apache.org/jira/browse/PHOENIX-5699
> Project: Phoenix
> Issue Type: Improvement
> Reporter: Istvan Toth
> Assignee: Richard Antal
> Priority: Major
> Attachments: PHOENIX-5699.master.v1.patch
>
>
> Some tests take a long time to run not because they are
> computationally/memory/IO intensive, but simply because they are waiting for
> some HBase chore to be run.
> One such test is MutableIndexSplitIT where we must wait for
> CompactedHFilesDischarger for the requested split to happen.
> Try to identify these cases, and reduce the chore intervals in the
> MiniCluster setup to speed up test executions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
