[jira] [Comment Edited] (OAK-3251) speeding up the build time
[
https://issues.apache.org/jira/browse/OAK-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733828#comment-14733828
]
Davide Giannella edited comment on OAK-3251 at 9/7/15 3:15 PM:
---
new build is not taking 13 minutes with the following top 10 tests
{noformat}
58.278 sec org.apache.jackrabbit.oak.upgrade.CopyVersionHistoryTest
48.328 sec
org.apache.jackrabbit.oak.plugins.document.DocumentDiscoveryLiteServiceTest
46.082 sec org.apache.jackrabbit.oak.upgrade.CopyVersionHistorySidegradeTest
35.065 sec org.apache.jackrabbit.oak.jcr.query.QueryJcrTest
17.164 sec org.apache.jackrabbit.oak.security.user.MembershipProviderTest
11.723 sec org.apache.jackrabbit.oak.plugins.document.BasicDocumentStoreTest
11.585 sec org.apache.jackrabbit.oak.run.osgi.LuceneSupportTest
11.579 sec org.apache.jackrabbit.oak.run.osgi.DocumentNodeStoreConfigTest
11.315 sec org.apache.jackrabbit.oak.upgrade.CopyNodeTypesUpgradeTest
10.997 sec org.apache.jackrabbit.oak.jcr.random.RandomizedReadTest
{noformat}
[full build|^build-1441637422.log], [full list of times|^times-1441637422.log]
was (Author: edivad):
new build is not taking 13 minutes with the following top 10 tests
{noformat}
58.278 sec org.apache.jackrabbit.oak.upgrade.CopyVersionHistoryTest
48.328 sec
org.apache.jackrabbit.oak.plugins.document.DocumentDiscoveryLiteServiceTest
46.082 sec org.apache.jackrabbit.oak.upgrade.CopyVersionHistorySidegradeTest
35.065 sec org.apache.jackrabbit.oak.jcr.query.QueryJcrTest
17.164 sec org.apache.jackrabbit.oak.security.user.MembershipProviderTest
11.723 sec org.apache.jackrabbit.oak.plugins.document.BasicDocumentStoreTest
11.585 sec org.apache.jackrabbit.oak.run.osgi.LuceneSupportTest
11.579 sec org.apache.jackrabbit.oak.run.osgi.DocumentNodeStoreConfigTest
11.315 sec org.apache.jackrabbit.oak.upgrade.CopyNodeTypesUpgradeTest
10.997 sec org.apache.jackrabbit.oak.jcr.random.RandomizedReadTest
{noformat}
[^build-1441637422.log|full build], [^times-1441637422.log|full list of times]
> speeding up the build time
> --
>
> Key: OAK-3251
> URL: https://issues.apache.org/jira/browse/OAK-3251
> Project: Jackrabbit Oak
> Issue Type: Improvement
>Reporter: Davide Giannella
>Assignee: Davide Giannella
> Attachments: build-1441353866-times.log, build-1441353866.log,
> build-1441637422.log, oak-build-for-unittests-times.log, oak-build-times.log,
> times-1441637422.log
>
>
> Running the build with a {mvn clean install} takes a considerable amount of
> time: 15 minutes on my local.
> The top 10 slowest unit test are the following
> {noformat}
> 110.822 sec org.apache.jackrabbit.oak.jcr.query.QueryJcrTest
> 54.012 sec
> org.apache.jackrabbit.oak.plugins.segment.SegmentDataStoreBlobGCTest
> 36.593 sec
> org.apache.jackrabbit.oak.plugins.document.VersionGarbageCollectorTest
> 35.234 sec org.apache.jackrabbit.oak.jcr.query.QueryJcrTest
> 25.047 sec org.apache.jackrabbit.oak.plugins.segment.file.FileStoreTest
> 24.787 sec org.apache.jackrabbit.oak.plugins.document.BasicDocumentStoreTest
> 17.477 sec org.apache.jackrabbit.oak.plugins.segment.ExternalBlobTest
> 16.343 sec org.apache.jackrabbit.oak.jcr.query.QueryTest
> 14.519 sec org.apache.jackrabbit.oak.plugins.segment.CompactionAndCleanupTest
> 11.604 sec org.apache.jackrabbit.oak.run.osgi.LuceneSupportTest
> {noformat}
> Is there anything we could do to speed-up these?
> sorted times obtained with
> https://gist.github.com/davidegiannella/b1d3cbe51d1f70314500
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (OAK-3251) speeding up the build time
[
https://issues.apache.org/jira/browse/OAK-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702675#comment-14702675
]
Davide Giannella edited comment on OAK-3251 at 8/19/15 8:04 AM:
When running a simple clean install, only the SEGMENT_MK is passed as
fixture. A first quick win I can think by looking at the tests
namespaces is to adopt the {{FixtureHelper}} in
- org.apache.jackrabbit.oak.plugins.document.VersionGarbageCollectorTest
- org.apache.jackrabbit.oak.plugins.document.BasicDocumentStoreTest
by having them running only for {{DOCUMENT_*}} fixtures. This will
speed up a clean install already by roughly one minute.
On the other hand for speeding up the builds Fixtures oriented builds
on jenkins we could limit to {{SEGMENT_MK}} fixtures the tests
- org.apache.jackrabbit.oak.plugins.segment.SegmentDataStoreBlobGCTest
- org.apache.jackrabbit.oak.plugins.segment.file.FileStoreTest
- org.apache.jackrabbit.oak.plugins.segment.ExternalBlobTest
- org.apache.jackrabbit.oak.plugins.segment.CompactionAndCleanupTest
having therefore a build for {{DOCUMENT_*}} roughly 2 minutes faster.
Thoughts?
was (Author: edivad):
When running a simple clean install, only the SEGMENT_MK is passed as
fixture. A first quick win I can thing by looking at the tests
namespaces is to adopt the {{FixtureHelper}} in
- org.apache.jackrabbit.oak.plugins.document.VersionGarbageCollectorTest
- org.apache.jackrabbit.oak.plugins.document.BasicDocumentStoreTest
by having them running only for {{DOCUMENT_*}} fixtures. This will
speed up a clean install already by roughly one minute.
On the other hand for speeding up the builds Fixtures oriented builds
on jenkins we could limit to {{SEGMENT_MK}} fixtures the tests
- org.apache.jackrabbit.oak.plugins.segment.SegmentDataStoreBlobGCTest
- org.apache.jackrabbit.oak.plugins.segment.file.FileStoreTest
- org.apache.jackrabbit.oak.plugins.segment.ExternalBlobTest
- org.apache.jackrabbit.oak.plugins.segment.CompactionAndCleanupTest
having therefore a build for {{DOCUMENT_*}} roughly 2 minutes faster.
Thoughts?
speeding up the build time
--
Key: OAK-3251
URL: https://issues.apache.org/jira/browse/OAK-3251
Project: Jackrabbit Oak
Issue Type: Improvement
Reporter: Davide Giannella
Assignee: Davide Giannella
Attachments: oak-build-for-unittests-times.log, oak-build-times.log
Running the build with a {mvn clean install} takes a considerable amount of
time: 15 minutes on my local.
The top 10 slowest unit test are the following
{noformat}
110.822 sec org.apache.jackrabbit.oak.jcr.query.QueryJcrTest
54.012 sec
org.apache.jackrabbit.oak.plugins.segment.SegmentDataStoreBlobGCTest
36.593 sec
org.apache.jackrabbit.oak.plugins.document.VersionGarbageCollectorTest
35.234 sec org.apache.jackrabbit.oak.jcr.query.QueryJcrTest
25.047 sec org.apache.jackrabbit.oak.plugins.segment.file.FileStoreTest
24.787 sec org.apache.jackrabbit.oak.plugins.document.BasicDocumentStoreTest
17.477 sec org.apache.jackrabbit.oak.plugins.segment.ExternalBlobTest
16.343 sec org.apache.jackrabbit.oak.jcr.query.QueryTest
14.519 sec org.apache.jackrabbit.oak.plugins.segment.CompactionAndCleanupTest
11.604 sec org.apache.jackrabbit.oak.run.osgi.LuceneSupportTest
{noformat}
Is there anything we could do to speed-up these?
sorted times obtained with
https://gist.github.com/davidegiannella/b1d3cbe51d1f70314500
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
