[
https://issues.apache.org/jira/browse/SOLR-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420466#comment-17420466
]
Mark Robert Miller commented on SOLR-15639:
-------------------------------------------
Okay, I found a change I had put in where I reduced a bit of work for non
Nightly runs in a loop after corrupting the index. With that as well as a bit
of additional non nightly reduction around number of files created
(surprisingly, the bottleneck is not really around file size or copying, but
the number of file names scanned and instantiated) I'm still 10 seconds off the
branch with integrated changes. That branch is built on the javabin perf
changes though, which has a couple other changes that perhaps could be related.
I may go spin those out and get them in, because it's fairly strange I can't
match the run time even with that additional easing. I'd like to at least match
what's on the branch before we decide if we should shift anything more
aggressive into nightly here. Because of all these file references (mostly
related to an S3 bucket call that gets all the files in a bucket) there is both
a pretty high gc cost and a fair difference between running this test on SSD vs
rotating disk. The second easing for non nightly I just made (not adding more
docs and committing quite so much for non nightly) removed most of the high gc
cost, but mostly I was just trying to see what it would take to get down to the
time I'm getting on the other branch. Given I'm still 10 seconds off even with,
there must be some other change giving that branch a decent boost here.
> S3 tests are needlessly slow.
> -----------------------------
>
> Key: SOLR-15639
> URL: https://issues.apache.org/jira/browse/SOLR-15639
> Project: Solr
> Issue Type: Test
> Security Level: Public(Default Security Level. Issues are Public)
> Components: contrib - S3 Repository, Tests
> Reporter: Mark Robert Miller
> Assignee: Mark Robert Miller
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org
For additional commands, e-mail: issues-h...@solr.apache.org
