[
https://issues.apache.org/jira/browse/SOLR-14656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17160311#comment-17160311
]
Ishan Chattopadhyaya commented on SOLR-14656:
---------------------------------------------
Here are collection creation times, as more and more collections are created.
The blue line is on master, the red line on the branch in this PR (where
autoscaling framework has been removed).
!Screenshot from 2020-07-18 07-49-01.png!
(Methodology: On a beefy machine, create 50 Solr JVMs, 1GB RAM each. Then, in a
loop, keep creating collections with 3 shards)
{code}
# Start Solr nodes:
bin/solr -c -m 1g
for i in {1..49}; do PORT=8983; echo $i; bin/solr -c -m 1g -z localhost:9983 -p
$((PORT+i)); done
# Create tons of collections
for i in {1..2000}; do echo $i; curl
"http://localhost:8983/solr/admin/collections?action=CREATE&name=col$i&numShards=3";;
done > collection-creation-times.log
{code}
> Deprecate current autoscaling framework, remove from master
> -----------------------------------------------------------
>
> Key: SOLR-14656
> URL: https://issues.apache.org/jira/browse/SOLR-14656
> Project: Solr
> Issue Type: Improvement
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Ishan Chattopadhyaya
> Priority: Major
> Attachments: Screenshot from 2020-07-18 07-49-01.png
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> The autoscaling framework is being re-designed in SOLR-14613 (SIP:
> https://cwiki.apache.org/confluence/display/SOLR/SIP-8+Autoscaling+policy+engine+V2).
> The current autoscaling framework is very inefficient, improperly designed
> and too bloated and doesn't receive the level of support we aspire to provide
> for all components that we ship.
> This issue is to deprecate current autoscaling framework in 8x, so we can
> focus on the new autoscaling framework afresh.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
