I was trying "SPLITSHARD" in my test env and encountered a strange behavior:
I created a 1M doc collection and it contained 8 shards, then split shard1,
after split:
* SPLITSHARD returned success.
* looks good
* shard1 (became inactive) -> shard1_0 and shard1_1
* range 80000000-9fffffff -> 80000000-8fffffff and 90000000-9fffffff
* but
* the doc number is increasing: docnum of shard1_0 (70702) + docnum of
shard1_1(67980) > docnum of shard1(124818)
I tested many times and this issue happened every time. Why?
Thanks.
________________________________
From: Hongxu Ma <inte...@outlook.com>
Sent: Monday, March 16, 2020 16:46
To: solr-user@lucene.apache.org <solr-user@lucene.apache.org>
Subject: number of documents exceed 2147483519
Hi
I'm using solr-cloud (ver 6.6), got an error:
org.apache.solr.common.SolrException: Exception writing document id (null) to
the index; possible analysis error: number of documents in the index cannot
exceed 2147483519
After googled it, I know the number is exceed one solr shard limit.
The collection has 64 shards, so I think total limit is 20B*64=128B
My question is:
I don't want to recreate index (then split to more shards) and also don't want
to delete docs.
Can I using the "SPLITSHARD" api to fix this issue?
https://lucene.apache.org/solr/guide/6_6/collections-api.html#CollectionsAPI-splitshard
After split each shard (now 128 shards), I think the total limit is increasing
to 256B, right?
Thanks.
Collections API | Apache Solr Reference Guide
6.6<https://lucene.apache.org/solr/guide/6_6/collections-api.html#CollectionsAPI-splitshard>
The Collections API is used to enable you to create, remove, or reload
collections, but in the context of SolrCloud you can also use it to create
collections with a specific number of shards and replicas.
lucene.apache.org
