Ouch :(
I guess it's as efficient as it can be but too bad, because writing to
a remove node sounds awesomely cool to me at least. :)
Thanks for explaining the key bits, Shalin.
Otis
--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematex
The splitting process is nothing but the creation of a bitset with
which a LiveDocsReader is created. These readers are then added to the
a new index via IW.addIndexes(IndexReader[] readers) method. All this
is performed below the IR/IW API and no documents are actually ever
read or written directl
Hi,
On Wed, Nov 20, 2013 at 12:53 PM, Shalin Shekhar Mangar <
shalinman...@gmail.com> wrote:
> At the Lucene level, I think it would require a directory
> implementation which writes to a remote node directly. Otherwise, on
> the solr side, we must move the leader itself to another node which
> h
At the Lucene level, I think it would require a directory
implementation which writes to a remote node directly. Otherwise, on
the solr side, we must move the leader itself to another node which
has enough disk space and then split the index.
On Wed, Nov 20, 2013 at 8:37 PM, Otis Gospodnetic
wrot
Do you think this is something that is actually implementable? If so,
I'll open an issue.
One use-case where this may come in handy is when the disk space is
tight. If a shard is using > 50% of the disk space on some node X,
you can't really split that shard because the 2 new sub-shards will
not
No, it is not supported yet. We can't split to a remote node directly.
The best bet is trigger a new leader election by unloading the leader
node once all replicas are active.
On Wed, Nov 20, 2013 at 1:32 AM, Otis Gospodnetic
wrote:
> Hi,
>
> Is it possible to perform a shard split and stream dat
Hi,
Is it possible to perform a shard split and stream data for the
new/sub-shards to remote nodes, avoiding persistence of new/sub-shards
on the local/source node first?
Thanks,
Otis
--
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/