Re: org.apache.solr.common.SolrException: this IndexWriter is closed

2021-03-05 Thread Dominique Bejean
; Version:8.7.0 > > org.apache.solr.common.SolrException: this IndexWriter is closed > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:234) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2627) > at > org.apache.solr.servlet.HttpSo

org.apache.solr.common.SolrException: this IndexWriter is closed

2021-03-05 Thread 李世明
Hello: Have you encountered the following exception that will cause the index to not be written? But you can query Version:8.7.0 org.apache.solr.common.SolrException: this IndexWriter is closed at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java

graphq query delete: this IndexWriter is closed ??

2020-02-21 Thread Jochen Barth
:d-nb.info* -rnd_d:[0 TO 10] -id:*#* -_query_:"{!graph from=id to=parent_ids}class_s:meta"' now 2020-02-21 13:47:03.523 ERROR (qtp548482954-59) [   x:Suchindex] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: this IndexWriter is closed Caused by: org.apache.lucene.store.Al

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Walter Underwood
If you have fast disk and enough RAM, indexing is CPU limited. So adjust the indexing load until the CPU is busy but not overloaded. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Apr 2, 2019, at 9:23 PM, Aroop Ganguly wrote: > > Thats an

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Aroop Ganguly
Thats an interesting scaling scheme you mention. I have been trying to devise a good scheme for myself for our scale. I will try to see how this works out for us. > On Apr 2, 2019, at 9:15 PM, Walter Underwood wrote: > > Yeah, that would overload it. To get good indexing speed, I configure two

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Walter Underwood
Yeah, that would overload it. To get good indexing speed, I configure two clients per CPU on the indexing machine. With one shard on a 16 processor machine, that would be 32 threads. With four shards on four 16 processor machines, 128 clients. Basically, one thread is waiting while the CPU

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Aroop Ganguly
Mutliple threads to the same index ? And how many concurrent threads? Our case is not merely multiple threads but actually large scale spark indexer jobs that index 1B records at a time with a concurrency of 400. In this case multiple such jobs were indexing into the same index. > On Apr 2,

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-02 Thread Walter Underwood
We run multiple threads indexing to Solr all the time and have been doing so for years. How big are your documents and how big are your batches? wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Apr 1, 2019, at 10:51 PM, Aroop Ganguly wrote: > >

Re: IndexWriter has closed

2019-04-02 Thread Zheng Lin Edwin Yeo
in > > > > On Fri, 29 Mar 2019 at 15:16, Aroop Ganguly > wrote: > > > >> Trying again .. Any idea why this might happen? > >> > >> > >>> On Mar 27, 2019, at 10:43 PM, Aroop Ganguly > >> wrote: > >>> > >&

Re: IndexWriter has closed

2019-04-01 Thread Aroop Ganguly
; Regards, > Edwin > > On Fri, 29 Mar 2019 at 15:16, Aroop Ganguly wrote: > >> Trying again .. Any idea why this might happen? >> >> >>> On Mar 27, 2019, at 10:43 PM, Aroop Ganguly >> wrote: >>> >>> Hi Everyone >>> >&

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Aroop Ganguly
Turns out the cause was multiple indexing jobs indexing into the index simultaneously, which one can imagine can cause jvm loads on certain replicas for sure. Once this was found and only one job ran at a time, things were back to normal. Your comments seem right on no correlation to the stack

Re: IndexWriter has closed

2019-04-01 Thread Zheng Lin Edwin Yeo
t; > Hi Everyone > > > > My indexing jobs are failing with “this IndexWriter has closed” errors.. > > This is a solr 7.5 setup, with an NRT index. > > > > In deeper logs I see, some of these exceptions, > > Any idea what could have caused this ? >

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Shawn Heisey
4/1/2019 5:40 PM, Aroop Ganguly wrote: Thanks Shawn, for the initial response. Digging into a bit, I was wondering if we’d care to read the inner most stack. From the inner most stack it seems to be telling us something about what trigger it ? Ofcourse, the system could have been overloaded

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Aroop Ganguly
Thanks Shawn, for the initial response. Digging into a bit, I was wondering if we’d care to read the inner most stack. From the inner most stack it seems to be telling us something about what trigger it ? Ofcourse, the system could have been overloaded as well, but is the exception telling us

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Erick Erickson
18) >>at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) >> at >> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) >>at >> org.eclipse.jetty.util.thread.strategy

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Shawn Heisey
On 4/1/2019 4:44 PM, Aroop Ganguly wrote: I am facing this issue again.The stack mentions Heap space issue. Are the document sizes too big ? Not sure what I should be doing here; As on the solr admin ui I do not see jvm being anywhere close to being full. Any advise on this is greatly

Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Aroop Ganguly
) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:679) at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:693

Re: Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Ashwin Tandel
gy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) > at > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) > at > org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) > at > org.eclipse.jetty.util.th

Solr 7.5 - Indexing Failing due to "IndexWriter is Closed"

2019-04-01 Thread Aroop Ganguly
) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:679) at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:693

Re: IndexWriter has closed

2019-03-29 Thread Aroop Ganguly
Trying again .. Any idea why this might happen? > On Mar 27, 2019, at 10:43 PM, Aroop Ganguly wrote: > > Hi Everyone > > My indexing jobs are failing with “this IndexWriter has closed” errors.. > This is a solr 7.5 setup, with an NRT index. > > In deeper logs I see,

Re: this IndexWriter is closed

2018-04-09 Thread Shawn Heisey
On 4/9/2018 12:31 PM, Jay Potharaju wrote: > I am getting Indexwriter is closed error only on some of my shards in the > collection. This seems to be happening on leader shards only. There is are > other shards on the box and they are not throwing any error. Also there is > enoug

this IndexWriter is closed

2018-04-09 Thread Jay Potharaju
Hi, I am getting Indexwriter is closed error only on some of my shards in the collection. This seems to be happening on leader shards only. There is are other shards on the box and they are not throwing any error. Also there is enough disc space on the box available at this time. Solr: 5.3.0

Re: SolrCloud 5.3.1 "IndexWriter is closed"

2017-09-12 Thread Susheel Kumar
eload whilst handling live traffic. > > The reload takes about 30 seconds and soon after (within a few seconds) we > start to see IndexWriter closed exceptions > > -Frank > > > Frank Kelly > Principal Software Engineer > Identity Profile Team (SCBE, Traces, CDA) > >

Re: SolrCloud 5.3.1 "IndexWriter is closed"

2017-09-12 Thread Kelly, Frank
The schema change doesn¹t seem to be making any difference - just the act of a reload whilst handling live traffic. The reload takes about 30 seconds and soon after (within a few seconds) we start to see IndexWriter closed exceptions -Frank Frank Kelly Principal Software Engineer Identity

Re: SolrCloud 5.3.1 "IndexWriter is closed"

2017-09-12 Thread Susheel Kumar
Kelly - If you do not make any change to schema and just reload your collection, does it work fine? How much time it takes to reload the collection? I am suspecting some conflict with commit frequency (5mins) and collection reload. Thnx On Tue, Sep 12, 2017 at 6:59 AM, Kelly, Frank

Re: SolrCloud 5.3.1 "IndexWriter is closed"

2017-09-12 Thread Kelly, Frank
No - these are new terms for new documents we will be adding later so no need to reindex old documents. Frank Frank Kelly Principal Software Engineer Identity Profile Team (SCBE, Traces, CDA) HERE 5 Wayside Rd, Burlington, MA 01803, USA 42° 29' 7" N 71° 11' 32" W

Re: SolrCloud 5.3.1 "IndexWriter is closed"

2017-09-12 Thread Rick Leir
the dreaded “IndexWriter is closed” exception and the only solution we have found to date is a Solr restart :-( Environment: * Solr 5.3.1 in Solr Cloud (3 shards each with 3 replicas across 3 EC2 Vms) * 300m+ documents (60+ GB index) * Relevant settings? o SOLR_OPTS="$SOLR

SolrCloud 5.3.1 "IndexWriter is closed"

2017-09-11 Thread Kelly, Frank
Just wondering if anyone has seen this before and might understand why this is happening When we deploy a new schema.xml adding some new search terms we get the dreaded “IndexWriter is closed” exception and the only solution we have found to date is a Solr restart :-( Environment: * Solr

Re: Solr 5.3.1: Collection reload results in IndexWriter is closed exception

2017-02-07 Thread Fuad Efendi
loads of a collection after changing solrconfig.xml without any issues. This time we saw it across 3 of 3 environments where we got several Solr’s showing “IndexWriter is closed” errors and had to stop and restart those Solr instances. In our final environment we skipped the RELOAD and just did solr stop, so

Solr 5.3.1: Collection reload results in IndexWriter is closed exception

2017-02-07 Thread Kelly, Frank
issues. This time we saw it across 3 of 3 environments where we got several Solr’s showing “IndexWriter is closed” errors and had to stop and restart those Solr instances. In our final environment we skipped the RELOAD and just did solr stop, solr start. The solrconfig.xml change we made