Re: NPE Within IndexWriter.optimize (Solr Trunk Nightly)

2010-05-25 Thread Chris Herron
Uwe, Mike,

I downloaded the nightly build by visiting the wiki:
http://wiki.apache.org/solr/FrontPage
... and then clicking on "Download newest Solr nightly build here"
http://hudson.zones.apache.org/hudson/job/Solr-trunk/lastSuccessfulBuild/artifact/trunk/solr/dist/
The exact file I download yesterday was:
http://hudson.zones.apache.org/hudson/job/Solr-trunk/lastSuccessfulBuild/artifact/trunk/solr/dist/apache-solr-2010-05-24_08-05-13.tgz
 (no longer exists).

I have no patches or mods added. The CHANGES.txt file in the download includes 
this:

~
$Id: CHANGES.txt 945897 2010-05-18 21:30:41Z hossman $

==  4.0.0-dev ==
Versions of Major Components
-
Apache Lucene trunk
Apache Tika 0.6
Carrot2 3.1.0
~

Did I fetch the wrong version? If so, where can I grab the (1.5.x) nightly 
builds?

Mike, thanks for the CheckIndex suggestion. Shall run that once I've confirmed 
which version I'm running.

Thanks,

Chris

On May 25, 2010, at 5:09 AM, Uwe Schindler wrote:

> Maybe it's the 3x version?
> 
> The artifact names in Hudson are currently identical for solr-trunk and
> solr-3x. You have to specifiy which version you use!
> 
> -
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: u...@thetaphi.de
> 
>> -Original Message-
>> From: Michael McCandless [mailto:luc...@mikemccandless.com]
>> Sent: Tuesday, May 25, 2010 11:01 AM
>> To: dev@lucene.apache.org
>> Subject: Re: NPE Within IndexWriter.optimize (Solr Trunk Nightly)
>> 
>> Hmmm spooky.
>> 
>> For some reason I can't correlate the line numbers in TermInfosReader.java
>> the current trunk sources; the line numbers for all the other sources line
> up.
>> This is a stock nightly build right?
>> You don't have any mods/patches?
>> 
>> Can you enable assertions when you optimize and see if anything trips?
>> 
>> Also, can you run CheckIndex on your index (java -ea
>> org.apache.lucene.index.CheckIndex /path/to/index), and post the output?
>> 
>> Mike
>> 
>> On Mon, May 24, 2010 at 7:43 PM, Chris Herron  wrote:
>>> Hi,
>>> 
>>> I'm using the latest nightly build of solr
> (apache-solr-2010-05-24_08-05-13)
>> and am repeatedly experiencing a NullPointerException after calling
> delete,
>> commit, optimize. Stack trace below. The index is ~20Gb.
>>> 
>>> I'm not doing Lucene/Solr core development - I just figured this was a
>> better place to ask given that this was a nightly build.
>>> 
>>> Any observations that would help resolve?
>>> 
>>> Thanks,
>>> 
>>> Chris
>>> 
>>> SEVERE: java.io.IOException: background merge hit exception:
>>> _gr5a:C127 _gsbj:C486/3 _gsbk:C1 _gsbl:C1/1 _gsbm:C1 _gsbn:C1 _gsbo:C1
>>> _gsbp:C1 _gsbq:C1 _gssn:C69 into _gsss [optimize] [mergeDocStores]
>>>at
>>> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2418)
>>>at
>>> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2343)
>>>at
>>> 
>> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler
>>> 2.java:403)
>>>at
>>> 
>> org.apache.solr.update.processor.RunUpdateProcessor.processCommit(Run
>> U
>>> pdateProcessorFactory.java:85)
>>>at
>>> 
>> org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandle
>>> rUtils.java:107)
>>>at
>>> 
>> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(Co
>> n
>>> tentStreamHandlerBase.java:48)
>>>at
>>> 
>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandl
>> e
>>> rBase.java:131)
>>>at org.apache.solr.core.SolrCore.execute(SolrCore.java:1321)
>>>at
>>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.
>>> java:341)
>>>at
>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter
>>> .java:244)
>>>at
>>> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletH
>>> andler.java:1190)
>>>at
>>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:
>>> 424)
>>>at
>>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.ja
>>> va:119)

NPE Within IndexWriter.optimize (Solr Trunk Nightly)

2010-05-24 Thread Chris Herron
Hi,

I'm using the latest nightly build of solr (apache-solr-2010-05-24_08-05-13) 
and am repeatedly experiencing a NullPointerException after calling delete, 
commit, optimize. Stack trace below. The index is ~20Gb.

I'm not doing Lucene/Solr core development - I just figured this was a better 
place to ask given that this was a nightly build.

Any observations that would help resolve?

Thanks,

Chris

SEVERE: java.io.IOException: background merge hit exception: _gr5a:C127 
_gsbj:C486/3 _gsbk:C1 _gsbl:C1/1 _gsbm:C1 _gsbn:C1 _gsbo:C1 _gsbp:C1 _gsbq:C1 
_gssn:C69 into _gsss [optimize] [mergeDocStores]
at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2418)
at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2343)
at 
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:403)
at 
org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:85)
at 
org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:107)
at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:48)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1321)
at 
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:341)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:244)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1190)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:424)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:457)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:931)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:361)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:186)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:867)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:245)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:113)
at org.eclipse.jetty.server.Server.handle(Server.java:337)
at 
org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:581)
at 
org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1005)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:560)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:222)
at 
org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:417)
at 
org.eclipse.jetty.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:474)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:437)
at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.NullPointerException
at 
org.apache.lucene.index.codecs.preflex.TermInfosReader.seekEnum(TermInfosReader.java:224)
at 
org.apache.lucene.index.codecs.preflex.TermInfosReader.seekEnum(TermInfosReader.java:214)
at 
org.apache.lucene.index.codecs.preflex.PreFlexFields$PreTermsEnum.reset(PreFlexFields.java:251)
at 
org.apache.lucene.index.codecs.preflex.PreFlexFields$PreFlexFieldsEnum.terms(PreFlexFields.java:198)
at 
org.apache.lucene.index.MultiFieldsEnum.terms(MultiFieldsEnum.java:103)
at 
org.apache.lucene.index.codecs.FieldsConsumer.merge(FieldsConsumer.java:48)
at 
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:647)
at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:151)
at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4414)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:4038)
at 
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:339)
at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:407)

Exception in thread "Lucene Merge Thread #0" 
org.apache.lucene.index.MergePolicy$MergeException: 
java.lang.NullPointerException
at 
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:471)
at 
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run