RE: NPE when faceting with MLT Query from upgrade to Solr 5.1.0

2015-05-26 Thread Jeroen Steggink
I have added a patch which should fix the problem.
https://issues.apache.org/jira/browse/SOLR-7559

Please review.

Cheers,
Jeroen

-Original Message-
From: Jeroen Steggink [mailto:jeroen.stegg...@contentstrategy.nl] 
Sent: dinsdag 26 mei 2015 21:45
To: solr-user@lucene.apache.org
Subject: RE: NPE when faceting with MLT Query from upgrade to Solr 5.1.0

Hi Tim,

I just ran into the exact same problem.
I see you created a bug in JIRA. I will check what is causing this and try and 
fix it.

https://issues.apache.org/jira/browse/SOLR-7559

Jeroen

-Original Message-
From: Tim H [mailto:th98...@gmail.com] 
Sent: maandag 18 mei 2015 17:28
To: solr-user@lucene.apache.org
Subject: NPE when faceting with MLT Query from upgrade to Solr 5.1.0

Hi everyone,

Recently I upgraded to solr 5.1.0.  When trying to generate facets using the 
more like this handler, I now get a a NullPointerException.  I never got this 
exception while using Solr 4.10.0 Details are below:

Stack Trace:
at
org.apache.solr.request.SimpleFacets.getHeatmapCounts(SimpleFacets.java:1555)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:284)
at
org.apache.solr.handler.MoreLikeThisHandler.handleRequestBody(MoreLikeThisHandler.java:233)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1984)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:829)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:446)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)


Query:
qt=/mlt
q=id:545dbb57b54c2403f286050e546dcdcab54cf2d074e5a2f7
mlt.mindf=5
mlt.mintf=1
mlt.minwl=3
mlt.boost=true
fq=storeid:546dcdcab54cf2d074e5a2f7
mlt.fl=overview_mlt,abstract_mlt,description_mlt,company_profile_mlt,bio_mlt
mlt.interestingTerms=details
fl=conceptid,score
sort=score desc
start=0
rows=2
facet=true
facet.field=tags
facet.field=locations
facet.mincount=1
facet.method=enum
facet.limit=-1
facet.sort=count

Schema.xml(relevant parts):
   field name=tags type=string indexed=true stored=true
multiValued=true /

   field name=locations type=string indexed=true stored=true
multiValued=true /

   dynamicField name=*_mlt stored=true indexed=true
type=text_general termVectors=true multiValued=true /


solrconfig.xml(relevant parts):
  requestHandler name=/mlt class=solr.MoreLikeThisHandler 
  /requestHandler


RE: NPE when faceting with MLT Query from upgrade to Solr 5.1.0

2015-05-26 Thread Jeroen Steggink
Hi Tim,

I just ran into the exact same problem.
I see you created a bug in JIRA. I will check what is causing this and try and 
fix it.

https://issues.apache.org/jira/browse/SOLR-7559

Jeroen

-Original Message-
From: Tim H [mailto:th98...@gmail.com] 
Sent: maandag 18 mei 2015 17:28
To: solr-user@lucene.apache.org
Subject: NPE when faceting with MLT Query from upgrade to Solr 5.1.0

Hi everyone,

Recently I upgraded to solr 5.1.0.  When trying to generate facets using the 
more like this handler, I now get a a NullPointerException.  I never got this 
exception while using Solr 4.10.0 Details are below:

Stack Trace:
at
org.apache.solr.request.SimpleFacets.getHeatmapCounts(SimpleFacets.java:1555)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:284)
at
org.apache.solr.handler.MoreLikeThisHandler.handleRequestBody(MoreLikeThisHandler.java:233)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1984)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:829)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:446)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:220)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)


Query:
qt=/mlt
q=id:545dbb57b54c2403f286050e546dcdcab54cf2d074e5a2f7
mlt.mindf=5
mlt.mintf=1
mlt.minwl=3
mlt.boost=true
fq=storeid:546dcdcab54cf2d074e5a2f7
mlt.fl=overview_mlt,abstract_mlt,description_mlt,company_profile_mlt,bio_mlt
mlt.interestingTerms=details
fl=conceptid,score
sort=score desc
start=0
rows=2
facet=true
facet.field=tags
facet.field=locations
facet.mincount=1
facet.method=enum
facet.limit=-1
facet.sort=count

Schema.xml(relevant parts):
   field name=tags type=string indexed=true stored=true
multiValued=true /

   field name=locations type=string indexed=true stored=true
multiValued=true /

   dynamicField name=*_mlt stored=true indexed=true
type=text_general termVectors=true multiValued=true /


solrconfig.xml(relevant parts):
  requestHandler name=/mlt class=solr.MoreLikeThisHandler 
  /requestHandler


Re: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread Jack Krupansky
Are you sure you want to facet on a text field??? That will facet on the 
individual terms, which isn't usually very useful.


Usually, people want to facet on full phrases or entire strings, so they do 
a schema copyField from the text field to a string field and then facet on 
the string field.


-- Jack Krupansky

-Original Message- 
From: coolpriya5

Sent: Wednesday, April 10, 2013 6:19 PM
To: solr-user@lucene.apache.org
Subject: NPE when faceting TEXTfield in a distributed search query

Hi,

I have a nullable TextField with field type as follows(field
name=fun_group):-
fieldType name=lowercase_sort_missing_first class=solr.TextField
sortMissingFirst=true positionIncrementGap=100
analyzertokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory//analyzer
/fieldType

field definition is:-
field name=fun_group type=lowercase_sort_missing_first indexed=true
stored=true multiValued=false/

I am running a distributed search(using shards= param) across 13 shards
while faceting on fun_group with the following params:-

http://shard1/solr/mycore/select?facet=truefacet.field=fun_groupfacet.mincount=1rows=0facet.limit=1facet.offset=0q=(((my_id:4024
AND ((flag:1 OR flag:0 AND
class_id:2604)shards=shard1/solr/mycore,shard2/solr/mycore,shard3/solr/mycore,shard4/solr/mycore,shard5/solr/mycore,shard6/solr/mycore,shard7/solr/mycore,shard8/solr/mycore,shard9/solr/mycore,shard10/solr/mycore,shard11/solr/mycore,shard12/solr/mycore,shard13/solr/mycore

I get Internal Server Error on shard6. In the logs, I see the NPE from
org.apache.solr.servlet.SolrDispatchFilter.

If I change the facet.limit from 1 to 5000 keeping the
facet.offset=0,there are no exceptions. Now again if try facet.limit=5000
and facet.offset=5000 , I get the same exception. I tried facet.limit=4000
and facet.offset=5000, it worked fine. Please help



--
View this message in context: 
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172.html
Sent from the Solr - User mailing list archive at Nabble.com. 



Re: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread Jack Krupansky
Ah... I see now that you are using the keyword tokenizer that should 
preserve the phrase structure of the text.


You haven't detailed the exception stack trace.

What are the numbers in terms of number of values and average length of each 
value?


-- Jack Krupansky

-Original Message- 
From: Jack Krupansky

Sent: Wednesday, April 10, 2013 6:30 PM
To: solr-user@lucene.apache.org
Subject: Re: NPE when faceting TEXTfield in a distributed search query

Are you sure you want to facet on a text field??? That will facet on the
individual terms, which isn't usually very useful.

Usually, people want to facet on full phrases or entire strings, so they do
a schema copyField from the text field to a string field and then facet on
the string field.

-- Jack Krupansky

-Original Message- 
From: coolpriya5

Sent: Wednesday, April 10, 2013 6:19 PM
To: solr-user@lucene.apache.org
Subject: NPE when faceting TEXTfield in a distributed search query

Hi,

I have a nullable TextField with field type as follows(field
name=fun_group):-
fieldType name=lowercase_sort_missing_first class=solr.TextField
sortMissingFirst=true positionIncrementGap=100
analyzertokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory//analyzer
/fieldType

field definition is:-
field name=fun_group type=lowercase_sort_missing_first indexed=true
stored=true multiValued=false/

I am running a distributed search(using shards= param) across 13 shards
while faceting on fun_group with the following params:-

http://shard1/solr/mycore/select?facet=truefacet.field=fun_groupfacet.mincount=1rows=0facet.limit=1facet.offset=0q=(((my_id:4024
AND ((flag:1 OR flag:0 AND
class_id:2604)shards=shard1/solr/mycore,shard2/solr/mycore,shard3/solr/mycore,shard4/solr/mycore,shard5/solr/mycore,shard6/solr/mycore,shard7/solr/mycore,shard8/solr/mycore,shard9/solr/mycore,shard10/solr/mycore,shard11/solr/mycore,shard12/solr/mycore,shard13/solr/mycore

I get Internal Server Error on shard6. In the logs, I see the NPE from
org.apache.solr.servlet.SolrDispatchFilter.

If I change the facet.limit from 1 to 5000 keeping the
facet.offset=0,there are no exceptions. Now again if try facet.limit=5000
and facet.offset=5000 , I get the same exception. I tried facet.limit=4000
and facet.offset=5000, it worked fine. Please help



--
View this message in context:
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172.html
Sent from the Solr - User mailing list archive at Nabble.com. 



Re: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread coolpriya5
Number of values fun_group on shard 6 = 48000
Max length of fun_group is 20 chars

If I run the facet on just shard6 it doesn't error out no matter the
facet.limit. Also this query returns results only from shard 6 since the
my_id:4024 belongs to shard 6.




--
View this message in context: 
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172p4055185.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread Jack Krupansky
If the NPE was in SolrDispatchFilter, it could relate to some limit on the 
HTTP request or response size.


Again, we need the full stack trace, and the Solr release.

-- Jack Krupansky
-Original Message- 
From: coolpriya5

Sent: Wednesday, April 10, 2013 7:06 PM
To: solr-user@lucene.apache.org
Subject: Re: NPE when faceting TEXTfield in a distributed search query

Number of values fun_group on shard 6 = 48000
Max length of fun_group is 20 chars

If I run the facet on just shard6 it doesn't error out no matter the
facet.limit. Also this query returns results only from shard 6 since the
my_id:4024 belongs to shard 6.




--
View this message in context: 
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172p4055185.html
Sent from the Solr - User mailing list archive at Nabble.com. 



Re: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread coolpriya5
Solr Version is 3.4. As for stacktrace, I tried setting logger level to
FINEST on the solr admin logging page and it still doesn't print the
stacktrace. All I get are one liners:-

2013-04-10 17:09:59,889 [http--18]   ERROR [Marker: ]
org.apache.solr.core.SolrCore  :
java.lang.NullPointerException
2013-04-10 17:09:59,890 [http--18]   INFO  [Marker: ]
org.apache.solr.core.SolrCore  : [catalog] webapp=/solr
path=/select params={} status=500 QTime=1
2013-04-10 17:09:59,890 [http-xxx-18]   ERROR [Marker: ]
org.apache.solr.servlet.SolrDispatchFilter :
java.lang.NullPointerException



--
View this message in context: 
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172p4055189.html
Sent from the Solr - User mailing list archive at Nabble.com.


RE: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread Michael Ryan
Large facet.limit values cause a very large amount of form data to be sent to 
the shards, though I'm not sure why this would cause a NullPointerException. 
Perhaps the web server you are using is truncating the data instead of 
returning a form too large error, which is somehow causing an NPE. Are you 
using Jetty, Tomcat, or something else?

-Michael

-Original Message-
From: coolpriya5 [mailto:coolpri...@gmail.com] 
Sent: Wednesday, April 10, 2013 7:17 PM
To: solr-user@lucene.apache.org
Subject: Re: NPE when faceting TEXTfield in a distributed search query

Solr Version is 3.4. As for stacktrace, I tried setting logger level to FINEST 
on the solr admin logging page and it still doesn't print the stacktrace. All I 
get are one liners:-

2013-04-10 17:09:59,889 [http--18]   ERROR [Marker: ]
org.apache.solr.core.SolrCore  :
java.lang.NullPointerException
2013-04-10 17:09:59,890 [http--18]   INFO  [Marker: ]
org.apache.solr.core.SolrCore  : [catalog] webapp=/solr
path=/select params={} status=500 QTime=1
2013-04-10 17:09:59,890 [http-xxx-18]   ERROR [Marker: ]
org.apache.solr.servlet.SolrDispatchFilter :
java.lang.NullPointerException



--
View this message in context: 
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172p4055189.html
Sent from the Solr - User mailing list archive at Nabble.com.


RE: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread coolpriya5
I'm using tomcat. Also in such a case, why wouldn't the same error occur when
I run the same query on shard 6 alone? Is this a limitation of distributed
search?

Shard 6 is the only shard that has data for this query.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172p4055208.html
Sent from the Solr - User mailing list archive at Nabble.com.


RE: NPE when faceting TEXTfield in a distributed search query

2013-04-10 Thread Michael Ryan
Yes, this is a distributed search thing. In a distributed search, it will first 
make a somewhat normal facet request to all of the shards, get back the facet 
values, then make a second request in order to get the full counts of the facet 
values - this second request contains a list of facet terms that were not 
returned in the first response but were found on the other shards. Though, if 
only one shard even has this facet data, I would kind of expect you to not see 
this...

If Tomcat is truncating the request, the NPE could be due to 
https://issues.apache.org/jira/browse/SOLR-435.

Are you able to see the query in the shard 6 log for the working 
facet.limit=5000facet.offset=0 query?

-Michael

-Original Message-
From: coolpriya5 [mailto:coolpri...@gmail.com] 
Sent: Wednesday, April 10, 2013 9:16 PM
To: solr-user@lucene.apache.org
Subject: RE: NPE when faceting TEXTfield in a distributed search query

I'm using tomcat. Also in such a case, why wouldn't the same error occur when I 
run the same query on shard 6 alone? Is this a limitation of distributed search?

Shard 6 is the only shard that has data for this query.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/NPE-when-faceting-TEXTfield-in-a-distributed-search-query-tp4055172p4055208.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: NPE when faceting

2012-05-01 Thread Jamie Johnson
it may be related this this

http://stackoverflow.com/questions/10124055/solr-faceted-search-throws-nullpointerexception-with-http-500-status

we are doing deletes from our index as well so it is possible that
we're running into the same issue.  I hope that sheds more light on
things.

On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson jej2...@gmail.com wrote:
 I had reported this issue a while back, hoping that it was something
 with my environment, but that doesn't seem to be the case.  I am
 getting the following stack trace on certain facet queries.
 Previously when I did an optimize the error went away, does anyone
 have any insight into why specifically this could be happening?

 May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
 SEVERE: java.lang.NullPointerException
        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
        at 
 org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
        at 
 org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
        at 
 org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
        at 
 org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
        at 
 org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
        at 
 org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
        at 
 org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
        at 
 org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
        at 
 org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
        at 
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
        at 
 org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
        at 
 org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
        at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
        at 
 org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
        at 
 org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
        at 
 org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
        at 
 org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
        at 
 org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
        at 
 org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
        at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
        at 
 org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
        at 
 org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
        at 
 org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
        at org.eclipse.jetty.server.Server.handle(Server.java:351)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
        at 
 org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
        at 
 org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
        at 
 org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
        at 
 org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
        at 
 org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
        at 
 org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
        at java.lang.Thread.run(Thread.java:662)


Re: NPE when faceting

2012-05-01 Thread Yonik Seeley
Darn... looks likely that it's another bug from when part of
UnInvertedField was refactored into Lucene.
We really need some random tests that can catch bugs like these though
- I'll see if I can reproduce.

Can you open a JIRA issue for this?

-Yonik
lucenerevolution.com - Lucene/Solr Open Source Search Conference.
Boston May 7-10


On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson jej2...@gmail.com wrote:
 I had reported this issue a while back, hoping that it was something
 with my environment, but that doesn't seem to be the case.  I am
 getting the following stack trace on certain facet queries.
 Previously when I did an optimize the error went away, does anyone
 have any insight into why specifically this could be happening?

 May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
 SEVERE: java.lang.NullPointerException
        at org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
        at 
 org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
        at 
 org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
        at 
 org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
        at 
 org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
        at 
 org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
        at 
 org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
        at 
 org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
        at 
 org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
        at 
 org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
        at 
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
        at 
 org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
        at 
 org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
        at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
        at 
 org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
        at 
 org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
        at 
 org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
        at 
 org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
        at 
 org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
        at 
 org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
        at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
        at 
 org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
        at 
 org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
        at 
 org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
        at org.eclipse.jetty.server.Server.handle(Server.java:351)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
        at 
 org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
        at 
 org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
        at 
 org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
        at 
 org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
        at 
 org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
        at 
 org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
        at java.lang.Thread.run(Thread.java:662)


Re: NPE when faceting

2012-05-01 Thread Jamie Johnson
I don't have any more details than I provided here, but I created a
ticket with this information.  Thanks again

https://issues.apache.org/jira/browse/SOLR-3427

On Tue, May 1, 2012 at 5:20 PM, Yonik Seeley yo...@lucidimagination.com wrote:
 Darn... looks likely that it's another bug from when part of
 UnInvertedField was refactored into Lucene.
 We really need some random tests that can catch bugs like these though
 - I'll see if I can reproduce.

 Can you open a JIRA issue for this?

 -Yonik
 lucenerevolution.com - Lucene/Solr Open Source Search Conference.
 Boston May 7-10


 On Tue, May 1, 2012 at 4:51 PM, Jamie Johnson jej2...@gmail.com wrote:
 I had reported this issue a while back, hoping that it was something
 with my environment, but that doesn't seem to be the case.  I am
 getting the following stack trace on certain facet queries.
 Previously when I did an optimize the error went away, does anyone
 have any insight into why specifically this could be happening?

 May 1, 2012 8:48:52 PM org.apache.solr.common.SolrException log
 SEVERE: java.lang.NullPointerException
        at 
 org.apache.lucene.index.DocTermOrds.lookupTerm(DocTermOrds.java:807)
        at 
 org.apache.solr.request.UnInvertedField.getTermValue(UnInvertedField.java:636)
        at 
 org.apache.solr.request.UnInvertedField.getCounts(UnInvertedField.java:411)
        at 
 org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:300)
        at 
 org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:396)
        at 
 org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:205)
        at 
 org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:81)
        at 
 org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:204)
        at 
 org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1550)
        at 
 org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442)
        at 
 org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263)
        at 
 org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337)
        at 
 org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484)
        at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
        at 
 org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
        at 
 org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233)
        at 
 org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065)
        at 
 org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413)
        at 
 org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192)
        at 
 org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999)
        at 
 org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
        at 
 org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250)
        at 
 org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149)
        at 
 org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111)
        at org.eclipse.jetty.server.Server.handle(Server.java:351)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454)
        at 
 org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:900)
        at 
 org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:954)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:857)
        at 
 org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
        at 
 org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66)
        at 
 org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254)
        at 
 org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599)
        at 
 org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534)
        at java.lang.Thread.run(Thread.java:662)