Solr numFound 0 but doc list empty in Solr Cloud setup
I am using below tutorial for Solr Cloud setup with 2 shards
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I am able to get the default set up working. However, I have a requirement
where my index is not in default location (data/index) and hence when I start
jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when I
query I get results with numFound 0 but doc list is always empty.
I verified that my index does have fields stored and indexed. Anyone else faced
similar issue or have an idea on what I am missing ? Verified that by loading
single core.
Appreciate any help.
request:
http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
response:
{ responseHeader: { status: 0, QTime: 18, params: { shards:
http://localhost:/solr/collection1;, indent: true, q: body:\to\,
_: 1421390858638, wt: json } }, response: { numFound: 2564,
start: 0, maxScore: 0.4523638, docs: [] } }
Re: Solr numFound 0 but doc list empty in Solr Cloud setup
Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true stored=true
multiValued=true /
--
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true
{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}
On Friday, January 16, 2015 9:56 AM, Erick Erickson erickerick...@gmail.com
wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?
Best,
Erick
On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
I am using below tutorial for Solr Cloud setup with 2 shards
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I am able to get the default set up working. However, I have a requirement
where my index is not in default location (data/index) and hence when I start
jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when
I query I get results with numFound 0 but doc list is always empty.
I verified that my index does have fields stored and indexed. Anyone else
faced similar issue or have an idea on what I am missing ? Verified that by
loading single core.
Appreciate any help.
request:
http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
response:
{ responseHeader: { status: 0, QTime: 18, params: { shards:
http://localhost:/solr/collection1;, indent: true, q:
body:\to\, _: 1421390858638, wt: json } }, response: {
numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }
Re: Solr numFound 0 but doc list empty in Solr Cloud setup
As I said earlier - single core set up works fine with same solrconfig.xml and
schema.xml
cd example
java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar
I am running Solr-4.10. Do I need to change any other configuration for running
in solr cloud mode ?
On Friday, January 16, 2015 11:56 AM, Jaikit Savla
jaikit.sa...@yahoo.com.INVALID wrote:
Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true stored=true
multiValued=true /
--
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true
{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}
On Friday, January 16, 2015 9:56 AM, Erick Erickson erickerick...@gmail.com
wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?
Best,
Erick
On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
I am using below tutorial for Solr Cloud setup with 2 shards
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I am able to get the default set up working. However, I have a requirement
where my index is not in default location (data/index) and hence when I start
jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when
I query I get results with numFound 0 but doc list is always empty.
I verified that my index does have fields stored and indexed. Anyone else
faced similar issue or have an idea on what I am missing ? Verified that by
loading single core.
Appreciate any help.
request:
http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
response:
{ responseHeader: { status: 0, QTime: 18, params: { shards:
http://localhost:/solr/collection1;, indent: true, q:
body:\to\, _: 1421390858638, wt: json } }, response: {
numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }
Re: Solr numFound 0 but doc list empty in Solr Cloud setup
One more point:
In cloud mode: If I submit a request with fl=id, it returns doc list. But when
I add any other field, I get an empty doc list.
http://localhost:/solr/select?q=domain:ebaywt=jsonshards=http://localhost:/solr/fl=idrows=1
{
responseHeader: {
status: 0,
QTime: 7,
params: {
fl: id,
shards: http://localhost:/solr/;,
q: domain:ebay,
wt: json,
rows: 1
}
},
response: {
numFound: 17,
start: 0,
maxScore: 3.8559604,
docs: [
{
id: d8406557-6cd8-46d9-9a5e-29844387afc4
}
]
}
}
Note: all of above works in single core mode.
On Friday, January 16, 2015 12:13 PM, Jaikit Savla
jaikit.sa...@yahoo.com.INVALID wrote:
As I said earlier - single core set up works fine with same solrconfig.xml and
schema.xml
cd example
java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar
I am running Solr-4.10. Do I need to change any other configuration for running
in solr cloud mode ?
On Friday, January 16, 2015 11:56 AM, Jaikit Savla
jaikit.sa...@yahoo.com.INVALID wrote:
Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true stored=true
multiValued=true /
--
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true
{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}
On Friday, January 16, 2015 9:56 AM, Erick Erickson erickerick...@gmail.com
wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?
Best,
Erick
On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
I am using below tutorial for Solr Cloud setup with 2 shards
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I am able to get the default set up working. However, I have a requirement
where my index is not in default location (data/index) and hence when I start
jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when
I query I get results with numFound 0 but doc list is always empty.
I verified that my index does have fields stored and indexed. Anyone else
faced similar issue or have an idea on what I am missing ? Verified that by
loading single core.
Appreciate any help.
request:
http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
response:
{ responseHeader: { status: 0, QTime: 18, params: { shards:
http://localhost:/solr/collection1;, indent: true, q:
body:\to\, _: 1421390858638, wt: json } }, response: {
numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }
Re: Solr numFound 0 but doc list empty in Solr Cloud setup
I followed all the steps listed here:
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I have not updated solrconfig.xml and it is same as what comes default with
4.10.
The only thing I added extra was list of my fields in
example/solr/collection1/conf/schema.xml
@shards: If I query with out that param, it returns below error:
http://localhost:/solr/collection1/select?q=*:*
response
lst name=responseHeader
int name=status503/int
int name=QTime3/int
lst name=params
str name=q*:*/str
/lst
/lst
lst name=error
str name=msgno servers hosting shard:/str
int name=code503/int
/lst
/response
On Friday, January 16, 2015 12:37 PM, Anshum Gupta ans...@anshumgupta.net
wrote:
Looks like a config issue to me more than anything else.
Can you share your solrconfig? You will not be able to attach a file here
but you could share it via pastebin or something similar.
Also, why are you adding the shards=http://localhost:8983/solr/collection1;
part to your request? You don't need to do that in most cases.
On Fri, Jan 16, 2015 at 12:20 PM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
One more point:
In cloud mode: If I submit a request with fl=id, it returns doc list. But
when I add any other field, I get an empty doc list.
http://localhost:/solr/select?q=domain:ebaywt=jsonshards=http://localhost:/solr/fl=idrows=1
{
responseHeader: {
status: 0,
QTime: 7,
params: {
fl: id,
shards: http://localhost:/solr/;,
q: domain:ebay,
wt: json,
rows: 1
}
},
response: {
numFound: 17,
start: 0,
maxScore: 3.8559604,
docs: [
{
id: d8406557-6cd8-46d9-9a5e-29844387afc4
}
]
}
}
Note: all of above works in single core mode.
On Friday, January 16, 2015 12:13 PM, Jaikit Savla
jaikit.sa...@yahoo.com.INVALID wrote:
As I said earlier - single core set up works fine with same solrconfig.xml
and schema.xml
cd example
java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar
I am running Solr-4.10. Do I need to change any other configuration for
running in solr cloud mode ?
On Friday, January 16, 2015 11:56 AM, Jaikit Savla
jaikit.sa...@yahoo.com.INVALID wrote:
Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true stored=true
multiValued=true /
--
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true
{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}
On Friday, January 16, 2015 9:56 AM, Erick Erickson
erickerick...@gmail.com wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?
Best,
Erick
On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
I am using below tutorial for Solr Cloud setup with 2 shards
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I am able to get the default set up working. However, I have a
requirement where my index is not in default location (data/index) and
hence when I start jvm for each shard I run with -Dsolr.data.dir=custom
index path . Now when I query I get results with numFound 0 but doc list
is always empty.
I verified that my index does have fields stored and indexed. Anyone
else faced similar issue or have an idea on what I am missing ? Verified
that by loading single core.
Appreciate any help.
request:
http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
response:
{ responseHeader: { status: 0, QTime: 18, params: { shards:
http://localhost:/solr/collection1;, indent: true, q:
body:\to\, _: 1421390858638, wt: json } }, response: {
numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }
--
Anshum Gupta
http://about.me/anshumgupta
Re: Solr numFound 0 but doc list empty in Solr Cloud setup
Anshuman,
You are right about @shards param not required. One of my shard was down and
hence when I added
shards.tolerant=true, it worked without shards param. However document list is
still empty.
content of solrconfig.xml
http://pastebin.com/CJxD22t1
On Friday, January 16, 2015 1:24 PM, Jaikit Savla jaikit.sa...@yahoo.com
wrote:
I followed all the steps listed here:
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I have not updated solrconfig.xml and it is same as what comes default with
4.10.
The only thing I added extra was list of my fields in
example/solr/collection1/conf/schema.xml
@shards: If I query with out that param, it returns below error:
http://localhost:/solr/collection1/select?q=*:*
response
lst name=responseHeader
int name=status503/int
int name=QTime3/int
lst name=params
str name=q*:*/str
/lst
/lst
lst name=error
str name=msgno servers hosting shard:/str
int name=code503/int
/lst
/response
On Friday, January 16, 2015 12:37 PM, Anshum Gupta ans...@anshumgupta.net
wrote:
Looks like a config issue to me more than anything else.
Can you share your solrconfig? You will not be able to attach a file here
but you could share it via pastebin or something similar.
Also, why are you adding the shards=http://localhost:8983/solr/collection1;
part to your request? You don't need to do that in most cases.
On Fri, Jan 16, 2015 at 12:20 PM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
One more point:
In cloud mode: If I submit a request with fl=id, it returns doc list. But
when I add any other field, I get an empty doc list.
http://localhost:/solr/select?q=domain:ebaywt=jsonshards=http://localhost:/solr/fl=idrows=1
{
responseHeader: {
status: 0,
QTime: 7,
params: {
fl: id,
shards: http://localhost:/solr/;,
q: domain:ebay,
wt: json,
rows: 1
}
},
response: {
numFound: 17,
start: 0,
maxScore: 3.8559604,
docs: [
{
id: d8406557-6cd8-46d9-9a5e-29844387afc4
}
]
}
}
Note: all of above works in single core mode.
On Friday, January 16, 2015 12:13 PM, Jaikit Savla
jaikit.sa...@yahoo.com.INVALID wrote:
As I said earlier - single core set up works fine with same solrconfig.xml
and schema.xml
cd example
java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar
I am running Solr-4.10. Do I need to change any other configuration for
running in solr cloud mode ?
On Friday, January 16, 2015 11:56 AM, Jaikit Savla
jaikit.sa...@yahoo.com.INVALID wrote:
Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true stored=true
multiValued=true /
--
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true
{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}
On Friday, January 16, 2015 9:56 AM, Erick Erickson
erickerick...@gmail.com wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?
Best,
Erick
On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
I am using below tutorial for Solr Cloud setup with 2 shards
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
I am able to get the default set up working. However, I have a
requirement where my index is not in default location (data/index) and
hence when I start jvm for each shard I run with -Dsolr.data.dir=custom
index path . Now when I query I get results with numFound 0 but doc list
is always empty.
I verified that my index does have fields stored and indexed. Anyone
else faced similar issue or have an idea on what I am missing ? Verified
that by loading single core.
Appreciate any help.
request:
http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
response:
{ responseHeader: { status: 0, QTime: 18, params: { shards:
http://localhost:/solr/collection1;, indent: true, q:
body:\to\, _: 1421390858638, wt: json } }, response: {
numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }
--
Anshum Gupta
http://about.me/anshumgupta
Re: Load existing Lucene sharded indexes onto single Solr collection
Yes, I wanted to get rid of merge step. But looks like merge is not that cumbersome either. Thanks Mikhail and Erick for pointers, that helped. Jaikit On Wednesday, January 14, 2015 8:24 AM, Erick Erickson erickerick...@gmail.com wrote: You certainly can't do this into a single directory, there would be zillions of name conflicts. I believe I saw Uwe make a comment on the Lucene list about using MultiReaders and keeping the sub-indexes in different directories, but that's lower-level than Solr has access to Plus, you'd have to control index updates _very_ carefully. So I don't think there's something built into Solr to work with indexes like this, so merge is probably your only option here. Do note that the contrib MapReduceIndexerTool that will do most all of this for you, it includes a --go-live option. That option still copies things around though. Best, Erick On Wed, Jan 14, 2015 at 1:25 AM, Jaikit Savla jaikit.sa...@yahoo.com.invalid wrote: This solution will merge the index as well. I want to find out if merge is required before loading indexes onto Solr ? If that is possible than I can just point solrconfig.xml to directory where I have all the shards. Jaikit On Wednesday, January 14, 2015 1:11 AM, Mikhail Khludnev mkhlud...@griddynamics.com wrote: On Wed, Jan 14, 2015 at 11:42 AM, Jaikit Savla jaikit.sa...@yahoo.com.invalid wrote: Now to load this index, I am currently using Lucene IndexMergeTool to merge all the shards into one giant index. My question is, is there a way to load shared index without merging into one giant index on to single collection ? https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-MERGEINDEXES ? -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics
Distributed Search returns Empty document list
Hello,
I am running Solr (4.10) in cloud mode by configuring multiple collections (1
for each day). Structure is as shown below. I can fetch documents for given
query, if I query individual collection. However when I send distributed
request to multiple shards, I only see numFound and no documents returned.
Appreciate any pointers on setup.
--- directory structure:solrcollection1 //(does
not have any index)collection_20150112collection_20150113
Command to run Solr:sh bin/solr restart -d example -cloud -p -noprompt
Set up RequestHandler called alias in solrconfig.xml of collecton1
requestHandler name=/alias class=solr.StandardRequestHandler
default=true
lst name=defaults
str name=echoParamsexplicit/str
str name=wtjson/str
str name=indenttrue/str
str name=dftext/str
str name=flscore,*/str
str
name=shardshttp://localhost:/solr/collection_20150113,http://localhost:/solr/collection_20150112/str
/lst
http://localhost:/solr/collection1/alias?q=domain:comdebug=falseshard.info=true
e.g{
- responseHeader: {
- status: 0,
- QTime: 19,
- params: {
- q: domain:com,
- debug: false,
- shard.info: true
}
},
- response: {
- numFound: 11696,
- start: 0,
- maxScore: 1.3015664,
- docs: [ ]
}
}
Thanks
Re: Distributed search across Solr cores in a collection - NPE
It was because I did not have unique id's in my index. I added that and it
worked. Also it is mentioned as one of the requirement for Distributed Search.
Thanks,Jaikit
On Wednesday, January 14, 2015 1:53 AM, Jaikit Savla
jaikit.sa...@yahoo.com wrote:
Folks,
I have set up 3 cores in a single collection and they all have same schema but
different index. I have set unique Id required field to false.field name=id
type=string indexed=true stored=true required=false/
When I run query against single core, it works fine. But when I add the shard
param and point to different core than request fails with NPE. I looked up on
the source code for QueryComponent and line 1043
isresultIds.put(shardDoc.id.toString(), shardDoc);
looks like the the shardDoc id.toString() is throwing
NPE.http://grepcode.com/file/repo1.maven.org/maven2/org.apache.solr/solr-core/4.10.1/org/apache/solr/handler/component/QueryComponent.java#QueryComponent.mergeIds%28org.apache.solr.handler.component.ResponseBuilder%2Corg.apache.solr.handler.component.ShardRequest%29
Any clue on if my set up is incorrect ?
http://localhost:/solr/core0/select?shards=localhost:/solr/core1q=title:amazonfl=*rows=10wt=json
RESPONSE:
{responseHeader:{status:500,QTime:11,params:{fl:*,shards:localhost:/solr/core1,q:domain:amazon,wt:json,rows:10}},error:{trace:java.lang.NullPointerException\n\tat
org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:1043)\n\tat
org.apache.solr.handler.component.QueryComponent.handleRegularResponses(QueryComponent.java:716)\n\tat
org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:695)\n\tat
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:324)\n\tat
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)\n\tat
org.apache.solr.core.SolrCore.execute(SolrCore.java:1967)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)\n\tat
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)\n\tat
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)\n\tat
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)\n\tat
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)\n\tat
org.eclipse.jetty.server.Server.handle(Server.java:368)\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)\n\tat
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)\n\tat
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)\n\tat
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)\n\tat
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)\n\tat
java.lang.Thread.run(Thread.java:745)\n,code:500}}
Appreciate any pointers.
Thanks,Jaikit
Load existing Lucene sharded indexes onto single Solr collection
Folks, I have generated multiple (count of 100) sharded Lucene indexes on Hadoop and they are of format. The total indexed data (sum of all the index-*) is of size 500GB and hence the number of shards.drwxr-x--- 2 index-66drwxr-x--- 2 index-68drwxr-x--- 2 index-9 and each index directory is of formatls index-9_4.fdt _4.fdx _4.fnm _4_Lucene40_0.frq _4_Lucene40_0.prx _4_Lucene40_0.tim _4_Lucene40_0.tip _4_nrm.cfe _4_nrm.cfs _4.si segments_1 segments.gen write.lock Now to load this index, I am currently using Lucene IndexMergeTool to merge all the shards into one giant index. My question is, is there a way to load shared index without merging into one giant index on to single collection ? Thanks,Jaikit
Re: Load existing Lucene sharded indexes onto single Solr collection
This solution will merge the index as well. I want to find out if merge is required before loading indexes onto Solr ? If that is possible than I can just point solrconfig.xml to directory where I have all the shards. Jaikit On Wednesday, January 14, 2015 1:11 AM, Mikhail Khludnev mkhlud...@griddynamics.com wrote: On Wed, Jan 14, 2015 at 11:42 AM, Jaikit Savla jaikit.sa...@yahoo.com.invalid wrote: Now to load this index, I am currently using Lucene IndexMergeTool to merge all the shards into one giant index. My question is, is there a way to load shared index without merging into one giant index on to single collection ? https://cwiki.apache.org/confluence/display/solr/CoreAdmin+API#CoreAdminAPI-MERGEINDEXES ? -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics
Distributed search across Solr cores in a collection - NPE
Folks,
I have set up 3 cores in a single collection and they all have same schema but
different index. I have set unique Id required field to false.field name=id
type=string indexed=true stored=true required=false/
When I run query against single core, it works fine. But when I add the shard
param and point to different core than request fails with NPE. I looked up on
the source code for QueryComponent and line 1043
isresultIds.put(shardDoc.id.toString(), shardDoc);
looks like the the shardDoc id.toString() is throwing
NPE.http://grepcode.com/file/repo1.maven.org/maven2/org.apache.solr/solr-core/4.10.1/org/apache/solr/handler/component/QueryComponent.java#QueryComponent.mergeIds%28org.apache.solr.handler.component.ResponseBuilder%2Corg.apache.solr.handler.component.ShardRequest%29
Any clue on if my set up is incorrect ?
http://localhost:/solr/core0/select?shards=localhost:/solr/core1q=title:amazonfl=*rows=10wt=json
RESPONSE:
{responseHeader:{status:500,QTime:11,params:{fl:*,shards:localhost:/solr/core1,q:domain:amazon,wt:json,rows:10}},error:{trace:java.lang.NullPointerException\n\tat
org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:1043)\n\tat
org.apache.solr.handler.component.QueryComponent.handleRegularResponses(QueryComponent.java:716)\n\tat
org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:695)\n\tat
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:324)\n\tat
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)\n\tat
org.apache.solr.core.SolrCore.execute(SolrCore.java:1967)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)\n\tat
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)\n\tat
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)\n\tat
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)\n\tat
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)\n\tat
org.eclipse.jetty.server.Server.handle(Server.java:368)\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)\n\tat
org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)\n\tat
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)\n\tat
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)\n\tat
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)\n\tat
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)\n\tat
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)\n\tat
java.lang.Thread.run(Thread.java:745)\n,code:500}}
Appreciate any pointers.
Thanks,Jaikit
