Re: Result docs missing only when shards parameter present in query?
A multiValued uniqueKey really doesn't make any sense. But your
log file should have something in it like this:
SEVERE: uniqueKey should not be multivalued
although it _is_ a bit hard to see on startup unless you've suppressed
the INFO level output.
See: https://issues.apache.org/jira/browse/SOLR-1570
Best
Erick
On Tue, Jul 17, 2012 at 9:24 AM, Bill Havanki havank...@gmail.com wrote:
I had the same problem as the original poster did two years ago (!), but
with Solr 3.4.0:
I cannot get hits back and do not get a correct total number of records
when using shard searching.
When performing a sharded query, I would get empty / missing results - no
documents at all. Querying each shard individually worked, but anything
with the shards parameter yielded no result documents.
I was able to get results back by updating my schema to include
multiValued=false for the unique key field.
The problem I was seeing was that, when Solr was formulating the queries to
go get records from each shard, it was including square brackets around the
ids it was asking for, e.g.:
...q=123ids=[ID1],[ID2],[ID3]...
I delved into the Solr code and saw that this query string was being formed
(in QueryComponent.createRetrieveDocs()) by simply calling toString() on
the unique key field value for each document it wanted to get. My guess is
that the value objects somehow were ArrayLists (or something like that) and
not Strings, so those annoying square brackets showed up via toString(). By
emphasizing in the schema that the field was single-valued, those lists
would hopefully stop appearing, and I think they did. At least the brackets
went away.
Here's the relevant QueryComponent code (again, 3.4.0 - it's the same in
3.6.0, didn't check 4):
ArrayListString ids = new ArrayListString(shardDocs.size());
for (ShardDoc shardDoc : shardDocs) {
// TODO: depending on the type, we may need more tha a simple toString()?
ids.add(shardDoc.id.toString());
}
sreq.params.add(ShardParams.IDS, StrUtils.join(ids, ','));
The comment in there seems to fit my theory. :)
Bill
Result docs missing only when shards parameter present in query?
I had the same problem as the original poster did two years ago (!), but
with Solr 3.4.0:
I cannot get hits back and do not get a correct total number of records
when using shard searching.
When performing a sharded query, I would get empty / missing results - no
documents at all. Querying each shard individually worked, but anything
with the shards parameter yielded no result documents.
I was able to get results back by updating my schema to include
multiValued=false for the unique key field.
The problem I was seeing was that, when Solr was formulating the queries to
go get records from each shard, it was including square brackets around the
ids it was asking for, e.g.:
...q=123ids=[ID1],[ID2],[ID3]...
I delved into the Solr code and saw that this query string was being formed
(in QueryComponent.createRetrieveDocs()) by simply calling toString() on
the unique key field value for each document it wanted to get. My guess is
that the value objects somehow were ArrayLists (or something like that) and
not Strings, so those annoying square brackets showed up via toString(). By
emphasizing in the schema that the field was single-valued, those lists
would hopefully stop appearing, and I think they did. At least the brackets
went away.
Here's the relevant QueryComponent code (again, 3.4.0 - it's the same in
3.6.0, didn't check 4):
ArrayListString ids = new ArrayListString(shardDocs.size());
for (ShardDoc shardDoc : shardDocs) {
// TODO: depending on the type, we may need more tha a simple toString()?
ids.add(shardDoc.id.toString());
}
sreq.params.add(ShardParams.IDS, StrUtils.join(ids, ','));
The comment in there seems to fit my theory. :)
Bill
Re: Result docs missing only when shards parameter present in query?
Does this seem like it would be a configuration issue, an indexed data issue, or something else? Thanks mrw wrote: We have two Solr nodes, each with multiple shards. If we query each shard directly (no shards parameter), we get the expected results: response lst name=responseHeader int name=status 0 int name=QTime 22 result name=response numFound=100 start=0 doc doc (^^^ hand-typed pseudo XML) However, if we add the shards parameter and even supply one of the above shards, we get the same number of results, but all the doc elements under the result element are missing: response lst name=responseHeader int name=status 0 int name=QTime 33 result name=response numFound=100 start=0 (^^^ note missing doc elements) It doesn't matter which shard is specified in the shards parameter; if any or all of the shards are specified after the shards parameter, we see this behavior. When we go to http://server:8983/solr/ on either node, we see all the shards properly listed. So, the shards seem to be registered properly, and work individually, but not when the shards parameter is supplied. Any ideas? Thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Result-docs-missing-only-when-shards-parameter-present-in-query-tp2928889p2932248.html Sent from the Solr - User mailing list archive at Nabble.com.
Result docs missing only when shards parameter present in query?
We have two Solr nodes, each with multiple shards. If we query each shard directly (no shards parameter), we get the expected results: response lst name=responseHeader int name=status 0 int name=QTime 22 result name=response numFound=100 start=0 doc doc (^^^ hand-typed pseudo XML) However, if we add the shards parameter and even supply one of the above shards, we get the same number of results, but all the doc elements under the result element are missing: response lst name=responseHeader int name=status 0 int name=QTime 33 result name=response numFound=100 start=0 (^^^ note missing doc elements) It doesn't matter which shard is specified in the shards parameter; if any or all of the shards are specified after the shards parameter, we see this behavior. When we go to http://server:8983/solr/ on either node, we see all the shards properly listed. So, the shards seem to be registered properly, and work individually, but not when the shards parameter is supplied. Any ideas? Thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Result-docs-missing-only-when-shards-parameter-present-in-query-tp2928889p2928889.html Sent from the Solr - User mailing list archive at Nabble.com.
