Re: Cant retrieve data
What query are you doing? Try q=*:* Also, what does /solr/admin/stats.jsp report for number of docs? Upayavira On Mon, 28 Mar 2011 04:28 -0700, "Merlin Morgenstern" wrote: > Hi there, > > I am new to solr and have just installed it on a suse box with mysql > backend. > > Install and MySQL connector seem to be running. I can see the solr admin > interface. > Now I tried to index a table with about 0.5 Mio rows. That seemed to > work as well. However, I do get 0 results doing a querie on it. > Something seemes to be wrong. I also did a commit of the full import. > > Here is the response from import. > > > − > > 0 > 3 > > − > > − > > data-config.xml > > > full-import > idle > > − > > 1 > 404575 > 0 > 2011-03-28 12:47:36 > − > > Indexing completed. Added/Updated: 0 documents. Deleted 0 documents. > > 2011-03-28 12:47:42 > 2011-03-28 12:47:42 > 0 > 0:0:6.141 > > − > > This response format is experimental. It is likely to change in the > future. > > > > Data-config.xml looks like this: > > > driver="com.mysql.jdbc.Driver" >url="jdbc:mysql://192.168.0.109/test" >user="solr" >password="bOgKk0Kg"/> > > > > > > > > > > Thank you for any hint to get this running. > > -- > http://www.fastmail.fm - Email service worth paying for. Try it for free > --- Enterprise Search Consultant at Sourcesense UK, Making Sense of Open Source
Re: Cant retrieve data
I'm also new but I was able to get DIH working. >From your response your have: ... Indexing completed. Added/Updated: 0 documents. Deleted 0 documents. ... 0 I believe your fetch (db source and query) is correct based on the response but perhaps your mapping isn't. I would check required fields on your schema.xml and see if they are properly mapped. Also are you getting any exceptions? - Jeff On Mon, Mar 28, 2011 at 8:12 PM, Upayavira wrote: > What query are you doing? > > Try q=*:* > > Also, what does /solr/admin/stats.jsp report for number of docs? > > Upayavira > > On Mon, 28 Mar 2011 04:28 -0700, "Merlin Morgenstern" > wrote: > > Hi there, > > > > I am new to solr and have just installed it on a suse box with mysql > > backend. > > > > Install and MySQL connector seem to be running. I can see the solr admin > > interface. > > Now I tried to index a table with about 0.5 Mio rows. That seemed to > > work as well. However, I do get 0 results doing a querie on it. > > Something seemes to be wrong. I also did a commit of the full import. > > > > Here is the response from import. > > > > > > - > > > > 0 > > 3 > > > > - > > > > - > > > > data-config.xml > > > > > > full-import > > idle > > > > - > > > > 1 > > 404575 > > 0 > > 2011-03-28 12:47:36 > > - > > > > Indexing completed. Added/Updated: 0 documents. Deleted 0 documents. > > > > 2011-03-28 12:47:42 > > 2011-03-28 12:47:42 > > 0 > > 0:0:6.141 > > > > - > > > > This response format is experimental. It is likely to change in the > > future. > > > > > > > > Data-config.xml looks like this: > > > > > > >driver="com.mysql.jdbc.Driver" > >url="jdbc:mysql://192.168.0.109/test" > >user="solr" > >password="bOgKk0Kg"/> > > > > > > > > > > > > > > > > > > > > Thank you for any hint to get this running. > > > > -- > > http://www.fastmail.fm - Email service worth paying for. Try it for free > > > --- > Enterprise Search Consultant at Sourcesense UK, > Making Sense of Open Source > >
Re: Cant retrieve data
On Mon, Mar 28, 2011 at 4:58 PM, Merlin Morgenstern wrote: [...] You should probably hide passwords when posting to public lists. > > > > > [...] Your select does not seem to have the ID field. Regards, Gora
Re: Cant retrieve data
On Mon, 28 Mar 2011 13:12 +0100, "Upayavira" wrote:
> What query are you doing?
>
/solr/select/?q=welpe%0D%0A&version=2.2&start=0&rows=10&indent=on
> Try q=*:*
>
returns:
−
0
5
−
*:*
> Also, what does /solr/admin/stats.jsp report for number of docs?
That's a good question. Core states: 0, however rows fetched is about
400K?!
Isn't that the same? If no, what must I do to get the documents from the
rows?
Here are the stats:
Solr Statistics: (example)
snake.fritz.box
Category
[Core] [Cache] [Query] [Update] [Highlighting] [Other]
Current Time: Mon Mar 28 14:46:41 CEST 2011
Server Start Time: Mon Mar 28 12:47:27 CEST 2011
Core
name: core
class:
version:1.0
description:SolrCore
stats: coreName :
startTime : Mon Mar 28 12:47:27 CEST 2011
refCount : 2
aliases : []
name: searcher
class: org.apache.solr.search.SolrIndexSearcher
version:1.0
description:index searcher
stats: searcherName : Searcher@1cf662f main
caching : true
numDocs : 0
maxDoc : 0
reader :
SolrIndexReader{this=1d8f162,r=ReadOnlyDirectoryReader@1d8f162,refCnt=1,segments=0}
readerDir :
org.apache.lucene.store.NIOFSDirectory@/home/andy/sw/apache-solr-1.4.1/example/solr/data/index
indexVersion : 1301253679802
openedAt : Mon Mar 28 12:48:00 CEST 2011
registeredAt : Mon Mar 28 12:48:00 CEST 2011
warmupTime : 3
name: Searcher@1cf662f main
class: org.apache.solr.search.SolrIndexSearcher
version:1.0
description:index searcher
stats: searcherName : Searcher@1cf662f main
caching : true
numDocs : 0
maxDoc : 0
reader :
SolrIndexReader{this=1d8f162,r=ReadOnlyDirectoryReader@1d8f162,refCnt=1,segments=0}
readerDir :
org.apache.lucene.store.NIOFSDirectory@/home/andy/sw/apache-solr-1.4.1/example/solr/data/index
indexVersion : 1301253679802
openedAt : Mon Mar 28 12:48:00 CEST 2011
registeredAt : Mon Mar 28 12:48:00 CEST 2011
warmupTime : 3
Query Handlers
name: /admin/properties
class: org.apache.solr.handler.admin.PropertiesRequestHandler
version:$Revision: 790580 $
description:Get System Properties
stats: handlerStart : 1301309248506
requests : 0
errors : 0
timeouts : 0
totalTime : 0
avgTimePerRequest : NaN
avgRequestsPerSecond : 0.0
name: /update/csv
class: Lazy[solr.CSVRequestHandler]
version:$Revision: 817165 $
description:Lazy[solr.CSVRequestHandler]
stats: note : not initialized yet
name: /admin/file
class: org.apache.solr.handler.admin.ShowFileRequestHandler
version:$Revision: 790580 $
description:Admin Get File -- view config files directly
stats: handlerStart : 1301309248509
requests : 0
errors : 0
timeouts : 0
totalTime : 0
avgTimePerRequest : NaN
avgRequestsPerSecond : 0.0
name: org.apache.solr.handler.dataimport.DataImportHandler
class: org.apache.solr.handler.dataimport.DataImportHandler
version:1.0
description:Manage data import from databases to Solr
stats: Status : IDLE
Documents Processed : 0
Requests made to DataSource : 1
Rows Fetched : 404575
Documents Deleted : 0
Documents Skipped : 0
Total Documents Processed : 0
Total Requests made to DataSource : 2
Total Rows Fetched : 809150
Total Documents Deleted : 0
Total Documents Skipped : 0
handlerStart : 1301309248131
requests : 4
errors : 0
timeouts : 0
totalTime : 24
avgTimePerRequest : 6.0
avgRequestsPerSecond : 5.591581E-4
name: org.apache.solr.handler.DumpRequestHandler
class: org.apache.solr.handler.DumpRequestHandler
version:$Revision: 954340 $
description:Dump handler (debug)
stats: handlerStart : 1301309248115
requests : 0
errors : 0
timeouts : 0
totalTime : 0
avgTimePerRequest : NaN
avgRequestsPerSecond : 0.0
name: /admin/threads
class: org.apache.solr.handler.admin.ThreadDumpHandler
version:$Revision: 790580 $
description:Thread Dump
stats: handlerStart : 1301309248505
requests : 0
errors : 0
timeouts : 0
totalTime : 0
avgTimePerRequest : NaN
avgRequestsPerSecond : 0.0
name: tvrh
class: org.apache.solr.handler.component.SearchHandler
version:$Revision: 766412 $
description:Search using components:
org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.TermVectorComponent,org.apache.solr.handler.component.DebugComponent,
stats: handlerStart : 1301309247958
requests : 0
errors : 0
timeouts : 0
totalTime : 0
avgTimePerRequest : NaN
avgRequestsPerSecond : 0.0
name: /debug/dump
class: org.apache.solr.handler.DumpRequestHandler
version:$Revision: 954340 $
description:Dump handler (debug)
stats: handlerStart : 1301309248115
requests : 0
errors : 0
timeouts :
Re: Cant retrieve data
Your documents aren't getting in your index. Did you follow up on Gora's
comment that you weren't selecting an ID? IDs are NOT generated by Solr,
you need to supply them as part of your document.
Second, look in your Solr logs, or just look at the screen where you started
Solr when you index. I bet you'll see a bunch of errors. Like 400K of them
telling you that your document isn't correct, but that's only a guess.
Third, there is a little-known DIH debugging console,
...solr/admin/dataimport.jsp
that might help.
I'd guess, but it's only a guess since we haven't seen your schema
file, that you
used the example and left either required="true" for the "id" field and/or
defined a field and you aren't passing that through to
Solr...
Best
Erick
On Mon, Mar 28, 2011 at 8:52 AM, Walter Andreas Pucko
wrote:
>
>
> On Mon, 28 Mar 2011 13:12 +0100, "Upayavira" wrote:
>> What query are you doing?
>>
>
> /solr/select/?q=welpe%0D%0A&version=2.2&start=0&rows=10&indent=on
>
>> Try q=*:*
>>
>
> returns:
>
> -
>
> 0
> 5
> -
>
> *:*
>
>
>
>
>
>
>> Also, what does /solr/admin/stats.jsp report for number of docs?
>
> That's a good question. Core states: 0, however rows fetched is about
> 400K?!
> Isn't that the same? If no, what must I do to get the documents from the
> rows?
>
> Here are the stats:
>
> Solr Statistics: (example)
> snake.fritz.box
> Category
>[Core] [Cache] [Query] [Update] [Highlighting] [Other]
>Current Time: Mon Mar 28 14:46:41 CEST 2011
>Server Start Time: Mon Mar 28 12:47:27 CEST 2011
>
> Core
>
> name: core
> class:
> version:1.0
> description:SolrCore
> stats: coreName :
> startTime : Mon Mar 28 12:47:27 CEST 2011
> refCount : 2
> aliases : []
>
> name: searcher
> class: org.apache.solr.search.SolrIndexSearcher
> version:1.0
> description:index searcher
> stats: searcherName : Searcher@1cf662f main
> caching : true
> numDocs : 0
> maxDoc : 0
> reader :
> SolrIndexReader{this=1d8f162,r=ReadOnlyDirectoryReader@1d8f162,refCnt=1,segments=0}
> readerDir :
> org.apache.lucene.store.NIOFSDirectory@/home/andy/sw/apache-solr-1.4.1/example/solr/data/index
> indexVersion : 1301253679802
> openedAt : Mon Mar 28 12:48:00 CEST 2011
> registeredAt : Mon Mar 28 12:48:00 CEST 2011
> warmupTime : 3
>
> name: Searcher@1cf662f main
> class: org.apache.solr.search.SolrIndexSearcher
> version:1.0
> description:index searcher
> stats: searcherName : Searcher@1cf662f main
> caching : true
> numDocs : 0
> maxDoc : 0
> reader :
> SolrIndexReader{this=1d8f162,r=ReadOnlyDirectoryReader@1d8f162,refCnt=1,segments=0}
> readerDir :
> org.apache.lucene.store.NIOFSDirectory@/home/andy/sw/apache-solr-1.4.1/example/solr/data/index
> indexVersion : 1301253679802
> openedAt : Mon Mar 28 12:48:00 CEST 2011
> registeredAt : Mon Mar 28 12:48:00 CEST 2011
> warmupTime : 3
>
>
> Query Handlers
>
> name: /admin/properties
> class: org.apache.solr.handler.admin.PropertiesRequestHandler
> version:$Revision: 790580 $
> description:Get System Properties
> stats: handlerStart : 1301309248506
> requests : 0
> errors : 0
> timeouts : 0
> totalTime : 0
> avgTimePerRequest : NaN
> avgRequestsPerSecond : 0.0
>
> name: /update/csv
> class: Lazy[solr.CSVRequestHandler]
> version:$Revision: 817165 $
> description:Lazy[solr.CSVRequestHandler]
> stats: note : not initialized yet
>
> name: /admin/file
> class: org.apache.solr.handler.admin.ShowFileRequestHandler
> version:$Revision: 790580 $
> description:Admin Get File -- view config files directly
> stats: handlerStart : 1301309248509
> requests : 0
> errors : 0
> timeouts : 0
> totalTime : 0
> avgTimePerRequest : NaN
> avgRequestsPerSecond : 0.0
>
> name: org.apache.solr.handler.dataimport.DataImportHandler
> class: org.apache.solr.handler.dataimport.DataImportHandler
> version:1.0
> description:Manage data import from databases to Solr
> stats: Status : IDLE
> Documents Processed : 0
> Requests made to DataSource : 1
> Rows Fetched : 404575
> Documents Deleted : 0
> Documents Skipped : 0
> Total Documents Processed : 0
> Total Requests made to DataSource : 2
> Total Rows Fetched : 809150
> Total Documents Deleted : 0
> Total Documents Skipped : 0
> handlerStart : 1301309248131
> requests : 4
> errors : 0
> timeouts : 0
> totalTime : 24
> avgTimePerRequest : 6.0
> avgRequestsPerSecond : 5.591581E-4
>
> name: org.apache.solr.handler.DumpRequestHandler
> class: org.apache.solr.handler.DumpRequestHandler
> version:$Revision: 954340 $
> description:Dump handler (debug)
> stats: handlerStart : 1301309248115
> requests : 0
> errors : 0
> timeouts : 0
> totalTime : 0
> avgTimePerRequest : NaN
> avgRequestsPerSecond : 0.0
>
> name: /admin/threads
> class: org.apache.solr.handler.admin.ThreadDumpHandler
> version:$Revision: 790580 $
> description:Thread Dump
> stats: handlerStart : 1301309248505
> requests : 0
> errors : 0
> timeouts : 0
