Re: Solr 7* Sorry, no dataimport-handler defined
On 11/7/2017 6:49 AM, richardg wrote:
> vs on the master that shows the error.
>
> 2017-11-07 13:29:14.131 INFO (qtp1839206329-36) [
> x:solr_aggregate_production] o.a.s.c.S.Request [solr_aggregate_production]
> webapp=/solr path=/admin/mbeans
> params={cat=QUERYHANDLER&wt=json&_=1510061366718} status=0 QTime=2
The string "QUERYHANDLER" (all uppercase) only shows up in a 7.1.0
source code checkout in the reference guide, it is not in any code that
builds the program. Its presence in the reference guide is likely a
documentation error.
If you are seeing QUERYHANDLER in a log for version 7.1.0, then I have
to wonder exactly how you did the upgrade -- because I think there are
only two ways that could happen: 1) Your 7.1.0 install includes at
least some files from a version before 6.4.1. 2) You've got something
(perhaps a load balancer) mixing up requests between two different
versions of Solr.
Thanks,
Shawn
Re: Solr 7* Sorry, no dataimport-handler defined
Yes I am referring to the dataimport tab in the admin UI and issue
SOLR-10035. My previous setup w/ 6.3 did not show this error. I then
upgraded to 7.1.0 and the error shows. I upgraded(downgraded) to versions
6.5.0 and 6.6.2 and I do not see the error. Version 7.0.1 also shows the
error for me. I am currently using version 6.6.2 and have been successfully
able to run a data import from the admin UI.
In my config directory we have
solcore.properties
solrconfig.xml which defines the dataimport handler (data-config.xml)
schema.xml
dataimport.properties
data-config.xml
some admin-extra*.html files
We copy all the config files over to the slave instances and they do no show
this behavior on 7.1.0, dataimport tab loads fine. The only thing I notice
is on the slaves I see entries like this in the log:
2017-11-07 13:36:11.200 INFO (qtp2053591126-35) [
x:solr_aggregate_production] o.a.s.c.S.Request [solr_aggregate_production]
webapp=/solr path=/admin/mbeans params={cat=QUERY&wt=json&_=1510061783971}
status=0 QTime=0
vs on the master that shows the error.
2017-11-07 13:29:14.131 INFO (qtp1839206329-36) [
x:solr_aggregate_production] o.a.s.c.S.Request [solr_aggregate_production]
webapp=/solr path=/admin/mbeans
params={cat=QUERYHANDLER&wt=json&_=1510061366718} status=0 QTime=2
I see just "QUERY" in the slave that is working and "QUERYHANDLER" in the
master that isn't. This is why I referenced the issue w/ 6.4 (SOLR-10035).
Other than that I do not see anything in the log showing and error for the
dataimport handler.
Thanks
--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
Re: Solr 7* Sorry, no dataimport-handler defined
On 11/6/2017 4:26 PM, Shawn Heisey wrote: > If I start Solr "normally" or with the cloud example, then the > dataimport tab shows that error -- which is exactly as expected. I have opened an improvement issue so that particular error message isn't as vague. It's been labeled with "newdev" because it's an easy change. https://issues.apache.org/jira/browse/SOLR-11613 Thanks, Shawn
Re: Solr 7* Sorry, no dataimport-handler defined
On 11/6/2017 1:47 PM, richardg wrote: > I see where this was an issue w/ 6.4 and fixed. I keep getting this error w/ > 7.0.1 and 7.1.0. Works fine up until 6.6.2. Could this issue have been > reintroduced? Is there somewhere to check what might be going on? I don't > see anything in the error logs. You've included almost no information here. I assume that the subject is the error? If so, where do you see it? Please be aware that without information, we can't help. https://wiki.apache.org/solr/UsingMailingLists My best guess is that you see that error in the admin UI when you click on dataimport. The error is pretty self-explanitory -- Solr couldn't find any defined dataimport handlers. At least one such handler must be set up in the config before you can use the dataimport tab. You mention that this was an issue with 6.4 and fixed ... but didn't include a link to the issue. Are you talking about SOLR-10035? https://issues.apache.org/jira/browse/SOLR-10035 If I start a fresh Solr 7.1.0 download with the DIH example (bin/solr start -e dih), clicking on the dataimport tab works on all five cores. If I start Solr "normally" or with the cloud example, then the dataimport tab shows that error -- which is exactly as expected. The example configsets in the base Solr download do not have a dataimport handler. Only the configs specifically in the DIH example have such handlers defined. Have you created a core with a dataimport handler that you KNOW is working, and seeing that error? If so, we'll need more detailed information. Solr version, everything in the core's conf directory, details about the error and steps taken to see it, etc. Any error messages in your logfile would be helpful as well. Thanks, Shawn
Solr 7* Sorry, no dataimport-handler defined
I see where this was an issue w/ 6.4 and fixed. I keep getting this error w/ 7.0.1 and 7.1.0. Works fine up until 6.6.2. Could this issue have been reintroduced? Is there somewhere to check what might be going on? I don't see anything in the error logs. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
Re: trying DIH but get 'Sorry, no dataimport-handler defined!'
I happen to find the problem. The problem seems to come from the html file that shows DIH function page. I use Maxthon browser, it has a function that can switch between IE mode and non-IE mode (actually the Webkit engine). I happen to switch back to non-IE mode and the error message is gone and everything is ok now! TOO WEIRD! scott.chu，scott@udngroup.com 2016/5/24 (週二) - Original Message - From: kostali hassan To: solr-user ; scott(自己) CC: Date: 2016/5/24 (週二) 16:55 Subject: Re: trying DIH but get 'Sorry, no dataimport-handler defined!' if you have in this path server/solr/configsets/testdih/conf you shoud right this in your line commande: 'bin\solr>solr create -c your_core -d testdih -p 8983 to create a core with an exemple config testdih. 2016-05-24 9:35 GMT+01:00 scott.chu : > > I do following things: > > * I create folder : D:\solr-6.0.0\myconfigsets\testdih. > * Copy D:\portable_sw\solr-6.0.0\example\example-DIH\solr\db\conf to > D:\solr-6.0.0\myconfigsets\testdih. > * Go into D:\solr-6.0.0\myconfigsets\testdih\conf and edit > db-data-config.xml as follows (I am pretty sure mysql environment is ok): > > > url="jdbc:mysql://localhost:3306/test" user="hello" password="hellothere" /> > > > > > > > > > > > * Then I copy mysql-connector-java-5.0.8-bin.jar to > D:\portable_sw\solr-6.0.0\server\solr-webapp\webapp\WEB-INF\lib. > * I check solrconfig.xml and see these relevant lines: > > regex="solr-dataimporthandler-.*\.jar" /> > ... > ... > > > db-data-config.xml > > > > * cd to D:solr-6.0.0, issue 'bin\solr start', it starts ok. > * Issue 'bin\solr create_core -c testdih -d myconfigsets\testdih\conf' to > create a core. It's ok, too. > > * The solr.log has these log messages: > > 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] > o.a.s.c.SolrResourceLoader Adding > 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-6.0.0.jar' to > classloader > 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] > o.a.s.c.SolrResourceLoader Adding > 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-extras-6.0.0.jar' > > to classloader > > * So I think dih jars are loaded ok. > > I go to localhost:893 in browser and select core 'testdih', then click > 'DataImport' item but rightpane shows "Sorry, no dataimport-handler > defined!". > > What do I miss? > > > scott.chu，scott@udngroup.com > 2016/5/24 (週二) > - 未在此訊息中找到病毒。 已透過 AVG 檢查 - www.avg.com 版本: 2015.0.6201 / 病毒庫: 4568/12285 - 發佈日期: 05/23/16
Re: trying DIH but get 'Sorry, no dataimport-handler defined!'
if you have in this path server/solr/configsets/testdih/conf you shoud right this in your line commande: 'bin\solr>solr create -c your_core -d testdih -p 8983 to create a core with an exemple config testdih. 2016-05-24 9:35 GMT+01:00 scott.chu : > > I do following things: > > * I create folder : D:\solr-6.0.0\myconfigsets\testdih. > * Copy D:\portable_sw\solr-6.0.0\example\example-DIH\solr\db\conf to > D:\solr-6.0.0\myconfigsets\testdih. > * Go into D:\solr-6.0.0\myconfigsets\testdih\conf and edit > db-data-config.xml as follows (I am pretty sure mysql environment is ok): > > >url="jdbc:mysql://localhost:3306/test" user="hello" password="hellothere" /> > > > > > > > > > > > * Then I copy mysql-connector-java-5.0.8-bin.jar to > D:\portable_sw\solr-6.0.0\server\solr-webapp\webapp\WEB-INF\lib. > * I check solrconfig.xml and see these relevant lines: > > regex="solr-dataimporthandler-.*\.jar" /> > ... > ... > > > db-data-config.xml > > > > * cd to D:solr-6.0.0, issue 'bin\solr start', it starts ok. > * Issue 'bin\solr create_core -c testdih -d myconfigsets\testdih\conf' to > create a core. It's ok, too. > > * The solr.log has these log messages: > > 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] > o.a.s.c.SolrResourceLoader Adding > 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-6.0.0.jar' to > classloader > 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] > o.a.s.c.SolrResourceLoader Adding > 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-extras-6.0.0.jar' > to classloader > > * So I think dih jars are loaded ok. > > I go to localhost:893 in browser and select core 'testdih', then click > 'DataImport' item but rightpane shows "Sorry, no dataimport-handler > defined!". > > What do I miss? > > > scott.chu，scott@udngroup.com > 2016/5/24 (週二) >
Re: trying DIH but get 'Sorry, no dataimport-handler defined!'
I try run the example by issuing "bin\solr create_core -c exampledih -d example\example-DIH\solr\db\conf". It also shows same error. Do I issue wrong command? scott.chu，scott@udngroup.com 2016/5/24 (週二) - Original Message - From: scott(自己) To: solr-user CC: Date: 2016/5/24 (週二) 16:35 Subject: trying DIH but get 'Sorry, no dataimport-handler defined!' I do following things: * I create folder : D:\solr-6.0.0\myconfigsets\testdih. * Copy D:\portable_sw\solr-6.0.0\example\example-DIH\solr\db\conf to D:\solr-6.0.0\myconfigsets\testdih. * Go into D:\solr-6.0.0\myconfigsets\testdih\conf and edit db-data-config.xml as follows (I am pretty sure mysql environment is ok): * Then I copy mysql-connector-java-5.0.8-bin.jar to D:\portable_sw\solr-6.0.0\server\solr-webapp\webapp\WEB-INF\lib. * I check solrconfig.xml and see these relevant lines: ... ... db-data-config.xml * cd to D:solr-6.0.0, issue 'bin\solr start', it starts ok. * Issue 'bin\solr create_core -c testdih -d myconfigsets\testdih\conf' to create a core. It's ok, too. * The solr.log has these log messages: 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-6.0.0.jar' to classloader 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-extras-6.0.0.jar' to classloader * So I think dih jars are loaded ok. I go to localhost:893 in browser and select core 'testdih', then click 'DataImport' item but rightpane shows "Sorry, no dataimport-handler defined!". What do I miss? scott.chu，scott@udngroup.com 2016/5/24 (週二) - 未在此訊息中找到病毒。 已透過 AVG 檢查 - www.avg.com 版本: 2015.0.6201 / 病毒庫: 4568/12285 - 發佈日期: 05/23/16
trying DIH but get 'Sorry, no dataimport-handler defined!'
I do following things: * I create folder : D:\solr-6.0.0\myconfigsets\testdih. * Copy D:\portable_sw\solr-6.0.0\example\example-DIH\solr\db\conf to D:\solr-6.0.0\myconfigsets\testdih. * Go into D:\solr-6.0.0\myconfigsets\testdih\conf and edit db-data-config.xml as follows (I am pretty sure mysql environment is ok): * Then I copy mysql-connector-java-5.0.8-bin.jar to D:\portable_sw\solr-6.0.0\server\solr-webapp\webapp\WEB-INF\lib. * I check solrconfig.xml and see these relevant lines: ... ... db-data-config.xml * cd to D:solr-6.0.0, issue 'bin\solr start', it starts ok. * Issue 'bin\solr create_core -c testdih -d myconfigsets\testdih\conf' to create a core. It's ok, too. * The solr.log has these log messages: 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-6.0.0.jar' to classloader 2016-05-24 15:59:24,781 INFO (coreLoadExecutor-6-thread-1) [ ] o.a.s.c.SolrResourceLoader Adding 'file:/D:/portable_sw/solr-6.0.0/dist/solr-dataimporthandler-extras-6.0.0.jar' to classloader * So I think dih jars are loaded ok. I go to localhost:893 in browser and select core 'testdih', then click 'DataImport' item but rightpane shows "Sorry, no dataimport-handler defined!". What do I miss? scott.chu，scott@udngroup.com 2016/5/24 (週二)
Re: sorry, no dataimport-handler defined!
in request data import handler for solrconfig.xml do : tika-data-config.xml and define your file tika-data-config.xml and put this file in the directory config from your core. 2016-02-02 17:35 GMT+00:00 Jean-Jacques Monot : > Exact. Newbie user ! > > OK i have seen what is missing ... > > Le 2 févr. 2016 15:40, "Davis, Daniel (NIH/NLM) [C]" > a écrit : > > > > It sounds a bit like you are just exploring Solr for the first time. > To use the Data Import Handler, you need to create an XML file that > configures it, data-config.xml by default. > > > > But before we go into details, what are you trying to accomplish with > Solr? > > > > -Original Message- > > From: Jean-Jacques MONOT [mailto:jj_mo...@yahoo.fr] > > Sent: Monday, February 01, 2016 2:31 PM > > To: solr-user@lucene.apache.org > > Subject: Potential SPAM:sorry, no dataimport-handler defined! > > > > Hello > > > > I am using SOLR 5.4.1 and the graphical admin UI. > > > > I successfully created multiples cores and indexed various documents, > using in line commands : (create -c) and (post.jar) on W10. > > > > But in the GUI, when I click on "Dataimport", I get the following > message : "sorry, no dataimport-handler defined!" > > > > I get the same message even on 5.3.1 or for different cores. > > > > What is wrong ? > > > > JJM > > > > --- > > L'absence de virus dans ce courrier électronique a été vérifiée par le > logiciel antivirus Avast. > > https://www.avast.com/antivirus > > > > >
Re: sorry, no dataimport-handler defined!
Exact. Newbie user ! OK i have seen what is missing ... Le 2 févr. 2016 15:40, "Davis, Daniel (NIH/NLM) [C]" a écrit : > > It sounds a bit like you are just exploring Solr for the first time. To use > the Data Import Handler, you need to create an XML file that configures it, > data-config.xml by default. > > But before we go into details, what are you trying to accomplish with Solr? > > -Original Message- > From: Jean-Jacques MONOT [mailto:jj_mo...@yahoo.fr] > Sent: Monday, February 01, 2016 2:31 PM > To: solr-user@lucene.apache.org > Subject: Potential SPAM:sorry, no dataimport-handler defined! > > Hello > > I am using SOLR 5.4.1 and the graphical admin UI. > > I successfully created multiples cores and indexed various documents, using > in line commands : (create -c) and (post.jar) on W10. > > But in the GUI, when I click on "Dataimport", I get the following message : > "sorry, no dataimport-handler defined!" > > I get the same message even on 5.3.1 or for different cores. > > What is wrong ? > > JJM > > --- > L'absence de virus dans ce courrier électronique a été vérifiée par le > logiciel antivirus Avast. > https://www.avast.com/antivirus > >
sorry, no dataimport-handler defined!
It sounds a bit like you are just exploring Solr for the first time. To use the Data Import Handler, you need to create an XML file that configures it, data-config.xml by default. But before we go into details, what are you trying to accomplish with Solr? -Original Message- From: Jean-Jacques MONOT [mailto:jj_mo...@yahoo.fr] Sent: Monday, February 01, 2016 2:31 PM To: solr-user@lucene.apache.org Subject: Potential SPAM:sorry, no dataimport-handler defined! Hello I am using SOLR 5.4.1 and the graphical admin UI. I successfully created multiples cores and indexed various documents, using in line commands : (create -c) and (post.jar) on W10. But in the GUI, when I click on "Dataimport", I get the following message : "sorry, no dataimport-handler defined!" I get the same message even on 5.3.1 or for different cores. What is wrong ? JJM --- L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel antivirus Avast. https://www.avast.com/antivirus
Re: sorry, no dataimport-handler defined!
Please register Data Import Handler to work with it https://cwiki.apache.org/confluence/display/solr/Uploading+Structured+Data+Store+Data+with+the+Data+Import+Handler On Mon, Feb 1, 2016 at 2:31 PM, Jean-Jacques MONOT wrote: > Hello > > I am using SOLR 5.4.1 and the graphical admin UI. > > I successfully created multiples cores and indexed various documents, > using in line commands : (create -c) and (post.jar) on W10. > > But in the GUI, when I click on "Dataimport", I get the following message > : "sorry, no dataimport-handler defined!" > > I get the same message even on 5.3.1 or for different cores. > > What is wrong ? > > JJM > > --- > L'absence de virus dans ce courrier électronique a été vérifiée par le > logiciel antivirus Avast. > https://www.avast.com/antivirus > >
sorry, no dataimport-handler defined!
Hello I am using SOLR 5.4.1 and the graphical admin UI. I successfully created multiples cores and indexed various documents, using in line commands : (create -c) and (post.jar) on W10. But in the GUI, when I click on "Dataimport", I get the following message : "sorry, no dataimport-handler defined!" I get the same message even on 5.3.1 or for different cores. What is wrong ? JJM --- L'absence de virus dans ce courrier électronique a été vérifiée par le logiciel antivirus Avast. https://www.avast.com/antivirus
Re: Solr error : sorry, no dataimport-handler defined!
s, so they are being ignored. But
> still very very wrong. Take those out all together.
>
> You should just have 3 things tying together:
> 1) jars loaded in the lib statement in solrconfig.xml
> 2) handler definition that points at your data-config file
> 3) data-config file itself.
>
> If you are still having troubles, I strongly recommend getting the
> shipped example to work and then adding your own stuff until you get
> that working. Then, try to create a standalone configuration.
> Sometimes, this is an easier approach for the first time user.
>
> Regards,
>Alex.
> P.s. I also cover that in my Solr book. A relevant example is here:
> https://github.com/arafalov/solr-indexing-book/tree/master/published/dihdb
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On 3 November 2014 13:40, Tim Dunphy wrote:
> > Hi Alexandre,
> >
> > Thanks so much for your input and examples! Ok so here's what I've done
> so
> > far with no luck as of yet unfortunately.
> >
> > Inside of solrconfig.xml I put the following:
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > As you can see, I've replaced the relative paths with absolute ones. So
> as
> > of now, my solr 4 server is no longer complaining about not being able to
> > find directories and modules. So we're off to a good start! And now I can
> > list the 'dist' directory and in my case find the jar files I'm looking
> for.
> >
> >
> > [root@solr1:/opt/solr/collection1/conf] #ls /opt/solr/dist/ | grep
> > dataimporthandler
> > solr-dataimporthandler-4.10.1.jar
> > solr-dataimporthandler-extras-4.10.1.jar
> >
> > So far so good.
> >
> > I next tried this db-data-config file in the same directory as
> > solrconfig.xml
> >
> > [root@solr1:/opt/solr/collection1/conf] #cat db-data-config.xml.bak
> >
> >
> >
> >
> > > url="jdbc:mysql://web1.mydomain.com:3306/jokefire" user="admin"
> > password="secret" batchSize="1" />
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > name="user_activation_key"
> > />
> >
> >
> >
> >
> >
> >
> >
> >
> > Restarted tomcat, and with this setup I wasn't getting any errors in the
> > browser or logs and the web interface was still working. Always a good
> sign!
> >
> > So then I went down to Core Selector -> collection1 -> data import. And
> it
> > was quite frustrating, cuz I was getting the same error as before!
> >
> > sorry, no dataimport-handler defined!
> >
> > So then I tried the exact db-data-config.xml file from your example.
> >
> >
> > > url="jdbc:hsqldb:./example-DIH/hsqldb/ex" user="sa" />
> >
> > > deltaQuery="select id from item where last_modified >
> > '${dataimporter.last_index_time}'">
> >
> >
> > > query="select DESCRIPTION from FEATURE where
> > ITEM_ID='${item.ID}'"
> > deltaQuery="select ITEM_ID from FEATURE where
> > last_modified > '${dataimporter.last_index_time}'"
> > parentDeltaQuery="select ID from item where
> > ID=${feature.ITEM_ID}">
> >
> >
> >
> > > query="select CATEGORY_ID from item_category where
> > ITEM_ID='${item.ID}'"
> > deltaQuery="select ITEM_ID, CATEGORY_ID from
> > item_category where last_modified > '${dataimporter.last_index_time}'"
> > parentDeltaQuery="select ID from item where
> > ID=${item_category.ITEM_ID}">
> > > query="select DESCRIPTION from category where ID
> =
> > '${item_category.CATEGORY_ID}'"
> > deltaQuery="select ID from category where
> > last_modified > '${dataimporter.last_index_time}'"
Re: Solr error : sorry, no dataimport-handler defined!
Two problems:
1) You have (span) elements in your solrconfig.xml. They just
do not belong there. The original tutorial screwed up. Your element
should be on the same level as the other elements in that example.
2) You also seem to have another random piece of data configuration in
the solrconfig.xml. Also in the spans, so they are being ignored. But
still very very wrong. Take those out all together.
You should just have 3 things tying together:
1) jars loaded in the lib statement in solrconfig.xml
2) handler definition that points at your data-config file
3) data-config file itself.
If you are still having troubles, I strongly recommend getting the
shipped example to work and then adding your own stuff until you get
that working. Then, try to create a standalone configuration.
Sometimes, this is an easier approach for the first time user.
Regards,
Alex.
P.s. I also cover that in my Solr book. A relevant example is here:
https://github.com/arafalov/solr-indexing-book/tree/master/published/dihdb
Personal: http://www.outerthoughts.com/ and @arafalov
Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
On 3 November 2014 13:40, Tim Dunphy wrote:
> Hi Alexandre,
>
> Thanks so much for your input and examples! Ok so here's what I've done so
> far with no luck as of yet unfortunately.
>
> Inside of solrconfig.xml I put the following:
>
>
>
>
>
>
>
>
>
>
>
>
>
> As you can see, I've replaced the relative paths with absolute ones. So as
> of now, my solr 4 server is no longer complaining about not being able to
> find directories and modules. So we're off to a good start! And now I can
> list the 'dist' directory and in my case find the jar files I'm looking for.
>
>
> [root@solr1:/opt/solr/collection1/conf] #ls /opt/solr/dist/ | grep
> dataimporthandler
> solr-dataimporthandler-4.10.1.jar
> solr-dataimporthandler-extras-4.10.1.jar
>
> So far so good.
>
> I next tried this db-data-config file in the same directory as
> solrconfig.xml
>
> [root@solr1:/opt/solr/collection1/conf] #cat db-data-config.xml.bak
>
>
>
>
> url="jdbc:mysql://web1.mydomain.com:3306/jokefire" user="admin"
> password="secret" batchSize="1" />
>
>
>
>
>
>
>
>
>
> />
>
>
>
>
>
>
>
>
> Restarted tomcat, and with this setup I wasn't getting any errors in the
> browser or logs and the web interface was still working. Always a good sign!
>
> So then I went down to Core Selector -> collection1 -> data import. And it
> was quite frustrating, cuz I was getting the same error as before!
>
> sorry, no dataimport-handler defined!
>
> So then I tried the exact db-data-config.xml file from your example.
>
>
> url="jdbc:hsqldb:./example-DIH/hsqldb/ex" user="sa" />
>
> deltaQuery="select id from item where last_modified >
> '${dataimporter.last_index_time}'">
>
>
> query="select DESCRIPTION from FEATURE where
> ITEM_ID='${item.ID}'"
> deltaQuery="select ITEM_ID from FEATURE where
> last_modified > '${dataimporter.last_index_time}'"
> parentDeltaQuery="select ID from item where
> ID=${feature.ITEM_ID}">
>
>
>
> query="select CATEGORY_ID from item_category where
> ITEM_ID='${item.ID}'"
> deltaQuery="select ITEM_ID, CATEGORY_ID from
> item_category where last_modified > '${dataimporter.last_index_time}'"
> parentDeltaQuery="select ID from item where
> ID=${item_category.ITEM_ID}">
> query="select DESCRIPTION from category where ID =
> '${item_category.CATEGORY_ID}'"
> deltaQuery="select ID from category where
> last_modified > '${dataimporter.last_index_time}'"
> parentDeltaQuery="select ITEM_ID, CATEGORY_ID from
> item_category where CATEGORY_ID=${category.ID}">
>
>
>
>
>
>
>
> Knowing full well it wouldn't actually work, as I"m using a remote mysql
> database instead of a local
Re: Solr error : sorry, no dataimport-handler defined!
Hi Alexandre,
Thanks so much for your input and examples! Ok so here's what I've done so
far with no luck as of yet unfortunately.
Inside of solrconfig.xml I put the following:
**
As you can see, I've replaced the relative paths with absolute ones. So as
of now, my solr 4 server is no longer complaining about not being able to
find directories and modules. So we're off to a good start! And now I can
list the 'dist' directory and in my case find the jar files I'm looking for.
[root@solr1:/opt/solr/collection1/conf] #ls /opt/solr/dist/ | grep
dataimporthandler
*solr-dataimporthandler-4.10.1.jar*
*solr-dataimporthandler-extras-4.10.1.jar*
So far so good.
I next tried this db-data-config file in the same directory as
solrconfig.xml
[root@solr1:/opt/solr/collection1/conf] #cat db-data-config.xml.bak
Restarted tomcat, and with this setup I wasn't getting any errors in the
browser or logs and the web interface was still working. Always a good sign!
So then I went down to Core Selector -> collection1 -> data import. And it
was quite frustrating, cuz I was getting the same error as before!
*sorry, no dataimport-handler defined!*
So then I tried the exact db-data-config.xml file from your example.
Knowing full well it wouldn't actually work, as I"m using a remote mysql
database instead of a local hsqldb database.But at this point, my only goal
was to get the data import to show up as an option. I'd tweak the
db-data-config.xml file at a later point if this in fact worked!
But alas, I was still getting the same result...
*sorry, no dataimport-handler defined!*
G.. so annoying after all that work. Anyway, I really do appreciate
your kindness and help. :) I'm enclosing my solrconfig.xml and both
versions of my db-data-config.xml in hopes that we can make some progress
here!
Thank
Tim
On Sun, Nov 2, 2014 at 9:50 PM, Alexandre Rafalovitch
wrote:
> That tutorial seems to be somewhat dodgy. You need at least one more
> step of adding DIH library in solrconfig.xml:
>
> https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/solrconfig.xml#L75
> (I recommend using absolute path though).
>
> Also, you should not need to spell the full class out. See lower down
> in the same class:
>
> https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/solrconfig.xml#L823
>
> Finally, in the config file, I don't remember document element having
> a name. Again, the working example can be found in the same directory:
>
> https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/db-data-config.xml#L3
>
> Solr ships with a bunch of examples. If you are using/download
> standard distribution, you could start from those until you understand
> how it all hangs together.
>
> Regards,
>Alex.
>
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On 2 November 2014 21:26, Tim Dunphy wrote:
> > Hi Alex,
> >
> >
> >> I thought the ""
> >> and the ending span were broken email thing but they seem to be in the
> >> solrconfig.xml file as well. I would start from removing those and
> >> leaving just the actual definition.
> >
> >
> > Thanks for your response!
> >
> > OK so I tried your suggestion of removing those span tags like so:
> >
>
--
GPG me!!
gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
4.10.1
${solr.data.dir:}
${solr.hdfs.home:}
${solr.hdfs.confdir:}
${solr.hdfs.blockcache.enabled:true}
${solr.hdfs.blockcache.global:true}
${solr.lock.type:native}
true
false
${solr.ulog.dir:}
${solr.autoCommit.maxTime:15000}
false
${solr.autoSoftCommit.maxTime:-1}
Re: Solr error : sorry, no dataimport-handler defined!
That tutorial seems to be somewhat dodgy. You need at least one more step of adding DIH library in solrconfig.xml: https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/solrconfig.xml#L75 (I recommend using absolute path though). Also, you should not need to spell the full class out. See lower down in the same class: https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/solrconfig.xml#L823 Finally, in the config file, I don't remember document element having a name. Again, the working example can be found in the same directory: https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/db-data-config.xml#L3 Solr ships with a bunch of examples. If you are using/download standard distribution, you could start from those until you understand how it all hangs together. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 On 2 November 2014 21:26, Tim Dunphy wrote: > Hi Alex, > > >> I thought the "" >> and the ending span were broken email thing but they seem to be in the >> solrconfig.xml file as well. I would start from removing those and >> leaving just the actual definition. > > > Thanks for your response! > > OK so I tried your suggestion of removing those span tags like so: >
Re: Solr error : sorry, no dataimport-handler defined!
that, I still don't have the ability to import data from mysql. :( Any other ideas? Thanks, Tim On Sun, Nov 2, 2014 at 8:56 PM, Alexandre Rafalovitch wrote: > Well, > > I thought the "" > and the ending span were broken email thing but they seem to be in the > solrconfig.xml file as well. I would start from removing those and > leaving just the actual definition. > > Regards, >Alex. > Personal: http://www.outerthoughts.com/ and @arafalov > Solr resources and newsletter: http://www.solr-start.com/ and @solrstart > Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 > > > On 2 November 2014 20:50, Tim Dunphy wrote: > > > > Hey guys, > > > > I'm real new at working with Solr. But I need to get up to speed and I > > appreciate your bearing with me. > > > > I've installed solr 4 and am running it under tomcat 7. The install went > > perfectly fine and everything seems to work, up to a point. I've even > > automated the installation with puppet which gets everything up and > running > > perfectly as well. > > > > However my problem is that I need to be able to import some data from a > > mysql database. > > > > I've followed this tutorial to try and do this: > > > > > > > http://www.beingjavaguys.com/2013/01/how-to-use-solr-data-import-handler-to.html > > > > > > I've added a file called data-config.xml to the following location under > my > > solr root: > > > > [root@solr1:/opt/solr/collection1/conf] #cat data-config.xml > > > > > > > > > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > > password=“secret” batchSize="1" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > name="user_activation_key" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > And added the following section to my > > /opt/solr/collection1/conf/solrconfig.xml > > > >> name="/dataimport" > > class="org.apache.solr.handler.dataimport.DataImportHandler"> > > > > > > > >data-config.xml > > > > > > > > > > > > > > > > Then restart tomcat. I then navigate to collection1 -> data import in the > > solr admin interface and see the following response: > > > > sorry, no dataimport-handler defined! > > > > I am ok with parsing XML with my eyes. I've worked in some big > environments, > > where I've had to read it until my eyes bled! hah.. but I am not sure if > I > > am placing the section in solrconfig.xml that it needs to be. I'm > probably > > missing something obvious since I'm so new at using solr. I'm hoping > someone > > with more experience can point me in the right direction. > > > > I'm enclosing my solrconfig.xml files and data-config.xml in case someone > > wants to get a sense of the context that I'm working with. > > > > Thanks! > > > > -- > > GPG me!! > > > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > > > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: Solr error : sorry, no dataimport-handler defined!
Well, I thought the "" and the ending span were broken email thing but they seem to be in the solrconfig.xml file as well. I would start from removing those and leaving just the actual definition. Regards, Alex. Personal: http://www.outerthoughts.com/ and @arafalov Solr resources and newsletter: http://www.solr-start.com/ and @solrstart Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 On 2 November 2014 20:50, Tim Dunphy wrote: > > Hey guys, > > I'm real new at working with Solr. But I need to get up to speed and I > appreciate your bearing with me. > > I've installed solr 4 and am running it under tomcat 7. The install went > perfectly fine and everything seems to work, up to a point. I've even > automated the installation with puppet which gets everything up and running > perfectly as well. > > However my problem is that I need to be able to import some data from a > mysql database. > > I've followed this tutorial to try and do this: > > > http://www.beingjavaguys.com/2013/01/how-to-use-solr-data-import-handler-to.html > > > I've added a file called data-config.xml to the following location under my > solr root: > > [root@solr1:/opt/solr/collection1/conf] #cat data-config.xml > > > > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > password=“secret” batchSize="1" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > And added the following section to my > /opt/solr/collection1/conf/solrconfig.xml > >name="/dataimport" > class="org.apache.solr.handler.dataimport.DataImportHandler"> > > > >data-config.xml > > > > > > > > Then restart tomcat. I then navigate to collection1 -> data import in the > solr admin interface and see the following response: > > sorry, no dataimport-handler defined! > > I am ok with parsing XML with my eyes. I've worked in some big environments, > where I've had to read it until my eyes bled! hah.. but I am not sure if I > am placing the section in solrconfig.xml that it needs to be. I'm probably > missing something obvious since I'm so new at using solr. I'm hoping someone > with more experience can point me in the right direction. > > I'm enclosing my solrconfig.xml files and data-config.xml in case someone > wants to get a sense of the context that I'm working with. > > Thanks! > > -- > GPG me!! > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B >
Solr error : sorry, no dataimport-handler defined!
Hey guys,
I'm real new at working with Solr. But I need to get up to speed and I
appreciate your bearing with me.
I've installed solr 4 and am running it under tomcat 7. The install went
perfectly fine and everything seems to work, up to a point. I've even
automated the installation with puppet which gets everything up and running
perfectly as well.
However my problem is that I need to be able to import some data from a
mysql database.
I've followed this tutorial to try and do this:
http://www.beingjavaguys.com/2013/01/how-to-use-solr-data-import-handler-to.html
I've added a file called data-config.xml to the following location under my
solr root:
[root@solr1:*/opt/solr/collection1/con*f] #cat data-config.xml
And added the following section to
my /opt/solr/collection1/conf/solrconfig.xml
data-config.xml
Then restart tomcat. I then navigate to collection1 -> data import in the
solr admin interface and see the following response:
sorry, no dataimport-handler defined!
I am ok with parsing XML with my eyes. I've worked in some big
environments, where I've had to read it until my eyes bled! hah.. but I am
not sure if I am placing the section in solrconfig.xml that it needs to be.
I'm probably missing something obvious since I'm so new at using solr. I'm
hoping someone with more experience can point me in the right direction.
I'm enclosing my solrconfig.xml files and data-config.xml in case someone
wants to get a sense of the context that I'm working with.
Thanks!
--
GPG me!!
gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
4.10.1
${solr.data.dir:}
${solr.hdfs.home:}
${solr.hdfs.confdir:}
${solr.hdfs.blockcache.enabled:true}
${solr.hdfs.blockcache.global:true}
${solr.lock.type:native}
true
false
${solr.ulog.dir:}
${solr.autoCommit.maxTime:15000}
false
${solr.autoSoftCommit.maxTime:-1}
1024
true
20
200
static firstSearcher warming in solrconfig.xml
false
2
explicit
10
text
explicit
json
true
text
data-config.xml
true
json
true
{!xport}
xsort
false
query
explicit
velocity
browse
layout
Solritas
edismax
text^0.5 features^1.0 name^1.2 sku^1.5 id^10.0 manu^1.1 cat^1.4
title^10.0 description^5.0 keywords^5.0 author^2.0 resourcename^1.0
text
100%
*:*
10
*,score
text^0.5 features^1.0 name^1.2 sku^1.5 id^10.0 manu^1.1 cat^1.4
title^10.0 description^5.0 keywords^5.0 author^2.0 resourcename^1.0
text,features,name,sku,id,manu,cat,title,description,keywords,author,resourcename
3
on
true
cat
manu_exact
content_type
author_s
ipod
GB
1
cat,inStock
after
price
0
600
50
popularity
0
10
3
manufacturedate_dt
NOW/YEAR-10YEARS
NOW
+1YEAR
before
after
on
content features title name
true
html
<b>
</b>
0
title
0
name
3
200
content
750
on
false
5
2
5
true
true
5
3
spellcheck
