how can i disable coord?
I want to disable coord in bq. But eventhough I set the coordFactor=false just like .../select?q=...&coordFactor=false, it's not working... How can I disable coord? -- View this message in context: http://lucene.472066.n3.nabble.com/how-can-i-disable-coord-tp4099121.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: query with colon in bq
It's working perfectly. Thnks~ -- View this message in context: http://lucene.472066.n3.nabble.com/query-with-colon-in-bq-tp4098400p4099122.html Sent from the Solr - User mailing list archive at Nabble.com.
query with colon in bq
I have a question about query with colon in bq. Actually I use edismax and I set the q and bq just like this, .../select?defType=edismax&q="1:100"^100 "1 100"^30&qf=Title^2.0 Body&bq=Title:(1:100)^6.0 Body:(1:100)^6.0 in this query phrase, I got the error in bq, undefined field 1. How do I use query with colon in bq? -- View this message in context: http://lucene.472066.n3.nabble.com/query-with-colon-in-bq-tp4098400.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr, db connections remain after indexing a table.
I read someone's question and answer about db connection.
Someone said, db connection is still alive for 10minutes.
But I start to index(dataimport) before 1 hour, all of db connection
remains for 1 hour.
| 88757 | id | localhost:38843 | tmp | Sleep | 3696 | | NULL
|
| 88758 | id | localhost:38844 | tmp | Sleep | 3624 | | NULL
|
2012/6/7 Jihyun Suh
> I index many tables which are written with entities in data-config.xml.
> But after indexing one table, db connection remains
> even though I set 'holdability="CLOSE_CURSORS_AT_COMMIT"'.
>
> How can I remove the connection after indexing a table?
>
>
>
> driver="com.mysql.jdbc.Driver"
>url="jdbc:mysql://hostname/dbname"
>batchSize="2000"
>user="id"
>password="passwd"
>readOnly="true"
>transactionIsolation="TRANSACTION_READ_COMMITTED"
>holdability="CLOSE_CURSORS_AT_COMMIT"
>connectionTimeout="1" readTimeout="24" />
>
> transformer="RegexTransformer"
> onError="continue"
> query="SELECT Title, url, DocID, substring_index(body,'
> ',2048) description FROM testTbl_0 WHERE status in ('1','s') ">
>
>
>
>
>
> transformer="RegexTransformer"
> onError="continue"
> query="SELECT Title, url, DocID, substring_index(body,'
> ',2048) description FROM testTbl_1 WHERE status in ('1','s') ">
>
>
>
>
>
>
>
>
> +---+--+--+--+-+--+---+---+
> | Id| User | Host | db | Command | Time |
> State | Info |
>
> +---+--+--+--+-+--+---+---+
> | 88757 | id | hostname:38843 | tmp | Sleep | 2268 | | NULL
>|
> | 88758 | id | hostname:38844 | tmp | Sleep | 2196 | | NULL
>|
> | 88759 | id | hostname:38845 | tmp | Sleep | 2134 | | NULL
>|
> | 88760 | id | hostname:47822 | tmp | Sleep | 2074 | | NULL
>|
> | 88761 | id | hostname:47823 | tmp | Sleep | 2013 | | NULL
>|
> | 88762 | id | hostname:47824 | tmp | Sleep | 1953 | | NULL
>|
> | 88763 | id | hostname:47825 | tmp | Sleep | 1896 | | NULL
>|
> | 88764 | id | hostname:47826 | tmp | Sleep | 1838 | | NULL
>|
> | 88765 | id | hostname:39795 | tmp | Sleep | 1778 | | NULL
>|
> | 88766 | id | hostname:39796 | tmp | Sleep | 1717 | | NULL
>|
> | 88767 | id | hostname:39797 | tmp | Sleep | 1658 | | NULL
>|
> | 88768 | id | hostname:39798 | tmp | Sleep | 1594 | | NULL
>|
> | 88769 | id | hostname:39799 | tmp | Sleep | 1535 | | NULL
>|
> | 88770 | id | hostname:50275 | tmp | Sleep | 1470 | | NULL
>|
> | 88771 | id | hostname:50276 | tmp | Sleep | 1411 | | NULL
>|
> | 88772 | id | hostname:50277 | tmp | Sleep | 1352 | | NULL
>|
> | 88773 | id | hostname:50278 | tmp | Sleep | 1291 | | NULL
>|
> | 88774 | id | hostname:57385 | tmp | Sleep | 1165 | | NULL
>|
> | 88775 | id | hostname:57386 | tmp | Sleep | 1044 | | NULL
>|
> | 88776 | id | hostname:57387 | tmp | Sleep | 923 | | NULL
>|
> | 88777 | id | hostname:53484 | tmp | Sleep | 801 | | NULL
>|
> | 88778 | id | hostname:53485 | tmp | Sleep | 682 | | NULL
>|
> | 88779 | id | hostname:58343 | tmp | Sleep | 560 | | NULL
>|
> | 88780 | id | hostname:58344 | tmp | Sleep | 438 | | NULL
>|
> | 88781 | id | hostname:58345 | tmp | Sleep | 314 | | NULL
>|
> | 88782 | id | hostname:50474 | tmp | Sleep | 193 | | NULL
>|
> | 88783 | id | hostname:50475 | tmp | Sleep | 72 | | NULL
>|
> ...
>
>
>
>
>
Solr, db connections remain after indexing a table.
I index many tables which are written with entities in data-config.xml. But after indexing one table, db connection remains even though I set 'holdability="CLOSE_CURSORS_AT_COMMIT"'. How can I remove the connection after indexing a table? +---+--+--+--+-+--+---+---+ | Id| User | Host | db | Command | Time | State | Info | +---+--+--+--+-+--+---+---+ | 88757 | id | hostname:38843 | tmp | Sleep | 2268 | | NULL | | 88758 | id | hostname:38844 | tmp | Sleep | 2196 | | NULL | | 88759 | id | hostname:38845 | tmp | Sleep | 2134 | | NULL | | 88760 | id | hostname:47822 | tmp | Sleep | 2074 | | NULL | | 88761 | id | hostname:47823 | tmp | Sleep | 2013 | | NULL | | 88762 | id | hostname:47824 | tmp | Sleep | 1953 | | NULL | | 88763 | id | hostname:47825 | tmp | Sleep | 1896 | | NULL | | 88764 | id | hostname:47826 | tmp | Sleep | 1838 | | NULL | | 88765 | id | hostname:39795 | tmp | Sleep | 1778 | | NULL | | 88766 | id | hostname:39796 | tmp | Sleep | 1717 | | NULL | | 88767 | id | hostname:39797 | tmp | Sleep | 1658 | | NULL | | 88768 | id | hostname:39798 | tmp | Sleep | 1594 | | NULL | | 88769 | id | hostname:39799 | tmp | Sleep | 1535 | | NULL | | 88770 | id | hostname:50275 | tmp | Sleep | 1470 | | NULL | | 88771 | id | hostname:50276 | tmp | Sleep | 1411 | | NULL | | 88772 | id | hostname:50277 | tmp | Sleep | 1352 | | NULL | | 88773 | id | hostname:50278 | tmp | Sleep | 1291 | | NULL | | 88774 | id | hostname:57385 | tmp | Sleep | 1165 | | NULL | | 88775 | id | hostname:57386 | tmp | Sleep | 1044 | | NULL | | 88776 | id | hostname:57387 | tmp | Sleep | 923 | | NULL | | 88777 | id | hostname:53484 | tmp | Sleep | 801 | | NULL | | 88778 | id | hostname:53485 | tmp | Sleep | 682 | | NULL | | 88779 | id | hostname:58343 | tmp | Sleep | 560 | | NULL | | 88780 | id | hostname:58344 | tmp | Sleep | 438 | | NULL | | 88781 | id | hostname:58345 | tmp | Sleep | 314 | | NULL | | 88782 | id | hostname:50474 | tmp | Sleep | 193 | | NULL | | 88783 | id | hostname:50475 | tmp | Sleep | 72 | | NULL | ...
Re: Solr, I have perfomance problem for indexing.
Each table has 35,000 rows. (35 thousands). I will check the log for each step of indexing. I run Solr 3.5. 2012/6/6 Jihyun Suh > I have 128 tables of mysql 5.x and each table have 3,5000 rows. > When I start dataimport(indexing) in Solr, it takes 5 minutes for one > table. > But When Solr indexs 20th table, it takes around 10 minutes for one table. > And then When it indexs 40th table, it takes around 20 minutes for one > table. > > Solr has some performance problem for too many documents? > Should I set some configuration? > >
Solr, I have perfomance problem for indexing.
I have 128 tables of mysql 5.x and each table have 3,5000 rows. When I start dataimport(indexing) in Solr, it takes 5 minutes for one table. But When Solr indexs 20th table, it takes around 10 minutes for one table. And then When it indexs 40th table, it takes around 20 minutes for one table. Solr has some performance problem for too many documents? Should I set some configuration?
Re: I got ERROR, Unable to execute query
I used 3.x mysql.
After I migrate to 5.x mysql, I don't get same error just like ' Unable to
execute query'.
Maybe low version of mysql and Solr have some problems, I don't know
exactly.
2012/6/5 Jihyun Suh
> That's why I made a new DB for dataimport test. So my tables have no
> access or activity.
> Those are just dormant ones.
>
>
> --
>
> My current suspicion is that there is activity in that table that is
> preventing DIH access. I mean, like maybe the table is being updated when
> DIH is failing. Maybe somebody is emptying the table and then regenerating
> it and your DIH run is catching the table when it is being emptied. Or
> something like that.
>
> -- Jack Krupansky
>
>
> 2012/6/4 Jihyun Suh
>
>> I read your answer. Thank you.
>>
>> But I don't get that error from same table. This time I get error from
>> test_5. but when I try to dataimport again, I can index test_5, but from
>> test_7 I get that error.
>>
>> I don't know the reason. Could you help me?
>>
>>
>> --
>>
>> Is test_5 created by a stored procedure? If so, is there a possibility
>> that
>> the stored procedure may have done an update and not returned data - but
>> just sometimes?
>>
>> -- Jack Krupansky
>>
>>
>> 2012/6/2 Jihyun Suh
>>
>>> I use many tables for indexing.
>>>
>>> During dataimport, I get errors for some tables like "Unable to execute
>>> query". But next time, when I try to dataimport for that table, I can do
>>> successfully without any error.
>>>
>>> [Thread-17] ERROR o.a.s.h.d.EntityProcessorWrapper - Exception in
>>> entity :
>>> test_5:org.apache.solr.handler.dataimport.DataImportHandlerException:
>>> Unable to execute query:
>>> SELECT Title, url, synonym, description FROM test_5 WHERE status in
>>> ('1','s') Processing Document # 11046
>>>
>>> at
>>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>>> at
>>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.(JdbcDataSource.java:253)
>>> at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:210)
>>> at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:39)
>>> at
>>> org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
>>> at
>>> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:73)
>>> at
>>> org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:238)
>>> at
>>> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:596)
>>> at
>>> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:268)
>>> at
>>> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:187)
>>> at
>>> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:359)
>>> at
>>> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:427)
>>> at
>>> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:408)
>>>
>>> I use many tables for indexing.
>>>
>>> During dataimport, I get errors for some tables like "Unable to execute
>>> query". But next time, when I try to dataimport for that table, I can do
>>> successfully without any error.
>>>
>>> [Thread-17] ERROR o.a.s.h.d.EntityProcessorWrapper - Exception in
>>> entity :
>>> test_5:org.apache.solr.handler.dataimport.DataImportHandlerException:
>>> Unable to execute query:
>>> SELECT Title, url, synonym, description FROM test_5 WHERE status in
>>> ('1','s') Processing Document # 11046
>>>
>>> at
>>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>>> at
>>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.(JdbcDataSource.java:253)
>>> at
>>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:210)
>>> at
>>> org.apache.solr.handl
Re: I got ERROR, Unable to execute query
That's why I made a new DB for dataimport test. So my tables have no access
or activity.
Those are just dormant ones.
--
My current suspicion is that there is activity in that table that is
preventing DIH access. I mean, like maybe the table is being updated when
DIH is failing. Maybe somebody is emptying the table and then regenerating
it and your DIH run is catching the table when it is being emptied. Or
something like that.
-- Jack Krupansky
2012/6/4 Jihyun Suh
> I read your answer. Thank you.
>
> But I don't get that error from same table. This time I get error from
> test_5. but when I try to dataimport again, I can index test_5, but from
> test_7 I get that error.
>
> I don't know the reason. Could you help me?
>
>
> --
>
> Is test_5 created by a stored procedure? If so, is there a possibility
> that
> the stored procedure may have done an update and not returned data - but
> just sometimes?
>
> -- Jack Krupansky
>
>
> 2012/6/2 Jihyun Suh
>
>> I use many tables for indexing.
>>
>> During dataimport, I get errors for some tables like "Unable to execute
>> query". But next time, when I try to dataimport for that table, I can do
>> successfully without any error.
>>
>> [Thread-17] ERROR o.a.s.h.d.EntityProcessorWrapper - Exception in entity
>> :
>> test_5:org.apache.solr.handler.dataimport.DataImportHandlerException:
>> Unable to execute query:
>> SELECT Title, url, synonym, description FROM test_5 WHERE status in
>> ('1','s') Processing Document # 11046
>>
>> at
>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>> at
>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.(JdbcDataSource.java:253)
>> at
>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:210)
>> at
>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:39)
>> at
>> org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
>> at
>> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:73)
>> at
>> org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:238)
>> at
>> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:596)
>> at
>> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:268)
>> at
>> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:187)
>> at
>> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:359)
>> at
>> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:427)
>> at
>> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:408)
>>
>> I use many tables for indexing.
>>
>> During dataimport, I get errors for some tables like "Unable to execute
>> query". But next time, when I try to dataimport for that table, I can do
>> successfully without any error.
>>
>> [Thread-17] ERROR o.a.s.h.d.EntityProcessorWrapper - Exception in entity
>> :
>> test_5:org.apache.solr.handler.dataimport.DataImportHandlerException:
>> Unable to execute query:
>> SELECT Title, url, synonym, description FROM test_5 WHERE status in
>> ('1','s') Processing Document # 11046
>>
>> at
>> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
>> at
>> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.(JdbcDataSource.java:253)
>> at
>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:210)
>> at
>> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:39)
>> at
>> org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
>> at
>> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:73)
>> at
>> org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:238)
>> at
>> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:596)
>> at
>> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:268)
>> at
>> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:187)
>> at
>> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:359)
>> at
>> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:427)
>> at
>> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:408)
>>
>>
>
Re: I got ERROR, Unable to execute query
I read your answer. Thank you.
But I don't get that error from same table. This time I get error from
test_5. but when I try to dataimport again, I can index test_5, but from
test_7 I get that error.
I don't know the reason. Could you help me?
--
Is test_5 created by a stored procedure? If so, is there a possibility that
the stored procedure may have done an update and not returned data - but
just sometimes?
-- Jack Krupansky
2012/6/2 Jihyun Suh
> I use many tables for indexing.
>
> During dataimport, I get errors for some tables like "Unable to execute
> query". But next time, when I try to dataimport for that table, I can do
> successfully without any error.
>
> [Thread-17] ERROR o.a.s.h.d.EntityProcessorWrapper - Exception in entity
> :
> test_5:org.apache.solr.handler.dataimport.DataImportHandlerException:
> Unable to execute query:
> SELECT Title, url, synonym, description FROM test_5 WHERE status in
> ('1','s') Processing Document # 11046
>
> at
> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> at
> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.(JdbcDataSource.java:253)
> at
> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:210)
> at
> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:39)
> at
> org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
> at
> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:73)
> at
> org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:238)
> at
> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:596)
> at
> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:268)
> at
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:187)
> at
> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:359)
> at
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:427)
> at
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:408)
>
> I use many tables for indexing.
>
> During dataimport, I get errors for some tables like "Unable to execute
> query". But next time, when I try to dataimport for that table, I can do
> successfully without any error.
>
> [Thread-17] ERROR o.a.s.h.d.EntityProcessorWrapper - Exception in entity
> :
> test_5:org.apache.solr.handler.dataimport.DataImportHandlerException:
> Unable to execute query:
> SELECT Title, url, synonym, description FROM test_5 WHERE status in
> ('1','s') Processing Document # 11046
>
> at
> org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:72)
> at
> org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.(JdbcDataSource.java:253)
> at
> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:210)
> at
> org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:39)
> at
> org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
> at
> org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:73)
> at
> org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:238)
> at
> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:596)
> at
> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:268)
> at
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:187)
> at
> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:359)
> at
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:427)
> at
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:408)
>
>
solr, how can I make search query with fixed slop(distance)
I want to search data within fixed slop in Solr. For example, I make search query 'title:+solr +user ~2' for search some data which have 'solr' and 'user' within 2 slops. But it's not working in Solr. I get some parameter, defType=edismax, pf, qs, ps. It's not change the search result, but order. If I use Phrase Query just like 'title:"solr user"~2', it can't get the result just like "... users for solr ..." which have not keywords in order. How Can I do? Help me.
