disable sort by score

2011-06-13 Thread Jason, Kim
Hi, All I want to get the search result which is not sorted by anything. Sorting by score take more time. So, I want to disable sorting by score. How can i do this? Thanks, Jason. -- View this message in context: http://lucene.472066.n3.nabble.com/disable-sort-by-score-tp3057767p3057767.html

Query on Synonyms feature in Solr

2011-06-13 Thread rajini maski
Synonyms feature to be enabled on documents in Solr. I have one field in solr that has the content of a document.( say field name : document_data). The data in that field is : Tamil Nadu state private school fee determination committee headed by Justice Raviraja has submitted the private

How to optimize DIH Full import if I am using SQLite and have 70,000, 700,000 or 7 million records?

2011-06-13 Thread Alucard
Hi all As far as I know, by using DIH it will read all the documents from database (I am using SQLite v3) to memory. Now I would like to ask if I have a lot of records (let say 7 millions), it will put All 7 millions record in memory, how can I avoid that? There is a piece of documentation that

Re: Query on Synonyms feature in Solr

2011-06-13 Thread karsten-solr
Hi rajini, multi-word synonyms like private schools normally make problems. See e.g. Solr-1-4-Enterprise-Search-Server Page 56: For multi-word synonyms to work, the analysis must be applied at index-time and with expansion so that both the original words and the combined word get indexed. ...

Re: Query on Synonyms feature in Solr

2011-06-13 Thread rajini maski
Karsten, I have tried for both the cases you mentioned below. For WhitespaceTokenizerFactory that generates two tokens: private schools and so i don't get results as required. It will initially split private schools as private and schools and then try to match in synonym filter. This fails

Re: SolrJ and Range Faceting

2011-06-13 Thread Martijn v Groningen
No, that doesn't work yet. I think we'll need to enhance the Solr query parser in order to support this. If that is supported we don't need to use the DataMathParser and this a more general solution also for other client libraries. Martijn On 12 June 2011 20:58, Jamie Johnson jej2...@gmail.com

Re: can't determine sort order?

2011-06-13 Thread Erick Erickson
It's easy to overlook, but all those relevance functions are on trunk (4.0+) only, not the 3.x code branch.. Sum is a math function that's been in there for quite some time. Best Erick On Sat, Jun 11, 2011 at 8:39 PM, Jason Toy jason...@gmail.com wrote: I am trying to use sorting by function

Re: disable sort by score

2011-06-13 Thread Erick Erickson
Can you back up and explain why you have this requirement? Disabling ranking by relevance is fairly unusual in any decent sized application. And before you jump into this as a solution, have you tried other ways of increasing performance? This may be an XY problem, see: Your question appears to

Re: How to optimize DIH Full import if I am using SQLite and have 70,000, 700,000 or 7 million records?

2011-06-13 Thread Shalin Shekhar Mangar
On Mon, Jun 13, 2011 at 4:43 PM, Alucard alucard...@gmail.com wrote: As far as I know, by using DIH it will read all the documents from database (I am using SQLite v3) to memory. That is incorrect. DIH does not read rows into memory, rather, only the set of rows needed to create a Solr

Re: Query on Synonyms feature in Solr

2011-06-13 Thread Erick Erickson
I think the point is that you need to expand synonyms at index time but not at query time. In the field type definitions you provided, the expansion happens both at index and query time Or have you tried that already? Best Erick On Mon, Jun 13, 2011 at 7:46 AM, rajini maski

Re: How to optimize DIH Full import if I am using SQLite and have 70,000, 700,000 or 7 million records?

2011-06-13 Thread alucard001
Thank you Shalin. But when I google sqlite jdbc driver documentation, there is not so many pages that describe such kind of parameters. The most relevant one is this: http://www.xerial.org/trac/Xerial/wiki/SQLiteJDBC Can you please tell me which resources I can reference to? Thank you again.

Re: URGENT HELP: Improving Solr indexing time

2011-06-13 Thread Alexey Serba
str name=Total Requests made to DataSource16276/str ... so I am doing a delta import of around 500,000 rows at a time. http://wiki.apache.org/solr/DataImportHandlerDeltaQueryViaFullImport

Using Edismax

2011-06-13 Thread Tirthankar Chatterjee
We are using edismax for query and the query fired is (url:_2010) http://redcarpet2.dm2.commvault.com:27000/solr/select/?q=url:

RE: Using Edismax

2011-06-13 Thread Tirthankar Chatterjee
There is an (underscore) character before 2010 -Original Message- From: Tirthankar Chatterjee [mailto:tchatter...@commvault.com] Sent: Monday, June 13, 2011 3:08 PM To: solr-user@lucene.apache.org Subject: Using Edismax We are using edismax for query and the query fired is (url:_2010)

Re: Using Edismax

2011-06-13 Thread Erick Erickson
You haven't supplied the information that's really needed to help here, please review: http://wiki.apache.org/solr/UsingMailingLists But at a guess your analysis chain contains WordDelimiterFilterFactory, which is splitting the input stream into tokens on letter/number changes, and

Exception using Analyze from the Solr Admin app

2011-06-13 Thread karthik
Hi Everyone, I am new to the Solr world and just started playing around with it. I had everything up running and suddenly the Analyze functionality started throwing an exception when i tried using it. It was working a few days ago suddenly it stopped working started throwing this exception.

Adding documents in a batch using Solrj

2011-06-13 Thread karthik
Hi Everyone, I am trying to use Solrj to add documents to my solr index. In the process of playing around with the implementation I noticed that when we add documents in a batch to Solr the response back from solr is just - status qtime. I am using Solr 3.1 right now. I came across the

Limitation on number of cores a solr instance can handle

2011-06-13 Thread Bin Lan
Dear All, We are currently learning solr, and have some questions on multicore setting. First, is there a limitation on number of cores a solr instance can handle? From what I can tell, a core is basically a entry in a Map, so there should (virtually) not be any limits on how many cores one

Re: Exceptions in Embedded Solr

2011-06-13 Thread kasunw
I also got the same exception, anyone know how to solve this? -- View this message in context: http://lucene.472066.n3.nabble.com/Exceptions-in-Embedded-Solr-tp2007304p3057746.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Huge performance drop in distributed search w/ shards on the same server/container

2011-06-13 Thread Yonik Seeley
On Sun, Jun 12, 2011 at 9:10 PM, Johannes Goll johannes.g...@gmail.com wrote: However, sporadically, Jetty 6.1.2X (shipped with  Solr 3.1.) sporadically throws Socket connect exceptions when executing distributed searches. Are you using the exact jetty.xml that shipped with the solr example

AndQueryNode to NearSpanQuery

2011-06-13 Thread mtraynham
I'm having an issue with how I can go about achieving this and I was wondering if someone had any pointers... My goal: To produce searches where AndQueries are ORed with a SpanNearQuery, therefore boosting the results higher because they appeared closer. The only use case I'm concerned with is

Re: Adding documents in a batch using Solrj

2011-06-13 Thread Erick Erickson
Take a look at SOLR-445, I started down this road a while ago but then got distracted. If you'd like to pick it up and take it farther, feel free. I haven't applied that patch in a while, so I don't know how easy it will be to apply. Last I left it, it would do much of what you're asking for for

Re: Limitation on number of cores a solr instance can handle

2011-06-13 Thread Erick Erickson
No, there's no a-priori limit to the number of cores Solr can handle, most generally you run into issues with machine memory (and its effect on performance) that requires you to split the cores amongst separate machines eventually. Only testing will tell you that point for your app.

Re: AndQueryNode to NearSpanQuery

2011-06-13 Thread Erick Erickson
Could simply adding a boosted phrase clause solve this? In your example the query would become (Tom Cruise Dancing) OR Tom Cruise Dancing~10^10. The problem here is choosing the slop factor, but it might be good enough with a reasonable number. This shouldn't require any custom code at all

Re: AndQueryNode to NearSpanQuery

2011-06-13 Thread mtraynham
Hey Erick, Thanks for the feedback, but I it doesn't particularly solve my problem. The issue with doing a boosted phrase clause is that the terms have to be in order to be considered a hit. I'm seeking a solution where the terms can be near another term in any direction. If I were to use a

Re: Adding documents in a batch using Solrj

2011-06-13 Thread karthik
Thanks Erick. Will certainly take a look. I am looking to do this for binary objects since i have started with that. -- karthik On Mon, Jun 13, 2011 at 8:52 PM, Erick Erickson erickerick...@gmail.comwrote: Take a look at SOLR-445, I started down this road a while ago but then got distracted.

Re: disable sort by score

2011-06-13 Thread Jason, Kim
Thanks to reply, Erick! Actually, I need sort by score. I was just curious that seach result without sorting is possible. Then I found http://lucene.472066.n3.nabble.com/MaxRows-and-disabling-sort-td2260650.html In above context, Chris Hostetter-3 wrote