Re: Has NRT been abandoned?

2011-05-02 Thread Andy
> Everything should work as before. So faceting, function > queries, query > boosting should still work. > > For eg: > q=name:efghij^2.2 name:abcd^3.2 > > returns all docs with name efghij and abcd but ranking > documents named > abcd above efghij > Thanks Nagendra. But I wasn't talking abo

Re: How to take differential backup of Solr Index

2011-05-02 Thread Lance Norskog
The Replication feature does this. If you configure a query server as a 'backup' server, it downloads changes but does not read them. On Mon, May 2, 2011 at 9:56 PM, Gaurav Shingala wrote: > > Hi, > > Is there any way to take differential backup of Solr Index? > > Thanks, > Gaurav > > -- Lanc

How to take differential backup of Solr Index

2011-05-02 Thread Gaurav Shingala
Hi, Is there any way to take differential backup of Solr Index? Thanks, Gaurav

Re: updates not reflected in solr admin

2011-05-02 Thread Michael Sokolov
Right I read those comments in the config, and it all sounds reasonable - presumably a new Searcher is opened when (or shortly after) we commit, from whatever source. That was my operating assumption, and the reason I was so confused when I saw different result in two different clients. I don

Re: How to debug if termsComponent is used

2011-05-02 Thread Otis Gospodnetic
Hi, That looks about right, but I don't know without checking around if debug component really needs query component, or if it can work with just terms component. Have you tried it? Did it not work? You may save yourself a lot of work and get something better than terms component with http://

Re: updates not reflected in solr admin

2011-05-02 Thread Michael Sokolov
No - this is all running against an external tomcat-based solr. I'm back to being mystified now. Maybe I'll see if I can isolate this a bit more. I'll post back if I do, although I'm beginning to wonder if we should just move to 3.1 and not worry about it. -Mike On 5/2/2011 8:39 PM, Jonath

Re: Has NRT been abandoned?

2011-05-02 Thread Nagendra Nagarajayya
Thanks Andy! Everything should work as before. So faceting, function queries, query boosting should still work. For eg: q=name:efghij^2.2 name:abcd^3.2 returns all docs with name efghij and abcd but ranking documents named abcd above efghij Regards, - NN On 5/1/2011 7:15 PM, Andy wrote:

Re: updates not reflected in solr admin

2011-05-02 Thread Jonathan Rochkind
On 5/2/2011 8:02 PM, Chris Hostetter wrote: Huh? No ... that's not true at all. A commit using SolrJ is no differnet then a commit via HTTP ... especially since that's all SOlrJ is doing when you ask it to commit. Unless you're using the 'embedded' solr server? Wonder if the OP is. Jonatha

Re: XS DateTime format

2011-05-02 Thread Chris Hostetter
: negative-signed numeral that represents the year. Is it intentional that : Solr strips leading zeros for the first four digits? No, it's a really stupid bug, due to some really stupid date formatting i haven't had a chance to refactor out of existence... https://issues.apache.org/jir

Re: updates not reflected in solr admin

2011-05-02 Thread Chris Hostetter
: I saw a comment recently (from Lance) that there is (annoying) HTTP caching : enabled by default in solrconfig.xml. Does this sound like something that : would be caused by that cache? If so, I'd probably want to disable it. Does the HTTP caching that tends to bite people in the ass is actu

Re: updates not reflected in solr admin

2011-05-02 Thread Chris Hostetter
: > Thanks - we are issuing a commit via SolrJ; I think that's the same : > thing, right? Or are you saying really we need to do a separate commit : > (via HTTP) to update the admin console's view? ... : > Yes separate commit is needed. Huh? No ... that's not true at all. A commit usin

How to debug if termsComponent is used

2011-05-02 Thread cyang2010
Hi, I defined a searchHanlder just for the sake of autosuggest, using TermsComponent. explicit terms debug This configuration might not even make sense, to configure "terms" and "debug" component together. Is "debug" component must be wired up

Re: Indexing relations for sorting

2011-05-02 Thread Chris Hostetter
: Every product-to-category relation has its own sorting order which we would : like to index in solr. ... : We want all products of subcat1 (no mather what the parent category is) : ordered by their sorting order : : We want all products of cat2_subcat1 ordered by their sorting order

Re: Dismax Minimum Match/Stopwords Bug

2011-05-02 Thread Chris Hostetter
: However, is there an actual fix in the 3.1 eDisMax parser which solves : the problem for real? Cannot find a JIRA issue for it. edismax uses the same query structure as dismax, which means it's not possible to "fix" anything here ... it's how the query parsers work. each "word" from the quer

Re: DataImportHandler on 2 tables

2011-05-02 Thread Otis Gospodnetic
Greg, 1 instance with 2 cores, each with their own schema, solrconfig, etc. (the conf dir stuff). Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Greg Georges > To: "solr-user@lucene.

Re: Avoiding corrupted index

2011-05-02 Thread Chris Hostetter
: First, I tried the scripts provided in the Solr distribution without success ... : And that's true : there is no /opt/apache-solr-1.4.1/src/bin/scripts-util : but a /opt/apache-solr-1.4.1/src/scripts/scripts-util : Is this normal to distribute the scripts with a bad path ? it looks like

Re: Formatted date/time in long field and javabinRW exception

2011-05-02 Thread Markus Jelsma
> : Any thoughts on this one? Why does Solr output a string in a long field > : with XMLResponseWriter but fails doing so (as it should) with the > : javabin format? > > performance. > > the XML Response writer doesn't make any attempt to validate data from > the index on the way out, the stored

Re: Formatted date/time in long field and javabinRW exception

2011-05-02 Thread Chris Hostetter
: Any thoughts on this one? Why does Solr output a string in a long field with : XMLResponseWriter but fails doing so (as it should) with the javabin format? performance. the XML Response writer doesn't make any attempt to validate data from the index on the way out, the stored value in the in

Indexing multiple languages

2011-05-02 Thread PeterKerk
I have categories facets. Currently on in 1 language, but since my site is multilanguage, I need to index them in multiple languages. My table looks like this: [music_categories] id int Unchecked title nvarchar(50)Unchecked title_ennvarchar(50)Unchecked title_nl

Re: fq parameter with partial value

2011-05-02 Thread Jonathan Rochkind
So if you have a field that IS tokenized, regardless of what it's called, then when you send "My Great Restaurant" to it for _indexing_, it gets _tokenized upon indexing_ to seperate tokens: "My", "Great", "Restaurant". Depending on what other analysis you have, it may get further analyzed, p

RE: DataImportHandler on 2 tables

2011-05-02 Thread Greg Georges
No it is not a problem, just wanted to confirm my question before looking into solr cores more closely. Thanks for your advice and confirmation Greg -Original Message- From: lboutros [mailto:boutr...@gmail.com] Sent: 2 mai 2011 16:43 To: solr-user@lucene.apache.org Subject: Re: DataImpo

Re: DataImportHandler on 2 tables

2011-05-02 Thread lboutros
ok, so It seems you should create a new index and core as you said. see here for the management : http://wiki.apache.org/solr/CoreAdmin But it seems that is a problem for you. Is it ? Ludovic. 2011/5/2 Greg Georges [via Lucene] < ml-node+2891277-472183207-383...@n3.nabble.com> > No, the data

RE: DataImportHandler on 2 tables

2011-05-02 Thread Greg Georges
No, the data has no relationship between each other, they are both independant with no joins. I want to search separately Greg -Original Message- From: lboutros [mailto:boutr...@gmail.com] Sent: 2 mai 2011 16:29 To: solr-user@lucene.apache.org Subject: Re: DataImportHandler on 2 tables

Re: DataImportHandler on 2 tables

2011-05-02 Thread lboutros
Do you want to search on the datas from the tables together or seperately ? Is there a join between the two tables ? Ludovic. 2011/5/2 Greg Georges [via Lucene] < ml-node+2891256-222073995-383...@n3.nabble.com> > Hello all, > > I have a system where I have a dataimporthandler defined for one tab

DataImportHandler on 2 tables

2011-05-02 Thread Greg Georges
Hello all, I have a system where I have a dataimporthandler defined for one table in my database. I need to also index data from another table, so therefore I will need another index to search on. Does this mean I must configure another solr instance (another schema.xml file, dataimporthandler

RE: Question concerning the updating of my solr index

2011-05-02 Thread Greg Georges
Yeah you are right, I have changed that to add a document and not a list of documents. Still works pretty fast, I will continue to test settings to see if I can tweak it further. Thanks Greg -Original Message- From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com] Sent: 2 mai 2011

Re: Why are they different?

2011-05-02 Thread Chris Hostetter
: The above code, if I start the server(tomcat) inside eclipse, it throws : "SolrException : Internal Server Error"; but if I start the server : outside eclipse, for instance, run "startup.bat" in tomcat's bin : directory, it runs successfully. I really don't understand Why they are : differen

Re: Question concerning the updating of my solr index

2011-05-02 Thread Otis Gospodnetic
Greg, I believe the point of SUSS is that you can just add docs to it one by one, so that SUSS can asynchronously send them to the backend Solr instead of you batching the docs. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.c

Re: when to change rows param?

2011-05-02 Thread Chris Hostetter
: I thought that injecting the rows param in the query-component would : have been enough (from the "limits" param my client is giving). But it : seems not to be the case. As i tried to explain before: the details matter. exactly where in the code you tried to do this and how you went about i

RE: Question concerning the updating of my solr index

2011-05-02 Thread Greg Georges
Oops, here is the code SolrServer server = new StreamingUpdateSolrServer("http://localhost:8080/apache-solr-1.4.1/";, 1000, 4); Collection docs = new ArrayList(); for (Iterator iterator = documents.iterator(); iterator.hasNext();) {

RE: Question concerning the updating of my solr index

2011-05-02 Thread Greg Georges
Ok I had seen this in the wiki, performance has gone from 19 seconds to 13. I have configured it like this, I wonder what would the best settings be with 20,000 docs to update? Higher or lower queue value? Higher or lower thread value? Thanks Greg -Original Message- From: Otis Gospodne

Re: Too many open files exception related to solrj getServer too often?

2011-05-02 Thread Chris Hostetter
Off the top of my head, i don't know hte answers to some of your questions, but as to the core cause of the exception... : 3. server.query(solrQuery) throws SolrServerException. How can concurrent : solr queries triggers Too many open file exception? ...bear in mind that (as i understand it) t

Re: How to combine Deduplication and Elevation

2011-05-02 Thread Chris Hostetter
: Hi I have a question. How to combine the Deduplication and Elevation : implementations in Solr. Currently , I managed to implement either one only. can you elaborate a bit more on what exactly you've tried and what problem you are facing? the SignatureUpdateProcessorFactory (which is used for

Re: updates not reflected in solr admin

2011-05-02 Thread Mike Sokolov
Ah - I didn't expect that. Thank you! On 05/02/2011 12:07 PM, Ahmet Arslan wrote: Thanks - we are issuing a commit via SolrJ; I think that's the same thing, right? Or are you saying really we need to do a separate commit (via HTTP) to update the admin console's view? Yes separate commit is

Re: querying in Java

2011-05-02 Thread Anuj Kumar
Hi Jeff, Either you can use a filter query or specify it explicitly, like- "Field:Value OR color:blue OR dayOfWeek:Tuesday" or use AND in between. It depends on what you want. Also, if you don't want to specify AND/OR and decide on a global declaration, then set it as the default operator in your

Re: querying in Java

2011-05-02 Thread Otis Gospodnetic
Jeff, If I understand what you need, then: yourFieldNameHere:(blue OR Tuesday) Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: "Saler, Jeff" > To: solr-user@lucene.apache.org > Sent:

Re: OutOfMemoryError with DIH loading 140.000 documents

2011-05-02 Thread Otis Gospodnetic
Zoltan - Solr is not preventing you from giving your JVM 2GB heap, something else is. If you paste the error we may be able to help. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Zol

Re: Question concerning the updating of my solr index

2011-05-02 Thread Otis Gospodnetic
Greg, You could use StreamingUpdateSolrServer instead of that UpdateRequest class - http://search-lucene.com/?q=StreamingUpdateSolrServer+&fc_project=Solr Your index won't be locked in the sense that you could have multiple apps or threads adding docs to the same index simultaneously and that se

Question concerning the updating of my solr index

2011-05-02 Thread Greg Georges
Hello all, I have integrated Solr into my project with success. I use a dataimporthandler to first import the data mapping the fields to my schema.xml. I use Solrj to query the data and also use faceting. Works great. The question I have now is a general one on updating the index and how it wo

RE: querying in Java

2011-05-02 Thread Saler, Jeff
This worked. Thank you. What if I want to query for two or more field's values. For example: Field color dayOf Week Value blue Tuesday I have tried a query string of "blue&Tuesday", with no success. -Original Message- From: Anuj Kumar [mailto:anujs...@gmail.com] Sent: Frid

Re: updates not reflected in solr admin

2011-05-02 Thread Ahmet Arslan
Thanks - we are issuing a commit via SolrJ; I think that's the same thing, right?  Or are you saying really we need to do a separate commit (via HTTP) to update the admin console's view? Yes separate commit is needed.

Re: updates not reflected in solr admin

2011-05-02 Thread Mike Sokolov
Thanks - we are issuing a commit via SolrJ; I think that's the same thing, right? Or are you saying really we need to do a separate commit (via HTTP) to update the admin console's view? -Mike On 05/02/2011 11:49 AM, Ahmet Arslan wrote: This is in 1.4 - we push updates via SolrJ; our applica

Re: Negative boost

2011-05-02 Thread Ahmet Arslan
I understand that the only way to simulate a negative boost is to positively boost the inverse. I have looked at http://wiki.apache.org/solr/SolrRelevancyFAQ but I think I am missing something on the formatting of my query. I am using: http://localhost:8983/solr/search?q=dog&bq=(*:* -species:She

Re: updates not reflected in solr admin

2011-05-02 Thread Ahmet Arslan
This is in 1.4 - we push updates via SolrJ; our application sees the updates, but when we use the solr admin screens to run test queries, or use Luke to view the schema and field values, it sees the database in its state prior to the commit.  I think eventually this seems to propagate, but I'm

Re: Highlighting words with non-ascii chars

2011-05-02 Thread Peter Wolanin
Does your servlet container have the URI encoding set correctly, e.g. URIEncoding="UTF-8" for tomcat6? http://wiki.apache.org/solr/SolrTomcat#URI_Charset_Config Older versions of Jetty use ISO-8859-1 as the default URI encoding, but jetty 6 should use UTF-8 as default: http://docs.codehaus.org/d

Negative boost

2011-05-02 Thread Brian Lamb
Hi all, I understand that the only way to simulate a negative boost is to positively boost the inverse. I have looked at http://wiki.apache.org/solr/SolrRelevancyFAQ but I think I am missing something on the formatting of my query. I am using: http://localhost:8983/solr/search?q=dog&bq=(*:* -spec

updates not reflected in solr admin

2011-05-02 Thread Mike Sokolov
This is in 1.4 - we push updates via SolrJ; our application sees the updates, but when we use the solr admin screens to run test queries, or use Luke to view the schema and field values, it sees the database in its state prior to the commit. I think eventually this seems to propagate, but I'm

Re: solr sorting problem

2011-05-02 Thread Erick Erickson
Your query is going against the default field (defined in schema.xml). Have you tried a fielded search? And it would best to start a new thread for new questions see: http://people.apache.org/~hossman/#threadhijack Best Erick On Mon, May 2, 2011 at 3:46 AM, Pratik wrote: > Hi, > Thanks for your

Re: OutOfMemoryError with DIH loading 140.000 documents

2011-05-02 Thread Erick Erickson
What do you have your commit parameters set to in solrconfig.xml? I suspect you can make this all work by reducing the ram threshold in the config file Best Erick On Mon, May 2, 2011 at 4:55 AM, Zoltán Altfatter wrote: > Hi, > > I receive OutOfMemoryError with Solr 3.1 when loading around 14

Re: fq parameter with partial value

2011-05-02 Thread Erick Erickson
See more below :). On Mon, May 2, 2011 at 2:43 AM, elisabeth benoit wrote: > I'm a bit confused here. > > What is the difference between CATEGORY and CATEGORY_TOKENIZED if I just do > a copyField from what field to another? [EOE] Copyfield is done with the original data, not the processed data.

Re: solr sorting problem

2011-05-02 Thread Pratik
Hi, Were you able to sort the results using alphaOnlySort ? If yes what changes were made to the schema and data-config ? Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/solr-sorting-problem-tp486144p2889473.html Sent from the Solr - User mailing list archive at Nabb

Re: Bulk update via filter query

2011-05-02 Thread Ahmet Arslan
Is there an efficient way to update multiple documents with common values (e.g. color = white)? An example would be to mark all white-colored items as sold-out. http://lucene.apache.org/solr/api/org/apache/solr/schema/ExternalFileField.html can be an option.

Bulk update via filter query

2011-05-02 Thread Rih
Is there an efficient way to update multiple documents with common values (e.g. color = white)? An example would be to mark all white-colored items as sold-out. - Rih

OutOfMemoryError with DIH loading 140.000 documents

2011-05-02 Thread Zoltán Altfatter
Hi, I receive OutOfMemoryError with Solr 3.1 when loading around 140.000 document with DIH. I have set the -Xmx to 1536M. Weird that I cannot give more heap memory. With -Xmx2G the process doesn't start. Do you know why can't I set 2G -Xmx to Solr 3.1? With Solr 4.0 trunk it I don't receive OutO

Re: solr sorting problem

2011-05-02 Thread Pratik
Hi, Thanks for your reply. I'm, using "commit=true" while indexing, and it does index the records and show the number of records indexed. The problem is that search yields 0 records ( numFound="0" ). e.g. 00onappl There are some entries for spell checking in my schema too. e.g. The S