Problem with WT parameter when upgrading from Solr1.2 to solr1.3

2008-12-29 Thread Pooja Verlani
Hi, I just upgraded my system from Solr 1.2 to Solr 1.3. I am using the same plugin for the queryResponseWriter that I used in Solr1.2. Problem here is that when I am using *wt* parameter as the plugin name with full package then I don't get the response which I used to get in 1.2 and when I don

Re: Local Solr - Error creating document with DIH

2008-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
apparently the local solr expects everything as string. I guess we must raise an issue with them. meanwhile you can convert those double fields to String using TemplateTransformer On Tue, Dec 30, 2008 at 5:49 AM, MapYours wrote: > > I have my data import handler set up correctly it connect

Re: DataImportHandler full-import: SolrException: Document [null] missing required field: id

2008-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
The column names are case sensitive. USER_ID != user_id On Tue, Dec 30, 2008 at 2:12 AM, Rakesh Sinha wrote: > Hi - > My dataconfig.xml looks as follows. > > > >user="username" password="password" /> > >query="select user_id, firstname from user where user_i

Re: DataImportHandler - The field :xyz present in DataConfig does not have a counterpart in Solr Schema

2008-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
These are warning messages . They do not stop anything in DIH It is very common that users make typos and that may be hard to debug. So the messages are spit out On Tue, Dec 30, 2008 at 12:06 AM, Rakesh Sinha wrote: > Hi - > I am testing around with the full - import functionality of Data > Impo

Re: can i reuse the index built with 1.3 with current solr from trunk

2008-12-29 Thread Otis Gospodnetic
Vinay, Please email only one list - solr-user. The answer is positive, but it's always best to back up your index just in case. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: vinay kumar kaku > To: solr-...@lucene.apache.org; solr-user@l

Re: how large can the index be?

2008-12-29 Thread Otis Gospodnetic
What you have below is not really what we call "Distributed Search", but more of "Query Load Balancing". Yes, the diagram below will work IF a single Solr box (A or B) can really handle a full 50M doc index. Of course "handle" can be fuzzy. That is, you could have a large index on a Solr box

Re: http internal error if i enable debugQuery=on

2008-12-29 Thread Otis Gospodnetic
Hi, Do you have q=XXX parameter in your URL as well? Try specifying it. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: vinay kumar kaku > To: solr-user@lucene.apache.org > Sent: Monday, December 29, 2008 6:09:24 PM > Subject: http inter

can i reuse the index built with 1.3 with current solr from trunk

2008-12-29 Thread vinay kumar kaku
Hi, I have an index thats built using 1.3 (before official release). can i re-use same data with current solr i get from trunk? what are the things that i need to keep in mind.vinay _ Send e-mail anywhere. No map, no compass. http:

Local Solr - Error creating document with DIH

2008-12-29 Thread MapYours
I have my data import handler set up correctly it connects and streams results returned from the database (sqlserver 2005) using JTDS driver. However, no documents are indexed: Dec 29, 2008 2:03:07 PM org.apache.solr.handler.dataimport.SolrWriter upload WARNING: Error creating document : SolrInpu

Re: Dismax Minimum Match/Stopwords Bug

2008-12-29 Thread Matthew Runo
Hmm, that makes sense to me - however I still think that even if we have mm set to "2" and we have "the 7449078" it should still match 7449078 in a productId field (it does not: http://zeta.zappos.com/search?department=&term=the+7449078) . This seems like it works against the way one would rea

http internal error if i enable debugQuery=on

2008-12-29 Thread vinay kumar kaku
Hi, i got solr on 23rd dec and using for my application. i have a filter &fq=-filtername[1+TO+*] all works fine until i say &debugQuery=on i get below error from my tomcat catalina.out logfile. if i change that filter to say &fq=-filtername[1+TO+10]&debugQuery=on it works fine.HTTP Status 500

Re: how large can the index be?

2008-12-29 Thread Antonio Eggberg
Thanks you very much for your answer. I was afraid of that the each document has about 20 fields.. As you pointed out it will slow down. Anyway I am thinking is it not possible to do the following: Load Balancer | Solr A, Solr B, ... | one index So I send 50% query to Solr A, 50% t

Re: how large can the index be?

2008-12-29 Thread Otis Gospodnetic
Hi Antonio, Besides thinking in terms of documents, you also need to think in terms of index size on the file system vs. the amount of RAM your search application/server can use. 50M documents may be doable on a single server if those documents are not too large and you have sufficient RAM. I

DataImportHandler full-import: SolrException: Document [null] missing required field: id

2008-12-29 Thread Rakesh Sinha
Hi - My dataconfig.xml looks as follows. When I do a full-import with this revised schema ( where the primary key of the table is not id , but user_id ), I am getting the following error. WARNING: Error creating document : SolrInpu

how large can the index be?

2008-12-29 Thread Antonio Eggberg
Hi, We are running successfully a solr index of 3 million docs. I have just been informed that our index size will increase to 50 million. I been going through the doc http://wiki.apache.org/solr/DistributedSearch Seems like we will loose out on the date facet and some more other stuff that

Re: DataImportHandler - The field :xyz present in DataConfig does not have a counterpart in Solr Schema

2008-12-29 Thread Rakesh Sinha
Oops. The fields were out of sync with those in schema.xml . Looking at the dynamic field name configuration in schema.xml - my dataconfig.xml file looks as follows. The naming of fields with suffix ( _s ) , as per the d

Re: Hi w.r.t solr 1.4

2008-12-29 Thread Otis Gospodnetic
Nightly build, please. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: vinay kumar kaku > To: solr-user@lucene.apache.org > Sent: Monday, December 29, 2008 2:05:42 PM > Subject: Hi w.r.t solr 1.4 > > > Hi, is there a stable build of sol

Hi w.r.t solr 1.4

2008-12-29 Thread vinay kumar kaku
Hi, is there a stable build of solr 1.4 that i could grab from? vinay _ Send e-mail faster without improving your typing skills. http://windowslive.com/online/hotmail?ocid=TXT_TAGLM_WL_hotmail_acq_speed_122008

DataImportHandler - The field :xyz present in DataConfig does not have a counterpart in Solr Schema

2008-12-29 Thread Rakesh Sinha
Hi - I am testing around with the full - import functionality of Data Import Handler. My dataconfig file looks as follows. In solrconfig.xml - I am setting the access for DIH as follows. data-config.xml

Re: Custom Search Results

2008-12-29 Thread Otis Gospodnetic
Johnny, There are lots of examples of SearchComponents in Solr itself. Have a look: o...@lesina:~/workspace/asf-solr$ ffjg -l "extends SearchComponent" ./src/java/org/apache/solr/handler/component/FacetComponent.java ./src/java/org/apache/solr/handler/component/QueryComponent.java ./src/java/org

Re: Multiple language support

2008-12-29 Thread Otis Gospodnetic
Hi, The problem is that a single document (and even a field in your case) is multilingual. Ideally you'd detect different languages within a document and apply a different tokenizer/filter to different parts of the field. So the first part would be handled as EN, and the second part as Chines

Re: High response times after snapshot install

2008-12-29 Thread Otis Gospodnetic
Hello Victor, The high response times could be caused by long and intense warming of the new searcher(s), which could be causing high IO (it sounds like all instances share the same index on the same file system) and high CPU usage (lots of cache items being copied from the old searcher). Oti

Re: Units for maxFieldLength

2008-12-29 Thread Otis Gospodnetic
Hi Alan, That number represents the number of tokens. Extra long field values get silently truncated. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Alan May > To: solr-user@lucene.apache.org > Sent: Monday, December 29, 2008 1:09:37

Units for maxFieldLength

2008-12-29 Thread Alan May
Hi, I'd love to get more details about the maxFieldLength attribute in the solrConfig.xml. Is this length in characters or bytes or some other measure? If chars, how are double byte characters handled? If an add request is sent with a field that exceeds this limit what is the behavior? (Is it

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Mon, Dec 29, 2008 at 5:11 PM, Manupriya wrote: > > Hi Shalin, > > I am using apache-solr-1.3.0 in my project. I thought it to be the latest > release. Does it not support delta import? It should, 1.3 of solr was the first realease of DIH. A lot of features got added to DIH since then. The night

Re: Retrieve documents that contain max value for a field

2008-12-29 Thread Sushil Vegad
This looks useful, but I am not sure how to use the component. Could you please elaborate? Also, this is not available in Solr 1.3. Any equivalent of it in 1.3? Thanks, Sushil ryantxu wrote: > > not exactly what you are asking for, but check: > http://wiki.apache.org/solr/StatsComponent > >

Re: Any new python libraries?

2008-12-29 Thread Ed Summers
Jacob, If you are interested in contributing any of your code to the solrpy project [1] please let us know, either on here or on the solrpy discussion list [2]. One of the motivations for putting the code up at code.google.com was to make it easy for people to quickly contribute enhancements/fixe

Re: Please help me integrate Nutch with Solr

2008-12-29 Thread Andrzej Bialecki
Tony Wang wrote: Thanks Otis. I've just downloaded NUTCH-442_v8.patchfrom https://issues.apache.org/jira/browse/NUTCH-442, but the patching process gave me lots errors, see below: This patch will be integrated within

High response times after snapshot install

2008-12-29 Thread Victor Hogemann
Greetings, Before anything I'd like to thank the Solr team for such great piece of software! Thank you. Now... back to my problem. I'm experiencing slowdowns on a Solr 1.3 multicore installation after a snapshot install, response times go up from 5ms to above 5sec, and don't go down unles

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Manupriya
Hi Shalin, I am using apache-solr-1.3.0 in my project. I thought it to be the latest release. Does it not support delta import? Thanks, Manu Shalin Shekhar Mangar wrote: > > Which version of Solr are you using? The deltaImportQuery feature was > added > recently, you'd need a nightly build fo

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Shalin Shekhar Mangar
Which version of Solr are you using? The deltaImportQuery feature was added recently, you'd need a nightly build for it to work. On Mon, Dec 29, 2008 at 4:57 PM, Manupriya wrote: > > Hi Noble, > > I tried with the deltaImportQuery as well. But still I am getting the same > exception on the server

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Manupriya
Hi Noble, I tried with the deltaImportQuery as well. But still I am getting the same exception on the server console - Dec 29, 2008 4:53:52 PM org.apache.solr.handler.dataimport.DataImporter doDeltaImport SEVERE: Delta Import Failed java.lang.NullPointerException at org.apache.solr.han

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
The same example with deltaImportQuery would look as follows On Mon, Dec 29, 2008 at 3:30 PM, Noble Paul നോബിള

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
did you put in the data? On Mon, Dec 29, 2008 at 3:07 PM, Manupriya wrote: > > Hi Shalin, > > I am actually trying out the example provided at > http://wiki.apache.org/solr/DataImportHandler. > > My db-data-config.xml is as following - > > > url="jdbc:mysql://localhost/solr_demo_db" user="ro

Multiple language support

2008-12-29 Thread Deshpande, Mukta
Hi All, I have a multiple language supporting schema in which there is a separate field for every language. I have a field "product_name" to store product name and its description that can be in any user preferred language. This can be stored in fields product_name_EN if user prefers English

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Manupriya
Hi Shalin, I am actually trying out the example provided at http://wiki.apache.org/solr/DataImportHandler. My db-data-config.xml is as following -

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
This may happen if your deltaQuery has a problem Try using the deltaImportQuery also. -- On Mon, Dec 29, 2008 at 2:57 PM, Shalin Shekhar Mangar wrote: > What does your data-config look like? especially the delta query part. > > On Mon, Dec 29, 2008 at 2:35 PM, Manupriya wrote: > >> >> Hi, >> >>

Re: Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Shalin Shekhar Mangar
What does your data-config look like? especially the delta query part. On Mon, Dec 29, 2008 at 2:35 PM, Manupriya wrote: > > Hi, > > I am using Delta DataImport feature to partially refresh the indexes. > > Note - full-import is working perfectly fine. But I need to do delta-import > as I do not

Delta DataImport is not picking the modified value in DB

2008-12-29 Thread Manupriya
Hi, I am using Delta DataImport feature to partially refresh the indexes. Note - full-import is working perfectly fine. But I need to do delta-import as I do not want to rebuild all the indexes. My database structure is same as mentioned in the example at http://wiki.apache.org/solr/DataImport