data-config.xml: delta-import unclear behaviour pre/postDeleteImportQuery with clean

2011-01-31 Thread manuel aldana
I have some unclear behaviour with using clean and pre/postImportDeleteQuery for delta-imports. The docs under http://wiki.apache.org/solr/DataImportHandler#Configuration_in_data-config.xml are not clear enough. My observation is: - preImportDeleteQuery is only executed if clean=true is set -

Re: DeletepkQuery is not actually deleting the records, please help

2011-01-31 Thread Stefan Matheis
Hey Prad, already had a look at your mysql-query log, to check if the relevant select query is executed? and if, what results it had? Regards Stefan On Sat, Jan 29, 2011 at 12:50 AM, makeyourrules makeyourru...@gmail.comwrote: Hello, I am trying to delete some records from my index with

Re: Solr for noSQL

2011-01-31 Thread Steven Noels
On Fri, Jan 28, 2011 at 1:30 AM, Jianbin Dai j...@huawei.com wrote: Hi, Do we have data import handler to fast read in data from noSQL database, specifically, MongoDB I am thinking to use? Or a more general question, how does Solr work with noSQL database? Can't say anything about

Re: Http Connection is hanging while deleteByQuery

2011-01-31 Thread shan2812
This is the log trace.. 2011-01-31 10:07:18,837 ERROR (main)[SearchBusinessControllerImpl] Solr connecting to url: http://10.145.10.154:8081/solr 2011-01-31 10:07:18,873 DEBUG (main)[DefaultHttpParams] Set parameter http.useragent = Jakarta Commons-HttpClient/3.1 2011-01-31 10:07:18,880 DEBUG

Re: first search on index

2011-01-31 Thread Grijesh
Solr is Http Caching enabled by default. Try to cleare cache before quering . Shift+refresh(F5) may cleare cache. Due to cache it may be possible old results may displayed after index have been changed - Thanx: Grijesh -- View this message in context:

Patch for edismax Query Parser

2011-01-31 Thread Isan Fulia
Hi all, I want to know how to apply patch for extended dismax query parser on solr 1.4.1. -- Thanks Regards, Isan Fulia.

Re: Patch for edismax Query Parser

2011-01-31 Thread Erick Erickson
Do you know how to apply patches in general? Or is this specifically about the edismax patch? Quick response for the general how to apply a patch question: 1 get the source code for Solr 2 get to the point you can run ant clean test successfully. 3 apply the source patch 4 execute ant dist. You

Re: SolrJ (Trunk) Invalid version or the data in not in 'javabin' format

2011-01-31 Thread Em
Hi, I will give you feedback today. There occured another issue with our current Solr-installation that I have to fix. Thanks for your effort! Regards -- View this message in context:

Re: Patch for edismax Query Parser

2011-01-31 Thread Isan Fulia
specifically for edismax patch On 31 January 2011 18:22, Erick Erickson erickerick...@gmail.com wrote: Do you know how to apply patches in general? Or is this specifically about the edismax patch? Quick response for the general how to apply a patch question: 1 get the source code for Solr

Re: Patch for edismax Query Parser

2011-01-31 Thread Erick Erickson
Have you tried it? What problems are you having? Please review: http://wiki.apache.org/solr/UsingMailingLists Erick On Mon, Jan 31, 2011 at 8:10 AM, Isan Fulia isan.fu...@germinait.comwrote: specifically for edismax patch On 31 January 2011 18:22, Erick Erickson erickerick...@gmail.com

UpdateHandler-Bug or intended feature?

2011-01-31 Thread Em
Hi list, I am not sure whether this behaviour is intended or not. I am experimenting with the UpdateRequestProcessor-feature of Solr (V: 1.4) and there occured something I find strange. Well, when I send csv-data to the CSV-UpdateHandler with some fields specified that are not part of the

Re: Extracting contents of zipped files with Tika and Solr 1.4.1

2011-01-31 Thread Gary Taylor
Can anyone shed any light on this, and whether it could be a config issue? I'm now using the latest SVN trunk, which includes the Tika 0.8 jars. When I send a ZIP file (containing two txt files, doc1.txt and doc2.txt) to the ExtractingRequestHandler, I get the following log entry (formatted

Re: Solr for noSQL

2011-01-31 Thread Estrada Groups
What are the advantages of using something like HBase over your standard Lucene index with Solr? It would seem to me like you'd be losing a lot of what Lucene has to offer!?! Adam On Jan 31, 2011, at 5:34 AM, Steven Noels stev...@outerthought.org wrote: On Fri, Jan 28, 2011 at 1:30 AM,

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Koji Sekiguchi
(11/01/31 22:20), Em wrote: Hi list, I am not sure whether this behaviour is intended or not. I am experimenting with the UpdateRequestProcessor-feature of Solr (V: 1.4) and there occured something I find strange. Well, when I send csv-data to the CSV-UpdateHandler with some fields specified

Re: field=string with value: 0, 1 and 2

2011-01-31 Thread stockii
i found the problem. DIH or i think the JDBC-Driver casting 0 and 1 to boolean, if the field in database from type (tinyint(1)). iam using tow fields with type of tinyint(1) and tinyint(2) -.- - --- System One Server, 12

EmbeddedSolrServer and junit

2011-01-31 Thread dan sutton
Hi, I have 2 cores CoreA and CoreB, when updating content on CoreB, I use solrj and EmbeddedSolrServer to query CoreA for information, however when I do this with my junit tests (which also use EmbeddedSolrServer to query) I get this error SEVERE: Previous SolrRequestInfo was not closed!

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Em
Hi Koji, following is the solrconfig: requestHandler name=/update/csv class=solr.CSVRequestHandler lst name=defaults str name=update.processorthrowAway/str /lst /requestHandler updateRequestProcessorChain name=throwAway processor

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Koji Sekiguchi
(11/01/31 23:33), Em wrote: Hi Koji, following is the solrconfig: requestHandler name=/update/csv class=solr.CSVRequestHandler lst name=defaults str name=update.processorthrowAway/str /lst /requestHandler updateRequestProcessorChain name=throwAway

Re: Solr Indexing Performance

2011-01-31 Thread Tomás Fernández Löbbe
Well, I would say that the best way to be sure is to benchmark different configurations. As far as I know, it's usually not recommended such a big RAM Buffer size, default is 32 MB and probably won't get any improvements using more than 128 MB. The same with the mergeFactor, I know that a larger

Re: DeletepkQuery is not actually deleting the records, please help

2011-01-31 Thread makeyourrules
Thanks for your reply Stefan, mysql log says query is returning those deleted records and also the solr log has the deleted records, but for some reason they are not actually getting deleted from the index. [2011/01/28 16:58:00.319] Deleting document: BAAH [2011/01/28 17:06:50.537] Deleting

Re: Search for FirstName with first Char uppercase followed by * not giving result; getting result with all lowercase and *

2011-01-31 Thread Ahmet Arslan
I had attached the Analysis report of the query George* Attachment didn't arrive. But I think you are referring output of analysis.jsp. It can be confusing because it does not do actual query parsing. Instead you can look output of debugQuery=on. When I indexed *George *it was also finally

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Em
Okay, I added some Logging-Stuff to both the processor and its factory. It turned out that there IS an updateProcessor returned and it is NOT null. However, my logging-method inside the processAdd-Method (1st line, so it HAS to be called, if one calls the method) get never called - so the

Re: NOT operator not working

2011-01-31 Thread abhayd
thanks that helps -- View this message in context: http://lucene.472066.n3.nabble.com/NOT-operator-not-working-tp2365831p2389803.html Sent from the Solr - User mailing list archive at Nabble.com.

one column indexed, the other isnt

2011-01-31 Thread PeterKerk
I have below configuration. Somehow the field KVK IS indexed and the varstatement column isnt. I have tried everything: reloaded schema.xml, reindex...but somehow the varstatement column remains 'false' even though I KNOW it is true. The KVK value IS indexed correctly. What else can it be? I

nested faceting ?

2011-01-31 Thread abhayd
hi We already have faceting on our site. I am loading devices and accessories in solr index. deviceType indicates if its a device or accessory All other attributes are same for device and accessory. When query results come back I would like to display someting like Devices +Manucaturer (100)

Adding plug-in to Solr

2011-01-31 Thread McGibbney, Lewis John
Hello list, I am attempting to port a plug-in to my Solr implementation and would like to discuss best practice for doing so. The plug-in relates specifically to the query submitted through Solr, the idea is to provide some sort of query 'refinement' mechanism relating t a specific domain.

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Em
Here is what I found out: The CSVRequestHandler gets its fields in line 240 and the following ones. Those fieldnames come from the file's header or from the specified params in the request. The CSVRequestHandler calls prepareFields to create an array of SchemaFields (see line 269) that will be

Re: resetting stats

2011-01-31 Thread Ian Connor
Has there been any progress on this or tools people might use to capture the average or 90% time for the last hour? That would allow us to better match up slowness with other metrics like CPU/IO/Memory to find bottlenecks in the system. Thanks, Ian. On Wed, Mar 31, 2010 at 9:13 PM, Chris

Re: EmbeddedSolrServer and junit

2011-01-31 Thread dan sutton
Hi, I think I've found the cause: src/java/org/apache/solr/util/TestHarness.java, query(String handler, SolrQueryRequest req) calls SolrRequestInfo.setRequestInfo(new SolrRequestInfo(req, rsp)), which my componenet also calls in the same thread hence the error. The fix was to override assertQ

Re: one column indexed, the other isnt

2011-01-31 Thread Erick Erickson
What is your schema definition for varstatement? Please include the fieldType as well as the field definition. How do you expect to convert from your bit type to whatever you've defined in your schema for varstatement (which is boolean?)? And lastly, how do you KNOW your actual select statement

Re: nested faceting ?

2011-01-31 Thread Erick Erickson
I don't think you'll be able to do this with your present schema, the information isn't available in the faceting response, you'd get something like manufacturers1100/manufacturers and no way to know that 1,000 of them were accessories. You could change the values in your index to something like

Migration from Solr 1.2 to Solr 1.4

2011-01-31 Thread Vincent Chavelle
Hello, I have huge numbers of data indexed in solr and I would know the best way to migrate it ? A simple cp of the data directory can work ? Thanks you Vincent Chavelle

CommonsHttpSolrServer and dynamic custom results filtering

2011-01-31 Thread Dave Troiano
Hi, I'm implementing custom dynamic results filtering to improve fuzzy / phonetic search support in my search application. I use the CommonsHttpSolrServer object to connect remotely to Solr. I would like to be able to index multiple fuzzy / phonetic match encodings, e.g. one of the packaged

CUSTOM JSP FOR APACHE SOLR

2011-01-31 Thread JOHN JAIRO GÓMEZ LAVERDE
SOLR LUCENE DEVELOPERS Hi i am new to solr and i like to make a custom search page for enterprise users in JSP that takes the results of Apache Solr. - Where i can find some useful examples for that topic ? - Is JSP the correct approach to solve mi requirement ? - If not what is the best

Re: Solr for noSQL

2011-01-31 Thread Upayavira
On Mon, 31 Jan 2011 08:40 -0500, Estrada Groups estrada.adam.gro...@gmail.com wrote: What are the advantages of using something like HBase over your standard Lucene index with Solr? It would seem to me like you'd be losing a lot of what Lucene has to offer!?! I think Steven is saying that he

Re: CUSTOM JSP FOR APACHE SOLR

2011-01-31 Thread Tomás Fernández Löbbe
Hi John, you can use whatever you want for building your application, using Solr on the backend (JSP included). You should find all the information you need on Solr's wiki page: http://wiki.apache.org/solr/ http://wiki.apache.org/solr/including some client libraries to easy integrate your

Re: deleteById throwing SocketTimeoutException

2011-01-31 Thread Ravi Kiran
I copied the whole index from our production box (which was having the delete issue) and put it on a test server and tried deleting docs and it works The only difference between the production server and test server is that production server keeps getting select queries from users pretty much

Re: CUSTOM JSP FOR APACHE SOLR

2011-01-31 Thread Paul Libbrecht
Tomas, I also know velocity can be used and works well. I would be interested to a simpler way to have the objects of SOLR available in a jsp than write a custom jsp processor as a request handler; indeed, this seems to be the way solrj is expected to be used in the wiki page. Actually I

phrase, inidividual term, prefix, fuzzy and stemming search

2011-01-31 Thread cyang2010
My current project has the requirement to support search when user inputs any number of terms across a few index fields (movie title, actor, director). In order to maximize result, I plan to support all those searches listed in the subject, phrase, individual term, prefix, fuzzy and stemming.

Re: one column indexed, the other isnt

2011-01-31 Thread PeterKerk
Haha, I KNOW that to be very true: I have done everything correct, its this stupid computer that doesnt understand me ;) Anyway: fieldType name=boolean class=solr.BoolField sortMissingLast=true omitNorms=true/ field name=varstatement type=boolean indexed=true stored=true/ The reason I'm

Re: one column indexed, the other isnt

2011-01-31 Thread Erick Erickson
On a very quick test, it looks like every integer value except 1 is converted to false (I haven't looked at the underlying code, but this sure makes sense). So my guess is that what's being sent to Solr isn't what you think, that is the varstatement you get back is something other than 1. I have

RE: match count per shard and across shards

2011-01-31 Thread Chris Hostetter
: Interesting idea. I must investigate if this is a possibility - eg. how often : will a document be reindexed from one shard to another - this is actually a : possibility as a consequence of the way we configure our shards :-/ : : Thanks for the input! I was still hoping for a way to get that

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Chris Hostetter
: Well, this does not seem to me like a bug but more like an exotic : situation where two concepts collidate with eachother. : The CSVRequestHandler is intended to sweep all the unneccessary stuff : out of the input to avoid exceptions for unknown fields : while my UpdateRequestProcessor needs

Re: Sending binary data as part of a query

2011-01-31 Thread Chris Hostetter
: I have successfully created a QueryComponent class that, assuming it : has the integer bitset, can turn that into the necessary DocSetFilter : to pass to the searcher, get back the facets, etc. That part all works ... : What I'm unsure how to do is actually send this compressed bitset

Re: nested faceting ?

2011-01-31 Thread Chris Hostetter
: I am loading devices and accessories in solr index. deviceType indicates if : its a device or accessory : : All other attributes are same for device and accessory. When query results : come back I would like to display someting like : : Devices : +Manucaturer (100) : - Samsung (50) : -

Re: Migration from Solr 1.2 to Solr 1.4

2011-01-31 Thread Chris Hostetter
: I have huge numbers of data indexed in solr and I would know the best way to : migrate it ? : A simple cp of the data directory can work ? if you don't have any custom components, you can probably just use your entire solr home dir as is -- just change the solr.war. (you can't just copy

Re: Http Connection is hanging while deleteByQuery

2011-01-31 Thread Ravi Kiran
Hello Shan, I was able to delete without hanging by making the following changes to the solrconfig.xml in the mainIndex section and reloading the core. BTW Iam using 1.4.1...Hope you get your deletes working as well. Let us know if it works for you or if you find any other

Re: Solr for noSQL

2011-01-31 Thread Steven Noels
On Mon, Jan 31, 2011 at 9:38 PM, Upayavira u...@odoko.co.uk wrote: On Mon, 31 Jan 2011 08:40 -0500, Estrada Groups estrada.adam.gro...@gmail.com wrote: What are the advantages of using something like HBase over your standard Lucene index with Solr? It would seem to me like you'd be losing

chaning schema

2011-01-31 Thread Dennis Gearon
Anyone got a great little script for changing a schema? i.e., after changing: database, the view in the database for data import the data-config.xml file the schema.xml file I BELIEVE that I have to run: a delete command for the whole index *:* a full import and optimize This all

Terms and termscomponent questions

2011-01-31 Thread openvictor Open
Dear Solr users, I am currently using SolR and TermsComponents to make an auto suggest for my website. I have a field called p_field indexed and stored with type=text in the schema xml. Nothing out of the usual. I feed to Solr a set of words separated by a coma and a space such as (for two

Re: UpdateHandler-Bug or intended feature?

2011-01-31 Thread Em
Hi Hoss, actually I thought this would be neccessary for the SolrInputDocument to map against a special FieldType, but this isn't true. The mapping comes sometimes after the UpdateProcessor finished its work. So yes, there is no reason to force the CSVRequestHandler to throw an Exception if the