Re: Updating data

2013-02-08 Thread anurag.jain
i have question what if id not exits in previous data ? ? like [ { id:6, is_good:{add:1} } ] -- View this message in context: http://lucene.472066.n3.nabble.com/Updating-data-tp4038492p4039190.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Trying to understand soft vs hard commit vs transaction log

2013-02-08 Thread Prakhar Birla
Great explanation Shawn! BTW soft commited documents will be not be recovered on JVM crash. On 8 February 2013 13:27, Shawn Heisey s...@elyograg.org wrote: On 2/7/2013 9:29 PM, Alexandre Rafalovitch wrote: Hello, What actually happens when using soft (as opposed to hard) commit? I

Re: how-to configure mysql pool connection on Solr Server

2013-02-08 Thread Miguel
Thanks for help It's a good idea configure datasource pool on Jetty or Tomcat and after reuse on my custom plugin. In this page of Jetty: http://docs.codehaus.org/display/JETTY/DataSource+Examples explain how-to configure differents datasources. thanks again. El 07/02/2013 17:35,

Re: Trying to understand soft vs hard commit vs transaction log

2013-02-08 Thread Isaac Hebsh
Shawn, what about 'flush to disk' behaviour on MMapDirectoryFactory? On Fri, Feb 8, 2013 at 11:12 AM, Prakhar Birla prakharbi...@gmail.comwrote: Great explanation Shawn! BTW soft commited documents will be not be recovered on JVM crash. On 8 February 2013 13:27, Shawn Heisey

unable to get the same results for ab and a b due to whitespace in solr

2013-02-08 Thread soumya vinukonda
Hi All, I have a synonyms.txt file where ab should give same result as a b . but when i search ab it gives 4 results and a b gives 104 results. I tried giving a+b but i donno how to give the + throug schema.xml . Please help. I tried giving expand= false and expand =false when doing indexing

Re: SolrCloud new zookeper node on different ip/ replicate between two clasters

2013-02-08 Thread mizayah
I dont think its so simple. First I need to have at last 3 zoo to keep failver for one server. Second after one zoo die, i need restart of all solrs. Maybe i define simply question. Two data centers. How to replicate two solr claster between two datacenters? In no SolrClaud there is repeater, if

ExtractingRequestHandler literals

2013-02-08 Thread marotosg
Hi, I am trying to index some documents using ExtractingRequestHandler and tika. Solr 3.6 I would like to add some extra data coming from a different source using literal. My schema contains these fields field name=DocumentID type=string indexed=true stored=true required=true/ field

Re: solr file based spell suggestions

2013-02-08 Thread Rohan Thakur
hi thanks I configured that using synonym mapping its now giving sII results on searching for s2. thanks regards Rohan On Thu, Feb 7, 2013 at 7:15 PM, Jack Krupansky j...@basetechnology.comwrote: Changing x to y (e.g., s2 to sII) is not a function of spell check or suggestion. Synonyms are

Can Solr analyze content and find dates and places

2013-02-08 Thread jazz
Hi, I want to know if Solr can analyze text and recoginze dates and places. If yes, is it then possible to create new dynamic fields with these dates and places (e.g. city). Thanks, Bart

RE: which analyzer is used for facet.query?

2013-02-08 Thread Kai Gülzau
So it seems that facet.query is using the analyzer of type index. Is it a bug or is there another analyzer type for the facet query? Nobody? Should I file a bug? Kai -Original Message- From: Kai Gülzau [mailto:kguel...@novomind.com] Sent: Tuesday, February 05, 2013 2:31 PM To:

Re: Can Solr analyze content and find dates and places

2013-02-08 Thread Alexandre Rafalovitch
Yes, it is possible. You are looking at UIMA or OpenNLP integration, most probably in Update Request Processor pipeline. Have a look here as a start: https://wiki.apache.org/solr/SolrUIMA You will have to put some serious work into this, it is not all tied together and packaged. Mostly because

Re: Trying to understand soft vs hard commit vs transaction log

2013-02-08 Thread Shawn Heisey
On 2/8/2013 3:12 AM, Isaac Hebsh wrote: Shawn, what about 'flush to disk' behaviour on MMapDirectoryFactory? MMapDirectoryFactory should flush everything to disk on a hard commit and not keep anything in RAM. I *think* that soft commits still end up in RAM with this implementation, but

copy Field / postprocess Fields after analyze / dynamic analyzer config

2013-02-08 Thread Kai Gülzau
I there a way to postprocess a field after analyze? Saying postprocess I think of renaming, moving or appending fields. Some more information: My schema.xml contains several language suffixed fields (nouns_de, ...). Each of these is analyzed in a language dependent way: fieldType name=

Re: Can Solr analyze content and find dates and places

2013-02-08 Thread jazz
Thanks Alex, I checked the documentation but it seems there is only a webservice (OpenCalais) available to extract dates and places. http://uima.apache.org/sandbox.html Do you know is there is a Solr Compatible UIMA add-on which detects dates and places (cities) without a webservice? If not,

Re: Can Solr analyze content and find dates and places

2013-02-08 Thread Alexandre Rafalovitch
Hi Bart, I haven't done any UIMA work (I used other stuff for my NLP phase), so not sure I can help much further. But in general, you are venturing into pure research territory here. Even for dates, what do you actually mean? Just fixed expression? Relative dates (e.g. last tuesday?). What about

Re: Can Solr analyze content and find dates and places

2013-02-08 Thread Bart Rijpers
Hi Alex, Indeed that is exactly what I am trying to achieve using wordcities. Date will be simple: 16-Jan becomes 16-Jan-2013 in a new dynamic field. But how do I integrate the Java library as UIMA? The documentation about changing schema.xml and solr.xml is not very detailed. Regards, Bart

Change client to http1.1

2013-02-08 Thread mbehlok
good day, using protocol http client that supports http 1.1 y change the HttpBase property useHttp11 to true but capturing packets still shows as a 1.0 request. This seems to be affecting my crawling. -- View this message in context:

Global .properties file for all Solr cores?

2013-02-08 Thread Hayden Muhl
I've read the documentation about how you can configure a Solr core with a properties file. Is there any way to specify a properties file that will apply to all cores running on a server? Here's my scenario. I have a solr setup where I have two cores, foo and bar. I want to enable replication

RE: Can Solr analyze content and find dates and places

2013-02-08 Thread Markus Jelsma
Bart, For Apache Nutch we built a date extractor that relies on some regular expressions to extract sequences that resemble dates and pass the extracted candidates through a list of Java date formats together with the identified language (DateFormat is locale aware). With it we can extract

Solr query parser, needs to call setAutoGeneratePhraseQueries(true)

2013-02-08 Thread Zhang, Lisheng
Hi, In our application we need to call method setAutoGeneratePhraseQueries(true) on lucene QueryParser, this is the way used to work in earlier versions and it seems to me that is the much natural way? But in current solr 3.6.1, the only way to do so is to set

Re: Solr query parser, needs to call setAutoGeneratePhraseQueries(true)

2013-02-08 Thread Jack Krupansky
Simply add the autoGeneratePhraseQueries attribute with a value of true to all of your text field types in your schema.xml. See the text_ -- Jack Krupansky -Original Message- From: Zhang, Lisheng Sent: Friday, February 08, 2013 3:20 PM To: solr-user@lucene.apache.org Subject: Solr

Re: Solr query parser, needs to call setAutoGeneratePhraseQueries(true)

2013-02-08 Thread Jack Krupansky
Simply add the autoGeneratePhraseQueries attribute with a value of true to all of your text field types in your schema.xml. See the text_en_splitting field type for an example: fieldType name=text_en_splitting class=solr.TextField positionIncrementGap=100 autoGeneratePhraseQueries=true ...

RE: Solr query parser, needs to call setAutoGeneratePhraseQueries(true)

2013-02-08 Thread Zhang, Lisheng
Thanks very much for your valuable help, it worked perfectly !!! Lisheng -Original Message- From: Jack Krupansky [mailto:j...@basetechnology.com] Sent: Friday, February 08, 2013 12:54 PM To: solr-user@lucene.apache.org Subject: Re: Solr query parser, needs to call

Re: Can Solr analyze content and find dates and places

2013-02-08 Thread SUJIT PAL
Hi Bart, I did some work with UIMA but this was to annotate the data before it goes to Lucene/Solr, ie not built as a UpdateRequestProcessor. I just looked through the SolrUima wiki page [http://wiki.apache.org/solr/SolrUIMA] and I believe you will have to set up your own aggregate analysis

Re: Trying to understand soft vs hard commit vs transaction log

2013-02-08 Thread Alexandre Rafalovitch
Sorry Shawn, Somehow I am still not quite grasping it. I would really appreciate if somebody (or even you) could have another go at very small part of this. Maybe it will clear it up: Similarly, in performance section of Wiki, it says: A commit (including a soft commit) will free up almost all

Re: Trying to understand soft vs hard commit vs transaction log

2013-02-08 Thread Shawn Heisey
On 2/8/2013 4:11 PM, Alexandre Rafalovitch wrote: Sorry Shawn, Somehow I am still not quite grasping it. I would really appreciate if somebody (or even you) could have another go at very small part of this. Maybe it will clear it up: Similarly, in performance section of Wiki, it says: A

Re: Solr query parser, needs to call setAutoGeneratePhraseQueries(true)

2013-02-08 Thread Jack Krupansky
(Sorry for my split message)... See the text_en_splitting field type for an example: fieldType name=text_en_splitting class=solr.TextField positionIncrementGap=100 autoGeneratePhraseQueries=true ... -- Jack Krupansky -Original Message- From: Zhang, Lisheng Sent: Friday, February 08,

Re: Trying to understand soft vs hard commit vs transaction log

2013-02-08 Thread Jack Krupansky
If you check the revision history of the wiki page, a Mr. jayqhacker added the quoted statement on November 26, 2012. I don't recognize his name as being a known authority on anything related to Solr, so maybe his uncorroborated comments should be taken with a grain of salt. -- Jack Krupansky

Custom update handler

2013-02-08 Thread Jorge Luis Betancourt Gonzalez
Hi: I'm trying to build a custom update handler to accomplish one specific task. In our app we do query suggestions based on previous queries passed into our frontend app, the thing is that instead of getting this queries from the solr logs, we stored in a separated core. So far so good, but

Re: Trying to understand soft vs hard commit vs transaction log

2013-02-08 Thread Mark Miller
A soft commit is just like a hard commit but doesn't do things like resolve deletes or call fsync on all the files that were written to disk. It will flush to disk however. Hard commits are for durability if you are not using the update log. If you are using the update log, hard commits are

Hourly Faceting

2013-02-08 Thread Cool Techi
Hi, I want to facet results on an hourly basis, the following query gives me an hourly breakdown, but with the date part. I want just the hour part across the days. Is there any other way of doing this, lst name=params str name=facet.date.start2013-02-01T00:00:00Z-330MINUTES/str str