Re: SolrCloud High Availability during indexing operation

2013-09-26 Thread Saurabh Saxena
Sorry for the late reply. All the documents have unique id. If I repeat the experiment, the num of docs indexed changes (I guess it depends when I shutdown a particular shard). When I do the experiment without shutting down leader Shards, all 80k docs get indexed (which I think proves that all doc

Re: Search statistics in category scale

2013-09-26 Thread Otis Gospodnetic
Hi Marina, I think you can get to these numbers in (only?) two ways: 1) at query time, for each suggestion hit the index, get the number of hits, and show it in the UI 2) at "suggestion data structure creation time" query the index for each suggestion, get the number of hits, include it in the loo

Re: ALIAS feature, can be used for what?

2013-09-26 Thread Otis Gospodnetic
Hi, Imagine you have an index and you need to reindex your data into a new index, but don't want to have to reconfigure or restart client apps when you want to point them to the new index. This is where aliases come in handy. If you created an alias for the first index and made your apps hit tha

Re: Solr Autocomplete with "did you means" functionality handle misspell word like google

2013-09-26 Thread Otis Gospodnetic
Hi, Not sure if Solr suggester can do this (can it, anyone?), but... shameless plug... I know http://sematext.com/products/autocomplete/index.html can do that. Otis -- Solr & ElasticSearch Support -- http://sematext.com/ Performance Monitoring -- http://sematext.com/spm On Thu, Sep 26, 2013 at

Re: * not working in Phrase Search in solar 4.4

2013-09-26 Thread Otis Gospodnetic
There is an oldish JIRA issue (with patches?) for "complex queries" https://issues.apache.org/jira/browse/SOLR-1604 Otis -- Solr & ElasticSearch Support -- http://sematext.com/ Performance Monitoring -- http://sematext.com/spm On Thu, Sep 26, 2013 at 12:15 PM, soumikghosh05 wrote: > Hi, >

Re: ContributorsGroup

2013-09-26 Thread JavaOne
Yes - that is me. mikelabib is my Jira user. Thanks for asking. Sent from my iPhone On Sep 26, 2013, at 7:32 PM, Erick Erickson wrote: > Hmmm, did Stefan add you correctly? I see MichaelLabib as a > contributor, but not mikelabib... > > Best > Erick > > On Thu, Sep 26, 2013 at 1:20 PM,

Re: cold searcher

2013-09-26 Thread Erick Erickson
Upping the number of concurrent warming searchers is almost always the wrong thing to do. I'd lengthen the polling interval or the commit interval. Throwing away warming searchers is uselessly consuming resources. And if you're trying to do any filter queries, your caches will almost never be used

Re: Not able to index documents using CloudSolrServer

2013-09-26 Thread Erick Erickson
this is key: openSearcher=false That means your commit did, indeed, fire but no new searcher was opened so the document remains invisible. If you configure softCommit, that will make the doc visible after the interval, or if you set openSearcher=true in your commit configuration. Or, as you note

Re: * not working in Phrase Search in solar 4.4

2013-09-26 Thread Erick Erickson
Certain parts of the analysis chain can be included in wildcard processing, see anything impolementing MultiTermAware. See: http://wiki.apache.org/solr/MultitermQueryAnalysis But phrases are different, and as Shawn says the analysis chain isn't applied similarly. The data is lowercased, but the wi

Re: Doing time sensitive search in solr

2013-09-26 Thread Otis Gospodnetic
Hi Darniz, Just put the date in a separate field and add a range query on that field to your existing query. Otis Solr & ElasticSearch Support http://sematext.com/ On Sep 26, 2013 7:53 PM, "Darniz" wrote: > hello Users, > > i have a requirement where my content should be search based upon time.

Re: ContributorsGroup

2013-09-26 Thread Erick Erickson
Hmmm, did Stefan add you correctly? I see MichaelLabib as a contributor, but not mikelabib... Best Erick On Thu, Sep 26, 2013 at 1:20 PM, Mike L. wrote: > > ah sorry! its: mikelabib > > thanks! > > From: Stefan Matheis > To: solr-user@lucene.apache.org > Sent: Thursday, September 26, 2013 1

Re: Sorting dependent on user preferences with FunctionQuery

2013-09-26 Thread Erick Erickson
You could also group by this field (aka "field collapsing") then have the front end put whichever group first you wanted. Best, Erick On Thu, Sep 26, 2013 at 9:41 AM, Ing. Jorge Luis Betancourt Gonzalez wrote: > I think you could use boosting queries: for group A you boost one category > and fo

Re: Xml file is not inserting from code java -jar post.jar *.xml

2013-09-26 Thread Erick Erickson
Solr does not index arbitrary XML, it only indexes XML in a very specific format. You haven't shown an example of what you're trying to index. See the examples in example/exempledocs for the format required. Best, Erick On Thu, Sep 26, 2013 at 8:32 AM, Furkan KAMACI wrote: > You should start to

Re: autocomplete_edge type split words

2013-09-26 Thread Erick Erickson
This is a classic issue where there's confusion between the query parser and field analysis. Early in the process the query parser has to take the input and break it up. that's how, for instance, a query like text:term1 term2 gets parsed as text:term1 defaultfield:term2 This happens long before th

Re: Custom Request Handlers

2013-09-26 Thread Erick Erickson
Well, I'd start by stating the conditions, maybe there's a better way to accomplish what you want without a custom request handler. They're not hard, but have you exhausted other options? This may be an XY problem. Best, Erick On Wed, Sep 25, 2013 at 9:24 AM, PAVAN wrote: > Hi, > > > I am new

Doing time sensitive search in solr

2013-09-26 Thread Darniz
hello Users, i have a requirement where my content should be search based upon time. For example below is our content in our cms. Sept content : Honda is releasing the car this month Dec content : Toyota is releasing the car this month On the website based upon time we display the co

Re: Cross index join query performance

2013-09-26 Thread Joel Bernstein
It looks like you are using int join keys so you may want to check out SOLR-4787, specifically the hjoin and bjoin. These perform well when you have a large number of results from the fromIndex. If you have a small number of results in the fromIndex the standard join will be faster. On Wed, Sep

Re: solr 4.5 release date

2013-09-26 Thread Arcadius Ahouansou
Thank you very much Steve and Shawn for the information. It's most appreciated. Arcadius. On 26 September 2013 20:35, Shawn Heisey wrote: > On 9/26/2013 11:27 AM, Arcadius Ahouansou wrote: > >> Please, any idea of the final Solr-4.5 release date? >> > > Steve gave you a better general answer

Re: Prevent public access to Solr Admin Page

2013-09-26 Thread Anshum Gupta
It's less Solr and more about tomcat. This should help you: http://stackoverflow.com/questions/4850112/restrict-access-to-specific-url-apache-tomcat On Fri, Sep 27, 2013 at 12:15 AM, uwe72 wrote: > unfortunately i didn't understand at all. > > We are using a tomcat for the solr server. > > how

RE: Prevent public access to Solr Admin Page

2013-09-26 Thread Markus Jelsma
As Shawn said, do not expose your Solr server to the internet. Do your internet users access the server directly or via some frontend application? Almost all web based applications connect to Solr via some frontend. Usually Solr is hidden from the internet just as some DBMS is. Do not expose it

Re: Prevent public access to Solr Admin Page

2013-09-26 Thread uwe72
unfortunately i didn't understand at all. We are using a tomcat for the solr server. how exactly can i prevent that user access the solr admin page? -- View this message in context: http://lucene.472066.n3.nabble.com/Prevent-public-access-to-Solr-Admin-Page-tp4092080p4092236.html Sent from th

RE: Problem loading my codec sometimes

2013-09-26 Thread Scott Schneider
Ok, I created SOLR-5278. Thanks again! Scott > -Original Message- > From: Chris Hostetter [mailto:hossman_luc...@fucit.org] > Sent: Wednesday, September 25, 2013 10:15 AM > To: solr-user@lucene.apache.org > Subject: RE: Problem loading my codec sometimes > > > : Ah, I fixed it. I was

Re: cold searcher

2013-09-26 Thread Shawn Heisey
On 9/26/2013 10:56 AM, Dmitry Kan wrote: Btw, related to master-slave setup. What makes read-only slave not to come across the same issue? Would it not pull data from the master and warm up searchers? Or does it do updates in a more controlled fashion that makes it avoid these issues? Most peop

Re: solr 4.5 release date

2013-09-26 Thread Shawn Heisey
On 9/26/2013 11:27 AM, Arcadius Ahouansou wrote: Please, any idea of the final Solr-4.5 release date? Steve gave you a better general answer than what I was writing. :) If you want to have your finger on the pulse of Solr development, join the dev mailing list. Nothing about the release proc

Re: Not able to index documents using CloudSolrServer

2013-09-26 Thread shamik
Just an update, I finally saw the documents getting indexed. But it happened after 4-5 hours since I had used CloudServer to send the documents to Solr. Is there any configuration change required ? I've having 2 nodes with a replica each and a single zookeeper instance. -- View this message in c

Re: * not working in Phrase Search in solar 4.4

2013-09-26 Thread Shawn Heisey
On 9/26/2013 10:15 AM, soumikghosh05 wrote: I have a doc that contains "Hello World" in the title field and title is of type of text_general. When I am searching with title:"Hello Wo*" -- not returning title:"Hello World" -- returning When you use wildcards, your analysis chain is not use

Re: XPathEntityProcessor nested in TikaEntityProcessor query null exception

2013-09-26 Thread P Williams
Hi, Haven't tried this myself but maybe try leaving out the FieldReaderDataSource entirely. From my quick searching looks like it's tied to SQL. Did you try copying the http://wiki.apache.org/solr/TikaEntityProcessor Advanced Parsing example exactly? What happens when you leave out FieldReaderD

Re: Prevent public access to Solr Admin Page

2013-09-26 Thread Shawn Heisey
On 9/26/2013 10:43 AM, Raymond Wiker wrote: On Sep 26, 2013, at 11:13 , uwe72 wrote: how can i prevent that everybody who knows the URL of our solr admin page, has the right to access it? I'd restrict access to the jetty server to localhost, and use an Apache httpd instance (or some other ca

Re: solr 4.5 release date

2013-09-26 Thread Steve Rowe
Hi Arcadius, The fifth release candidate, hopefully the last one, will be cut today. The release vote will be open until next Tuesday, and assuming all goes well, the release could be available next Wednesday at the earliest, six days from today. Steve On Sep 26, 2013, at 1:27 PM, Arcadius Ah

solr 4.5 release date

2013-09-26 Thread Arcadius Ahouansou
Hello. Please, any idea of the final Solr-4.5 release date? Many thanks. Arcadius.

Re: ContributorsGroup

2013-09-26 Thread Mike L.
  ah sorry! its: mikelabib   thanks! From: Stefan Matheis To: solr-user@lucene.apache.org Sent: Thursday, September 26, 2013 12:05 PM Subject: Re: ContributorsGroup Mike To add you as Contributor i'd need to know your Username? :) Stefan On Thursday, September 26, 2013 at 6:50 PM, Mike L

Re: ContributorsGroup

2013-09-26 Thread Stefan Matheis
Mike To add you as Contributor i'd need to know your Username? :) Stefan On Thursday, September 26, 2013 at 6:50 PM, Mike L. wrote: > > Solr Admins, > > I've been using Solr for the last couple years and would like to > contribute to this awesome project. Can I be added to the Contr

Re: cold searcher

2013-09-26 Thread Dmitry Kan
Thanks for following up the question on IRC! All right, your explanation makes it more clear, and now the words "until the *first searcher* is done warming" stand out. Yes, I have noticed commits in a quick succession (related to the other question on stamping core names on log entries I asked).

ContributorsGroup

2013-09-26 Thread Mike L.
  Solr Admins,   I've been using Solr for the last couple years and would like to contribute to this awesome project. Can I be added to the Contributorsgroup with also access to update the Wiki?   Thanks in advance.   Mike L.

Re: how to output solr core name with log4j

2013-09-26 Thread Dmitry Kan
yes, and vice versa: I'm sleeping when U.S. folks like you are active. :) Thanks for posting an answer. As you suggested I have filed a jira: https://issues.apache.org/jira/browse/SOLR-5277 Thanks! Dmitry On Thu, Sep 26, 2013 at 5:31 PM, Shawn Heisey wrote: > On 9/26/2013 5:16 AM, Dmitry Ka

Re: Prevent public access to Solr Admin Page

2013-09-26 Thread Raymond Wiker
On Sep 26, 2013, at 11:13 , uwe72 wrote: > Hi there, > > how can i prevent that everybody who knows the URL of our solr admin page, > has the right to access it? > > Thanks in advance! > Uwe I'd restrict access to the jetty server to localhost, and use an Apache httpd instance (or some other

How to use NumericTermsRangeEnum from NumericRangeQuery

2013-09-26 Thread Chetan Vora
Hi all I was trying to use the above enum to do some range search on dates... this enum is returned by NumericRangeQuery.getTermsEnum() but I realized that this is a protected method of the class and since this is a final class, I can't see how I can use it. Maybe I'm missing something ? Would ap

* not working in Phrase Search in solar 4.4

2013-09-26 Thread soumikghosh05
Hi, I have a doc that contains "Hello World" in the title field and title is of type of text_general. When I am searching with title:"Hello Wo*" -- not returning title:"Hello World" -- returning Could you please explain what I am missing? I have used WhitespaceTokenizerFactory instead of Stan

Re: Not able to index documents using CloudSolrServer

2013-09-26 Thread shamik
Anyone suggestion ? -- View this message in context: http://lucene.472066.n3.nabble.com/Not-able-to-index-documents-using-CloudSolrServer-tp4092074p4092185.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: how to input .txt or .html to the server in Solrj

2013-09-26 Thread Darius Miliauskas
Thanks Shawn, so, as far as I understood the "fieldname" is the title of my .txt file, and "fieldValue" is the entire text parsed to a very long string, isn't it? I guess I need just to parse the content of .txt file to the string: a) Apache Tika is one of the choice recommended online, b) readin

Re: how to input .txt or .html to the server in Solrj

2013-09-26 Thread Shawn Heisey
On 9/26/2013 5:33 AM, Darius Miliauskas wrote: > Dear All, > > I am trying to use Solr (actually Solrj) to make a simple app which will > give me the recommended texts according to the similarity to the history of > reading other texts. Firstly, I need to input these texts to the server. > Let's s

Re: how to output solr core name with log4j

2013-09-26 Thread Shawn Heisey
On 9/26/2013 5:16 AM, Dmitry Kan wrote: > Is there any way to always output core name into log with solr4j > configuration? > > If you prefer to get some SO points, the same question posted to: > > http://stackoverflow.com/questions/19026577/how-to-output-solr-core-name-with-log4j I posted an an

Re: cold searcher

2013-09-26 Thread Shawn Heisey
On 9/26/2013 6:43 AM, Dmitry Kan wrote: > Can someone please help me understand the comment in solr 4.3.1's > solrconfig.xml: > > > false As I understand it, this only applies to Solr startup or core reload, because that's the only time you'd normally have no registered searchers. The w

Re: Sorting dependent on user preferences with FunctionQuery

2013-09-26 Thread Ing. Jorge Luis Betancourt Gonzalez
I think you could use boosting queries: for group A you boost one category and for group B some other category. - Mensaje original - De: "Snubbel" Para: solr-user@lucene.apache.org Enviados: Jueves, 26 de Septiembre 2013 8:01:36 Asunto: Sorting dependent on user preferences with Function

Re: Implementing Solr Suggester for Autocomplete (multiple columns)

2013-09-26 Thread Ing. Jorge Luis Betancourt Gonzalez
Great!! I haven't see your message yet, perhaps you could create a PR to that Github repository, son it will be in sync with current versions of Solr. - Mensaje original - De: "JMill" Para: solr-user@lucene.apache.org Enviados: Jueves, 26 de Septiembre 2013 9:10:49 Asunto: Re: Implementi

Re: Implementing Solr Suggester for Autocomplete (multiple columns)

2013-09-26 Thread Stefan Matheis
That is because of jQuery's changes .. jQuery.browser (http://api.jquery.com/jQuery.browser/) Description: Contains flags for the useragent, read from navigator.userAgent. This property was removed in jQuery 1.9 and is available only through the jQuery.migrate plugin. Please try to use feature d

Re: Implementing Solr Suggester for Autocomplete (multiple columns)

2013-09-26 Thread JMill
solved. On Thu, Sep 26, 2013 at 1:50 PM, JMill wrote: > I managed to get rid of the query error by playing jquery file in the > velocity folder and adding line: " src="#{url_for_solr}/admin/file?file=/velocity/jquery.min.js&contentType=text/javascript">". > That has not solved the issues the co

Re: Implementing Solr Suggester for Autocomplete (multiple columns)

2013-09-26 Thread JMill
I managed to get rid of the query error by playing jquery file in the velocity folder and adding line: "". That has not solved the issues the console is showing a new error - "[13:42:55.181] TypeError: $.browser is undefined @ http://localhost:8983/solr/ac/admin/file?file=/velocity/jquery.autocompl

cold searcher

2013-09-26 Thread Dmitry Kan
Hello! Can someone please help me understand the comment in solr 4.3.1's solrconfig.xml: false What precisely happens when userColdSearcher is set to true and a request arrives while a searcher is warming up? - Does the state of warming slow down the search performance? Does it affect

Re: Xml file is not inserting from code java -jar post.jar *.xml

2013-09-26 Thread Furkan KAMACI
You should start to read from here: http://lucene.apache.org/solr/4_4_0/tutorial.html 2013/9/26 Kishan Parmar > > http://www.coretechnologies.com/products/AlwaysUp/Apps/RunApacheSolrAsAService.html > \ > > this is the link from where i fown the solr installation > > Regards, > > Kishan Parmar >

Solr Autocomplete with "did you means" functionality handle misspell word like google

2013-09-26 Thread Suneel Pandey
Hi, I have implemented auto complete it's working file but, I want to implement autosuggestion like google (see above screen) . when someone typing misspell words suggestion should be show e.g: cmputer => computer. Please

Re: Implementing Solr Suggester for Autocomplete (multiple columns)

2013-09-26 Thread JMill
Do you know the directory the "#{url_root}" in points too? and same for ""#{url_for_solr}" On Wed, Sep 25, 2013 at 7:33 PM, Ing. Jorge Luis Betancourt Gonzalez < jlbetanco...@uci.cu> wrote: > Try quering the core where the data has been imported, something like: > > http://localhost:8983/solr/

Sorting dependent on user preferences with FunctionQuery

2013-09-26 Thread Snubbel
Hello, I want to present to different user groups a search result in different orders. Say, i have customer group A, which I know prefers Books, I want to get Books at the top of my query result, DVDs at the bottom. And for group B, preferring DVD, these first. In my index I have a field of type t

Prevent public access to Solr Admin Page

2013-09-26 Thread uwe72
Hi there, how can i prevent that everybody who knows the URL of our solr admin page, has the right to access it? Thanks in advance! Uwe -- View this message in context: http://lucene.472066.n3.nabble.com/Prevent-public-access-to-Solr-Admin-Page-tp4092080.html Sent from the Solr - User mailing

how to input .txt or .html to the server in Solrj

2013-09-26 Thread Darius Miliauskas
Dear All, I am trying to use Solr (actually Solrj) to make a simple app which will give me the recommended texts according to the similarity to the history of reading other texts. Firstly, I need to input these texts to the server. Let's say I have 1000 .txt files in one folder or 1000 html articl

RE: Exact Word Match Search comes in first come In Solr4.3

2013-09-26 Thread Markus Jelsma
That won't boost order but Lucene's SpanFirstQuery does. You do have to make a custom query parser plugin for it but that's trivial. -Original message- > From:Otis Gospodnetic > Sent: Thursday 26th September 2013 13:24 > To: solr-user@lucene.apache.org > Subject: Re: Exact Word Match Se

Re: Exact Word Match Search comes in first come In Solr4.3

2013-09-26 Thread Otis Gospodnetic
Hello there. Use two fields, one unanalyzed and the other analyzed and boost the former. Otis Solr & ElasticSearch Support http://sematext.com/ On Sep 26, 2013 7:19 AM, "Viresh Modi" wrote: > I want to get ORDER As Per Exact Search match: > > Search with "EMIR" comes First exact match “Emir”

Exact Word Match Search comes in first come In Solr4.3

2013-09-26 Thread Viresh Modi
I want to get ORDER As Per Exact Search match: Search with "EMIR" comes First exact match “Emir” not “United Arab Emirates”. For example, when you search for “EMIR” the first result has nothing to do with that and is all about “United Arab Emirates”, which obviously contains “Emir” as part of

how to output solr core name with log4j

2013-09-26 Thread Dmitry Kan
Hello, Is there any way to always output core name into log with solr4j configuration? If you prefer to get some SO points, the same question posted to: http://stackoverflow.com/questions/19026577/how-to-output-solr-core-name-with-log4j Thanks, Dmitry

ALIAS feature, can be used for what?

2013-09-26 Thread yriveiro
Today I was thinking about the ALIAS feature and the utility on Solr. Can anyone explain me with an example where this feature may be useful? It's possible have an ALIAS of multiples collections, if I do a write to the alias, Is this write replied to all collections? /Yago - Best regards

XPathEntityProcessor nested in TikaEntityProcessor query null exception

2013-09-26 Thread Andreas Owen
i'm using solr 4.3.1 and the dataimporter. i am trying to use XPathEntityProcessor within the TikaEntityProcessor for indexing html-pages but i'm getting this error for each document. i have also tried dataField="tika.text" and dataField="text" to no avail. the nested XPathEntityProcessor "deta

Re: Select all descendants in a relation index

2013-09-26 Thread Oussama Mubarak
Thank you very much Erick. Would you know by any chance of a tutorial or book that explains how to use PathHierarchyTokenizerFactory ? How does solr know how to generate the path ? Most examples online look like the one below, and don't explain how the path is generated:

auto commit error...:java.lang.ArrayIndexOutOfBoundsException

2013-09-26 Thread Tor Egil
Running Solr - 4.4.0 1504776 - sarowe - 2013-07-19 03:00:56 on solrcloud with 1 master and 2 replicas. I have tested autocommit (every 1 document) for a while, and came over this one today: 2013-09-26T06:47:07 INFO (o.a.solr.update.UpdateHandler:511) - start commit{,optimize=false,openSearche

Re: Xml file is not inserting from code java -jar post.jar *.xml

2013-09-26 Thread Kishan Parmar
http://www.coretechnologies.com/products/AlwaysUp/Apps/RunApacheSolrAsAService.html \ this is the link from where i fown the solr installation Regards, Kishan Parmar Software Developer +91 95 100 77394 Jay Shree Krishnaa !! On Thu, Sep 26, 2013 at 1:13 PM, Kishan Parmar wrote: > i am not us

Not able to index documents using CloudSolrServer

2013-09-26 Thread Shamik Bandopadhyay
Hi, I've recently started exploring SolrCloud and is trying to index documents using CloudSolrServer client. The issue I'm seeing is if I don't fire an explicit commit on CloudSolrServer object, the documents are not getting indexed. Here's my code snippet : CloudSolrServer server = new CloudS

Re: Xml file is not inserting from code java -jar post.jar *.xml

2013-09-26 Thread Kishan Parmar
i am not using tomcat but i am using alwaysup software to run the solr system. it is working perfectly but i can not add my xml file to index..i channged my schema file as per requirement of my xml file ... and also i am using this command to insert xml to index java -Durl=http://localhost:898