Re: Reading results from FieldCollapsing

2011-09-07 Thread Sowmya V.B.
Hi Martjin Sorry for a late response. I did take the latest Solr build last week. After the new snapshot, there was a class called grouped response: (org.apache.solr.client.solrj.response.GroupResponse) But, the Solrj snapshot (apache-solr-solrj-3.4-SNAPSHOT.jar)'s QueryResponse class did not

please help! deletequery*:*/query/delete followed by commit does not work

2011-09-07 Thread Roland Tollenaar
Hi All, I want to clear the solr server and start loading documents afresh. According to the information I found on internet I would have to do somethign like this: http://localhost:8983/solr/update?commit=true-HContent-Type:text/xml--data-binary;'deletequery*:*/query/delete' which in my

Re: please help! deletequery*:*/query/delete followed by commit does not work

2011-09-07 Thread Gora Mohanty
On Wed, Sep 7, 2011 at 1:18 PM, Roland Tollenaar rwatollen...@gmail.com wrote: Hi All, I want to clear the solr server and start loading documents afresh. According to the information I found on internet I would have to do somethign like this:

Re: please help! deletequery*:*/query/delete followed by commit does not work

2011-09-07 Thread Parvin Gasimzade
Use this to clear the solr server. http://localhost:8983/solr/update?stream.body= deletequery*:*/query/deletecommit=true On Wed, Sep 7, 2011 at 10:48 AM, Roland Tollenaar rwatollen...@gmail.comwrote: Hi All, I want to clear the solr server and start loading documents afresh. According to

maximum rows for dataimport using solrj

2011-09-07 Thread Tobias Rübner
Hi, I want to trigger the data import handler remotly using the solrj api. So I added a dih request handler to my solr config and tried to call the handler as described here http://wiki.apache.org/solr/SolJava ModifiableSolrParams params = new ModifiableSolrParams(); params.set(qt, /dataimport);

Spellcheck

2011-09-07 Thread Danicela nutch
Hi, I'm trying to get search suggestions like Google 'Did you mean ?' with indexed data with Solr from Nutch. I added this to my schema.xml : fieldType name=textSpell class=solr.TextField positionIncrementGap=100 analyzer tokenizer class=solr.StandardTokenizerFactory/ filter

logging client ip address

2011-09-07 Thread dan sutton
Hi, We're using log4j with solr which is working fine and I'm wondering how I might be able to log the client ip address? Has anyone else been able to do this? Cheers, Dan

Re: Solr 1.4.1: problems with replication and index operation both at the same time.

2011-09-07 Thread Luis Cappa Banda
Hello, Erik. Thank you for answering again. I'm using Java JDK 1.5 and an Apache Tomcat 1.6 configuring it's memory parameters from 1G to 2G maximum for each Tomcat server. The machine has a RAID5 HDD, 32G RAM and eight cores, and I have six Tomcat launched with their process running at the same

Re: Solr 1.4.1: problems with replication and index operation both at the same time.

2011-09-07 Thread Luis Cappa Banda
Excuse me, I mean an Apache Tomcat 6.

Re: logging client ip address

2011-09-07 Thread Shalin Shekhar Mangar
On Wed, Sep 7, 2011 at 2:56 PM, dan sutton danbsut...@gmail.com wrote: Hi, We're using log4j with solr which is working fine and I'm wondering how I might be able to log the client ip address? Has anyone else been able to do this? Your application container should have an access log

Re: Spellcheck

2011-09-07 Thread Shalin Shekhar Mangar
On Wed, Sep 7, 2011 at 1:52 PM, Danicela nutch danicela-nu...@mail.comwrote: Hi, I'm trying to get search suggestions like Google 'Did you mean ?' with indexed data with Solr from Nutch. I added this to my schema.xml : fieldType name=textSpell class=solr.TextField

Re: maximum rows for dataimport using solrj

2011-09-07 Thread Shalin Shekhar Mangar
On Wed, Sep 7, 2011 at 1:45 PM, Tobias Rübner d...@tobr.eu wrote: Hi, I want to trigger the data import handler remotly using the solrj api. So I added a dih request handler to my solr config and tried to call the handler as described here http://wiki.apache.org/solr/SolJava

Re: Spellcheck

2011-09-07 Thread Danicela nutch
I just tried to start the data from scratch, I deleted Nutch segments and solr/data/index files, but it changed nothing. Maybe I should delete other elements ? - Original Message - From: Shalin Shekhar Mangar Sent: 09/07/11 12:08 PM To: solr-user@lucene.apache.org Subject: Re:

Re: please help! deletequery*:*/query/delete followed by commit does not work

2011-09-07 Thread Roland Tollenaar
curl http://localhost:8983/solr/update?commit=true -H Content-Type: text/xml --data-binary 'deletequery*:*/query/delete' This executed but still did not clear the data... Thanks. Roland Please see http://wiki.apache.org/solr/UpdateXmlMessages . Regards, Gora

Re: please help! deletequery*:*/query/delete followed by commit does not work

2011-09-07 Thread Roland Tollenaar
Hi Parvin, Parvin Gasimzade wrote: Use this to clear the solr server. http://localhost:8983/solr/update?stream.body= deletequery*:*/query/deletecommit=true Thanks, this worked first time. Kind regards, Roland On Wed, Sep 7, 2011 at 10:48 AM, Roland Tollenaar

Synonyms problem

2011-09-07 Thread roySolr
hello, I have some problems with synonyms. I will show some examples to descripe the problem: Data: High school Lissabon High school Barcelona University of applied science When a user search for IFD i want all the results back. So i want to use this synonyms at query time: IFD = high school

Re: logging client ip address

2011-09-07 Thread dan sutton
Does anyone know how I would be able to include the client ip address for tomcat 6 with log4j? Cheers, Dan On Wed, Sep 7, 2011 at 11:03 AM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Wed, Sep 7, 2011 at 2:56 PM, dan sutton danbsut...@gmail.com wrote: Hi, We're using log4j with

Re: Synonyms problem

2011-09-07 Thread Ahmet Arslan
Simply multi-word synonyms are recommended to use at index time. As explained here: http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.SynonymFilterFactory --- On Wed, 9/7/11, roySolr royrutten1...@gmail.com wrote: From: roySolr royrutten1...@gmail.com Subject: Synonyms

Re: logging client ip address

2011-09-07 Thread Markus Jelsma
You could configure your proxy or application to send any key/value pair not being using by Solr. Solr will ignore the parameter but still log it as part of params={}. We use this to send various pieces of information that's being analyzed later together with the query information. On

Re: Reading results from FieldCollapsing

2011-09-07 Thread Erick Erickson
I think it's getGroupResponse, not getGroupedResponse I was looking at source I just got this morning... Best Erick On Wed, Sep 7, 2011 at 3:32 AM, Sowmya V.B. vbsow...@gmail.com wrote: Hi Martjin Sorry for a late response. I did take the latest Solr build last week. After the new

Re: Reading results from FieldCollapsing

2011-09-07 Thread Sowmya V.B.
Hi Erick Both methods don't exist in the jar(apache-solr-solrj-3.4-SNAPSHOT.jar) file. I did notice getGroupResponse() method in the QueryResponse.java file in the src directory though. But, it did not show up in the Jar file I got after compiling the source. Sowmya. On Wed, Sep 7, 2011 at 1:27

Re: how to run solr in apache server?

2011-09-07 Thread Markus Jelsma
You can only run Solr embedded in a Java application (not recommended) or in some servlet container such as Tomcat, Jetty etc. On Wednesday 07 September 2011 13:40:50 nagarjuna wrote: Hi everybody... can anybody tell me how to run solr on Apache server(not apache tomcat)

Re: Solr 1.4.1: problems with replication and index operation both at the same time.

2011-09-07 Thread Erick Erickson
Hmmm, why all those tomcats? Are they all running Solr? I'm pretty sure you'd be a lot better off simply having one indexer and one searcher on this box. Give the searcher the most resources I'd guess. In fact, you'd be even better off offloading the indexing process to a different (perhaps less

RE: how to run solr in apache server?

2011-09-07 Thread Moore, Gary
Solr only runs in a container. To make it appear as if Solr is running on httpd, Google 'httpd tomcat' for instructions on how to front tomcat with httpd mod_jk or mod_proxy. Our system admins prefer mod_proxy. Not sure why you'd need to front Solr with httpd since it's usually an

RE: how to run solr in apache server?

2011-09-07 Thread nagarjuna
so finally what do u say ? we cant run solr in apacheHTTP serverit is possible only with servlet containeram i right? can u pls explain other than tomcat and jetty which containers will support to run solr? -- View this message in context:

Re: Reading results from FieldCollapsing

2011-09-07 Thread Erick Erickson
How were you looking for it? The QueryResponse class exists, and the method is available on an instance of that class in an IDE. As I said I got a copy this morning. But 'jar tvf apache-solr-solrj-3.4-SNAPSHOT.jar' won't show you the method, just the class existence. Best Erick On Wed, Sep 7,

RE: Synonyms Not Working when using SRC DEST

2011-09-07 Thread Jaeger, Jay - DOT
I have a very huge schema spanning up to 10K lines , if I use query time it will be huge hit for me because one term will be mapped to multiple terms . similar in the case of allergy I think maybe you mean synonym file, rather than the schema? I doubt that the number of lines matters all

Re: how to run solr in apache server?

2011-09-07 Thread Erick Erickson
Please look at this page: http://wiki.apache.org/solr/SolrInstall. Near the bottom there is a list of tips for setting up Solr in various containers. Will one of them work for you? But if you're just starting, why not make it easy and start with the example that is already set up to run in Jetty?

Re: maximum rows for dataimport using solrj

2011-09-07 Thread Tobias Rübner
Thanks for your quick response. The reason why I am using the debug mode is to dynamically add a data config with my request. I want to create a new core and add a new configuration to index a new database with the DIH, without changing the solrconfig.xml. Do you see any other options? tob

RE: Sentence aware Highlighter

2011-09-07 Thread O. Klein
Not truncating terms anymore is a good first step. Ill be looking forward to your solution Koji. A real SentenceAwareFragmentsBuilder is probably too difficult to make. But maybe someone can implement the RegexFragmenter functionality for FVH. -- View this message in context:

Re: Reading results from FieldCollapsing

2011-09-07 Thread Sowmya V.B.
Hi Erick I was looking the .Java file in the Src folder (... apache-solr-3.4-2011-08-29_18-09-28/solr/solrj/src/java/org/apache/solr/client/solrj/response/QueryResponse.java) to make sure that the method getGroupResponse() exists in the source code. After adding the Solrj jar file to my

RE: Synonyms Not Working when using SRC DEST

2011-09-07 Thread Jaeger, Jay - DOT
Also, just to make one thing just a bit more clear. You can specify two different kinds of entries in synonym files. See http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters (solr.SynonymFilterFactory) One is replacement, where the words before the = are *replaced* by the right

Re: maximum rows for dataimport using solrj

2011-09-07 Thread Erick Erickson
Hossman just posted this, does it help? You should be able to paramaterize hte table name in the SQL using a request parameter... https://wiki.apache.org/solr/DataImportHandler#Accessing_request_parameters Best Erick On Wed, Sep 7, 2011 at 9:00 AM, Tobias Rübner d...@tobr.eu wrote: Thanks

Re: how to run solr in apache server?

2011-09-07 Thread nagarjuna
Thank u very much for ur grateful suggestion Erick Erickson. actually i know whole process of running solr in tomcat,jetty and right now i am using solr with jetty but, my requirement made me to search the process of running solr in Apache HTTP serverbut ultimately i got the point

RE: Sentence aware Highlighter

2011-09-07 Thread O. Klein
I just stumbled upon https://issues.apache.org/jira/browse/LUCENE-1822 maybe this can help too? -- View this message in context: http://lucene.472066.n3.nabble.com/Sentence-aware-Highlighter-tp3310982p3316619.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Reading results from FieldCollapsing

2011-09-07 Thread Sowmya V.B.
Hi Erick does it compile? Are you absolutely sure you've pathed to the proper jar file? Did you check that the jar file that Eclipse is looking at has been rebuilt after you got the new code? -the webapp does not throw compilation errors. The very fact that I am able to declare a GroupResponse

Re: maximum rows for dataimport using solrj

2011-09-07 Thread Tobias Rübner
Thanks Erik, but I want to change the whole configuration to e.g. connect to an other database. So there is also the need to add/remove (sub-)entities to resolve database relations. tob On Wed, Sep 7, 2011 at 3:04 PM, Erick Erickson erickerick...@gmail.comwrote: Hossman just posted this, does

RE: how to run solr in apache server?

2011-09-07 Thread Jaeger, Jay - DOT
That is correct. Apache is not an *application* server. It is an HTTP *web* server. On its own it does not support running Java applications written to the JEE/J2EE servlet specification - like Solr. (Apache is also not written in Java, if that was what you meant). -Original

RE: how to run solr in apache server?

2011-09-07 Thread Jaeger, Jay - DOT
Other containers that will support Solr: just about any JEE/J2EE container. We have tested under WebSphere Application Server Version 7 -- works fine. Oracle's web application server would presumably work, too -- just about anything. -Original Message- From: nagarjuna

RE: how to run solr in apache server?

2011-09-07 Thread nagarjuna
Thank u for ur reply Jaeger, Jay - DOT. so i can conclude that solr will run only on application servers(having servlet containers) and not in web servers am i correct? and i have one more question is it possible to add servlet container to the web servers? -- View

Re: Synonyms Not Working when using SRC DEST

2011-09-07 Thread balaji
So, if instead of: allergy test = Doctors, Doctors-Medical, PHYSICIANS, Physicians Surgeons You specified allergy test = allergy test, Doctors, Doctors-Medical, PHYSICIANS, Physicians Surgeons I followed the above approach allergy test = allergy test, Doctors, Doctors-Medical,

RE: how to run solr in apache server?

2011-09-07 Thread Jaeger, Jay - DOT
is it possible to add servlet container to the web servers? Some JEE/J2EE web application servers work well downstream of an HTTP server. WebSphere application server has that capability. Tomcat has that ability as well, according to the information at

Re: Reading results from FieldCollapsing

2011-09-07 Thread Sowmya V.B.
Hi Erick It was indeed an eclipse issue! Thanks for saying that. I cleaned the project, restarted eclipse and built again...and I can see the getGroupResponse() method in the intellisense. I don't understand why eclipse did that...and what happened in a restart...but, I now see the method.

running SOLR on same server as your website

2011-09-07 Thread okayndc
Hi everyone! Is it not a good practice to run SOLR on the same server where you website files sit? Or is it a MUST to house SOLR on it's own application server? The problem that I'm facing is that, my website's files sit on a servlet container (Tomcat) and I think it would be more convenient to

Re: running SOLR on same server as your website

2011-09-07 Thread Erik Hatcher
It's not necessarily a bad idea... as long as you secure it properly such that user requests cannot hit Solr, only requests from your application can do so. Eventually, perhaps, scale would be an issue and you'd want/need to separate the tiers, but as long as you've got security and scalability

Re: running SOLR on same server as your website

2011-09-07 Thread okayndc
In the context of application, I assume that you mean SOLRJ (for example)? On Wed, Sep 7, 2011 at 10:04 AM, Erik Hatcher erik.hatc...@gmail.comwrote: It's not necessarily a bad idea... as long as you secure it properly such that user requests cannot hit Solr, only requests from your

RE: running SOLR on same server as your website

2011-09-07 Thread Jaeger, Jay - DOT
You could host Solr inside the same Tomcat container, or in a different servlet container (say, a second Tomcat instance) on the same server. Be aware of your OS memory requirements, though: In my experience, Solr performs best when it has lots of OS memory to cache index files (at least, if

Re: running SOLR on same server as your website

2011-09-07 Thread okayndc
Right now, the index is relatively small in size ~less than 1mb. I think right now, it's okay but, a couple years down the road, we may have to transfer SOLR onto a separate application server. On Wed, Sep 7, 2011 at 10:15 AM, Jaeger, Jay - DOT jay.jae...@dot.wi.govwrote: You could host Solr

RE: running SOLR on same server as your website

2011-09-07 Thread Tim Gilbert
Just make sure that outside users can't talk directly to your solr instance. If they can talk to Solr, they can add/delete documents which will affect your site. Tim -Original Message- From: okayndc [mailto:bodymo...@gmail.com] Sent: Wednesday, September 07, 2011 10:45 AM To:

MMapDirectory failed to map a 23G compound index segment

2011-09-07 Thread Rich Cariens
Ahoy ahoy! I've run into the dreaded OOM error with MMapDirectory on a 23G cfs compound index segment file. The stack trace looks pretty much like every other trace I've found when searching for OOM map failed[1]. My configuration follows: Solr 1.4.1/Lucene 2.9.3 (plus

Re: MMapDirectory failed to map a 23G compound index segment

2011-09-07 Thread François Schiettecatte
My memory of this is a little rusty but isn't mmap also limited by mem + swap on the box? What does 'free -g' report? François On Sep 7, 2011, at 12:25 PM, Rich Cariens wrote: Ahoy ahoy! I've run into the dreaded OOM error with MMapDirectory on a 23G cfs compound index segment file. The

Re: Spellcheck

2011-09-07 Thread Gora Mohanty
On Wed, Sep 7, 2011 at 3:47 PM, Danicela nutch danicela-nu...@mail.com wrote: I just tried to start the data from scratch, I deleted Nutch segments and solr/data/index files, but it changed nothing. Maybe I should delete other elements ? [...] Hi, Following up from your message on the Nutch

Sorting groups by numFound group size

2011-09-07 Thread bobsolr
Hi, I'm using this sample query to group the result set by category: q=testgroup=truegroup.field=category This works as expected and I get this sample response: response: {numFound:1,start:0,docs:[ { ... } {numFound:6,start:0,docs:[ { ... }

SolrCloud and TermsComponent

2011-09-07 Thread Jamie Johnson
I took a quick look at TermsComponent and noticed that it works with distributed queries but it doesn't seem to work with distrib=true. Am I missing something, have there been any updates to this to get this to work with SolrCloud?

Re: Sorting groups by numFound group size

2011-09-07 Thread Martijn v Groningen
Sorting groups by numfound isn't possible. You can sort groups by specifying a function or a field (from your schema) in the sort parameter. The numFound isn't a field so that is why you can't sort on it. Martijn On 7 September 2011 08:17, bobsolr xbvbvccvb...@hotmail.com wrote: Hi, I'm

Solr Cloud - is replication really a feature on the trunk?

2011-09-07 Thread Pulkit Singhal
Hello, I'm working off the trunk and the following wiki link: http://wiki.apache.org/solr/SolrCloud The wiki link has a section that seeks to quickly familiarize a user with replication in SolrCloud - Example B: Simple two shard cluster with shard replicas But after going through it, I have to

Re: SolrCloud and TermsComponent

2011-09-07 Thread Mark Miller
On Sep 7, 2011, at 2:48 PM, Jamie Johnson wrote: I took a quick look at TermsComponent and noticed that it works with distributed queries but it doesn't seem to work with distrib=true. Am I missing something, have there been any updates to this to get this to work with SolrCloud? Are you

grouping by alpha-numeric field

2011-09-07 Thread alxsss
Hello, I try to group by a field with type string. In the results I see groupValues as parts of the group field. Any ideas how to fix this. Thanks. Alex.

Re: SolrCloud and TermsComponent

2011-09-07 Thread Jamie Johnson
I have a snapshot of trunk from some time ago, I'll check the latest code thanks for the reply On Wed, Sep 7, 2011 at 3:39 PM, Mark Miller markrmil...@gmail.com wrote: On Sep 7, 2011, at 2:48 PM, Jamie Johnson wrote: I took a quick look at TermsComponent and noticed that it works with

Re: Sorting groups by numFound group size

2011-09-07 Thread bobsolr
Hi Martijn, Thanks for the reply. Unfortunately I can't reference the group size using a function or by specifying a schema field, although I use those methods to sort docs within a group. Do you know if sort by group size is available/planned for a future release of solr(maybe 4.0)? if so, it

synonyms.txt: different results on admin and on site..

2011-09-07 Thread deniz
hi all... i have checked the list about the issue in the title, but couldnt find any related info... so my problem is: i change sysnonyms.txt and then reload the core without restarting the server. new synonyms works smoothly if i use admin interface of solr, however when i use the site which is

Re: Solr Cloud - is replication really a feature on the trunk?

2011-09-07 Thread Yury Kats
On 9/7/2011 3:18 PM, Pulkit Singhal wrote: Hello, I'm working off the trunk and the following wiki link: http://wiki.apache.org/solr/SolrCloud The wiki link has a section that seeks to quickly familiarize a user with replication in SolrCloud - Example B: Simple two shard cluster with

Re: synonyms.txt: different results on admin and on site..

2011-09-07 Thread deniz
could it be related with analysis issue about synonyms once again? - Zeki ama calismiyor... Calissa yapar... -- View this message in context: http://lucene.472066.n3.nabble.com/synonyms-txt-different-results-on-admin-and-on-site-tp3318338p3318464.html Sent from the Solr - User mailing

Re: synonyms.txt: different results on admin and on site..

2011-09-07 Thread Rob Casson
you should probably post your schema.xml and some parts of your synonyms.txt. it could be differences between your index and query analysis chains, synonym expansion errors, etc, but folks will likely need more details to help you out. cheers, rob On Wed, Sep 7, 2011 at 9:46 PM, deniz

Re: synonyms.txt: different results on admin and on site..

2011-09-07 Thread deniz
well yea you are right... i realised that lack of detail issue here... so here it comes... This is from my schema.xml and basically i have a