Differences in debugQuery and results

2011-12-21 Thread roySolr
Hello, I have some configuration problems and can't get it working. I see some differences with the debugQuery. I search for: w.j ((DisjunctionMaxQueryname1_search:w name1_search:j)^5.0) | ((name2_search:w name2_search:j)^5.0))~1.0) I search for: w j

blocking access by user-agent

2011-12-21 Thread RT
Hi, I would like to control what applications get access to the solr database. I am using jetty as the appcontainer. Is this at all achievable? If yes, how? Internet search has not yielded anything I could use so far. Thanks in advance. Roland

Re: blocking access by user-agent

2011-12-21 Thread Patrick Plaatje
Hi Roland, you can configure Jetty to use a simple .htaccess file to allow only specific IP adresses access to your webapp. Have a look here on how to do thta: http://www.viaboxxsystems.de/how-to-configure-your-jetty-webapp-to-grant-access-for-dedicated-ip-addresses-only If you want more

Re: blocking access by user-agent

2011-12-21 Thread RT
Thanks Patrick, Would you have any idea in what directory to place the .htaccess file to block all information retrieval? I am not sure HTAccessHandler of jetty supports all its commands. This site however implies that it does have the ones for user-agent blocking. :

Querying on dynamic field

2011-12-21 Thread Isan Fulia
Hi, I hava a dynamic field E_* I want to seach for E_abc*:something Is there any way i can do this in solr. If not possible in Solr 3.4 , does Solr 4.0 includes wildcard query on dynamic field. -- Thanks Regards, Isan Fulia.

Re: Mapping and Capture in ExtractingRequestHandler

2011-12-21 Thread Erick Erickson
Googling 'solrj examples' points right to a great example here: http://wiki.apache.org/solr/Solrj Best Erick On Wed, Dec 21, 2011 at 12:04 AM, Swapna Vuppala swapna.vupp...@arup.com wrote: Hi Erick, Can you please give me little more information about SolrJ program and how to use it to

Re: disable stemming on query parser.

2011-12-21 Thread Erick Erickson
Actually, 1M records isn't all that much for a Solr index, so I'd simply test with the copyfield alternative as it's much easier. About compression: this simply compresses the *stored* data, which has essentially no effect on index search speed, but will affect the size of the file (*.fdt) that

Solr 3.5 | Highlighting

2011-12-21 Thread Tanguy Moal
Dear all, I'm try to get highlighting working, and I'm almost done, but that's not perfect yet... Basically my documents have a title and a description. I have two kind of text fields : text : fieldType name=text class=solr.TextField positionIncrementGap=100 analyzer type=index tokenizer

Re: disable stemming on query parser.

2011-12-21 Thread meghana
Hi, So we need to find that solr patch , which do add special character on word , which i index. i like to add here, that the my copy field is multivalued field, with many sentences. so do it add special character at each word of that? and for compression, Erik yes, i am storing my copy field

Re: disable stemming on query parser.

2011-12-21 Thread meghana
Hi, So we need to find that solr patch , which do add special character on word , which i index. i like to add here, that the my copy field is multivalued field, with many sentences. so do it add special character at each word of that? and for compression, Erik yes, i am storing my copy field

Re: Where clause

2011-12-21 Thread Gora Mohanty
On Wed, Dec 21, 2011 at 4:58 PM, ayyappan ayyaba...@gmail.com wrote: In the information search in DB, the query has to be based on customer specific. Is it possible to change “where” clause value in select query based on the user who logged in. It is not clear what you are asking here? Which

Solr - Mutivalue field search on different elements

2011-12-21 Thread meghana
Hi all, i need to make a different search on multivalued field. for e.g. i have data as below arr name=xx strMichel/str strJackson/str stris/str strgood/str strsinger and dancer/str /arr if i search using Michel Jackson , then i want above displayed record should come in result

Re: a question on jmx solr exposure

2011-12-21 Thread Gora Mohanty
On Wed, Dec 21, 2011 at 3:26 PM, Dmitry Kan dmitry@gmail.com wrote: Hello list, This might be not the right place to ask the jmx specific questions, but I decided to try, as we are polling SOLR statistics through jmx. We currently have two solr cores with different schemas A and B being

Re: disable stemming on query parser.

2011-12-21 Thread Erick Erickson
Why do you think you require compression? It doesn't affect search. It should lengthen the document load time. You haven't told us how big your index is yet, so we can't judge a thing about whether you really need this or not. You haven't told us what your evidence is that the index size

Re: Solr - Mutivalue field search on different elements

2011-12-21 Thread Tanguy Moal
Hello, I think that the positionIncrementGap attribute of your field has to changed to 0 (instead of 100 by default). (See http://lucene.472066.n3.nabble.com/positionIncrementGap-in-schema-xml-td488338.html ) Hope this helps, -- Tanguy Le 21/12/2011 15:39, meghana a écrit : Hi all, i

Re: Exception using SolrJ

2011-12-21 Thread Shawn Heisey
On 12/21/2011 1:10 AM, Shawn Heisey wrote: On 12/20/2011 10:33 AM, Otis Gospodnetic wrote: Shawn, Give httping a try: http://www.vanheusden.com/httping/ It may reveal something about connection being dropped periodically. Maybe even a plain ping would show some dropped packets if it's a

RE: Spellchecker issue related to exact match of query in spellcheck index

2011-12-21 Thread Pravin Agrawal
Hi James, Thanks a lot for your reply. The workaround that you suggested is working fine of me. Hope to see this enhancement in future releases of solr. -Pravin From: Dyer, James [james.d...@ingrambook.com] Sent: Monday, December 19, 2011 11:11 PM To:

Replication not working

2011-12-21 Thread Dean Pullen
Hi all, I have an odd problem locally when attempting replication with solr 1.4 The problem is, though the master files get copied to a temp directory in the slave data directory (I see this happen at runtime), they are then not copied over the actual slave index data. We were wondering if it

Re: Replication not working

2011-12-21 Thread Dean Pullen
E.g. I see this in the slave logs: 2011-12-21 15:45:27,635 INFO handler.SnapPuller:265 - Master's version: 1271406570655, generation: 376 2011-12-21 15:45:27,635 INFO handler.SnapPuller:266 - Slave's version: 1271406571565, generation: 1286 2011-12-21 15:45:27,636 INFO handler.SnapPuller:267

Re: URLDataSource delta import

2011-12-21 Thread Alessandro Benedetti
Any News? I'm also interested in this topic :) 2011/12/12 Brian Lamb brian.l...@journalexperts.com Hi all, According to http://wiki.apache.org/solr/DataImportHandler#Usage_with_XML.2BAC8-HTTP_Datasource a delta-import is not currently implemented for URLDataSource. I say currently

Re: Querying on dynamic field

2011-12-21 Thread Tomás Fernández Löbbe
The only way I know is by using a copyfield at index time that copies everything from fields called E_* to a field with a known name, then use that field for searching. On Wed, Dec 21, 2011 at 9:41 AM, Isan Fulia isan.fu...@germinait.comwrote: Hi, I hava a dynamic field E_* I want to seach

Re: Replication not working

2011-12-21 Thread Erick Erickson
You've probably hit it on the head. The slave version is greater than the master version, so replication isn't necessary. BTW, the version starts life as a timestamp, but then is simply incremented on successive commits, which accounts for what you are seeing. You should be able to blow the index

Re: Solr Tomcat Maximum Heap Memory

2011-12-21 Thread Andre Bois-Crettez
Try running a 64bit JVM on your 64bits OS, it should work for much larger heaps sizes, be it Linux or Windows. Beware that the memory need is around 30% more important with a 64 bits JVM (bigger object pointers) if you are not using Compressed Oops :

Re: Replication not working

2011-12-21 Thread Dean Pullen
Thought as much, thanks for the reply. Is there an easy way of dropping the index on the slave, or do I have to manually delta the index files? Regards, Dean. On 21 Dec 2011, at 15:54, Erick Erickson wrote: You've probably hit it on the head. The slave version is greater than the master

Re: Replication not working

2011-12-21 Thread Dean Pullen
I can't see a way, if the slave is on another server. We're going to upgrade solr - as you can delete the index after unloading a core in this way: cores?action=UNLOADcore=liveCoredeleteIndex=true From v3.3 (I think) On 21 Dec 2011, at 16:11, Dean Pullen wrote: Thought as much, thanks for

Re: Exception using SolrJ

2011-12-21 Thread Chantal Ackermann
Hi Shawn, maybe the requests that fail have a certain pattern - for example that they are longer than all the others. Chantal

Re: Replication not working

2011-12-21 Thread Erick Erickson
Be careful deleting the index manually. Delete the entire index directory, i.e. the data dir has no index directory under it. About copying the index from the slave to the master, just shut down the master, delete all the files from the index, and use scp or something to copy the files in the

Re: Replication not working

2011-12-21 Thread Dean Pullen
I can't understand, then, how we could ever restore and get replication to work without manual intervention! Dean On 21 Dec 2011, at 16:37, Dean Pullen wrote: I can't see a way, if the slave is on another server. We're going to upgrade solr - as you can delete the index after unloading a

Re: Why is query result set caching disabled for grouping queries?

2011-12-21 Thread astubbs
Been looking at the code a bit, and it seems it's not disabled per se, it's just not there. The normal searcher has an inbuilt result set cache check before and after executing, where as the Grouping#execute doesn't have any concept of result cache. Can't they just share the same cache and

Re: Replication not working

2011-12-21 Thread Erick Erickson
You can't. But index restoration should be a very rare thing, or you have some lurking problem in your process. Or this is an XY problem, what problem are you trying to solve? see: http://people.apache.org/~hossman/#xyproblem Best Erick On Wed, Dec 21, 2011 at 12:21 PM, Dean Pullen

Re: Release build or code for SolrCloud

2011-12-21 Thread Dipti Srivastava
Hi Mark, I built the example and dist and ran the solrcloud.sh script. While running I get the following error... Is this ok? It appears that some of the instances got started though. --CLOUD--[ec2-user@ cloud_dev]$ ./solrcloud.sh ./solrcloud.sh: line 16: ant: command not found Exception in

best practice to introducing singletons inside of Solr (IoC)

2011-12-21 Thread Mikhail Khludnev
Hello, I need to introduce several singletons inside of Solr and make them available for my own SearchHandlers, Components, and even QParsers, etc. Right now I use some kind of fake SolrRequestHandler which loads on init() and available everywhere through

Re: Release build or code for SolrCloud

2011-12-21 Thread Dipti Srivastava
Ok, so the issue was that I had only copied the cloud_dev, example and dist directories and that¹s why some of the libraries were missing. I copied the build, lib as well and got around the issue. Now, I am getting this error when I run the script to start 6 nodes cluster. INFO: makePath:

[ann] Lily 1.1 is out

2011-12-21 Thread Steven Noels
Hi everybody, if you use 'HBase' and 'Solr' in one sentence, Lily might be worth checking out. It's a scalable data repository layering a high-level (i.e. easy-to-use) data model + API on top of HBase, and consistent, reliable maintenance of a configurable Solr index (which can optionally be

RE: Poor performance on distributed search

2011-12-21 Thread ku3ia
Hi! Today I'd added loginfo to Solr here: ~/solr-3.5/solr/core/src/java/org/apache/solr/servlet/SolrDispatchFilter.java to method private void writeResponse(SolrQueryResponse solrRsp, ServletResponse response, QueryResponseWriter responseWriter, SolrQueryRequest

Update schema.xml using solrj APIs

2011-12-21 Thread Ahmed Abdeen Hamed
Hello friend, I am new to Solrj and I am wondering if there is a away you can update the schema.xml file via the APIs. I would appreciate any help. Thanks very much, -Ahmed

Re: Release build or code for SolrCloud

2011-12-21 Thread Mark Miller
Hey Dipti - that error is normal - the script fires up a tmp zookeeper server to upload the conf files to. It then shuts that server down, which unfortunately logs this exception. Then the first Solr instance will run a zookeeper server. Uploading the configs ahead of time allows us to be sure the

Re: Solr 3.5 | Highlighting

2011-12-21 Thread Koji Sekiguchi
(11/12/21 22:28), Tanguy Moal wrote: Dear all, I'm try to get highlighting working, and I'm almost done, but that's not perfect yet... Basically my documents have a title and a description. I have two kind of text fields : text : fieldType name=text class=solr.TextField

Re: Release build or code for SolrCloud

2011-12-21 Thread Dipti Srivastava
Hi Mark, Thanks! So now I am deploying a 4 node cluster on AMI's and the main instance that bootstraps the config to the zookeeper does not come up I get an exception as follows. My solrcloud.sh looks like #!/usr/bin/env bash cd .. rm -r -f example/solr/zoo_data rm -f example/example.log cd

Re: Update schema.xml using solrj APIs

2011-12-21 Thread Otis Gospodnetic
Ahmed, At this point in time - no.  You need to edit it manually and restart Solr to see the changed. This will change in the future. Otis Performance Monitoring SaaS for Solr - http://sematext.com/spm/solr-performance-monitoring/index.html From: Ahmed

Re: Solr - Mutivalue field search on different elements

2011-12-21 Thread meghana
Hi Tanguy, Thanks for your reply.. this is really useful. but i have one questions on that. my multivalued field is not just simple text. it has values like below str1s:[This is very nice day.]/str str3s:[Christmas is about come and christmas]/str str4s:[preparation is just on ]/str

Re: Exception using SolrJ

2011-12-21 Thread Shawn Heisey
On 12/20/2011 10:33 AM, Otis Gospodnetic wrote: Shawn, Give httping a try: http://www.vanheusden.com/httping/ It may reveal something about connection being dropped periodically. Maybe even a plain ping would show some dropped packets if it's a general network and not a Solr-specific issue.

a question on jmx solr exposure

2011-12-21 Thread Dmitry Kan
Hello list, This might be not the right place to ask the jmx specific questions, but I decided to try, as we are polling SOLR statistics through jmx. We currently have two solr cores with different schemas A and B being run under the same tomcat instance. Question is: which stat is jconsole

Re: disable stemming on query parser.

2011-12-21 Thread meghana
Hi Dmitry , If we add some unseen character sequence to array , doesn't it remove my stemming at all time? how we can manage stemmed and unstemmed words in the same field? i am a bit confused on this. also i tried with making compression on a field, which i use for copy field, what i read

Solr Tomcat Maximum Heap Memory

2011-12-21 Thread Husain, Yavar
I know this is a Solr forum however my problem is related to Solr running on Tomcat running on Windows 64 bit OS. I am running a 32 bit JVM on a 64 bit Windows 2008 Server. The max heap space I am able to allocate is around 1.5 GB though I have 10 GB of RAM on my system and there is no other

Re: a question on jmx solr exposure

2011-12-21 Thread Dmitry Kan
Solved by exposing jmx only on one of the cores, as it is of a more interest than the other one. Dmitry On Wed, Dec 21, 2011 at 11:56 AM, Dmitry Kan dmitry@gmail.com wrote: Hello list, This might be not the right place to ask the jmx specific questions, but I decided to try, as we are

solr.home

2011-12-21 Thread Thomas Fischer
Hello, I'm trying to move forward with my solr system from 1.4 to 3.5 and ran into some problems with solr home. Is this a known problem? My solr 1.4 gives me the following messages (amongst many many others…) in catalina.out: INFO: No /solr/home in JNDI INFO: using system property