Re: Large Index and OutOfMemoryError: Map failed

2012-03-31 Thread Michael McCandless
It's the virtual memory limit that matters; yours says unlimited below (good!), but, are you certain that's really the limit your Solr process runs with? On Linux, there is also a per-process map count: cat /proc/sys/vm/max_map_count I think it typically defaults to 65,536 but you should

Solr caching memory consumption Problem

2012-03-31 Thread Suneel
Hello friends, I am using DIH for solr indexing. I have 60 million records in SQL which need to upload on solr. i started caching its smoothly working and memory consumption is normal, But after some time incrementally memory consumption going high and process reach more then 6 gb. that the

Content privacy, search index

2012-03-31 Thread dbenjamin
Hi, I'm relatively new to Solr, new in the way that i already used Solr several times but always with a very simple approach, meaning simple fulltext search with faceting and filtering. Today, i've to go a bit further and before i do, i'd like to get your point of view ;-) I need to index users

Re: How do I use localparams/joins using SolrJ and/or the Admin GUI

2012-03-31 Thread Erick Erickson
Try escaping the '+' with %2B (as I remember). Your stack trace didn't come through, at least by the time it got to my mail so Im guessing a bit. Best Erick On Fri, Mar 30, 2012 at 5:33 PM, vybe3142 vybe3...@gmail.com wrote: Here's a JOIN query using local params that I can sucessfully

Re: How do I use localparams/joins using SolrJ and/or the Admin GUI

2012-03-31 Thread Yonik Seeley
On Sat, Mar 31, 2012 at 11:50 AM, Erick Erickson erickerick...@gmail.com wrote: Try escaping the '+' with %2B (as I remember). Shouldn't that be the other way? The admin UI should do any necessary escaping, so those + chars should instead be a spaces? -Yonik lucenerevolution.com - Lucene/Solr

Re: Content privacy, search index

2012-03-31 Thread Erick Erickson
The second option is actually possible, and actually easiest in terms of letting Solr do the most work. Presumably you have some web-app facing the user, you could pre-calculate the list of authorized viewers there on some kind of session basis. Be careful, however, that this list of IDs doesn't

Re: How do I use localparams/joins using SolrJ and/or the Admin GUI

2012-03-31 Thread Erick Erickson
Gh, of course it should be the other way. That'll teach me to not try to listen to wait wait, don't tell me and reply to the list at the same time... Thanks, Erick On Sat, Mar 31, 2012 at 12:01 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Sat, Mar 31, 2012 at 11:50 AM, Erick

Re: Solr Tomcat Install

2012-03-31 Thread CCS Talk - PJ Villarta
i also encountered this same problem during an installation. i found out that the config.xml file was a malformed XML document. you might want to check there. - Original Message - From: rdancy To: solr-user@lucene.apache.org Sent: Thursday, March 29, 2012 1:20 AM Subject:

ExtractingRequestHandler

2012-03-31 Thread spring
Hi, I want to index various filetypes in solr, this can easily done with ExtractingRequestHandler. But I also need the extracted content back. I know ext.extract.only but then nothing gets indexed, right? Can I index the document AND get the content back as with ext.extract.only? In a single

RE: Client-side failover with SolrJ

2012-03-31 Thread spring
Did you try http://lucene.apache.org/solr/api/org/apache/solr/client/solrj /impl/LBHttpSolrServer.html? This might be what you're looking for. Cool! Thx!

Re: Content privacy, search index

2012-03-31 Thread dbenjamin
Hi Erick and thanks for the quick reply. Well, my intend would not to index all content elements with its own list of authorized users IDs. I was thinking more of something like I index the contents and the users + their friend list separatly, and then being able somehow to ask Solr to filter

Re: Content privacy, search index

2012-03-31 Thread Paul Libbrecht
Benjamin, I think implementing a QueryHandler that adds the necessary query is the right way to do that. It'd transform a query for a b into +(a b) +(authorizedBit) (to use the language of the default QueryParser but please not by substring, using the real query objects!). Recalculating the

RE: Content privacy, search index

2012-03-31 Thread spring
- Is it the best way to do that ? - It's obvious that i need to index the registered users in Solr (because an user can search for others), but is it clever to index friend list for each user as well ? (if we take a look at the search box on Facebook, or other any sexy social network,

RE: 400 Error adding field 'tags'='[a,b,c]'

2012-03-31 Thread jlark
[Solved] Turns out the text field I was copying all these to was not multivalued! make sure that if you're copying multiple fields to a single field that the single field has multivalued=true. phew. Thanks for the Help. Date: Thu, 15 Mar 2012 03:19:15 -0700 From:

Determining individual Field matches within a SolrRequestHandler or SearchComponent

2012-03-31 Thread Joshua Sumali
Hi, Is it possible to easily and programmatically determine whether one or more solr fields were a successful match within a SolrRequestHandler or SearchComponent? The DebugComponent provides similar text output when debugging/explaining a query: 8.249506 = (MATCH)