Multiple shards for one collection on the same Solr server

2012-11-26 Thread Per Steffensen
Hi Before upgrading to Solr 4.0.0 we used to handle our collection creation ourselves, by creating each shards through the low-level CoreAdmin API. We used to create multiple shards under the same collection on each Solr server. Performance tests has shown that this is a good idea, and it is

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Mark Miller
The Collections API was fairly rushed - so that 4.0 had something easier than the CoreAdmin API. Due to that, it has a variety of limitations: 1. It only picks instances for a collection one way - randomly from the list of live instances. This means it's no good for multiple shards on the same

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Per Steffensen
Mark Miller skrev: The Collections API was fairly rushed - so that 4.0 had something easier than the CoreAdmin API. Yes I see. Our collection-creation code is more sophisticated than yours. We probably would like to migrate to the Solr Collection API now anyway - to be using it already when

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Mark Miller
On Mon, Nov 26, 2012 at 9:55 AM, Per Steffensen wrote: > Well I would like to jump in with respect to making support for running > several shards of the same collection on the same instance, it is just so > damn hard to get you to commit stuff :-) A lot of the problem is time limitations for me p

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Per Steffensen
Of course I understand everything you say. We are just using Solr very intensively in my current project and we want to do big changes and when we make them we test them very thoroughly - so we are pretty sure they work as they are supposed to, but of course that is hard to see on your side, be

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Mark Miller
On Nov 26, 2012, at 11:51 AM, Per Steffensen wrote: > I am a very experinced programmer with a long record as architect, designer, > mentor etc. Is there a chance that I could become committer? You will end up > happy - and so will I! :-) You have to build up enough merit in the project to ge

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Per Steffensen
Ok thanks. Guess you are not ready to nominate me for now. But who are the nominators? Are you a nominator, Mark? And how to get nominated - do I have to ask (as I did today) or do I just have to wait until a nominator gets the idea about me as a committer by himself? Regards, Per Steffensen

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Mark Miller
The nominators are generally the committers on the lucene and solr projects. There is a list of those on the website under "Who We Are". Yes, I am one. The PMC then votes - there is also a list of who is on the PMC on the website. The history is, generally you just wait to be nominated. Everyone

Re: Multiple shards for one collection on the same Solr server

2012-11-26 Thread Otis Gospodnetic
Per - keep contributing. Your contributions so far have not gone unnoticed - you've been spotted. At least from here in New York. :) Otis -- SOLR Performance Monitoring - http://sematext.com/spm/index.html Search Analytics - http://sematext.com/search-analytics/index.html On Mon, Nov 26, 201

Re: Multiple shards for one collection on the same Solr server

2012-11-27 Thread Per Steffensen
Well I have created issue SOLR-4114 on the subject. Patch comming up. Regards, Per Steffensen Per Steffensen skrev: Mark Miller skrev: The Collections API was fairly rushed - so that 4.0 had something easier than the CoreAdmin API. Yes I see. Our collection-creation code is more sophistica