Re: custom hashing across cloud & shards

2013-08-20 Thread kmccork
But this discussion says that if you don't specify numshards, you can still have shards and you can have custom hashing http://lucene.472066.n3.nabble.com/Solr-4-1-Custom-Hashing-DIH-td4036316.html, and I'm pretty sure I've read that elsewhere as well. Does anyone have more info

Re: custom hashing across cloud & shards

2013-08-19 Thread Erick Erickson
rse if you have the bandwidth to help on that JIRA I'm sure Joel & Mark would appreciate it. Best Erick On Mon, Aug 19, 2013 at 6:26 PM, Katie McCorkell wrote: > Hey All, > > If you don't specify numShards at the start, then you can do custom > hashing, because Solr will

custom hashing across cloud & shards

2013-08-19 Thread Katie McCorkell
Hey All, If you don't specify numShards at the start, then you can do custom hashing, because Solr will just write the document to whatever shard you send it to. However, when I don't specify numshards, I'm having trouble creating more than one shard. It makes one shard and the o

Re: Custom Hashing

2013-07-08 Thread Erick Erickson
ex some documents together . > For this, I want chang hash function by my logic . > > by SOLR-2592, I can add to solrconfig. > > This doesn't working. > > I need change hash function. > Does exist some solution for this? > > TNX > > > > > -- > View

Custom Hashing

2013-07-07 Thread lampa24
TNX -- View this message in context: http://lucene.472066.n3.nabble.com/Custom-Hashing-tp4076066.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread Yonik Seeley
On Fri, Jan 25, 2013 at 4:09 PM, davers wrote: > I'm not sure I understand. I thought ID had to be unique. Right - the group becomes part of the ID (the prefix), not the whole ID. > for example > I have the following > > [ > { "id" : 1, "groupid" : 1 }, > { "id" : 2, "groupid" : 1}, > { "id" : 3

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread davers
the same shard using the ID ? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-1-Custom-Hashing-DIH-tp4036316p4036354.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread Yonik Seeley
On Fri, Jan 25, 2013 at 3:59 PM, davers wrote: > I want to shard on groupid instead of id but it doesn't seem to be working. That's not yet implemented. Currently you need to put the group in the ID. From the release notes: * Simple multi-tenancy through enhanced document routing: - The "comp

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread davers
ucene.472066.n3.nabble.com/Solr-4-1-Custom-Hashing-DIH-tp4036316p4036352.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread Mark Miller
On Jan 25, 2013, at 3:15 PM, davers wrote: > I am using the coreadmin to assign nodes to the cluster. How can I tell the > collection how many shards it has without using the collections api or > boostrapping > On the first CoreAdmin API call that creates a core, pass the numShards param. The

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread davers
I am using the coreadmin to assign nodes to the cluster. How can I tell the collection how many shards it has without using the collections api or boostrapping -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-1-Custom-Hashing-DIH-tp4036316p4036340.html Sent from the

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread Yonik Seeley
noticed that my documents always > end up on the shard that I run the DIH on. I'm assuming this has something > to do with the changes to allow custom hashing. It does... if you create your cluster using numShards=N, then ranges will be created for each shard and that will be respec

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread davers
Also this doesn't seem like a problem with DIH specifically. I tried doing JSON updates with the same result. Documents are only added to the shard that I send the updates to. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-1-Custom-Hashing-DIH-tp4036316p4036332

Re: Solr 4.1 Custom Hashing DIH

2013-01-25 Thread davers
So is this a problem with the DIH not respecting sharding? This was not a problem for me in 4.0 with the same configuration. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-1-Custom-Hashing-DIH-tp4036316p4036321.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr 4.1 Custom Hashing DIH

2013-01-25 Thread davers
on. I'm assuming this has something to do with the changes to allow custom hashing. How do I use custom hashing? Basically I want to reproduce the functionality of how Solr 4.0 would hash and distribute the updates automatically but I don't want to use ID for the hashing function I w