Re: Limit on having number of nodes in C* cluster

2017-08-22 Thread Jeff Jirsa 
You can't, you typically need to add a whole new datacenter, replicate your 
data and traffic there, and decommission the old one 

-- 
Jeff Jirsa


> On Aug 22, 2017, at 8:56 AM, techpyaasa .  wrote:
> 
> How can I decrease tokens for existing nodes?
> Doesn't it create problem?
> 
> 
> On Aug 22, 2017 7:22 PM, "Vladimir Yudovin"  wrote:
> Probably decreasing tokens number can help to mange big cluster?
> 
> Best regards, Vladimir Yudovin, 
> Winguzone - Cloud Cassandra Hosting
> 
> 
>  On Mon, 21 Aug 2017 19:38:37 -0400 Eduard Tudenhoefner 
>  wrote 
> 
> We've been doing successful testing with multi-DC setups and 500 nodes per 
> DC. However, I agree with Jon here. Certain things are easier/faster with 
> e.g. 5x100 node clusters than 1x500 node cluster.
> 
> Cheers
> 
> On Mon, Aug 21, 2017 at 10:16 AM, Jon Haddad  
> wrote:
> As far as I know, those 75K nodes are not in a single cluster.  If memory 
> serves correctly (and this article seems to indicate that it does 
> http://www.techrepublic.com/article/apples-secret-nosql-sauce-includes-a-hefty-dose-of-cassandra/),
>  you’ll see clusters of 1,000 nodes.  
> 
> Things start to get a little hairy once you go above a couple hundred nodes.  
> I would rather run 5 100 node clusters than a single 500 node cluster.  In 
> theory, once you’ve built out the tooling to manage 2 clusters you should be 
> able to apply it to manage 20 (reality always gets in the way though…)
> 
> Jon
> 
> On Aug 21, 2017, at 9:15 AM, techpyaasa .  wrote:
> 
> Thanks lot for reply :)
> 
> On Aug 21, 2017 6:44 PM, "Vladimir Yudovin"  wrote:
> 
> Actually there are clusters of thousandths nodes: Some of the largest 
> production deployments include Apple's, with over 75,000 nodes storing over 
> 10 PB of data
> 
> Best regards, Vladimir Yudovin, 
> Winguzone - Cloud Cassandra Hosting
> 
> 
>  On Mon, 21 Aug 2017 08:35:37 -0400 techpyaasa .  
> wrote 
> 
> Hi 
> 
> Is there any limit on having number of nodes in c* cluster.
> Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups & each 
> group has 21 nodes.
> 
> We wanted to increase the cluster capacity by adding 6 nodes per group as 
> many of nodes disk usage crossed 65%.
> 
> So just wanted to clarify is there any limit/drawback having huge cluster/too 
> many nodes in a c* cluster
> 
> Thanks in advance
> TechPyaasa
> 
> 
> 
> 
> 
> 
>

Re: Limit on having number of nodes in C* cluster

2017-08-22 Thread techpyaasa . 
How can I decrease tokens for existing nodes?
Doesn't it create problem?


On Aug 22, 2017 7:22 PM, "Vladimir Yudovin"  wrote:

Probably decreasing tokens number
 can help to mange
big cluster?

Best regards, Vladimir Yudovin,
*Winguzone  - Cloud Cassandra Hosting*


 On Mon, 21 Aug 2017 19:38:37 -0400 *Eduard Tudenhoefner
>*
wrote 

We've been doing successful testing with multi-DC setups and 500 nodes per
DC. However, I agree with Jon here. Certain things are easier/faster with
e.g. 5x100 node clusters than 1x500 node cluster.

Cheers

On Mon, Aug 21, 2017 at 10:16 AM, Jon Haddad 
wrote:

As far as I know, those 75K nodes are not in a single cluster.  If memory
serves correctly (and this article seems to indicate that it does
http://www.techrepublic.com/article/apples-secret-
nosql-sauce-includes-a-hefty-dose-of-cassandra/), you’ll see clusters of
1,000 nodes.

Things start to get a little hairy once you go above a couple hundred
nodes.  I would rather run 5 100 node clusters than a single 500 node
cluster.  In theory, once you’ve built out the tooling to manage 2 clusters
you should be able to apply it to manage 20 (reality always gets in the way
though…)

Jon

On Aug 21, 2017, at 9:15 AM, techpyaasa .  wrote:

Thanks lot for reply :)

On Aug 21, 2017 6:44 PM, "Vladimir Yudovin"  wrote:


Actually there are clusters of thousandths nodes: Some of the largest
production deployments include Apple's, with over 75,000 nodes storing over
10 PB of data 

Best regards, Vladimir Yudovin,
*Winguzone  - Cloud Cassandra Hosting*


 On Mon, 21 Aug 2017 08:35:37 -0400 *techpyaasa . >* wrote 

Hi

Is there any limit on having number of nodes in c* cluster.
Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups & each
group has 21 nodes.

We wanted to increase the cluster capacity by adding 6 nodes per group as
many of nodes disk usage crossed 65%.

So just wanted to clarify is there any limit/drawback having huge
cluster/too many nodes in a c* cluster

Thanks in advance
TechPyaasa

Re: Limit on having number of nodes in C* cluster

2017-08-22 Thread Vladimir Yudovin 
Probably decreasing tokens number can help to mange big cluster?



Best regards, Vladimir Yudovin, 

Winguzone - Cloud Cassandra Hosting






 On Mon, 21 Aug 2017 19:38:37 -0400 Eduard Tudenhoefner 
eduard.tudenhoef...@datastax.com wrote 




We've been doing successful testing with multi-DC setups and 500 nodes per DC. 
However, I agree with Jon here. Certain things are easier/faster with e.g. 
5x100 node clusters than 1x500 node cluster.



Cheers



On Mon, Aug 21, 2017 at 10:16 AM, Jon Haddad jonathan.had...@gmail.com 
wrote:

As far as I know, those 75K nodes are not in a single cluster.  If memory 
serves correctly (and this article seems to indicate that it does 
http://www.techrepublic.com/article/apples-secret-nosql-sauce-includes-a-hefty-dose-of-cassandra/),
 you’ll see clusters of 1,000 nodes.  



Things start to get a little hairy once you go above a couple hundred nodes.  I 
would rather run 5 100 node clusters than a single 500 node cluster.  In 
theory, once you’ve built out the tooling to manage 2 clusters you should be 
able to apply it to manage 20 (reality always gets in the way though…)



Jon



On Aug 21, 2017, at 9:15 AM, techpyaasa . techpya...@gmail.com wrote:



Thanks lot for reply :)



On Aug 21, 2017 6:44 PM, "Vladimir Yudovin" vla...@winguzone.com wrote:



Actually there are clusters of thousandths nodes: Some of the largest 
production deployments include Apple's, with over 75,000 nodes storing over 10 
PB of data



Best regards, Vladimir Yudovin, 

Winguzone - Cloud Cassandra Hosting






 On Mon, 21 Aug 2017 08:35:37 -0400 techpyaasa . 
techpya...@gmail.com wrote 




Hi 



Is there any limit on having number of nodes in c* cluster.

Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups  each 
group has 21 nodes.



We wanted to increase the cluster capacity by adding 6 nodes per group as many 
of nodes disk usage crossed 65%.



So just wanted to clarify is there any limit/drawback having huge cluster/too 
many nodes in a c* cluster



Thanks in advance

TechPyaasa

Re: Limit on having number of nodes in C* cluster

2017-08-21 Thread Eduard Tudenhoefner 
We've been doing successful testing with multi-DC setups and 500 nodes per
DC. However, I agree with Jon here. Certain things are easier/faster with
e.g. 5x100 node clusters than 1x500 node cluster.

Cheers

On Mon, Aug 21, 2017 at 10:16 AM, Jon Haddad 
wrote:

> As far as I know, those 75K nodes are not in a single cluster.  If memory
> serves correctly (and this article seems to indicate that it does
> http://www.techrepublic.com/article/apples-secret-
> nosql-sauce-includes-a-hefty-dose-of-cassandra/), you’ll see clusters of
> 1,000 nodes.
>
> Things start to get a little hairy once you go above a couple hundred
> nodes.  I would rather run 5 100 node clusters than a single 500 node
> cluster.  In theory, once you’ve built out the tooling to manage 2 clusters
> you should be able to apply it to manage 20 (reality always gets in the way
> though…)
>
> Jon
>
> On Aug 21, 2017, at 9:15 AM, techpyaasa .  wrote:
>
> Thanks lot for reply :)
>
> On Aug 21, 2017 6:44 PM, "Vladimir Yudovin"  wrote:
>
>> Actually there are clusters of thousandths nodes: Some of the largest
>> production deployments include Apple's, with over 75,000 nodes storing over
>> 10 PB of data 
>>
>> Best regards, Vladimir Yudovin,
>> *Winguzone  - Cloud Cassandra Hosting*
>>
>>
>>  On Mon, 21 Aug 2017 08:35:37 -0400 *techpyaasa .
>> >* wrote 
>>
>> Hi
>>
>> Is there any limit on having number of nodes in c* cluster.
>> Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups &
>> each group has 21 nodes.
>>
>> We wanted to increase the cluster capacity by adding 6 nodes per group as
>> many of nodes disk usage crossed 65%.
>>
>> So just wanted to clarify is there any limit/drawback having huge
>> cluster/too many nodes in a c* cluster
>>
>> Thanks in advance
>> TechPyaasa
>>
>>
>>
>

Re: Limit on having number of nodes in C* cluster

2017-08-21 Thread Jon Haddad 
As far as I know, those 75K nodes are not in a single cluster.  If memory 
serves correctly (and this article seems to indicate that it does 
http://www.techrepublic.com/article/apples-secret-nosql-sauce-includes-a-hefty-dose-of-cassandra/
 
),
 you’ll see clusters of 1,000 nodes.  

Things start to get a little hairy once you go above a couple hundred nodes.  I 
would rather run 5 100 node clusters than a single 500 node cluster.  In 
theory, once you’ve built out the tooling to manage 2 clusters you should be 
able to apply it to manage 20 (reality always gets in the way though…)

Jon

> On Aug 21, 2017, at 9:15 AM, techpyaasa .  wrote:
> 
> Thanks lot for reply :)
> 
> On Aug 21, 2017 6:44 PM, "Vladimir Yudovin"  > wrote:
> Actually there are clusters of thousandths nodes: Some of the largest 
> production deployments include Apple's, with over 75,000 nodes storing over 
> 10 PB of data 
> 
> Best regards, Vladimir Yudovin, 
> Winguzone  - Cloud Cassandra Hosting
> 
> 
>  On Mon, 21 Aug 2017 08:35:37 -0400 techpyaasa .  > wrote 
> 
> Hi 
> 
> Is there any limit on having number of nodes in c* cluster.
> Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups & each 
> group has 21 nodes.
> 
> We wanted to increase the cluster capacity by adding 6 nodes per group as 
> many of nodes disk usage crossed 65%.
> 
> So just wanted to clarify is there any limit/drawback having huge cluster/too 
> many nodes in a c* cluster
> 
> Thanks in advance
> TechPyaasa
>

Re: Limit on having number of nodes in C* cluster

2017-08-21 Thread techpyaasa . 
Thanks lot for reply :)

On Aug 21, 2017 6:44 PM, "Vladimir Yudovin"  wrote:

> Actually there are clusters of thousandths nodes: Some of the largest
> production deployments include Apple's, with over 75,000 nodes storing over
> 10 PB of data 
>
> Best regards, Vladimir Yudovin,
> *Winguzone  - Cloud Cassandra Hosting*
>
>
>  On Mon, 21 Aug 2017 08:35:37 -0400 *techpyaasa .
> >* wrote 
>
> Hi
>
> Is there any limit on having number of nodes in c* cluster.
> Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups &
> each group has 21 nodes.
>
> We wanted to increase the cluster capacity by adding 6 nodes per group as
> many of nodes disk usage crossed 65%.
>
> So just wanted to clarify is there any limit/drawback having huge
> cluster/too many nodes in a c* cluster
>
> Thanks in advance
> TechPyaasa
>
>
>

Re: Limit on having number of nodes in C* cluster

2017-08-21 Thread Vladimir Yudovin 
Actually there are clusters of thousandths nodes: Some of the largest 
production deployments include Apple's, with over 75,000 nodes storing over 10 
PB of data



Best regards, Vladimir Yudovin, 

Winguzone - Cloud Cassandra Hosting






 On Mon, 21 Aug 2017 08:35:37 -0400 techpyaasa . 
techpya...@gmail.com wrote 




Hi 



Is there any limit on having number of nodes in c* cluster.

Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups  each 
group has 21 nodes.



We wanted to increase the cluster capacity by adding 6 nodes per group as many 
of nodes disk usage crossed 65%.



So just wanted to clarify is there any limit/drawback having huge cluster/too 
many nodes in a c* cluster



Thanks in advance

TechPyaasa

Limit on having number of nodes in C* cluster

2017-08-21 Thread techpyaasa . 
Hi

Is there any limit on having number of nodes in c* cluster.
Right now we have c*-2.1.17 cluster with 3 DCs each DC with 3 groups & each
group has 21 nodes.

We wanted to increase the cluster capacity by adding 6 nodes per group as
many of nodes disk usage crossed 65%.

So just wanted to clarify is there any limit/drawback having huge
cluster/too many nodes in a c* cluster

Thanks in advance
TechPyaasa