Re: Cassandra 4 alpha/alpha2

2019-11-01 Thread Jon Haddad
A new thing like this would be much better served by the community through
several iterations.  For instance, over the last year I've developed a tool
for spinning up lab clusters, it's here:
https://thelastpickle.com/tlp-cluster/

I had to make a *lot* of tradeoffs here.  Everything Jeff mentioned, plus a
handful of others.  I'm pretty sure if someone where to try to accomplish
the same thing they'd go about it a different way.  It might be better or
worse in a variety of ways.

I agree with Jeff that these are problems better solved elsewhere, at least
till an idea matures enough to adopt it.  Otherwise we're creating a lot of
technical debt that needs to be maintained, when we really need about a
dozen prototypes that get thrown out first.

Sharing work with the community, whether it be through packer, AMIs, or
home made tooling is the first step here.

Jon

On Fri, Nov 1, 2019 at 11:47 AM Jeff Jirsa  wrote:

> Lots of this, but also getting into the weeds, it's pretty clear this is
> nontrivial:
>
> - If we did an AWS AMI, would we also do Azure? GCP? AliCloud? OCI? Where
> do we stop?
> - What if there's a security hole in the base image - who's responsible
> for fixing that? We could have tooling that makes a new one every day, but
> that tooling has to run somewhere, who's going to pay for it?
> - What base OS? Do we do Amazon Linux or CentOS or Ubuntu or Debian? How
> do we choose? PV or HVM?
> - Which region? How long do we keep it? If we're doing nightly AMIs to
> pick up security fixes in the base image, what do we do with old AMIs? If
> we yank them we may break people, if we dont they may be using something
> with a security hole.
>
> All of these are solvable problems, but we're just not at a point where
> we're going to solve them at the project level anytime soon.
>
>
>
>
> On Fri, Nov 1, 2019 at 8:01 AM Reid Pinchback 
> wrote:
>
>> That is indeed what Amazon AMIs are for.  
>>
>>
>>
>> However if your question is “why don’t the C* developers do that for
>> people?” the answer is going to be some mix of “people only do so much work
>> for free” and “the ones that don’t do it for free have a company you pay to
>> do things like that (Datastax)”.  Keep in mind, that when you create AMIs
>> you’re using AWS resources and whoever owns the account that did the work,
>> is on the hook to pay for the resources.
>>
>>
>>
>> But if your question is about whether you can do that for your own
>> company, then obviously yes.  And when you do so at first it’ll be about
>> C*, then it’ll be about how your company in particular likes to monitor
>> things, and handle backup, spec out encryption of data at rest, and deal
>> with auth security, and deal with log shipping, and deal with PII concerns,
>> and …
>>
>>
>>
>> Which is why there isn’t really a big win to other people setting up an
>> AMI for you, except in cases where they are offering
>> whatever-it-is-as-a-service and get paid for its usage.  1000 consumers
>> will say they want a simple thing, but all 1000 usages will be a little
>> different, and nobody will like the AMI they get if their simple thing
>> isn’t present on it.
>>
>>
>>
>> (plus AMI creation and maintenance, within and across regions, is just a
>> pain in the rump and I can’t imagine doing it without money coming back
>> from the effort)
>>
>>
>>
>>
>>
>> *From: *Sergio 
>> *Reply-To: *"user@cassandra.apache.org" 
>> *Date: *Thursday, October 31, 2019 at 4:09 PM
>> *To: *"user@cassandra.apache.org" 
>> *Subject: *Re: Cassandra 4 alpha/alpha2
>>
>>
>>
>> *Message from External Sender*
>>
>> OOO but still relevant:
>> Would not it be possible to create an Amazon AMI that has all the OS and
>> JVM settings in the right place and from there each developer can tweak the
>> things that need to be adjusted?
>> Best,
>> Sergio
>>
>>
>>
>> Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel 
>> ha scritto:
>>
>> Looks like i am messing up or missing something ..will revisit again
>>
>> On Thursday, October 31, 2019, Stefan Miklosovic <
>> stefan.mikloso...@instaclustr.com> wrote:
>>
>> Hi,
>>
>> I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and
>> all went fine (I have some custom images for my own purposes).
>>
>> Update between alpha and alpha2 was just about mere version bump.
>>
>> Cheers
>>
>> On Thu, 31 Oct 2019 at 20:40, Abdul Patel  wrote:
>>

Re: Cassandra 4 alpha/alpha2

2019-11-01 Thread Jeff Jirsa
Lots of this, but also getting into the weeds, it's pretty clear this is
nontrivial:

- If we did an AWS AMI, would we also do Azure? GCP? AliCloud? OCI? Where
do we stop?
- What if there's a security hole in the base image - who's responsible for
fixing that? We could have tooling that makes a new one every day, but that
tooling has to run somewhere, who's going to pay for it?
- What base OS? Do we do Amazon Linux or CentOS or Ubuntu or Debian? How do
we choose? PV or HVM?
- Which region? How long do we keep it? If we're doing nightly AMIs to pick
up security fixes in the base image, what do we do with old AMIs? If we
yank them we may break people, if we dont they may be using something with
a security hole.

All of these are solvable problems, but we're just not at a point where
we're going to solve them at the project level anytime soon.




On Fri, Nov 1, 2019 at 8:01 AM Reid Pinchback 
wrote:

> That is indeed what Amazon AMIs are for.  
>
>
>
> However if your question is “why don’t the C* developers do that for
> people?” the answer is going to be some mix of “people only do so much work
> for free” and “the ones that don’t do it for free have a company you pay to
> do things like that (Datastax)”.  Keep in mind, that when you create AMIs
> you’re using AWS resources and whoever owns the account that did the work,
> is on the hook to pay for the resources.
>
>
>
> But if your question is about whether you can do that for your own
> company, then obviously yes.  And when you do so at first it’ll be about
> C*, then it’ll be about how your company in particular likes to monitor
> things, and handle backup, spec out encryption of data at rest, and deal
> with auth security, and deal with log shipping, and deal with PII concerns,
> and …
>
>
>
> Which is why there isn’t really a big win to other people setting up an
> AMI for you, except in cases where they are offering
> whatever-it-is-as-a-service and get paid for its usage.  1000 consumers
> will say they want a simple thing, but all 1000 usages will be a little
> different, and nobody will like the AMI they get if their simple thing
> isn’t present on it.
>
>
>
> (plus AMI creation and maintenance, within and across regions, is just a
> pain in the rump and I can’t imagine doing it without money coming back
> from the effort)
>
>
>
>
>
> *From: *Sergio 
> *Reply-To: *"user@cassandra.apache.org" 
> *Date: *Thursday, October 31, 2019 at 4:09 PM
> *To: *"user@cassandra.apache.org" 
> *Subject: *Re: Cassandra 4 alpha/alpha2
>
>
>
> *Message from External Sender*
>
> OOO but still relevant:
> Would not it be possible to create an Amazon AMI that has all the OS and
> JVM settings in the right place and from there each developer can tweak the
> things that need to be adjusted?
> Best,
> Sergio
>
>
>
> Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel 
> ha scritto:
>
> Looks like i am messing up or missing something ..will revisit again
>
> On Thursday, October 31, 2019, Stefan Miklosovic <
> stefan.mikloso...@instaclustr.com> wrote:
>
> Hi,
>
> I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and
> all went fine (I have some custom images for my own purposes).
>
> Update between alpha and alpha2 was just about mere version bump.
>
> Cheers
>
> On Thu, 31 Oct 2019 at 20:40, Abdul Patel  wrote:
> >
> > Hey Everyone
> >
> > Did anyone was successfull to install either alpha or alpha2 version for
> cassandra 4.0?
> > Found 2 issues :
> > 1> cassandra-env.sh:
> > JAVA_VERSION varianle is not defined.
> > Jvm-server.options file is not defined.
> >
> > This is fixable and after adding those , the error for cassandra-env.sh
> errora went away.
> >
> > 2> second and major issue the cassandea binary when i try to start says
> syntax error.
> >
> > /bin/cassandea: line 198:exec: : not found.
> >
> > Anyone has any idea on second issue?
> >
>
> -
> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> For additional commands, e-mail: user-h...@cassandra.apache.org
>
>


Re: Cassandra 4 alpha/alpha2

2019-11-01 Thread Reid Pinchback
That is indeed what Amazon AMIs are for.  

However if your question is “why don’t the C* developers do that for people?” 
the answer is going to be some mix of “people only do so much work for free” 
and “the ones that don’t do it for free have a company you pay to do things 
like that (Datastax)”.  Keep in mind, that when you create AMIs you’re using 
AWS resources and whoever owns the account that did the work, is on the hook to 
pay for the resources.

But if your question is about whether you can do that for your own company, 
then obviously yes.  And when you do so at first it’ll be about C*, then it’ll 
be about how your company in particular likes to monitor things, and handle 
backup, spec out encryption of data at rest, and deal with auth security, and 
deal with log shipping, and deal with PII concerns, and …

Which is why there isn’t really a big win to other people setting up an AMI for 
you, except in cases where they are offering whatever-it-is-as-a-service and 
get paid for its usage.  1000 consumers will say they want a simple thing, but 
all 1000 usages will be a little different, and nobody will like the AMI they 
get if their simple thing isn’t present on it.

(plus AMI creation and maintenance, within and across regions, is just a pain 
in the rump and I can’t imagine doing it without money coming back from the 
effort)


From: Sergio 
Reply-To: "user@cassandra.apache.org" 
Date: Thursday, October 31, 2019 at 4:09 PM
To: "user@cassandra.apache.org" 
Subject: Re: Cassandra 4 alpha/alpha2

Message from External Sender
OOO but still relevant:
Would not it be possible to create an Amazon AMI that has all the OS and JVM 
settings in the right place and from there each developer can tweak the things 
that need to be adjusted?
Best,
Sergio

Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel 
mailto:abd786...@gmail.com>> ha scritto:
Looks like i am messing up or missing something ..will revisit again

On Thursday, October 31, 2019, Stefan Miklosovic 
mailto:stefan.mikloso...@instaclustr.com>> 
wrote:
Hi,

I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and
all went fine (I have some custom images for my own purposes).

Update between alpha and alpha2 was just about mere version bump.

Cheers

On Thu, 31 Oct 2019 at 20:40, Abdul Patel 
mailto:abd786...@gmail.com>> wrote:
>
> Hey Everyone
>
> Did anyone was successfull to install either alpha or alpha2 version for 
> cassandra 4.0?
> Found 2 issues :
> 1> cassandra-env.sh:
> JAVA_VERSION varianle is not defined.
> Jvm-server.options file is not defined.
>
> This is fixable and after adding those , the error for cassandra-env.sh 
> errora went away.
>
> 2> second and major issue the cassandea binary when i try to start says 
> syntax error.
>
> /bin/cassandea: line 198:exec: : not found.
>
> Anyone has any idea on second issue?
>

-
To unsubscribe, e-mail: 
user-unsubscr...@cassandra.apache.org<mailto:user-unsubscr...@cassandra.apache.org>
For additional commands, e-mail: 
user-h...@cassandra.apache.org<mailto:user-h...@cassandra.apache.org>


Re: Cassandra 4 alpha/alpha2

2019-10-31 Thread Sergio
OOO but still relevant:
Would not it be possible to create an Amazon AMI that has all the OS and
JVM settings in the right place and from there each developer can tweak the
things that need to be adjusted?
Best,
Sergio

Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel 
ha scritto:

> Looks like i am messing up or missing something ..will revisit again
>
> On Thursday, October 31, 2019, Stefan Miklosovic <
> stefan.mikloso...@instaclustr.com> wrote:
>
>> Hi,
>>
>> I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and
>> all went fine (I have some custom images for my own purposes).
>>
>> Update between alpha and alpha2 was just about mere version bump.
>>
>> Cheers
>>
>> On Thu, 31 Oct 2019 at 20:40, Abdul Patel  wrote:
>> >
>> > Hey Everyone
>> >
>> > Did anyone was successfull to install either alpha or alpha2 version
>> for cassandra 4.0?
>> > Found 2 issues :
>> > 1> cassandra-env.sh:
>> > JAVA_VERSION varianle is not defined.
>> > Jvm-server.options file is not defined.
>> >
>> > This is fixable and after adding those , the error for cassandra-env.sh
>> errora went away.
>> >
>> > 2> second and major issue the cassandea binary when i try to start says
>> syntax error.
>> >
>> > /bin/cassandea: line 198:exec: : not found.
>> >
>> > Anyone has any idea on second issue?
>> >
>>
>> -
>> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
>> For additional commands, e-mail: user-h...@cassandra.apache.org
>>
>>


Re: Cassandra 4 alpha/alpha2

2019-10-31 Thread Abdul Patel
Looks like i am messing up or missing something ..will revisit again

On Thursday, October 31, 2019, Stefan Miklosovic <
stefan.mikloso...@instaclustr.com> wrote:

> Hi,
>
> I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and
> all went fine (I have some custom images for my own purposes).
>
> Update between alpha and alpha2 was just about mere version bump.
>
> Cheers
>
> On Thu, 31 Oct 2019 at 20:40, Abdul Patel  wrote:
> >
> > Hey Everyone
> >
> > Did anyone was successfull to install either alpha or alpha2 version for
> cassandra 4.0?
> > Found 2 issues :
> > 1> cassandra-env.sh:
> > JAVA_VERSION varianle is not defined.
> > Jvm-server.options file is not defined.
> >
> > This is fixable and after adding those , the error for cassandra-env.sh
> errora went away.
> >
> > 2> second and major issue the cassandea binary when i try to start says
> syntax error.
> >
> > /bin/cassandea: line 198:exec: : not found.
> >
> > Anyone has any idea on second issue?
> >
>
> -
> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
> For additional commands, e-mail: user-h...@cassandra.apache.org
>
>


Re: Cassandra 4 alpha/alpha2

2019-10-31 Thread Stefan Miklosovic
Hi,

I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and
all went fine (I have some custom images for my own purposes).

Update between alpha and alpha2 was just about mere version bump.

Cheers

On Thu, 31 Oct 2019 at 20:40, Abdul Patel  wrote:
>
> Hey Everyone
>
> Did anyone was successfull to install either alpha or alpha2 version for 
> cassandra 4.0?
> Found 2 issues :
> 1> cassandra-env.sh:
> JAVA_VERSION varianle is not defined.
> Jvm-server.options file is not defined.
>
> This is fixable and after adding those , the error for cassandra-env.sh 
> errora went away.
>
> 2> second and major issue the cassandea binary when i try to start says 
> syntax error.
>
> /bin/cassandea: line 198:exec: : not found.
>
> Anyone has any idea on second issue?
>

-
To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org
For additional commands, e-mail: user-h...@cassandra.apache.org



Re: Cassandra 4 alpha/alpha2

2019-10-31 Thread Abdul Patel
Centos 7.6


On Thursday, October 31, 2019, Jon Haddad  wrote:

> What artifact did you use and what OS are you on?
>
> On Thu, Oct 31, 2019 at 12:40 PM Abdul Patel  wrote:
>
>> Hey Everyone
>>
>> Did anyone was successfull to install either alpha or alpha2 version for
>> cassandra 4.0?
>> Found 2 issues :
>> 1> cassandra-env.sh:
>> JAVA_VERSION varianle is not defined.
>> Jvm-server.options file is not defined.
>>
>> This is fixable and after adding those , the error for cassandra-env.sh
>> errora went away.
>>
>> 2> second and major issue the cassandea binary when i try to start says
>> syntax error.
>>
>> /bin/cassandea: line 198:exec: : not found.
>>
>> Anyone has any idea on second issue?
>>
>>


Re: Cassandra 4 alpha/alpha2

2019-10-31 Thread Jon Haddad
What artifact did you use and what OS are you on?

On Thu, Oct 31, 2019 at 12:40 PM Abdul Patel  wrote:

> Hey Everyone
>
> Did anyone was successfull to install either alpha or alpha2 version for
> cassandra 4.0?
> Found 2 issues :
> 1> cassandra-env.sh:
> JAVA_VERSION varianle is not defined.
> Jvm-server.options file is not defined.
>
> This is fixable and after adding those , the error for cassandra-env.sh
> errora went away.
>
> 2> second and major issue the cassandea binary when i try to start says
> syntax error.
>
> /bin/cassandea: line 198:exec: : not found.
>
> Anyone has any idea on second issue?
>
>