Re: Cassandra 4 alpha/alpha2
A new thing like this would be much better served by the community through several iterations. For instance, over the last year I've developed a tool for spinning up lab clusters, it's here: https://thelastpickle.com/tlp-cluster/ I had to make a *lot* of tradeoffs here. Everything Jeff mentioned, plus a handful of others. I'm pretty sure if someone where to try to accomplish the same thing they'd go about it a different way. It might be better or worse in a variety of ways. I agree with Jeff that these are problems better solved elsewhere, at least till an idea matures enough to adopt it. Otherwise we're creating a lot of technical debt that needs to be maintained, when we really need about a dozen prototypes that get thrown out first. Sharing work with the community, whether it be through packer, AMIs, or home made tooling is the first step here. Jon On Fri, Nov 1, 2019 at 11:47 AM Jeff Jirsa wrote: > Lots of this, but also getting into the weeds, it's pretty clear this is > nontrivial: > > - If we did an AWS AMI, would we also do Azure? GCP? AliCloud? OCI? Where > do we stop? > - What if there's a security hole in the base image - who's responsible > for fixing that? We could have tooling that makes a new one every day, but > that tooling has to run somewhere, who's going to pay for it? > - What base OS? Do we do Amazon Linux or CentOS or Ubuntu or Debian? How > do we choose? PV or HVM? > - Which region? How long do we keep it? If we're doing nightly AMIs to > pick up security fixes in the base image, what do we do with old AMIs? If > we yank them we may break people, if we dont they may be using something > with a security hole. > > All of these are solvable problems, but we're just not at a point where > we're going to solve them at the project level anytime soon. > > > > > On Fri, Nov 1, 2019 at 8:01 AM Reid Pinchback > wrote: > >> That is indeed what Amazon AMIs are for. >> >> >> >> However if your question is “why don’t the C* developers do that for >> people?” the answer is going to be some mix of “people only do so much work >> for free” and “the ones that don’t do it for free have a company you pay to >> do things like that (Datastax)”. Keep in mind, that when you create AMIs >> you’re using AWS resources and whoever owns the account that did the work, >> is on the hook to pay for the resources. >> >> >> >> But if your question is about whether you can do that for your own >> company, then obviously yes. And when you do so at first it’ll be about >> C*, then it’ll be about how your company in particular likes to monitor >> things, and handle backup, spec out encryption of data at rest, and deal >> with auth security, and deal with log shipping, and deal with PII concerns, >> and … >> >> >> >> Which is why there isn’t really a big win to other people setting up an >> AMI for you, except in cases where they are offering >> whatever-it-is-as-a-service and get paid for its usage. 1000 consumers >> will say they want a simple thing, but all 1000 usages will be a little >> different, and nobody will like the AMI they get if their simple thing >> isn’t present on it. >> >> >> >> (plus AMI creation and maintenance, within and across regions, is just a >> pain in the rump and I can’t imagine doing it without money coming back >> from the effort) >> >> >> >> >> >> *From: *Sergio >> *Reply-To: *"user@cassandra.apache.org" >> *Date: *Thursday, October 31, 2019 at 4:09 PM >> *To: *"user@cassandra.apache.org" >> *Subject: *Re: Cassandra 4 alpha/alpha2 >> >> >> >> *Message from External Sender* >> >> OOO but still relevant: >> Would not it be possible to create an Amazon AMI that has all the OS and >> JVM settings in the right place and from there each developer can tweak the >> things that need to be adjusted? >> Best, >> Sergio >> >> >> >> Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel >> ha scritto: >> >> Looks like i am messing up or missing something ..will revisit again >> >> On Thursday, October 31, 2019, Stefan Miklosovic < >> stefan.mikloso...@instaclustr.com> wrote: >> >> Hi, >> >> I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and >> all went fine (I have some custom images for my own purposes). >> >> Update between alpha and alpha2 was just about mere version bump. >> >> Cheers >> >> On Thu, 31 Oct 2019 at 20:40, Abdul Patel wrote: >>
Re: Cassandra 4 alpha/alpha2
Lots of this, but also getting into the weeds, it's pretty clear this is nontrivial: - If we did an AWS AMI, would we also do Azure? GCP? AliCloud? OCI? Where do we stop? - What if there's a security hole in the base image - who's responsible for fixing that? We could have tooling that makes a new one every day, but that tooling has to run somewhere, who's going to pay for it? - What base OS? Do we do Amazon Linux or CentOS or Ubuntu or Debian? How do we choose? PV or HVM? - Which region? How long do we keep it? If we're doing nightly AMIs to pick up security fixes in the base image, what do we do with old AMIs? If we yank them we may break people, if we dont they may be using something with a security hole. All of these are solvable problems, but we're just not at a point where we're going to solve them at the project level anytime soon. On Fri, Nov 1, 2019 at 8:01 AM Reid Pinchback wrote: > That is indeed what Amazon AMIs are for. > > > > However if your question is “why don’t the C* developers do that for > people?” the answer is going to be some mix of “people only do so much work > for free” and “the ones that don’t do it for free have a company you pay to > do things like that (Datastax)”. Keep in mind, that when you create AMIs > you’re using AWS resources and whoever owns the account that did the work, > is on the hook to pay for the resources. > > > > But if your question is about whether you can do that for your own > company, then obviously yes. And when you do so at first it’ll be about > C*, then it’ll be about how your company in particular likes to monitor > things, and handle backup, spec out encryption of data at rest, and deal > with auth security, and deal with log shipping, and deal with PII concerns, > and … > > > > Which is why there isn’t really a big win to other people setting up an > AMI for you, except in cases where they are offering > whatever-it-is-as-a-service and get paid for its usage. 1000 consumers > will say they want a simple thing, but all 1000 usages will be a little > different, and nobody will like the AMI they get if their simple thing > isn’t present on it. > > > > (plus AMI creation and maintenance, within and across regions, is just a > pain in the rump and I can’t imagine doing it without money coming back > from the effort) > > > > > > *From: *Sergio > *Reply-To: *"user@cassandra.apache.org" > *Date: *Thursday, October 31, 2019 at 4:09 PM > *To: *"user@cassandra.apache.org" > *Subject: *Re: Cassandra 4 alpha/alpha2 > > > > *Message from External Sender* > > OOO but still relevant: > Would not it be possible to create an Amazon AMI that has all the OS and > JVM settings in the right place and from there each developer can tweak the > things that need to be adjusted? > Best, > Sergio > > > > Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel > ha scritto: > > Looks like i am messing up or missing something ..will revisit again > > On Thursday, October 31, 2019, Stefan Miklosovic < > stefan.mikloso...@instaclustr.com> wrote: > > Hi, > > I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and > all went fine (I have some custom images for my own purposes). > > Update between alpha and alpha2 was just about mere version bump. > > Cheers > > On Thu, 31 Oct 2019 at 20:40, Abdul Patel wrote: > > > > Hey Everyone > > > > Did anyone was successfull to install either alpha or alpha2 version for > cassandra 4.0? > > Found 2 issues : > > 1> cassandra-env.sh: > > JAVA_VERSION varianle is not defined. > > Jvm-server.options file is not defined. > > > > This is fixable and after adding those , the error for cassandra-env.sh > errora went away. > > > > 2> second and major issue the cassandea binary when i try to start says > syntax error. > > > > /bin/cassandea: line 198:exec: : not found. > > > > Anyone has any idea on second issue? > > > > - > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > For additional commands, e-mail: user-h...@cassandra.apache.org > >
Re: Cassandra 4 alpha/alpha2
That is indeed what Amazon AMIs are for. However if your question is “why don’t the C* developers do that for people?” the answer is going to be some mix of “people only do so much work for free” and “the ones that don’t do it for free have a company you pay to do things like that (Datastax)”. Keep in mind, that when you create AMIs you’re using AWS resources and whoever owns the account that did the work, is on the hook to pay for the resources. But if your question is about whether you can do that for your own company, then obviously yes. And when you do so at first it’ll be about C*, then it’ll be about how your company in particular likes to monitor things, and handle backup, spec out encryption of data at rest, and deal with auth security, and deal with log shipping, and deal with PII concerns, and … Which is why there isn’t really a big win to other people setting up an AMI for you, except in cases where they are offering whatever-it-is-as-a-service and get paid for its usage. 1000 consumers will say they want a simple thing, but all 1000 usages will be a little different, and nobody will like the AMI they get if their simple thing isn’t present on it. (plus AMI creation and maintenance, within and across regions, is just a pain in the rump and I can’t imagine doing it without money coming back from the effort) From: Sergio Reply-To: "user@cassandra.apache.org" Date: Thursday, October 31, 2019 at 4:09 PM To: "user@cassandra.apache.org" Subject: Re: Cassandra 4 alpha/alpha2 Message from External Sender OOO but still relevant: Would not it be possible to create an Amazon AMI that has all the OS and JVM settings in the right place and from there each developer can tweak the things that need to be adjusted? Best, Sergio Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel mailto:abd786...@gmail.com>> ha scritto: Looks like i am messing up or missing something ..will revisit again On Thursday, October 31, 2019, Stefan Miklosovic mailto:stefan.mikloso...@instaclustr.com>> wrote: Hi, I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and all went fine (I have some custom images for my own purposes). Update between alpha and alpha2 was just about mere version bump. Cheers On Thu, 31 Oct 2019 at 20:40, Abdul Patel mailto:abd786...@gmail.com>> wrote: > > Hey Everyone > > Did anyone was successfull to install either alpha or alpha2 version for > cassandra 4.0? > Found 2 issues : > 1> cassandra-env.sh: > JAVA_VERSION varianle is not defined. > Jvm-server.options file is not defined. > > This is fixable and after adding those , the error for cassandra-env.sh > errora went away. > > 2> second and major issue the cassandea binary when i try to start says > syntax error. > > /bin/cassandea: line 198:exec: : not found. > > Anyone has any idea on second issue? > - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org<mailto:user-unsubscr...@cassandra.apache.org> For additional commands, e-mail: user-h...@cassandra.apache.org<mailto:user-h...@cassandra.apache.org>
Re: Cassandra 4 alpha/alpha2
OOO but still relevant: Would not it be possible to create an Amazon AMI that has all the OS and JVM settings in the right place and from there each developer can tweak the things that need to be adjusted? Best, Sergio Il giorno gio 31 ott 2019 alle ore 12:56 Abdul Patel ha scritto: > Looks like i am messing up or missing something ..will revisit again > > On Thursday, October 31, 2019, Stefan Miklosovic < > stefan.mikloso...@instaclustr.com> wrote: > >> Hi, >> >> I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and >> all went fine (I have some custom images for my own purposes). >> >> Update between alpha and alpha2 was just about mere version bump. >> >> Cheers >> >> On Thu, 31 Oct 2019 at 20:40, Abdul Patel wrote: >> > >> > Hey Everyone >> > >> > Did anyone was successfull to install either alpha or alpha2 version >> for cassandra 4.0? >> > Found 2 issues : >> > 1> cassandra-env.sh: >> > JAVA_VERSION varianle is not defined. >> > Jvm-server.options file is not defined. >> > >> > This is fixable and after adding those , the error for cassandra-env.sh >> errora went away. >> > >> > 2> second and major issue the cassandea binary when i try to start says >> syntax error. >> > >> > /bin/cassandea: line 198:exec: : not found. >> > >> > Anyone has any idea on second issue? >> > >> >> - >> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org >> For additional commands, e-mail: user-h...@cassandra.apache.org >> >>
Re: Cassandra 4 alpha/alpha2
Looks like i am messing up or missing something ..will revisit again On Thursday, October 31, 2019, Stefan Miklosovic < stefan.mikloso...@instaclustr.com> wrote: > Hi, > > I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and > all went fine (I have some custom images for my own purposes). > > Update between alpha and alpha2 was just about mere version bump. > > Cheers > > On Thu, 31 Oct 2019 at 20:40, Abdul Patel wrote: > > > > Hey Everyone > > > > Did anyone was successfull to install either alpha or alpha2 version for > cassandra 4.0? > > Found 2 issues : > > 1> cassandra-env.sh: > > JAVA_VERSION varianle is not defined. > > Jvm-server.options file is not defined. > > > > This is fixable and after adding those , the error for cassandra-env.sh > errora went away. > > > > 2> second and major issue the cassandea binary when i try to start says > syntax error. > > > > /bin/cassandea: line 198:exec: : not found. > > > > Anyone has any idea on second issue? > > > > - > To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > For additional commands, e-mail: user-h...@cassandra.apache.org > >
Re: Cassandra 4 alpha/alpha2
Hi, I have tested both alpha and alpha2 and 3.11.5 on Centos 7.7.1908 and all went fine (I have some custom images for my own purposes). Update between alpha and alpha2 was just about mere version bump. Cheers On Thu, 31 Oct 2019 at 20:40, Abdul Patel wrote: > > Hey Everyone > > Did anyone was successfull to install either alpha or alpha2 version for > cassandra 4.0? > Found 2 issues : > 1> cassandra-env.sh: > JAVA_VERSION varianle is not defined. > Jvm-server.options file is not defined. > > This is fixable and after adding those , the error for cassandra-env.sh > errora went away. > > 2> second and major issue the cassandea binary when i try to start says > syntax error. > > /bin/cassandea: line 198:exec: : not found. > > Anyone has any idea on second issue? > - To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org For additional commands, e-mail: user-h...@cassandra.apache.org
Re: Cassandra 4 alpha/alpha2
Centos 7.6 On Thursday, October 31, 2019, Jon Haddad wrote: > What artifact did you use and what OS are you on? > > On Thu, Oct 31, 2019 at 12:40 PM Abdul Patel wrote: > >> Hey Everyone >> >> Did anyone was successfull to install either alpha or alpha2 version for >> cassandra 4.0? >> Found 2 issues : >> 1> cassandra-env.sh: >> JAVA_VERSION varianle is not defined. >> Jvm-server.options file is not defined. >> >> This is fixable and after adding those , the error for cassandra-env.sh >> errora went away. >> >> 2> second and major issue the cassandea binary when i try to start says >> syntax error. >> >> /bin/cassandea: line 198:exec: : not found. >> >> Anyone has any idea on second issue? >> >>
Re: Cassandra 4 alpha/alpha2
What artifact did you use and what OS are you on? On Thu, Oct 31, 2019 at 12:40 PM Abdul Patel wrote: > Hey Everyone > > Did anyone was successfull to install either alpha or alpha2 version for > cassandra 4.0? > Found 2 issues : > 1> cassandra-env.sh: > JAVA_VERSION varianle is not defined. > Jvm-server.options file is not defined. > > This is fixable and after adding those , the error for cassandra-env.sh > errora went away. > > 2> second and major issue the cassandea binary when i try to start says > syntax error. > > /bin/cassandea: line 198:exec: : not found. > > Anyone has any idea on second issue? > >