Also agreed on Nick's deployment comments. Deploying on AWS manually is fairly trivial. The Ansible scripts have not been touched in months (years, even). You could also install Hadoop services manually (Big Top, for instance), but YMMV. Most of our testing to this point has been on Ambari, however we're looking to move away from directly depending on it in the near future.
On Tue, Oct 29, 2019 at 8:30 AM Nick Allen <[email protected]> wrote: > To echo Simon's comments, you should NOT use the automated deployment > mechanism described at *metron-deployment/amazon-ec2/README.md*. This > has not been maintained, deploys an unsecure cluster by default, and is not > the preferred installation method. This installation path pre-dates the > Ambari MPack that provides a much simpler, universal installation mechanism. > > The preferred installation path with AWS is to just spin-up your EC2 > nodes, install Ambari with Metron's MPack, and use Ambari to deploy > Metron. This is the same installation path for bare metal, a private > cloud, AWS, etc. > > On Tue, Oct 29, 2019 at 9:43 AM Eric Jacksch <[email protected]> wrote: > >> I did earlier on this list, but wasn't able to make any progress. >> >> Someone who knows the product well really should try as I suggested -- >> start from a clean slate in AWS, create an EC2 instance, and try to >> deploy using the provided scripts. It's so badly broken that a >> security guy with 25+ years of *nix experience AND an experienced >> devops team who spend their life in AWS with K8S, Docker, etc, >> couldn't get it built. >> >> On Tue, 29 Oct 2019 at 09:38, Nick Allen <[email protected]> wrote: >> > >> > Have you opened a JIRA or sent an email describing what problems that >> you've run into? >> > >> > On Tue, Oct 29, 2019 at 9:35 AM Eric Jacksch <[email protected]> wrote: >> >> >> >> I thought I may have just missed something, but one of my customer's >> >> DevOps team worked on it for three days and couldn't get it going >> >> either. >> >> >> >> On Tue, 29 Oct 2019 at 09:32, Marcus Persson <[email protected]> >> wrote: >> >> > >> >> > then its just not me that have had problems... BUt my problem was >> best way of running it on CentOS.. >> >> > >> >> > On 2019/10/29 13:22:08, Eric Jacksch <[email protected]> wrote: >> >> > > We unfortunately gave up after trying several approaches to getting >> >> > > Metron running in AWS. I'm disappointed -- I think Metron has huge >> >> > > potential. >> >> > > >> >> > > I suspect those who are using it have established development >> systems >> >> > > and that there are some undocumented prerequisites. If anyone on >> the >> >> > > Metron team has time, just try to deploy it in AWS using a freshly >> >> > > spun up EC2 instance as your build/deploy machine and the issues >> will >> >> > > rapidly become evident. >> >> > > >> >> > > Regards, >> >> > > Eric >> >> > > >> >> > > On Tue, 29 Oct 2019 at 08:54, <[email protected]> wrote: >> >> > > > >> >> > > > Hello, >> >> > > > >> >> > > > How are you using Metron in a production environment? >> >> > > > I have checked around and my conclusion is that the >> Ambari-solution >> >> > > > should not be used in production environment and just for >> poc/testing. >> >> > > > >> >> > > > I want to run Metron with Hadoop on CentOS 7 or 8, If you have >> other >> >> > > > recomendation I can change OS. >> >> > > > >> >> > > > >> >> > > > Thanks alot in advance! >> >> > > > >> >> > > > Best Regards >> >> > > > Marcus >> >> > > >> >> > > >> >> > > >> >> > > -- >> >> > > Eric Jacksch, CPP, CISM, CISSP >> >> > > [email protected] >> >> > > Twitter: @EricJacksch >> >> > > https://SecurityShelf.com >> >> > > >> >> >> >> >> >> >> >> -- >> >> Eric Jacksch, CPP, CISM, CISSP >> >> [email protected] >> >> Twitter: @EricJacksch >> >> https://SecurityShelf.com >> >> >> >> -- >> Eric Jacksch, CPP, CISM, CISSP >> [email protected] >> Twitter: @EricJacksch >> https://SecurityShelf.com >> >
