Hey Antoine.
Indeed, Bigtop has all the tools for automatic cluster deployment
according to the roles of the nodes. In fact, this is exactly how we
test Bigtop in our CI/CD environment with docker provisioner. Same would
apply to actual hardware based cluster.
Please check bigtop-deploy/puppet/README.md and other content in that
directory for more information.
There's also a way to deploy clusters with Ubuntu Juju, but I am not
sure how up-to-date that solution is.
Cheers.
--
With regards,
Cos
On 30.03.2021 12:25, Antoine DUBOIS wrote:
Hello,
I've been working to deploy multiple Apache big data products (Yarn,
Spark, Zeppelin, Hive, Ranger) not HDFS
So far I've been deploying it manually and it works.
I'm now aiming at a production infrastructure with automated deployement.
I'm wondering if Apache bigtop can help us to deploy such cluster and if
possible how ?
Is it simply a way to build RPM with choosen version or can it help us
deploy the full cluster with proper configuration depending on server
roles ?
It's a bit confusing in my head what is exactly Apache bigtop.
Have a very nice day.
Antoine
