Thanks for the summary, Evans.
>From Linaro's perspective, it would be great to see:
1. Simple and unified deployment/management for Bigtop SW stack across
various distros and architectures.
We've seen people like Bigtop stack (open and easy to customize) but
failed to deploy and manage in an easy way. While Ambari provides such
capabilities it combines tight with HDP and x86. And this prevents the
wider aoption for Bigtop. As some academies and industry players are
leveraging certain Bigdata workloads to non-x86 platforms it would give
them great help if we can enable Bigtop SW stack support in Ambari. Also I
think community can work with ODPi (https://www.odpi.org/) on this to move
things forward more effectively.
2. Add and improve tests (smoke tests/package tests) to improve Bigtop
stack quality.
There are quite a few components enabled in the stack but lack of
tests. And some existing smoke tests need improvement to align with new
versions/settings. This could be improved to achieve good tests quality and
results to give users pretty confident to use Bigtop in their daily work.
3. Native K8s support as Jay has mentioned
4. Hadoop 3.x supports.
This could take times and effort (I think most come from ecosystem
dependecies), but it could be our primary but not prioritized work. :)
That's things came up to me so far. Pls feel free to comment.
Thanks.
Jun
Evans Ye 于2019年1月4日周五 上午12:10写道：
> To sum up the discussion of this thread, there're two ideas proposed:
> * Native K8S packages - by Jay
> * Deploy Bigtop via Ambari - by Jun
>
> I think both are very good ideas. However I'd like to gather more info from
> the requirement point of view. For example, Jun what do you see from the
> Linaro perspective for user requirements on Big Data? I think that's a
> valuable input to the community since you guys are also becoming a
> significant contributors at the community.
>
> - Evans
>
>
> Jun HE 於 2018年12月17日 週一 上午9:17寫道：
>
> > +1 for this!
> >
> > And another thing is I'm not clear about the status of ambari mpack in
> > Bigtop, so can we deploy Bigtop SW stack using ambari now? If the answer
> is
> > no, maybe this is what end user would like to see.
> >
> > Jay Vyas 于2018年12月15日周六 上午1:11写道：
> >
> > > How about a Kubernetes native distribution :).
> > >
> > > > On Dec 14, 2018, at 11:53 AM, Evans Ye wrote:
> > > >
> > > > Hi all,
> > > >
> > > > We've just released 1.3.0 back in Nov. 2018 with RM Jun He and the
> > > > community's great help. Now it's time to look forward and setup a
> goal
> > > for
> > > > the next stage. We've a doc established back in 2017 to record the
> > ideas
> > > of
> > > > Bigtop. See:
> > > >
> > > >
> > >
> >
> https://docs.google.com/document/d/1F2Gxu8GARQDZXgqHn12LKkQ5wCV_AF4b_tVmjYB6YfA/edit#
> > > >
> > > > Align with Project Frontier's goal, I'll work on the testing part and
> > > > improve our testing, deployment, CI pipelines as a whole. So welcome
> to
> > > > work on this together!
> > > > But as time flows by, I'd more like to call out for your thoughts.
> What
> > > is
> > > > the most valuable feature to add in Bigtop, which ultimately helps
> you,
> > > > your company, and the big data users in the world. Please join the
> > > > discussion and shape the future of our project.
> > > >
> > > > Best,
> > > > Evans Ye
> > >
> >
>
