July 25, 2019
Participants: Cloudera, Tencent, Taiwan University, Xiaomi, ByteDance, JD,
Didi, Alibaba
ByteDance
-
Version: 2.6.0
-
1000+ patches
-
Fair scheduler
-
Improvements: like CS global scheduling
-
Scale: 40,000 hosts last year!!
-
Flink + Spark + MR + other computations
-
Not server side federation: client side to route apps to clusters
-
Largest cluster 10,000 nodes
Alibaba
-
Version: 3.1.0 (upgraded 1.5 year before)
-
CS + Global scheduling
-
Overcommitment with opportunistic containers -> increase utilization
-
Scheduler activities (share more details in upcoming meetup)
Xiaomi
-
2.6.0 -> 3.1.0 (upgrading in progress)
-
Migrate FS to CS
-
Investigating federation
-
TODO: Open umbrella for migration
Hadoop Meetup 8/10 discussion
-
Location TBD, most likely will be a one day event
-
Setting up a review-board, we are glad to have 1 or 2 contract-point
from each company in this board, please nominate to junping...@apache.org
-
Call for more talks!!!
FYI
Wanqiang Ji
俊平堵 <junping...@apache.org>于2019年7月25日 周四11:53写道：
> Hi Folks,
>
> Kindly remind that we have YARN+MR APAC sync today, and you are
> welcome to join:
>
>
> Time and Date：07/25 1:00 pm (CST Time)
>
> Zoom link：Zoom | https://cloudera.zoom.us/j/880548968
>
> Summary：
>
> https://docs.google.com/document/d/1GY55sXrekVd-aDyRY7uzaX0hMDPyh3T-AL1kUY2TI5M
>
>
> Thanks,
>
>
> Junping
>
>
>
> Wangda Tan <wheele...@gmail.com> 于2019年6月28日周五 上午2:57写道：
>
> > Hi folks,
> >
> > Here's the Hadoop Community Sync Up proposal/schedule:
> >
> https://docs.google.com/document/d/1GfNpYKhNUERAEH7m3yx6OfleoF3MqoQk3nJ7xqHD9nY/edit#heading=h.xh4zfwj8ppmn
> >
> > And here's calendar file:
> >
> >
> >
> https://calendar.google.com/calendar/ical/hadoop.community.sync.up%40gmail.com/public/basic.ics
> >
> > We gave it a try this week for YARN+MR and Submarine sync, feedbacks from
> > participants seems pretty good, lots of new information shared during
> sync
> > up, and companies are using/developing Hadoop can better know each other.
> >
> > Next week there're 4 community sync-ups (Two Submarine for different
> > timezones, one YARN+MR, one storage), please join to whichever you're
> > interested:
> >
> > [image: image.png]
> >
> > Zoom info and notes can be found in the Google calendar invitation.
> >
> > Thanks,
> > Wangda
> >
>
