Re: scheduler braindump: architecture, gotchas, etc.

2019-02-04 Thread John Zhuge
Thx Xiao! On Mon, Feb 4, 2019 at 9:04 AM Xiao Li wrote: > Thank you, Imran! > > Also, I attached the slides of "Deep Dive: Scheduler of Apache Spark". > > Cheers, > > Xiao > > > > John Zhuge 于2019年2月4日周一 上午8:59写道: > >> Thanks Imran! >> >> On Mon, Feb 4, 2019 at 8:42 AM Imran Rashid >> wrote:

Re: scheduler braindump: architecture, gotchas, etc.

2019-02-04 Thread sujith chacko
Thanks Li and Imran for providing us an overview about one of the complex module in spark  Excellent sharing. Regards Sujith. On Mon, 4 Feb 2019 at 10:54 PM, Xiao Li wrote: > Thank you, Imran! > > Also, I attached the slides of "Deep Dive: Scheduler of Apache Spark". > > Cheers, > > Xiao > >

Re: scheduler braindump: architecture, gotchas, etc.

2019-02-04 Thread Parth Gandhi
Thank you Imran, this is quite helpful. Regards, Parth Kamlesh Gandhi On Mon, Feb 4, 2019 at 11:01 AM Rubén Berenguel wrote: > Thanks Imran, will definitely give it a look (even if just out of sheer > interest on how the sausage is done) > > R > > > On 4 February 2019 at 17:59:33, John Zhuge

Re: scheduler braindump: architecture, gotchas, etc.

2019-02-04 Thread John Zhuge
Thanks Imran! On Mon, Feb 4, 2019 at 8:42 AM Imran Rashid wrote: > The scheduler has been pretty error-prone and hard to work on, and I feel > like there may be a dwindling core of active experts. I'm sure its very > discouraging to folks trying to make what seem like simple changes, and >

scheduler braindump: architecture, gotchas, etc.

2019-02-04 Thread Imran Rashid
The scheduler has been pretty error-prone and hard to work on, and I feel like there may be a dwindling core of active experts. I'm sure its very discouraging to folks trying to make what seem like simple changes, and then find they are in a rats nest of complex issues they weren't expecting.