Re: Reparitioning Hive tables - Container killed by YARN for exceeding memory limits

2017-08-03 Thread Chetan Khatri
Thanks Holden ! On Thu, Aug 3, 2017 at 4:02 AM, Holden Karau wrote: > The memory overhead is based less on the total amount of data and more on > what you end up doing with the data (e.g. if your doing a lot of off-heap > processing or using Python you need to increase it). Honestly most people

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-03 Thread Marcelo Vanzin
This vote passes with 3 binding +1 votes, 5 non-binding votes, and no -1 votes. Thanks all! +1 votes (binding): Tom Graves Sean Owen Marcelo Vanzin +1 votes (non-binding): Ryan Blue Denis Bolshakov Dong Joon Hyun Hyukjin Kwon Ashutosh Pathak On Mon, Jul 31, 2017 at 10:27 AM, Marcelo Vanzin wr

Re: [VOTE] [SPIP] SPARK-18085: Better History Server scalability

2017-08-03 Thread Reynold Xin
A late +1 too. On Thu, Aug 3, 2017 at 1:37 PM Marcelo Vanzin wrote: > This vote passes with 3 binding +1 votes, 5 non-binding votes, and no -1 > votes. > > Thanks all! > > +1 votes (binding): > Tom Graves > Sean Owen > Marcelo Vanzin > > +1 votes (non-binding): > Ryan Blue > Denis Bolshakov > Do