Re: Announcing Delta Lake 0.3.0

2019-08-02 Thread Gourav Sengupta
Yah! celebrations, wine, cocktails, parties, dances tonight :) Regards, Gourav On Fri, Aug 2, 2019 at 2:44 AM Tathagata Das wrote: > Hello everyone, > > We are excited to announce the availability of Delta Lake 0.3.0 which > introduces new programmatic APIs for manipulating and

Re: How to get logging right for Spark applications in the YARN ecosystem

2019-08-02 Thread raman gugnani
HI Srinath, I am not able to use log4j2 , Rolling file appender is only supported in log4j 2. On Fri, 2 Aug 2019 at 15:48, Girish bhat m wrote: > Hi Raman, > > Since you are using YARN, you collect the yarn logs (which also contains > the application logs) by executing below command and move

Re: How to get logging right for Spark applications in the YARN ecosystem

2019-08-02 Thread Girish bhat m
Hi Raman, Since you are using YARN, you collect the yarn logs (which also contains the application logs) by executing below command and move to the desired location yarn logs -applicationId Best Girish On Fri, Aug 2, 2019 at 10:17 AM Srinath C wrote: > Hi Raman, > > Probably use the rolling