Re: Design review of SPARK-28594

2019-09-01 Thread Jungtaek Lim
:22 PM > *To:* dev > *Subject:* Design review of SPARK-28594 > > Hi devs, > > I have been working on designing SPARK-28594 [1] (though I've started with > this via different requests) and design doc is now available [2]. > > Let me describe SPARK-28954 briefly - single and grow

Re: Design review of SPARK-28594

2019-09-01 Thread Felix Cheung
I did review it and solving this problem makes sense. I will comment in the JIRA. From: Jungtaek Lim Sent: Sunday, August 25, 2019 3:34:22 PM To: dev Subject: Design review of SPARK-28594 Hi devs, I have been working on designing SPARK-28594 [1] (though I've

Design review of SPARK-28594

2019-08-25 Thread Jungtaek Lim
Hi devs, I have been working on designing SPARK-28594 [1] (though I've started with this via different requests) and design doc is now available [2]. Let me describe SPARK-28954 briefly - single and growing event log file for application has been major issue for streaming application as as long