Re: Slower than usual on PRs

Sorry to hear that. Hope you get better soon! On Tue, Dec 3, 2019 at 1:28 AM Holden Karau wrote: > Hi Spark dev folks, > > Just an FYI I'm out dealing with recovering from a motorcycle accident so > my lack of (or slow) responses on PRs/docs is health related and please > don't block on any of m

Re: Fw:Re:Re: A question about radd bytes size

You can only know the actual data size of your RDD in memory if you serialize your data objects to binaries. Otherwise you can only estimate the size of the data objects in JVM. On Tue, Dec 3, 2019 at 5:58 AM zhangliyun wrote: > > > > > > > 转发邮件信息 > 发件人："zhangliyun" > 发送日期：201

Re: Status of Scala 2.13 support

Thank you for sharing the status, Sean. Given the current circumstance, our status and approach sounds realistic to me. +1 for continuing after cutting `branch-3.0`. Bests, Dongjoon. On Sun, Dec 1, 2019 at 10:50 AM Sean Owen wrote: > As you can see, I've been working on Scala 2.13 support. T

Fw:Re:Re: A question about radd bytes size

转发邮件信息 发件人："zhangliyun" 发送日期：2019-12-03 05:56:55 收件人："Wenchen Fan" 主题：Re:Re: A question about radd bytes size Hi Fan: thanks for reply, I agree that the how the data is stored decides the total bytes of the table file. In my experiment, I found that sequenc

Slower than usual on PRs

Hi Spark dev folks, Just an FYI I'm out dealing with recovering from a motorcycle accident so my lack of (or slow) responses on PRs/docs is health related and please don't block on any of my reviews. I'll do my best to find some OSS cycles once I get back home. Cheers, Holden -- Twitter: http

Re: Enabling fully disaggregated shuffle on Spark

Hi Felix & Ben, This is Li Hao from Baidu, same team with Linhong. As mentioned in Linhong’s email, independent disaggregated shuffle service is also our solution and continuous exploring direction for improving stability of Hadoop MR and Spark in the production environment. We would love to hea

Re: Meetup Link for Bangalore is broken

Hi All,     I have fixed a broken link and pointed the link to an active Spark group run by me and submitted the Pull request as suggested below.   Appreciate if somebody can review and approve if all looks good. -Thanks -Sanjay On 20-10-2019 2