Unsubscribe

2021-05-18 Thread Dhruv Kumar
Unsubscribe - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [ANNOUNCE] Apache Spark 2.4.8 released

2021-05-18 Thread Gengliang Wang
Great work, Liang-Chi! > On May 19, 2021, at 10:23 AM, 郑瑞峰 wrote: > > Thank you for the great work, Liang-Chi! > > > -- 原始邮件 -- > 发件人: "Chao Sun" ; > 发送时间: 2021年5月19日(星期三) 凌晨1:28 > 收件人: "Maxim Gekk"; > 抄送: "Yuming Wang";"Jungtaek > Lim";"Wenchen >

Re: Apache Spark 3.1.2 Release?

2021-05-18 Thread Gengliang Wang
Late +1, thank you, Dongjoon! > On May 19, 2021, at 10:47 AM, Jungtaek Lim > wrote: > > Late +1 here as well, thanks for volunteering! > > 2021년 5월 19일 (수) 오전 11:24, 郑瑞峰 >님이 작성: > late +1. thanks Dongjoon! > > > -- 原始邮件 -- > 发件人:

Re: Apache Spark 3.1.2 Release?

2021-05-18 Thread Jungtaek Lim
Late +1 here as well, thanks for volunteering! 2021년 5월 19일 (수) 오전 11:24, 郑瑞峰 님이 작성: > late +1. thanks Dongjoon! > > > -- 原始邮件 -- > *发件人:* "Dongjoon Hyun" ; > *发送时间:* 2021年5月19日(星期三) 凌晨1:29 > *收件人:* "Wenchen Fan"; > *抄送:* "Xiao Li";"Kent Yao";"John >

WholeStageCodeGen + DSv2

2021-05-18 Thread Andrew Melo
Hello, When reading a very wide (> 1000 cols) input, WholeStageCodeGen blows past the 64kB source limit and fails. Looking at the generated code, a big part of the code is simply the DSv2 convention that the codegen'd variable names are the same as the columns instead of something more compact

回复: Apache Spark 3.1.2 Release?

2021-05-18 Thread 郑瑞峰
late +1. thanks Dongjoon! --原始邮件-- 发件人: "Dongjoon Hyun"

回复: [ANNOUNCE] Apache Spark 2.4.8 released

2021-05-18 Thread 郑瑞峰
Thank you for the great work, Liang-Chi! --原始邮件-- 发件人: "Chao Sun"

Secrets store for DSv2

2021-05-18 Thread Andrew Melo
Hello, When implementing a DSv2 datasource, where is an appropriate place to store/transmit secrets from the driver to the executors? Is there built-in spark functionality for that, or is my best bet to stash it as a member variable in one of the classes that gets sent to the executors? Thanks!

Re: Apache Spark 3.1.2 Release?

2021-05-18 Thread Dongjoon Hyun
Thank you all! I'll start to prepare. Bests, Dongjoon. On Tue, May 18, 2021 at 12:53 AM Wenchen Fan wrote: > +1, thanks! > > On Tue, May 18, 2021 at 1:37 PM Xiao Li wrote: > >> +1 Thanks, Dongjoon! >> >> Xiao >> >> >> >> On Mon, May 17, 2021 at 8:45 PM Kent Yao wrote: >> >>> +1. thanks

Re: [ANNOUNCE] Apache Spark 2.4.8 released

2021-05-18 Thread Chao Sun
Great work Liang-Chi! On Tue, May 18, 2021 at 1:14 AM Maxim Gekk wrote: > Congratulations everyone with the new release, and thanks to Liang-Chi. > > Maxim Gekk > > Software Engineer > > Databricks, Inc. > > > On Tue, May 18, 2021 at 11:06 AM Yuming Wang wrote: > >> Great work, Liang-Chi! >>

Re: [ANNOUNCE] Apache Spark 2.4.8 released

2021-05-18 Thread Maxim Gekk
Congratulations everyone with the new release, and thanks to Liang-Chi. Maxim Gekk Software Engineer Databricks, Inc. On Tue, May 18, 2021 at 11:06 AM Yuming Wang wrote: > Great work, Liang-Chi! > > On Tue, May 18, 2021 at 3:57 PM Jungtaek Lim > wrote: > >> Thanks for the huge efforts on

Re: [ANNOUNCE] Apache Spark 2.4.8 released

2021-05-18 Thread Yuming Wang
Great work, Liang-Chi! On Tue, May 18, 2021 at 3:57 PM Jungtaek Lim wrote: > Thanks for the huge efforts on driving the release! > > On Tue, May 18, 2021 at 4:53 PM Wenchen Fan wrote: > >> Thank you, Liang-Chi! >> >> On Tue, May 18, 2021 at 1:32 PM Dongjoon Hyun >> wrote: >> >>> Finally!

Re: [ANNOUNCE] Apache Spark 2.4.8 released

2021-05-18 Thread Jungtaek Lim
Thanks for the huge efforts on driving the release! On Tue, May 18, 2021 at 4:53 PM Wenchen Fan wrote: > Thank you, Liang-Chi! > > On Tue, May 18, 2021 at 1:32 PM Dongjoon Hyun > wrote: > >> Finally! Thank you, Liang-Chi. >> >> Bests, >> Dongjoon. >> >> >> On Mon, May 17, 2021 at 10:14 PM

Re: [ANNOUNCE] Apache Spark 2.4.8 released

2021-05-18 Thread Wenchen Fan
Thank you, Liang-Chi! On Tue, May 18, 2021 at 1:32 PM Dongjoon Hyun wrote: > Finally! Thank you, Liang-Chi. > > Bests, > Dongjoon. > > > On Mon, May 17, 2021 at 10:14 PM Takeshi Yamamuro > wrote: > >> Thank you for the release work, Liang-Chi~ >> >> On Tue, May 18, 2021 at 2:11 PM Hyukjin Kwon

Re: Apache Spark 3.1.2 Release?

2021-05-18 Thread Wenchen Fan
+1, thanks! On Tue, May 18, 2021 at 1:37 PM Xiao Li wrote: > +1 Thanks, Dongjoon! > > Xiao > > > > On Mon, May 17, 2021 at 8:45 PM Kent Yao wrote: > >> +1. thanks Dongjoon >> >> *Kent Yao * >> @ Data Science Center, Hangzhou Research Institute, NetEase Corp. >> *a spark enthusiast* >> *kyuubi