Re: [ANNOUNCE] Announcing Apache Spark 3.1.1

Congrats, all! Bests, Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark 

AW: [ANNOUNCE] Announcing Apache Spark 3.1.1

Congrats! Von: Hyukjin Kwon Gesendet: Mittwoch, 3. März 2021 02:41 An: user @spark ; dev Betreff: [ANNOUNCE] Announcing Apache Spark 3.1.1 We are excited to announce Spark 3.1.1 today. Apache Spark 3.1.1 is the second release of the 3.x line. This release adds Python type annotations and

Re: [ANNOUNCE] Announcing Apache Spark 3.1.1

Congrats, all! Bests, Takeshi On Wed, Mar 3, 2021 at 2:18 PM Mridul Muralidharan wrote: > > Thanks Hyukjin and congratulations everyone on the release ! > > Regards, > Mridul > > On Tue, Mar 2, 2021 at 8:54 PM Yuming Wang wrote: > >> Great work, Hyukjin! >> >> On Wed, Mar 3, 2021 at 9:50 AM

Re: [ANNOUNCE] Announcing Apache Spark 3.1.1

Thanks Hyukjin and congratulations everyone on the release ! Regards, Mridul On Tue, Mar 2, 2021 at 8:54 PM Yuming Wang wrote: > Great work, Hyukjin! > > On Wed, Mar 3, 2021 at 9:50 AM Hyukjin Kwon wrote: > >> We are excited to announce Spark 3.1.1 today. >> >> Apache Spark 3.1.1 is the

Re: [ANNOUNCE] Announcing Apache Spark 3.1.1

Great work, Hyukjin! On Wed, Mar 3, 2021 at 9:50 AM Hyukjin Kwon wrote: > We are excited to announce Spark 3.1.1 today. > > Apache Spark 3.1.1 is the second release of the 3.x line. This release adds > Python type annotations and Python dependency management support as part > of Project Zen. >

Re: minikube and kubernetes cluster versions for integration testing

Thank you for sharing and suggestion, Attila. Additionally, given the following information, - The latest Minikube is v1.18.0 with K8s v1.20.2 - AWS EKS will add K8s v1.20 on April, 2021 - The end of support in AWS EKS are K8s v1.15 (May 3, 2021) K8s v1.16 (July, 2021) K8s v1.17

[ANNOUNCE] Announcing Apache Spark 3.1.1

We are excited to announce Spark 3.1.1 today. Apache Spark 3.1.1 is the second release of the 3.x line. This release adds Python type annotations and Python dependency management support as part of Project Zen. Other major updates include improved ANSI SQL compliance support, history server

Re: [DISCUSS] SPIP: FunctionCatalog

Yes, GenericInternalRow is safe if when type mismatches, with the cost of using Object[], and primitive types need to do boxing. And this is a runtime failure, which is absolutely worse than query-compile-time checks. Also, don't forget my previous point: users need to specify the type and index

minikube and kubernetes cluster versions for integration testing

Hi All, I am working on PR to change kubernetes integration testing and use the `minikube kubectl -- config view --minify` output to build the kubernetes client config. This solution has the advantage of not using hardcoded values like 8443 for server port (which is wrong when the vm-driver is