Spark 2.4.5 RC2 Preparation Status

2020-01-20 Thread Dongjoon Hyun
Hi, All. RC2 was scheduled on Today and all RC1 feedbacks seems to be addressed. However, I'm waiting for another on-going correctness PR. https://github.com/apache/spark/pull/27233 [SPARK-29701][SQL] Correct behaviours of group analytical queries when empty input given Unlike the other

[SQL] Is it worth it (and advisable) to implement native UDFs?

2020-01-20 Thread email
Hi, I read online[1] that for a best UDF performance it is possible to implement them using internal Spark expressions, and I also saw a couple of pull requests such as [2] and [3] where this was put to practice (not sure if for that reason or just to extend the API). We have an

Re: [Discuss] Metrics Support for DS V2

2020-01-20 Thread Ryan Blue
I sent them to you. I had to go direct because the ASF mailing list will remove attachments. I'm happy to send them to others if needed as well. On Sun, Jan 19, 2020 at 9:01 PM Sandeep Katta < sandeep0102.opensou...@gmail.com> wrote: > Please send me the patch , I will apply and test. > > On