Re: Unsubscribe

2020-06-21 Thread Wesley
please send an empty email to: dev-unsubscr...@spark.apache.org user-unsubscr...@spark.apache.org for unsubscribing yourself from the lists. Thanks. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: unsubscribe

2020-06-07 Thread Wesley
please send an empty email to: user-unsubscr...@spark.apache.org for unsubscribing. thanks. unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Adding an indexed column

2015-05-29 Thread Wesley Miao
One way I can see is to - 1. get rdd from your df 2. call rdd.zipWithIndex to get a new rdd 3. turn your new rdd to a new df On Fri, May 29, 2015 at 5:43 AM, Cesar Flores ces...@gmail.com wrote: Assuming that I have the next data frame: flag | price -- 1

Re: Using Log4j for logging messages inside lambda functions

2015-05-25 Thread Wesley Miao
The reason it didn't work for you is that the function you registered with someRdd.map will be running on the worker/executor side, not in your driver's program. Then you need to be careful to not accidentally close over some objects instantiated from your driver's program, like the log object in

Re: [ANNOUNCE] Announcing Apache Spark 2.4.4

2019-09-02 Thread Wesley Peng
on 2019/9/2 5:54, Dongjoon Hyun wrote: We are happy to announce the availability of Spark 2.4.4! Spark 2.4.4 is a maintenance release containing stability fixes. This release is based on the branch-2.4 maintenance branch of Spark. We strongly recommend all 2.4 users to upgrade to this stable

Re: unsubscribe

2020-06-27 Thread Wesley Peng
please send an empty email to: user-unsubscr...@spark.apache.org to unsubscribe yourself from the list. Sri Kris wrote: Sent from Mail for Windows 10 - To unsubscribe

Re: Unsubscribe

2020-12-22 Thread Wesley Peng
Bhavya Jain wrote: Unsubscribe please send an email to: user-unsubscr...@spark.apache.org to unsubscribe yourself from the list. thanks. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org