[no subject]

2021-11-17 Thread 马殿军
unsubscribe

Unsubscribe

2021-11-17 Thread HARSH TAKKAR
Unsubscribe

Unsubscribe

2021-11-17 Thread Edwin Barahona
Unsubscribe

unsubscribe

2021-11-17 Thread Shafaq
unsubscribe -- Kind Regards, Shafaq

[no subject]

2021-11-17 Thread Fred Wang
unsubscribe

A mass of unexpected SQLMetric in resutlStage

2021-11-17 Thread shipenglei
Hi， I have a query like `insert overwrite select`, which only has a resultTask but contains a huge resultSize 500+kb, i found it's caused by 8000+ accumulators which most are SQLMetric. The last stage is below: It looks like there are

Re: Apache Spark 3.2.0 | Pyspark | Pycharm Setup

2021-11-17 Thread Mich Talebzadeh
yep the latest pyspark is 3.2. you can easily install it from available packages [image: image.png] my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or

Re: Apache Spark 3.2.0 | Pyspark | Pycharm Setup

2021-11-17 Thread Khalid Mammadov
Hi Anil You dont need to download and Install Spark. It's enough to add pyspark to PyCharm as a package for your environment and start developing and testing locally. The thing is PySpark includes local Spark that is installed as part of pip install. When it comes to your particular issue. I

Re: Apache Spark 3.2.0 | Pyspark | Pycharm Setup

2021-11-17 Thread Gourav Sengupta
Hi Anil, I generally create an anaconda environment, and then install pyspark in it, and then configure the interpreter to point to that particular environment. Never faced an issue with my approach. Regards, Gourav Sengupta On Wed, Nov 17, 2021 at 7:39 AM Anil Kulkarni wrote: > Hi Spark