: 星期二, 2022年9月20日 15:58
收件人: user @spark
主题: NoClassDefError and SparkSession should only be created and accessed on the
driver.
Hello ,
I am using Spark3 where there are some UDFs along . I am using Dataframe APIs
to write parquet using spark. I am getting NoClassDefError along with below
park running code?
>
>
>
> *发件人**:* rajat kumar
> *日期**:* 星期二, 2022年9月20日 15:58
> *收件人**:* user @spark
> *主题**:* NoClassDefError and SparkSession should only be created and
> accessed on the driver.
>
> Hello ,
>
> I am using Spark3 where there are some UDFs along . I a
Can you show us your code?
your udf wasn’t serialized by spark, In my opinion, were they out of the
spark running code?
发件人: rajat kumar
日期: 星期二, 2022年9月20日 15:58
收件人: user @spark
主题: NoClassDefError and SparkSession should only be created and accessed on the
driver.
Hello ,
I am using
Hello ,
I am using Spark3 where there are some UDFs along . I am using Dataframe
APIs to write parquet using spark. I am getting NoClassDefError along with
below error.
If I comment out all UDFs , it is working fine.
Could someone suggest what could be wrong. It was working fine in Spark2.4
22/
