On Tue, Sep 13, 2022, 6:30 PM Hari Kunapareddy
wrote:
>
>
On Tue, Sep 13, 2022, 21:23 Sachit Murarka wrote:
> Hi Vibhor,
>
> Thanks for your response!
>
> There are some properties which can be set without changing this flag
> "spark.sql.legacy.setCommandRejectsSparkCoreConfs"
> post creation of spark session , like shuffle partitions. Any idea why
Hi Sachit,
Check the migration guide.
https://spark.apache.org/docs/latest/sql-migration-guide.html#:~:text=Spark%202.4%20and%20below%3A%20the,legacy.setCommandRejectsSparkCoreConfs%20to%20false.
Migration Guide: SQL, Datasets and DataFrame - Spark 3.3.0 Documentation -
Apache
Hello Everyone,
I am trying to set network timeout property , it used to work in Spark2.X ,
but in Spark 3 , it is giving following error:-
Could you please suggest if it is due to any bug in Spark3 or do we need
any other property because as per spark official doc ,this is the unchanged