On Tue, Sep 13, 2022, 6:30 PM Hari Kunapareddy
wrote:
>
>
On Tue, Sep 13, 2022, 21:23 Sachit Murarka wrote:
> Hi Vibhor,
>
> Thanks for your response!
>
> There are some properties which can be set without changing this flag
> "spark.sql.legacy.setCommandRejectsSparkCoreConfs"
> post creation of spark session , like shuffle partitions. Any idea why
Hello Everyone,
I am trying to set network timeout property , it used to work in Spark2.X ,
but in Spark 3 , it is giving following error:-
Could you please suggest if it is due to any bug in Spark3 or do we need
any other property because as per spark official doc ,this is the unchanged
Hi Sachit,
Check the migration guide.
https://spark.apache.org/docs/latest/sql-migration-guide.html#:~:text=Spark%202.4%20and%20below%3A%20the,legacy.setCommandRejectsSparkCoreConfs%20to%20false.
Migration Guide: SQL, Datasets and DataFrame - Spark 3.3.0 Documentation -
Apache
