Hi,
Can you print out the environment tab on your UI.
By default spark-sql runs on local mode which means that you only have one
driver and one executor in one jvm. Do you increase the executor memory
through
SET spark.executor.memory=xG
And adjust it and run the SQL again.
HTH
Dr Mich
Hi,
Can you print out the environment tab on your UI.
By default spark-sql runs on local mode which means that you only have one
driver and one executor in one jvm. Do you increase the executor memory
through
SET spark.executor.memory=xG
And adjust it and run the SQL again.
HTH
Dr Mich