filesystem.
I created a new database and confirmed that the location was in HDFS
i.e.hdfs://xxx:8020/apps/hive/warehouse/
For this the code ran fine.
Thanks for the help,
-Nirmal
From: Nirmal Kumar
Sent: 19 June 2019 11:51
To: Raymond Honderdors
Cc: user
Subject: RE: Unable to run simple spark-sql
directory of hive user
(/home/hive/).
Why is it referring the local file system and from where?
Thanks,
Nirmal
From: Raymond Honderdors
Sent: 19 June 2019 11:18
To: Nirmal Kumar
Cc: user
Subject: Re: Unable to run simple spark-sql
Hi Nirmal,
i came across the following article
"
for Android<https://aka.ms/ghei36>
From: Nirmal Kumar
Sent: Tuesday, June 18, 2019 5:56:06 PM
To: Raymond Honderdors; Nirmal Kumar
Cc: user
Subject: RE: Unable to run simple spark-sql
Hi Raymond,
Permission on hdfs is 777
drwxrwxrwx - impadmin hdfs 0 2
-warehouse/testdb.db/employee_orc/.hive-staging_hive_2019-06-18_16-08-21_448_1691186175028734135-1'
Thanks,
-Nirmal
From: Raymond Honderdors
Sent: 18 June 2019 17:52
To: Nirmal Kumar
Cc: user
Subject: Re: Unable to run simple spark-sql
Hi
Can you check the permission of the user running spark
O
Hi List,
I tried running the following sample Java code using Spark2 version 2.0.0 on
YARN (HDP-2.5.0.0)
public class SparkSQLTest {
public static void main(String[] args) {
SparkSession sparkSession = SparkSession.builder().master("yarn")
.config("spark.sql.warehouse.dir",