Re: Create table before inserting in SQL

2023-02-01 Thread Mich Talebzadeh
Hi, It is not very clear your statement below: ".. If the table existed, I would create a table using JDBC in spark SQL and then insert into it, but I can't create a table if it doesn't exist in JDBC database..." If the table exists in your JDBC database, why do you need to create it? How do

Create table before inserting in SQL

2023-02-01 Thread Harut Martirosyan
I have a resultset (defined in SQL), and I want to insert it into my JDBC database using only SQL, not dataframes API. If the table existed, I would create a table using JDBC in spark SQL and then insert into it, but I can't create a table if it doesn't exist in JDBC database. How to do that

Spark Thrift Server issue with external HDFS table

2023-02-01 Thread Kalhara Gurugamage
Hello Team, We are using the spark 3.3.0 version. We’ve created external HDFS tables using beeline spark with thrift server Here we have multiple parquet files in one partition need to be attached to the external HDFS table. Note that HDFS data is stored as distributed setup. - There is