Hello,
I’m trying to create a table with sqlContext.sql method as below:
val sc = new SparkContext()
val sqlContext = new SQLContext(sc)
import sqlContext.implicits._
sqlContext.sql(s"""
create table if not exists landing (
date string,
referrer string
)
partitioned by (partnerid string,dt string)
row format delimited fields terminated by '\t' lines terminated by '\n'
STORED AS TEXTFILE LOCATION 's3n://...'
"”")
It gives error on spark-submit:
Exception in thread "main" java.lang.RuntimeException: [2.1] failure: ``with''
expected but identifier create found
create external table if not exists landing (
^
at scala.sys.package$.error(package.scala:27)
at
org.apache.spark.sql.catalyst.AbstractSparkSQLParser.parse(AbstractSparkSQLParser.scala:36)
at
org.apache.spark.sql.catalyst.DefaultParserDialect.parse(ParserDialect.scala:67)
What can be the reason??