Hi,
I tried to insert into a hive partitioned table
val ZONE: Int = Integer.valueOf(args(2))
val MONTH: Int = Integer.valueOf(args(3))
val YEAR: Int = Integer.valueOf(args(4))
val weightedUVToDF = weightedUVToRecord.toDF()
weightedUVToDF.registerTempTable(speeddata)
hiveContext.sql(INSERT
Not quite sure whether I understand your question properly. But if you
just want to read the partition columns, it’s pretty easy. Take the
“year” column as an example, you may do this in HiveQL:
|hiveContext.sql(SELECT year FROM speed)
|
or in DataFrame DSL:
I would like to insert the table, and the value of the partition column
to be inserted must be from temporary registered table/dataframe.
Patcharee
On 16. mars 2015 15:26, Cheng Lian wrote:
Not quite sure whether I understand your question properly. But if you
just want to read the
I see. Since all Spark SQL queries must be issued from the driver side,
you'll have to first collect all interested values to the driver side,
and then use them to compose one or more insert statements.
Cheng
On 3/16/15 10:33 PM, patcharee wrote:
I would like to insert the table, and the
