Yin & Michael, Thanks, I'll try the SQL route.
From: Yin Huai <[email protected]<mailto:[email protected]>> Date: Wednesday, August 13, 2014 at 5:04 PM To: Michael Armbrust <[email protected]<mailto:[email protected]>> Cc: Silvio Fiorito <[email protected]<mailto:[email protected]>>, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Re: SparkSQL Hive partitioning support Hi Silvio, You can insert into a static partition via SQL statement. Dynamic partitioning is not supported at the moment. Thanks, Yin On Wed, Aug 13, 2014 at 2:03 PM, Michael Armbrust <[email protected]<mailto:[email protected]>> wrote: This is not supported at the moment. There are no concrete plans at the moment to support it though the programatic API, but it should work using SQL as you suggested. On Wed, Aug 13, 2014 at 8:22 AM, Silvio Fiorito <[email protected]<mailto:[email protected]>> wrote: Using the SchemaRDD insertInto method, is there any way to support partitions on a field in the RDD? If not, what's the alternative, register a table and do an insert into via SQL statement? Any plans to support partitioning via insertInto? What other options are there for inserting into a partitioned Hive table via SparkSQL? Thanks, Silvio
