Thank you very much, also can do this, it seems that I know too little about RDD
> 在 2014年9月2日,21:22,Silvio Fiorito <[email protected]> 写道: > > Once you’ve registered an RDD as a table, you can use it in SparkSQL > statements: > > myrdd.registerAsTable(“my_table”) > > hql(“FROM my_table INSERT INTO TABLE my_other_table”) > > > On 9/2/14, 9:18 AM, "centerqi" <[email protected]> wrote: > >>>>> schemardd can exec SQL stamens? >> >> >> >>> 在 2014年9月2日,20:42,Silvio Fiorito <[email protected]> 写道: >>> >>> You can use saveAsTable or do an INSERT SparkSQL statement as well in >>> case >>> you need other Hive query features, like partitioning. >>> >>>> On 9/2/14, 6:54 AM, "centerqi hu" <[email protected]> wrote: >>>> >>>> I got it >>>> >>>> import org.apache.spark.{SparkConf, SparkContext} >>>> import org.apache.spark.sql._ >>>> val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc) >>>> import hiveContext._ >>>> val usermeta = hql(" SELECT userid,idlist from meta WHERE >>>> day='2014-08-01' limit 1000") >>>> case class SomeClass(name:String,idlist:String) >>>> val scmm = usermeta.map(t=>{SomeClass(t(0).toString,t(1).toString >>>> +"iddddddddd")}) >>>> val good = createSchemaRDD(scmm) >>>> good.saveAsTable("meta_test") >>>> >>>> 2014-09-02 17:50 GMT+08:00 centerqi hu <[email protected]>: >>>>> I want to save schemardd to hive >>>>> >>>>> val usermeta = hql(" SELECT userid,idlist from usermeta WHERE >>>>> day='2014-08-01' limit 1000") >>>>> case class SomeClass(name:String,idlist:String) >>>>> val schemardd = >>>>> usermeta.map(t=>{SomeClass(t(0).toString,t(1).toString)}) >>>>> >>>>> How to save schemardd to hive? >>>>> >>>>> Thanks >>>>> >>>>> -- >>>>> [email protected]|齐忠 >>>> >>>> >>>> >>>> -- >>>> [email protected]|齐忠 >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: [email protected] >>>> For additional commands, e-mail: [email protected] >>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: [email protected] >>> For additional commands, e-mail: [email protected] > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] >
