Re: 答复: How can I get the column data based on specific column name and then stored these data in array or list ?

Actually you can call df.collect_list("a"). 2015-12-25 16:00 GMT+08:00 Jeff Zhang : > You can use udf to convert one column for array type. Here's one sample > > val conf = new SparkConf().setMaster("local[4]").setAppName("test") > val sc = new SparkContext(conf) > val

答复: 答复: How can I get the column data based on specific column name and then stored these data in array or list ?

Yes. It’s a good method . But UDF ? What is UDF ? U…..D…F ? OK, I can learn from it. Thanks, Minglei. 发件人: Jeff Zhang [mailto:zjf...@gmail.com] 发送时间: 2015年12月25日 16:00 收件人: zml张明磊 抄送: dev@spark.apache.org 主题: Re: 答复: How can I get the column data based on specific column name and

答复: 答复: How can I get the column data based on specific column name and then stored these data in array or list ?

咦 ？？？ I will have a try. Thanks, Minglei. 发件人: Yanbo Liang [mailto:yblia...@gmail.com] 发送时间: 2015年12月25日 16:07 收件人: Jeff Zhang 抄送: zml张明磊; dev@spark.apache.org 主题: Re: 答复: How can I get the column data based on specific column name and then stored these data in array or list ? Actually you can

Re: 答复: How can I get the column data based on specific column name and then stored these data in array or list ?

You can use udf to convert one column for array type. Here's one sample val conf = new SparkConf().setMaster("local[4]").setAppName("test") val sc = new SparkContext(conf) val sqlContext = new SQLContext(sc) import sqlContext.implicits._ import sqlContext._ sqlContext.udf.register("f", (a:String)

答复: How can I get the column data based on specific column name and then stored these data in array or list ?

Thanks, Jeff. It’s not choose some columns of a Row. It’s just choose all data in a column and convert it to an Array. Do you understand my mean ? In Chinese 我是想基于这个列名把这一列中的所有数据都选出来，然后放到数组里面去。 发件人: Jeff Zhang [mailto:zjf...@gmail.com] 发送时间: 2015年12月25日 15:39 收件人: zml张明磊 抄送: