RE: How to specify default value for StructField?

2017-02-21 Thread Begar, Veena
Thanks Yan and Yong, Yes, from Spark, I can access ORC files loaded to Hive tables. Thanks. From: 颜发才(Yan Facai) [mailto:facai@gmail.com] Sent: Friday, February 17, 2017 6:59 PM To: Yong Zhang <java8...@hotmail.com> Cc: Begar, Veena <veena.be...@hpe.com>; smartzjp <zjp_j...@

RE: How to specify default value for StructField?

2017-02-15 Thread Begar, Veena
it using dataframe? Thanks. From: Yong Zhang [mailto:java8...@hotmail.com] Sent: Tuesday, February 14, 2017 8:31 PM To: Begar, Veena <veena.be...@hpe.com>; smartzjp <zjp_j...@163.com>; user@spark.apache.org Subject: Re: How to specify default value for StructField? You maybe are looking f

RE: How to specify default value for StructField?

2017-02-14 Thread Begar, Veena
, February 14, 2017 10:32 AM To: Begar, Veena <veena.be...@hpe.com>; user@spark.apache.org Subject: Re: How to specify default value for StructField? You can try the below code. val df = spark.read.format("orc").load("/user/hos/orc_files_test_together") df.select(“f1”,”f2”)