Re: Java to show struct field from a Dataframe

rn row;             } From: Richard Xin <richardxin...@yahoo.com> Sent: Saturday, December 17, 2016 8:53 PM To: Yong Zhang; zjp_j...@163.com; user Subject: Re: Java to show struct field from a Dataframe I tried to transform root  |-- latitude: double (nullable = false)  |-- longitude: double (null

Re: Java to show struct field from a Dataframe

: Richard Xin <richardxin...@yahoo.com> Sent: Saturday, December 17, 2016 8:53 PM To: Yong Zhang; zjp_j...@163.com; user Subject: Re: Java to show struct field from a Dataframe I tried to transform root |-- latitude: double (nullable = false) |-- longitude: double (nullable = false) |-- name:

Re: Java to show struct field from a Dataframe

le, as your schema defined. The error message clearly indicates the data doesn't match with  the type specified in the schema. I wonder how you are so sure about your data? Do you check it under other tool? Yong From: Richard Xin <richardxin...@yahoo.com.INVALID> Sent: Saturday, Dece

Re: Java to show struct field from a Dataframe

about your data? Do you check it under other tool? Yong From: Richard Xin <richardxin...@yahoo.com.INVALID> Sent: Saturday, December 17, 2016 10:56 AM To: zjp_j...@163.com; user Subject: Re: Java to show struct field from a Dataframe data is good On Satur

Re: Java to show struct field from a Dataframe

data is good On Saturday, December 17, 2016 11:50 PM, "zjp_j...@163.com" wrote: #yiv7434848277 body {line-height:1.5;}#yiv7434848277 blockquote {margin-top:0px;margin-bottom:0px;margin-left:0.5em;}#yiv7434848277 div.yiv7434848277foxdiv20161217234614718397

Re: Java to show struct field from a Dataframe

I think the causation is your invanlid Double data , have u checked your data ? zjp_j...@163.com From: Richard Xin Date: 2016-12-17 23:28 To: User Subject: Java to show struct field from a Dataframe let's say I have a DataFrame with schema of followings: root |-- name: string (nullable

Java to show struct field from a Dataframe

let's say I have a DataFrame with schema of followings:root  |-- name: string (nullable = true)  |-- location: struct (nullable = true)  |    |-- longitude: double (nullable = true)  |    |-- latitude: double (nullable = true) df.show(); throws following exception: java.lang.ClassCastException: