Re:Re: Possible issue for Spark SQL/DataFrame

2015-08-12 Thread Netwaver
It is a space separated data, just as below And What is your thought about the second issue? Thank you. At 2015-08-10 15:20:39, Akhil Das ak...@sigmoidanalytics.com wrote: Isnt it a space separated data? It is not a comma(,) separated nor pipe (|) separated data. Thanks Best Regards

Re: Possible issue for Spark SQL/DataFrame

2015-08-12 Thread Eugene Morozov
Cannot tell anything specific about separator as it’s not clear how you create schema from schemaString. Regarding the second issue - that’s expected, because there is a Map there and you cannot provide more, than one value for the key. That’s why you see only the last “min” value. This is a

Re: Possible issue for Spark SQL/DataFrame

2015-08-10 Thread Akhil Das
Isnt it a space separated data? It is not a comma(,) separated nor pipe (|) separated data. Thanks Best Regards On Mon, Aug 10, 2015 at 12:06 PM, Netwaver wanglong_...@163.com wrote: Hi Spark experts, I am now using Spark 1.4.1 and trying Spark SQL/DataFrame API with text

Possible issue for Spark SQL/DataFrame

2015-08-10 Thread Netwaver
Hi Spark experts, I am now using Spark 1.4.1 and trying Spark SQL/DataFrame API with text file in below format id gender height 1 M 180 2 F 167 ... ... But I meet