Dear Taotao,
Yes, I tried sparkCSV.
Thanks,
Nawwar
On Mon, Mar 23, 2015 at 12:20 PM, Taotao.Li <taotao...@datayes.com> wrote:
> can it load successfully if the format is invalid?
>
> ------------------------------
> *发件人: *"Ahmed Nawar" <ahmed.na...@gmail.com>
> *收件人: *user@spark.apache.org
> *发送时间: *星期一, 2015年 3 月 23日 下午 4:48:54
> *主题: *Data/File structure Validation
>
> Dears,
>
> Is there any way to validate the CSV, Json ... Files while loading to
> DataFrame.
> I need to ignore corrupted rows.(Rows with not matching with the
> schema).
>
>
> Thanks,
> Ahmed Nawwar
>
>
>
> --
>
>
> *---------------------------------------------------------------------------*
>
> *Thanks & Best regards*
>
> 李涛涛 Taotao · Li | Fixed Income@Datayes | Software Engineer
>
> 地址：上海市浦东新区陆家嘴西路99号万向大厦8楼， 200120
> Address :Wanxiang Towen 8F, Lujiazui West Rd. No.99, Pudong New District,
> Shanghai, 200120
>
> 电话|Phone：021-60216502 手机|Mobile: +86-18202171279
>
>
