thanks Suresh. it worked nicely
From: Suresh Thalamati <suresh.thalam...@gmail.com>
Sent: Tuesday, September 12, 2017 2:59:29 PM
To: jeff saremi
Cc: user@spark.apache.org
Subject: Re: Continue reading dataframe from file despite errors
Try the CSV Option
hotmail.com>
> Sent: Tuesday, September 12, 2017 2:32:03 PM
> To: user@spark.apache.org
> Subject: Continue reading dataframe from file despite errors
>
> I'm using a statement like the following to load my dataframe from some text
> file
> Upon encountering the first error, t
.scala:250)
From: jeff saremi <jeffsar...@hotmail.com>
Sent: Tuesday, September 12, 2017 2:32:03 PM
To: user@spark.apache.org
Subject: Continue reading dataframe from file despite errors
I'm using a statement like the following to load my dataframe from some text
file
Upon encoun
I'm using a statement like the following to load my dataframe from some text
file
Upon encountering the first error, the whole thing throws an exception and
processing stops.
I'd like to continue loading even if that results in zero rows in my dataframe.
How can i do that?
thanks
