Re: CSV parser - is there a way to find malformed csv record

2018-10-09 Thread Nirav Patel
onday, October 8, 2018 11:57 AM > *To:* spark users > *Subject:* CSV parser - is there a way to find malformed csv record > > > > I am getting `RuntimeException: Malformed CSV record` while parsing csv > record and attaching schema at same time. Most likely there are addit

RE: CSV parser - is there a way to find malformed csv record

2018-10-09 Thread Taylor Cox
) can be found. From: Nirav Patel Sent: Monday, October 8, 2018 11:57 AM To: spark users Subject: CSV parser - is there a way to find malformed csv record I am getting `RuntimeException: Malformed CSV record` while parsing csv record and attaching schema at same time. Most likely

Re: CSV parser - is there a way to find malformed csv record

2018-10-09 Thread Shuporno Choudhury
ww.facebook.com/XactlyCorp> > <http://www.youtube.com/xactlycorporation> > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/CSV-par

CSV parser - is there a way to find malformed csv record

2018-10-08 Thread Nirav Patel
I am getting `RuntimeException: Malformed CSV record` while parsing csv record and attaching schema at same time. Most likely there are additional commas or json data in some field which are not escaped properly. Is there a way CSV parser tells me which record is malformed? This is what I am