er@spark.apache.org <mailto:user@spark.apache.org>" <user@spark.apache.org
<mailto:user@spark.apache.org>>
Subject: Re: CSV escaping not working
well my expectation would be that if you have delimiters in your data you
need to quote your values. if you now have quote
n, Nishit" <nja...@underarmour.com>
> Cc: "user@spark.apache.org" <user@spark.apache.org>
> Subject: Re: CSV escaping not working
>
> well my expectation would be that if you have delimiters in your data you
> need to quote your values. if you now have quotes
lto:ko...@tresata.com>>
Date: Thursday, October 27, 2016 at 12:49 PM
To: "Jain, Nishit" <nja...@underarmour.com<mailto:nja...@underarmour.com>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
<user@spark.apache.org<mailto:user@spark.apa
t; Do you mind sharing why should escaping not work without quotes?
>
> From: Koert Kuipers <ko...@tresata.com>
> Date: Thursday, October 27, 2016 at 12:40 PM
> To: "Jain, Nishit" <nja...@underarmour.com>
> Cc: "user@spark.apache.org" <use
"user@spark.apache.org<mailto:user@spark.apache.org>"
<user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: Re: CSV escaping not working
that is what i would expect: escaping only works if quoted
On Thu, Oct 27, 2016 at 1:24 PM, Jain, Nishit
<nja...@underarmo
; Date: Thursday, October 27, 2016 at 10:54 AM
> To: "user@spark.apache.org" <user@spark.apache.org>
> Subject: CSV escaping not working
>
> I am using spark-core version 2.0.1 with Scala 2.11. I have simple code to
> read a csv file which has \ escapes.
>
> val
t;
<user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: CSV escaping not working
I am using spark-core version 2.0.1 with Scala 2.11. I have simple code to read
a csv file which has \ escapes.
val myDA = spark.read
.option("quote",null)
.schema(mySchema)
I am using spark-core version 2.0.1 with Scala 2.11. I have simple code to read
a csv file which has \ escapes.
val myDA = spark.read
.option("quote",null)
.schema(mySchema)
.csv(filePath)
As per documentation \ is default escape for csv reader. But it does not work.
Spark is
