If you are using Spark 2.4.0, I think you can try something like this:
.option("quote", "\u0000")
.option("emptyValue", “”)
.option("nullValue", null)
Regards
Swetha
> On Jul 11, 2019, at 1:45 PM, Anil Kulkarni <[email protected]> wrote:
>
> Hi Spark users,
>
> My question is :
> I am writing a Dataframe to csv.
> Option i am using as
> .option("quoteAll","true").
>
> This is quoting even null values and making them appear as an empty string.
>
> How do i make sure that quotes are enabled only for non null values?
>
> --
> Cheers,
> Anil Kulkarni
> about.me/anilkulkarni
>
> http://anilkulkarni.com/
> <http://about.me/anilkulkarni>
