Re: double quota is automaticly added when sinking as csv

2019-05-21 Thread Akshay Bhardwaj
Hi, Add writeStream.option("quoteMode", "NONE") By default Spark dataset api assumes that all the values MUST BE enclosed in quote character (def: ") while writing to CSV files. Akshay Bhardwaj +91-97111-33849 On Tue, May 21, 2019 at 5:34 PM 杨浩 wrote: > We use struct streaming 2.2, when

double quota is automaticly added when sinking as csv

2019-05-21 Thread 杨浩
We use struct streaming 2.2, when sinking as csv, a json str will automatic add "" for it, like an element is > > {"hello": "world"} result data in fs will be > "{\"hello\": \"world\"}" How to avoid the "",we only want > {"hello": "world"} code like > resultDS. > writeStream. >