Re: [I] CSV `quote` parameter is ignored [datafusion]

2024-05-26 Thread via GitHub


alamb closed issue #10670: CSV `quote` parameter is ignored
URL: https://github.com/apache/datafusion/issues/10670


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org



[I] CSV `quote` parameter is ignored [datafusion]

2024-05-25 Thread via GitHub


DDtKey opened a new issue, #10670:
URL: https://github.com/apache/datafusion/issues/10670

   ### Describe the bug
   
   quote` parameter of CSV writer is not getting passed to `arrow-csv` writer:
   
https://github.com/apache/datafusion/blob/ea92ae72f7ec2e941d35aa077c6a39f74523ab63/datafusion/common/src/file_options/csv_writer.rs#L48-L75
   
   
   
   ### To Reproduce
   
   ```sql
   COPY (select '12,3', 'abc,d' ) TO 'test.csv' STORED AS csv OPTIONS ('quote' 
'|')
   ```
   results in
   ```csv
   "Utf8(""12,3"")","Utf8(""abc,d"")"
   "12,3","abc,d"
   ```
   
   Result is the same if we use `write_csv` with passed option
   
   ### Expected behavior
   
   Writer should use appropriate quote char.
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org