[ https://issues.apache.org/jira/browse/SPARK-26804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16763728#comment-16763728 ]
Bruce Robbins commented on SPARK-26804: --------------------------------------- v2.4.0: Fails as described Tip of branch-2.4: Fails as described master (3.0.0): Works fine. Whatever the issue is (schema inference bug?), it's now fixed on the master branch. > Spark sql carries newline char from last csv column when imported > ----------------------------------------------------------------- > > Key: SPARK-26804 > URL: https://issues.apache.org/jira/browse/SPARK-26804 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.4.0 > Reporter: Raj > Priority: Major > Attachments: TestFile.csv, image-2019-02-04-12-09-19-210.png, > image-2019-02-04-12-28-21-117.png > > > I am trying to generate external sql tables in DataBricks using Spark sql > query. Below is my query. The query reads csv file and creates external table > but it carries the newline char while creating the last column. Is there a > way to resolve this issue? > > %sql > create table if not exists <<My table name>> > using CSV > options ("header"="true", "inferschema"="true","multiLine"="true", > "escape"='"') > location <my csv path> -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org