[ https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239049#comment-17239049 ]
Hyukjin Kwon edited comment on SPARK-33566 at 11/26/20, 3:57 AM: ----------------------------------------------------------------- Here is the output from running mvn clean test: Running org.test.CommaTest {code} 2020-11-25 17:55:45,728 INFO [CommaTest:12] OpenCsv 2020-11-25 17:55:45,758 INFO [CommaTest:19] h1 h3 h2 2020-11-25 17:55:45,758 INFO [CommaTest:19] one three two 2020-11-25 17:55:45,760 INFO [CommaTest:19] abc xyz ^@<b><i><span style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is hard working.<A0> Super smart, though you wouldn't know it at first.<A0> 6 months, and we sold this project.<A0> Phooey he said to me!<A0> What's up with you people.<A0> You'll say anything for a sale!<A0> Until he met me of course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be applied this weekend. <A0></span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty added.</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0> 2020-11-25 17:55:45,763 INFO [CommaTest:26] spark 2020-11-25 17:55:46,464 WARN [NativeCodeLoader:62] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2020-11-25 17:55:55,299 INFO [CommaTest:36] Count: 2 2020-11-25 17:55:55,449 INFO [CommaTest:41] one three two 2020-11-25 17:55:55,449 INFO [CommaTest:41] abc sans-serif;"">Referral from Joe Smith.<A0> Fred is hard working.<A0> Super smart "^@<b><i><span style=""font-family: tahoma 2020-11-25 17:55:55,450 INFO [CommaTest:48] commons 2020-11-25 17:55:55,465 INFO [CommaTest:57] one three two 2020-11-25 17:55:55,467 INFO [CommaTest:57] abc xyz ^@<b><i><span style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is hard working.<A0> Super smart, though you wouldn't know it at first.<A0> 6 months, and we sold this project.<A0> Phooey he said to me!<A0> What's up with you people.<A0> You'll say anything for a sale!<A0> Until he met me of course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be applied this weekend. <A0></span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty added.</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0> was (Author: moresmores): {{Here is the output from running mvn clean test}} {{Running org.test.CommaTest}} {{2020-11-25 17:55:45,728 INFO [CommaTest:12] }} {{OpenCsv}} {{2020-11-25 17:55:45,758 INFO [CommaTest:19] h1 h3 h2}} {{2020-11-25 17:55:45,758 INFO [CommaTest:19] one three two}} {{2020-11-25 17:55:45,760 INFO [CommaTest:19] abc xyz ^@<b><i><span style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is hard working.<A0> Super smart, though you wouldn't know it at first.<A0> 6 months, and we sold this project.<A0> Phooey he said to me!<A0> What's up with you people.<A0> You'll say anything for a sale!<A0> Until he met me of course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be applied this weekend. <A0></span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty added.</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0>}} {{2020-11-25 17:55:45,763 INFO [CommaTest:26] }} {{spark}} {{2020-11-25 17:55:46,464 WARN [NativeCodeLoader:62] Unable to load native-hadoop library for your platform... using builtin-java classes where applicable}} {{2020-11-25 17:55:55,299 INFO [CommaTest:36] Count: 2}} {{2020-11-25 17:55:55,449 INFO [CommaTest:41] one three two}} {{2020-11-25 17:55:55,449 INFO [CommaTest:41] abc sans-serif;"">Referral from Joe Smith.<A0> Fred is hard working.<A0> Super smart "^@<b><i><span style=""font-family: tahoma}} {{2020-11-25 17:55:55,450 INFO [CommaTest:48] }} {{commons}} {{2020-11-25 17:55:55,465 INFO [CommaTest:57] one three two}} {{2020-11-25 17:55:55,467 INFO [CommaTest:57] abc xyz ^@<b><i><span style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is hard working.<A0> Super smart, though you wouldn't know it at first.<A0> 6 months, and we sold this project.<A0> Phooey he said to me!<A0> What's up with you people.<A0> You'll say anything for a sale!<A0> Until he met me of course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be applied this weekend. <A0></span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty added.</span></i></b><br><A0><br><b><i><span style="font-family: tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0>}} > Incorrectly Parsing CSV file > ---------------------------- > > Key: SPARK-33566 > URL: https://issues.apache.org/jira/browse/SPARK-33566 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.4.7 > Reporter: Stephen More > Priority: Minor > > Here is a test case: > [https://github.com/mores/maven-examples/blob/master/comma/src/test/java/org/test/CommaTest.java] > It shows how I believe apache commons csv and opencsv correctly parses the > sample csv file. > spark is not correctly parsing the sample csv file. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org