[ 
https://issues.apache.org/jira/browse/SPARK-33566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239049#comment-17239049
 ] 

Hyukjin Kwon edited comment on SPARK-33566 at 11/26/20, 3:57 AM:
-----------------------------------------------------------------

Here is the output from running mvn clean test:

Running org.test.CommaTest
{code}
2020-11-25 17:55:45,728 INFO [CommaTest:12]
OpenCsv
2020-11-25 17:55:45,758 INFO [CommaTest:19] h1 h3 h2
2020-11-25 17:55:45,758 INFO [CommaTest:19] one three two
2020-11-25 17:55:45,760 INFO [CommaTest:19] abc xyz ^@<b><i><span 
style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is 
hard working.<A0> Super smart, though you wouldn&#39;t know it at first.<A0> 6 
months, and we sold this project.<A0> Phooey he said to me!<A0> What&#39;s up 
with you people.<A0> You&#39;ll say anything for a sale!<A0> Until he met me of 
course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span 
style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be 
applied this weekend. <A0></span></i></b><br><A0><br><b><i><span 
style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty 
added.</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0>
2020-11-25 17:55:45,763 INFO [CommaTest:26]

spark
2020-11-25 17:55:46,464 WARN [NativeCodeLoader:62] Unable to load native-hadoop 
library for your platform... using builtin-java classes where applicable
2020-11-25 17:55:55,299 INFO [CommaTest:36] Count: 2
2020-11-25 17:55:55,449 INFO [CommaTest:41] one three two
2020-11-25 17:55:55,449 INFO [CommaTest:41] abc sans-serif;"">Referral from Joe 
Smith.<A0> Fred is hard working.<A0> Super smart "^@<b><i><span 
style=""font-family: tahoma
2020-11-25 17:55:55,450 INFO [CommaTest:48] 

commons
2020-11-25 17:55:55,465 INFO [CommaTest:57] one three two
2020-11-25 17:55:55,467 INFO [CommaTest:57] abc xyz ^@<b><i><span 
style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is 
hard working.<A0> Super smart, though you wouldn&#39;t know it at first.<A0> 6 
months, and we sold this project.<A0> Phooey he said to me!<A0> What&#39;s up 
with you people.<A0> You&#39;ll say anything for a sale!<A0> Until he met me of 
course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span 
style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be 
applied this weekend. <A0></span></i></b><br><A0><br><b><i><span 
style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty 
added.</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0>


was (Author: moresmores):
{{Here is the output from running mvn clean test}}

 

{{Running org.test.CommaTest}}
{{2020-11-25 17:55:45,728 INFO [CommaTest:12] }}
{{OpenCsv}}
{{2020-11-25 17:55:45,758 INFO [CommaTest:19] h1 h3 h2}}
{{2020-11-25 17:55:45,758 INFO [CommaTest:19] one three two}}
{{2020-11-25 17:55:45,760 INFO [CommaTest:19] abc xyz ^@<b><i><span 
style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is 
hard working.<A0> Super smart, though you wouldn&#39;t know it at first.<A0> 6 
months, and we sold this project.<A0> Phooey he said to me!<A0> What&#39;s up 
with you people.<A0> You&#39;ll say anything for a sale!<A0> Until he met me of 
course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span 
style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be 
applied this weekend. <A0></span></i></b><br><A0><br><b><i><span 
style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty 
added.</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0>}}
{{2020-11-25 17:55:45,763 INFO [CommaTest:26] }}
{{spark}}
{{2020-11-25 17:55:46,464 WARN [NativeCodeLoader:62] Unable to load 
native-hadoop library for your platform... using builtin-java classes where 
applicable}}
{{2020-11-25 17:55:55,299 INFO [CommaTest:36] Count: 2}}
{{2020-11-25 17:55:55,449 INFO [CommaTest:41] one three two}}
{{2020-11-25 17:55:55,449 INFO [CommaTest:41] abc sans-serif;"">Referral from 
Joe Smith.<A0> Fred is hard working.<A0> Super smart "^@<b><i><span 
style=""font-family: tahoma}}
{{2020-11-25 17:55:55,450 INFO [CommaTest:48] }}
{{commons}}
{{2020-11-25 17:55:55,465 INFO [CommaTest:57] one three two}}
{{2020-11-25 17:55:55,467 INFO [CommaTest:57] abc xyz ^@<b><i><span 
style="font-family: tahoma,sans-serif;">Referral from Joe Smith.<A0> Fred is 
hard working.<A0> Super smart, though you wouldn&#39;t know it at first.<A0> 6 
months, and we sold this project.<A0> Phooey he said to me!<A0> What&#39;s up 
with you people.<A0> You&#39;ll say anything for a sale!<A0> Until he met me of 
course....haar haar!</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Internet is spotty</span></i></b><br><b><i><span 
style="font-family: tahoma,sans-serif;">Working while at home so.<A0> Will be 
applied this weekend. <A0></span></i></b><br><A0><br><b><i><span 
style="font-family: tahoma,sans-serif;">On Bill Recovery and 20 yr warranty 
added.</span></i></b><br><A0><br><b><i><span style="font-family: 
tahoma,sans-serif;">Kindness made this deal happen!</span></i></b><br><A0>}}

> Incorrectly Parsing CSV file
> ----------------------------
>
>                 Key: SPARK-33566
>                 URL: https://issues.apache.org/jira/browse/SPARK-33566
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.4.7
>            Reporter: Stephen More
>            Priority: Minor
>
> Here is a test case: 
> [https://github.com/mores/maven-examples/blob/master/comma/src/test/java/org/test/CommaTest.java]
> It shows how I believe apache commons csv and opencsv correctly parses the 
> sample csv file.
> spark is not correctly parsing the sample csv file.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to