[
https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233267#comment-17233267
]
Takeshi Yamamuro commented on SPARK-33395:
------------------------------------------
hm, but we cannot avoid the rounding in this case, I think. Any idea? Either
way, I think this is an expected behaviour, so I will change "Bug" ->
"Improvement" now.
> Spark reading data in scientific notation
> -----------------------------------------
>
> Key: SPARK-33395
> URL: https://issues.apache.org/jira/browse/SPARK-33395
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.3.4, 2.4.8, 3.1.0
> Reporter: Nilesh Patil
> Priority: Critical
>
> File is having below data
> DAta
> 1200404151072.121111111111
> 1200404151073
> 1200404151074.1232323
> 1200404151075.124344
> 1200404151076.12
> 1200404151077.123433333
> 1200404151078.12
> 1200404151079.12544545454554
> 1251080.1234444444444444444444
> 10000000000000000000000000000
>
> Spark is reading with scientific notation as we wanted to read data as it is
> available in file with accurate datatype not with string datatype.
> +--------------------+
> | DAta|
> +--------------------+
> |1.200404151072121E12|
> | 1.200404151073E12|
> |1.200404151074123...|
> |1.200404151075124...|
> | 1.20040415107612E12|
> |1.200404151077123...|
> | 1.20040415107812E12|
> |1.200404151079125...|
> | 1251080.1234444445|
> | 1.0E28|
> +--------------------
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
