Github user viirya commented on the issue: https://github.com/apache/spark/pull/22171 Scientific notation is more efficient on saving the values in CSV. If there are many zero values of high scale decimal type, this non scientific notation can cost storage space and loading time. I'm not sure if there is a standard for this. But I did a search roughly, looks like it is common to save decimal values as scientific notation in CSV.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org