caoxuewen created SPARK-26001:
---------------------------------
Summary: Reduce memory copy when writing decimal
Key: SPARK-26001
URL: https://issues.apache.org/jira/browse/SPARK-26001
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.5.0
Reporter: caoxuewen
this PR fix 2 here:
- when writing non-null decimals, we not zero-out all the 16 allocated bytes.
if the number of bytes needed for a decimal is greater than 8. then we not need
zero-out between 0-byte and 8-byte. The first 8-byte will be covered when
writing decimal.
- when writing null decimals, we not zero-out all the 16 allocated bytes.
BitSetMethods.set the label for null and the length of decimal to 0. when we
get the decimal, will not access the 16 byte memory value, so this is safe.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
