Reynold Xin created SPARK-9404: ---------------------------------- Summary: UnsafeArrayData Key: SPARK-9404 URL: https://issues.apache.org/jira/browse/SPARK-9404 Project: Spark Issue Type: Sub-task Components: SQL Reporter: Reynold Xin Assignee: Wenchen Fan
An Unsafe-based ArrayData implementation. To begin with, we can encode data this way: first 4 bytes is the # elements then each 4 byte is the start offset of the element, unless it is negative, in which case the element is null. followed by the elements themselves For example, [10, 11, 12, 13, null, 14], internally should be represented as (each 4 bytes) 5, 28, 32, 36, 40, -44, 48, 10, 11, 12, 13, 0, 14 -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org