Cheng Lian created SPARK-1694:
---------------------------------
Summary: Simplify ColumnBuilder/Accessor class hierarchy
Key: SPARK-1694
URL: https://issues.apache.org/jira/browse/SPARK-1694
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 1.0.0
Reporter: Cheng Lian
Assignee: Cheng Lian
Fix For: 1.1.0
Current {{ColumnBuilder/Accessor}} class hierarchy design was largely
refactored from the in-memory columnar storage component of Shark. Code related
to null values and compression were factored into
{{NullableColumnBuilder/Accessor}} and {{CompressibleColumnBuilder/Accessor}}
and then mixed in as stackable traits. The drawback is:
# Interactions among these classes were unnecessarily complicated and error
prone.
# Flexibility provided by this design now seems useless
To simplify this, we can merge {{CompressibleColumnBuilder/Accessor}} and
{{NullableColumnBuilder/Accessor}} into {{NativeColumnBuilder/Accessor}},
simply hard code null value processing and compression logic together.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
