Kazuaki Ishizaki created SPARK-15117: ----------------------------------------
Summary: Generate code that get a value in each compressed column from CachedBatch when DataFrame.cache() is called Key: SPARK-15117 URL: https://issues.apache.org/jira/browse/SPARK-15117 Project: Spark Issue Type: Improvement Components: SQL Reporter: Kazuaki Ishizaki Once SPARK-14098 is merged, we will migrate a feature in this JIRA entry. When DataFrame.cache() is called, data is stored as column-oriented storage in CachedBatch. The current Catalyst generates Java program to get a value of a column from an InternalRow that is translated from CachedBatch. This issue generates Java code to get a value of a column from CachedBatch. This JIRA entry supports other primitive types (boolean/byte/short/int/long) whose column may be compressed. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org