[DISCUSSION]support new feature: Partition Table
Hi all, Let's start the discussion regarding the partition table. To support partition table, what we should do? 1. create table with partition to support Range Partitioning, Hash Partitioning, List Partitioning and Composite Partitioning, write the partition info to schema. 2. during data loading, re-partition the input data, start a task process a partition, write partition information to footer and index file. 3. during data query, prune B+Tree by partition if the filter contain the partition column. or prune data blocks by partition when there is only partition column predicate. 4. optimizer the join performance of two partition tables if partition column is the join column. Any thoughts, comments and questions ? Thanks! Best Regards David -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-support-new-feature-Partition-Table-tp9935.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.
[jira] [Created] (CARBONDATA-843) null pointer exception is thrown when floor operation is done on decimal column
Akash R Nilugal created CARBONDATA-843: -- Summary: null pointer exception is thrown when floor operation is done on decimal column Key: CARBONDATA-843 URL: https://issues.apache.org/jira/browse/CARBONDATA-843 Project: CarbonData Issue Type: Bug Components: core Reporter: Akash R Nilugal Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CARBONDATA-842) when SORT_COLUMN is empty, no need to sort data.
QiangCai created CARBONDATA-842: --- Summary: when SORT_COLUMN is empty, no need to sort data. Key: CARBONDATA-842 URL: https://issues.apache.org/jira/browse/CARBONDATA-842 Project: CarbonData Issue Type: Sub-task Reporter: QiangCai -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (CARBONDATA-841) improve the compress encoding for numeric type column to give good performance
QiangCai created CARBONDATA-841: --- Summary: improve the compress encoding for numeric type column to give good performance Key: CARBONDATA-841 URL: https://issues.apache.org/jira/browse/CARBONDATA-841 Project: CarbonData Issue Type: Sub-task Reporter: QiangCai Now no-dictionary column use LV(length-value) encoding. It isn't the best choice for numeric type column. -- This message was sent by Atlassian JIRA (v6.3.15#6346)