[DISCUSSION]support new feature: Partition Table

2017-03-31 Thread QiangCai
Hi all, 

  Let's start the discussion regarding the partition table.

  To support partition table, what we should do?

  1. create table with partition to support Range Partitioning, Hash
Partitioning, List Partitioning and Composite Partitioning, write the
partition info to schema. 

  2. during data loading, re-partition the input data, start a task process
a partition, write partition information to footer and index file.

  3. during data query, prune B+Tree by partition if the filter contain the
partition column. or prune data blocks by partition when there is only
partition column predicate.

  4. optimizer the join performance of two partition tables if partition
column is the join column.

   Any thoughts, comments and questions ?

   Thanks!

Best Regards
David



--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-support-new-feature-Partition-Table-tp9935.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.


[jira] [Created] (CARBONDATA-843) null pointer exception is thrown when floor operation is done on decimal column

2017-03-31 Thread Akash R Nilugal (JIRA)
Akash R Nilugal created CARBONDATA-843:
--

 Summary: null pointer exception is thrown when floor operation is 
done on decimal column
 Key: CARBONDATA-843
 URL: https://issues.apache.org/jira/browse/CARBONDATA-843
 Project: CarbonData
  Issue Type: Bug
  Components: core
Reporter: Akash R Nilugal
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CARBONDATA-842) when SORT_COLUMN is empty, no need to sort data.

2017-03-31 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-842:
---

 Summary: when SORT_COLUMN is empty, no need to sort data.
 Key: CARBONDATA-842
 URL: https://issues.apache.org/jira/browse/CARBONDATA-842
 Project: CarbonData
  Issue Type: Sub-task
Reporter: QiangCai






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (CARBONDATA-841) improve the compress encoding for numeric type column to give good performance

2017-03-31 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-841:
---

 Summary: improve the compress encoding for numeric type column to 
give good performance
 Key: CARBONDATA-841
 URL: https://issues.apache.org/jira/browse/CARBONDATA-841
 Project: CarbonData
  Issue Type: Sub-task
Reporter: QiangCai


Now no-dictionary column use LV(length-value) encoding. It isn't the best 
choice for numeric type column.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)