Re: Apache CarbonData online meetup on 13th Mar,2017

2017-03-07 Thread Sandeep Purohit
Hi , I also want to join this meetup but when i register for the meetup and proceed to pay it will not show the indian banks for payment options. On Tue, Mar 7, 2017 at 8:42 AM, ZhuWilliam wrote: > Carbondata's reversed index,BTree implementation and how carbondata do the > spark integration >

I loaded the data with the timestamp field unsuccessful

2017-03-07 Thread kex
I loaded the data with the timestamp field unsuccessful,and timestamp field is null. my sql: carbon.sql("create TABLE IF NOT EXISTS test1 (date timestamp,id string) STORED BY 'carbondata' TBLPROPERTIES ('DICTIONARY_INCLUDE'='date','DATEFORMAT'='date:/MM/dd')") carbon.sql("LOAD DATA inpath 'hd

question about dimColumnExecuterInfo.getFilterKeys()

2017-03-07 Thread 马云
Hi Dev, when do filter query, I can see a filtered byte array. Does filterValues always has order by the dictionary value? If not, which case it has no order. thanks byte[][] filterValues = dimColumnExecuterInfo.getFilterKeys();

Re: Improving Non-dictionary storage & performance.

2017-03-07 Thread QiangCai
+1 I agree. About non-dictionary column of sort_columns: 1. sort column data in ColumnChunk2 2. compress column by datatype string: RLE or snappy (if RLE is not good) short, int, bigint: Delta and number compressor (ValueCompressor and NumberCompressor) float, double: Delta and snappy (ValueCom

subscribing

2017-03-07 Thread Yong Zhang
subscribing

Re: Improving Non-dictionary storage & performance.

2017-03-07 Thread bill.zhou
hi Ravindra The column which type is double or float always is measure, the cardinality is high, so if default dictionary it will cause performance problem I think. 1. Make always SHORT, INT, BIGINT, DOUBLE & FLOAT always direct dictionary. Right now only date and timestamp are direct

Re: Improving Non-dictionary storage & performance.

2017-03-07 Thread bill.zhou
hi Jacky I think this is not easy for user to control if cabron is online running. May be for one table two different load can be different cardinality for the same column but user cannot give different dictionary columns for one table. Regards Jacky Li wrote > Hi Ravindra, > > Another sug

[jira] [Created] (CARBONDATA-751) Adding Header and making footer optional

2017-03-07 Thread kumar vishal (JIRA)
kumar vishal created CARBONDATA-751: --- Summary: Adding Header and making footer optional Key: CARBONDATA-751 URL: https://issues.apache.org/jira/browse/CARBONDATA-751 Project: CarbonData Iss

Re: [DISCUSS] Apache CarbonData podling graduation

2017-03-07 Thread Niclas Hedhman
I think the wording needs tuning, and my own interpretation of the intent has been, Project claims itself to comply, and list any exceptions and why that is the case. I think that can deal with the invariance that exists. Cheers Niclas On Mar 7, 2017 14:48, "Jim Apple" wrote: > > Actually, t

Re: [DISCUSS] Apache CarbonData podling graduation

2017-03-07 Thread Jim Apple
> Actually, the Maturity Model can be a very nice framework to organize > incubation around. If you're talking about a platonic MM, then I agree. If you are talking about the MM at https://community.apache.org/apache-way/apache-project-maturity-model.html, I think it needs to be much more carefull

Re:Re: "between and" filter query is very slow

2017-03-07 Thread 马云
Hi Dev, I have created the jira named CARBONDATA-748 a few days ago. Today I have fixed it for version 0.2. And created a new pull request. Please help to confirm. thanks At 2017-03-03 20:47:51, "Kumar Vishal" wrote: >Hi, > >Currently In include and exclude filter case when dimensio