Re: Grammar about supporting string longer than 32000 characters

2018-05-02 Thread ravipesala
Hi,

I agree with option 2 but not new datatype use varchar(size).
There are more optimizations we can do with varchar(size) datatype like
1. if the size is smaller (less than 8 bytes)  then we can write in fixed
length encoder instead of  LV encode it can save a lot of space and memory.
2. If the size is less than 32000 then use current our string datatype.
3. If size is more than 32000 then encode using int as a length in LV
format. 

In spark dataframe support we can by default use string as datatype.

Even if we take option 1 also carbon should internally has new datatype
otherwise code will not be good as you need to check this property many
places so ideally new datatype can lead to a new set of implementations and
easier to code and maintain.



--
Sent from: 
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/


Re: [ANNOUNCE] Zhichao Zhang as new Apache CarbonData committer

2018-05-02 Thread Kumar Vishal
Congrats Zhichao

-Regards
Kumar Vishal

Sent from my iPhone

> On 02-May-2018, at 12:10, Bhavya Aggarwal  wrote:
> 
> Congrats Zhichao


Re: [ANNOUNCE] Zhichao Zhang as new Apache CarbonData committer

2018-05-02 Thread Bhavya Aggarwal
Congrats Zhichao!


Regards
Bhavya

On Wed, May 2, 2018 at 8:37 AM, Lionel CL  wrote:

> Congrats Zhichao!
>
> Best Regards,
> CaoLu
>
> 发件人: Liang Chen >
> 答复: "u...@carbondata.apache.org" <
> u...@carbondata.apache.org>
> 日期: 2018年5月2日 星期三 上午10:59
> 至: "dev@carbondata.apache.org" <
> dev@carbondata.apache.org>, "
> u...@carbondata.apache.org" <
> u...@carbondata.apache.org>
> 主题: [ANNOUNCE] Zhichao Zhang as new Apache CarbonData committer
>
> Hi all
>
> We are pleased to announce that the PMC has invited Zhichao Zhang as new
> Apache CarbonData committer, and the invite has been accepted!
>
> Congrats to Zhichao Zhang and welcome aboard.
>
> Regards
> Apache CarbonData PMC
>
>