Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

[Henry Saputra]

Sure, lets do one more release

+1

On Mon, Mar 27, 2017 at 2:58 AM, manish gupta 
wrote:

> +1
>
> Regards
> Manish Gupta
>
> On Mon, Mar 27, 2017 at 2:41 PM, Kumar Vishal 
> wrote:
>
> > +1
> > -Regards
> > Kumar Vishal
> >
> > On Mar 27, 2017 09:31, "xm_zzc" <441586...@qq.com> wrote:
> >
> > > Hi, Liang:
> > >   Thanks for your reply.
> > >
> > >
> > >
> > > --
> > > View this message in context: http://apache-carbondata-
> > > mailing-list-archive.1130556.n5.nabble.com/Re-DISCUSSION-
> > > Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9672p9680.html
> > > Sent from the Apache CarbonData Mailing List archive mailing list
> archive
> > > at Nabble.com.
> > >
> >
>

Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

[manish gupta]

+1

Regards
Manish Gupta

On Mon, Mar 27, 2017 at 2:41 PM, Kumar Vishal 
wrote:

> +1
> -Regards
> Kumar Vishal
>
> On Mar 27, 2017 09:31, "xm_zzc" <441586...@qq.com> wrote:
>
> > Hi, Liang:
> >   Thanks for your reply.
> >
> >
> >
> > --
> > View this message in context: http://apache-carbondata-
> > mailing-list-archive.1130556.n5.nabble.com/Re-DISCUSSION-
> > Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9672p9680.html
> > Sent from the Apache CarbonData Mailing List archive mailing list archive
> > at Nabble.com.
> >
>

Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

[Kumar Vishal]

+1
-Regards
Kumar Vishal

On Mar 27, 2017 09:31, "xm_zzc" <441586...@qq.com> wrote:

> Hi, Liang:
>   Thanks for your reply.
>
>
>
> --
> View this message in context: http://apache-carbondata-
> mailing-list-archive.1130556.n5.nabble.com/Re-DISCUSSION-
> Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9672p9680.html
> Sent from the Apache CarbonData Mailing List archive mailing list archive
> at Nabble.com.
>

Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

[xm_zzc]

Hi, Liang:
  Thanks for your reply.



--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Re-DISCUSSION-Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9672p9680.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.

Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

[Liang Chen]

Hi

Yes, update and delete feature with spark-2.x, will be supported after
1.1.0. 
As planed , 1.2 would support it or earlier.

Regards
Liang


xm_zzc wrote
> Hi, does this version support for the updating and deleting with
> spark-2.1? Seems like it does not support, what time is it planned to
> support it?
> 
> 
> 
> 
> -- Original --
> From:  "ravipesala [via Apache CarbonData Mailing List archive]";

> ml-node+s1130556n9623h49@.nabble

> ;
> Date:  Sun, Mar 26, 2017 01:16 PM
> To:  "恩爸"<

> 441586683@

>>; 
> 
> Subject:  [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating
> Release
> 
> 
> 
>   Hi All, 
> 
> As planned we are going to release Apache CarbonData-1.1.0. Please discuss 
> and vote for it to initiate 1.1.0 release, i will start to prepare the 
> release after 3-days of discussion. It will have following features. 
> 
>  1. Introduced new data format called V3(version 3). 
> 
>   Improves the sequential IO by keeping larger size blocklets.So read 
> larger data at once to memory. 
>   Introduced pages with size of 32000 each for every column inside 
> blocklet. And min/max is maintained for each page to improve the filter 
> queries. 
>   Improved compression/decompression of row pages. 
> Our all performance is improved by 50% compare to old format as per TPC-H 
> benchmark results. 
> 
> 
> 2. Alter table support in carbondata. (Only for Spark 2.1) 
> 
>Support renaming of existing table. 
>Support adding of new column. 
>Support removing of new column. 
>Support Upcasting(Ex: from smallint to int) of datatype 
> 
> 
> 3. Supported Batch Sort to improve dataloading performance. 
> 
>It makes sort step as non blocking step and capable of sorting whole 
> batch in memory and converts to carbondata file. 
> 
> 
> 4. Improved Single pass load by upgrading to latest netty framework and 
> launched dictionary client for each loading 
> 
> 5. Supported range filters to combine the between filters to one filter to 
> improve the filter performance. 
> 
> 6. Apart from features many bugs and improvements are done in this
> release. 
> 
> --  
> Thanks & Regards, 
> Ravindra 
>   
>   
>   
>   If you reply to this email, your message will be added 
> to the
> discussion below:
>   
> http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9623.html
>   
>   To start a new topic under Apache CarbonData Mailing 
> List archive,
> email 

> ml-node+s1130556n1h67@.nabble

>  
>   To unsubscribe from Apache CarbonData Mailing List archive, 
> click here.
>   NAML





--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Re-DISCUSSION-Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9672p9678.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.

Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

[xm_zzc]

Hi, does this version support for the updating and deleting with spark-2.1? 
Seems like it does not support, what time is it planned to support it?




-- Original --
From:  "ravipesala [via Apache CarbonData Mailing List 
archive]";;
Date:  Sun, Mar 26, 2017 01:16 PM
To:  "恩爸"<441586...@qq.com>; 

Subject:  [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release



Hi All, 

As planned we are going to release Apache CarbonData-1.1.0. Please discuss 
and vote for it to initiate 1.1.0 release, i will start to prepare the 
release after 3-days of discussion. It will have following features. 

 1. Introduced new data format called V3(version 3). 

  Improves the sequential IO by keeping larger size blocklets.So read 
larger data at once to memory. 
  Introduced pages with size of 32000 each for every column inside 
blocklet. And min/max is maintained for each page to improve the filter 
queries. 
  Improved compression/decompression of row pages. 
Our all performance is improved by 50% compare to old format as per TPC-H 
benchmark results. 


2. Alter table support in carbondata. (Only for Spark 2.1) 

   Support renaming of existing table. 
   Support adding of new column. 
   Support removing of new column. 
   Support Upcasting(Ex: from smallint to int) of datatype 


3. Supported Batch Sort to improve dataloading performance. 

   It makes sort step as non blocking step and capable of sorting whole 
batch in memory and converts to carbondata file. 


4. Improved Single pass load by upgrading to latest netty framework and 
launched dictionary client for each loading 

5. Supported range filters to combine the between filters to one filter to 
improve the filter performance. 

6. Apart from features many bugs and improvements are done in this release. 

--  
Thanks & Regards, 
Ravindra 



If you reply to this email, your message will be added 
to the discussion below:

http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9623.html

To start a new topic under Apache CarbonData Mailing 
List archive, email ml-node+s1130556n1...@n5.nabble.com 
To unsubscribe from Apache CarbonData Mailing List archive, 
click here.
NAML



--
View this message in context: 
http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Re-DISCUSSION-Initiating-Apache-CarbonData-1-1-0-incubating-Release-tp9672.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at 
Nabble.com.

Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

[Liang Chen]

Hi

+1 for starting to prepare new release 1.1
Great progress, new file format V3 would significantly improve performance.

Regards
Liang

2017-03-26 10:46 GMT+05:30 Ravindra Pesala :

> Hi All,
>
> As planned we are going to release Apache CarbonData-1.1.0. Please discuss
> and vote for it to initiate 1.1.0 release, i will start to prepare the
> release after 3-days of discussion. It will have following features.
>
>  1. Introduced new data format called V3(version 3).
>
>   Improves the sequential IO by keeping larger size blocklets.So read
> larger data at once to memory.
>   Introduced pages with size of 32000 each for every column inside
> blocklet. And min/max is maintained for each page to improve the filter
> queries.
>   Improved compression/decompression of row pages.
> Our all performance is improved by 50% compare to old format as per TPC-H
> benchmark results.
>
>
> 2. Alter table support in carbondata. (Only for Spark 2.1)
>
>Support renaming of existing table.
>Support adding of new column.
>Support removing of new column.
>Support Upcasting(Ex: from smallint to int) of datatype
>
>
> 3. Supported Batch Sort to improve dataloading performance.
>
>It makes sort step as non blocking step and capable of sorting whole
> batch in memory and converts to carbondata file.
>
>
> 4. Improved Single pass load by upgrading to latest netty framework and
> launched dictionary client for each loading
>
> 5. Supported range filters to combine the between filters to one filter to
> improve the filter performance.
>
> 6. Apart from features many bugs and improvements are done in this release.
>
> --
> Thanks & Regards,
> Ravindra
>



-- 
Regards
Liang