+1 This would further enhance the performance of queries where io is the bottleneck
Regards Raghu On Fri, 12 Oct 2018, 12:18 pm Xu, Cheng A, <[email protected]> wrote: > Thanks Chuanyin. This PR looks cool. Allowing customized codec is a good > option. Comparing with the existing built-in Snappy codec in CarbonData, I > think QATCodec with better performance and better compression ratio is also > a good candidate for built-in support. Any thoughts? > > Thanks > Ferdinand Xu > > -----Original Message----- > From: xuchuanyin [mailto:[email protected]] > Sent: Friday, October 12, 2018 11:07 AM > To: [email protected] > Subject: Re: Proposal to integrate QATCodec into Carbondata > > emm, if it only needs to extend another compressor for software > implementation, I think it will be quite easy to integrate. > > Actually a PR has already been raised weeks ago to support customize > compressor in carbondata, you can refer to this link: > https://github.com/apache/carbondata/pull/2715. You can refer to the > `CustomizeCompressor` in `TestLoadDataWithCompression.scala` for more > information. > > > > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >
