hbase compression

2010-11-20 Thread Adam Portley
Hi, I'm using a map-reduce job with HFileOutputFormat followed by bulk loads/merges to create and populate a table with multiple column familes. I would like to understand how compression works, and how to specify a non-default compression in this setup. So: AFAIK, there are two relevant s

Hbase Compression

2013-09-24 Thread aiyoh79
://apache-hbase.679495.n3.nabble.com/Hbase-Compression-tp4051122.html Sent from the HBase User mailing list archive at Nabble.com.

Re: hbase compression

2010-11-20 Thread Todd Lipcon
Hi Adam, Answers inline below: On Sat, Nov 20, 2010 at 7:14 AM, Adam Portley wrote: > > Hi, > I'm using a map-reduce job with HFileOutputFormat followed by bulk > loads/merges to create and populate a table with multiple column familes. I > would like to understand how compression works, and h

Re: Hbase Compression

2013-09-24 Thread Ted Yu
hen it finally added, the size is 64.4m. Lastly, there are 2 more > parameters which is 128.2m and 48.0m for currentsize. > > I never specify hbase.regionserver.codecs preperty in my hbase-site.xml > file, so is the size difference still because of compression? > > Thanks, > &g

Re: Hbase Compression

2013-09-24 Thread Jean-Daniel Cryans
rty in my hbase-site.xml > file, so is the size difference still because of compression? > > Thanks, > > aiyoh79 > > > > -- > View this message in context: > http://apache-hbase.679495.n3.nabble.com/Hbase-Compression-tp4051122.html > Sent from the HBase User mailing list archive at Nabble.com. >

Re: Hbase Compression

2013-09-24 Thread aiyoh79
added, the size is 64.4m. Lastly, there are 2 more >> parameters which is 128.2m and 48.0m for currentsize. >> >> I never specify hbase.regionserver.codecs preperty in my hbase-site.xml >> file, so is the size difference still because of compression? >> >> Thank

Re: Hbase Compression

2013-09-24 Thread aiyoh79
>> parameters which is 128.2m and 48.0m for currentsize. >> >> I never specify hbase.regionserver.codecs preperty in my hbase-site.xml >> file, so is the size difference still because of compression? >> >> Thanks, >> >> aiyoh79 >> >>

Considering deprecation and removal of XZ compression (hbase-compression-xz)

2024-04-01 Thread Andrew Purtell
aster/hbase-compression/hbase-compression-xz). We depend on version 1.9 of xz-java, which was published in 2021, well before maintenance changes in the project and the involvement of a person who is now believed to be a malicious actor. Projects like HBase that depend on xz-java have no reason

Re: Considering deprecation and removal of XZ compression (hbase-compression-xz)

2024-04-02 Thread Duo Zhang
ort > for the LZMA algorithm ( > https://github.com/apache/hbase/tree/master/hbase-compression/hbase-compression-xz). > We depend on version 1.9 of xz-java, which was published in 2021, well > before maintenance changes in the project and the involvement of a person > who is now beli

Re: Considering deprecation and removal of XZ compression (hbase-compression-xz)

2024-04-09 Thread Andrew Purtell
recent releases of the native liblzma library as a vector for malicious > > code. > > > > This is not the pure Java version that we depend upon for HBase's support > > for the LZMA algorithm ( > > > https://github.com/apache/hbase/tree/master/hbase-compression/h

Re: Considering deprecation and removal of XZ compression (hbase-compression-xz)

2024-04-09 Thread Wei-Chiu Chuang
> recent releases of the native liblzma library as a vector for malicious > > code. > > > > This is not the pure Java version that we depend upon for HBase's support > > for the LZMA algorithm ( > > > https://github.com/apache/hbase/tree/master/hbase-compres