Re: Loading and reading Snappy compressed files on Hadoop

2011-10-27 Thread Shantian Purkad
n Purkad Sent: Thursday, October 27, 2011 4:32 PM Subject: RE: Loading and reading Snappy compressed files on Hadoop Shantian, reading a single compressed file through multiple hosts requires a "splittable" compression format such as bzip or lzo or else encapsulation of the compres

RE: Loading and reading Snappy compressed files on Hadoop

2011-10-27 Thread Tim Broberg
e information. - Tim. From: Shantian Purkad [shantian_pur...@yahoo.com] Sent: Thursday, October 27, 2011 4:07 PM To: hdfs-user@hadoop.apache.org Subject: Loading and reading Snappy compressed files on Hadoop Hi, What is best way to load a snappy compressed files on Hadoop and then read them

Loading and reading Snappy compressed files on Hadoop

2011-10-27 Thread Shantian Purkad
Hi, What is best way to load a snappy compressed files on Hadoop and then read them through M/R I see that hadoop can uncompress .gz files (using single map) But looking for a better way to utilize multiple mappers to read precompressed files. Thanks and Regards, Shantian