n
Purkad
Sent: Thursday, October 27, 2011 4:32 PM
Subject: RE: Loading and reading Snappy compressed files on Hadoop
Shantian, reading a single compressed file through multiple hosts requires a
"splittable" compression format such as bzip or lzo or else encapsulation of
the compres
e information.
- Tim.
From: Shantian Purkad [shantian_pur...@yahoo.com]
Sent: Thursday, October 27, 2011 4:07 PM
To: hdfs-user@hadoop.apache.org
Subject: Loading and reading Snappy compressed files on Hadoop
Hi,
What is best way to load a snappy compressed files on Hadoop and then read them
Hi,
What is best way to load a snappy compressed files on Hadoop and then read them
through M/R
I see that hadoop can uncompress .gz files (using single map)
But looking for a better way to utilize multiple mappers to read precompressed
files.
Thanks and Regards,
Shantian