Hi,
I am using LZO to compress my intermediate map outputs.
These are the settings:
mapred.map.output.compression.codec = com.hadoop.compression.lzo.LzoCodec
pig.tmpfilecompression.codec = lzo
But I am consistently getting the following exception (I dont get this
exception when I use "gz" a
and in the gc.log of the region server we get CMS failures that cause full
gc (that fails to free memory):
11867.254: [Full GC 11867.254: [CMS: 3712638K->3712638K(3712640K), 4.7779250
secs] 4032614K->4032392K(4057664K), [CMS Perm : 20062K->19883K(33548K)]
icms_dc=100 , 4.7780440 secs] [Times: user
Hi,
cluster details:
hbase 0.90.2. 10 machines. 1GB switch.
use-case
M/R job that inserts about 10 million rows to hbase in the reducer, followed
by M/R that works with hdfs files.
When the first job maps finish the second job maps starts and region server
crushes.
please note, that when running
Hi Subroto,
I cannot visit that video in China
Today, I got it somehow.
I got a question how can I make the number of Mappers and nodes the same?
There is no adjacent matrix of the graph in input files
How can I get the "seed" of the graph?
--
Regards!
Jun Tan
At 2011-08-10 02:51:08,"Subrot
