Another point concerning the Combiners,
the grouping is currently done using the RawComparator used for
sorting the Mapper's output. Wouldn't it be useful to be able to set a
custom CombinerGroupingComparatorClass?
Mathias.
I would like to know if and ever if HDFS RAID (
http://wiki.apache.org/hadoop/HDFS-RAID) will ever get into mainline. This
is would be an extremely useful feature for many sites especially larger
ones. The saving on storage will be noticeable. I haven really seen any
progress in
Hello Rita,
This discussion might interest you on the topic:
http://search-hadoop.com/m/3O8Rl15Kqsq1
On 29-Oct-2011, at 6:47 PM, Rita wrote:
I would like to know if and ever if HDFS RAID (
http://wiki.apache.org/hadoop/HDFS-RAID) will ever get into mainline. This
is would be an extremely
- Original Message -
From: Jay Vyas jayunit...@gmail.com
Date: Saturday, October 29, 2011 8:27 pm
Subject: can't format namenode
To: common-user@hadoop.apache.org
Hi guys : In order to fix some issues im having (recently posted),
I'vedecided to try to make sure my name node is
I have been getting error in my output saying error reading task
outputhttp - I read that this may be a logging issue but
do not know how or where to look for problems - when I go to the task
tracker and click on the attempy is says ChildError
and when I click on the output of the task it says
We've been getting up to speed on SOLR, and one of the recent problems we've
run into is with successful jobs delivering corrupt index shards.
This is a look at a 12-sharded index we built and then copied to local disk
off of HDFS.
$ ls -l part-1
total 16
drwxr-xr-x 2 vmc visible 4096 Oct 29
Did you build a jar file for your job and did you put mysql-cinnector,jar in
its lib directory???
I have had this work for me
On Fri, Oct 28, 2011 at 12:56 PM, Jamal x jm151...@gmail.com wrote:
Thanks for the response.
I need to submit this job programatically, instead of using the command
Hey Mark,
(Before you jump in with LZO, perhaps consider using Snappy+SequenceFiles?)
On 30-Oct-2011, at 7:59 AM, Mark wrote:
Email was sent a bit prematurely.
Anyway. How can one test that LZO compression is configured correctly? I've
found multiple sources on how to compile the
