classpath question

2010-07-05 Thread Andrew Rothstein
I've written a mapper that relies upon hsqldb-2.0. I had a tough time determining that despite submitting my job with -libjars hsqldb-2.0.jar my code was conflicted with the v1.8 jar that comes in $HADOOP_HOME/lib/hsqldb-1.8.0.10.jar. Is there a way to promote the v2.0 jar to the front of the class

Re: TotalOrderPartitioner for the new API?

2010-07-05 Thread Todd Lipcon
On Fri, Jul 2, 2010 at 4:50 AM, juber patel wrote: > Hi, > > my program needs total sorting as done by the TotalOrderPartitioner. I > have written all my code using the new API. I see that this > partitioner was ported to new API only in 0.21 RC0 that Tom White > released today. > > Considering t

Re: parititioning dataset

2010-07-05 Thread Alex Loddengaard
Hi there, Unfortunately you can't control which mapper gets what data. The InputSplit -> map task assignment is random. You could, however, do the join in the reduce, by using an intermediate key as your join key. Does that make sense? Alex On Sat, Jul 3, 2010 at 9:28 AM, Denim Live wrote:

how to write map/reduce from sql?

2010-07-05 Thread jake 宫
hi,   The sql is select count(distinct (uname)) from table.   For your information!

Re: Shuffle Error: Exceeded MAX_FAILED_UNIQUE_FETCHES; bailing-out.

2010-07-05 Thread bmdevelopment
Hello, I still have had no luck with this over the past week. And even get the same exact problem on a completely different 5 node cluster. Is it worth opening an new issue in jira for this? Thanks On Fri, Jun 25, 2010 at 11:56 PM, bmdevelopment wrote: > Hello, > Thanks so much for the reply. >