Global sorting fails

of the box​​, I am not sure how these managed to get unordered?? The result is that the first job passes fine, but the map phase of the second job fails with the above exception. Thanks for the help! Keren -- Keren Ouaknine www.kereno.com

map-side and reduce-side join implementations

). I started with the Def Guide book, but it doesn't have a map-side example (just explanations on the algorithm). I looked on the web and found examples of three way-joins only. Any pointers? Thanks, Keren -- Keren Ouaknine www.kereno.com

RandomSampler and TotalOrderPartitioner

there is only one partition which explains the one reducer: SEQ org.apache.hadoop.io.Text!org.apache.hadoop.io.NullWritable I am wondering how come the partition file contains only one sample, though I asked for 399 samples above? Thanks for the help!! Keren​ -- Keren Ouaknine www.kereno.com

.eclipse.templates not found

: [kereno@keren pig10]$ patch -p0 --dry-run HADOOP-7653.1.patch patching file build.xml Hunk #1 FAILED at 1521. Hunk #2 FAILED at 1549. Hunk #3 FAILED at 1636. 3 out of 3 hunks FAILED -- saving rejects to file build.xml.rej Any idea how to solve this? Thanks, Keren -- Keren Ouaknine Web

port for datanode

Hello, I would like to query about the list of datanode's ips and ports. I am aware the default port is 50075, but on this scenario I might have two versions of Hadoop with datanode running on non-default ports. Thanks, Keren

memory configuration

to 1536 Error: Current usage: 1.1gb of 1.0gb physical memory used; 1.9gb of 2.1gb virtual memory used. Killing container. Few questions, if you have a clue about the memory settings above, and can advise for best configuration that would be very helpful. Thanks!! Thanks, Keren -- Keren Ouaknine

Hadoop 0.23.1 - cluster startup and job test

Hello, I configured 0.23 thanks to cloudavenue's http://www.thecloudavenue.com/2012/01/getting-started-with-nextgen-mapreduce.htmlpost. My UI seems ok, but reports only one node out of the ten. My master is running: 18130 DataNode 18264 ResourceManager 18507 NodeManager 19881 NameNode And my

Re: Apache Hadoop optimization

help!! Avi -- Keren Ouaknine Web: www.kereno.com

reduce tasks pending - no progress for few hours

=job_20302144_0187type=reducepagenum=1state=completed 0 3http://10.239.24.12:50030/jobfailures.jsp?jobid=job_20302144_0187kind=reducecause=failed/ 0 Thanks, Keren -- Keren Ouaknine Cell: +972 54 2565404 Web: www.kereno.com

Re: negative map number

and Regards, Ravi teja -- *From:* Keren Ouaknine [ker...@gmail.com] *Sent:* 29 November 2011 08:38:53 *To:* mapreduce-user *Subject:* negative map number * Jobid* *Priority* *User* *Name* *Map % Complete* *Map Total* *Maps Completed* *Reduce % Complete* *Reduce

Re: #number of mappers

configured property at the TaskTrackers? The right property is mapred.tasktracker.{map,reduce}.tasks.maximum, and applies to each TaskTracker individually (so all your TT mapred-site.xml need to carry that property to limit their slots). On 25-Nov-2011, at 8:45 AM, Keren Ouaknine wrote

#number of mappers

0 http://10.239.24.12:50030/machines.jsp?type=excluded -- Keren Ouaknine Cell: +972 54 2565404 Web: www.kereno.com

Hadoop's use cases

help with more info / ideas? Thanks, Keren -- Keren Ouaknine Cell: +972 54 2565404 Web: www.kereno.com

error while running gridmix2

in `find /mnt/hadoop/CDH3-keren -name '*jar'`; do echo $jar; jar tvf $jar | grep -i *gridmixrunner*; done -- Keren Ouaknine Cell: +972 54 2565404 Web: www.kereno.com -- Keren Ouaknine Cell: +972 54 2565404 Web: www.kereno.com

conferences

Hello, I would like to find the list of prestigious conferences related to Hadoop. Where can I find the list of these? Thanks! Keren -- Keren Ouaknine Cell: +972 54 2565404 Web: www.kereno.com