map-side and reduce-side join implementations

Hi, I am looking for implementations of a simple two way join algorithm based on the new api (mapreduce) map-side join and reduce-side join. (cause one join has two large datasets and the other has a large and a small dataset so that would map to reduce side-join and map-side join respectively).

How to remove dead node ?

Hadoop Version 2.4.1 Remove the datanode process. Decommissioning Nodesgt;gt; Decommissioned gt;gt; Deads How to remove DeadNodes ???

No space left on device Exception, OPENFORWRITE file

How can i disk re-balancing of datanode??? Why does generate openforwrite file? How do I handle openforwrite file? Hadoop 1.1.2 *** Datanode disk usage Use% Mounted on 100%/data01 100%/data02 100%/data03 100%/data04 100%/data05 100%/data06 20% /data07

How to remove Decommissioned node??

Hadoop Version 2.4.1 Remove the datanode process. Decommissioning Nodesgt;gt; Decommissioned gt;gt; Dead How to remove decommissioned dead node???

namenod shutdown. epoch number mismatch

hadoop version 2.4.1 Namenode shutdown to become epoch number mismatch. Why suddenly epoch numbers mismatch ? Why suddenly namenode shutdown ? *** namenode log 2014-08-26 12:17:48,625 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Rescanning after

Re: Local file system to access hdfs blocks

*BP-13-7914115-10.122.195.197-14909166276345 is the blockpool information* *blk_1073742025 1073742025 is the block name;* *these names are private to teh HDFS system and user should not use them, right?* *But if you really want ot know this, you can check the fsck code to see whether they are

Reflect changes without restart data node

Hi folks, Is there anyway that Hadoop re-read config file like core-site.XML without restarting datanode. Ex like we dor slave or exclude file by running Hadoop dfsadmin - refreshNodes Thanks Vikas Srivastava

[HDFS] DFSClient does not closing a closed socket resulting in thousand of CLOSE_WAIT sockets with HDP 2.1/HBase 0.98.0/Hadoop/2.4.0

Hello Hadoopers, When I run HDP 2.1/HBase 0.98.0/Hadoop/2.4.0, I always got the fatal problem: DFSClient does not closing a closed socket resulting in thousand of CLOSE_WAIT sockets. Have you guys got same issue, if that please share to me? Thanks a lot. I also create a issue HDFS-6973 for this.

FW: Problem in using Hadoop Eclipse Plugin

From: YIMEN YIMGA Gael ItecCsySat Sent: Friday 29 August 2014 12:12 To: 'hdfs-u...@hadoop.apache.org' Subject: Problem in using Hadoop Eclipse Plugin Hello Dears, I did the same, but I'm facing the same error when launching the program [cid:image001.png@01CFC382.72E72730] Here is the error

Re: Hadoop 2.5.0 - HDFS browser-based file view

For normal use, yes. For development, it's useful to start small and be able to quickly see the output. It's certainly not a major issue. I just didn't know if there was a config option to change the behavior. Thanks, Brian On 08/28/2014 02:30 AM, Stanley Shi wrote: Normally files in HDFS

Hadoop 2.5.0 unit tests failures

Hi, I wanted to know if all the unit tests pass in the hadoop-common project across various releases. I have never been able to get a clean run on my machine (Centos 6.5 / 4GB RAM / tried both Java 6 and Java 7). I have also attached the document which has the failures that I got while running

Re: Local file system to access hdfs blocks

Stanley, Thanks. Btw, I found this jira hdfs-2246, which probably match what I am looking for. Demai on the run On Aug 28, 2014, at 11:34 PM, Stanley Shi s...@pivotal.io wrote: BP-13-7914115-10.122.195.197-14909166276345 is the blockpool information blk_1073742025 is the block name;