Daily digest option

Hi all, Is their a daily digest option in this mailing list to which we can subscribe? Lot of individual emails come daily but I don't want to leave the mailing list as the topics interest me. I want to switch to daily digest, one email per day with all messages embedded in it. -- Neil Sa

Re: Hadoop streaming or pipes ..

Thanks all, and Charles you guided me to Baidu slides titled: Introduction to *Hadoop C++ Extension* which is their experience and the sixth-slide shows exactly what I was looking for. It is still hard to manage memory with pipes besides t

Reading properties file from command line + passing parameters from main to mapper/reducer?

Dear friends I am new to hadoop on aws. I am using AWS Elastic mapreduce. I am trying to convert an old java program to elastic mapreduce. I would appreciate your help. My question is about: 1. How do I pass a "Properties" file which i used to pass via command line paramters - to elastic map

Reading properties file from command line + passing parameters from main to mapper/reducer?

Dear friends I am new to hadoop on aws. I am using AWS Elastic mapreduce. I am trying to convert an old java program to elastic mapreduce. I would appreciate your help. My question is about: 1. How do I pass a "Properties" file which i used to pass via command line paramters - to elastic

Reading properties file from command line + passing parameters from main to mapper/reducer?

Dear friends I am new to hadoop on aws. I am using AWS Elastic mapreduce. I am trying to convert an old java program to elastic mapreduce. I would appreciate your help. My question is about: 1. How do I pass a "Properties" file which i used to pass via command line paramters - to elastic map

Re: Namespace logs : a common issue?

If you are talking about the "Incompatible namespace ID" issues, then look at https://issues.apache.org/jira/browse/HDFS-107 for a discussion on the topic. It is a common issue with newcomers as they end up "formatting" at the first sight of trouble, or skip reading most of the tutorial that other

Namespace logs : a common issue?

Hi guys : I'm noticing that namespace conflicts or differences are a common theme in hadoop both in my experience and now on this list Serv. Does anyone have any thoughts on why this is such a common issue and how it will be dealt with in new releases? Jay Vyas MMSB UCHC

Re: Data Node is not Started

according to the logs the namespace id in the datanode data directories is incompatible. Since you formatted the namenode these id's do not match. Clean up the contents of the data dir (/app/hadoop/tmp/dfs/data) and then start the datanode. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com

Re: Data Node is not Started

Below are DataNode logs hduser@sujit:~/Desktop/hadoop/logs$ cat hadoop-hduser-datanode-sujit.log 2012-04-06 22:11:34,566 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: / STARTUP_MSG: Starting DataNode STARTUP_M

Re: Data Node is not Started

Can you check the datanode logs? May its an incompatible namespace issue. On Apr 6, 2012, at 11:13 AM, Sujit Dhamale wrote: > Hi all, > my DataNode is not started . > > even after deleting hadoop*.pid file from /tmp , But still Data node is not > started , > > > Hadoop Version: hadoop-1.0.1.tar

Data Node is not Started

Hi all, my DataNode is not started . even after deleting hadoop*.pid file from /tmp , But still Data node is not started , Hadoop Version: hadoop-1.0.1.tar.gz Java version : java version "1.6.0_26 Operating System : Ubuntu 11.10 i did below procedure *hduser@sujit:~/Desktop/hadoop/bin$ jps*

Re: map task execution time

On 04/04/2012 11:20 PM, bikash sharma wrote: Hi, Is it possible to get the execution time of the constituent map/reduce tasks of a MapReduce job (say sort) at the end of a job run? Preferably, can we obtain this programatically? Thanks, Bikash You could parse the logs inside the job's output

Hadoop-Fuse issue

Dear All, I have installed Hadoop-fuse to mount the HDFS filesystem locally for more flexibility. I could mount the HDFS without any issues.But I am not able to do any file operations like *delete, copy, move* orations directly. The directory ownership automatically changed to nobody:nobody while