building hadoop

2011-11-17 Thread mohmmadanis moulavi
Friends, I have modified the source program of hadoop, and i want to build it using  "ant"  but it's not working . I use the following command ant -Doffline=true -Dresolvers=internal the ouput of this command looks like as follows: clover.setup: clover.info: [echo] [echo] 

Re: wrong in secondary namenode ?

2011-11-17 Thread Patai Sangbutsarakum
Sadly, https://issues.apache.org/jira/browse/HDFS-1839 -P On Wed, Oct 12, 2011 at 2:32 PM, patrick sang wrote: > hi hadoopers, > > just want to check how it looks in your hadoop settings. > i am running Cloudera CDH3u0, and really curious why previous.checkpoint > directory is not there. > I h

RE: "No HADOOP COMMON HOME set."

2011-11-17 Thread GOEKE, MATTHEW (AG/1000)
Jay, Did you download stable (0.20.203.X) or 0.23? From what I can tell, after looking in the tarball for 0.23, it is a different setup then 0.20 (e.g. hadoop-env.sh doesn't exist anymore and is replaced by yarn-env.sh) and the documentation you referenced below is for setting up 0.20. I would

"No HADOOP COMMON HOME set."

2011-11-17 Thread Jay Vyas
Hi guys : I followed the exact directions on the hadoop installation guide for psuedo-distributed mode here http://hadoop.apache.org/common/docs/current/single_node_setup.html#Configuration However, I get that several environmental variables are not set (for example , "HaDOOP_COMMON_HOME" is not s

hadoop and java 7

2011-11-17 Thread David LaBarbera
Has anyone tried using java 7 with hadoop? -- David LaBarbera | Senior Software Engineer Proclivity Systems 22 West 19th Street | 9th Floor New York, NY 10011 o 646.237.3734 *dlabarb...@proclivitysystems.com* www.proclivitysystems.com Proclivity® | We Value Your Customers™ This message is the p

Re: simple question : where is conf/hadoop-env.sh ?

2011-11-17 Thread Jay Vyas
I mean... when I look in the hadoop installation directory (after untarring it) ... I dont see any of those files in conf ...? Does that mean i have to manually copy them over from the templates ? On Thu, Nov 17, 2011 at 1:54 PM, Ayon Sinha wrote: > $HADOOP_HOME/conf > > -Ayon > See My Photos o

Re: simple question : where is conf/hadoop-env.sh ?

2011-11-17 Thread Ayon Sinha
$HADOOP_HOME/conf   -Ayon See My Photos on Flickr Also check out my Blog for answers to commonly asked questions. From: Jay Vyas To: common-user@hadoop.apache.org Sent: Thursday, November 17, 2011 10:40 AM Subject: simple question : where is conf/hadoop-env.sh ?

simple question : where is conf/hadoop-env.sh ?

2011-11-17 Thread Jay Vyas
Hi guys : I do not see a "conf/hadoop-env.sh" file, which is required for hadoop installation, according to standard hadoop install directions which I find online and in the hadoop elephant book... Any hints on how to install a basic, hybrid mode hadoop fs on my laptop ? I DO SEE a series of

Hadoop Metrics

2011-11-17 Thread Paolo Rodeghiero
Hi, I'm developing on top of Hadoop for my Master final thesis, which aims to connect theoretical MapReduce modelling to a more practical ground. A part of the project is about analyzing the impact of some parameters to Hadoop internals. To do so, I need some deep understanding of the Metrics

Hadoop start up error

2011-11-17 Thread Frank Astier
Hi - I’m seeing the following exception while trying to start MiniDFSCluster in some environment. The stack trace is: Starting DataNode 0 with dfs.data.dir: build/test/data/dfs/data/data1,build/test/data/dfs/data/data2 java.lang.NullPointerException at org.apache.hadoop.hdfs.MiniDFSC

Re: Adding a new platform support to Hadoop

2011-11-17 Thread Steve Loughran
On 17/11/11 15:02, Amir Sanjar wrote: Is there any specific development, build, and packaging guidelines to add support for a new hardware platform, in this case PPC64, to hadoop? Best Regards Amir Sanjar Linux System Management Architect and Lead IBM Senior Software Engineer Phone# 512-286-839

Re: Adding a new platform support to Hadoop

2011-11-17 Thread Brian Bockelman
Hi Amir, The best person to engage is Allen Wittenauer, who has "fought the good fight" on this previously. It's a bit of an uphill battle, as the primary development platform is definitely Linux / x86-64. I saw him close a bunch of portability-related tickets a few weeks ago, which made me a

Adding a new platform support to Hadoop

2011-11-17 Thread Amir Sanjar
Is there any specific development, build, and packaging guidelines to add support for a new hardware platform, in this case PPC64, to hadoop? Best Regards Amir Sanjar Linux System Management Architect and Lead IBM Senior Software Engineer Phone# 512-286-8393 Fax# 512-838-8858

Re: Announcing Bangalore Hadoop Meetup Group

2011-11-17 Thread bejoy . hadoop
Hi Sharad Great effort. Hats off!.. I'd bring my whole team in. Please fix on the date as well. I have proposed for December 2nd 4 PM in the meet up. Please contact me for any assistance as even I'm put up in the same campus. Thanks a lot!.. Regards Bejoy K S -Original Message

Announcing Bangalore Hadoop Meetup Group

2011-11-17 Thread Sharad Agarwal
Hi Bangalore Area Hadoop Developers and Users, There is a lot of interest in Hadoop and Big Data space in Bangalore. Many folks have been asking for Bangalore meetups for long. I have just created the group here to manage the logistics - http://www.meetup.com/Bangalore-Hadoop-Meetups The idea is

Re: how to complie &package my hadoop?

2011-11-17 Thread seven garfee
thx my version is 0.20.2 and is there any resouces i can refer? 2011/11/17 Harsh J > What version are you modifying? > > If its 0.20 based, simply do "ant jar" and then look for a built jar > under build/. > > On Thu, Nov 17, 2011 at 3:57 PM, seven garfee > wrote: > > hi,all > > I modify some

Re: how to complie &package my hadoop?

2011-11-17 Thread Harsh J
What version are you modifying? If its 0.20 based, simply do "ant jar" and then look for a built jar under build/. On Thu, Nov 17, 2011 at 3:57 PM, seven garfee wrote: > hi,all >  I modify some code in hadoop. >  but i'm not good at ant or maven.what cmd should i enter in linux shell > to build

Re: reducing mappers for a job

2011-11-17 Thread Paolo Rodeghiero
Il 17/11/2011 05:00, He Chen ha scritto: Hi Jay Vyas Ke yuan's method may decrease the number of mapper because in default the number of mapper for a job = the number of blocks in this job's input file. Hi, I'm not in production phase, so I just reference things that I read. First, may be o

how to complie &package my hadoop?

2011-11-17 Thread seven garfee
hi,all I modify some code in hadoop. but i'm not good at ant or maven.what cmd should i enter in linux shell to build a new hadoop-*.jar to test my code?

hadoop 0.20.205.0 conf/ versus etc/hadoop

2011-11-17 Thread stephen mulcahy
Why is there a conf/ directory and an etc/hadoop directory in the distributed tar-file? They seem to contain the same files? -stephen -- Stephen Mulcahy, DI2, Digital Enterprise Research Institute, NUI Galway, IDA Business Park, Lower Dangan, Galway, Ireland http://di2.deri.iehttp://webst