Re: Hadoop source code modification.

2016-11-19 Thread zhangjc
t > <https://github.com/apache/hadoop/blob/trunk/BUILDING.txt> > > > > Regards > Brahma Reddy Battula > > -Original Message- > From: Madhvaraj Shetty [mailto:madresearch2...@gmail.com > <mailto:madresearch2...@gmail.com>] > Sent: 15 November 2016 19

Re: Hadoop source code modification.

2016-11-18 Thread Madhvaraj Shetty
com/apache/hadoop/blob/trunk/BUILDING.txt >> >> >> >> Regards >> Brahma Reddy Battula >> >> -Original Message----- >> From: Madhvaraj Shetty [mailto:madresearch2...@gmail.com] >> Sent: 15 November 2016 19:36 >> To: gene...@hadoop.ap

RE: Hadoop source code modification.

2016-11-15 Thread Mallanagouda Patil
/hadoop/blob/trunk/BUILDING.txt > > > > Regards > Brahma Reddy Battula > > -Original Message- > From: Madhvaraj Shetty [mailto:madresearch2...@gmail.com] > Sent: 15 November 2016 19:36 > To: gene...@hadoop.apache.org > Subject: Hadoop source code modification.

RE: Hadoop source code modification.

2016-11-15 Thread Brahma Reddy Battula
Following links might be useful fro you. https://wiki.apache.org/hadoop/EclipseEnvironment http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/ https://www.quora.com/What-are-the-best-ways-to-learn-about-Hadoop-source Regards Brahma Reddy Battula From

RE: Hadoop source code modification.

2016-11-15 Thread Brahma Reddy Battula
raj Shetty [mailto:madresearch2...@gmail.com] Sent: 15 November 2016 19:36 To: gene...@hadoop.apache.org Subject: Hadoop source code modification. Hello, I am working in the area of hadoop, especially i want to improve hadoop security. So i need procedure for modifying hadoop source code. I ha

Re: build hadoop source code errors

2015-11-06 Thread Zheng Huang
up...@gmail.com <mailto:bup...@gmail.com>> > Reply-To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>" > <user@hadoop.apache.org <mailto:user@hadoop.apache.org>> > Date: Friday, November 6, 2015 at 12:57 AM > To: "user@hadoop.apach

Re: build hadoop source code errors

2015-11-06 Thread Chris Nauroth
doop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Date: Friday, November 6, 2015 at 12:57 AM To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>&g

build hadoop source code errors

2015-11-05 Thread Zheng Huang
HI all, build hadoop source cod have an error after clone hadoop from trunk branch of github.com <http://github.com/>. a commant is mvn package -Pdist,native,docs,src -DskipTests -Dtar on ubuntu:14.10 ppc64le os errors is below:Failed to execute goal org.apache.maven.plugins:maven-

Re: build hadoop source code errors

2015-11-05 Thread Zheng Huang
ail.com>> > Reply-To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>" > <user@hadoop.apache.org <mailto:user@hadoop.apache.org>> > Date: Thursday, November 5, 2015 at 10:19 PM > To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>&qu

Re: build hadoop source code errors

2015-11-05 Thread Chris Nauroth
oop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Date: Thursday, November 5, 2015 at 10:19 PM To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Subject: build hadoop s

Re: build hadoop source code errors

2015-11-05 Thread Zheng Huang
e.org>> > Date: Thursday, November 5, 2015 at 11:51 PM > To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>" > <user@hadoop.apache.org <mailto:user@hadoop.apache.org>> > Subject: Re: build hadoop source code errors > > it work , thank

Re: build hadoop source code errors

2015-11-05 Thread Chris Nauroth
ser@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Subject: Re: build hadoop source code errors it work , thank you ,very happy for submitting path . but I am a student, don't know how to submit path , could you give me some docs about patch

Hadoop source code in eclipse

2014-10-30 Thread mufc_fan
Hi...I want to debug Map-reduce jobs (pig,hive) using eclipse. That is, to set break points in the hadoop source java file and to inspect the elements while running map-reduce jobs. To do this, I started all the services using eclipse and I can debug some class files. But I cant create an entire

a question about hadoop source code repo

2014-05-12 Thread Libo Yu
Hi, Under hadoop-mapreduce-project directory, I notice the following two directories: 1hadoop-mapreduce-client/ 2src/ 2 src/ can be expanded to java/org/apache/hadoop/mapreduce My question is what the directory is for. And I wonder why mapreduce code is in hadoop-mapreduce-client.

hadoop source code

2014-03-24 Thread Avinash Kujur
hi, i downloaded the hadoop source code from github. after importing those files in eclipse some of the classes and packages are missing. And i am not able able to get those files online. help me out to get all the files once and some link for what are the files do i need to import eclipse

Re: hadoop source code

2014-03-24 Thread Azuryy Yu
Hi, you'd bettern check out from svn, then build with maven: mvn eclipse:eclipse, which will generate eclipse projects to you. On Mon, Mar 24, 2014 at 3:24 PM, Avinash Kujur avin...@gmail.com wrote: hi, i downloaded the hadoop source code from github. after importing those files in eclipse

Re: regarding hadoop source code

2014-03-11 Thread Avinash Kujur
after executing this command : mvn clean install i am getting this error. Failed tests: TestMetricsSystemImpl.testMultiThreadedPublish:232 expected:0 but was:5 TestNetUtils.testNormalizeHostName:617 null TestFsShellReturnCode.testGetWithInvalidSourcePathShouldNotDisplayNullInConsole:307

Re: regarding hadoop source code

2014-03-11 Thread Jian He
Those are just test failures, I suggest you skip the tests as you earlier did and do mvn clean install. On Tue, Mar 11, 2014 at 5:10 AM, Avinash Kujur avin...@gmail.com wrote: after executing this command : mvn clean install i am getting this error. Failed tests:

Re: regarding hadoop source code

2014-03-10 Thread Avinash Kujur
hi, i downloaded the code from https://github.com/apache/hadoop-common.git . but while executing the command mvn install -DskipTests its giving this error in between: [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ hadoop-hdfs-httpfs --- [INFO] Compiling 56 source files to

Re: regarding hadoop source code

2014-03-10 Thread Oleg Zhurakousky
You must be using Java 1.5 or below where @Override is not allowed on any method that implements its counterpart from interface. Remember, both 1.5 and 1.6 are EOL, so I would suggest upgrading to 1.7. Oleg On Mon, Mar 10, 2014 at 10:49 AM, Avinash Kujur avin...@gmail.com wrote: hi, i

Re: unable to compile hadoop source code

2014-01-06 Thread Diego Gutierrez
El ene 6, 2014 10:48 PM, nagarjuna kanamarlapudi nagarjuna.kanamarlap...@gmail.com escribió: Hi, I checked out the source code from https://svn.apache.org/repos/asf/hadoop/common/trunk/ I tried to compile the code with mvn. I am compiling this on a mac os X , mavericks. Any help is

RE: unable to compile hadoop source code

2014-01-06 Thread Rohith Sharma K S
2014 09:18 To: user@hadoop.apache.org Subject: unable to compile hadoop source code Hi, I checked out the source code from https://svn.apache.org/repos/asf/hadoop/common/trunk/ I tried to compile the code with mvn. I am compiling this on a mac os X , mavericks. Any help is appreciated

Re: unable to compile hadoop source code

2014-01-06 Thread nagarjuna kanamarlapudi
*To:* user@hadoop.apache.org *Subject:* unable to compile hadoop source code Hi, I checked out the source code from https://svn.apache.org/repos/asf/hadoop/common/trunk/ I tried to compile the code with mvn. I am compiling this on a mac os X , mavericks. Any help is appreciated

Re: Error while running Hadoop Source Code

2013-11-09 Thread Basu,Indrashish
Any updates on this ? Regards, Indra On Thu, 07 Nov 2013 11:28:57 -0500, Basu,Indrashish wrote: Hi Vinod, Please find the below details requested: A) ALL OF THE TASKTRACKER LOG : Same what I have provided in the earlier email. B) THE TASK-LOGS : SYSLOG :

Re: Error while running Hadoop Source Code

2013-11-06 Thread Basu,Indrashish
Hi Vinod, Thanks for your help regarding this. I checked the task logs, this is what it is giving as output. 2013-11-06 06:40:05,541 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311060636_0001_m_1100862588 2013-11-06 06:40:05,553 INFO

Re: Error while running Hadoop Source Code

2013-11-06 Thread Basu,Indrashish
Can anyone please assist regarding this ? Thanks in advance Regards, Indra On Wed, 06 Nov 2013 09:50:02 -0500, Basu,Indrashish wrote: Hi Vinod, Thanks for your help regarding this. I checked the task logs, this is what it is giving as output. 2013-11-06 06:40:05,541 INFO

Re: Error while running Hadoop Source Code

2013-11-06 Thread Vinod Kumar Vavilapalli
Don't see anything in the logs that you pasted. Can you paste the following in say pastebin? - All of the TaskTracker log - The task-logs. These are syslog, stderr, stdout files for a specific TaskAttempt. - And specific TaskAttempt's TaskAttemtpID that is failing. Thanks, +Vinod On Nov 6,

Re: Error while running Hadoop Source Code

2013-11-05 Thread Basu,Indrashish
Hi, Can anyone kindly assist on this ? Regards, Indrashish On Mon, 04 Nov 2013 10:23:23 -0500, Basu,Indrashish wrote: Hi All, Any update on the below post ? I came across some old post regarding the same issue. It explains the solution as The *nopipe* example needs more documentation.

Re: Error while running Hadoop Source Code

2013-11-05 Thread Vinod Kumar Vavilapalli
It seems like your pipes mapper is exiting before consuming all the input. Did you check the task-logs on the web UI? Thanks, +Vinod On Nov 5, 2013, at 7:25 AM, Basu,Indrashish wrote: Hi, Can anyone kindly assist on this ? Regards, Indrashish On Mon, 04 Nov 2013 10:23:23 -0500,

Re: Error while running Hadoop Source Code

2013-11-04 Thread Basu,Indrashish
Hi All, Any update on the below post ? I came across some old post regarding the same issue. It explains the solution as The *nopipe* example needs more documentation. It assumes that it is run with the InputFormat from src/test/org/apache/*hadoop*/mapred/*pipes*/

Error while running Hadoop Source Code

2013-10-31 Thread Basu,Indrashish
Hi, I am trying to run a sample Hadoop GPU source code (kmeans algorithm) on an ARM processor and getting the below error. Can anyone please throw some light on this ? rmr: cannot remove output: No such file or directory. 13/10/31 13:43:12 WARN mapred.JobClient: No job jar file set. User

Hadoop Source

2013-08-06 Thread Sathwik B P
Hi guys, I wanted to checkout the Hadoop source. I see that there are 3 repo listed under http://git.apache.org/ hadoop-common.git hadoop-hdfs.git hadoop-mapreduce.git I checked out the hadoop-common.git and I see that it has hadoop-common-project, hadoop-hdfs-project, hadoop-yarn-project

Re: Hadoop Source

2013-08-06 Thread Harsh J
that should help resolve your questions and also get you going. On Tue, Aug 6, 2013 at 1:25 PM, Sathwik B P sath...@apache.org wrote: Hi guys, I wanted to checkout the Hadoop source. I see that there are 3 repo listed under http://git.apache.org/ hadoop-common.git hadoop-hdfs.git hadoop

HOW TO WORK WITH HADOOP SOURCE CODE

2013-02-10 Thread Dibyendu Karmakar
Hi, I am trying to view HADOOP SOURCE CODE. I am using HADOOP 1.0.3. In HADOOP distribution, only jar files are there. Give me some instruction to view source code... please I have seen contribute to hadoop page ( wiki.apache.org/hadoop/HowToContribute ) where something about git is written. I am

building Hadoop source code in Eclipse

2012-08-23 Thread susnata basak
Hi All, While trying to build hadoop source code in eclipse using maven following the instructions on - http://wiki.apache.org/hadoop/EclipseEnvironment I noticed that the project layout has changed in the latest development version, as such the instruction didn't quite match. I was wondering

Re: building Hadoop source code in Eclipse

2012-08-23 Thread Adam Berry
To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: building Hadoop source code in Eclipse Hi All, While trying to build hadoop source code in eclipse using maven following the instructions on - http://wiki.apache.org/hadoop

Re: building Hadoop source code in Eclipse

2012-08-23 Thread Harsh J
@hadoop.apache.org user@hadoop.apache.org Subject: building Hadoop source code in Eclipse Hi All, While trying to build hadoop source code in eclipse using maven following the instructions on - http://wiki.apache.org/hadoop/EclipseEnvironment I noticed that the project layout has changed

RE: building Hadoop source code in Eclipse

2012-08-23 Thread susnata basak
Hey Harsh, I came across a video on building hadoop source code on cloudera site, but it was using Ant (on an older project layout). If you're able to use m2eclipse, would you like to make a similar video post or document it somewhere. The other issue I ran into - the unit tests weren't

how to read hadoop source code efficiently

2011-12-07 Thread 陈竞
hi, i am reading hadoop-0.23 source code, mainly focusing on hadoop yarn. However i have some problems in reading the source code. There is no Debugging tools for hadoop, so i can't track the code execution flow. Therefore i can't understand the code quickly since there are lots of overwirte,

Re: how to read hadoop source code efficiently

2011-12-07 Thread wang xin
Hi,Jing, you can run ant eclipse-files at command line.And then you can import it to your eclipse. I think you can read the code from JobTracker and TaskTracker .you can find the main() function in these class. 在 2011-12-8,下午1:50, 陈竞 写道: hi, i am reading hadoop-0.23 source code,

Re: how to read hadoop source code efficiently

2011-12-07 Thread 陈竞
my problem is that there are many definitions of one function, i can't get which function it really use even in eclipse , since there are many overwrite, so i want to track it. is there some tools like gdb in java for runing hadoop? 在 2011年12月8日 下午1:59,wang xin wangxin0072...@gmail.com写道:

Re: how to read hadoop source code efficiently

2011-12-07 Thread Harsh J
You can run daemons from within Eclipse in debugging mode -- you only need to launch the right main class (NameNode, DataNode, etc. for example). This is a feature of Eclipse. But distributed programming is best debugged with proper logging, if you can't afford running all the daemons and the

help with hadoop source code

2010-07-11 Thread Rahul.V.
Hi, Am trying to implement a small map reduce framework on another file system. A very elementary one at that. So I am trying to access the Hadoop source code for that. Where do I find it? -- Regards, R.V.

Re: help with hadoop source code

2010-07-11 Thread Ted Yu
to access the Hadoop source code for that. Where do I find it? -- Regards, R.V.

Re: help with hadoop source code

2010-07-11 Thread Rahul.V.
reduce framework on another file system. A very elementary one at that. So I am trying to access the Hadoop source code for that. Where do I find it? -- Regards, R.V. -- Regards, R.V.

How can I debug the hadoop source code within eclipse

2008-08-27 Thread li luo
Hi, All I am deploy hadoop in my Linux computer as a single-node environment.And everything running good.Now I want to follow the running step of hadoop job step by step in Eclipse.please tell me how I can do that? Thanks