Re: Which component manages slow tasks?

2012-06-09 Thread Merto Mertek
able to, with any decent IDE, follow the above > entry points and then be able to drill up/down from there to analyze > the code. In case you get stuck somewhere in understanding something > around these features, feel free to ask us here! > > On Fri, Jun 8, 2012 at 9:14 PM, Merto

How to make a ganglia metric in the new api?

2012-03-10 Thread Merto Mertek
I am aware of two options. First is writing a python module that would be placed under cron and would parse from a file where my stats are stored, and the second one would be to implement a metric usign the new gaglia api 31. I am interested for the second one and how could I do a graph with updati

Re: How to change the scheduler

2012-03-06 Thread Merto Mertek
If you will change the default scheduler take a look at the thread "Dynamic changing of slaves" on the mailing list where I described my understanding of the scheduling process. However if you will modify some fairscheduling code, take a look at classes fairscheduler.java and schedulingalgorithms.j

Re: Developing and deploying hadoop

2012-02-29 Thread Merto Mertek
describing best practices in developing, deploying and automatization of java project in unix/linux environment.. thanks.. On 13 February 2012 11:26, Merto Mertek wrote: > I am interested in some general tips on how to develop and deploy new > versions of hadoop. I've been trying to co

Re: Install an environment for hadoop development

2012-02-20 Thread Merto Mertek
You can try to see if you find something useful from bellow links.. I think both of them require svn and not git.. http://www.cloudera.com/blog/2009/04/configuring-eclipse-for-hadoop-development-a-screencast/ http://wiki.apache.org/hadoop/BuildingHadoopFromSVN?highlight=%28svn%29 On 20 February 2

Developing and deploying hadoop

2012-02-13 Thread Merto Mertek
I am interested in some general tips on how to develop and deploy new versions of hadoop. I've been trying to compile a new version of hadoop and place the new jar to the cluster in the lib folder, however it was not picked despite the classpath was explicitly set to the lib folder. I am intereste

Re: slave nodes could not connect to Master .

2011-10-26 Thread Merto Mertek
Ok, problem seems to be solved. In the core-site.xml file on the namenode I left value for fs.name.default pointing to localhost. After changing it to hadoomaster, and restarting it I could see other nodes too.. On 26 October 2011 04:02, Merto Mertek wrote: > Same problem here.. Sachinites h

Re: slave nodes could not connect to Master .

2011-10-25 Thread Merto Mertek
Same problem here.. Sachinites have you found a solution? I have three nodes where situation is the same as described above.. Pinging and ssh-ing to the master node works ok, however logs are full of the following info: "INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hadoopmaster/1