Re: Cloudera Agent not starting

2015-03-13 Thread Ahmed Ossama
You are getting this error either because the agent cannot bind to the address assigned to the hostname nn1.amazonaws.com or the port 9000 is already in use. Check that nn1.amazonaws.com points to an IP address that is actually bound to the server. And check that no other processes are

Re: Apache Slider stop function not working

2015-03-13 Thread Ted Yu
Please see http://slider.incubator.apache.org/mailing_lists.html Let's continue discussion on the Slider dev mailing list. On Fri, Mar 13, 2015 at 11:13 AM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi, I am not aware of any Slider specific group, so I am posting it here.

Apache Slider stop function not working

2015-03-13 Thread Krishna Kishore Bonagiri
Hi, I am not aware of any Slider specific group, so I am posting it here. We are using Apache Slider 0.60 and implemented the management operations start, status, stop, etc. in python script. Everything else is working but the stop function is not getting invoked when the container is

Re: Cloudera Agent not starting

2015-03-13 Thread Mauro Schneider
Have you configured /etc/sysconfig/network ? I had the same issue without to configure it. Atenciosamente, Mauro Schneider 2015-03-12 14:39 GMT-03:00 Krish Donald gotomyp...@gmail.com: Firewall is not running [root@ec2-52-10-19-232 ~]# netstat -anp | grep 9000 [root@ec2-52-10-19-232

Can't find map or reduce logs when a job ends.

2015-03-13 Thread xeonmailinglist-gmail
Hi, With this configuration in mapreduce (see [1] and [2]), I can’t see the map and reduce logs of the job when it ends. When I try to look to the history, I get this error |Not Found: job_1426267326549_0005|. But if I list the log dir in the hdfs (see [3]), I have some logs about the job,

AWS Private and Public Ip

2015-03-13 Thread Krish Donald
Hi, I am using Elastic Ip Address and assigned Elastic Ip Address to the instances. After doing lot of trial and error , I could atleast install Cloudera Manager on AWS. But a very starnge thing I have notice, I am not sure if I am doing something wrong . When I have installed CM on AWS on an

Re: Cloudera Agent not starting

2015-03-13 Thread Krish Donald
I am using Elastic Ip Address and assigned Elastic Ip Address to the instances. After doing lot of trial and error , I could atleast install Cloudera Manager on AWS. But a very starnge thing I have notice, I am not sure if I am doing something wrong . When I have installed CM on AWS on an

Re: How to create hdfs directory or file in a cluster which was created using Cloudera manager

2015-03-13 Thread Sean Busbey
please ask vendor specific questions on the vendor's site. For problems with Cloudera Manager, that is http://community.cloudera.com/ On Fri, Mar 13, 2015 at 6:15 PM, Krish Donald gotomyp...@gmail.com wrote: Hi, I have create a cluster using Cloudera Manager. I have used id Hadoop while

Re: How to create hdfs directory or file in a cluster which was created using Cloudera manager

2015-03-13 Thread Krish Donald
I have asked vendor specific questions like cloudera in their community but I don't get any answers there. On Fri, Mar 13, 2015 at 7:26 PM, Sean Busbey bus...@cloudera.com wrote: please ask vendor specific questions on the vendor's site. For problems with Cloudera Manager, that is

Re: How to create hdfs directory or file in a cluster which was created using Cloudera manager

2015-03-13 Thread Sean Busbey
Hi Krish! While I could not find a posting that appeared to be from you about this, I did find this one that sounds like the same problem: http://tiny.cloudera.com/oqqzr If that is not your problem, please post a new topic over on the vendor site and send me a note off list. I will make sure

Re: AWS Private and Public Ip

2015-03-13 Thread max scalf
you will get the the private ip to work until and unless you are in your VPC connected to a VPN or a direct connect. For what you are doing, i would use the public IP that should work just fine. On Fri, Mar 13, 2015 at 3:00 PM, Krish Donald gotomyp...@gmail.com wrote: Hi, I am using Elastic

How to create hdfs directory or file in a cluster which was created using Cloudera manager

2015-03-13 Thread Krish Donald
Hi, I have create a cluster using Cloudera Manager. I have used id Hadoop while setting up cluster which has the name password on all the node. After installation while tried to list the Hadoop filesystem using Hadoop user, I am getting below uoutout: [hadoop@dn1 ~]$ hadoop fs -ls / -bash:

Re: Prune out data to a specific reduce task

2015-03-13 Thread xeonmailinglist-gmail
Hi, The only obstacle is to know to which partition the map output would go. 1 ~ From the map method, how can I know to which partition the output go? 2 ~ Can I call |getPartition(K key, V value, int numReduceTasks)| from the map function? Thanks, On 13-03-2015 03:25, Naganarasimha G R

Datanode Error

2015-03-13 Thread SP
Hi All, I am seeing these errors in my datanode logs. I see a case HDFS-2906 is still open in https://issues.apache.org/jira/browse/HDFS-2906 Did got fixed? did any one got these error and resolved it? can you please share any info ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: