RE: how to install and distribute master services in 4 nodes.

2014-04-07 Thread Alex Lee
hi Olivier, With totally 4 nodes(PC), I tried to put all master services into one node. And with all the 4 nodes, tried to put as datanode and installed client as the attached screen.http://postimg.org/image/fflx6tpmz/ In installation, only the 4th node is completely installed. others all

RE: how to install and distribute master services in 4 nodes.

2014-04-07 Thread Olivier Renault
Moving thread to Ambari user ML. What are the errors? FYI, there should be no conflicts in between services. You can even installed a single node cluster with all services running on one node. Kind regards Olivier On 7 Apr 2014 10:20, Alex Lee eliy...@hotmail.com wrote: hi Olivier, With

Re: Connect a node in virtual machine with other nodes inphysicalmachine with port forwarding

2014-04-07 Thread GHui
I see. You can buy a router. And use router with your student account to login. Your colleage will guide you. -- Original -- From: Chau Yee Cheung;joyeec...@gmail.com; Date: Sun, Apr 6, 2014 10:59 PM To: useruser@hadoop.apache.org; Subject: Re: Connect

Cleanup activity on YARN containers

2014-04-07 Thread Krishna Kishore Bonagiri
Hi, Is there any callback kind of facility, in which I can write some code to be executed on my container at the end of my application or at the end of that particular container execution? I want to do some cleanup activities at the end of my application, and the clean up is not related to

Re: Eclipse-Plugin

2014-04-07 Thread P lva
Is that the only way out. I wasn't looking to run EMR jobs, but was under the opinion that you could submit jobs to remote cluster through eclipse. On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte drdwi...@gmail.com wrote: Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I

Re: Connect a node in virtual machine with other nodes inphysicalmachine with port forwarding

2014-04-07 Thread Chau Yee Cheung
The problem is, we live in different dormitories, so I don't know how to use a router to make things better... But today I went to the lab and found out that we can pick any IP if we use the network there, though we managed to connect the machines together without using brigded mode anyway(The

Re: customize containter-log4j.properties

2014-04-07 Thread Federico Baldo
Thank you for the feedback on that. Though I don't understand why the container-log4j.properties should be included in the hadoop-yarn-server-nodemanager and not as a standard configuration file in the configuration directory, is there any specific requirements for this config file that I'm

Re: Exception in createBlockOutputStream trying to start application

2014-04-07 Thread Murillo Flores
Thanks for your answer Azuryy. Do you know any configuration that we could tune to be more permissive with this errors? I'm not sure that 'dfs.client.block.write.retries' will serve this purpose. 2014-04-04 19:44 GMT-03:00 Azuryy azury...@gmail.com: Hi Mirillo, Generally EOF error was

Container is hung and never be killed

2014-04-07 Thread Anfernee Xu
Hi, I'm running Hadoop cluster in 2.2.0 release, I encounter one issue in which one container is never killed/clean up. What I'm doing is we set mapreduce.task.timeout to 4 hours and due to some bug in one 3rdparty library, the task stuck somewhere and cannot make any progress, I'm hoping is that

RE: Cleanup activity on YARN containers

2014-04-07 Thread Rohith Sharma K S
Hi Kishore, Is jobs are submitted through MapReduce or Is it Yarn Application? 1. For MapReduce Framwork, framework itself provides facility to clean up per task level. Is there any callback kind of facility, in which I can write some code to be executed on my