General Query : Master & DataNode start

Hi All, As part of my lab exercise i am doing a self study of Hadoop. i have cloned Master to 2 Datanodes as Datanode 1 and Datanode 2. Two Querys from Real Scenarios : 1. If Master is Up and running, DataNodes are stopped/suspended, will there be any communication channel from Datanode to

Re: Mismatch in length of source:

Hi I can't remember the exact error message but distcp consistently fails when trying to copy open files. Is it your case ? Workaround it to snapshot prior to copying Ulul On 31/12/2016 19:25, Aditya exalter wrote: Hi All, A very happy new year to ALL. I am facing issue while

Re: HDFS client with Knox

Hi all, Sorry for that bad quality post. I accidentally send a draft during my holidays (with a bad connexion). I will send you a detail message (in english) as soon as I can. I will update it with your answer. Regards, Philippe 2017-01-01 15:46 GMT+01:00 Ted Yu : > Can

Re: Heartbeat between RM and AM

Hi If you are thinking about allocation requests heartbeat calls from AM to RM, then its mostly driven per application level (not YARN specific config). For eg: in MapReduce, below config is used for same. yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms Thanks Sunil On Sat, Dec 31, 2016

Re: HDFS client with Knox

Hi Philippe is asking about using basing auth with knox and using SSL with webhdfs a) this is exactly what you do with your d) : you pass admin:admin-password credentials to knox, basic auth bing curl default. If your question is about knox authenticating to hdfs, that's normal : HDFS has