Re: Heartbeat between RM and AM
Hi Sunil, Thank you for your reply. I don't mean the heartbeat interval. Based on my knowledge, the AM report a job's progress every t ms, so I need to add more info to the messages between the AM and RM. On Mon, Jan 2, 2017 at 4:56 AM, Sunil Govind wrote: > Hi > > If you are thinking about allocation requests heartbeat calls from AM to > RM, then its mostly driven per application level (not YARN specific > config). For eg: in MapReduce, below config is used for same. > yarn.app.mapreduce.am.scheduler.heartbeat.interval-ms > > Thanks > Sunil > > > On Sat, Dec 31, 2016 at 8:20 AM Sultan Alamro > wrote: > >> Hi all, >> >> Can any one tell me how I can modify the heartbeat between the RM and AM? >> I need to add new requests to the AM from the RM. >> >> These requests basically are values calculated by the RM to be used by >> the AM online. >> >> Thanks, >> Sultan >> >
Re: Why is the size of a HDFS file changed?
Is there a carriage return / new line / some other whitespace which `cat` may be appending? On Thu, Jan 5, 2017 at 6:09 PM, Mungeol Heo wrote: > Hello, > > Suppose, I name the HDFS file which cause the problem as A. > > hdfs dfs -ls A > -rw-r--r-- 3 web_admin hdfs 868003931 2017-01-04 09:05 A > > hdfs dfs -get A AFromGet > hdfs dfs -cat A > AFromCat > > ls -l > -rw-r--r-- 1 hdfs hadoop 883715443 Jan 5 18:32 AFromGet > -rw-r--r-- 1 hdfs hadoop 883715443 Jan 5 18:32 AFromCat > > hdfs dfs -put AFromGet > > diff <(hdfs dfs -cat A) <(hdfs dfs -cat AFromGet) > (no output, which means the contents of two files are same. At least, > after "cat") > > hdfs dfs -checksum A > A MD5-of-262144MD5-of-512CRC32C > 0204e667fb4f0dda78101feb2b689af8260b > > hdfs dfs -checksum AFromGet > AFromGet MD5-of-262144MD5-of-512CRC32C > 02047284759249ff98c7395e6a4bb59343dc > > As I listed some results above. I wonder why is the size of the file > changed. > Any help will be GREAT! > > Thank you. > > - > To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org > For additional commands, e-mail: user-h...@hadoop.apache.org > >
