Re: Job status shows 0's for counters

2013-09-03 Thread Shinichi Yamashita
Hi, I reported this issue in MAPREDUCE-5376 (https://issues.apache.org/jira/browse/MAPREDUCE-5376) and attached a patch. But it is not fixed by the current release. Thanks, Shinichi (2013/09/03 11:20), Robert Dyer wrote: I just noticed the job status for MR jobs tends to show 0's in the Map

How to control of the output of /stacks

2013-07-12 Thread Shinichi Yamashita
Hi, I can see the stack trace of the node when I access /stacks of Web UI. And stack trace is output in the log file of the node, too. Because the expansion of the log file and hard to see it, I don't want to output it in a log file. Is there the method to solve this problem? Regards, Shinichi

Re: About connection to NameNode in NameNode-HA

2012-11-04 Thread Shinichi Yamashita
in the configuration. We currently do write StandybException into the standby's logs, but I think it's a good idea for an improvement to remove that, since it is an expected exception and could cause too much log spew. Want to submit a patch? -Todd On Thu, Nov 1, 2012 at 8:44 AM, Shinichi Yamashita shin1

About connection to NameNode in NameNode-HA

2012-11-01 Thread Shinichi Yamashita
Hi, I write hdfs-site.xml of all nodes as follows in NameNode-HA. -- ... snip ... property namedfs.namenode.rpc-address.ns.nn1/name valuenn1:8020/value /property property namedfs.namenode.rpc-address.ns.nn2/name valuenn2:8020/value /property property

Re: How to change topology

2012-10-10 Thread Shinichi Yamashita
Loughran ste...@hortonworks.comwrote: On 9 October 2012 16:51, Shinichi Yamashita shin1...@gmail.com wrote: Hi Steve, Thank you for your reply. no, it's the Namenode and JobTracker that needs to be restarted; they are the bits that care where the boxes are. I confirmed it in my cluster

Re: How to change topology

2012-10-09 Thread Shinichi Yamashita
node toplogy decision, HashMap data is given priority to over a script. The HashMap data become invalid by restart of NameNode and JobTracker. Regards, Shinichi 2012/10/9 Steve Loughran ste...@hortonworks.com On 8 October 2012 14:23, Shinichi Yamashita shin1...@gmail.com wrote: Hi, I know

How to change topology

2012-10-08 Thread Shinichi Yamashita
Hi, I know that DataNode and TaskTracker must restart to change topology. Is there the method to execute the topology change without restart of DataNode and TaskTracker? In other words, can I change the topology by a command? Thanks in advance! Shinichi

JobClient hangs-up in getTaskLogs

2010-11-13 Thread Shinichi YAMASHITA
are applied to 0.21.0 and CDH2. 2. Property mapreduce.client.output.filter is changed into NONE (However, FAILED-tasklog disappears from JobClient). Regards, Shinichi YAMASHITA