Re: How to configure mapreduce archive size?

2013-04-18 Thread Hemanth Yamijala
** ** *From:* Hemanth Yamijala [mailto:yhema...@thoughtworks.com] *Sent:* Wednesday, April 17, 2013 9:11 PM *To:* user@hadoop.apache.org *Subject:* Re: How to configure mapreduce archive size? ** ** The check for cache file cleanup is controlled by the property

RE: How to configure mapreduce archive size?

2013-04-17 Thread Xia_Yang
again. Thanks, Jane From: Hemanth Yamijala [mailto:yhema...@thoughtworks.com] Sent: Tuesday, April 16, 2013 9:35 PM To: user@hadoop.apache.org Subject: Re: How to configure mapreduce archive size? You can limit the size by setting local.cache.size in the mapred-site.xml (or core-site.xml

Re: How to configure mapreduce archive size?

2013-04-17 Thread Hemanth Yamijala
, ** ** Jane ** ** *From:* Hemanth Yamijala [mailto:yhema...@thoughtworks.com] *Sent:* Tuesday, April 16, 2013 9:35 PM *To:* user@hadoop.apache.org *Subject:* Re: How to configure mapreduce archive size? ** ** You can limit the size by setting local.cache.size in the mapred-site.xml

RE: How to configure mapreduce archive size?

2013-04-16 Thread Xia_Yang
/archive. Could you help? Thanks. Xia From: Hemanth Yamijala [mailto:yhema...@thoughtworks.com] Sent: Thursday, April 11, 2013 9:09 PM To: user@hadoop.apache.org Subject: Re: How to configure mapreduce archive size? TableMapReduceUtil has APIs like addDependencyJars which will use

Re: How to configure mapreduce archive size?

2013-04-16 Thread Hemanth Yamijala
** ** *From:* Hemanth Yamijala [mailto:yhema...@thoughtworks.com] *Sent:* Thursday, April 11, 2013 9:09 PM *To:* user@hadoop.apache.org *Subject:* Re: How to configure mapreduce archive size? ** ** TableMapReduceUtil has APIs like addDependencyJars which will use DistributedCache. I

Re: How to configure mapreduce archive size?

2013-04-11 Thread Hemanth Yamijala
*From:* Hemanth Yamijala [mailto:yhema...@thoughtworks.com] *Sent:* Monday, April 08, 2013 9:09 PM *To:* user@hadoop.apache.org *Subject:* Re: How to configure mapreduce archive size? Hi, This directory is used as part of the 'DistributedCache' feature

Re: How to configure mapreduce archive size?

2013-04-11 Thread Hemanth Yamijala
...@thoughtworks.com] *Sent:* Thursday, April 11, 2013 12:29 AM *To:* user@hadoop.apache.org *Subject:* Re: How to configure mapreduce archive size? ** ** Could you paste the contents of the directory ? Not sure whether that will help, but just giving it a shot. ** ** What application

RE: How to configure mapreduce archive size?

2013-04-10 Thread Xia_Yang
:09 PM To: user@hadoop.apache.org Subject: Re: How to configure mapreduce archive size? Hi, This directory is used as part of the 'DistributedCache' feature. (http://hadoop.apache.org/docs/r1.0.4/mapred_tutorial.html#DistributedCache). There is a configuration key local.cache.size which controls

Re: How to configure mapreduce archive size?

2013-04-10 Thread Arun C Murthy
Subject: Re: How to configure mapreduce archive size? Hi, This directory is used as part of the 'DistributedCache' feature. (http://hadoop.apache.org/docs/r1.0.4/mapred_tutorial.html#DistributedCache). There is a configuration key local.cache.size which controls the amount of data

RE: How to configure mapreduce archive size?

2013-04-10 Thread Xia_Yang
-default.xml, which is in hadoop-core-1.0.3.jar Thanks, Jane From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: Wednesday, April 10, 2013 2:45 PM To: user@hadoop.apache.org Subject: Re: How to configure mapreduce archive size? Ensure no jobs are running (cache limit is only for non-active

How to configure mapreduce archive size?

2013-04-08 Thread Xia_Yang
Hi, I am using hadoop which is packaged within hbase -0.94.1. It is hadoop 1.0.3. There is some mapreduce job running on my server. After some time, I found that my folder /tmp/hadoop-root/mapred/local/archive has 14G size. How to configure this and limit the size? I do not want to waste my

Re: How to configure mapreduce archive size?

2013-04-08 Thread Hemanth Yamijala
Hi, This directory is used as part of the 'DistributedCache' feature. ( http://hadoop.apache.org/docs/r1.0.4/mapred_tutorial.html#DistributedCache). There is a configuration key local.cache.size which controls the amount of data stored under DistributedCache. The default limit is 10GB. However,

Re: How to configure mapreduce archive size?

2013-03-31 Thread Ted Yu
-- View this message in context: http://apache-hbase.679495.n3.nabble.com/How-to-configure-mapreduce-archive-size-tp4040488p4041237.html Sent from the HBase User mailing list archive at Nabble.com.