Thx to both respondents.
Note i've not tried this redirection as I have only production grids available.
Our grids are growing and with them, log volume.
As until now that log location has been in the same fs as the grid data,
so running out of space due log bloat is a growing problem.
From your replies, sounds like I can relocate my logs, Cool!
But now the tough question, if i set up a too small partition and it runs out
of space,
will my grid become unstable if hadoop can no longer write to its logs?
Thx again, jackc...
Jack Craig, Operations
CarrierIQ.comhttp://CarrierIQ.com
1200 Villa Ct, Suite 200
Mountain View, CA. 94041
650-625-5456
On Jun 22, 2011, at 1:09 PM, Harsh J wrote:
Jack,
I believe the location can definitely be set to any desired path.
Could you tell us the issues you face when you change it?
P.s. The env var is used to set the config property hadoop.log.dir
internally. So as long as you use the regular scripts (bin/ or init.d/
ones) to start daemons, it would apply fine.
On Thu, Jun 23, 2011 at 1:32 AM, Jack Craig
jcr...@carrieriq.commailto:jcr...@carrieriq.com wrote:
Hi Folks,
In the hadoop-env.sh, we find, ...
# Where log files are stored. $HADOOP_HOME/logs by default.
# export HADOOP_LOG_DIR=${HADOOP_HOME}/logs
is there any reason this location could not be a separate filesystem on the
name node?
Thx, jackc...
Jack Craig, Operations
CarrierIQ.comhttp://CarrierIQ.com
1200 Villa Ct, Suite 200
Mountain View, CA. 94041
650-625-5456
--
Harsh J
