spark history server trying to hit port 8021

2014-09-03 Thread Greg Hill
My Spark history server won't start because it's trying to hit the namenode on 
8021, but the namenode is on 8020 (the default).  How can I configure the 
history server to use the right port?  I can't find any relevant setting on the 
docs: http://people.apache.org/~tdas/spark-1.0.0-rc11-docs/monitoring.html

Greg


Re: spark history server trying to hit port 8021

2014-09-03 Thread Greg Hill
Nevermind, PEBKAC.  I had put in the wrong port in the $LOG_DIR environment 
variable.

Greg

From: Greg greg.h...@rackspace.commailto:greg.h...@rackspace.com
Date: Wednesday, September 3, 2014 1:56 PM
To: user@spark.apache.orgmailto:user@spark.apache.org 
user@spark.apache.orgmailto:user@spark.apache.org
Subject: spark history server trying to hit port 8021

My Spark history server won't start because it's trying to hit the namenode on 
8021, but the namenode is on 8020 (the default).  How can I configure the 
history server to use the right port?  I can't find any relevant setting on the 
docs: http://people.apache.org/~tdas/spark-1.0.0-rc11-docs/monitoring.html

Greg


Re: spark history server trying to hit port 8021

2014-09-03 Thread Andrew Or
Hi Greg,

For future references you can set spark.history.ui.port in
SPARK_HISTORY_OPTS. By default this should point to 18080. This information
is actually in the link that you provided :) (as well as the most updated
docs here: http://spark.apache.org/docs/latest/monitoring.html)

-Andrew


2014-09-03 12:14 GMT-07:00 Greg Hill greg.h...@rackspace.com:

  Nevermind, PEBKAC.  I had put in the wrong port in the $LOG_DIR
 environment variable.

  Greg

   From: Greg greg.h...@rackspace.com
 Date: Wednesday, September 3, 2014 1:56 PM
 To: user@spark.apache.org user@spark.apache.org
 Subject: spark history server trying to hit port 8021

   My Spark history server won't start because it's trying to hit the
 namenode on 8021, but the namenode is on 8020 (the default).  How can I
 configure the history server to use the right port?  I can't find any
 relevant setting on the docs:
 http://people.apache.org/~tdas/spark-1.0.0-rc11-docs/monitoring.html

  Greg