Re: 20 Newsgroups Example

[Jeff Eastman]

I enabled rlogin as Sean suggested and that got past the port 22 problem. I can ssh localhost, but I get this now:

jeff-eastmans-macbook-pro:hadoop-0.19.1 jeff$ bin/start-all.sh

localhost: Error: JAVA_HOME is not set.

localhost: Error: JAVA_HOME is not set.

localhost: Error: JAVA_HOME is not set.

JAVA_HOME is set, even when I ssh

Jeff


Grant Ingersoll wrote:

starting namenode, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-namenode-jeff-eastmans-macbook-pro.local.out localhost: starting datanode, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-datanode-jeff-eastmans-macbook-pro.local.out localhost: starting secondarynamenode, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-secondarynamenode-jeff-eastmans-macbook-pro.local.out starting jobtracker, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-jobtracker-jeff-eastmans-macbook-pro.local.out localhost: starting tasktracker, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-tasktracker-jeff-eastmans-macbook-pro.local.out

You need to have passphraseless SSH setup, even for localhost. See http://hadoop.apache.org/core/docs/current/quickstart.html and the section on Pseudo-Distributed Operation

HTH,
Grant

On Mar 20, 2009, at 1:48 PM, Jeff Eastman wrote:

jeff-eastmans-macbook-pro:hadoop-0.19.1 jeff$ bin/start-all.sh

localhost: ssh: connect to host localhost port 22: Connection refused
localhost: ssh: connect to host localhost port 22: Connection refused

localhost: ssh: connect to host localhost port 22: Connection refused

I'm using the out of the box config

Jeff

Grant Ingersoll wrote:

starting namenode, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-namenode-jeff-eastmans-macbook-pro.local.out starting jobtracker, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-jobtracker-jeff-eastmans-macbook-pro.local.out

What error do you get? And how are you running it? I am running on a Macbook just fine.

On Mar 20, 2009, at 11:12 AM, Jeff Eastman wrote:

Good, that works, and the wiki is the place to put the fix. I can't seem to actually bring up hadoop on my macbook (it runs in standalone mode but start-all fails for some port 22 connection-related issue that I don't understand) so I will have to bring up a cluster on EC2 for further testing. I'd like to test all of the examples in the next few days.

Jeff


Grant Ingersoll wrote:

OK, I've posted a workaround.  Give it a try.

On Mar 20, 2009, at 9:06 AM, Grant Ingersoll wrote:

On Mar 20, 2009, at 7:49 AM, Grant Ingersoll wrote:

One Maven command that comes in handy from time to time is: mvn dependencies:copy-dependencies. This will download all the project dependencies into your target directory, from which you can then add to a classpath.

Sorry, that should have been mvn dependency:copy-dependencies

People will probably find http://maven.apache.org/plugins/index.html helpful for knowing what goals are available.

PGP.sig
Description: PGP signature