Re: 20 Newsgroups Example

2009-03-20 Thread Sean Owen
(Hope it's OK to break the code freeze just to fix these:) The SL4FJ business -- perhaps related to the update to SLF4J 1.5.6. I discovered some references to 1.5.5 in a few places and fixed those. Update and try again. PriorityQueue: yeah shouldn't be used as a raw type. It seemed clear enough h

Re: 20 Newsgroups Example

2009-03-20 Thread Grant Ingersoll
Boy, I knew not porting it would bite me. I ran the first command, but not the second. The workaround, obviously, is to just get those things in the classpath. One Maven command that comes in handy from time to time is: mvn dependencies:copy-dependencies. This will download all the proj

GSOC Mentor

2009-03-20 Thread Grant Ingersoll
Hey Gang, The ASF has been accepted to participate in GSOC. If you want to be a mentor, you can now sign up to be one. Just choose to be a part of the ASF. http://socghop.appspot.com/program/home/google/gsoc2009 You should also subscribe to code-awa...@a.o for ASF specific info. Note, y

Re: 20 Newsgroups Example

2009-03-20 Thread Grant Ingersoll
On Mar 20, 2009, at 7:49 AM, Grant Ingersoll wrote: One Maven command that comes in handy from time to time is: mvn dependencies:copy-dependencies. This will download all the project dependencies into your target directory, from which you can then add to a classpath. Sorry, that shoul

Re: 20 Newsgroups Example

2009-03-20 Thread Grant Ingersoll
OK, I've posted a workaround. Give it a try. On Mar 20, 2009, at 9:06 AM, Grant Ingersoll wrote: On Mar 20, 2009, at 7:49 AM, Grant Ingersoll wrote: One Maven command that comes in handy from time to time is: mvn dependencies:copy-dependencies. This will download all the project depen

Re: [VOTE] Mahout 0.1

2009-03-20 Thread Grant Ingersoll
Just realized, I didn't add my +1, although it seems implied since I produced the candidate. Anyway, +1 -Grant On Mar 19, 2009, at 5:36 PM, Grant Ingersoll wrote: Please review and vote for releasing Mahout 0.1. This is our first release and is all new code. The artifacts in are located

Useful? Data Format reader

2009-03-20 Thread Grant Ingersoll
http://mloss.org/software/view/163/ License is ASF friendly.

Re: [VOTE] Mahout 0.1

2009-03-20 Thread Dawid Weiss
Hi guys. Not much activity from me -- really ashamed of it, but swamped in other duties. Anyway, downloaded mahout-0.1-project.tar.bz2 and (OpenSuSE 10.3): tar -jxf *.bz2 gives a warning: tar: A lone zero block at 14473 Running mvn:install (Maven 2.0.9) hangs for a long time on one of the t

Re: [VOTE] Mahout 0.1

2009-03-20 Thread Grant Ingersoll
On Mar 20, 2009, at 10:02 AM, Dawid Weiss wrote: Hi guys. Not much activity from me -- really ashamed of it, but swamped in other duties. Anyway, downloaded mahout-0.1- project.tar.bz2 and (OpenSuSE 10.3): tar -jxf *.bz2 gives a warning: tar: A lone zero block at 14473 I assume you ar

Re: [VOTE] Mahout 0.1

2009-03-20 Thread Dawid Weiss
tar: A lone zero block at 14473 I assume you are on a Mac? I get that too, but it always seems to be fine. Nope, it's OpenSuSE (Linux), 64-bit. I've seen these warnins with gzip and bzip-compressed tar files occasionally, but they never meant anything that would indicate data corruption.

Re: 20 Newsgroups Example

2009-03-20 Thread Jeff Eastman
Good, that works, and the wiki is the place to put the fix. I can't seem to actually bring up hadoop on my macbook (it runs in standalone mode but start-all fails for some port 22 connection-related issue that I don't understand) so I will have to bring up a cluster on EC2 for further testing.

Re: 20 Newsgroups Example

2009-03-20 Thread Grant Ingersoll
What error do you get? And how are you running it? I am running on a Macbook just fine. On Mar 20, 2009, at 11:12 AM, Jeff Eastman wrote: Good, that works, and the wiki is the place to put the fix. I can't seem to actually bring up hadoop on my macbook (it runs in standalone mode but sta

Re: 20 Newsgroups Example

2009-03-20 Thread Sean Owen
PS I did commit the fixes, so, if you update in SVN and it works, we know that was it. And if that's the case, I believe we'd want to include the fix in 0.1 if that's OK. It was very targeted and straightforward. On Fri, Mar 20, 2009 at 8:34 AM, Sean Owen wrote: > (Hope it's OK to break the code

Re: 20 Newsgroups Example

2009-03-20 Thread Jeff Eastman
jeff-eastmans-macbook-pro:hadoop-0.19.1 jeff$ bin/start-all.sh starting namenode, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-namenode-jeff-eastmans-macbook-pro.local.out localhost: ssh: connect to host localhost port 22: Connection refused localhost: ssh: connect to host

Re: 20 Newsgroups Example

2009-03-20 Thread Sean Owen
(Dumb question, you enabled ssh on your Mac? "Remote Login" in sharing?) On Fri, Mar 20, 2009 at 5:48 PM, Jeff Eastman wrote: > jeff-eastmans-macbook-pro:hadoop-0.19.1 jeff$ bin/start-all.sh > starting namenode, logging to > /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-namenode-jeff-e

Re: GSOC Mentor

2009-03-20 Thread Grady Laksmono
Hi guys, I'm actually interested with your project. I haven't started my proposal yet, because I'm still working on my finals now, I'll be writing it soon and let you guys know any updates. But I'm generally interested this idea: http://wiki.apache.org/general/SummerOfCode2008#lucene I had Machin

Re: 20 Newsgroups Example

2009-03-20 Thread Grant Ingersoll
You need to have passphraseless SSH setup, even for localhost. See http://hadoop.apache.org/core/docs/current/quickstart.html and the section on Pseudo-Distributed Operation HTH, Grant On Mar 20, 2009, at 1:48 PM, Jeff Eastman wrote: jeff-eastmans-macbook-pro:hadoop-0.19.1 jeff$ bin/start-a

Re: 20 Newsgroups Example

2009-03-20 Thread Jeff Eastman
I enabled rlogin as Sean suggested and that got past the port 22 problem. I can ssh localhost, but I get this now: jeff-eastmans-macbook-pro:hadoop-0.19.1 jeff$ bin/start-all.sh starting namenode, logging to /Users/jeff/hadoop/hadoop-0.19.1/bin/../logs/hadoop-jeff-namenode-jeff-eastmans-macbook

Re: 20 Newsgroups Example

2009-03-20 Thread Sean Owen
I export JAVA_HOME in my ~/.profile file to make sure it's available even for non-login shells, perhaps that does it? not sure. (I am not a bash expert so the above might not be optimal.)

Re: 20 Newsgroups Example

2009-03-20 Thread Jeff Eastman
The NameNode and JobTracker start ok, but the DataNode and SecondaryNameNode have the java problem Jeff Eastman wrote: * PGP Signed: 03/20/09 at 11:28:38 Sean Owen wrote: I export JAVA_HOME in my ~/.profile file to make sure it's available even for non-login shells, perhaps that does it? not

Re: 20 Newsgroups Example

2009-03-20 Thread Jeff Eastman
Sean Owen wrote: I export JAVA_HOME in my ~/.profile file to make sure it's available even for non-login shells, perhaps that does it? not sure. (I am not a bash expert so the above might not be optimal.) I have a similar export in my .bash_profile file, and when I to ssh localhost the JAV

Re: 20 Newsgroups Example

2009-03-20 Thread Ted Dunning
ssh with a command does not log in, but instead works like a subshell command. Try [ssh localhost env | grep JAVA]. That may give different results than ssh to localhost with an interactive shell. On Fri, Mar 20, 2009 at 11:28 AM, Jeff Eastman wrote: > Sean Owen wrote: > >> I export JAVA_HOME i

Re: 20 Newsgroups Example

2009-03-20 Thread Sean Owen
Ah, solution -- add this to .bashrc, not .profile. That's the one bash uses for non-interactive shells. Now I remember. On Fri, Mar 20, 2009 at 7:15 PM, Ted Dunning wrote: > ssh with a command does not log in, but instead works like a subshell > command. > > Try [ssh localhost env | grep JAVA].  

Re: Useful? Data Format reader

2009-03-20 Thread Ted Dunning
Cool. Their heart is definitely in the right place. The code appears very, very new as of now and they are working on different kinds of stuff than we are. On Fri, Mar 20, 2009 at 6:52 AM, Grant Ingersoll wrote: > http://mloss.org/software/view/163/ > > License is ASF friendly. > -- Ted Dun

Re: 20 Newsgroups Example

2009-03-20 Thread Jeff Eastman
I'm out of my depth here. I'm just using the default OS-X bash shell and it uses .bash_profile not .bashrc. I tried creating .bashrc and it did not solve the problem that Ted's snippet verified: ssh localhost env | grep JAVA returns nothing. Jeff Sean Owen wrote: Ah, solution -- add this to

Re: 20 Newsgroups Example

2009-03-20 Thread Ted Dunning
This might help even more: Additionally, ssh reads ~/.ssh/environment, and adds lines of the format ``VARNAME=value'' to the environment if the file exists and users are allowed to change their environment. For more information, see the PermitUserEnvironment option in sshd_co

Re: 20 Newsgroups Example

2009-03-20 Thread Ted Dunning
Does this part of the manual for bash help? When bash is started non-interactively, to run a shell script, for example, it looks for the variable BASH_ENV in the environment, expands its value if it appears there, and uses the expanded value as the name of a file