Re: Anyone successfully run Hadoop in pseudo or cluster model under Cygwin?

2012-04-13 Thread Stephen Boesch
Hi Tim, Running in cygwin one encounters more bugs and often will get less support (since less people running cygwin) than running on native linux distros. So if you have a choice I'd not recommend it. If you do not have a choice then of course please wait for other responses on this ML. step

Re: UDF compiling

2012-04-12 Thread Stephen Boesch
HI try adding the directory in which WordCount.class was placed to the -classpath 4/12 Barry, Sean F > I am trying to compiling a customized WordCount UDF but I get this cannot > find symbol error when I compile. And I'm not sure how to resolve this > issue. > > hduser@master:~> javac -classp

Re: Hadoop Oppurtunity

2012-02-19 Thread Stephen Boesch
yes please, let's focus on the technical issues 2012/2/18 real great.. > Could we actually create a separate mailing list for Hadoop related jobs? > > On Sun, Feb 19, 2012 at 11:40 AM, larry wrote: > > > Hi: > > > > We are looking for someone to help install and support hadoop clusters. > > We

Re: Matrix multiplication in Hadoop

2011-11-19 Thread Stephen Boesch
Hi, there are two solutions suggested that take advantage of either (a) a vector x matrix (your CF / Mahout example ) or (b) a small matrix x large matrix (an earlier suggestion of putting the small matrix into the Distributed Cache). Not clear yet on good approaches of (c) large matrix x la

Suggestions on hadoop using virtualization on local hardware but can't use Hypervisor

2011-09-07 Thread Stephen Boesch
Hi I have been struggling a long time with how to set up a hadoop test environment with 6 to 10 nodes. I have some concerns about using S3/EC2 but have not ruled it out. Another direction is that I have set up a higher end box with the intent of using virtualization. The box is a core i7 2600

Re: Estimating Time required to compute M/Rjob

2011-04-16 Thread Stephen Boesch
uce stages - is the application using multiple chained M/R stages? Multi stage M/R's are more difficult to tune properly in terms of keeping all workers busy . That may be challenging to model. 2011/4/16 Stephen Boesch > You could consider two scenarios / set of requirements

Re: Estimating Time required to compute M/Rjob

2011-04-16 Thread Stephen Boesch
You could consider two scenarios / set of requirements for your estimator: 1. Allow it to 'learn' from certain input data and then project running times of similar (or moderately dissimilar) workloads. So the first steps could be to define a couple of relatively small "control" M/R jo

Re: Birthday Calendar

2011-04-11 Thread Stephen Boesch
Forum moderator: pls mark emails from this user as spam. 2011/4/10 Tiru Murugan > Hi > > I am creating a birthday calendar of all my friends and family. Can you > please click on the link below to enter your birthday for me? > > > http://www.birthdayalarm.com/bd2/86124361a478169686b1536202358c5

Re: running local hadoop job in windows

2011-04-05 Thread Stephen Boesch
o, I hoped that it is not absolutely necessary for that kind of > > use. > > > I > > > >> > am > > > >> > not even issuing the "hadoop -jar" command, but it is pure "java > > > -jar". > >

Re: How to insert some print codes into Hadoop?

2011-03-23 Thread Stephen Boesch
keep in mind for going that direction that aspectJ has limited support in some IDE's (e.g. intellij). can complicate the development. 2011/3/23 Konstantin Boudnik > [Moving to common-user@, Bcc'ing general@] > > If you know where you need to have your print statements you can use > AspectJ to do

Re: Hadoop Jar

2011-03-22 Thread Stephen Boesch
Hola Miguel, Wondering what "Main" method are you referring to that is "defined to run". Can you be specific? 2011/3/22 Miguel Costa > I already fixed, > > > > I had the Main class defined on my project . > > > > Even if I execute hadoop –jar myyjar.jar mymainClass > > mymainClass is never exec

Re: running local hadoop job in windows

2011-03-18 Thread Stephen Boesch
presumably you ran this under cygwin? 2011/3/18 Mark Kerzner > Hi, guys, > > I want to give my users a sense of what my hadoop application can do, and I > am trying to make it run in Windows, with this command > > java -jar dist\FreeEed.jar > > This command runs my hadoop job locally, and it wor