submitting map-reduce jobs without creating jar file ?

2008-04-22 Thread Tarandeep Singh
hi, Can I submit a map-reduce job without creating the jar file (and using $HADOOP_HOME/bin/hadoop script). I looked into the hadoop script and it is invoking org.apache.hadoop.util.RunJar class. Should I (or rather do I) have to do the same thing as this class is doing if I don't want to use the

Re: submitting map-reduce jobs without creating jar file ?

2008-04-22 Thread Ted Dunning
Grool might help you. It allows you to write full on java-based map-reduce programs using a very simple scripting interface. It has a jar with all of the code needed, but your scripts wouldn't have to be packaged into anything. As a scripting language, it is very easy to integrate and the map-

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Torsten Curdt
On Apr 23, 2008, at 00:31, Ted Dunning wrote: Grool might help you. Got a link? Google is not very helpful on the "Grool + Groovy" search. cheers -- Torsten

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Stuart Sierra
On Wed, Apr 23, 2008 at 4:43 AM, Torsten Curdt <[EMAIL PROTECTED]> wrote: > On Apr 23, 2008, at 00:31, Ted Dunning wrote: > > Grool might help you. > > Got a link? Google is not very helpful on the "Grool + Groovy" search. Try Grool + Hadoop: http://www.google.com/search?q=grool+hadoop -Stuart

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Ted Dunning
I haven't distributed it formally yet. If you would like a tarball, I would be happy to send it. On 4/23/08 1:43 AM, "Torsten Curdt" <[EMAIL PROTECTED]> wrote: > > On Apr 23, 2008, at 00:31, Ted Dunning wrote: > >> Grool might help you. > > Got a link? Google is not very helpful on the "Gro

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Doug Cutting
Ted Dunning wrote: I haven't distributed it formally yet. If you would like a tarball, I would be happy to send it. Can you attach it to a Jira issue? Then we can target it for a contrib module or somesuch. Doug

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Ted Dunning
Good idea. Done. On 4/23/08 9:31 AM, "Doug Cutting" <[EMAIL PROTECTED]> wrote: > Ted Dunning wrote: >> I haven't distributed it formally yet. >> >> If you would like a tarball, I would be happy to send it. > > Can you attach it to a Jira issue? Then we can target it for a contrib > module o

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Torsten Curdt
Ah, OK Well, bring it on :-) cheers -- Torsten On Apr 23, 2008, at 18:06, Ted Dunning wrote: I haven't distributed it formally yet. If you would like a tarball, I would be happy to send it. On 4/23/08 1:43 AM, "Torsten Curdt" <[EMAIL PROTECTED]> wrote: On Apr 23, 2008, at 00:31, Ted Du

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Ted Dunning
I need some advice/help on how it should be structured as a contrib module. On 4/23/08 9:31 AM, "Doug Cutting" <[EMAIL PROTECTED]> wrote: > Ted Dunning wrote: >> I haven't distributed it formally yet. >> >> If you would like a tarball, I would be happy to send it. > > Can you attach it to a J

Re: submitting map-reduce jobs without creating jar file ?

2008-04-23 Thread Ted Dunning
Just added it to Hadoop 2781. See here [ https://issues.apache.org/jira/browse/HADOOP-2781?page=com.atlassian.jira.pl ugin.system.issuetabpanels:all-tabpanel ] On 4/23/08 9:35 AM, "Torsten Curdt" <[EMAIL PROTECTED]> wrote: > Ah, OK > > Well, bring it on :-) > > cheers > -- > Torst