Re: Problem while installing Oozie

2011-01-20 Thread Alejandro Abdelnur
FYI, answered in the oozie-users@ alias: http://tech.groups.yahoo.com/group/Oozie-users/message/673 On Thu, Jan 20, 2011 at 7:15 PM, Giridhar Addepalli < giridhar.addepa...@komli.com> wrote: > Hi, > > > > I am using hadoop-0.20.2+228 version of hadoop. Want to use Oozie for > managing workflows.

RE: mapred.local.dir cleanup

2011-01-20 Thread rakesh kothari
Any ideas on how "attempt*" directories getting created directly under "mapred.local.dir" ? Pointers to parts of the source code would help too. Thanks, -Rakesh From: rkothari_...@hotmail.com To: mapreduce-user@hadoop.apache.org Subject: mapred.local.dir cleanup Date: Tue, 18 Jan 2011 17:20:04

Re: can one map instance handle many data of input paths at the same time

2011-01-20 Thread Harsh J
If you meant a single Mapper instance reading files/splits from those two sources, it should be doable too. > On Thu, Jan 20, 2011 at 1:52 AM, lei liu wrote: > > There are two input paths, example: /user/test1/ and /user/test2/ path. > > Can > > one map instance handle many data of input paths at

Multiplicative Model of Upscaling Several Machine Learning Algorithms on MapReduce/Hadoop

2011-01-20 Thread Song Liu
Dear all, First I apologize if this email goes to the wrong place, and I'll be appreciated if any one corrects me. I would like to introduce a new project "BigO" to you all. It is a set of tools that uses multiplicative methods to upscale several machine learning algorithms on MapR

Re: can one map instance handle many data of input paths at the same time

2011-01-20 Thread Owen O'Malley
As defined in http://hadoop.apache.org/mailing_lists.html , please send user questions to mapreduce-user@hadoop.apache.org. -- Owen On Jan 20, 2011, at 10:21 AM, Eric Sammer wrote: LiuLei: Yes. What you're looking for is TextInputFormat.addPath() (assuming you're talking about text). You

hadoop pipes C++ examples not reducing? [0.20.2]

2011-01-20 Thread David Fang
Hi, [re-sent from common-user, since I haven't seen any responses] New hadoop-0.20.2 user here. Following directions in the c++ dirs, I've succesfully built and installed the C++ hadooppipes and hadooputils libraries on Mac OS X 10.6 (via configure; make), and compiled the various wor

Re: How to reduce number of splits in DataDrivenDBInputFormat?

2011-01-20 Thread Sonal Goyal
Moving this offline from the list. Thanks and Regards, Sonal Connect Hadoop with databases, Salesforce, FTP servers and others Nube Technologies On Thu, Ja

Re: How to reduce number of splits in DataDrivenDBInputFormat?

2011-01-20 Thread Joan
Hi Sonal, I've downloaded hiho project and I can see that hiho's a DBInputAvroMapper.java very interesting. I want to read from DB using this Mapper and its Reducer can write serialize object too. How can I do? After I want create other job that its Mapper reads the output (serialize object) fro

Re: How to reduce number of splits in DataDrivenDBInputFormat?

2011-01-20 Thread Joan
Hi Sonal, I'm using hadoop 0.21.0 2011/1/20 Sonal Goyal > Which hadoop version are you on? > > You can alternatively try using hiho from > https://github.com/sonalgoyal/hiho to get your data from the db. Please > write to me directly if you need any help there. > > > Thanks and Regards, > Sona