Re: Message in mapreduce class not logged

I notice that the job message indeed gets logged in the userlogs dir, where contains sys* files. Thanks for help. On Wed, Feb 23, 2011 at 9:02 PM, Harsh J wrote: > The logs should appear in each of the ReduceTask's log. Are they not > appearing in them? > > On Wed, Feb 23, 2011 at 6:27 PM, Thoma

Re: WholeFileInputFormat

Hi, On Fri, Feb 25, 2011 at 4:31 AM, Mohamed Riadh Trad wrote: > Dear All, > Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api? 1. Create new class extending FileInputFormat (or its other derivatives) 2. Override isSplitable to return false. 3. Provide a record reader accordin

Re: Change the storage directory.

Hi, On Fri, Feb 25, 2011 at 6:02 AM, real great.. wrote: > >   dfs.data.dir There's also dfs.name.dir for the NameNode's image (which would go to default ${hadoop.tmp.dir} if unset). -- Harsh J www.harshj.com

Re: Change the storage directory.

Did you try running the stop and start scripts ? On Thu, Feb 24, 2011 at 4:32 PM, real great.. wrote: > Hi, > As i guess, Hadoop creates the default dfs in temp directory. > I tried changing it by editing the hdfs-site.xml to: > ?xml version="1.0"?> > > > > > > > dfs.replication > 2

Change the storage directory.

Hi, As i guess, Hadoop creates the default dfs in temp directory. I tried changing it by editing the hdfs-site.xml to: ?xml version="1.0"?> dfs.replication 2 dfs.data.dir /home/supreme/hdfs Comma separated list of paths on the local filesystem of a DataNode where it shou

WholeFileInputFormat

Dear All, Has anyone wrote the WholeFileInputFormat with the hadoop 0.20.2 api? Best Regards, Trad Mohamed Riadh, M.Sc, Ing. PhD. student INRIA-TELECOM PARISTECH Office: 11-15 Phone: (33)-1 39 63 59 33 Fax: (33)-1 39 63 56 74 Email: riadh.t...@inria.fr Home page: http://www-rocq.inria.fr/who/M

Re: error: UNRESOLVED DEPENDENCIES

Not sure, but you could try to execute ant clean clean-cache mvn-install in the common project before. This would install the common artifacet into the local ivy repo. Johannes On Feb 24, 2011, at 3:49 PM, 祝美祺 wrote: > Thanks, > i don't think so . i can visit > http://repo1.maven.org

Re: error: UNRESOLVED DEPENDENCIES

Thanks, i don't think so . i can visit http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-common/0.21.0/but there is no file hadoop-common-0.21.0.pom

Re: error: UNRESOLVED DEPENDENCIES

GFW, you knew that. On Thu, Feb 24, 2011 at 9:43 PM, 祝美祺 wrote: > when i try to compile mapred of 0.21.0 > > I got error: > > [ivy:resolve] :: problems summary :: > [ivy:resolve] WARNINGS > [ivy:resolve] module not found: org.apache.hadoop#hadoop-common;0.21.0 > [ivy:resolve] apache-sn

error: UNRESOLVED DEPENDENCIES

when i try to compile mapred of 0.21.0 I got error: [ivy:resolve] :: problems summary :: [ivy:resolve] WARNINGS [ivy:resolve] module not found: org.apache.hadoop#hadoop-common;0.21.0 [ivy:resolve] apache-snapshot: tried [ivy:resolve]https://repository.apache.org/content/repositories/sna