unable to resolve the heap space error even when running the examples

Hello, I have searched a lot and still cant find any solution that can fix my problem. I am using the the basic downloaded version of hadoop-1.0.2 and I have edited only what has been asked in the setup page of hadoop and I have set it up to work in a pseudo random distributed mode. My JAVA_HOME

Re: unable to resolve the heap space error even when running the examples

Try exporting HADOOP_HEAPSIZE to bigger value like 1500 (1.5 gb) before running program or change it in hadoop-env.sh If still gives error, u can try with bigger value. Sent from my iPhone On Apr 12, 2012, at 12:10 AM, "SRIKANTH KOMMINENI (RIT Student)" wrote: > Hello, > > I have searched

Re: unable to resolve the heap space error even when running the examples

Tried that it didn't work for a lot of combinations of values On Thu, Apr 12, 2012 at 3:25 AM, Mapred Learn wrote: > Try exporting HADOOP_HEAPSIZE to bigger value like 1500 (1.5 gb) before > running program or change it in hadoop-env.sh > > If still gives error, u can try with bigger value. > > S

Differences between hflush & hsync()

Folks, Can some one shed out more technical details than what the javadoc talks about. Also, which one should be used when? -- Thanks, - Inder Tech Platforms @Inmobi Linkedin - http://goo.gl/eR4Ub

Re: Differences between hflush & hsync()

In Hadoop 1.0 (from 0.20-append), there's just a single "sync(…)" output-stream call that does a metadata update to persist the data already written to the under-construction blocks and flushes the open file for the block at the DNs (but does *not* flush the file descriptor of the file at the OS le

Re: unable to resolve the heap space error even when running the examples

Can you show to us the logs of your NN/DN? On 04/12/2012 03:28 AM, SRIKANTH KOMMINENI (RIT Student) wrote: Tried that it didn't work for a lot of combinations of values On Thu, Apr 12, 2012 at 3:25 AM, Mapred Learn > wrote: Try exporting HADOOP_HEAPSIZE to b

Re: Differences between hflush & hsync()

Thanks Harsh. - inder On Thu, Apr 12, 2012 at 6:13 PM, Harsh J wrote: > In Hadoop 1.0 (from 0.20-append), there's just a single "sync(…)" > output-stream call that does a metadata update to persist the data > already written to the under-construction blocks and flushes the open > file for the b

Re: unable to resolve the heap space error even when running the examples

Can u share ur error also ? Sent from my iPhone On Apr 12, 2012, at 7:16 AM, Marcos Ortiz wrote: > Can you show to us the logs of your NN/DN? > > On 04/12/2012 03:28 AM, SRIKANTH KOMMINENI (RIT Student) wrote: >> >> Tried that it didn't work for a lot of combinations of values >> >> On Thu,

Re: unable to resolve the heap space error even when running the examples

The following is the error that i get bin/hadoop jar hadoop-examples-*.jar grep input output 'dfs[a-z.]+' 12/04/11 23:52:50 INFO util.NativeCodeLoader: Loaded the native-hadoop library 12/04/11 23:52:50 WARN mapred.JobClient: No job jar file set. User classes may not be found. See JobConf(Class

Re: unable to resolve the heap space error even when running the examples

Thanks your help , I finally am able to run my program and I still dont have a clue why I was having that issue. I just removed everything that had to do with hadoop and started working a fresh copy of hadoop and it just worked. On Thu, Apr 12, 2012 at 11:56 AM, SRIKANTH KOMMINENI (RIT Student) <

Question about «dfs.replication.considerLoad» property

Hi all, The property «dfs.replication.considerLoad» "Decide if chooseTarget considers the target's load or not"; but it works both in writing and in reading? or only during writing? Thanks Gianni

Re: Question about «dfs.replication.considerLoad» property

Hi Gianni, The property only affects replication _target_ choice. The source node for replication is chosen based on the policy described in the javadoc for BlockManager#chooseSourceDatanode. -Todd On Thu, Apr 12, 2012 at 7:40 AM, Giovanni Marzulli wrote: > Hi all, > > The property «dfs.replica