Re: Want to unsubscibe myself

Hi, you have to send an e-mail from your mail account to: user-unsubscr...@hadoop.apache.org Btw: I would like to propose an automatic regular e-mail with some informations about this mailing list, e.g. with "how to unsubscribe" ;). Best wishes Wilm

HDFS balance

Hi, We have 11 nodes cluster. Every hour a cron job is started to upload one file( ~1GB) to Hadoop on node1. (plain hadoop fs -put) This way node1 is getting full because the first replica is always stored on the node where the command is executed. Every day i am running re-balance, but this seems

Re: HDFS balance

Better to create one client/gateway node(where no DN is running) and schedule your cron from that machine. Thanks & Regards, B Anil Kumar. On Wed, Sep 3, 2014 at 1:25 PM, Georgi Ivanov wrote: > Hi, > We have 11 nodes cluster. > Every hour a cron job is started to upload one file( ~1GB) to Hado

Re: Hadoop 2.0.0 stopping itself

The general@ mailing list is NOT for end-user questions and discussion. Please use the user@hadoop.apache.org mailing list for such issues. Please also read http://hadoop.apache.org/mailing_lists.html prior to posting emails here. As to your problem, you will need to look at your logs to determin

OEV - NameNode crash Edits file for 1.0.3

Hi My NameNode is crashed. It gave a NullPointerException at FsDirectory.addChild 1) My Hadoop version 1.0.3 2) I patched a code for identifying the files throwing NullPointerException - I found those files. 3) Now I want to remove those file operations in the edits file 4)

Unsubscribe

unsubscribe *Don Hilborn *Solutions Engineer, Hortonworks *Mobile: 832-444-5463* Email: *dhilb...@hortonworks.com * Website: *http://www.hortonworks.com/ * Hortonworks where business data becomes business insight

RE: HDFS balance

Can you run the load from an "edge node" that is not a DataNode? john John Lilley Chief Architect, RedPoint Global Inc. 1515 Walnut Street | Suite 300 | Boulder, CO 80302 T: +1 303 541 1516  | M: +1 720 938 5761 | F: +1 781-705-2077 Skype: jlilley.redpoint | john.lil...@redpoint.net | www.redpoint

RE: How can I increase the speed balancing?

I have also found that neither dfsadmin - setBalanacerBandwidth nor dfs.datanode.balance.bandwidthPerSec’ have any notable effect on apparent balancer rate. This is on Hadoop 2.2.0 john From: cho ju il [mailto:tjst...@kgrid.co.kr] Sent: Wednesday, September 03, 2014 12:55 AM To: user@hadoop.apac

Re: Unsubscribe

See http://hadoop.apache.org/mailing_lists.html Please send email to user-unsubscr...@hadoop.apache.org On Wed, Sep 3, 2014 at 5:23 AM, Don Hilborn wrote: > unsubscribe > *Don Hilborn *Solutions Engineer, Hortonworks > *Mobile: 832-444-5463 <832-444-5463>* > Email: *dhilb...@hortonworks.com *

Re: Hadoop 2.0.0 stopping itself

First of all, sorry for the inconvenience. Thanks for advice. I will check my logs. El 03/09/14 a las #4, Harsh J escribió: The general@ mailing list is NOT for end-user questions and discussion. Please use the user@hadoop.apache.org mailing list for such issues. Please also read http://hadoo

question about matching java API with libHDFS

hi, folks, I am currently using java to access HDFS. for example, I am using this API " DFSclient.getNamenode().getBlockLocations(...)..." to retrieve file block information. Now I need to move the same logic into C/C++. so I am looking at libHDFS, and this wiki page: http://wiki.apache.org/hadoo

StandbyCheckpointer: Exception in doCheckpoint

hadoop version 2.4.1 checkpoing fail ** namenode log, 2014-09-03 13:35:05,338 ERROR org.apache.hadoop.hdfs.server.namenode.ha.StandbyCheckpointer: Exception in doCheckpointjava.io.IOException: No image directories available!at org.apache.hadoop.hdfs.server.namenode.FSImage.saveFSImageInAllDir

Datanode can not start with error "Error creating plugin: org.apache.hadoop.metrics2.sink.FileSink"

hi,maillist: i have a 10-worknode hadoop cluster using CDH 4.4.0 , one of my datanode ,one of it's disk is full , when i restart this datanode ,i get error STARTUP_MSG: java = 1.7.0_45 / 2014-09-04 10:20:00,576 INFO org.apache.had

RE: How can I increase the speed balancing?

AFAIK, this setting is meant to throttle bandwidth usage by balancer so that the balancing traffic will not severely impact the performance of the running jobs. Increasing this value will show effect only when there is enough total available bandwidth on the network. On an already overloaded net