Re: DataNode not recognising available disk space

Hi Yusaku, Thank you for your reply, unfortunately that's not the problem - the new slave node has a single drive, so is using the default data directory path. I'll post this to the Ambari list. Regards, Charles On 16 September 2014 23:12, Yusaku Sako yus...@hortonworks.com wrote: Charles,

Re: hadoop cluster crash problem

virtualbox is known for causing instabilities in the host-kernel (or at least, it used to). You might be better off asking for support there: https://www.virtualbox.org/wiki/Bugtracker - André On Wed, Sep 17, 2014 at 4:25 AM, Li Li fancye...@gmail.com wrote: hi all, I know it's not a

Data migration from hbase 0.90 to hbase 0.98

Hello there, I’m wondering if anyone knows how to move tables in hbase 0.90 to hbase 0.98? I did export on hbase 0.90 and import to hbase 0.98. However it throws exception like java.lang.Exception: java.io.IOException: keyvalues=NONE read 2 bytes, should read 143121 at

ClassCastException on running map-reduce jobs + tests on Windows (mongo-hadoop)

Hi! I am getting some CCE and don´t really understand why... Here my mapper: public class AveragePriceMapper extends MapperString, BSONObject, String, BSONObject{ @Override public void map(final String key, final BSONObject val, final Context context) throws IOException,

AW: ClassCastException on running map-reduce jobs + tests on Windows (mongo-hadoop)

Hi again, I changed the String objects with org.apache.hadoop.io.Text objects (why is String not accepted?), and now I get another exception, so I don´t really know if I solved something or I broke something: java.lang.Exception: java.lang.NullPointerException at

Re: ClassCastException on running map-reduce jobs + tests on Windows (mongo-hadoop)

Can you provide the driver code for this job? Regards, Shahab On Wed, Sep 17, 2014 at 10:28 AM, Blanca Hernandez blanca.hernan...@willhaben.at wrote: Hi again, I changed the String objects with org.apache.hadoop.io.Text objects (why is String not accepted?), and now I get another exception,

AW: ClassCastException on running map-reduce jobs + tests on Windows (mongo-hadoop)

Thanks for answering: hadoop jar /tmp/hadoop-test.jar at.willhaben.hadoop.AveragePriceCalculationJob In the AveragePriceCalculationJob I have my configuration: private static class AveragePriceCalculationJob extends MongoTool { private AveragePriceCalculationJob(AveragePriceNode

Re: ClassCastException on running map-reduce jobs + tests on Windows (mongo-hadoop)

You String as the outputKey (). java.lang.String is not Writable. Change it to Text just like you did for the Mapper. Regards, Shahab On Wed, Sep 17, 2014 at 10:43 AM, Blanca Hernandez blanca.hernan...@willhaben.at wrote: Thanks for answering: hadoop jar /tmp/hadoop-test.jar

YARN ResourceManager Hostname in HA configuration

How do I configure the “yarn.resourcemanager.hostname” property when in an HA configuration? It seems that this property will configure how the UI knits together the node/application/timeline/etc UIs into a seamless experience. The issue I come across is that this property seems to only

Map Reduce Job is reported as complete on history server while on console it shows as only half way thru

Hi All, I am running a MRV1 job on Hadoop YARN 2.3.0 cluster , the problem is when I submit this job YARN the application that is running in YARN is marked as complete even as on console its reported as only 58% complete . I have confirmed that its also not printing the log statements that its

Re: Map Reduce Job is reported as complete on history server while on console it shows as only half way thru

Is it possible that the client JVM is somehow getting killed while the YARN application finishes as usual on the cluster in the background? +Vinod On Wed, Sep 17, 2014 at 9:29 AM, S.L simpleliving...@gmail.com wrote: Hi All, I am running a MRV1 job on Hadoop YARN 2.3.0 cluster , the

Re: Map Reduce Job is reported as complete on history server while on console it shows as only half way thru

I am not sure, I running a sequence of MRV1 jobs using a bash script , this seems to happen in the 4th iteration consistently, how do I confirm this possibility? On Wed, Sep 17, 2014 at 1:34 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Is it possible that the client JVM is somehow

Re: Map Reduce Job is reported as complete on history server while on console it shows as only half way thru

I don't see any hs_err file in the current directory , so I don't think that is the case. On Wed, Sep 17, 2014 at 2:21 PM, S.L simpleliving...@gmail.com wrote: I am not sure, I running a sequence of MRV1 jobs using a bash script , this seems to happen in the 4th iteration consistently, how do

hadoop archive impact on hbase performance

Dear All, Recently I observe that whenever Hadoop archive is running, all HBase insert (put) will slow down, from average 0.001 to 0.023, that is 23x times slower. I wonder if there a way to slow down the archive process? Like restrict read / write buffer? One of the restriction already

Re: YARN ResourceManager Hostname in HA configuration

I observed in Yarn Cluster, you set these properties yarn.resourcemanager.hostname.rm-id1 yarn.resourcemanager.hostname.rm-id2 not yarn.resourcemanager.hostname. On 9/17/14, Matt Narrell matt.narr...@gmail.com wrote: How do I configure the “yarn.resourcemanager.hostname” property when in an