Re: queries regarding hadoop DFS

I do get benefited by rack-awareness > in the cluster? > ​With you ambition, hire or employ an expert for the cluster setup. The configuration is ​quite simple, the network configuration on nodes are more complexe (to have enough bandwidth with bonding) : https://hadoop.apache.org/docs/r2.7.

Re: HDFS: Confused about "immutability" wrt overwrites

uration option which enables this sort of behaviour? Or am I > chasing a pipe dream? > > Thanks, > > - Bram > > - > To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org > For additional commands,

Re: YARN - How is a node for a container determined?

iner? >> >> Is this tunable? I'd like to densely pack containers on fewer nodes. >> >> A pointer to source code would be nice. >> >> > -- Philippe Kernévez Directeur technique (Suisse), pkerne...@octo.com +41 79 888 33 32 Retrouvez OCTO sur OCTO Talk : http://blog.octo.com OCTO Technology http://www.octo.ch

Re: Disk maintenance

Hadoop components? > > > > Adaryl "Bob" Wakefield, MBA > Principal > Mass Street Analytics, LLC > 913.938.6685 <(913)%20938-6685> > > www.massstreet.net > > www.linkedin.com/in/bobwakefieldmba > Twitter: @BobLovesData <http://twitter.com/B

Re: Disk maintenance

> > tmpfs3.1G 0 3.1G 0% /run/user/1018 > > tmpfs3.1G 0 3.1G 0% /run/user/1002 > > tmpfs3.1G 0 3.1G 0% /run/user/1009 > > > > Adaryl "Bob" Wakefield, MBA > Principal > M

Re: Active Name Nodes behavior difference in HA Cluster

t; worry about > > notice2:there are no difference between two active name nodes performance > if we issue hdfs commands the difference only in webhdfs interface requests > (in curl requests) > > what could be possible reasons of this difference in performance between > two act

Re: Disk maintenance

t; > I'm running Hortonworks Data Platform 2.5 with HDFS 2.7.3 on CENTOS 7. I > thought it might be a Linux issue but the problem is clearly confined to > the parts of the disk taken up by HDFS. > > > > Adaryl "Bob" Wakefield, MBA > Principal > Mass Street Analytics, LLC > 913.938.6685 <(913)%20938-6685> > > www.massstreet.net > > www.linkedin.com/in/bobwakefieldmba > Twitter: @BobLovesData <http://twitter.com/BobLovesData> > > > > > -- Philippe Kernévez Directeur technique (Suisse), pkerne...@octo.com +41 79 888 33 32 Retrouvez OCTO sur OCTO Talk : http://blog.octo.com OCTO Technology http://www.octo.ch

Re: Ensure High Availability of Datanodes in a HDFS cluster

supergroup 2576 2017-06-29 08:33 > /topics/testTopic/year=2017/month=06/day=29/hour=14/testTopic+23+0001236477+0001236499 > > P.S. - My records are written on HDFS by Confluent Kafka Connect HDFS Sink > Connector. > > > Thanks > > Nishant > -- Philippe Kernévez Directeur technique (Suisse), pkerne...@octo.com +41 79 888 33 32 Retrouvez OCTO sur OCTO Talk : http://blog.octo.com OCTO Technology http://www.octo.ch

Re: Lots of warning messages and exception in namenode logs

(LeaseManager.java:329)* >> >> *at java.lang.Thread.run(Thread.java:745)* >> >> >> >> I have checked the two datanodes. Both are running and have enough space >> for new data. >> >> >> >> *PS: I have 2 Namenode and 2 datanodes in Ha

Re: Running a script/executable stored in HDFS from a mapper

> > Is it possible to run a script/executable stored in HDFS from a mapper ? > > Thank you, > Evelina > > -- Philippe Kernévez Directeur technique (Suisse), pkerne...@octo.com +41 79 888 33 32 Retrouvez OCTO sur OCTO Talk : http://blog.octo.com OCTO Technology http://www.octo.ch

Re: Anatomy of read in hdfs

o do parallel processing of you data. ​What do you want to do with the data that you read ? Regards, Philippe​ > > > Thanks for your help in advance. > > Sidharth > > > On 10-Apr-2017 1:50 PM, "Philippe Kernévez" wrote: > >> Hi Sidharth, >> >

Re: Anatomy of read in hdfs

;> Thanks for your response . But I dint understand yet,if you don't mind >>> can you tell me what do you mean by "*With Hadoop, the idea is to >>> parallelize the readers (one per block for the mapper) with processing >>> framework like MapReduce.*" >&g

Re: Anatomy of read in hdfs

; stream*." > > So can you kindly explain me how read operation will exactly happens. > > > Thanks for your help in advance > > Sidharth > > -- Philippe Kernévez Directeur technique (Suisse), pkerne...@octo.com +41 79 888 33 32 Retrouvez OCTO sur OCTO Talk : http://blog.octo.com OCTO Technology http://www.octo.ch

Re: HDFS fsck command giving health as corrupt for '/'

Average block replication: 6.8544796E-5 > Corrupt blocks:43766 > Missing replicas: 0 (0.0 %) > Number of data-nodes: 3 > Number of racks: 1 > FSCK ended at Tue Feb 14 07:59:10 UTC 2017 in 932 milliseconds > > > T

Re: Multi cluster Installation of Hadoop on win7

n my > win7 machine. Could please let me know hardware requirements of computer > and installation steps. > > Your faithfully > Yadav D > -- Philippe Kernévez Directeur technique (Suisse), pkerne...@octo.com +41 79 888 33 32 Retrouvez OCTO sur OCTO Talk : http

Re: HDFS client with Knox

in English ? > > 2017-01-01 4:22 GMT-08:00 Philippe Kernévez : > >> kk1) Maintenant que Knox est en place j'aimerai l'utiliser. >> En particulier depuis un client HDFS. >> Je peux faire (ça marche) : >> a) HDFS en RPC sur mon name node actif : "hdf

HDFS client with Knox

authent basique, je ne trouve pas de moyen de passer un login/password à la commande (soit elle est sans sécu, soit avec Kerberos) b) Comment indiquer que le protocole est en SSL, webhdfss ne semble pas exister... -- Philippe Kernévez Directeur technique (Suisse), pkerne...@octo.com +41 79 888