Query : Hadoop Cluster OS upgrade

Hi All, Does anybody tried out/share learnings ,using maintenance state or upgrade domains for big data cluster OS upgrades? Regards, Brahma

Re: unsubscribe

Please drop mail to "user-unsubscr...@hadoop.apache.org" as mentioned in the footer mail. On Fri, Feb 9, 2024 at 2:32 PM Henning Blohm wrote: > unsubscribe > > > - > To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org >

Re: Performance with large no of files

Not sure, what's your backup approach. One option can be archiving[1] the files which were done for yarn logs[2]. To Speed on this, you can write one mapreduce job for archiving the files. Please refer to the Document for sample mapreduce[3].

Re: IPV6 support in Apache Hadoop

IPv6#:~:text=Apache%20Hadoop%20is%20not%20currently,only%2C%20you%20will%20encounter%20problems > . > > https://issues.apache.org/jira/browse/HADOOP-11890 > > > > > > > > Regards, > > Deepti Sharma > * PMP® & ITIL* > > > -- --Brahma Reddy Battula

Re: Any comment on the log4j issue?

Isn't this library used in Hadoop? Pretty sure I saw > log4j.properties somewhere. Can anybody shed some light on the > vulnerability of a Hadoop installation? Can it be exploited via RPC? The > HDFS or YARN web interface? The command line? > > Thanks > Rupert > > -- --Brahma Reddy Battula

Re: Unsubscribe

Please drop mail to “user-unsubscr...@hadoop.apache.org”… On Mon, 5 Jul 2021 at 10:27 AM, Madhav A wrote: > -- --Brahma Reddy Battula

Re: [ANNOUNCE] Apache Hadoop 3.3.1 release

a, Xiaoqiao He and other folks who continued helps for this > release process. > > Best Regards, > Wei-Chiu Chuang > -- --Brahma Reddy Battula

Re: [ANNOUNCE] Apache Hadoop 3.3.1 release

a, Xiaoqiao He and other folks who continued helps for this > release process. > > Best Regards, > Wei-Chiu Chuang > -- --Brahma Reddy Battula

Re: After deleting data of Hbase table hdfs size is not decreasing HDFS-15812

0-315 and hbase 2.0.2.3.1.4.0-315. >>> >>> We are deleting the data with normal hbase delete command and even with >>> api using phoenix. The count is reducing on phoenix and hbase but the >>> Hdfs size of the hbase directory is not reducing even I ran the major >>> compaction. >>> >>> Regards, >>> Satya >>> >>> >>> >> >> -- >> -- >> Regards, >> S.P.Gaurav >> >> > > -- > Thanks & Regards, > > Venkatesh > SRE, Media.net (Data Platform) > Flock Id- venkatesul...@media.net > Contact - 9949522101 > > -- --Brahma Reddy Battula

Re: Mandarin Hadoop online sync this week

6 Wednesday US Pacific Time 10PM > > Link: > https://cloudera.zoom.us/j/880548968 > > Past sync summary: > > https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit > -- --Brahma Reddy Battula

[ANNOUNCE] Apache Hadoop 3.3.0 release

.3.3.0.html [4] https://hadoop.apache.org/rele <https://hadoop.apache.org/releases.html> ases.html Regards, Brahma Reddy Battula

Re: Hadoop Jira Bug Workflows/Lifecycle Documentation

es > Jira. Various workflows e.g. > > Values of "Status" & "Resolution" field and their meanings. > How is a bug targeted for multiple releases. > > Looking for detailed documentation, if any. > > Thanks > > -Ajay Bakhshi > -- --Brahma Reddy Battula

Re: hadoop 3.3.0 release plan

y release plan for hadoop 3.3.0 > > thanks > -- > wangyongqiang0...@163.com > -- --Brahma Reddy Battula

RE: hadoop-2.8.5 Container launch failed for container_1560691739419_0001_01_000002 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist

Looks there is typo in configuration..? should be yarn.nodemanager.aux-services.. Upload yarn-site.xml and nodemanager logs mapreduceyarn.nodemanager.aux-services mapreduce_shuffle From: Mike IT Expert [mailto:mikeitexp...@gmail.com] Sent: Sunday, June 16, 2019 8:30 PM To: Wanqiang Ji Cc:

Re:

don't do anything. Any help regarding setting the erasure coding policy > (and hitchhiker feature) would be appreciated. > > It's a bit urgent. > > Warm regards, > Shuubham Ojha > -- --Brahma Reddy Battula

Re: Could not run dfsadmin command with -getStoragePolicy or -setStoragePolicy.

tml#dfsadmin > > > > Best Regards > > Kousuke Miyamoto > > > - > To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org > For additional commands, e-mail: user-h...@hadoop.apache.org > > -- --Brahma Reddy Battula

RE: Security problem extra

Unknowingly "dfs.encrypt.data.transfer" configured as true in datanode?? Please cross with check datanode configurations using the following way. http://:/conf bq.1 what the client mean, it mean the application running on hdfs, how does it have a

RE: No FileSystem for scheme: hdfs when using hadoop-2.8.0 jars

UnsupportedFileSystemException("No FileSystem for scheme " + "\"" + scheme + "\""); } --Brahma Reddy Battula From: omprakash [mailto:ompraka...@cdac.in] Sent: 31 July 2017 18:17 To: 'user' Subject: No FileSystem for scheme: hdfs when using hadoop-2.8.0 jars Hi all, I have

Re: Hadoop Issues - Can't find on StackOverflow

I guess it's in DOS format..can you execute "dos2unix start-yarn.sh" and check once..? From: johnsonngu...@ups.com.INVALID Sent: Wednesday, July 19, 2017 3:06 AM To: user@hadoop.apache.org Subject: Hadoop Issues - Can't find on

RE: Namenode not able to come out of SAFEMODE

Dn1 and Dn2 is re-started successfully..? can you check the DN logs..? --Brahma Reddy Battula From: omprakash [mailto:ompraka...@cdac.in] Sent: 20 July 2017 12:12 To: user@hadoop.apache.org Subject: Namenode not able to come out of SAFEMODE Hi all, I have a setup of 3 node Hadoop cluster

RE: Unsubscribe

It doesn’t like that.. Kindly drop a mail to "user-unsubscr...@hadoop.apache.org<mailto:user-unsubscr...@hadoop.apache.org>" --Brahma Reddy Battula From: Shawn Du [mailto:shawndow...@gmail.com] Sent: 17 July 2017 13:30 To: user@hadoop.apache.org Subject: Unsubscribe Unsubscribe Thanks Shawn

RE: reconfiguring storage

: Decommission might not proper if there are no ecnough nodes in the cluster ,it might fail. --Brahma Reddy Battula From: Brian Jeltema [mailto:bdjelt...@gmail.com] Sent: 07 July 2017 22:24 To: user Subject: Re: reconfiguring storage I prefer to decommission - reconfigure - recommission

Re: Tentative release date for 2.7.4?

AFAIK,Mostly It will be out in couple of weeks. Please stay tuned following link for more details. https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.7.4 Hadoop 2.7.4 - Hadoop - Apache Software Foundation

RE: Mismatch in length of source:

gives list of open files. --Brahma Reddy Battula -Original Message- From: Ulul [mailto:had...@ulul.org] Sent: 02 January 2017 23:05 To: user@hadoop.apache.org Subject: Re: Mismatch in length of source: Hi I can't remember the exact error message but distcp consistently fails when trying to

RE: java.io.IOException on Namenode logs

are more(you can check jmx) If there is any possibility enable the debug logs which can give useful info. --Brahma Reddy Battula From: daemeon reiydelle [mailto:daeme...@gmail.com] Sent: 04 July 2017 01:04 To: Nishant Verma Cc: user Subject: Re: java.io.IOException on Namenode logs A possibility

RE: Unsubscribe

It doesn't work like that. Kindly drop a mail to "user-unsubscr...@hadoop.apache.org<mailto:user-unsubscr...@hadoop.apache.org>" --Brahma Reddy Battula From: Atul Rajan [mailto:atul.raja...@gmail.com] Sent: 03 July 2017 15:19 To: Donald Nelson Cc: user@hadoop.apache

Re: unsubscribe

welcome!! From: Yue Cheng <yue...@gmail.com> Sent: Sunday, July 2, 2017 3:06 AM To: Brahma Reddy Battula Subject: Re: unsubscribe Thanks Brahma! Best, Yue On Fri, Jun 30, 2017 at 8:20 PM, Brahma Reddy Battula <brahmareddy.batt...@ho

Re: unsubscribe

It doesn't work like that. Kindly drop a mail to "user-unsubscr...@hadoop.apache.org" From: Yue Cheng Sent: Saturday, July 1, 2017 2:47 AM To: user@hadoop.apache.org Subject: unsubscribe Please sign me off. Thanks.

Re: Ensure High Availability of Datanodes in a HDFS cluster

is used if replication is not specified in create time. 3. "dfs.replication" is client(in your case confluent kafka) side property.May be,you can cross check this configuration in kafka. -Brahma Reddy Battula From: Nishant Verma <nishant.verma0

Re: Any ideas when Hadoop 3 will become final?

0.0+release> cwiki.apache.org Release schedule. For Hadoop 3, we are planning to "release early, release often" to quickly iterate on feedback collected from downstream projects. -Brahma Reddy Battula From: Jasson Chenwei <ynjassionc...@gmail.com>

RE: HDFS file replication to slave nodes not working

Yes, you can configure “dfs.datanode.data.dir”. Reference for default configurations: http://hadoop.apache.org/docs/r2.7.3/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml Regards Brahma Reddy Battula From: Bhushan Pathak [mailto:bhushan.patha...@gmail.com] Sent: 14 June 2017 17:47 To: Brahma

RE: HDFS file replication to slave nodes not working

Please see my comments inline. Regards Brahma Reddy Battula From: Bhushan Pathak [mailto:bhushan.patha...@gmail.com] Sent: 14 June 2017 17:14 To: common-u...@hadoop.apache.org Subject: HDFS file replication to slave nodes not working Hello, I have hadoop 2.7.3 running on a 3-node cluster

RE: Yarn not picking up the Resource manager configurations

Looks configurations(mainly yarn-site.xml here which you pointed) are not loaded in classpath. Can you check the output of “hadoop classpath”..? Regards Brahma Reddy Battula From: Dhanushka Parakrama [mailto:parakrama1...@gmail.com] Sent: 19 May 2017 16:40 To: user@hadoop.apache.org Subject

RE: unsubscribe

Kindly send an email to user-unsubscr...@hadoop.apache.org -Brahma From: shanker valipireddy [mailto:shanker.valipire...@gmail.com] Sent: 28 April 2017 03:40 To: user-subscr...@hadoop.apache.org; gene...@hadoop.apache.org; user Subject: unsubscribe

RE: Hadoop 2.7.3 cluster namenode not starting

Are you sure that you are starting in same machine (master)..? Please share “/etc/hosts” and configuration files.. Regards Brahma Reddy Battula From: Bhushan Pathak [mailto:bhushan.patha...@gmail.com] Sent: 27 April 2017 17:18 To: user@hadoop.apache.org Subject: Fwd: Hadoop 2.7.3 cluster

RE: Request for Hadoop mailing list subscription and 3.0.0 issues

Regards Brahma Reddy Battula From: Sidharth Kumar [mailto:sidharthkumar2...@gmail.com] Sent: 28 March 2017 14:46 To: user@hadoop.apache.org Subject: Request for Hadoop mailing list subscription and 3.0.0 issues Hi Folks, I am working as full time Hadoop Administrator since 2 years and want

Re: about dfs.datanode.du.reserved

y to push this config to > all the nodes from master or should I make to script to do this? > > Regards > > Enviado desde mi iPhone > > El 12 feb. 2017, a las 02:30, Brahma Reddy Battula <bra...@apache.org> > escribió: > > Hi Alexis Fidalgo > > 1) I did not se

Re: about dfs.datanode.du.reserved

if im asking about an already discussed issue, i > just suscribed to the list. > > regards > > > - > To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org > For additional commands, e-mail: user-h...@hadoop.apache.org > > -- --Brahma Reddy Battula

RE: moving hadoop and hive tables with its table structure and schema to new hadoop cluster

://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_administration/content/using_distcp.html Regards Brahma Reddy Battula From: Sirisha Cheruvu [mailto:sirisha5...@gmail.com] Sent: 10 January 2017 19:15 To: user@hadoop.apache.org Subject: moving hadoop and hive tables with its table structure and schema

RE: Hadoop source code modification.

Following links might be useful fro you. https://wiki.apache.org/hadoop/EclipseEnvironment http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/ https://www.quora.com/What-are-the-best-ways-to-learn-about-Hadoop-source Regards Brahma Reddy Battula From

RE: Hadoop source code modification.

(Keeping user-mailing list in loop.) You can compile corresponding module which you modified. Please refer "Where to run Maven from?" from the following. https://github.com/apache/hadoop/blob/trunk/BUILDING.txt Regards Brahma Reddy Battula -Original Message- From: Madhva

RE: HDFS - Corrupt replicas preventing decommissioning?

Please check my inline comments to your queries. Hope I have answered all your questions… Regards Brahma Reddy Battula From: Hariharan [mailto:hariharan...@gmail.com] Sent: 15 November 2016 18:55 To: user@hadoop.apache.org Subject: HDFS - Corrupt replicas preventing decommissioning? Hello

RE: unsubscribe

Drop a mail to user-unsubscr...@hadoop.apache.org --Brahma Reddy Battula From: Chen Qiming [mailto:qimin...@usc.edu] Sent: 24 October 2016 14:53 To: user@hadoop.apache.org Subject: unsubscribe unsubscribe

RE: LeaseExpiredException: No lease on /user/biadmin/analytic‐root/SX5XPWPPDPQH/.

Can you trace namenode logs, whether this is file deleted/renamed(might be parent folder) before this reducer run..? --Brahma Reddy Battula From: Zhang Jianfeng [mailto:jzhang...@gmail.com] Sent: 18 October 2016 18:55 To: Gaurav Kumar Cc: user.hadoop; Rakesh Radhakrishnan Subject: Re

RE: hdfs2.7.3 kerberos can not startup

Could you please re-check the ssl-server.xml, keystore and truststore properties: ssl.server.keystore.location ssl.server.keystore.keypassword ssl.client.truststore.location ssl.client.truststore.password --Brahma Reddy Battula From: kevin [mailto:kiss.kevin...@gmail.com] Sent: 20 September 2

RE: How to clear block count alert on hdfs

Can you elaborate more..? are asking about why “nondfsused”more..? can you please mention hadoop version details also..? --Brahma Reddy Battula From: sandeep vura [mailto:sandeepv...@gmail.com] Sent: 17 September 2016 12:20 To: user@hadoop.apache.org Subject: How to clear block count alert

RE: Re:

Might be it is considered as local filesystem and listing local folders . It can happen with default configuration where “fs.defaultFS” is not configured. Please check HADOOP_CONF_DIR is having the hdfs-site.xml and core-site.xml with proper configuration. --Brahma Reddy Battula From

RE: [DISCUSS] Retire BKJM from trunk?

Yes, We can remove from trunk and can be deprecated in branch-2. We confirmed with all the existing customers on this.. --Brahma Reddy Battula -Original Message- From: Gangumalla, Uma [mailto:uma.ganguma...@intel.com] Sent: 28 July 2016 13:22 To: Rakesh Radhakrishnan; Sijie Guo Cc

RE: How to restart an HDFS standby namenode dead for a very long time

Sorry for late reply.. To recover this, you can restart the DN’s one by one. (OR) apply the patch in HDFS-9917 and then restart the Standby Namenode. --Brahma Reddy Battula From: Zach Cox [mailto:zcox...@gmail.com] Sent: 15 July 2016 19:59 To: Brahma Reddy Battula; user@hadoop.apache.org

RE: How to restart an HDFS standby namenode dead for a very long time

Seems to be you are hitting following jira.. Please refer https://issues.apache.org/jira/browse/HDFS-9917 --Brahma Reddy Battula From: Zach Cox [mailto:zcox...@gmail.com] Sent: 14 July 2016 03:34 To: user@hadoop.apache.org Subject: How to restart an HDFS standby namenode dead for a very long

RE: NameNode HA from a client perspective

) occurs, then repeat #2 and #3, starting from the next namenode url in the list. --Brahma Reddy Battula From: Cecile, Adam [mailto:adam.cec...@hitec.lu] Sent: 04 May 2016 16:26 To: Sandeep Nemuri Cc: user@hadoop.apache.org Subject: RE: NameNode HA from a client perspective Hello, I'm not sure

RE: Guideline on setting Namenode RPC Handler count (client and service)

issue recently , may be you can have look at HDFS-10301. --Brahma Reddy Battula From: Chackravarthy Esakkimuthu [mailto:chaku.mi...@gmail.com] Sent: 03 May 2016 18:10 To: Gokul Cc: user@hadoop.apache.org Subject: Re: Guideline on setting Namenode RPC Handler count (client and service) To add

RE: UnstaisfiedLinkError - Windows Environment

corrupted ? Are you able to read without libraries?? Dont put those libraries in bin and try. --Brahma Reddy Battula From: karthi keyan [mailto:karthi93.san...@gmail.com] Sent: 29 March 2016 16:47 To: Brahma Reddy Battula Cc: user@hadoop.apache.org Subject: Re: UnstaisfiedLinkError - Windows Environment

RE: UnstaisfiedLinkError - Windows Environment

As you told Server is Hadoop 2.5.2. But client is 2.6.2, as seen in the exception. Whether client-side libraries built with Hadoop 2.6.2? From: karthi keyan [mailto:karthi93.san...@gmail.com] Sent: 29 March 2016 15:16 To: Brahma Reddy Battula Cc: user@hadoop.apache.org Subject: Re

RE: UnstaisfiedLinkError - Windows Environment

Are you using the right libraries ( built for 64-bit windows and Hadoop 2.6.2) ? From: karthi keyan [mailto:karthi93.san...@gmail.com] Sent: 29 March 2016 14:51 To: Brahma Reddy Battula Cc: user@hadoop.apache.org Subject: Re: UnstaisfiedLinkError - Windows Environment Hi Brahma, I have added

RE: UnstaisfiedLinkError - Windows Environment

Hadoop Cluster installed in Windows or only client is in Windows? Whether Hadoop distribution contains windows library files and /bin is added to PATH ? From: karthi keyan [mailto:karthi93.san...@gmail.com] Sent: 29 March 2016 14:29 To: user@hadoop.apache.org Subject: UnstaisfiedLinkError -

RE: Name node files are creating different directory

Hi vinodh As properties are wrong, it is taken default properties..Correct like following.. fs.namenode.name.dir should be like dfs.namenode.name.dir, fs.datanode.data.dir should be like dfs.datanode.data.dir Reference:

RE: hdfs-site.xml change must restart datanode?

Hi yaoxiaohua, Use "dfs.datanode.max.transfer.threads" instead of "dfs.datanode.max.xcievers (deprecated)"..Yes, you need to restart the datanode. Reference for deprecated properties:https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/DeprecatedProperties.html Thanks And

RE: Distcp fails with "Got EOF but currentPos = 240377856 < filelength = 1026034162" error

Hi Buntu Dev, Please check the Data node logs to get the exact root reason. One more possible reason (apart from kai mentioned)can be direct buffer memory is not enough while copying the large files. If you observe the OOM in direct buffer, just increase it.. Hope it’s helpful. From: Buntu

RE: Max Parallel task executors

I'm glad to hear it helped. Thanks & Regards Brahma Reddy Battula From: sandeep das [yarnhad...@gmail.com] Sent: Monday, November 09, 2015 11:54 AM To: user@hadoop.apache.org Subject: Re: Max Parallel task executors After increa

RE: unsubscribe

Kindly drop a mail to user-unsubscr...@hadoop.apache.org Thanks And RegardsBrahma Reddy Battula Subject: RE: unsubscribe To: user@hadoop.apache.org From: wadood.chaudh...@instinet.com Date: Mon, 9 Nov 2015 11:14:53 -0500 unsubscribe

RE: Max Parallel task executors

thinking, Two Nodemanger's are unhealthy (OR) you might have configured mapreduce.map/reduce.memory.mb=2GB(or 5 core). As laxman pointed you can post RMUI or you can cross check like above. Hope this helps. Thanks & Regards Brahma Reddy Battula From: Laxma

RE: Unsubscribe footer for user@h.a.o messages

+ 1 ( non-binding).. Nice thought,Arpit.. Thanks And RegardsBrahma Reddy Battula Subject: Re: Unsubscribe footer for user@h.a.o messages From: m...@hortonworks.com To: user@hadoop.apache.org Date: Thu, 5 Nov 2015 21:23:41 + +1 (non-binding) On Nov 5, 2015, at 12:50 PM,

RE: hadoop not using whole disk for HDFS

to configure for data.dir might be ambari's constraint, instead you can manually try to add a data dir in /home, for your usecase, and restart datanodes. Thanks & Regards Brahma Reddy Battula From: Naganarasimha G R (Naga) [garlanaganarasi...@huawei

RE: Problem running example (wrong IP address)

: Problem running example (wrong IP address) From: dwmaill...@gmail.com To: user@hadoop.apache.org hadoop-master http://pastebin.com/yVF8vCYShadoop-data1 http://pastebin.com/xMEdf01ehadoop-data2 http://pastebin.com/prqd02eZ On Fri, Sep 25, 2015 at 11:53 AM, Brahma Reddy Battula <brahmareddy.b

RE: Problem running example (wrong IP address)

192.168.52.4 : datanode startup might be failed ( you can check this node logs) 192.168.51.4 : <http://192.168.51.4:50010> Datanode starup is success..which is in master node.. Thanks & Regards Brahma Reddy Battula From: Daniel Watrous [dwma

RE: Problem running example (wrong IP address)

-data2 Here are the startup logs for all three nodes:https://gist.github.com/dwatrous/7241bb804a9be8f9303f https://gist.github.com/dwatrous/bcd85cda23d6eca3a68b https://gist.github.com/dwatrous/922c4f773aded0137fa3 Thanks for your help. On Fri, Sep 25, 2015 at 10:33 AM, Brahma Reddy Battula

RE: unsubscribe

Kindly Drop a mail to user-unsubscr...@hadoop.apache.org Thanks & Regards Brahma Reddy Battula From: Jean-Eric CAZAMEA [jecaza...@yahoo.com] Sent: Friday, September 18, 2015 1:17 AM To: User Hadoop Subject: unsubscribe

RE: unsubscribe me

Drop a mail to user-unsubscr...@hadoop.apache.org Thanks And RegardsBrahma Reddy Battula Date: Wed, 16 Sep 2015 19:48:26 +0530 Subject: unsubscribe me From: akfak...@gmail.com To: user@hadoop.apache.org

RE: unsubscribe

Kindly Drop a mail to user-unsubscr...@hadoop.apache.org Thanks & Regards Brahma Reddy Battula From: dhvanika.s...@wipro.com [dhvanika.s...@wipro.com] Sent: Monday, September 14, 2015 10:09 AM To: user@hadoop.apache.org Subject: unsubsc

RE: Re:RE: Unable to use ./hdfs dfsadmin -report with HDFS Federation

check following. http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-hdfs/ViewFs.html Hope this can answer your query. Thanks Regards Brahma Reddy Battula From: Todd [bit1...@163.com] Sent: Monday, August 24, 2015 9:33 AM To: user

RE: NNBench on external HDFS

HI Alex HDFS-7651 is raised for same..Please have a look at once.. Thanks Regards Brahma Reddy Battula ___ From: Alexander Striffeler [a.striffe...@students.unibe.ch] Sent: Thursday, July 23, 2015 1:00 PM To: user@hadoop.apache.org Subject: Re: NNBench

RE: Incorrect configuration issue

://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html Thanks Regards Brahma Reddy Battula From: khalid yatim [yatimkha...@gmail.com] Sent: Monday, July 13, 2015 11:16 PM To: user@hadoop.apache.org Subject: Re: Incorrect

RE: Cannot obtain block length for LocatedBlock

Can you try like following..? hdfs fsck -openforwrite -files -blocks -locations / | grep blk_1109280129_1099547327549 Thanks Regards Brahma Reddy Battula From: Adnan Karač [adnanka...@gmail.com] Sent: Tuesday, May 26, 2015 1:34 PM To: user

RE: Please unsubscribe Me.

Please send email to user-unsubscr...@hadoop.apache.orghttp://apache.org Thanks Regards Brahma Reddy Battula From: Aqeel Ahmed [aqeel@gmail.com] Sent: Tuesday, May 26, 2015 6:47 PM To: user@hadoop.apache.org Subject: Please unsubscribe Me. Please

RE: unsubscribe

Please send email to user-unsubscr...@hadoop.apache.org Date: Thu, 23 Apr 2015 09:23:37 -0700 Subject: unsubscribe From: nelsonq4t...@gmail.com To: user@hadoop.apache.org; nandakumar.vadiv...@ericsson.com unsubscribe

RE: Unable to load native-hadoop library

Hello Mich Talebzadeh Please mention which release you are using and how did you compile ( if you had complied or from where did you took the release ) bq: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable This will

RE: ipc.Client: Retrying connect to server

Hello Mahmood Naderan, When client is trying to connect to server with configured port(and address) and server is not started with that port then client will retry ( and you will get following error..).. I can able to trace that Namenode is not running From JPS report which you had

RE: ResourceLocalizationService: Localizer failed when running pi example

As Alexander Alten-Lorenz pointed, it mostly config issue(yarn.nodemanager.local-dirs or mapred.local.dir).. can you able provide full logs..? Bytheway NPE is handled in Trunk ..Please check HADOOP-8436 for more details.. From: wget.n...@gmail.com Subject: Re: ResourceLocalizationService:

RE: Unsubscribe

You can mailto user-unsubscr...@hadoop.apache.org Date: Tue, 14 Apr 2015 09:12:07 -0700 Subject: Unsubscribe From: preya.2.s...@gmail.com To: user@hadoop.apache.org unsubscribe

RE: hdfs ls command took more time to get response after update

Please send vendor specific questions to that vendor's support mechanism. Since your issue appears to be with CDH, please use http://community.cloudera.com/http://community.cloudera.com/ Thanks Regards Brahma Reddy Battula From: ZhuGe [t...@outlook.com

unsubscribe

Kindly Send email to user-unsubscr...@hadoop.apache.org Subject: Re: Hadoop 2.6 issue To: user@hadoop.apache.org From: rapen...@in.ibm.com Date: Thu, 2 Apr 2015 09:02:09 +0530 Please un subscribe me from this list. Regards, Ravi Prasad Pentakota India Software Lab, IBM Software Group

RE: How to know when datanode are marked dead by namenode

configure dfs.namenode.heartbeat.recheck-interval based one your requirement.. Thanks Regards Brahma Reddy Battula From: Himawan Mahardianto [mahardia...@ugm.ac.id] Sent: Saturday, March 28, 2015 4:42 PM To: user@hadoop.apache.org Subject: How to know when

RE: Hadoop 2.6.0 Error

Instead of exporting the JAVA_HOME, Please set JAVA_HOME in system level ( like putting in /etc/profile...) For more details please check the following jira. https://issues.apache.org/jira/browse/HADOOP-11538 Thanks Regards Brahma Reddy Battula From

RE: Hadoop 2.6.0 Error

HI Ideally it should take effect , if you configure in .profile or hadoop-env.sh.. As you told that you set in .profile ( hope you did source ~/.profile ),,, did you verify that take effect..? ( by checking echo $JAVA_HOME,, or jps..etc )... Thanks Regards Brahma Reddy Battula

RE: journal node shared edits directory should be present on HDFS or NAS or anything else?

/property http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html Thanks Regards Brahma Reddy Battula From: Chandrashekhar Kotekar [shekhar.kote...@gmail.com] Sent: Thursday, February 12, 2015 5:01 PM To: user

RE: hadoop cluster with non-uniform disk spec

..? Thanks Regards Brahma Reddy Battula From: daemeon reiydelle [daeme...@gmail.com] Sent: Thursday, February 12, 2015 12:02 PM To: user@hadoop.apache.org Cc: Ravi Prakash Subject: Re: hadoop cluster with non-uniform disk spec What have you set

RE: journal node shared edits directory should be present on HDFS or NAS or anything else?

reference for more details)/NFS/BOOKKeeper Thanks Regards Brahma Reddy Battula From: Chandrashekhar Kotekar [shekhar.kote...@gmail.com] Sent: Thursday, February 12, 2015 5:31 PM To: user@hadoop.apache.org Subject: Re: journal node shared edits directory

RE: Failed to start datanode due to bind exception

, it will be replaced by the TCP port of the DataNode. Ideally if some port present only , you will get that error.please re-checkonce.. if you delete /var/run/hdfs-sockets/datanode (worst condition, if it is corrupted) and start the datanode. Thanks Regards Brahma Reddy Battula

RE: Hadoop 2.6.0: FileSystem file:/// is not a distributed file system

Hi Dong, HADOOP_CONF_DIR might be referring to default..you can export HADOOP_CONF_DIR where following configuration files are present.. Thanks Regards Brahma Reddy Battula From: Dan Dong [dongda...@gmail.com] Sent: Saturday, December 13, 2014 3:43 AM

RE: how to increate data node expire time

can configure dfs.namenode.heartbeat.recheck-interval based one your requirement.. Thanks Regards Brahma Reddy Battula From: Henry Hung [ythu...@winbond.com] Sent: Tuesday, November 25, 2014 8:05 AM To: user@hadoop.apache.org Subject: how to increate data node

RE: Configure Rack Numbers

details. https://issues.apache.org/jira/secure/attachment/12345251/Rack_aware_HDFS_proposal.pdf Thanks Regards Brahma Reddy Battula HUAWEI TECHNOLOGIES INDIA PVT.LTD. Ground,12 floors,Solitaire, 139/26,Amarjyoti Layout,Intermediate Ring Road,Domlur Bangalore - 560 071 , India Tel : +91

RE: issue about pig can not know HDFS HA configuration

and mapred-site.xml files): 1. export PIG_CLASSPATH=/mycluster/conf 2. Set the HADOOP_CONF_DIR environment variable to the location of the cluster configuration directory: export HADOOP_CONF_DIR=/mycluster/conf Thanks Regards Brahma Reddy Battula From

RE: HDFS multiple dfs_data_dir disbalance

some time Thanks Regards Brahma Reddy Battula From: Georgi Ivanov [iva...@vesseltracker.com] Sent: Wednesday, October 22, 2014 5:17 PM To: user@hadoop.apache.org Subject: HDFS multiple dfs_data_dir disbalance Hi, My cluster is configured with 2 data dirs

RE: Error executing job in YARN. Exception Shell$ExitCodeException

Hi gortiz Please have a look at application master logs(you can get RM UI or JHS (if aggeration enabled) or yarn-nodemanger-logs-dir (if aggeration is disabled) ) and Nodemanager logs to get the exact cause.. Thanks Regards Brahma Reddy Battula

RE: Not able to update jar

Hi Patcharee Did you put the updated jar under $HADOOP_HOME/share/hadoop/common/lib Please send the exception which you are getting while executing.. and syntax is $HADOOP_HOME/bin/hadoop jar jar name class name arg0 arg1 Thanks Regards Brahma Reddy Battula

RE: How to find extent of data node imbalance ?

HI Manoj, You can check from namenode web UI also apart from what you mentioned.. http://NameNode-host:httpPort/dfsnodelist.jsp?whatNodes=LIVEhttp://10.18.51.157:25000/dfsnodelist.jsp?whatNodes=LIVE Thanks Regards Brahma Reddy Battula From: Manoj

RE: DFS Used V/S Non DFS Used

largest folders. Thanks Regards Brahma Reddy Battula HUAWEI TECHNOLOGIES INDIA PVT.LTD. Ground,12 floors,Solitaire, 139/26,Amarjyoti Layout,Intermediate Ring Road,Domlur Bangalore - 560 071 , India Tel : +91- 80- 3980 9600 Ext No: 4905 Mobile : +91 9620022006 Fax : +91-80-41118578

RE: Failed to active namenode when config HA

to active state. Please go through following link for more details.. http://hadoop.apache.org/docs/r2.5.1/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html Thanks Regards Brahma Reddy Battula From: 清如许 [475053...@qq.com] Sent: Tuesday

RE: Hadoop 2.4.1 Verifying Automatic Failover Failed: Unable to trigger a roll of the active NN

for NameNode web console is 50070. you can check value of dfs.namenode.http-address in hdfs-site.xml.. Default values, you can check from the following link.. http://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml Thanks Regards Brahma Reddy Battula

  1   2   >