Hello!
Important message, visit http://besamestreet.com/walked.php?aq
Abdul Navaz
Hello!
Important message, visit http://hempaving.com/them.php?bvtv1
Abdul Navaz
this temporary
directory as it is not needed anymore.
My question was how to get the size of this mapper output. Anyhow I figured
it now, When running map reduce job execute “du –ah” will give me the size
of all directories including subdirectories.
Thanks Regards,
Abdul Navaz
Research Assistant
I get the size of mapper output
in bytes
Thanks.
From: Abdul Navaz navaz@gmail.com
Date: Friday, December 12, 2014 at 12:36 AM
To: user@hadoop.apache.org user@hadoop.apache.org
Subject: Where the output of mappers are saved ?
Hello,
I am interested in efficiently manage the Hadoop
?
How can i get the size of mapper output from each datanodes in a real time ?
Appreciate your help.
Thanks Regards,
Abdul Navaz
command to check ?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
Ph: 281-685-0388
From: Brahma Reddy Battula brahmareddy.batt...@huawei.com
Reply-To: user@hadoop.apache.org
Date: Sunday, November 16, 2014 at 11:10 PM
To: user@hadoop.apache.org user
configure this rack numbers and say this DN belongs to this rack number.
Thanks Regards,
Abdul Navaz
traffic which is exchanged between
mappers and reducers before performing reducing ?
Please clarify !
Thanks Regards,
Abdul Navaz
From: Pramod Biligiri pramodbilig...@gmail.com
Reply-To: user@hadoop.apache.org
Date: Thursday, October 2, 2014 at 12:44 AM
To: zookeeper-u...@hadoop.apache.org
It was the space issue. It works perfectly after adding this to mapped.site
xml file.
property
namemapred.local.dir/name
value/mnt/value
/property
Thanks for the help. :)
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
Ph: 281-685-0388
From
to check the hadoop network
perfromance.
Is the configuration I have chosen is right ?
Thanks Regards,
Abdul Navaz
2MB. Why can¹t it just use all 4 reducer disc
space ?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
Ph: 281-685-0388
From: Rohith Sharma K S rohithsharm...@huawei.com
Reply-To: user@hadoop.apache.org
Date: Monday, October 6, 2014 at 5:52 AM
understand is why it uses only one
datanode disc space. I have change the number of reducer as 4 still it uses
only one datanode disc and throws above error.
How can I fix this issue?
Thanks Regards,
Navaz
Am I doing anything wrong here ?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
Ph: 281-685-0388
From: ViSolve Hadoop Support hadoop.supp...@visolve.com
Reply-To: user@hadoop.apache.org
Date: Friday, October 3, 2014 at 1:29 AM
To: user
Hello Pramod,
This is great work !. Thank you for sharing the report.
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
Ph: 281-685-0388
From: Pramod Biligiri pramodbilig...@gmail.com
Reply-To: user@hadoop.apache.org
Date: Thursday, October 2
as it has capacity of
5.9GB , I want to use only /dev/xvda4. How can I do this ?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
Ph: 281-685-0388
From: Abdul Navaz navaz@gmail.com
Date: Monday, September 29, 2014 at 1:53 PM
To: user
committed heap usage
I am trying to find the shuffling traffic that is total traffic generated
when mappers exchange their key values pair with the reducer. Is the
highlighted portion gives the shuffling traffic ?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main
can I fix this ?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
Ph: 281-685-0388
From: Aitor Cedres aced...@pivotal.io
Reply-To: user@hadoop.apache.org
Date: Monday, September 29, 2014 at 7:53 AM
To: user@hadoop.apache.org
Subject: Re
108G 75G 59%
/proj/ch-geni-net
root@nn:~#
I can see there is no space left on /dev/xvda2.
How can I make hadoop to see newly mounted /dev/xvda4 ? Or do I need to move
the file manually from /dev/xvda2 to xvda4 ?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main
to know when the shuffling traffic starts ?
- Is there any way to find out when exactly shuffling started ? Does it
generate any syslog in the logs .
- How to find the total amount of shuffling traffic?
Thanks Regards,
Abdul Navaz
Research Assistant
University of Houston Main Campus, Houston TX
?
Appreciate your response.
Thanks Regards
Abdul Navaz
Graduate Student
University of Houston Main Campus,Texas
Mob: (281) 685-0388
numbers, How the connection is established , etc).
I would like to see all these network information. Can anyone help me on
this?
Thanks in advance.
Thanks Regards
*Abdul Navaz*
Hi
I would like to measure the network delay between mappers and reducers.
How can I calcute this time?
Log file is having this info?
Thanks
Navaz
file*
*/usr/local/hadoop/bin/hadoop: line 390: /usr/lib/jvm/jdk1.7.0//bin/java:
Success*
hduser@base:~$
Still I am getting the error message. What can be done?
Thanks
Navaz
On Tue, Jan 7, 2014 at 3:58 PM, German Florez-Larrahondo
german...@samsung.com wrote:
This could be because you
How to remove one of the slave node. ?
I have a namenode ( master) and 3 datanode (slave) running. I would like to
remove one of the problematic datanode. How can i do this?
Unfortunately i dont have access to that problematic data node.
Thanks
Navaz
) 'attempt_201312311107_0003_r_00_1' to tip task
_201312311107_0003_r_00, for tracker 'tracker_slave1:localhost/
127.0.0.1:57492'
On Tue, Dec 31, 2013 at 4:42 PM, navaz navaz@gmail.com wrote:
Hi
My hdfs-site is configured for 4 nodes. ( One is master and 3 slaves)
property
namedfs.replication/name
, 2014 at 4:54 PM, Hardik Pandya smarty.ju...@gmail.comwrote:
do you have your hosnames properly configured in etc/hosts? have you tried
192.168.?.? instead of localhost 127.0.0.1
On Wed, Jan 1, 2014 at 11:33 AM, navaz navaz@gmail.com wrote:
Thanks. But I wonder Why map succeeds 100
mapred.JobClient: map 100% reduce 14%
HANGS HEAR
Could you please help me in resolving this issue.
Thanks Regards
*Abdul Navaz*
.
Thanks
Navaz
On Tue, Dec 31, 2013 at 3:25 PM, Hardik Pandya smarty.ju...@gmail.comwrote:
what does your job log says? is yout hdfs-site configured properly to find
3 data nodes? this could very well getting stuck in shuffle phase
last thing to try : does stop-all and start-all helps? even
me why i am not able to access this file .
Is there any alternative to get this?
Thanks regards
*Abdul Navaz*
official website?
http://archive.apache.org/dist/hadoop/core/hadoop-1.1.2/
Yong
--
Date: Mon, 30 Dec 2013 11:42:25 -0500
Subject: Unable to access the link
From: navaz@gmail.com
To: user@hadoop.apache.org
Hi
I am using below instruction set to set up
. Data Solutions Software Engineer
100 Sandusky Street | 2nd Floor | Pittsburgh, PA 15212
Google Voice: 412-256-8556 | www.rdx.com
On Mon, Dec 30, 2013 at 12:19 PM, navaz navaz@gmail.com wrote:
Thanks. But I am following the steps mentioned in the above file. Also i
am interested use
me in creating a multinode hadoop cluster ( 3 nodes) on vmware?
Thanks Regards
*Abdul Navaz*
*Masters in Network Communications*
*University of Houston*
*Houston, TX - 77204-4020*
*Ph - 281-685-0388*
*fabdulna...@uh.edu* fabdulna...@uh.edu
correctly.
hduser@ubuntu:~/Downloads$ tcpdump port 13562
tcpdump: no suitable device found
Thanks
Abdul Navaz
On Thu, Dec 5, 2013 at 9:31 PM, ch huang justlo...@gmail.com wrote:
hi, Abdul Navaz:
assign shuffle port in each NM using option mapreduce.shuffle.port in
mapred-site.xml,then
monitor
Hello
I am following the tutorial hadoop on single node cluster and I am able
test word count program map reduce. its working fine.
I would like to know
How to monitor when shuffle phase network traffic occurs via wireshark or
someother means.
Pls guide me.
Thanks
Abdul Navaz
Graduate student
34 matches
Mail list logo
