Is there a way to monitor the proportion of HDFS read data that is satisfied by
local nodes vs going across the network?
Thanks
John
Please take a look at https://issues.apache.org/jira/browse/HDFS-4698
Cheers
On Sun, Jan 26, 2014 at 9:11 AM, John Lilley wrote:
> Is there a way to monitor the proportion of HDFS read data that is
> satisfied by local nodes vs going across the network?
>
> Thanks
>
> John
>
>
>
>
>
To: common-u...@hadoop.apache.org
Subject: Re: HDFS read stats
Please take a look at https://issues.apache.org/jira/browse/HDFS-4698
Cheers
On Sun, Jan 26, 2014 at 9:11 AM, John Lilley
mailto:john.lil...@redpoint.net>> wrote:
Is there a way to monitor the proportion of HDFS read data t
6 AM
> *To:* common-u...@hadoop.apache.org
> *Subject:* Re: HDFS read stats
>
>
>
> Please take a look at https://issues.apache.org/jira/browse/HDFS-4698
>
>
>
> Cheers
>
>
>
> On Sun, Jan 26, 2014 at 9:11 AM, John Lilley
> wrote:
>
> Is there a way t
mon-u...@hadoop.apache.org
Subject: Re: HDFS read stats
Please take a look at DFSInputStream#ReadStatistics which contains four metrics
including local bytes read.
You can obtain ReadStatistics through getReadStatistics()
Cheers
On Sun, Jan 26, 2014 at 4:00 PM, John Lilley
mailto:joh
t; John
>
>
>
>
>
> *From:* Ted Yu [mailto:yuzhih...@gmail.com]
> *Sent:* Sunday, January 26, 2014 6:16 PM
>
> *To:* common-u...@hadoop.apache.org
> *Subject:* Re: HDFS read stats
>
>
>
> Please take a look at DFSInputStream#ReadStatistics which contains fou
Thanks! I would have never found that.
john
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Monday, January 27, 2014 4:57 PM
To: common-u...@hadoop.apache.org
Subject: Re: HDFS read stats
FSDataInputStream has this javadoc:
/** Utility that wraps a {@link FSInputStream} in a {@link
You're welcome.
On Feb 9, 2014, at 6:27 AM, John Lilley wrote:
> Thanks! I would have never found that.
> john
>
> From: Ted Yu [mailto:yuzhih...@gmail.com]
> Sent: Monday, January 27, 2014 4:57 PM
> To: common-u...@hadoop.apache.org
> Subject: Re: HDFS read sta
