[jira] [Updated] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2021-04-16 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-15980: -- Fix Version/s: 3.4.0 Affects Version/s: 3.4.0 Status: Patch Available (was: In P

[jira] [Work started] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2021-04-16 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15980 started by Zheng Shao. - > Fix tests for HDFS-15754 Create packet metrics for DataNode > --

[jira] [Commented] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2021-04-15 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322539#comment-17322539 ] Zheng Shao commented on HDFS-15980: --- There are 3 issues: # The metric names in the tes

[jira] [Assigned] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2021-04-15 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao reassigned HDFS-15980: - Assignee: Zheng Shao > Fix tests for HDFS-15754 Create packet metrics for DataNode > ---

[jira] [Created] (HDFS-15980) Fix tests for HDFS-15754 Create packet metrics for DataNode

2021-04-15 Thread Zheng Shao (Jira)
Zheng Shao created HDFS-15980: - Summary: Fix tests for HDFS-15754 Create packet metrics for DataNode Key: HDFS-15980 URL: https://issues.apache.org/jira/browse/HDFS-15980 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-11586) Report %free, %write_locked, %read_locked for the NameNode FSNamesystemLock

2019-01-26 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16752986#comment-16752986 ] Zheng Shao commented on HDFS-11586: --- [~vagarychen] I would propose that "%free + %write

[jira] [Created] (HDFS-14233) Implement DistributedFileSystem#listStatus(Path[]) by adding a batching listStatus RPC call to NameNode

2019-01-25 Thread Zheng Shao (JIRA)
Zheng Shao created HDFS-14233: - Summary: Implement DistributedFileSystem#listStatus(Path[]) by adding a batching listStatus RPC call to NameNode Key: HDFS-14233 URL: https://issues.apache.org/jira/browse/HDFS-14233

[jira] [Updated] (HDFS-14229) Nonblocking HDFS create|write

2019-01-25 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-14229: -- Description: Right now, the create call on HDFS is blocking.  The write call can also be blocking if t

[jira] [Updated] (HDFS-14229) Nonblocking HDFS create|write

2019-01-24 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-14229: -- Description: Right now, the create call on HDFS is blocking.  The write call can also be blocking if t

[jira] [Created] (HDFS-14229) Nonblocking HDFS create|write

2019-01-24 Thread Zheng Shao (JIRA)
Zheng Shao created HDFS-14229: - Summary: Nonblocking HDFS create|write Key: HDFS-14229 URL: https://issues.apache.org/jira/browse/HDFS-14229 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Created] (HDFS-11586) Report %free, %write_locked, %read_locked for the NameNode FSNamesystemLock

2017-03-27 Thread Zheng Shao (JIRA)
Zheng Shao created HDFS-11586: - Summary: Report %free, %write_locked, %read_locked for the NameNode FSNamesystemLock Key: HDFS-11586 URL: https://issues.apache.org/jira/browse/HDFS-11586 Project: Hadoop H

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15796369#comment-15796369 ] Zheng Shao commented on HDFS-11280: --- The Test Failures were caused by the calling of "co

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: (was: HDFS-11280.for.2.7.and.below.patch) > Allow WebHDFS to reuse HTTP connections to N

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.5.patch > Allow WebHDFS to reuse HTTP connections to NN >

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.7.and.below.patch > Allow WebHDFS to reuse HTTP connections to NN > ---

[jira] [Updated] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFS to reuse HTTP connections to NN > -

[jira] [Commented] (HDFS-11280) Allow WebHDFS to reuse HTTP connections to NN

2017-01-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15794319#comment-15794319 ] Zheng Shao commented on HDFS-11280: --- Sorry guys, I think we need to revert this patch.

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.4.patch Replaced the other instance of conn.disconnect(). Als

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.3.patch > Allow WebHDFSClient to reuse HTTP connections (HTTP

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Commented] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15788274#comment-15788274 ] Zheng Shao commented on HDFS-11280: --- > The patch doesn't appear to include any new or mo

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Description: WebHDFSClient calls "conn.disconnect()", which disconnects from the NameNode. When we use

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Description: WebHDFSClient calls "conn.disconnect()", which disconnects from the NameNode. When we use

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.2.patch Addressed findbug issue - getInputStream() is known to

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Open (was: Patch Available) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.patch > Allow WebHDFSClient to reuse HTTP connections (HTTP Ke

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: (was: HDFS-11280.for.2.8.and.beyond.patch) > Allow WebHDFSClient to reuse HTTP connectio

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: (was: HDFS-11280.for.2.8.and.beyond.patch) > Allow WebHDFSClient to reuse HTTP connectio

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: In Progress) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-A

[jira] [Assigned] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao reassigned HDFS-11280: - Assignee: Zheng Shao > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.patch > Allow WebHDFSClient to reuse HTTP connections (HTTP Ke

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: In Progress (was: Patch Available) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-A

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.8.and.beyond.patch > Allow WebHDFSClient to reuse HTTP connections (HTTP Ke

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.7.and.below.patch > Allow WebHDFSClient to reuse HTTP connections (HTTP Kee

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: (was: HDFS-11280.for.2.7.and.below.patch) > Allow WebHDFSClient to reuse HTTP connection

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Description: WebHDFSClient calls "conn.disconnect()", which disconnects from the NameNode. When we use

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Status: Patch Available (was: Open) > Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) >

[jira] [Updated] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-11280: -- Attachment: HDFS-11280.for.2.7.and.below.patch > Allow WebHDFSClient to reuse HTTP connections (HTTP Kee

[jira] [Created] (HDFS-11280) Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive)

2016-12-28 Thread Zheng Shao (JIRA)
Zheng Shao created HDFS-11280: - Summary: Allow WebHDFSClient to reuse HTTP connections (HTTP Keep-Alive) Key: HDFS-11280 URL: https://issues.apache.org/jira/browse/HDFS-11280 Project: Hadoop HDFS

[jira] Commented: (HDFS-1479) Massive file deletion causes some timeouts in writers

2010-11-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12927581#action_12927581 ] Zheng Shao commented on HDFS-1479: -- Thanh, we have a service that keeps the last 5 days of

[jira] Created: (HDFS-1479) Massive file deletion causes some timeouts in writers

2010-10-26 Thread Zheng Shao (JIRA)
Massive file deletion causes some timeouts in writers - Key: HDFS-1479 URL: https://issues.apache.org/jira/browse/HDFS-1479 Project: Hadoop HDFS Issue Type: Improvement Affects Versions

[jira] Created: (HDFS-1208) DFSClient swallows InterruptedException

2010-06-15 Thread Zheng Shao (JIRA)
DFSClient swallows InterruptedException --- Key: HDFS-1208 URL: https://issues.apache.org/jira/browse/HDFS-1208 Project: Hadoop HDFS Issue Type: Bug Reporter: Zheng Shao DFSClient sometimes s

[jira] Updated: (HDFS-1154) libhdfs::hdfsExists should return different value in case of 1. error and 2. file does not exist

2010-05-13 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1154: - Status: Patch Available (was: Open) > libhdfs::hdfsExists should return different value in case of 1. err

[jira] Updated: (HDFS-1154) libhdfs::hdfsExists should return different value in case of 1. error and 2. file does not exist

2010-05-13 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1154: - Attachment: HDFS-1154.1.patch > libhdfs::hdfsExists should return different value in case of 1. error and

[jira] Created: (HDFS-1154) libhdfs::hdfsExists should return different value in case of 1. error and 2. file does not exist

2010-05-13 Thread Zheng Shao (JIRA)
libhdfs::hdfsExists should return different value in case of 1. error and 2. file does not exist Key: HDFS-1154 URL: https://issues.apache.org/jira/browse/HDFS-1154

[jira] Commented: (HDFS-1154) libhdfs::hdfsExists should return different value in case of 1. error and 2. file does not exist

2010-05-13 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12867389#action_12867389 ] Zheng Shao commented on HDFS-1154: -- Current code looks like this: {code} int hdfsExists(hd

[jira] Updated: (HDFS-1127) Improve the speed of FileSystem object creation

2010-05-04 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1127: - Attachment: HDFS-1127.branch-20.3.patch Fixed unit test. > Improve the speed of FileSystem object creatio

[jira] Updated: (HDFS-1127) Improve the speed of FileSystem object creation

2010-05-04 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1127: - Attachment: HDFS-1127.branch-20.2.patch Make the test better. > Improve the speed of FileSystem object cr

[jira] Updated: (HDFS-1127) Improve the speed of FileSystem object creation

2010-05-04 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1127: - Status: Patch Available (was: Open) > Improve the speed of FileSystem object creation > -

[jira] Updated: (HDFS-1127) Improve the speed of FileSystem object creation

2010-05-04 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1127: - Attachment: HDFS-1127.1.patch Patch includes new unit tests. > Improve the speed of FileSystem object cre

[jira] Created: (HDFS-1127) Improve the speed of FileSystem object creation

2010-05-03 Thread Zheng Shao (JIRA)
Improve the speed of FileSystem object creation --- Key: HDFS-1127 URL: https://issues.apache.org/jira/browse/HDFS-1127 Project: Hadoop HDFS Issue Type: Improvement Affects Versions: 0.20.2, 0.

[jira] Updated: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1118: - Status: Open (was: Patch Available) > DFSOutputStream socket leak when cannot connect to DataNode > -

[jira] Updated: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-30 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1118: - Status: Patch Available (was: Open) > DFSOutputStream socket leak when cannot connect to DataNode > -

[jira] Updated: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1118: - Status: Patch Available (was: Open) > DFSOutputStream socket leak when cannot connect to DataNode > -

[jira] Updated: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1118: - Attachment: HDFS-1118.2.patch Moved the cleanup to finally section. > DFSOutputStream socket leak when ca

[jira] Updated: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-29 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1118: - Status: Open (was: Patch Available) > DFSOutputStream socket leak when cannot connect to DataNode > -

[jira] Updated: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1118: - Attachment: HDFS-1118.1.patch This patch does not have a unit test yet. Not sure what is the best way to

[jira] Updated: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-1118: - Status: Patch Available (was: Open) > DFSOutputStream socket leak when cannot connect to DataNode > -

[jira] Created: (HDFS-1118) DFSOutputStream socket leak when cannot connect to DataNode

2010-04-28 Thread Zheng Shao (JIRA)
DFSOutputStream socket leak when cannot connect to DataNode --- Key: HDFS-1118 URL: https://issues.apache.org/jira/browse/HDFS-1118 Project: Hadoop HDFS Issue Type: Bug Affects Vers

[jira] Commented: (HDFS-987) HDFS/HFTP InputStream to expose the information about whether a file is under construction or not

2010-02-18 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12835452#action_12835452 ] Zheng Shao commented on HDFS-987: - Sure. We uses http://github.com/facebook/scribe to write l

[jira] Created: (HDFS-987) HDFS/HFTP InputStream to expose the information about whether a file is under construction or not

2010-02-18 Thread Zheng Shao (JIRA)
HDFS/HFTP InputStream to expose the information about whether a file is under construction or not - Key: HDFS-987 URL: https://issues.apache.org/jira/browse/HDFS-987

[jira] Commented: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-02-18 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12835356#action_12835356 ] Zheng Shao commented on HDFS-878: - Hairong, I guess you mean DFSInputStream provides the visi

[jira] Assigned: (HDFS-952) FSNamesystem.setTimes fails on directory

2010-02-04 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao reassigned HDFS-952: --- Assignee: Guanghao Shen > FSNamesystem.setTimes fails on directory > --

[jira] Created: (HDFS-952) FSNamesystem.setTimes fails on directory

2010-02-04 Thread Zheng Shao (JIRA)
FSNamesystem.setTimes fails on directory Key: HDFS-952 URL: https://issues.apache.org/jira/browse/HDFS-952 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.22.0 Reporter: Zheng

[jira] Commented: (HDFS-879) FileStatus should have the visible length of the file

2010-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798844#action_12798844 ] Zheng Shao commented on HDFS-879: - A mistake in 2A above. FileStatus should be DFSFileStatus.

[jira] Commented: (HDFS-879) FileStatus should have the visible length of the file

2010-01-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798832#action_12798832 ] Zheng Shao commented on HDFS-879: - I mean data node sends heartbeat with latest/visible size

[jira] Commented: (HDFS-879) FileStatus should have the visible length of the file

2010-01-08 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798227#action_12798227 ] Zheng Shao commented on HDFS-879: - do it in 2 ways: 1. Only do it for files under constructi

[jira] Commented: (HDFS-879) FileStatus should have the visible length of the file

2010-01-08 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798225#action_12798225 ] Zheng Shao commented on HDFS-879: - I think cost won't be a big concern: As commented in HDFS

[jira] Commented: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-08 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12798215#action_12798215 ] Zheng Shao commented on HDFS-878: - Instead of changing FileStatus which is incompatible, we c

[jira] Commented: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797819#action_12797819 ] Zheng Shao commented on HDFS-878: - There are 2 use cases: 1. {{DistributedFileSystem.listSta

[jira] Updated: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-878: Description: Currently DFSClient has no way to know whether a file is under construction or not, unless we o

[jira] Created: (HDFS-879) FileStatus should have the visible length of the file

2010-01-07 Thread Zheng Shao (JIRA)
FileStatus should have the visible length of the file - Key: HDFS-879 URL: https://issues.apache.org/jira/browse/HDFS-879 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] Created: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Zheng Shao (JIRA)
FileStatus should have a field "isUnderConstruction" Key: HDFS-878 URL: https://issues.apache.org/jira/browse/HDFS-878 Project: Hadoop HDFS Issue Type: New Feature Reporter: Zh

[jira] Commented: (HDFS-770) SocketTimeoutException: timeout while waiting for channel to be ready for read

2009-12-22 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793720#action_12793720 ] Zheng Shao commented on HDFS-770: - bad machine: {code} /proc/sys/vm/block_dump:0 /proc/sys/vm

[jira] Commented: (HDFS-770) SocketTimeoutException: timeout while waiting for channel to be ready for read

2009-12-21 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12793371#action_12793371 ] Zheng Shao commented on HDFS-770: - The new machine is running: "Linux hadoop0100.xxx.yyy.com

[jira] Updated: (HDFS-770) SocketTimeoutException: timeout while waiting for channel to be ready for read

2009-12-21 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-770: Attachment: filewriter.cpp filewriter.cpp: A simple program to test whether the box will block continuous wr

[jira] Commented: (HDFS-770) SocketTimeoutException: timeout while waiting for channel to be ready for read

2009-12-11 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789514#action_12789514 ] Zheng Shao commented on HDFS-770: - In my case, it seems a problem with my box. It's running "

[jira] Commented: (HDFS-770) SocketTimeoutException: timeout while waiting for channel to be ready for read

2009-12-08 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787900#action_12787900 ] Zheng Shao commented on HDFS-770: - I saw the same thing with hadoop 0.19 while doing heavy-we

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-10 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.branch-20.v6.patch Attaching the patch for hadoop 0.20. Although we don't need it for ap

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-09 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12775257#action_12775257 ] Zheng Shao commented on HDFS-611: - Dhruba, can you check if your workspace has HDFS-733 in? T

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Status: Patch Available (was: Open) > Heartbeats times from Datanodes increase when there are plenty of bloc

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Status: Open (was: Patch Available) > Heartbeats times from Datanodes increase when there are plenty of bloc

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.trunk.v6.patch Moved ReplicaFileDeletionTask and deleteAsync into FSDatasetAsyncDiskServ

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-05 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774070#action_12774070 ] Zheng Shao commented on HDFS-611: - bq. It is better to keep the whole implementation in one p

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.trunk.v5.patch bq. It would look really good if you could move the deleteAsync() method

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Status: Patch Available (was: Open) Re-trigger unit tests. > Heartbeats times from Datanodes increase when

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-03 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Status: Open (was: Patch Available) > Heartbeats times from Datanodes increase when there are plenty of bloc

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Status: Patch Available (was: Open) > Heartbeats times from Datanodes increase when there are plenty of bloc

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Status: Open (was: Patch Available) > Heartbeats times from Datanodes increase when there are plenty of bloc

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: (was: HDFS-611.trunk.v4.patch) > Heartbeats times from Datanodes increase when there are plen

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-11-02 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.trunk.v4.patch > Heartbeats times from Datanodes increase when there are plenty of block

  1   2   >