[jira] [Updated] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-25 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated HDFS-10220: --- Status: Patch Available (was: Open) > Namenode failover due to too long loking in LeaseManage

[jira] [Updated] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-25 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated HDFS-10220: --- Status: Open (was: Patch Available) > Namenode failover due to too long loking in LeaseManage

[jira] [Created] (HDFS-10328) Add cache pool level replication managment

2016-04-25 Thread xupeng (JIRA)
xupeng created HDFS-10328: - Summary: Add cache pool level replication managment Key: HDFS-10328 URL: https://issues.apache.org/jira/browse/HDFS-10328 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10217) show "blockScheduled count" in datanodes table.

2016-04-25 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257600#comment-15257600 ] Vinayakumar B commented on HDFS-10217: -- How about making it scheduled count as a "too

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257593#comment-15257593 ] Hadoop QA commented on HDFS-10324: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257577#comment-15257577 ] Hudson commented on HDFS-9869: -- FAILURE: Integrated in Hadoop-trunk-Commit #9667 (See [https:

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9869: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Committed t

[jira] [Updated] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9869: Hadoop Flags: Reviewed Thanks Rakesh for the update. +1 on the latest patch. Committing to trunk shortly. >

[jira] [Commented] (HDFS-10305) Hdfs audit shouldn't log mkdir operaton if the directory already exists.

2016-04-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257537#comment-15257537 ] Ravi Prakash commented on HDFS-10305: - Thanks Colin! That's interesting then. {{hdfs

[jira] [Commented] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-04-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257483#comment-15257483 ] Brahma Reddy Battula commented on HDFS-9902: [~arpitagarwal] if you've chance,,

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.009.patch > Implement asynchronous rename for DistributedFileSyst

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: (was: HDFS-10224-HDFS-9924.009.patch) > Implement asynchronous rename for Distribu

[jira] [Updated] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10324: --- Attachment: HDFS-10324.003.patch Thanks [~andrew.wang]. I think your proposal is a reasonable

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257422#comment-15257422 ] He Tianyi commented on HDFS-10326: -- Some system may not support auto tuning, defaulting t

[jira] [Commented] (HDFS-10305) Hdfs audit shouldn't log mkdir operaton if the directory already exists.

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257383#comment-15257383 ] Colin Patrick McCabe commented on HDFS-10305: - Thanks, [~raviprak]. It's alwa

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-04-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257341#comment-15257341 ] Ming Ma commented on HDFS-10320: [~xiaochen], regarding the expected behavior, besides you

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257289#comment-15257289 ] Takanobu Asanuma commented on HDFS-10325: - Thank you for committing the patch, [~i

[jira] [Commented] (HDFS-10327) Open files in WEBHDFS which are stored in folders by Spark

2016-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257291#comment-15257291 ] Chris Nauroth commented on HDFS-10327: -- As originally described, it was an ask for We

[jira] [Commented] (HDFS-10327) Open files in WEBHDFS which are stored in folders by Spark

2016-04-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257283#comment-15257283 ] Wei-Chiu Chuang commented on HDFS-10327: I think that instead of marking this as "

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-25 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257281#comment-15257281 ] Takanobu Asanuma commented on HDFS-8057: Thank you for committing the patch, [~szet

[jira] [Resolved] (HDFS-10327) Open files in WEBHDFS which are stored in folders by Spark

2016-04-25 Thread Thomas Hille (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Hille resolved HDFS-10327. - Resolution: Won't Fix > Open files in WEBHDFS which are stored in folders by Spark > -

[jira] [Updated] (HDFS-10327) Open files in WEBHDFS which are stored in folders by Spark

2016-04-25 Thread Thomas Hille (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Hille updated HDFS-10327: Issue Type: Improvement (was: Bug) > Open files in WEBHDFS which are stored in folders by Spark > -

[jira] [Commented] (HDFS-10327) Open files in WEBHDFS which are stored in folders by Spark

2016-04-25 Thread Thomas Hille (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257266#comment-15257266 ] Thomas Hille commented on HDFS-10327: - Hej Chris Nauroth, they dont use any special se

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257227#comment-15257227 ] Ravi Prakash commented on HDFS-10220: - Thanks Walter! I too would favor a timeout, (ma

[jira] [Commented] (HDFS-9545) DiskBalancer : Add Plan Command

2016-04-25 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257202#comment-15257202 ] Lei (Eddy) Xu commented on HDFS-9545: - Hi, [~anu] Thanks for posting this. {code} if (

[jira] [Issue Comment Deleted] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10224: --- Comment: was deleted (was: Github user xiaobingo closed the pull request at: http

[jira] [Issue Comment Deleted] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10224: --- Comment: was deleted (was: GitHub user xiaobingo opened a pull request: https://g

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257176#comment-15257176 ] Hudson commented on HDFS-10325: --- FAILURE: Integrated in Hadoop-trunk-Commit #9666 (See [htt

[jira] [Commented] (HDFS-10327) Open files in WEBHDFS which are stored in folders by Spark

2016-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257170#comment-15257170 ] Chris Nauroth commented on HDFS-10327: -- Hello [~SonGuko]. I'm not familiar with how

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257164#comment-15257164 ] Konstantin Shvachko commented on HDFS-10301: Yes, on trunk {{generateUniqueBlo

[jira] [Commented] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257153#comment-15257153 ] Hadoop QA commented on HDFS-10224: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-10325: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Created] (HDFS-10327) Open files in WEBHDFS which are stored in folders by Spark

2016-04-25 Thread Thomas Hille (JIRA)
Thomas Hille created HDFS-10327: --- Summary: Open files in WEBHDFS which are stored in folders by Spark Key: HDFS-10327 URL: https://issues.apache.org/jira/browse/HDFS-10327 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257099#comment-15257099 ] Mingliang Liu commented on HDFS-10175: -- Thanks for proposing the discussion. The time

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257074#comment-15257074 ] Colin Patrick McCabe commented on HDFS-10175: - We already have three statistic

[jira] [Commented] (HDFS-10305) Hdfs audit shouldn't log mkdir operaton if the directory already exists.

2016-04-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257038#comment-15257038 ] Ravi Prakash commented on HDFS-10305: - Rushabh! Do you want to re-open this ticket if

[jira] [Updated] (HDFS-10320) Rack failures may result in NN terminate

2016-04-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10320: - Attachment: HDFS-10324.002.patch I went through this again, and feels the current way of falling back to l

[jira] [Commented] (HDFS-10305) Hdfs audit shouldn't log mkdir operaton if the directory already exists.

2016-04-25 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257010#comment-15257010 ] Ravi Prakash commented on HDFS-10305: - Cool! Thanks for the pointer Colin! I knew ther

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257008#comment-15257008 ] Mingliang Liu commented on HDFS-10326: -- {quote} If we strongly believe that auto-tuni

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.009.patch > Implement asynchronous rename for DistributedFileSyst

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: (was: HDFS-10224-HDFS-9924.009.patch) > Implement asynchronous rename for Distribu

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256891#comment-15256891 ] Steve Loughran commented on HDFS-10175: --- yes, could have a talk. I actually thinks t

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256862#comment-15256862 ] Hudson commented on HDFS-8057: -- FAILURE: Integrated in Hadoop-trunk-Commit #9665 (See [https:

[jira] [Commented] (HDFS-10323) transient deleteOnExit failure in ViewFileSystem due to close() ordering

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256861#comment-15256861 ] Colin Patrick McCabe commented on HDFS-10323: - Thanks for the detailed bug rep

[jira] [Commented] (HDFS-10305) Hdfs audit shouldn't log mkdir operaton if the directory already exists.

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256858#comment-15256858 ] Colin Patrick McCabe commented on HDFS-10305: - bq. I believe the audit log was

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256848#comment-15256848 ] Colin Patrick McCabe commented on HDFS-10326: - bq. I think we can keep the con

[jira] [Comment Edited] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256842#comment-15256842 ] Colin Patrick McCabe edited comment on HDFS-10175 at 4/25/16 7:20 PM: --

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256843#comment-15256843 ] Brahma Reddy Battula commented on HDFS-10326: - I too feel same, we can disable

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256842#comment-15256842 ] Colin Patrick McCabe commented on HDFS-10175: - Thanks for commenting, [~steve_

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256825#comment-15256825 ] Kihwal Lee commented on HDFS-10326: --- I think we can keep the configurability, but set th

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256824#comment-15256824 ] Tsz Wo Nicholas Sze commented on HDFS-8057: --- I have committed the patch to trunk.

[jira] [Comment Edited] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256803#comment-15256803 ] Tsz Wo Nicholas Sze edited comment on HDFS-8057 at 4/25/16 7:03 PM: -

[jira] [Updated] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-25 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8057: -- Hadoop Flags: Reviewed +1 the .3 and .5 patches look good. > Move BlockReader implementa

[jira] [Comment Edited] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256791#comment-15256791 ] Colin Patrick McCabe edited comment on HDFS-10301 at 4/25/16 6:58 PM: --

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256791#comment-15256791 ] Colin Patrick McCabe commented on HDFS-10301: - bq. [~shv] wrote: The last line

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256742#comment-15256742 ] Xiaoyu Yao commented on HDFS-10324: --- Thanks [~andrew.wang] for the comments. I agree it

[jira] [Updated] (HDFS-9543) DiskBalancer : Add Data mover

2016-04-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9543: --- Status: Open (was: Patch Available) > DiskBalancer : Add Data mover > --

[jira] [Updated] (HDFS-9543) DiskBalancer : Add Data mover

2016-04-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9543: --- Status: Patch Available (was: Open) > DiskBalancer : Add Data mover > --

[jira] [Commented] (HDFS-9543) DiskBalancer : Add Data mover

2016-04-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256730#comment-15256730 ] Anu Engineer commented on HDFS-9543: error seems to network related -- Failed to fetch

[jira] [Commented] (HDFS-9543) DiskBalancer : Add Data mover

2016-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256725#comment-15256725 ] Hadoop QA commented on HDFS-9543: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256716#comment-15256716 ] Mingliang Liu commented on HDFS-10326: -- Thanks for reporting this. FWIW, [HDFS-8829]a

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256715#comment-15256715 ] Arpit Agarwal commented on HDFS-10326: -- +1 to stop setting this value. > Disable set

[jira] [Updated] (HDFS-9543) DiskBalancer : Add Data mover

2016-04-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9543: --- Attachment: HDFS-9543-HDFS-1312.002.patch updating the patch based on comments from [~arpitagarwal] >

[jira] [Commented] (HDFS-334) dfsadmin -metasave should also log corrupt replicas info

2016-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256705#comment-15256705 ] Hadoop QA commented on HDFS-334: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Sub

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256691#comment-15256691 ] Hadoop QA commented on HDFS-10325: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256688#comment-15256688 ] Esteban Gutierrez commented on HDFS-10326: -- +1 to have a conf knob with the defau

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256686#comment-15256686 ] Mingliang Liu commented on HDFS-10325: -- Failing tests are not related. +1 (non-bindin

[jira] [Updated] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10326: --- Description: The DataStreamer and the Datanode use a hardcoded DEFAULT_DATA_SOCKET_SIZE=128K for the

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256667#comment-15256667 ] Daryn Sharp commented on HDFS-10326: My vote is remove entirely and allow the system c

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1525#comment-1525 ] Andrew Wang commented on HDFS-10324: I'm somewhat concerned about the compatibility is

[jira] [Created] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10326: -- Summary: Disable setting tcp socket send/receive buffers for write pipelines Key: HDFS-10326 URL: https://issues.apache.org/jira/browse/HDFS-10326 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256657#comment-15256657 ] Hadoop QA commented on HDFS-10324: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Status: Patch Available (was: Open) > Implement asynchronous rename for DistributedFileSystem > -

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Status: Open (was: Patch Available) > Implement asynchronous rename for DistributedFileSystem > -

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256633#comment-15256633 ] Xiaoyu Yao commented on HDFS-10324: --- [~jojochuang], I mentioned #2 because Trash is clie

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256614#comment-15256614 ] Hadoop QA commented on HDFS-10325: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-25 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256604#comment-15256604 ] Andras Bokor commented on HDFS-10318: - Thanks for taking care with this [~kihwal]. We

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256596#comment-15256596 ] John Zhuge commented on HDFS-10287: --- Thanks [~boky01] for creating the patch, however, y

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-25 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256594#comment-15256594 ] Andras Bokor commented on HDFS-10287: - You are right. This was linked to YARN-4959 as

[jira] [Commented] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256582#comment-15256582 ] Hudson commented on HDFS-10318: --- FAILURE: Integrated in Hadoop-trunk-Commit #9664 (See [htt

[jira] [Updated] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10318: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.009.patch > Implement asynchronous rename for DistributedFileSyst

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256569#comment-15256569 ] Wei-Chiu Chuang commented on HDFS-10324: Thanks [~xyao] for the comments. Regardin

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: (was: HDFS-10224-HDFS-9924.009.patch) > Implement asynchronous rename for Distribu

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: HDFS-10224-HDFS-9924.009.patch > Implement asynchronous rename for DistributedFileSyst

[jira] [Updated] (HDFS-10224) Implement asynchronous rename for DistributedFileSystem

2016-04-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10224: - Attachment: (was: HDFS-10224-HDFS-9924.009.patch) > Implement asynchronous rename for Distribu

[jira] [Commented] (HDFS-10318) TestJMXGet hides the real error in case of test failure

2016-04-25 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256552#comment-15256552 ] Kihwal Lee commented on HDFS-10318: --- +1 lgtm > TestJMXGet hides the real error in case

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256550#comment-15256550 ] John Zhuge commented on HDFS-10287: --- This jira is not a clone of YARN-4959. > MiniDFSCl

[jira] [Updated] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-04-25 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8057: --- Attachment: HDFS-8057.4.patch The failed test, which is {{TestDFSShell.testMoveWithTargetPortEm

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-25 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256505#comment-15256505 ] Xiaoyu Yao commented on HDFS-10324: --- Thanks [~jojochuang] for updating the patch. Here a

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256493#comment-15256493 ] Brahma Reddy Battula commented on HDFS-10325: - +1 ( non-binding).. > TestDFSS

[jira] [Updated] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-10325: Component/s: test > TestDFSShell#testMoveWithTargetPortEmpty fails > ---

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256492#comment-15256492 ] Masatake Iwasaki commented on HDFS-10325: - +1, pending jenkins. > TestDFSShell#te

[jira] [Updated] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-10325: Affects Version/s: 3.0.0 > TestDFSShell#testMoveWithTargetPortEmpty fails >

[jira] [Updated] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10325: Attachment: HDFS-10325.2.patch Thank you for your advice, [~iwasakims]. I agree with you. I

[jira] [Commented] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256452#comment-15256452 ] Masatake Iwasaki commented on HDFS-10325: - Thanks for the patch, [~tasanuma0829].

[jira] [Commented] (HDFS-334) dfsadmin -metasave should also log corrupt replicas info

2016-04-25 Thread Denis Bolshakov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256430#comment-15256430 ] Denis Bolshakov commented on HDFS-334: -- @Hadoop QA, I've checked these failed tests lo

[jira] [Updated] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10325: Status: Patch Available (was: Open) > TestDFSShell#testMoveWithTargetPortEmpty fails >

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-25 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10287: Attachment: HDFS-10287.01.patch I attached a patch where I was looking for methods in test classes w

[jira] [Updated] (HDFS-10325) TestDFSShell#testMoveWithTargetPortEmpty fails

2016-04-25 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-10325: Attachment: HDFS-10325.1.patch HDFS doesn't use default ports as ephemeral ports by HDFS-942

  1   2   >