[jira] [Issue Comment Deleted] (HDFS-10361) Support starting StorageContainerManager as a daemon

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10361: - Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10361) Support starting StorageContainerManager as a daemon

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10361: - Attachment: HDFS-10361-HDFS-7240.01.patch > Support starting StorageContainerManager as a daemon

[jira] [Updated] (HDFS-10361) Support starting StorageContainerManager as a daemon

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10361: - Attachment: (was: HDFS-10361.01.patch) > Support starting StorageContainerManager as a daemon

[jira] [Commented] (HDFS-10361) Support starting StorageContainerManager as a daemon

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270099#comment-15270099 ] Hadoop QA commented on HDFS-10361: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10361) Support starting StorageContainerManager as a daemon

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10361: - Status: Patch Available (was: Open) > Support starting StorageContainerManager as a daemon >

[jira] [Updated] (HDFS-10361) Support starting StorageContainerManager as a daemon

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10361: - Attachment: HDFS-10361.01.patch v01 patch adds a new service to the {{hdfs}} script called

[jira] [Created] (HDFS-10361) Support starting StorageContainerManager as a daemon

2016-05-03 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-10361: Summary: Support starting StorageContainerManager as a daemon Key: HDFS-10361 URL: https://issues.apache.org/jira/browse/HDFS-10361 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10338) DistCp masks potential CRC check failures

2016-05-03 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270094#comment-15270094 ] Lin Yiqun commented on HDFS-10338: -- Hi, [~raviprak], thanks for review. I agree with your comment. Is

[jira] [Commented] (HDFS-10346) Implement asynchronous setPermission for DistributedFileSystem

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270045#comment-15270045 ] Hadoop QA commented on HDFS-10346: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270042#comment-15270042 ] Arpit Agarwal commented on HDFS-10359: -- Hi [~Tao Jie], processing full block reports is an expensive

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-05-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270026#comment-15270026 ] Mingliang Liu commented on HDFS-10220: -- I also think changing from {{Lease leaseToCheck =

[jira] [Commented] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-03 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270024#comment-15270024 ] Tao Jie commented on HDFS-10359: [~kihwal], [~cnauroth], [~arpitagarwal], [~linyiqun] Thank you for reply!

[jira] [Commented] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269973#comment-15269973 ] Hadoop QA commented on HDFS-10360: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-2173) saveNamespace should not throw IOE when only one storage directory fails to write VERSION file

2016-05-03 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269962#comment-15269962 ] Todd Lipcon commented on HDFS-2173: --- Hrm, the original test/bug was filed >4.5 years ago so I'm a bit

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-05-03 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269921#comment-15269921 ] Ravi Prakash commented on HDFS-10220: - Thanks Nicolas! You're amazing :-) I think I would like to hear

[jira] [Commented] (HDFS-10338) DistCp masks potential CRC check failures

2016-05-03 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269909#comment-15269909 ] Ravi Prakash commented on HDFS-10338: - {{ignoreFailures}} would be a tragically confusing and misnamed

[jira] [Commented] (HDFS-9902) Support different values of dfs.datanode.du.reserved per storage type

2016-05-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269902#comment-15269902 ] Hudson commented on HDFS-9902: -- FAILURE: Integrated in Hadoop-trunk-Commit #9709 (See

[jira] [Updated] (HDFS-9902) Support different values of dfs.datanode.du.reserved per storage type

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9902: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269860#comment-15269860 ] Hadoop QA commented on HDFS-9890: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10344) DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash

2016-05-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10344: -- Reporter: Namit Maheshwari (was: Xiaoyu Yao) > DistributedFileSystem#getTrashRoots should skip

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269807#comment-15269807 ] Hadoop QA commented on HDFS-10324: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.005.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-05-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269766#comment-15269766 ] Andrew Wang commented on HDFS-9924: --- Hi all, a few notes: * Can we do this work on a branch? This is a

[jira] [Commented] (HDFS-10346) Implement asynchronous setPermission for DistributedFileSystem

2016-05-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269735#comment-15269735 ] Xiaobing Zhou commented on HDFS-10346: -- The patch v000 is posted for review. I will add more tests in

[jira] [Updated] (HDFS-10346) Implement asynchronous setPermission for DistributedFileSystem

2016-05-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10346: - Attachment: HDFS-10346-HDFS-9924.000.patch > Implement asynchronous setPermission for

[jira] [Updated] (HDFS-10346) Implement asynchronous setPermission for DistributedFileSystem

2016-05-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10346: - Status: Patch Available (was: Open) > Implement asynchronous setPermission for

[jira] [Commented] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269669#comment-15269669 ] Wei-Chiu Chuang commented on HDFS-10360: In addition to the fix, it should also report the error

[jira] [Updated] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10360: --- Description: Under certain circumstances, if the current/VERSION of a storage directory is

[jira] [Updated] (HDFS-10360) DataNode may format directory and lose blocks if current/VERSION is missing

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10360: --- Summary: DataNode may format directory and lose blocks if current/VERSION is missing (was:

[jira] [Updated] (HDFS-10360) DataNode may format directory and lose blocks if If current/VERSION is missing

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10360: --- Status: Patch Available (was: Open) > DataNode may format directory and lose blocks if If

[jira] [Updated] (HDFS-10360) DataNode may format directory and lose blocks if If current/VERSION is missing

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10360: --- Attachment: HDFS-10360.001.patch Upload a proof of concept for the fix proposed in #1. >

[jira] [Created] (HDFS-10360) DataNode may format directory and lose blocks if If current/VERSION is missing

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10360: -- Summary: DataNode may format directory and lose blocks if If current/VERSION is missing Key: HDFS-10360 URL: https://issues.apache.org/jira/browse/HDFS-10360

[jira] [Commented] (HDFS-10320) Rack failures may result in NN terminate

2016-05-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269566#comment-15269566 ] Ming Ma commented on HDFS-10320: Thanks [~xiaochen]! The patch looks good overall. Couple questions: *

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269515#comment-15269515 ] Hadoop QA commented on HDFS-9890: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10348) Namenode report bad block method doesn't check whether the block belongs to datanode before adding it to corrupt replicas map.

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269397#comment-15269397 ] Hadoop QA commented on HDFS-10348: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9902) Support different values of dfs.datanode.du.reserved per storage type

2016-05-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269394#comment-15269394 ] Xiaoyu Yao commented on HDFS-9902: -- Thanks [~brahmareddy] for updating the patch. +1 for patch v05. >

[jira] [Updated] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-05-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10324: --- Attachment: HDFS-10324.005.patch Rev05: Thanks [~xyao] and [~andrew.wang]. I added an

[jira] [Updated] (HDFS-10355) Fix thread_local related build issue on Mac OS X

2016-05-03 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated HDFS-10355: -- Description: The native hdfs library uses C++11 features heavily. One of such feature is thread_local

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.004.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Commented] (HDFS-10355) Fix thread_local related build issue on Mac OS X

2016-05-03 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269166#comment-15269166 ] Tibor Kiss commented on HDFS-10355: --- Yes, it does have pthread support. > Fix thread_local related

[jira] [Updated] (HDFS-10354) Fix compilation & unit test issues on Mac OS X with clang compiler

2016-05-03 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated HDFS-10354: -- Description: Compilation fails with multiple errors on Mac OS X. Unit test

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269156#comment-15269156 ] Yongjun Zhang commented on HDFS-9732: - Hi [~liuml07], Thanks for your question. Please see some

[jira] [Commented] (HDFS-10355) Fix thread_local related build issue on Mac OS X

2016-05-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269134#comment-15269134 ] James Clampffer commented on HDFS-10355: Does the builtin version of clang on OSX have pthread

[jira] [Commented] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269106#comment-15269106 ] Kihwal Lee commented on HDFS-10359: --- Although this will be an excellent stress test tool, it will

[jira] [Commented] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269055#comment-15269055 ] Chris Nauroth commented on HDFS-10359: -- I also am not in favor of adding such a command, for the same

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268988#comment-15268988 ] James Clampffer commented on HDFS-9890: --- Patch looks good. I have some comments/open questions: Can

[jira] [Commented] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-05-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268954#comment-15268954 ] Colin Patrick McCabe commented on HDFS-10328: - Thanks for the patch, [~xupener]. {code} diff

[jira] [Updated] (HDFS-10348) Namenode report bad block method doesn't check whether the block belongs to datanode before adding it to corrupt replicas map.

2016-05-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10348: -- Status: Patch Available (was: Open) Attaching a new patch addressing white space and find bugs

[jira] [Updated] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

2016-05-03 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9823: - Resolution: Fixed Status: Resolved (was: Patch Available) This has been taken care of in

[jira] [Commented] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268894#comment-15268894 ] Arpit Agarwal commented on HDFS-10359: -- I agree with [~linyiqun]. This could bring down the NameNode

[jira] [Updated] (HDFS-10348) Namenode report bad block method doesn't check whether the block belongs to datanode before adding it to corrupt replicas map.

2016-05-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10348: -- Attachment: HDFS-10348-1.patch > Namenode report bad block method doesn't check whether the

[jira] [Updated] (HDFS-10348) Namenode report bad block method doesn't check whether the block belongs to datanode before adding it to corrupt replicas map.

2016-05-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10348: -- Status: Open (was: Patch Available) > Namenode report bad block method doesn't check whether

[jira] [Commented] (HDFS-10354) Fix compilation & unit test issues on Mac OS X with clang compiler

2016-05-03 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268892#comment-15268892 ] Bob Hansen commented on HDFS-10354: --- Thanks for bringing that to our attention, [~tibor.k...@gmail.com].

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268841#comment-15268841 ] Hadoop QA commented on HDFS-8449: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268740#comment-15268740 ] Hadoop QA commented on HDFS-10328: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7330) Unclosed RandomAccessFile warnings in FSDatasetIml.

2016-05-03 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268735#comment-15268735 ] Andras Bokor commented on HDFS-7330: [~shv] Where do you see the warning? > Unclosed RandomAccessFile

[jira] [Commented] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-03 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268541#comment-15268541 ] Lin Yiqun commented on HDFS-10359: -- Hi, [~Tao Jie], I don't think this is a good idea. If I trigger all

[jira] [Updated] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-05-03 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8449: Attachment: HDFS-8449-008.patch > Add tasks count metrics to datanode for ECWorker >

[jira] [Created] (HDFS-10359) Allow trigger block report from all datanodes

2016-05-03 Thread Tao Jie (JIRA)
Tao Jie created HDFS-10359: -- Summary: Allow trigger block report from all datanodes Key: HDFS-10359 URL: https://issues.apache.org/jira/browse/HDFS-10359 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268438#comment-15268438 ] Kai Zheng commented on HDFS-9833: - Thanks Rakesh for your understanding. It may help to explain about this

[jira] [Commented] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-05-03 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268433#comment-15268433 ] xupeng commented on HDFS-10328: --- Attach a new patch, modify cli command arg name , and change the filed name

[jira] [Updated] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-05-03 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xupeng updated HDFS-10328: -- Attachment: HDFS-10328.002.patch > Add per-cache-pool default replication num configuration >

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-05-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268378#comment-15268378 ] John Zhuge commented on HDFS-10287: --- [~boky01], do you think {{MiniDFSCluster}} should extend

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-05-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268300#comment-15268300 ] Hadoop QA commented on HDFS-8449: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-05-03 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268254#comment-15268254 ] xupeng commented on HDFS-10328: --- Hi [~cmccabe] : Thanks for your reply , and sorry for my late reply. I

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268251#comment-15268251 ] Rakesh R commented on HDFS-9833: Following is the brief idea about the proposed approach. Kindly go through

[jira] [Updated] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-05-03 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xupeng updated HDFS-10328: -- Release Note: Add per-cache-pool default replication num configuration (was: add cache pool level replication

[jira] [Updated] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-05-03 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xupeng updated HDFS-10328: -- Summary: Add per-cache-pool default replication num configuration (was: Add per-cache-pool default replication

[jira] [Updated] (HDFS-10328) Add per-cache-pool default replication configuration

2016-05-03 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xupeng updated HDFS-10328: -- Description: For now, hdfs cacheadmin can not set a default replication num for cached directive in the same

[jira] [Updated] (HDFS-10328) Add per-cache-pool default replication configuration

2016-05-03 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xupeng updated HDFS-10328: -- Summary: Add per-cache-pool default replication configuration (was: Add cache pool level replication managment

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-05-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268230#comment-15268230 ] Kai Zheng commented on HDFS-8449: - The latest patch LGTM. +1 on Jenkins. > Add tasks count metrics to