[jira] [Commented] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083879#comment-14083879 ] Hadoop QA commented on HDFS-6783: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6782) Improve FS editlog logSync

2014-08-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6782: - Attachment: HDFS-6782.002.patch Update patch and verified locally. > Improve FS editlog logSync > ---

[jira] [Updated] (HDFS-573) Porting libhdfs to Windows

2014-08-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-573: --- Hadoop Flags: Reviewed The test failures are unrelated. I'm planning to commit this on Monday, 8/4. >

[jira] [Commented] (HDFS-6810) StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083847#comment-14083847 ] Hudson commented on HDFS-6810: -- FAILURE: Integrated in Hadoop-trunk-Commit #6002 (See [https:

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083846#comment-14083846 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6812) Reomve addBlock and replaceBlock from DatanodeDescriptor

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083844#comment-14083844 ] Hadoop QA commented on HDFS-6812: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6810) StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6810: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target Version/s:

[jira] [Updated] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-08-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6783: - Attachment: HDFS-6783.006.patch Thanks [~cmccabe], I agree with the logic in the new patch. One small nit: initia

[jira] [Commented] (HDFS-6810) StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083822#comment-14083822 ] Hadoop QA commented on HDFS-6810: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.002.patch Version 002 to address test failure. > distcp from insecure cluste

[jira] [Updated] (HDFS-6812) Reomve addBlock and replaceBlock from DatanodeDescriptor

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6812: -- Component/s: namenode > Reomve addBlock and replaceBlock from DatanodeDescriptor > -

[jira] [Updated] (HDFS-6812) Reomve addBlock and replaceBlock from DatanodeDescriptor

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6812: -- Status: Patch Available (was: Open) > Reomve addBlock and replaceBlock from DatanodeDes

[jira] [Updated] (HDFS-6812) Reomve addBlock and replaceBlock from DatanodeDescriptor

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6812: -- Attachment: (was: h6812_20140803.patch) > Reomve addBlock and replaceBlock from Data

[jira] [Updated] (HDFS-6812) Reomve addBlock and replaceBlock from DatanodeDescriptor

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6812: -- Attachment: h6812_20140803.patch > Reomve addBlock and replaceBlock from DatanodeDescrip

[jira] [Updated] (HDFS-6812) Reomve addBlock and replaceBlock from DatanodeDescriptor

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6812: -- Attachment: h6812_20140803.patch h6812_20140803.patch: removes both methods and also cle

[jira] [Created] (HDFS-6812) Reomve addBlock and replaceBlock from DatanodeDescriptor

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-6812: - Summary: Reomve addBlock and replaceBlock from DatanodeDescriptor Key: HDFS-6812 URL: https://issues.apache.org/jira/browse/HDFS-6812 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6810) StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083766#comment-14083766 ] Ted Yu commented on HDFS-6810: -- Thanks for taking care of this, Nicolas. > StorageReport arra

[jira] [Updated] (HDFS-6810) StorageReport is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6810: - Summary: StorageReport is initialized with wrong size in DatanodeDescriptor#getStorageReports (was: storageMap is

[jira] [Updated] (HDFS-6810) StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6810: - Summary: StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports (was: Storage

[jira] [Updated] (HDFS-6810) storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6810: -- Status: Patch Available (was: Open) > storageMap is accessed without proper synchroniza

[jira] [Updated] (HDFS-6810) storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6810: -- Attachment: h6810_20140803.patch Ted, good catch. It should not call storageMap.size().

[jira] [Updated] (HDFS-6810) storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6810: -- Component/s: namenode > storageMap is accessed without proper synchronization in > Data

[jira] [Assigned] (HDFS-6810) storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-6810: - Assignee: Tsz Wo Nicholas Sze > storageMap is accessed without proper synchronizat

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083692#comment-14083692 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6811) Fix bad default value for dfs.namenode.list.encryption.zones.num.responses

2014-08-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6811: -- Attachment: hdfs-6811.001.patch Patch attached, trivial. Unit tests are currently broken. > Fix bad def

[jira] [Work started] (HDFS-6811) Fix bad default value for dfs.namenode.list.encryption.zones.num.responses

2014-08-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6811 started by Andrew Wang. > Fix bad default value for dfs.namenode.list.encryption.zones.num.responses > --

[jira] [Created] (HDFS-6811) Fix bad default value for dfs.namenode.list.encryption.zones.num.responses

2014-08-02 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6811: - Summary: Fix bad default value for dfs.namenode.list.encryption.zones.num.responses Key: HDFS-6811 URL: https://issues.apache.org/jira/browse/HDFS-6811 Project: Hadoop HDFS

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083658#comment-14083658 ] Hadoop QA commented on HDFS-573: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083652#comment-14083652 ] Hadoop QA commented on HDFS-573: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-08-02 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6134: -- Attachment: HDFS-6134_test_plan.pdf I've attached a test plan we will execute for this feature. Feel fre

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Status: Patch Available (was: Open) Submit patch 001 for webhdfs in trunk. Will add hftp fix for br

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.001.patch > distcp from insecure cluster (source) to secure cluster (destinati

[jira] [Updated] (HDFS-573) Porting libhdfs to Windows

2014-08-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-573: --- Attachment: HDFS-573.4.patch > Porting libhdfs to Windows > -- > >

[jira] [Commented] (HDFS-573) Porting libhdfs to Windows

2014-08-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083597#comment-14083597 ] Hadoop QA commented on HDFS-573: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083590#comment-14083590 ] Hudson commented on HDFS-6794: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1850 (See [htt

[jira] [Commented] (HDFS-6802) Some tests in TestDFSClientFailover are missing @Test annotation

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083586#comment-14083586 ] Hudson commented on HDFS-6802: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1850 (See [htt

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083589#comment-14083589 ] Hudson commented on HDFS-6482: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1850 (See [htt

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083591#comment-14083591 ] Hudson commented on HDFS-6788: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1850 (See [htt

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083569#comment-14083569 ] Hudson commented on HDFS-6482: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1825 (See [https://

[jira] [Commented] (HDFS-6796) Improving the argument check during balancer command line parsing

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083570#comment-14083570 ] Hudson commented on HDFS-6796: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1825 (See [https://

[jira] [Commented] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083571#comment-14083571 ] Hudson commented on HDFS-6794: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1825 (See [https://

[jira] [Commented] (HDFS-6802) Some tests in TestDFSClientFailover are missing @Test annotation

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083566#comment-14083566 ] Hudson commented on HDFS-6802: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1825 (See [https://

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083572#comment-14083572 ] Hudson commented on HDFS-6788: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1825 (See [https://

[jira] [Created] (HDFS-6810) storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6810: Summary: storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports Key: HDFS-6810 URL: https://issues.apache.org/jira/browse/HDFS-6810 Project: Ha

[jira] [Commented] (HDFS-6794) Update BlockManager methods to use DatanodeStorageInfo where possible

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083526#comment-14083526 ] Hudson commented on HDFS-6794: -- FAILURE: Integrated in Hadoop-Yarn-trunk #631 (See [https://b

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083524#comment-14083524 ] Hudson commented on HDFS-6482: -- FAILURE: Integrated in Hadoop-Yarn-trunk #631 (See [https://b

[jira] [Commented] (HDFS-6802) Some tests in TestDFSClientFailover are missing @Test annotation

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083521#comment-14083521 ] Hudson commented on HDFS-6802: -- FAILURE: Integrated in Hadoop-Yarn-trunk #631 (See [https://b

[jira] [Commented] (HDFS-6796) Improving the argument check during balancer command line parsing

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083525#comment-14083525 ] Hudson commented on HDFS-6796: -- FAILURE: Integrated in Hadoop-Yarn-trunk #631 (See [https://b

[jira] [Commented] (HDFS-6788) Improve synchronization in BPOfferService with read write lock

2014-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14083527#comment-14083527 ] Hudson commented on HDFS-6788: -- FAILURE: Integrated in Hadoop-Yarn-trunk #631 (See [https://b