[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-03 Thread Hangjun Ye (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016335#comment-14016335 ] Hangjun Ye commented on HDFS-6382: -- Thanks Haohui and Colin. The balancer or a

[jira] [Commented] (HDFS-6465) Enable the configuration of multiple clusters

2014-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016353#comment-14016353 ] Vinayakumar B commented on HDFS-6465: - Hi [~dian.fu], This patch looks good. I have

[jira] [Commented] (HDFS-6424) blockReport doesn't need to invalidate blocks on SBN

2014-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016405#comment-14016405 ] Hudson commented on HDFS-6424: -- FAILURE: Integrated in Hadoop-Yarn-trunk #572 (See

[jira] [Commented] (HDFS-6109) let sync_file_range() system call run in background

2014-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016406#comment-14016406 ] Hudson commented on HDFS-6109: -- FAILURE: Integrated in Hadoop-Yarn-trunk #572 (See

[jira] [Commented] (HDFS-6464) Support multiple xattr.name parameters for WebHDFS getXAttrs.

2014-06-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016481#comment-14016481 ] Charles Lamb commented on HDFS-6464: bq. It happens when there is no value for some

[jira] [Commented] (HDFS-6464) Support multiple xattr.name parameters for WebHDFS getXAttrs.

2014-06-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016530#comment-14016530 ] Yi Liu commented on HDFS-6464: -- Hi Charles, it's *the value* of xattr.name *parameter*, so

[jira] [Commented] (HDFS-6464) Support multiple xattr.name parameters for WebHDFS getXAttrs.

2014-06-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016540#comment-14016540 ] Charles Lamb commented on HDFS-6464: Oh, of course. Thanks for the clarification. +1

[jira] [Commented] (HDFS-6424) blockReport doesn't need to invalidate blocks on SBN

2014-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016623#comment-14016623 ] Hudson commented on HDFS-6424: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1763 (See

[jira] [Commented] (HDFS-6109) let sync_file_range() system call run in background

2014-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016624#comment-14016624 ] Hudson commented on HDFS-6109: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1763 (See

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016805#comment-14016805 ] Colin Patrick McCabe commented on HDFS-6382: bq. So just wondering if possible

[jira] [Commented] (HDFS-6109) let sync_file_range() system call run in background

2014-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016811#comment-14016811 ] Hudson commented on HDFS-6109: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1790 (See

[jira] [Commented] (HDFS-6424) blockReport doesn't need to invalidate blocks on SBN

2014-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016810#comment-14016810 ] Hudson commented on HDFS-6424: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1790 (See

[jira] [Created] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6481: Summary: DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs Key: HDFS-6481 URL: https://issues.apache.org/jira/browse/HDFS-6481 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Attachment: hdfs-6481-v1.txt Patch v1 adds check for i against the length of storageIDs

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Status: Patch Available (was: Open) DatanodeManager#getDatanodeStorageInfos() should check the length of

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Attachment: hdfs-6481-v1.txt DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Attachment: (was: hdfs-6481-v1.txt) DatanodeManager#getDatanodeStorageInfos() should check the length of

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-06-03 Thread Ali Ghodsi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016877#comment-14016877 ] Ali Ghodsi commented on HDFS-5851: -- [~sanjay.radia] Sanjay, Tachyon indeed has had

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-06-03 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016907#comment-14016907 ] Andrew Purtell commented on HDFS-5851: -- bq. Can we make these files transient like ZK

[jira] [Updated] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-06-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6268: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-06-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017074#comment-14017074 ] Hudson commented on HDFS-6268: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5649 (See

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017083#comment-14017083 ] Hadoop QA commented on HDFS-6481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017085#comment-14017085 ] Hadoop QA commented on HDFS-6481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017110#comment-14017110 ] Hadoop QA commented on HDFS-6481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread James Thomas (JIRA)
James Thomas created HDFS-6482: -- Summary: Use block ID-based block layout on datanodes Key: HDFS-6482 URL: https://issues.apache.org/jira/browse/HDFS-6482 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.patch Initial work, no tests or performance testing yet. Use block ID-based

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Description: Right now blocks are placed into directories that are split into many subdirectories

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6482: - Fix Version/s: (was: 2.5.0) Hey James, just for future reference - we don't set the fix

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017192#comment-14017192 ] Hadoop QA commented on HDFS-6481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-06-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6268: -- Fix Version/s: (was: 2.5.0) Better sorting in NetworkTopology#pseudoSortByDistance when no local

[jira] [Reopened] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-06-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-6268: --- Looks like branch-2 needs a different patch, since it has an extra test file that needs to be updated.

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017240#comment-14017240 ] Hadoop QA commented on HDFS-6481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017246#comment-14017246 ] Colin Patrick McCabe commented on HDFS-6482: {code} + public static long

[jira] [Commented] (HDFS-6392) Wire crypto streams for encrypted files in DFSClient

2014-06-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017281#comment-14017281 ] Charles Lamb commented on HDFS-6392: bq, My suggest is we can define some class like

[jira] [Resolved] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-06-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6268. --- Resolution: Fixed Committed new patch to branch-2, thanks for the quick review ATM. Better sorting

[jira] [Commented] (HDFS-6465) Enable the configuration of multiple clusters

2014-06-03 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017301#comment-14017301 ] Dian Fu commented on HDFS-6465: --- Hi Vinay, Thanks very much for your review of the patch.

[jira] [Updated] (HDFS-6392) Wire crypto streams for encrypted files in DFSClient

2014-06-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6392: - Attachment: HdfsDataInputStream-HdfsDataOutputStream_crypto.diff Hi Charles and Andrew. The {{DFSOutputStream}}

[jira] [Commented] (HDFS-6464) Support multiple xattr.name parameters for WebHDFS getXAttrs.

2014-06-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017355#comment-14017355 ] Uma Maheswara Rao G commented on HDFS-6464: --- Tiny nit: {code} Map?, ? json =

[jira] [Updated] (HDFS-6465) Enable the configuration of multiple clusters

2014-06-03 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated HDFS-6465: -- Attachment: HDFS-6465.2.patch rebase patch against branch HDFS-5442 Enable the configuration of multiple

[jira] [Updated] (HDFS-6465) Enable the configuration of multiple clusters

2014-06-03 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated HDFS-6465: -- Affects Version/s: DisasterRecovery (HDFS-5442) Fix Version/s: 3.0.0 Enable the configuration of

[jira] [Commented] (HDFS-6465) Enable the configuration of multiple clusters

2014-06-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017388#comment-14017388 ] Vinayakumar B commented on HDFS-6465: - Hi [~dian.fu], Please note, in Hadoop, we