[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-09-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6482: Fix Version/s: (was: 3.0.0) 2.6.0 Target Version/s: (was: 3.0.0)

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-09-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6482: Target Version/s: 3.0.0 (was: 2.6.0) Use block ID-based block layout on datanodes

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-09-01 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6482: Affects Version/s: (was: 2.5.0) 3.0.0 Use block ID-based block layout on

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-08-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6482: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-18 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.8.patch Fixed the new test and parallelized and nativized the hard link process

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-18 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: hadoop-24-datanode-dir.tgz HDFS-6482.9.patch Removed binary file from

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-18 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: (was: HDFS-6482.9.patch) Use block ID-based block layout on datanodes

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-18 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.9.patch It tried to apply the tgz .. reuploading patch. Use block ID-based

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-07 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Release Note: The directory structure for finalized replicas on DNs has been changed. Now, the

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-07 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: 6482-design.doc Here is a brief design doc. Please let me know if you would like to see

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-03 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.7.patch Thanks for that find, Colin. Fixed. Use block ID-based block layout

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-6482: --- Target Version/s: 2.6.0 (was: 2.5.0) Use block ID-based block layout on datanodes

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-07-01 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.6.patch Added ASF license comment. Use block ID-based block layout on

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-18 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.5.patch Added a unit test for the layout upgrade. After some thought and

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-12 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.4.patch Use block ID-based block layout on datanodes

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-10 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.3.patch Made changes suggested by Arpit. I don't think that deletion of empty

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-10 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Release Note: The directory structure for finalized replicas on DNs has been changed. Now, the

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-06 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.2.patch Made all changes suggested by Colin. Some heap dumps I've taken with a

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-04 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.1.patch Use block ID-based block layout on datanodes

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Attachment: HDFS-6482.patch Initial work, no tests or performance testing yet. Use block ID-based

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6482: --- Description: Right now blocks are placed into directories that are split into many subdirectories

[jira] [Updated] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6482: - Fix Version/s: (was: 2.5.0) Hey James, just for future reference - we don't set the fix