[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

2015-05-04 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526375#comment-14526375 ] Kai Sasaki commented on HDFS-8062: -- I'm sorry for delay but I am just on vacation from Apr

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

2015-05-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526405#comment-14526405 ] Kai Zheng commented on HDFS-8062: - Thanks for your sync. I thought it's OK if we could work

[jira] [Updated] (HDFS-8242) Erasure Coding: XML based end-to-end test for ECCli commands

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8242: --- Attachment: HDFS-8242-HDFS-7285.05.patch > Erasure Coding: XML based end-to-end test for ECCli commands > -

[jira] [Commented] (HDFS-8242) Erasure Coding: XML based end-to-end test for ECCli commands

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526451#comment-14526451 ] Rakesh R commented on HDFS-8242: It looks like test failures due to something wrong and I f

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526455#comment-14526455 ] Hadoop QA commented on HDFS-2484: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-4185) Add a metric for number of active leases

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526484#comment-14526484 ] Hadoop QA commented on HDFS-4185: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526502#comment-14526502 ] surendra singh lilhore commented on HDFS-8219: -- Can I work on this issue?. I a

[jira] [Commented] (HDFS-8137) Sends the EC schema to DataNode as well in EC encoding/recovering command

2015-05-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526509#comment-14526509 ] Kai Zheng commented on HDFS-8137: - Thanks for your update, Uma. The patch looks good and ju

[jira] [Updated] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-2484: --- Attachment: HDFS-2484.01.patch > checkLease should throw FileNotFoundException when file does not exist > -

[jira] [Updated] (HDFS-8251) Move the synthetic load generator into its own package

2015-05-04 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8251: - Status: Patch Available (was: Open) > Move the synthetic load generator into its own package > ---

[jira] [Commented] (HDFS-4185) Add a metric for number of active leases

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526519#comment-14526519 ] Rakesh R commented on HDFS-4185: Test failure and checkstyle issue are not related to the p

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

2015-05-04 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526525#comment-14526525 ] Kai Sasaki commented on HDFS-8062: -- Yes 8th May. Thank you so much! > Remove hard-coded v

[jira] [Updated] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-05-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8284: --- Attachment: HDFS-8284.001.patch I attached patch to fix doc for tracing. I moved default config

[jira] [Updated] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-05-04 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8284: --- Status: Patch Available (was: Open) > Add usage of tracing originated in DFSClient to doc > --

[jira] [Commented] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526563#comment-14526563 ] surendra singh lilhore commented on HDFS-8219: -- Little change in the scenario,

[jira] [Updated] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8219: - Attachment: HDFS-8219.patch > setStoragePolicy with folder behavior is different af

[jira] [Commented] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-05-04 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526564#comment-14526564 ] surendra singh lilhore commented on HDFS-8219: -- Attached patch with fix and te

[jira] [Updated] (HDFS-7904) NFS hard codes ShellBasedIdMapping

2015-05-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7904: --- Assignee: (was: Brahma Reddy Battula) > NFS hard codes ShellBasedIdMapping > --

[jira] [Updated] (HDFS-6300) Allows to run multiple balancer simultaneously

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6300: --- Attachment: HDFS-6300-001.patch > Allows to run multiple balancer simultaneously >

[jira] [Updated] (HDFS-6300) Shouldn't allows to run multiple balancer simultaneously

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6300: --- Summary: Shouldn't allows to run multiple balancer simultaneously (was: Allows to run multiple balancer simult

[jira] [Commented] (HDFS-1915) fuse-dfs does not support append

2015-05-04 Thread Valerio Schiavoni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526581#comment-14526581 ] Valerio Schiavoni commented on HDFS-1915: - I get the same problem with CD5.4, 1 NN

[jira] [Updated] (HDFS-6300) Shouldn't allows to run multiple balancer simultaneously

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6300: --- Target Version/s: 2.8.0 > Shouldn't allows to run multiple balancer simultaneously > --

[jira] [Commented] (HDFS-6300) Shouldn't allows to run multiple balancer simultaneously

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526584#comment-14526584 ] Rakesh R commented on HDFS-6300: Thanks a lot [~aw] for the interest. Sorry for the delay,

[jira] [Updated] (HDFS-6300) Shouldn't allows to run multiple balancer simultaneously

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6300: --- Status: Patch Available (was: Open) > Shouldn't allows to run multiple balancer simultaneously > -

[jira] [Commented] (HDFS-8251) Move the synthetic load generator into its own package

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526598#comment-14526598 ] Hadoop QA commented on HDFS-8251: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-7097) Allow block reports to be processed during checkpointing on standby name node

2015-05-04 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-7097: -- Target Version/s: (was: 2.6.0) > Allow block reports to be processed during checkpointing on standby name node

[jira] [Updated] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6348: --- Attachment: HDFS-6348-003.patch > Secondary namenode - RMI Thread prevents JVM from exiting after main() > co

[jira] [Updated] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6348: --- Attachment: (was: HDFS-6348-003.patch) > Secondary namenode - RMI Thread prevents JVM from exiting after m

[jira] [Updated] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-6348: --- Attachment: HDFS-6348-003.patch > Secondary namenode - RMI Thread prevents JVM from exiting after main() > co

[jira] [Commented] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526628#comment-14526628 ] Rakesh R commented on HDFS-6348: Attached re-based(in latest trunk) patch to get the jenkin

[jira] [Commented] (HDFS-8242) Erasure Coding: XML based end-to-end test for ECCli commands

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526644#comment-14526644 ] Hadoop QA commented on HDFS-8242: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-2484) checkLease should throw FileNotFoundException when file does not exist

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526655#comment-14526655 ] Hadoop QA commented on HDFS-2484: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8137) Sends the EC schema to DataNode as well in EC encoding/recovering command

2015-05-04 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-8137: -- Attachment: HDFS-8137-2.patch Thanks a lot, Kai for the review! I have updated the patch

[jira] [Updated] (HDFS-8203) Erasure Coding: Seek and other Ops in DFSStripedInputStream.

2015-05-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8203: - Attachment: HDFS-8203.001.patch Will add some test for the seek tomorrow. > Erasure Coding: Seek and other Ops in

[jira] [Commented] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526773#comment-14526773 ] Hadoop QA commented on HDFS-8284: - (!) The patch artifact directory has been removed! This

[jira] [Commented] (HDFS-6300) Shouldn't allows to run multiple balancer simultaneously

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526800#comment-14526800 ] Hadoop QA commented on HDFS-6300: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8311) DataStreamer.transfer() should timeout the socket InputStream.

2015-05-04 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez updated HDFS-8311: Attachment: 0001-HDFS-8311-DataStreamer.transfer-should-timeout-the-s.patch [~kiranmr] is ok

[jira] [Commented] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526881#comment-14526881 ] Hadoop QA commented on HDFS-6348: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8249) Separate HdfsConstants into the client and the server side class

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8249: Description: The constants in {{HdfsConstants}} are used by both the client side and the server side. There

[jira] [Commented] (HDFS-6348) Secondary namenode - RMI Thread prevents JVM from exiting after main() completes

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526896#comment-14526896 ] Hadoop QA commented on HDFS-6348: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

2015-05-04 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6407: --- Attachment: HDFS-6407-003.patch Adjusted the page size to a lower number (instead of All) to ensure tha

[jira] [Commented] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526913#comment-14526913 ] Hadoop QA commented on HDFS-6407: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDFS-8315) Datanode does not log reads

2015-05-04 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-8315: Summary: Datanode does not log reads Key: HDFS-8315 URL: https://issues.apache.org/jira/browse/HDFS-8315 Project: Hadoop HDFS Issue Type: Bug Reporter: K

[jira] [Created] (HDFS-8316) Erasure coding: refactor EC constants to be consistent with HDFS-8249

2015-05-04 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8316: --- Summary: Erasure coding: refactor EC constants to be consistent with HDFS-8249 Key: HDFS-8316 URL: https://issues.apache.org/jira/browse/HDFS-8316 Project: Hadoop HDFS

[jira] [Work started] (HDFS-8316) Erasure coding: refactor EC constants to be consistent with HDFS-8249

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8316 started by Zhe Zhang. --- > Erasure coding: refactor EC constants to be consistent with HDFS-8249 > --

[jira] [Updated] (HDFS-8316) Erasure coding: refactor EC constants to be consistent with HDFS-8249

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8316: Attachment: HDFS-8316-HDFS-7285.0.patch > Erasure coding: refactor EC constants to be consistent with HDFS-82

[jira] [Updated] (HDFS-8315) Datanode does not log reads

2015-05-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8315: - Attachment: HDFS-8315.patch > Datanode does not log reads > --- > >

[jira] [Updated] (HDFS-8315) Datanode does not log reads

2015-05-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8315: - Assignee: Kihwal Lee Status: Patch Available (was: Open) > Datanode does not log reads > ---

[jira] [Commented] (HDFS-8316) Erasure coding: refactor EC constants to be consistent with HDFS-8249

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526942#comment-14526942 ] Zhe Zhang commented on HDFS-8316: - [~wheat9] / [~szetszwo] Could you take a look and see if

[jira] [Commented] (HDFS-8315) Datanode does not log reads

2015-05-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526946#comment-14526946 ] Haohui Mai commented on HDFS-8315: -- Can you elaborate how you debug the load issues based

[jira] [Created] (HDFS-8317) test-patch.sh should be documented

2015-05-04 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-8317: -- Summary: test-patch.sh should be documented Key: HDFS-8317 URL: https://issues.apache.org/jira/browse/HDFS-8317 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-05-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8237: - Attachment: HDFS-8237.002.patch > Move all protocol classes used by ClientProtocol to hdfs-client > ---

[jira] [Updated] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-05-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8237: - Attachment: HDFS-8237.002.patch > Move all protocol classes used by ClientProtocol to hdfs-client > ---

[jira] [Updated] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-05-04 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8237: - Attachment: (was: HDFS-8237.002.patch) > Move all protocol classes used by ClientProtocol to hdfs-clien

[jira] [Updated] (HDFS-7609) startup used too much time to load edits

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7609: -- Attachment: HDFS-7609.patch Here is the draft patch that prevents client from polluting the retry cache when sta

[jira] [Updated] (HDFS-7609) startup used too much time to load edits

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7609: -- Assignee: Ming Ma Status: Patch Available (was: Open) > startup used too much time to load edits > ---

[jira] [Updated] (HDFS-5640) Add snapshot methods to FileContext.

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5640: --- Attachment: HDFS-5640-004.patch > Add snapshot methods to FileContext. > >

[jira] [Commented] (HDFS-8316) Erasure coding: refactor EC constants to be consistent with HDFS-8249

2015-05-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526990#comment-14526990 ] Jing Zhao commented on HDFS-8316: - Thanks for the work, Zhe! +1. > Erasure coding: refacto

[jira] [Resolved] (HDFS-8316) Erasure coding: refactor EC constants to be consistent with HDFS-8249

2015-05-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8316. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this to the fe

[jira] [Commented] (HDFS-8316) Erasure coding: refactor EC constants to be consistent with HDFS-8249

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526997#comment-14526997 ] Zhe Zhang commented on HDFS-8316: - Thanks Jing for the prompt review! > Erasure coding: re

[jira] [Commented] (HDFS-8315) Datanode does not log reads

2015-05-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527002#comment-14527002 ] Kihwal Lee commented on HDFS-8315: -- If accesses to a small set of blocks create hot spots,

[jira] [Updated] (HDFS-8311) DataStreamer.transfer() should timeout the socket InputStream.

2015-05-04 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez updated HDFS-8311: Attachment: HDFS-8311.001.patch Added correctly timeout for both DS.createBlockOutputStream()

[jira] [Commented] (HDFS-5640) Add snapshot methods to FileContext.

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527004#comment-14527004 ] Rakesh R commented on HDFS-5640: Attached another patch, here I've added few unit test case

[jira] [Commented] (HDFS-8242) Erasure Coding: XML based end-to-end test for ECCli commands

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527014#comment-14527014 ] Zhe Zhang commented on HDFS-8242: - Thanks Rakesh. Since the main change is to add a new tes

[jira] [Commented] (HDFS-8237) Move all protocol classes used by ClientProtocol to hdfs-client

2015-05-04 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527016#comment-14527016 ] Brandon Li commented on HDFS-8237: -- +1 pending Jenkins. > Move all protocol classes used

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8305: --- Description: HDFS INotify: the destination field of RenameOp should always end with the

[jira] [Commented] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527023#comment-14527023 ] Colin Patrick McCabe commented on HDFS-8305: bq. can we add a description to th

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8305: --- Attachment: HDFS-8305.002.patch > HDFS INotify: the destination field of RenameOp shoul

[jira] [Updated] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-05-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8290: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527030#comment-14527030 ] Ming Ma commented on HDFS-7609: --- #3 in the scenario description above should be "Before nn2 s

[jira] [Updated] (HDFS-5757) refreshNodes with many nodes at the same time could slow down NN

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-5757: -- Resolution: Duplicate Status: Resolved (was: Patch Available) This optimization has been taken care of b

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-05-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527039#comment-14527039 ] Hudson commented on HDFS-8290: -- FAILURE: Integrated in Hadoop-trunk-Commit #7724 (See [https:

[jira] [Commented] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527042#comment-14527042 ] Ming Ma commented on HDFS-6184: --- Anyone gets time to review this? We have been running with t

[jira] [Commented] (HDFS-6184) Capture NN's thread dump when it fails over

2015-05-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527050#comment-14527050 ] Hadoop QA commented on HDFS-6184: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8315) Datanode does not log reads

2015-05-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527052#comment-14527052 ] Arpit Agarwal commented on HDFS-8315: - Hi Kihwal, IIRC [~gopalv] had some data indicati

[jira] [Commented] (HDFS-8242) Erasure Coding: XML based end-to-end test for ECCli commands

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527055#comment-14527055 ] Rakesh R commented on HDFS-8242: Thanks again [~zhz] for the reviews! [Build Report - Tes

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-05-04 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Open (was: Patch Available) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Commented] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-05-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527073#comment-14527073 ] Rakesh R commented on HDFS-7949: Thanks [~zhz] and [~drankye] for the reviews and committin

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-05-04 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: (was: HDFS-8078.8.patch) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-05-04 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Patch Available (was: Open) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-05-04 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: HDFS-8078.9.patch Fix checkstyle errors and whitespace; test seems to be ND. > HDFS client gets

[jira] [Commented] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527092#comment-14527092 ] Zhe Zhang commented on HDFS-8281: - bq. the tradeoff here is the throughput and the biggest

[jira] [Updated] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

2015-05-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7672: -- Attachment: h7672_20150504.patch h7672_20150504.patch: - handles failure of (non-leading)

[jira] [Updated] (HDFS-7397) Add more detail to the documentation for the conf key "dfs.client.read.shortcircuit.streams.cache.size"

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7397: --- Summary: Add more detail to the documentation for the conf key "dfs.client.read.shortci

[jira] [Updated] (HDFS-7397) Add more detail to the documentation for the conf key "dfs.client.read.shortcircuit.streams.cache.size"

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7397: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Created] (HDFS-8318) Unable to move files on Hdfs

2015-05-04 Thread ankush (JIRA)
ankush created HDFS-8318: Summary: Unable to move files on Hdfs Key: HDFS-8318 URL: https://issues.apache.org/jira/browse/HDFS-8318 Project: Hadoop HDFS Issue Type: Test Components: HDFS

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-05-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.001.patch Thanks a lot for reviewing, [~andrew.wang] bq. I think xattr keys ca

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527180#comment-14527180 ] Colin Patrick McCabe commented on HDFS-7758: bq. FsDatasetImpl#volumes is a FsV

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-05-04 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527183#comment-14527183 ] Rushabh S Shah commented on HDFS-7916: -- [~vinayrpet]: We deployed this fix to one of o

[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

2015-05-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527189#comment-14527189 ] Zhe Zhang commented on HDFS-7621: - Thanks for working on this Walter. bq. Balancer doesn'

[jira] [Commented] (HDFS-3643) hdfsJniHelper.c unchecked string pointers

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527200#comment-14527200 ] Colin Patrick McCabe commented on HDFS-3643: We put braces around all "if" stat

[jira] [Commented] (HDFS-8284) Add usage of tracing originated in DFSClient to doc

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527214#comment-14527214 ] Colin Patrick McCabe commented on HDFS-8284: Thanks, [~iwasakims]. {code} 2328

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7847: --- Assignee: Colin Patrick McCabe (was: Charles Lamb) > Modify NNThroughputBenchmark to b

[jira] [Updated] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-05-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7758: Attachment: HDFS-7758.008.patch Thanks a lot for reivews, [~cmccabe]. bq. Let's fix TestWriteToRepli

[jira] [Work stopped] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7847 stopped by Colin Patrick McCabe. -- > Modify NNThroughputBenchmark to be able to operate on a remote NameN

[jira] [Work stopped] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7847 stopped by Colin Patrick McCabe. -- > Modify NNThroughputBenchmark to be able to operate on a remote NameN

[jira] [Work started] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7847 started by Colin Patrick McCabe. -- > Modify NNThroughputBenchmark to be able to operate on a remote NameN

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7847: --- Assignee: Charles Lamb (was: Colin Patrick McCabe) Status: Patch Available (was:

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7847: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-7836) > Modify NNThroug

[jira] [Commented] (HDFS-7397) Add more detail to the documentation for the conf key "dfs.client.read.shortcircuit.streams.cache.size"

2015-05-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527239#comment-14527239 ] Hudson commented on HDFS-7397: -- FAILURE: Integrated in Hadoop-trunk-Commit #7726 (See [https:

  1   2   >