[jira] [Resolved] (HDFS-6590) NullPointerException was generated in getBlockLocalPathInfo when datanode restarts

2014-11-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-6590. - Resolution: Duplicate Closing as duplicate > NullPointerException was generated in getBlockLocalPa

[jira] [Reopened] (HDFS-6590) NullPointerException was generated in getBlockLocalPathInfo when datanode restarts

2014-11-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reopened HDFS-6590: - > NullPointerException was generated in getBlockLocalPathInfo when datanode > restarts > -

[jira] [Commented] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195833#comment-14195833 ] Yi Liu commented on HDFS-7218: -- +1, thanks Charles, will commit patch later. > FSNamesystem A

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2014-11-03 Thread Hu Liu, (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195830#comment-14195830 ] Hu Liu, commented on HDFS-7056: --- Hi [~shv], Thanks for your comments. It's glad to see your

[jira] [Commented] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195828#comment-14195828 ] Hadoop QA commented on HDFS-7340: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195827#comment-14195827 ] Hadoop QA commented on HDFS-7218: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7348) Process erasure decoding work

2014-11-03 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7348: --- Summary: Process erasure decoding work Key: HDFS-7348 URL: https://issues.apache.org/jira/browse/HDFS-7348 Project: Hadoop HDFS Issue Type: Task Reporter:

[jira] [Updated] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-11-03 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6552: Assignee: Amir Langer > add DN storage to a BlockInfo will not replace the different storage from >

[jira] [Commented] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-11-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195824#comment-14195824 ] stack commented on HDFS-6803: - Oh, [~ste...@apache.org] feedback appreciated too > Documen

[jira] [Created] (HDFS-7347) Configurable erasure coding policy for individual files and directories

2014-11-03 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7347: --- Summary: Configurable erasure coding policy for individual files and directories Key: HDFS-7347 URL: https://issues.apache.org/jira/browse/HDFS-7347 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-11-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HDFS-6803: Attachment: 9117.md.txt Adding tenets 2.1 and 2.2. to fsdatainputstream.md Changes the voice on the PositionedReadab

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195821#comment-14195821 ] Kai Zheng commented on HDFS-7337: - Yes, agree. Please go ahead. Thanks. > Configurable and

[jira] [Created] (HDFS-7346) Process erasure encoding work

2014-11-03 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7346: --- Summary: Process erasure encoding work Key: HDFS-7346 URL: https://issues.apache.org/jira/browse/HDFS-7346 Project: Hadoop HDFS Issue Type: Task Components:

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195818#comment-14195818 ] Zhe Zhang commented on HDFS-7337: - [~drankye] Sorry about the confusion. I actually created

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195815#comment-14195815 ] Kai Zheng commented on HDFS-7337: - To better position this issue and avoid the possible con

[jira] [Updated] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7337: Description: According to HDFS-7285 and the design, this considers to support multiple Erasure Codecs

[jira] [Updated] (HDFS-7337) Configurable erasure coding policy

2014-11-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-7337: -- Affects Version/s: HDFS-EC > Configurable erasure coding policy > ---

[jira] [Updated] (HDFS-7337) Configurable erasure coding policy

2014-11-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-7337: -- Fix Version/s: (was: HDFS-EC) > Configurable erasure coding policy >

[jira] [Updated] (HDFS-7338) Reed-Solomon codec library support

2014-11-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-7338: -- Affects Version/s: HDFS-EC > Reed-Solomon codec library support > ---

[jira] [Updated] (HDFS-7338) Reed-Solomon codec library support

2014-11-03 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-7338: -- Fix Version/s: (was: HDFS-EC) > Reed-Solomon codec library support >

[jira] [Assigned] (HDFS-7338) Reed-Solomon codec library support

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-7338: --- Assignee: Li Bo > Reed-Solomon codec library support > -- > >

[jira] [Updated] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7314: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Aborted DFSClient's impact on long running service

[jira] [Updated] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7314: -- Attachment: HDFS-7314.patch Thanks [~kihwal] and [~cmccabe] for the good suggestions. Here is the initial patch

[jira] [Updated] (HDFS-7344) Erasure Coding worker and support in DataNode

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7344: Assignee: Li Bo (was: Kai Zheng) > Erasure Coding worker and support in DataNode > -

[jira] [Created] (HDFS-7345) Local Reconstruction Codes (LRC)

2014-11-03 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7345: --- Summary: Local Reconstruction Codes (LRC) Key: HDFS-7345 URL: https://issues.apache.org/jira/browse/HDFS-7345 Project: Hadoop HDFS Issue Type: Sub-task Affects Ver

[jira] [Created] (HDFS-7344) Erasure Coding worker and support in DataNode

2014-11-03 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7344: --- Summary: Erasure Coding worker and support in DataNode Key: HDFS-7344 URL: https://issues.apache.org/jira/browse/HDFS-7344 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195770#comment-14195770 ] Kai Zheng commented on HDFS-7285: - Hi [~andrew.wang], to address the policy engine aspects

[jira] [Commented] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195766#comment-14195766 ] Kai Zheng commented on HDFS-7343: - For [~apurtell]'s [comments|https://issues.apache.org/j

[jira] [Commented] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195760#comment-14195760 ] Kai Zheng commented on HDFS-7343: - Abstracted from [~Andrew.wang]'s [meeting notes|https:/

[jira] [Updated] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7343: Summary: A comprehensive and flexible storage policy engine (was: A comprehensive storage policy engine) >

[jira] [Created] (HDFS-7343) A comprehensive storage policy engine

2014-11-03 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7343: --- Summary: A comprehensive storage policy engine Key: HDFS-7343 URL: https://issues.apache.org/jira/browse/HDFS-7343 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195748#comment-14195748 ] Kai Zheng commented on HDFS-7285: - Hi [~apurtell], I think you have good points. As the men

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2014-11-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195736#comment-14195736 ] Kai Zheng commented on HDFS-7285: - Thanks everyone for having the branch. We're currently w

[jira] [Updated] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-11-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HDFS-6803: Attachment: DocumentingDFSClientDFSInputStream.v2.pdf Need license to improve pread so back here again (pardon the ab

[jira] [Commented] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195729#comment-14195729 ] Charles Lamb commented on HDFS-7334: I ran TestDataTransferKeepalive on my machine with

[jira] [Updated] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7218: --- Attachment: HDFS-7218.005.patch Good catch Yi. Attached is a corrected patch. Thanks again for the tho

[jira] [Commented] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195695#comment-14195695 ] Hudson commented on HDFS-7328: -- FAILURE: Integrated in Hadoop-trunk-Commit #6433 (See [https:

[jira] [Updated] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7328: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-4882) Namenode LeaseManager checkLeases() runs into infinite loop

2014-11-03 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195678#comment-14195678 ] Ravi Prakash commented on HDFS-4882: I've filed HDFS-7342 to investigate why the lease

[jira] [Updated] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7340: Target Version/s: 2.6.0 Affects Version/s: (was: 2.6.0) 2.4.0 S

[jira] [Updated] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7340: Attachment: HDFS-7340.000.patch Initial patch to make rollingUpgrade idempotent. > make rollingUpgrade start

[jira] [Created] (HDFS-7342) Lease Recovery doesn't happen some times

2014-11-03 Thread Ravi Prakash (JIRA)
Ravi Prakash created HDFS-7342: -- Summary: Lease Recovery doesn't happen some times Key: HDFS-7342 URL: https://issues.apache.org/jira/browse/HDFS-7342 Project: Hadoop HDFS Issue Type: Bug Af

[jira] [Commented] (HDFS-4882) Namenode LeaseManager checkLeases() runs into infinite loop

2014-11-03 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195675#comment-14195675 ] Ravi Prakash commented on HDFS-4882: Can someone please review and commit this JIRA? >

[jira] [Updated] (HDFS-7340) make rollingUpgrade start/finalize idempotent

2014-11-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7340: Summary: make rollingUpgrade start/finalize idempotent (was: rollingUpgrade prepare command does not have re

[jira] [Commented] (HDFS-7340) rollingUpgrade prepare command does not have retry cache support

2014-11-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195669#comment-14195669 ] Jing Zhao commented on HDFS-7340: - If we add retry cache support for start/finalize rolling

[jira] [Commented] (HDFS-7333) Improve log message in Storage.tryLock()

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195655#comment-14195655 ] Hadoop QA commented on HDFS-7333: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195656#comment-14195656 ] Hadoop QA commented on HDFS-7331: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195608#comment-14195608 ] Hadoop QA commented on HDFS-7334: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195607#comment-14195607 ] Colin Patrick McCabe commented on HDFS-3107: Hi Konstantin, Yes, I was aware o

[jira] [Commented] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195598#comment-14195598 ] Colin Patrick McCabe commented on HDFS-7341: As discussed on the parent subtask

[jira] [Updated] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7341: --- Attachment: HDFS-3107_Nov3.patch This is the patch originally posted by [~zero45] on HD

[jira] [Commented] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195590#comment-14195590 ] Hadoop QA commented on HDFS-7328: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7341: --- Attachment: editsStored_Nov3.xml > Add initial snapshot support based on pipeline recov

[jira] [Commented] (HDFS-7332) Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195591#comment-14195591 ] Hadoop QA commented on HDFS-7332: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7341: --- Attachment: editsStored_Nov3 > Add initial snapshot support based on pipeline recovery

[jira] [Created] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7341: -- Summary: Add initial snapshot support based on pipeline recovery Key: HDFS-7341 URL: https://issues.apache.org/jira/browse/HDFS-7341 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195563#comment-14195563 ] Yi Liu commented on HDFS-7328: -- +1 pending jenkins. Thanks Chris. > TestTraceAdmin assumes Un

[jira] [Commented] (HDFS-7218) FSNamesystem ACL operations should write to audit log on failure

2014-11-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195560#comment-14195560 ] Yi Liu commented on HDFS-7218: -- Thanks [~clamb], just one small nit, +1 after addressing. {co

[jira] [Updated] (HDFS-7332) Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.

2014-11-03 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7332: Attachment: HDFS-7332.000.patch Use {{Timer}} to control the initial values of {{BlockScanInfo}} sort

[jira] [Updated] (HDFS-7332) Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.

2014-11-03 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7332: Status: Patch Available (was: Open) > Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.

[jira] [Updated] (HDFS-7340) rollingUpgrade prepare command does not have retry cache support

2014-11-03 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta updated HDFS-7340: -- Assignee: Jing Zhao > rollingUpgrade prepare command does not have retry cache support >

[jira] [Created] (HDFS-7340) rollingUpgrade prepare command does not have retry cache support

2014-11-03 Thread Arpit Gupta (JIRA)
Arpit Gupta created HDFS-7340: - Summary: rollingUpgrade prepare command does not have retry cache support Key: HDFS-7340 URL: https://issues.apache.org/jira/browse/HDFS-7340 Project: Hadoop HDFS

[jira] [Created] (HDFS-7339) Create block groups for initial block encoding

2014-11-03 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7339: --- Summary: Create block groups for initial block encoding Key: HDFS-7339 URL: https://issues.apache.org/jira/browse/HDFS-7339 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7338) Reed-Solomon codec library support

2014-11-03 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7338: --- Summary: Reed-Solomon codec library support Key: HDFS-7338 URL: https://issues.apache.org/jira/browse/HDFS-7338 Project: Hadoop HDFS Issue Type: Sub-task R

[jira] [Created] (HDFS-7337) Configurable

2014-11-03 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7337: --- Summary: Configurable Key: HDFS-7337 URL: https://issues.apache.org/jira/browse/HDFS-7337 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Zhe Zhang

[jira] [Updated] (HDFS-7337) Configurable erasure coding policy

2014-11-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7337: Summary: Configurable erasure coding policy (was: Configurable ) > Configurable erasure coding policy >

[jira] [Commented] (HDFS-7225) Failed DataNode lookup can crash NameNode with NullPointerException

2014-11-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195494#comment-14195494 ] Andrew Wang commented on HDFS-7225: --- We could also test the concern about readding a DN a

[jira] [Commented] (HDFS-7225) Failed DataNode lookup can crash NameNode with NullPointerException

2014-11-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195492#comment-14195492 ] Andrew Wang commented on HDFS-7225: --- Fix looks good, I just have some unit test comments:

[jira] [Commented] (HDFS-7336) Unused member DFSInputStream.buffersize

2014-11-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195488#comment-14195488 ] Konstantin Shvachko commented on HDFS-7336: --- This means that even though we pass

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195484#comment-14195484 ] Haohui Mai commented on HDFS-7331: -- Got it. It's a nice feature. Some comments: {code} +

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-03 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195474#comment-14195474 ] Chen He commented on HDFS-7199: --- LGTM, +1, non-binding. > DFSOutputStream can silently drop

[jira] [Created] (HDFS-7336) Unused member DFSInputStream.buffersize

2014-11-03 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7336: - Summary: Unused member DFSInputStream.buffersize Key: HDFS-7336 URL: https://issues.apache.org/jira/browse/HDFS-7336 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195470#comment-14195470 ] Charles Lamb commented on HDFS-7331: Hi [~wheat9], The current metric only exposes the

[jira] [Comment Edited] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195463#comment-14195463 ] Haohui Mai edited comment on HDFS-7331 at 11/4/14 12:37 AM: Sin

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195463#comment-14195463 ] Haohui Mai commented on HDFS-7331: -- Since the information has been exposed in metrics, why

[jira] [Created] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-03 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7335: - Summary: Redundant checkOperation() in FSN.analyzeFileState() Key: HDFS-7335 URL: https://issues.apache.org/jira/browse/HDFS-7335 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7334: --- Attachment: HDFS-7334.001.patch This test was setting the wrong config parameter. The result was that t

[jira] [Updated] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7334: --- Status: Patch Available (was: Open) > Fix periodic failures of TestCheckpoint#testTooManyEditReplayFai

[jira] [Created] (HDFS-7334) Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures

2014-11-03 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7334: -- Summary: Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures Key: HDFS-7334 URL: https://issues.apache.org/jira/browse/HDFS-7334 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7333) Improve log message in Storage.tryLock()

2014-11-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7333: -- Status: Patch Available (was: Open) > Improve log message in Storage.tryLock() > ---

[jira] [Updated] (HDFS-7333) Improve log message in Storage.tryLock()

2014-11-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7333: -- Attachment: logging.patch Simple patch. > Improve log message in Storage.tryLock() > ---

[jira] [Created] (HDFS-7333) Improve log message in Storage.tryLock()

2014-11-03 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7333: - Summary: Improve log message in Storage.tryLock() Key: HDFS-7333 URL: https://issues.apache.org/jira/browse/HDFS-7333 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7331: --- Description: Add per-datanode counts to the datanode jmx page. For example, networkErrors could be exp

[jira] [Updated] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7331: --- Status: Patch Available (was: Open) > Add Datanode network counts to datanode jmx page > -

[jira] [Updated] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7331: --- Attachment: HDFS-7331.001.patch A patch to implement this is attached. > Add Datanode network counts t

[jira] [Created] (HDFS-7332) Fix TestMultipleNNDataBlockScanner failures in jenkin slaves.

2014-11-03 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7332: --- Summary: Fix TestMultipleNNDataBlockScanner failures in jenkin slaves. Key: HDFS-7332 URL: https://issues.apache.org/jira/browse/HDFS-7332 Project: Hadoop HDFS

[jira] [Created] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-03 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7331: -- Summary: Add Datanode network counts to datanode jmx page Key: HDFS-7331 URL: https://issues.apache.org/jira/browse/HDFS-7331 Project: Hadoop HDFS Issue Type: Im

[jira] [Created] (HDFS-7330) Unclosed RandomAccessFile warnings in FSDatasetIml.

2014-11-03 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7330: - Summary: Unclosed RandomAccessFile warnings in FSDatasetIml. Key: HDFS-7330 URL: https://issues.apache.org/jira/browse/HDFS-7330 Project: Hadoop HDFS

[jira] [Created] (HDFS-7329) MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails.

2014-11-03 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7329: - Summary: MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails. Key: HDFS-7329 URL: https://issues.apache.org/jira/browse/HDFS-7329

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-11-03 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195409#comment-14195409 ] Lars Hofhansl commented on HDFS-6698: - Yeah, let's combine these. We can close this one

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195395#comment-14195395 ] Hadoop QA commented on HDFS-3107: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-3107) HDFS truncate

2014-11-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3107: -- Attachment: HDFS_truncate.pdf Updated design document. > HDFS truncate > - >

[jira] [Updated] (HDFS-3107) HDFS truncate

2014-11-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3107: -- Status: Open (was: Patch Available) > HDFS truncate > - > >

[jira] [Updated] (HDFS-6292) Display HDFS per user and per group usage on the webUI

2014-11-03 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-6292: --- Target Version/s: 2.7.0 (was: 2.6.0) > Display HDFS per user and per group usage on the webUI > --

[jira] [Commented] (HDFS-7147) Update archival storage user documentation

2014-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195351#comment-14195351 ] Hudson commented on HDFS-7147: -- FAILURE: Integrated in Hadoop-trunk-Commit #6431 (See [https:

[jira] [Updated] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7328: Status: Patch Available (was: Open) > TestTraceAdmin assumes Unix line endings. > --

[jira] [Updated] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7328: Attachment: HDFS-7328.1.patch Here is a test fix to use the correct platform line separator. > TestT

[jira] [Created] (HDFS-7328) TestTraceAdmin assumes Unix line endings.

2014-11-03 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7328: --- Summary: TestTraceAdmin assumes Unix line endings. Key: HDFS-7328 URL: https://issues.apache.org/jira/browse/HDFS-7328 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7147) Update archival storage user documentation

2014-11-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7147: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-3107) HDFS truncate

2014-11-03 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-3107: --- Attachment: (was: editsStored) > HDFS truncate > - > > Key: HDF

  1   2   >