[jira] [Commented] (HDFS-9237) NPE at TestDataNodeVolumeFailureToleration#tearDown

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962970#comment-14962970 ] Hudson commented on HDFS-9237: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #549 (See

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-19 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Status: Open (was: Patch Available) > Allow fsck display pending replica location information for being-written

[jira] [Commented] (HDFS-9237) NPE at TestDataNodeVolumeFailureToleration#tearDown

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962991#comment-14962991 ] Hudson commented on HDFS-9237: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1286 (See [https://

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-19 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Attachment: HDFS-9070-trunk.07.patch Hi, [~andreina]. I have uploaded a new patch, please let me know if it makes

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-19 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963006#comment-14963006 ] Kai Sasaki commented on HDFS-8287: -- [~rakeshr] Great. Thank you so much for reviewing. {

[jira] [Commented] (HDFS-8631) WebHDFS : Support list/setQuota

2015-10-19 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963013#comment-14963013 ] J.Andreina commented on HDFS-8631: -- Thanks [~surendrasingh] for the patch. It looks great

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963045#comment-14963045 ] Steve Loughran commented on HDFS-9241: -- I see your point, but I will note that it lose

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963055#comment-14963055 ] Walter Su commented on HDFS-9260: - Excellent work [~sfriberg]! 1. Per your tests, the resu

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-19 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: HDFS-8287.13.patch > DFSStripedOutputStream.writeChunk should not wait for writing parity > --

[jira] [Commented] (HDFS-9237) NPE at TestDataNodeVolumeFailureToleration#tearDown

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963109#comment-14963109 ] Hudson commented on HDFS-9237: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2498 (See [htt

[jira] [Commented] (HDFS-9237) NPE at TestDataNodeVolumeFailureToleration#tearDown

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963125#comment-14963125 ] Hudson commented on HDFS-9237: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2449 (See [https://

[jira] [Commented] (HDFS-9237) NPE at TestDataNodeVolumeFailureToleration#tearDown

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963150#comment-14963150 ] Hudson commented on HDFS-9237: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #512 (See [htt

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963165#comment-14963165 ] Hadoop QA commented on HDFS-8287: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (HDFS-815) FileContext tests fail on Windows

2015-10-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-815. - Resolution: Cannot Reproduce Fix Version/s: 2.7.2 These don't appear to happen any more, so c

[jira] [Created] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-9263: Summary: tests are using /test/build/data; breaking Jenkins Key: HDFS-9263 URL: https://issues.apache.org/jira/browse/HDFS-9263 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Attachment: HDFS-9249.003.patch Reset authentication method at end of the test to clean up. > NP

[jira] [Commented] (HDFS-6589) TestDistributedFileSystem.testAllWithNoXmlDefaults failed intermittently

2015-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963306#comment-14963306 ] Wei-Chiu Chuang commented on HDFS-6589: --- Unfortunately I can not reproduce the except

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963318#comment-14963318 ] Jagadesh Kiran N commented on HDFS-9263: Thanks [~steve_l] for reporting the same,

[jira] [Created] (HDFS-9264) Minor cleanup of operations on FsVolumeList#volumes

2015-10-19 Thread Walter Su (JIRA)
Walter Su created HDFS-9264: --- Summary: Minor cleanup of operations on FsVolumeList#volumes Key: HDFS-9264 URL: https://issues.apache.org/jira/browse/HDFS-9264 Project: Hadoop HDFS Issue Type: Impro

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-10-19 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963398#comment-14963398 ] Dave Marion commented on HDFS-8486: --- Does this also affect 2.5.0? If so, can someone prov

[jira] [Updated] (HDFS-9264) Minor cleanup of operations on FsVolumeList#volumes

2015-10-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9264: Attachment: HDFS-9264.01.patch > Minor cleanup of operations on FsVolumeList#volumes > --

[jira] [Updated] (HDFS-9264) Minor cleanup of operations on FsVolumeList#volumes

2015-10-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9264: Status: Patch Available (was: Open) > Minor cleanup of operations on FsVolumeList#volumes >

[jira] [Assigned] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N reassigned HDFS-9263: -- Assignee: Jagadesh Kiran N > tests are using /test/build/data; breaking Jenkins > --

[jira] [Reopened] (HDFS-7464) TestDFSAdminWithHA#testRefreshSuperUserGroupsConfiguration fails against Java 8

2015-10-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-7464: --- I am seeing this today with Java 7 java version "1.7.0_79" Java(TM) SE Runtime Environment (build 1

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-10-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963429#comment-14963429 ] Arpit Agarwal commented on HDFS-8486: - 2.5.0 is not affected. > DN startup may cause s

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-10-19 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963431#comment-14963431 ] Dave Marion commented on HDFS-8486: --- Thanks for the quick response! > DN startup may cau

[jira] [Commented] (HDFS-8486) DN startup may cause severe data loss

2015-10-19 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963432#comment-14963432 ] Dave Marion commented on HDFS-8486: --- Thanks for the quick response! > DN startup may cau

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963449#comment-14963449 ] Allen Wittenauer commented on HDFS-8914: We don't update the documentation for a re

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9263: - Attachment: HDFS-9263-001.patch This covers -common and a couple of other places too, but it's wher

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9263: - Status: Patch Available (was: Open) > tests are using /test/build/data; breaking Jenkins > ---

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963464#comment-14963464 ] Steve Loughran commented on HDFS-9263: -- I'd already pulled out the IDE, though it'll t

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-9263: --- Assignee: Steve Loughran (was: Jagadesh Kiran N) > tests are using /test/build/data; breaking

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963480#comment-14963480 ] Hadoop QA commented on HDFS-9249: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963503#comment-14963503 ] Chris Nauroth commented on HDFS-9208: - [~kihwal], thank you for the patch. I am +1 for

[jira] [Created] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-19 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9265: - Summary: Use of undefined behavior in remote_block_reader causing deterministic crashes. Key: HDFS-9265 URL: https://issues.apache.org/jira/browse/HDFS-9265 Project

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963545#comment-14963545 ] Ravindra Babu commented on HDFS-8914: - When this patch will deployed? > Documentation

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963546#comment-14963546 ] Ravindra Babu commented on HDFS-8914: - When this patch will be deployed? > Documentati

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963549#comment-14963549 ] Allen Wittenauer commented on HDFS-8914: a) it needs to get reviewed and committed

[jira] [Commented] (HDFS-9264) Minor cleanup of operations on FsVolumeList#volumes

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963564#comment-14963564 ] Hadoop QA commented on HDFS-9264: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963575#comment-14963575 ] Hadoop QA commented on HDFS-9263: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim reassigned HDFS-9077: Assignee: HeeSoo Kim > webhdfs client requires SPNEGO to do renew >

[jira] [Work started] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9077 started by HeeSoo Kim. > webhdfs client requires SPNEGO to do renew > --

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Attachment: HDFS-9077.patch > webhdfs client requires SPNEGO to do renew >

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-19 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963610#comment-14963610 ] Staffan Friberg commented on HDFS-9260: --- Hi Walter 1) I think this is part could red

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8647: --- Attachment: HDFS-8647-007.patch > Abstract BlockManager's rack policy into BlockPlaceme

[jira] [Updated] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9251: Attachment: HDFS-9251.02.patch Thanks for the inputs, [~cmccabe]. I removed the precondition checks

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963625#comment-14963625 ] Haohui Mai commented on HDFS-9241: -- Totally agree. Let's go ahead with your proposals :-)

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963652#comment-14963652 ] Mingliang Liu commented on HDFS-9241: - I think you two [~wheat9] and [~steve_l] have ma

[jira] [Updated] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9252: Attachment: HDFS-9252.01.patch Thanks a lot for the feedbacks, [~cmccabe]. bq. It seems like blockF

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963662#comment-14963662 ] Brahma Reddy Battula commented on HDFS-8647: [~mingma] {quote}BlockManager sho

[jira] [Commented] (HDFS-9237) NPE at TestDataNodeVolumeFailureToleration#tearDown

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963667#comment-14963667 ] Brahma Reddy Battula commented on HDFS-9237: Thanks [~ozawa] for review and com

[jira] [Created] (HDFS-9266) hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals

2015-10-19 Thread Nemanja Matkovic (JIRA)
Nemanja Matkovic created HDFS-9266: -- Summary: hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals Key: HDFS-9266 URL: https://issues.apache.org/jira/browse/HDFS-9266 Pro

[jira] [Commented] (HDFS-9266) hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals

2015-10-19 Thread Nemanja Matkovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963689#comment-14963689 ] Nemanja Matkovic commented on HDFS-9266: Cannot make this task to sub-task of HADOO

[jira] [Commented] (HDFS-9266) hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals

2015-10-19 Thread Nemanja Matkovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963705#comment-14963705 ] Nemanja Matkovic commented on HDFS-9266: For context on why things are broken up th

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Status: Patch Available (was: In Progress) > webhdfs client requires SPNEGO to do renew >

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963714#comment-14963714 ] Ravindra Babu commented on HDFS-8914: - so it this patch reviewed currently? I see test

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963717#comment-14963717 ] Allen Wittenauer commented on HDFS-8914: No, it isn't reviewed. You might find ht

[jira] [Updated] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Babu updated HDFS-8914: Attachment: (was: HDFS-8914.1.patch.txt) > Documentation conflict regarding fail-over of Namenode

[jira] [Updated] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Babu updated HDFS-8914: Attachment: HDFS-8914.1.patch.txt Review this patch > Documentation conflict regarding fail-over of

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963792#comment-14963792 ] Ravindra Babu commented on HDFS-8914: - Still I did not get the process. Can you please

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963812#comment-14963812 ] Allen Wittenauer commented on HDFS-8914: The process is relatively simple: a) cont

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963857#comment-14963857 ] Ravindra Babu commented on HDFS-8914: - Current report of QA says -1 due to white space

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9208: - Attachment: HDFS-9208.v2.patch Thanks for the review, Chris. Attaching a new patch that removes the unused

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963898#comment-14963898 ] Lars Francke commented on HDFS-8914: I missed the -1, thanks for the heads up. I'll try

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963918#comment-14963918 ] Hadoop QA commented on HDFS-8647: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-19 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963963#comment-14963963 ] Bob Hansen commented on HDFS-8766: -- Haohui - thanks for those explicit and actionable item

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Target Version/s: 3.0.0 Status: Patch Available (was: Open) > Erasure coding: emulate race con

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Attachment: HDFS-9098.wip.patch WIP patch to demonstrate the idea. It leverages ideas from the [IMUnit | htt

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964024#comment-14964024 ] James Clampffer commented on HDFS-8766: --- Thanks Bob and Haohui for the feedback. Bob

[jira] [Commented] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964025#comment-14964025 ] Hadoop QA commented on HDFS-9077: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9265: -- Description: The remote block reader relies on undefined behavior in how it uses enable_shared_f

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964044#comment-14964044 ] Colin Patrick McCabe commented on HDFS-9241: bq. I see your point, but I will n

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964062#comment-14964062 ] Hadoop QA commented on HDFS-9208: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-9267: --- Summary: TestDiskError should get stored replicas through FsDatasetTestUtils. Key: HDFS-9267 URL: https://issues.apache.org/jira/browse/HDFS-9267 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9267: Status: Patch Available (was: Open) > TestDiskError should get stored replicas through FsDatasetTest

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9267: Attachment: HDFS-9267.00.patch > TestDiskError should get stored replicas through FsDatasetTestUtils.

[jira] [Commented] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964151#comment-14964151 ] Hadoop QA commented on HDFS-9098: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Attachment: HDFS-9077.001.patch > webhdfs client requires SPNEGO to do renew >

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Status: In Progress (was: Patch Available) > webhdfs client requires SPNEGO to do renew >

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-19 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Status: Patch Available (was: Open) > Config file reader / options classes for libhdfs++ > ---

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-19 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.001.patch Implemented config files and Options creations. Gluing the optio

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964214#comment-14964214 ] Hadoop QA commented on HDFS-9117: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964218#comment-14964218 ] Andrew Wang commented on HDFS-9250: --- LGTM, thanks Xiao. I'll update the summary and commi

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Summary: Add Precondition check to LocatedBlock#addCachedLoc (was: LocatedBlock#addCachedLoc may throw A

[jira] [Commented] (HDFS-9124) NullPointerException when underreplicated blocks are there

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964219#comment-14964219 ] Lei (Eddy) Xu commented on HDFS-9124: - Thanks a lot for reporting this, [~syedakram]. I

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Issue Type: Improvement (was: Bug) > Add Precondition check to LocatedBlock#addCachedLoc > -

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Affects Version/s: 2.4.0 > Add Precondition check to LocatedBlock#addCachedLoc >

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 Status: Reso

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964229#comment-14964229 ] Colin Patrick McCabe commented on HDFS-9252: bq. The data length and genstemp r

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964233#comment-14964233 ] Andrew Wang commented on HDFS-9263: --- I retriggered the build on this, some of these seem

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964237#comment-14964237 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-trunk-Commit #8666 (See [https:

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964241#comment-14964241 ] Andrew Wang commented on HDFS-9263: --- Other sort of related comment is that we have all th

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.04.patch The only locally reproducible failure is {{testDatanodeFailureRandomLength}}.

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964246#comment-14964246 ] Colin Patrick McCabe commented on HDFS-9251: +1 pending Jenkins. Thanks, [~edd

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964235#comment-14964235 ] Xiao Chen commented on HDFS-9250: - Thanks very much [~andrew.wang] for the review! > Add P

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964250#comment-14964250 ] Colin Patrick McCabe commented on HDFS-9259: That seems reasonable to me. It s

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964253#comment-14964253 ] Hadoop QA commented on HDFS-7087: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964261#comment-14964261 ] Andrew Wang commented on HDFS-7087: --- Looks good, thanks for revving Xiao. Patch needs a s

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964270#comment-14964270 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #569 (See [htt

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964272#comment-14964272 ] Haohui Mai commented on HDFS-9241: -- bq. most of the problematic dependencies like Jackson,

  1   2   >