[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

2015-09-11 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741935#comment-14741935 ] Duo Zhang commented on HDFS-7966: - No, the testcase uses multiple connections... But yes, t

[jira] [Commented] (HDFS-9043) Doc updation for commands in HDFS Federation

2015-09-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741929#comment-14741929 ] Vinayakumar B commented on HDFS-9043: - All changes are looks good to me. +1 for all. [

[jira] [Commented] (HDFS-8780) Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node.

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741923#comment-14741923 ] Hadoop QA commented on HDFS-8780: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741883#comment-14741883 ] Hadoop QA commented on HDFS-9041: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741881#comment-14741881 ] Hadoop QA commented on HDFS-8996: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741879#comment-14741879 ] Hadoop QA commented on HDFS-8873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741872#comment-14741872 ] Hadoop QA commented on HDFS-9065: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.002.patch Good suggestion. Here's a new patch. > Include commas on # of

[jira] [Created] (HDFS-9066) expose truncate via webhdfs

2015-09-11 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-9066: -- Summary: expose truncate via webhdfs Key: HDFS-9066 URL: https://issues.apache.org/jira/browse/HDFS-9066 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Updated] (HDFS-8780) Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node.

2015-09-11 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8780: - Attachment: HDFS-8780.2.patch Updated the patch fixing checkstyle comments. Testcase failures are unrelate

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741849#comment-14741849 ] Allen Wittenauer commented on HDFS-9055: bq. This is a false statement. The peopl

[jira] [Updated] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

2015-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9040: Attachment: HDFS-9040.001.wip.patch Upload a wip patch (based on Walter's great job in HDFS-8383) to demo the

[jira] [Commented] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741835#comment-14741835 ] Haohui Mai commented on HDFS-9065: -- Thanks! It might make sense to use {{Number.toLocaleSt

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741828#comment-14741828 ] Haohui Mai commented on HDFS-9055: -- bq. it does not work with curl or wget despite the abo

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741774#comment-14741774 ] Allen Wittenauer commented on HDFS-9055: A bit more research reveals that the gRPC

[jira] [Commented] (HDFS-4981) chmod 777 the .snapshot directory does not error that modification on RO snapshot is disallowed

2015-09-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741764#comment-14741764 ] Xiao Chen commented on HDFS-4981: - Hi Stephen, Thanks for reporting the issue. I'll be wor

[jira] [Commented] (HDFS-5802) NameNode does not check for inode type before traversing down a path

2015-09-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741762#comment-14741762 ] Xiao Chen commented on HDFS-5802: - Hi Harsh, Thanks for reporting the issue. I'll be worki

[jira] [Assigned] (HDFS-4981) chmod 777 the .snapshot directory does not error that modification on RO snapshot is disallowed

2015-09-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-4981: --- Assignee: Xiao Chen > chmod 777 the .snapshot directory does not error that modification on RO > snap

[jira] [Assigned] (HDFS-5802) NameNode does not check for inode type before traversing down a path

2015-09-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-5802: --- Assignee: Xiao Chen > NameNode does not check for inode type before traversing down a path > -

[jira] [Commented] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2015-09-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741711#comment-14741711 ] Ming Ma commented on HDFS-8874: --- Thanks [~ctrezzo]. * If the new {{receiveBlock}} returns fa

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741694#comment-14741694 ] Hadoop QA commented on HDFS-6955: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741670#comment-14741670 ] Hadoop QA commented on HDFS-9065: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Attachment: HDFS-8996.01.patch Thanks Colin. Updating the patch to eliminate {{validateLog}} and {{validateE

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-09-11 Thread Zhe Zhang (JIRA)
20150707.patch, Consolidated-20150806.patch, > Consolidated-20150810.patch, ECAnalyzer.py, ECParser.py, > HDFS-7285-Consolidated-20150911.patch, HDFS-7285-initial-PoC.patch, > HDFS-7285-merge-consolidated-01.patch, > HDFS-7285-merge-consolidated-trunk-01.patch, > HDFS-7285-m

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota without need to get file and directory counts

2015-09-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741632#comment-14741632 ] Joep Rottinghuis commented on HDFS-8898: So it sounds like we're discussing two thi

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741622#comment-14741622 ] Colin Patrick McCabe commented on HDFS-8873: Good work, [~templedf]. {code}

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-09-11 Thread Jing Zhao (JIRA)
tch, ECAnalyzer.py, ECParser.py, > HDFS-7285-Consolidated-20150911.patch, HDFS-7285-initial-PoC.patch, > HDFS-7285-merge-consolidated-01.patch, > HDFS-7285-merge-consolidated-trunk-01.patch, > HDFS-7285-merge-consolidated.trunk.03.patch, > HDFS-7285-merge-consolidated.trunk.04.pa

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.001.patch Resolved some of the checkstyle issues. On the line too long c

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: (was: HDFS-8873.001.patch) > throttle directoryScanner > --

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741591#comment-14741591 ] Hadoop QA commented on HDFS-8873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741571#comment-14741571 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #359 (See [htt

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Status: Patch Available (was: Open) > Include commas on # of files, blocks, total filesystem o

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.001.patch > Include commas on # of files, blocks, total filesystem object

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-09-11 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7285: Attachment: HDFS-7285-Consolidated-20150911.patch With HDFS-8833 committed, all remaining subtasks are about

[jira] [Created] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-9065: -- Summary: Include commas on # of files, blocks, total filesystem objects in NN Web UI Key: HDFS-9065 URL: https://issues.apache.org/jira/browse/HDFS-9065 Project:

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741552#comment-14741552 ] Hudson commented on HDFS-9027: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2321 (See [htt

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741539#comment-14741539 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2298 (See [https://

[jira] [Updated] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

2015-09-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8099: - Fix Version/s: (was: 2.8.0) 2.7.2 > Change "DFSInputStream has been closed already"

[jira] [Commented] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

2015-09-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741528#comment-14741528 ] Kihwal Lee commented on HDFS-8099: -- The bug was introduced in 2.7.0. Cherry-picking this t

[jira] [Resolved] (HDFS-8952) InputStream.PositionRead() should be aware of available DNs

2015-09-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8952. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Committed to the HDFS-8707

[jira] [Updated] (HDFS-9025) Fix compilation issues on arch linux

2015-09-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9025: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target Version/s:

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741481#comment-14741481 ] James Clampffer commented on HDFS-9062: --- That's correct. Glad it sounds like a reaso

[jira] [Commented] (HDFS-9008) Balancer#Parameters class could use a builder pattern

2015-09-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741460#comment-14741460 ] Ming Ma commented on HDFS-9008: --- +1 for the latest patch. [~szetszwo] do you have additional

[jira] [Comment Edited] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741447#comment-14741447 ] Colin Patrick McCabe edited comment on HDFS-8829 at 9/11/15 7:47 PM:

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741447#comment-14741447 ] Colin Patrick McCabe commented on HDFS-8829: Thanks for working on this, [~He T

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741443#comment-14741443 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #373 (See

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741436#comment-14741436 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Yarn-trunk # (See [https://

[jira] [Updated] (HDFS-7767) Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI

2015-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7767: --- Attachment: HDFS-7767.01.patch Here's a patch which DOESN'T use the noredirect flag. I'm uploading it o

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741427#comment-14741427 ] Allen Wittenauer commented on HDFS-9055: Also: https://github.com/grpc/grpc-common

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741424#comment-14741424 ] Chris Nauroth commented on HDFS-9062: - Thanks for the additional details, James. I had

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741421#comment-14741421 ] Allen Wittenauer commented on HDFS-9055: bq. Can you show some numbers on what are

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Status: Patch Available (was: Open) > throttle directoryScanner > - >

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.001.patch Here's a patch to add a time-based throttle. The changes are a

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741391#comment-14741391 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #379 (See [htt

[jira] [Commented] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

2015-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741388#comment-14741388 ] Jing Zhao commented on HDFS-9040: - Thanks for the patch, Walter! I think this looks much cl

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-11 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741380#comment-14741380 ] Kanaka Kumar Avvaru commented on HDFS-8953: --- test failures doesn't seem to be rel

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-11 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741374#comment-14741374 ] Kanaka Kumar Avvaru commented on HDFS-6955: --- patch v8 address {{TestSpaceReservat

[jira] [Updated] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-11 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru updated HDFS-6955: -- Attachment: HDFS-6955-08.patch > DN should reserve disk space for a full block when creat

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-11 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741365#comment-14741365 ] Kanaka Kumar Avvaru commented on HDFS-6955: --- Thanks for the review [~arpitagarwal

[jira] [Commented] (HDFS-7986) Allow files / directories to be deleted from the NameNode UI

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741350#comment-14741350 ] Hadoop QA commented on HDFS-7986: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741337#comment-14741337 ] Haohui Mai commented on HDFS-9055: -- bq. Adding a third protocol which nothing really suppo

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-09-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741329#comment-14741329 ] Vinayakumar B commented on HDFS-9038: - Thanks brahma for the options. #1 would be bette

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741286#comment-14741286 ] James Clampffer commented on HDFS-9062: --- Hi Chris, Thanks for the suggestions and us

[jira] [Updated] (HDFS-9022) Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client

2015-09-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9022: Status: Open (was: Patch Available) > Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdf

[jira] [Updated] (HDFS-9022) Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client

2015-09-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9022: Status: Patch Available (was: Open) > Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdf

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Status: Patch Available (was: Open) > Replace NameNode.DEFAULT_PORT with > HdfsClientConfigKeys.DFS

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Status: Open (was: Patch Available) > Replace NameNode.DEFAULT_PORT with > HdfsClientConfigKeys.DFS

[jira] [Assigned] (HDFS-7986) Allow files / directories to be deleted from the NameNode UI

2015-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reassigned HDFS-7986: -- Assignee: Ravi Prakash > Allow files / directories to be deleted from the NameNode UI >

[jira] [Updated] (HDFS-7986) Allow files / directories to be deleted from the NameNode UI

2015-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7986: --- Attachment: HDFS-7986.01.patch Here's a patch which allows deleting of files and directories via the UI

[jira] [Updated] (HDFS-7986) Allow files / directories to be deleted from the NameNode UI

2015-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7986: --- Status: Patch Available (was: Open) > Allow files / directories to be deleted from the NameNode UI > -

[jira] [Commented] (HDFS-7779) Improve the HDFS Web UI browser to allow chowning / chgrp and setting replication

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741273#comment-14741273 ] Hadoop QA commented on HDFS-7779: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-09-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741271#comment-14741271 ] Rushabh S Shah commented on HDFS-9064: -- only in the REST call. > NN old UI (block_inf

[jira] [Commented] (HDFS-9008) Balancer#Parameters class could use a builder pattern

2015-09-11 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741262#comment-14741262 ] Chris Trezzo commented on HDFS-9008: Test failures are unrelated. The patch should be g

[jira] [Commented] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741258#comment-14741258 ] Ravi Prakash commented on HDFS-9064: Thanks for reporting the issue Rushabh! Is this re

[jira] [Updated] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-09-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9064: - Description: In 2.6.x hadoop deploys, given a blockId it was very easy to find out the file name a

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741256#comment-14741256 ] Arpit Agarwal commented on HDFS-6955: - Thanks for updating the patch. A few comments. #

[jira] [Created] (HDFS-9064) NN old UI (block_info_xml) not available in 2.7.x

2015-09-11 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-9064: Summary: NN old UI (block_info_xml) not available in 2.7.x Key: HDFS-9064 URL: https://issues.apache.org/jira/browse/HDFS-9064 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741242#comment-14741242 ] Hudson commented on HDFS-9027: -- FAILURE: Integrated in Hadoop-trunk-Commit #8435 (See [https:

[jira] [Commented] (HDFS-9056) add set/remove quota capability to webhdfs

2015-09-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741228#comment-14741228 ] Surendra Singh Lilhore commented on HDFS-9056: -- Duplicate of HDFS-8631. > add

[jira] [Updated] (HDFS-7779) Improve the HDFS Web UI browser to allow chowning / chgrp and setting replication

2015-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7779: --- Attachment: HDFS-7779.02.patch > Improve the HDFS Web UI browser to allow chowning / chgrp and setting

[jira] [Updated] (HDFS-7779) Improve the HDFS Web UI browser to allow chowning / chgrp and setting replication

2015-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7779: --- Assignee: Ravi Prakash Status: Patch Available (was: Open) > Improve the HDFS Web UI browser to

[jira] [Commented] (HDFS-9060) expose snapshotdiff via WebHDFS

2015-09-11 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741215#comment-14741215 ] Kanaka Kumar Avvaru commented on HDFS-9060: --- I would like to work on this issue.

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741210#comment-14741210 ] Allen Wittenauer commented on HDFS-9055: bq. I would like work on this, please fee

[jira] [Assigned] (HDFS-9060) expose snapshotdiff via WebHDFS

2015-09-11 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru reassigned HDFS-9060: - Assignee: Kanaka Kumar Avvaru > expose snapshotdiff via WebHDFS >

[jira] [Created] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-11 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9063: --- Summary: Correctly handle snapshot path for getContentSummary Key: HDFS-9063 URL: https://issues.apache.org/jira/browse/HDFS-9063 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9027: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: (was: 2.8.0)

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741159#comment-14741159 ] Hadoop QA commented on HDFS-6955: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

2015-09-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741145#comment-14741145 ] Haohui Mai commented on HDFS-7966: -- I never understand the the performance numbers. What d

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741133#comment-14741133 ] Haohui Mai commented on HDFS-9055: -- Can you elaborate where and how WebHDFS v1 is broken?

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741118#comment-14741118 ] Chris Nauroth commented on HDFS-9062: - Hi [~James Clampffer]. I'm curious if you've tr

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741110#comment-14741110 ] Hadoop QA commented on HDFS-8953: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741088#comment-14741088 ] Chris Nauroth commented on HDFS-9055: - Hi [~aw]. AFAIK, the only proposed backwards-in

[jira] [Commented] (HDFS-5795) RemoteBlockReader2#checkSuccess() shoud print error status

2015-09-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741076#comment-14741076 ] Xiao Chen commented on HDFS-5795: - Hi Brandon, Thank you for reporting this issue. I'll wo

[jira] [Commented] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14741038#comment-14741038 ] Brahma Reddy Battula commented on HDFS-9055: I would like work on this, please

[jira] [Assigned] (HDFS-9059) Expose lssnapshottabledir via WebHDFS

2015-09-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-9059: -- Assignee: Brahma Reddy Battula > Expose lssnapshottabledir via WebHDFS > ---

[jira] [Assigned] (HDFS-9061) hdfs groups should be exposed via WebHDFS

2015-09-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-9061: -- Assignee: Brahma Reddy Battula > hdfs groups should be exposed via WebHDFS > ---

[jira] [Created] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9062: - Summary: Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path Key: HDFS-9062 URL: https://issues.apache.org/jira/browse/HDFS-9062

[jira] [Assigned] (HDFS-9057) allow/disallow snapshots via webhdfs

2015-09-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-9057: -- Assignee: Brahma Reddy Battula > allow/disallow snapshots via webhdfs >

[jira] [Assigned] (HDFS-9058) enable find via WebHDFS

2015-09-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-9058: -- Assignee: Brahma Reddy Battula > enable find via WebHDFS > -

[jira] [Updated] (HDFS-9055) WebHDFS REST v2

2015-09-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9055: --- Description: There's starting to be enough changes to fix and add missing functionality to webh

  1   2   >