[jira] [Created] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-03-03 Thread Pan Yuxuan (JIRA)
Pan Yuxuan created HDFS-9902: Summary: dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK Key: HDFS-9902 URL: https://issues.apache.org/jira/browse/HDFS-9902 Project: Hado

[jira] [Commented] (HDFS-9888) TestBalancer#testBalancerWithKeytabs should reset KerberosName in test case setup

2016-03-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179516#comment-15179516 ] Zhe Zhang commented on HDFS-9888: - Thanks Xiao for the analysis! It makes sense and the pat

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179513#comment-15179513 ] Zhe Zhang commented on HDFS-7866: - Thanks Rui! I think we are pretty close. # To save mem

[jira] [Commented] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179505#comment-15179505 ] Hadoop QA commented on HDFS-9702: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179493#comment-15179493 ] Hadoop QA commented on HDFS-9239: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Work started] (HDFS-9901) Move block validation out of the heartbeat thread

2016-03-03 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9901 started by Hua Liu. - > Move block validation out of the heartbeat thread > --

[jira] [Created] (HDFS-9901) Move block validation out of the heartbeat thread

2016-03-03 Thread Hua Liu (JIRA)
Hua Liu created HDFS-9901: - Summary: Move block validation out of the heartbeat thread Key: HDFS-9901 URL: https://issues.apache.org/jira/browse/HDFS-9901 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179389#comment-15179389 ] Hadoop QA commented on HDFS-9871: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9879) Erasure Coding : schedule striped blocks to be cached on DataNodes

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179361#comment-15179361 ] Rakesh R commented on HDFS-9879: Thanks a lot [~drankye], [~andrew.wang], its really intere

[jira] [Updated] (HDFS-9856) Suppress Jenkins warning for sample JSON file

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9856: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thank you for the patch, I have comm

[jira] [Commented] (HDFS-9856) Suppress Jenkins warning for sample JSON file

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179349#comment-15179349 ] Hadoop QA commented on HDFS-9856: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-03 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179335#comment-15179335 ] Hua Liu commented on HDFS-9882: --- Hi [~arpiagariu] When a data node needs to transfer a block

[jira] [Updated] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9702: --- Status: Patch Available (was: Open) > DiskBalancer : getVolumeMap implementation > ---

[jira] [Updated] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9702: --- Attachment: HDFS-9702-HDFS-1312.001.patch > DiskBalancer : getVolumeMap implementation > --

[jira] [Updated] (HDFS-9702) DiskBalancer : getVolumeMap implementation

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9702: --- Attachment: (was: HDFS-9702-HDFS-1312.001.patch) > DiskBalancer : getVolumeMap implementation > ---

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179292#comment-15179292 ] Arpit Agarwal commented on HDFS-9882: - Hi [~elgoiri], bq. heartbeats were reporting

[jira] [Commented] (HDFS-9900) The implication of auth-conf is not followed in optimized HDFS data transfer encryption

2016-03-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179277#comment-15179277 ] Brahma Reddy Battula commented on HDFS-9900: Seems to be dupe of HDFS-9899.. >

[jira] [Created] (HDFS-9899) The implication of auth-conf is not followed in optimized HDFS data transfer encryption

2016-03-03 Thread Jerry Chen (JIRA)
Jerry Chen created HDFS-9899: Summary: The implication of auth-conf is not followed in optimized HDFS data transfer encryption Key: HDFS-9899 URL: https://issues.apache.org/jira/browse/HDFS-9899 Project:

[jira] [Created] (HDFS-9900) The implication of auth-conf is not followed in optimized HDFS data transfer encryption

2016-03-03 Thread Jerry Chen (JIRA)
Jerry Chen created HDFS-9900: Summary: The implication of auth-conf is not followed in optimized HDFS data transfer encryption Key: HDFS-9900 URL: https://issues.apache.org/jira/browse/HDFS-9900 Project:

[jira] [Updated] (HDFS-9371) Code cleanup for DatanodeManager

2016-03-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9371: -- Component/s: namenode > Code cleanup for DatanodeManager > --

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179184#comment-15179184 ] Hadoop QA commented on HDFS-9427: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7639) Remove the limitation imposed by dfs.balancer.moverThreads

2016-03-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179177#comment-15179177 ] John Zhuge commented on HDFS-7639: -- +1 Definitely wasteful to occupy a thread to send a re

[jira] [Commented] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179175#comment-15179175 ] Brahma Reddy Battula commented on HDFS-9871: [~shahrs87] thanks for taking a lo

[jira] [Updated] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9871: --- Attachment: HDFS-9871-002.patch > "Bytes Being Moved" -ve(-1 B) when cluster was alread

[jira] [Commented] (HDFS-9889) Update balancer/mover document about HDFS-6133 feature

2016-03-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179145#comment-15179145 ] Andrew Wang commented on HDFS-9889: --- +1 LGTM, thanks Yongjun! > Update balancer/mover do

[jira] [Work started] (HDFS-6520) hdfs fsck -move not working

2016-03-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6520 started by John Zhuge. > hdfs fsck -move not working > --- > > Key: HDFS-

[jira] [Updated] (HDFS-6520) hdfs fsck -move not working

2016-03-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6520: - Summary: hdfs fsck -move not working (was: Failed to run fsck -move) Was able to gain more insight after e

[jira] [Updated] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-03-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9239: Attachment: HDFS-9239.003.patch [~szetszwo], thank you for your code review. I am attaching patch v0

[jira] [Updated] (HDFS-9683) DiskBalancer : Add cancelPlan implementation

2016-03-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9683: Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: (was: HDFS-1312)

[jira] [Updated] (HDFS-9856) Suppress Jenkins warning for sample JSON file

2016-03-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9856: Status: Patch Available (was: Open) > Suppress Jenkins warning for sample JSON file > --

[jira] [Commented] (HDFS-9856) Suppress Jenkins warning for sample JSON file

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179063#comment-15179063 ] Anu Engineer commented on HDFS-9856: [~xiaobingo] Thanks for the patch. +1, pending jen

[jira] [Commented] (HDFS-9856) Suppress Jenkins warning for sample JSON file

2016-03-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179061#comment-15179061 ] Xiaobing Zhou commented on HDFS-9856: - I posted the patch v000 that excludes {noformat

[jira] [Updated] (HDFS-9856) Suppress Jenkins warning for sample JSON file

2016-03-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9856: Attachment: HDFS-9856-HDFS-1312.000.patch > Suppress Jenkins warning for sample JSON file > -

[jira] [Commented] (HDFS-9683) DiskBalancer : Add cancelPlan implementation

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179042#comment-15179042 ] Anu Engineer commented on HDFS-9683: Test failures are not related to this patch. > D

[jira] [Commented] (HDFS-9683) DiskBalancer : Add cancelPlan implementation

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179036#comment-15179036 ] Hadoop QA commented on HDFS-9683: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9817) Use SLF4J in new classes

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9817: --- Status: Patch Available (was: Open) > Use SLF4J in new classes > > >

[jira] [Updated] (HDFS-9817) Use SLF4J in new classes

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9817: --- Attachment: HDFS-9817-HDFS-1312.001.patch > Use SLF4J in new classes > > >

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178871#comment-15178871 ] Mingliang Liu commented on HDFS-9579: - +1 (non-binding) pending on Jenkins. > Provide

[jira] [Updated] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9579: -- Attachment: HDFS-9579-9.patch Thank you [~liuml07] for the good catch! Here is the new patch with your suggestio

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-03 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178841#comment-15178841 ] Inigo Goiri commented on HDFS-9882: --- I think we need to add a description to Metrics.md.

[jira] [Commented] (HDFS-9888) TestBalancer#testBalancerWithKeytabs should reset KerberosName in test case setup

2016-03-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178743#comment-15178743 ] Xiao Chen commented on HDFS-9888: - The test failure and license warning looks unrelated. [~

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178740#comment-15178740 ] Xiaobing Zhou commented on HDFS-9427: - V002 changed ports into contiguous range as: {no

[jira] [Updated] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9427: Attachment: HDFS-9427.002.patch > HDFS should not default to ephemeral ports > --

[jira] [Commented] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178694#comment-15178694 ] Hadoop QA commented on HDFS-1477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178689#comment-15178689 ] Hadoop QA commented on HDFS-9822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HDFS-6520) Failed to run fsck -move

2016-03-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-6520: Assignee: John Zhuge > Failed to run fsck -move > > > Key:

[jira] [Updated] (HDFS-9683) DiskBalancer : Add cancelPlan implementation

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9683: --- Attachment: HDFS-9683-HDFS-1312.002.patch Hi [~arpitagarwal], Thanks for the review. This patch addre

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178651#comment-15178651 ] Mingliang Liu commented on HDFS-9579: - Thanks for updating the patch, [~mingma]! I like

[jira] [Commented] (HDFS-9879) Erasure Coding : schedule striped blocks to be cached on DataNodes

2016-03-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178640#comment-15178640 ] Andrew Wang commented on HDFS-9879: --- I think it's still possible to cache striped files,

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178578#comment-15178578 ] Rushabh S Shah commented on HDFS-9874: -- I ran all the failed tests on jdk7 (jdk1.7.0_7

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178418#comment-15178418 ] Hadoop QA commented on HDFS-9874: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-1477) Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart

2016-03-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Attachment: HDFS-1477-HDFS-9000.008.patch 008 fixed check style issues, and test failures are not rel

[jira] [Updated] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9822: --- Attachment: HDFS-9822-002.patch > Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178387#comment-15178387 ] Mingliang Liu commented on HDFS-7661: - Thanks for the further review, [~demongaorui].

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178302#comment-15178302 ] Rakesh R commented on HDFS-9822: Thanks a lot [~drankye] for the interests and useful comme

[jira] [Assigned] (HDFS-9896) WebHDFS API may return invalid JSON

2016-03-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-9896: Assignee: John Zhuge > WebHDFS API may return invalid JSON > --- > >

[jira] [Commented] (HDFS-9873) Ozone: Add container transport server

2016-03-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178274#comment-15178274 ] Anu Engineer commented on HDFS-9873: Ozone test failures were addressed as part of HDFS

[jira] [Commented] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178182#comment-15178182 ] Hadoop QA commented on HDFS-9868: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9871) "Bytes Being Moved" -ve(-1 B) when cluster was already balanced.

2016-03-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178148#comment-15178148 ] Rushabh S Shah commented on HDFS-9871: -- It seems like -1 is used as a default value.

[jira] [Commented] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178152#comment-15178152 ] Wei-Chiu Chuang commented on HDFS-9868: --- Hi, Thanks for the contribution. Do you have

[jira] [Updated] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread NING DING (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] NING DING updated HDFS-9868: Attachment: HDFS-9868.2.patch > add reading source cluster with HA access mode feature for DistCp > -

[jira] [Updated] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread NING DING (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] NING DING updated HDFS-9868: Attachment: (was: HDFS-9868.2.patch) > add reading source cluster with HA access mode feature for DistCp

[jira] [Updated] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9874: - Status: Patch Available (was: Open) This patch goes through the volume map and stops the writer th

[jira] [Updated] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9874: - Attachment: HDFS-9874-trunk.patch > Long living DataXceiver threads cause volume shutdown to block.

[jira] [Commented] (HDFS-9879) Erasure Coding : schedule striped blocks to be cached on DataNodes

2016-03-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178017#comment-15178017 ] Kai Zheng commented on HDFS-9879: - The problem is, HDFS cache is initially designed for rep

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177980#comment-15177980 ] Kai Zheng commented on HDFS-9822: - Thanks [~rakeshr] for working on this. I have some quest

[jira] [Updated] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9699: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Add appropriate c

[jira] [Commented] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177971#comment-15177971 ] James Clampffer commented on HDFS-9699: --- Committed this to HDFS-8707. > libhdfs++: A

[jira] [Updated] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9699: -- Assignee: Bob Hansen (was: James Clampffer) > libhdfs++: Add appropriate catch blocks for ASIO o

[jira] [Created] (HDFS-9898) An operation of atomic fold rename crashed in Wasb FileSystem

2016-03-03 Thread Liu Shaohui (JIRA)
Liu Shaohui created HDFS-9898: - Summary: An operation of atomic fold rename crashed in Wasb FileSystem Key: HDFS-9898 URL: https://issues.apache.org/jira/browse/HDFS-9898 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-9897) A failed atomic folder rename operation can never recovery for the destination file is deleted in Wasb filesystem

2016-03-03 Thread Liu Shaohui (JIRA)
Liu Shaohui created HDFS-9897: - Summary: A failed atomic folder rename operation can never recovery for the destination file is deleted in Wasb filesystem Key: HDFS-9897 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Commented] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177830#comment-15177830 ] Hadoop QA commented on HDFS-9868: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread NING DING (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] NING DING updated HDFS-9868: Attachment: HDFS-9868.2.patch > add reading source cluster with HA access mode feature for DistCp > -

[jira] [Updated] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread NING DING (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] NING DING updated HDFS-9868: Attachment: (was: HDFS-9868.3.patch) > add reading source cluster with HA access mode feature for DistCp

[jira] [Updated] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread NING DING (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] NING DING updated HDFS-9868: Attachment: (was: HDFS-9868.4.patch) > add reading source cluster with HA access mode feature for DistCp

[jira] [Updated] (HDFS-9868) add reading source cluster with HA access mode feature for DistCp

2016-03-03 Thread NING DING (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] NING DING updated HDFS-9868: Attachment: (was: HDFS-9868.2.patch) > add reading source cluster with HA access mode feature for DistCp

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177752#comment-15177752 ] Hadoop QA commented on HDFS-9822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9896) WebHDFS API may return invalid JSON

2016-03-03 Thread Alexander Shorin (JIRA)
Alexander Shorin created HDFS-9896: -- Summary: WebHDFS API may return invalid JSON Key: HDFS-9896 URL: https://issues.apache.org/jira/browse/HDFS-9896 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9896) WebHDFS API may return invalid JSON

2016-03-03 Thread Alexander Shorin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Shorin updated HDFS-9896: --- Affects Version/s: 2.6.0 Environment: FreeBSD 10.2 (was: FreeBSD 10.2 Hadoop 2.6.0 )

[jira] [Commented] (HDFS-9875) HDFS client requires compromising permission when running under JVM security manager

2016-03-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177625#comment-15177625 ] Steve Loughran commented on HDFS-9875: -- OK. I expect the same flaw to exist elsewhere.

[jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177607#comment-15177607 ] Hudson commented on HDFS-9048: -- FAILURE: Integrated in Hadoop-trunk-Commit #9418 (See [https:

[jira] [Updated] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9048: --- Resolution: Fixed Fix Version/s: 2.7.3 2.8.0 Target Versi

[jira] [Updated] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9822: --- Target Version/s: 3.0.0 Status: Patch Available (was: Open) > Erasure Coding: Avoids scheduling

[jira] [Commented] (HDFS-7661) Erasure coding: support hflush and hsync

2016-03-03 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177578#comment-15177578 ] GAO Rui commented on HDFS-7661: --- [~liuml07], thanks for updating the design doc. I agree wit

[jira] [Commented] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177577#comment-15177577 ] Rakesh R commented on HDFS-9822: {{BlockManager#computeReconstructionWorkForBlocks()}} is g

[jira] [Updated] (HDFS-9822) Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9822: --- Summary: Erasure Coding: Avoids scheduling multiple reconstruction tasks for a striped block at the same time

[jira] [Updated] (HDFS-9822) Erasure Coding:

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9822: --- Summary: Erasure Coding: (was: BlockManager.validateReconstructionWork throws AssertionError) > Erasure Codi

[jira] [Updated] (HDFS-9822) BlockManager.validateReconstructionWork throws AssertionError

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9822: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > BlockManager.validateReconstructionWork throws Ass

[jira] [Updated] (HDFS-9822) BlockManager.validateReconstructionWork throws AssertionError

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9822: --- Attachment: HDFS-9822-001.patch > BlockManager.validateReconstructionWork throws AssertionError > -

[jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177530#comment-15177530 ] Hadoop QA commented on HDFS-9048: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daisuke Kobayashi updated HDFS-9048: Attachment: HDFS-9048-4.patch Uploaded a v4 patch. Thanks. > DistCp documentation is out-of-

[jira] [Assigned] (HDFS-9822) BlockManager.validateReconstructionWork throws AssertionError

2016-03-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-9822: -- Assignee: Rakesh R > BlockManager.validateReconstructionWork throws AssertionError > ---

[jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177490#comment-15177490 ] Masatake Iwasaki commented on HDFS-9048: {{namenode_address}} or {{namenode_host}}

[jira] [Commented] (HDFS-9048) DistCp documentation is out-of-dated

2016-03-03 Thread Daisuke Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177471#comment-15177471 ] Daisuke Kobayashi commented on HDFS-9048: - Ah, thanks for pointing me out to the ri