[jira] [Comment Edited] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390881#comment-16390881 ] Weiwei Wu edited comment on HDFS-13212 at 3/8/18 7:54 AM: -- [~elgo

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390881#comment-16390881 ] Weiwei Wu commented on HDFS-13212: -- [~elgoiri], Thanks for you review.Update a new patch.

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Wu updated HDFS-13212: - Attachment: HDFS-13212-007.patch > RBF: Fix router location cache issue >

[jira] [Commented] (HDFS-13247) FileInputStream not closed when read the checksum header from the meta file

2018-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390867#comment-16390867 ] John Zhuge commented on HDFS-13247: --- Please check out  [try-with-resources|https://docs.

[jira] [Created] (HDFS-13247) FileInputStream not closed when read the checksum header from the meta file

2018-03-07 Thread liaoyuxiangqin (JIRA)
liaoyuxiangqin created HDFS-13247: - Summary: FileInputStream not closed when read the checksum header from the meta file Key: HDFS-13247 URL: https://issues.apache.org/jira/browse/HDFS-13247 Project:

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390861#comment-16390861 ] genericqa commented on HDFS-13230: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.03.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Status: Patch Available (was: In Progress) > WebHdfs file path gets truncated when having semicol

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Status: In Progress (was: Patch Available) > WebHdfs file path gets truncated when having semicol

[jira] [Commented] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390849#comment-16390849 ] Yiqun Lin commented on HDFS-13240: -- Attach the patch to address all. > RBF: Update some

[jira] [Updated] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13240: - Status: Patch Available (was: Open) > RBF: Update some inaccurate document descriptions > ---

[jira] [Updated] (HDFS-13240) RBF: Update some inaccurate document descriptions

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13240: - Attachment: HDFS-13240.001.patch > RBF: Update some inaccurate document descriptions > ---

[jira] [Commented] (HDFS-13233) RBF: getMountPoint doesn't return the correct mount point of the mount table

2018-03-07 Thread wangzhiyuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390833#comment-16390833 ] wangzhiyuan commented on HDFS-13233: Hi [~elgoiri], there is a little difference betwe

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390828#comment-16390828 ] Íñigo Goiri commented on HDFS-13212: Thanks [~wuweiwei] for [^HDFS-13212-006.patch].

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390820#comment-16390820 ] genericqa commented on HDFS-13212: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389833#comment-16389833 ] Íñigo Goiri edited comment on HDFS-13212 at 3/8/18 6:33 AM: Th

[jira] [Updated] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-07 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13246: -- Attachment: HDFS-13246.001.patch > FileInputStream redundant closes in readReplicasFromCache >

[jira] [Updated] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-07 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13246: -- Status: Patch Available (was: Open) > FileInputStream redundant closes in readReplicasFromCache

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390803#comment-16390803 ] SammiChen commented on HDFS-11600: -- Hi [~rakeshr], do you have time to help review the pa

[jira] [Created] (HDFS-13246) FileInputStream redundant closes in readReplicasFromCache

2018-03-07 Thread liaoyuxiangqin (JIRA)
liaoyuxiangqin created HDFS-13246: - Summary: FileInputStream redundant closes in readReplicasFromCache Key: HDFS-13246 URL: https://issues.apache.org/jira/browse/HDFS-13246 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390789#comment-16390789 ] genericqa commented on HDFS-13056: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2018-03-07 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390786#comment-16390786 ] lufei commented on HDFS-12999: -- It was my mistake to set this issue's fix version. [~leftnote

[jira] [Commented] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390772#comment-16390772 ] Zephyr Guo commented on HDFS-13243: --- Attach v2 patch to fix NoSuchMethodException > Get

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated HDFS-13243: -- Attachment: HDFS-13243-v2.patch > Get CorruptBlock because of calling close and sync in same time >

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.03.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390739#comment-16390739 ] He Xiaoqiao commented on HDFS-13234: Thanks [~kihwal],[~elgoiri] for your comments. {q

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390737#comment-16390737 ] genericqa commented on HDFS-13226: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390736#comment-16390736 ] genericqa commented on HDFS-11600: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13244) Add stack, conf, metrics links to utilities dropdown in NN webUI

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390734#comment-16390734 ] Ajay Kumar commented on HDFS-13244: --- +1 non-binding. tested in local machine. > Add st

[jira] [Updated] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13230: Attachment: HDFS-13230.001.patch > RBF: ConnectionManager's cleanup task will compare each pool's own active

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390730#comment-16390730 ] Chao Sun commented on HDFS-13230: - Thanks [~ywskycn] for taking a look. I think those two

[jira] [Created] (HDFS-13245) RBF: State store DBMS implementation

2018-03-07 Thread maobaolong (JIRA)
maobaolong created HDFS-13245: - Summary: RBF: State store DBMS implementation Key: HDFS-13245 URL: https://issues.apache.org/jira/browse/HDFS-13245 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390704#comment-16390704 ] Wangda Tan commented on HDFS-12999: --- [~figo], removed fix version, it should be only set

[jira] [Updated] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-12999: -- Fix Version/s: (was: 3.1.0) > When reach the end of the block group, it may not need to flush all th

[jira] [Commented] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390698#comment-16390698 ] Weiwei Wu commented on HDFS-13212: -- Add an assert to check the default location and fix t

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390697#comment-16390697 ] maobaolong commented on HDFS-13226: ---  My next patch will base on v003, let me complete t

[jira] [Updated] (HDFS-13212) RBF: Fix router location cache issue

2018-03-07 Thread Weiwei Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Wu updated HDFS-13212: - Attachment: HDFS-13212-006.patch > RBF: Fix router location cache issue >

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390628#comment-16390628 ] Yiqun Lin commented on HDFS-13226: -- {quote}and the end user really want to realize what m

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390621#comment-16390621 ] genericqa commented on HDFS-13230: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390619#comment-16390619 ] maobaolong commented on HDFS-13226: --- [~linyiqun] So, what about v003 patch, it fit the H

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Patch Available (was: Open) > Expose file-level composite CRCs in HDFS which are comparable acr

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390617#comment-16390617 ] Dennis Huo commented on HDFS-13056: --- Some observations - the FileSystem interface doesn'

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Status: Open (was: Patch Available) > Expose file-level composite CRCs in HDFS which are comparable acr

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056.008.patch > Expose file-level composite CRCs in HDFS which are comparable across

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056-branch-2.8.005.patch > Expose file-level composite CRCs in HDFS which are compara

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390615#comment-16390615 ] Yiqun Lin edited comment on HDFS-13226 at 3/8/18 2:25 AM: -- Just l

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390615#comment-16390615 ] Yiqun Lin commented on HDFS-13226: -- Just looking into the v004 patch. I don't think it's

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated HDFS-13243: -- Description: HDFS File might get broken because of corrupt block(s) that could be produced by calling c

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-07 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated HDFS-13243: -- Summary: Get CorruptBlock because of calling close and sync in same time (was: File might get broken be

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390595#comment-16390595 ] Íñigo Goiri commented on HDFS-13226: I'd be OK switching to using {void}, we intenrall

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390570#comment-16390570 ] maobaolong commented on HDFS-13226: --- [~elgoiri] I think we should check the exception fo

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390566#comment-16390566 ] Íñigo Goiri commented on HDFS-13226: In [^HDFS-13226.004.patch], for the unit test, sh

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390567#comment-16390567 ] maobaolong commented on HDFS-13226: --- As the Router has not been used widely, we maybe ca

[jira] [Updated] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDFS-13226: -- Attachment: HDFS-13226.004.patch HDFS-13226.003.patch > RBF: We should throw the failure

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390561#comment-16390561 ] genericqa commented on HDFS-13239: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390559#comment-16390559 ] Wei Yan commented on HDFS-13230: In general LGTM. Some minors: (1) We can just remove the

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:06 AM: --- [~el

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:04 AM: --- [~el

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390543#comment-16390543 ] Íñigo Goiri commented on HDFS-13226: Let's keep the return to boolean for now; just fo

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:04 AM: --- [~el

[jira] [Comment Edited] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390537#comment-16390537 ] maobaolong edited comment on HDFS-13226 at 3/8/18 1:03 AM: --- [~el

[jira] [Updated] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HDFS-13176: - Attachment: HDFS-13176-branch-2.01.patch > WebHdfs file path gets truncated when having semicolon

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390539#comment-16390539 ] Chao Sun commented on HDFS-13230: - Yes, I was going to complete that. The approach I was t

[jira] [Commented] (HDFS-13226) RBF: We should throw the failure validate and refuse this mount entry

2018-03-07 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390537#comment-16390537 ] maobaolong commented on HDFS-13226: --- [~elgoiri] Yeah, i think throw the IllegalArgumentE

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390523#comment-16390523 ] Íñigo Goiri commented on HDFS-13230: {quote} The cleanup method is actually moved out

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390508#comment-16390508 ] Chao Sun commented on HDFS-13230: - Thanks [~elgoiri] for the review and explanations. The

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390446#comment-16390446 ] Íñigo Goiri commented on HDFS-13230: Thanks [~csun] for [^HDFS-13230.000.patch]. Can

[jira] [Commented] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390398#comment-16390398 ] Chao Sun commented on HDFS-13230: - Attaching patch v0. Found that I need to change a few p

[jira] [Updated] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13230: Status: Patch Available (was: Open) > RBF: ConnectionManager's cleanup task will compare each pool's own ac

[jira] [Updated] (HDFS-13230) RBF: ConnectionManager's cleanup task will compare each pool's own active conns with its total conns

2018-03-07 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-13230: Attachment: HDFS-13230.000.patch > RBF: ConnectionManager's cleanup task will compare each pool's own active

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390395#comment-16390395 ] genericqa commented on HDFS-11394: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390391#comment-16390391 ] Hudson commented on HDFS-13225: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390388#comment-16390388 ] Wei Yan commented on HDFS-13232: Thanks [~elgoiri] > RBF: ConnectionPool should return fi

[jira] [Assigned] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Ekanth S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ekanth S reassigned HDFS-13232: --- Assignee: Ekanth S (was: Wei Yan) > RBF: ConnectionPool should return first usable connection >

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390385#comment-16390385 ] Íñigo Goiri commented on HDFS-13232: Added, he should be able to assign himself to JIR

[jira] [Commented] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390380#comment-16390380 ] Wei Yan commented on HDFS-13232: [~elgoiri] could u help add  [~ekanth] to the contributor

[jira] [Assigned] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned HDFS-13232: -- Assignee: Wei Yan > RBF: ConnectionPool should return first usable connection > ---

[jira] [Assigned] (HDFS-13232) RBF: ConnectionPool should return first usable connection

2018-03-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan reassigned HDFS-13232: -- Assignee: (was: Wei Yan) > RBF: ConnectionPool should return first usable connection >

[jira] [Updated] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13225: -- Resolution: Fixed Status: Resolved (was: Patch Available) > StripeReader#checkMissingBl

[jira] [Updated] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13225: -- Fix Version/s: 3.2.0 3.0.2 > StripeReader#checkMissingBlocks() 's IOException

[jira] [Updated] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13225: -- Fix Version/s: 3.1.0 > StripeReader#checkMissingBlocks() 's IOException info is incomplete > ---

[jira] [Commented] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390344#comment-16390344 ] Hanisha Koneru commented on HDFS-13225: --- Thanks for the contribution [~figo]. Commit

[jira] [Commented] (HDFS-13225) StripeReader#checkMissingBlocks() 's IOException info is incomplete

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390329#comment-16390329 ] Hanisha Koneru commented on HDFS-13225: --- Patch v02 LGTM. +1. > StripeReader#checkMi

[jira] [Updated] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13239: -- Status: Patch Available (was: In Progress) > Fix non-empty dir warning message when set

[jira] [Updated] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13239: -- Attachment: HDFS-13239.00.patch > Fix non-empty dir warning message when setting default

[jira] [Work started] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13239 started by Bharat Viswanadham. - > Fix non-empty dir warning message when setting default EC policy > --

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390298#comment-16390298 ] Kihwal Lee commented on HDFS-13234: --- New conf objects are created to prevent unintended

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390272#comment-16390272 ] Dennis Huo commented on HDFS-13056: --- Good catch, thanks for the report, [~ajayydv]. I ac

[jira] [Commented] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390210#comment-16390210 ] Hudson commented on HDFS-13176: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-13176) WebHdfs file path gets truncated when having semicolon (;) inside

2018-03-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390173#comment-16390173 ] Sean Mackrory commented on HDFS-13176: -- I've pushed this to trunk. This would be good

[jira] [Comment Edited] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390170#comment-16390170 ] Ajay Kumar edited comment on HDFS-13056 at 3/7/18 8:34 PM: --- Hi [

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-03-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390170#comment-16390170 ] Ajay Kumar commented on HDFS-13056: --- Hi [~dennishuo], Below test case fails with latest

[jira] [Commented] (HDFS-13241) RBF: TestRouterSafemode failed if the port 8888 is in use

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390161#comment-16390161 ] genericqa commented on HDFS-13241: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13234) Remove renew configuration instance in ConfiguredFailoverProxyProvider and reduce memory footprint for client

2018-03-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390147#comment-16390147 ] Kihwal Lee commented on HDFS-13234: --- bq. Configuration occupies over 600MB How big is a

[jira] [Commented] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390128#comment-16390128 ] Hanisha Koneru commented on HDFS-11394: --- I have posted patch v05 to move this forwar

[jira] [Updated] (HDFS-11394) Add method for getting erasure coding policy through WebHDFS

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11394: -- Attachment: HDFS-11394.005.patch > Add method for getting erasure coding policy through WebHDFS

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in EZ commands

2018-03-07 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390109#comment-16390109 ] Hanisha Koneru commented on HDFS-13109: --- Thanks [~xyao] for committing the patch and

[jira] [Commented] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-07 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390100#comment-16390100 ] Bharat Viswanadham commented on HDFS-13222: --- Thank You [~szetszwo] for review an

[jira] [Commented] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390098#comment-16390098 ] Hudson commented on HDFS-13222: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-13222) Update getBlocks method to take minBlockSize in RPC calls

2018-03-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390089#comment-16390089 ] Tsz Wo Nicholas Sze commented on HDFS-13222: I have committed this.  Thanks, B

  1   2   >