[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12327: - Attachment: (was: HDFS-12327-HDFS-7240.003.patch) > Ozone: support setting timeout in background servi

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136406#comment-16136406 ] Anu Engineer commented on HDFS-12282: - [~cheersyang] My concern comes from the issues

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136402#comment-16136402 ] Weiwei Yang commented on HDFS-12327: Thanks [~linyiqun], I just noticed this is wrappe

[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12327: - Attachment: HDFS-12327-HDFS-7240.003.patch > Ozone: support setting timeout in background service > --

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136401#comment-16136401 ] Weiwei Yang commented on HDFS-12282: Hi [~anu] Thanks for your quick comments. I have

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136399#comment-16136399 ] Yiqun Lin commented on HDFS-12327: -- Thanks for the review, [~cheersynang]. All the commen

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Attachment: HDFS-12282-HDFS-7240.002.patch > Ozone: DeleteKey-4: Block delete via HB between SCM and D

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-08-21 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136375#comment-16136375 ] Huafeng Wang commented on HDFS-1: - I just tweaked the patch according to your sugg

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-21 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136363#comment-16136363 ] Yuanbo Liu commented on HDFS-12283: --- [~cheersyang] Thanks for your comments. {quote} ozo

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136362#comment-16136362 ] Uma Maheswara Rao G commented on HDFS-12225: {quote} This is for standby namen

[jira] [Updated] (HDFS-12222) Add EC information to BlockLocation

2017-08-21 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-1: Attachment: HDFS-1.002.patch > Add EC information to BlockLocation > ---

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-001.patch > Federation Metrics > -- > >

[jira] [Comment Edited] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136290#comment-16136290 ] Surendra Singh Lilhore edited comment on HDFS-12225 at 8/22/17 5:09 AM:

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136290#comment-16136290 ] Surendra Singh Lilhore commented on HDFS-12225: --- bq. Why is this required? W

[jira] [Commented] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-08-21 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136275#comment-16136275 ] Yuanbo Liu commented on HDFS-12328: --- [~cheersyang], sure, I will update it in the descri

[jira] [Commented] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-08-21 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136274#comment-16136274 ] Yuanbo Liu commented on HDFS-12328: --- [~linyiqun] Thanks for your comments. Renaming the

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136224#comment-16136224 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-08-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136223#comment-16136223 ] Yiqun Lin commented on HDFS-12328: -- Hi [~yuanbo] and [~cheersyang], just some thoughts fr

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2017-08-21 Thread Doris Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136200#comment-16136200 ] Doris Gu commented on HDFS-2139: [~mopishv0] Could you please tell me the plan of this issu

[jira] [Commented] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-08-21 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136179#comment-16136179 ] Yiqun Lin commented on HDFS-12331: -- bq. Let's leave this JIRA open for the moment. The bu

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136143#comment-16136143 ] legend commented on HDFS-12318: --- Thanks [~jzhuge] for review and update. The failed tests s

[jira] [Commented] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-21 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136129#comment-16136129 ] liaoyuxiangqin commented on HDFS-12302: --- [~liuml07] Thanks for you review, could you

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Status: Patch Available (was: Open) > Federation Metrics > -- > > Key

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136101#comment-16136101 ] Íñigo Goiri commented on HDFS-12273: [~giovanni.fumarola], thank you for the comments.

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-000.patch Proposal for the metrics. > Federation Metrics >

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136093#comment-16136093 ] Wei-Chiu Chuang commented on HDFS-10899: ReencryptionUpdater#throttle(): {code} p

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136074#comment-16136074 ] Hadoop QA commented on HDFS-12321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136068#comment-16136068 ] Hadoop QA commented on HDFS-12273: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136022#comment-16136022 ] Anu Engineer commented on HDFS-12282: - [~cheersyang] Thanks for posting an early patch

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Description: Add metrics for the Router and the State Store. > Federation Metrics > --

[jira] [Assigned] (HDFS-12335) Federation Metrics

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-12335: -- Assignee: Íñigo Goiri > Federation Metrics > -- > > Key: HDFS-1

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.005.patch Thanks [~anu] for the review and the comments! Post v005 patc

[jira] [Comment Edited] (HDFS-12273) Federation UI

2017-08-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135948#comment-16135948 ] Giovanni Matteo Fumarola edited comment on HDFS-12273 at 8/21/17 10:29 PM: -

[jira] [Commented] (HDFS-12273) Federation UI

2017-08-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135948#comment-16135948 ] Giovanni Matteo Fumarola commented on HDFS-12273: - Thanks [~elgoiri]. Can

[jira] [Created] (HDFS-12335) Federation Metrics

2017-08-21 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created HDFS-12335: --- Summary: Federation Metrics Key: HDFS-12335 URL: https://issues.apache.org/jira/browse/HDFS-12335 Project: Hadoop HDFS Issue Type: Sub-

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135918#comment-16135918 ] Anu Engineer commented on HDFS-12280: - [~ljain] Thanks for taking care of this issue.

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135912#comment-16135912 ] Anu Engineer commented on HDFS-12321: - [~vagarychen] Thanks for adding this amazing ca

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135910#comment-16135910 ] Hudson commented on HDFS-11738: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135903#comment-16135903 ] Uma Maheswara Rao G commented on HDFS-12225: Hi [~surendrasingh], Thank you fo

[jira] [Updated] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12334: -- Status: Patch Available (was: Open) > [branch-2] Add storage type demand to into DFSNetworkTopology#cho

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135871#comment-16135871 ] Anu Engineer commented on HDFS-11888: - [~nandakumar131] , [~yuanbo] This patch fixes s

[jira] [Updated] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12334: -- Attachment: HDFS-12334-branch-2.001.patch > [branch-2] Add storage type demand to into DFSNetworkTopolog

[jira] [Created] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-21 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12334: - Summary: [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom Key: HDFS-12334 URL: https://issues.apache.org/jira/browse/HDFS-12334 Project: Hadoop HD

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135866#comment-16135866 ] Anu Engineer commented on HDFS-11888: - [~xyao] Thanks for creating this patch. I think

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-21 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135853#comment-16135853 ] Wei-Chiu Chuang commented on HDFS-10899: Still part way through the rev014 patch.

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.004.patch Fix the javac warning in v004 patch. > Ozone : debug cli: ad

[jira] [Updated] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11482: - Fix Version/s: 2.9.0 Pushed to branch-2 via HDFS-12322. Thanks [~vagarychen]! > Add storage type

[jira] [Updated] (HDFS-12273) Federation UI

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12273: --- Attachment: HDFS-12273-HDFS-10467-002.patch Rebased to HDFS-10467 and fixed a couple minor issues. The

[jira] [Updated] (HDFS-12322) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom.

2017-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12322: - Resolution: Duplicate Status: Resolved (was: Patch Available) Thanks [~vagarychen]. All f

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11738: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135764#comment-16135764 ] Hadoop QA commented on HDFS-12321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135680#comment-16135680 ] Arpit Agarwal edited comment on HDFS-12325 at 8/21/17 7:43 PM: -

[jira] [Commented] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135680#comment-16135680 ] Arpit Agarwal commented on HDFS-12325: -- The [documentation for SftpException|https:/

[jira] [Commented] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135670#comment-16135670 ] Chen Liang commented on HDFS-12325: --- Thanks [~elgoiri] for the review, this is good poin

[jira] [Commented] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135633#comment-16135633 ] Hudson commented on HDFS-12325: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-08-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135620#comment-16135620 ] Tsz Wo Nicholas Sze commented on HDFS-12331: BTW, we could fix the URISyntaxEx

[jira] [Commented] (HDFS-11988) Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version file

2017-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135592#comment-16135592 ] Hudson commented on HDFS-11988: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12325: - Reporter: Namit Maheshwari (was: Chen Liang) > SFTPFileSystem operations should restore cwd > ---

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135586#comment-16135586 ] Íñigo Goiri commented on HDFS-10631: Committed. Thank you [~subru] for the help on the

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-10631: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10467 Status: Resol

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.003.patch Fix the various Jenkins warnings in v003 patch. > Ozone : de

[jira] [Updated] (HDFS-10355) Fix thread_local related build issue on Mac OS X

2017-08-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10355: --- Attachment: HDFS-10355.HDFS-8707.000.patch Initial pass at a fix. Still a little left to do b

[jira] [Commented] (HDFS-12325) SFTPFileSystem operations should restore cwd

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135574#comment-16135574 ] Íñigo Goiri commented on HDFS-12325: Shouldn't the restore be done in a finally block?

[jira] [Commented] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-08-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135571#comment-16135571 ] Tsz Wo Nicholas Sze commented on HDFS-12331: [~linyiqun], thanks for reporting

[jira] [Updated] (HDFS-11988) Verify HDFS Snapshots with open files captured are safe across truncates and appends on current version file

2017-08-21 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11988: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 2.9.0 S

[jira] [Assigned] (HDFS-7240) Object store in HDFS

2017-08-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-7240: - Assignee: Jitendra Nath Pandey (was: Yiqun Lin) > Object store in HDFS >

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135524#comment-16135524 ] Hadoop QA commented on HDFS-12318: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135526#comment-16135526 ] Hadoop QA commented on HDFS-12225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

2017-08-21 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135483#comment-16135483 ] Chen Liang commented on HDFS-12332: --- Thanks [~xzhao9] for the improvement. One thought,

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135479#comment-16135479 ] Hadoop QA commented on HDFS-12282: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135456#comment-16135456 ] Weiwei Yang commented on HDFS-12283: Hi [~yuanbo] A few comments to v6 patch *ozone-

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135451#comment-16135451 ] Rakesh R commented on HDFS-12225: - Thanks [~surendrasingh], latest patch looks good to me.

[jira] [Commented] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135408#comment-16135408 ] Hadoop QA commented on HDFS-12332: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9941) Do not log StandbyException on NN, other minor logging fixes

2017-08-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135406#comment-16135406 ] Arpit Agarwal commented on HDFS-9941: - Hi [~brahmareddy], sure go ahead. This should be

[jira] [Commented] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135395#comment-16135395 ] Weiwei Yang commented on HDFS-12328: Hi [~yuanbo] Thanks for creating this task, this

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12318: -- Attachment: HDFS-12318.002.patch Thanks for the unit test! +1 LGTM with minor comments: * Rename unit t

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135387#comment-16135387 ] Weiwei Yang commented on HDFS-12327: Hi [~linyiqun] Thanks for working on this, it lo

[jira] [Commented] (HDFS-11520) libhdfs++: Support cancellation of individual RPC calls in C++ API

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135382#comment-16135382 ] Hadoop QA commented on HDFS-11520: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

2017-08-21 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12333: Description: Current Datanode web interface shows information about the Block Pools: * Namenode Add

[jira] [Assigned] (HDFS-11520) libhdfs++: Support cancellation of individual RPC calls in C++ API

2017-08-21 Thread Deepak Majeti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Majeti reassigned HDFS-11520: Assignee: Deepak Majeti (was: James Clampffer) > libhdfs++: Support cancellation of indivi

[jira] [Created] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

2017-08-21 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12333: --- Summary: Ozone: Extend Datanode web interface with SCM information Key: HDFS-12333 URL: https://issues.apache.org/jira/browse/HDFS-12333 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-21 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-07.patch Thanks [~rakeshr] for review.. Attach

[jira] [Commented] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135333#comment-16135333 ] James Clampffer commented on HDFS-10787: Thanks for the updates [~anatoli.shein].

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Attachment: HDFS-12282-HDFS-7240.001.patch > Ozone: DeleteKey-4: Block delete via HB between SCM and D

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Status: Patch Available (was: In Progress) > Ozone: DeleteKey-4: Block delete via HB between SCM and

[jira] [Updated] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

2017-08-21 Thread Xu Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Zhao updated HDFS-12332: --- Attachment: hdfs-12332.patch > Logging improvement suggestion for SampleStat function MinMax.add > ---

[jira] [Updated] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

2017-08-21 Thread Xu Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Zhao updated HDFS-12332: --- Flags: (was: Patch) > Logging improvement suggestion for SampleStat function MinMax.add > --

[jira] [Updated] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

2017-08-21 Thread Xu Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Zhao updated HDFS-12332: --- Target Version/s: 3.0.0-alpha4 Status: Patch Available (was: Open) > Logging improvement sugges

[jira] [Created] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

2017-08-21 Thread Xu Zhao (JIRA)
Xu Zhao created HDFS-12332: -- Summary: Logging improvement suggestion for SampleStat function MinMax.add Key: HDFS-12332 URL: https://issues.apache.org/jira/browse/HDFS-12332 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-10355) Fix thread_local related build issue on Mac OS X

2017-08-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135290#comment-16135290 ] James Clampffer commented on HDFS-10355: I'll get a patch up for this this week.

[jira] [Assigned] (HDFS-10355) Fix thread_local related build issue on Mac OS X

2017-08-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-10355: -- Assignee: James Clampffer > Fix thread_local related build issue on Mac OS X >

[jira] [Commented] (HDFS-12331) Ozone: Mini cluster can't start up on Windows after HDFS-12159

2017-08-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135272#comment-16135272 ] Anu Engineer commented on HDFS-12331: - [~szetszwo] Would you please take a look at why

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135256#comment-16135256 ] Hadoop QA commented on HDFS-12318: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-12275) Ozone: Corona: Support for random validation of writes

2017-08-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135229#comment-16135229 ] Mukul Kumar Singh commented on HDFS-12275: -- I missed a review comment in my last

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-21 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135228#comment-16135228 ] Mukul Kumar Singh commented on HDFS-12280: -- Hi [~ljain], Thanks for the patch, it

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Status: Open (was: Patch Available) > Fix IOException condition for openInfo in DFSInputStream > --

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Status: Patch Available (was: Open) > Fix IOException condition for openInfo in DFSInputStream > --

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-21 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12318: -- Attachment: HDFS-12318.001.patch > Fix IOException condition for openInfo in DFSInputStream > --

[jira] [Commented] (HDFS-12299) Race Between update pipeline and DN Re-Registration

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135127#comment-16135127 ] Hadoop QA commented on HDFS-12299: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16135109#comment-16135109 ] Hadoop QA commented on HDFS-12319: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

  1   2   >