[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256716#comment-15256716 ] Mingliang Liu commented on HDFS-10326: -- Thanks for reporting this. FWIW, [HDFS-8829]a

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257008#comment-15257008 ] Mingliang Liu commented on HDFS-10326: -- {quote} If we strongly believe that auto-tuni

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15257099#comment-15257099 ] Mingliang Liu commented on HDFS-10175: -- Thanks for proposing the discussion. The time

[jira] [Commented] (HDFS-10326) Disable setting tcp socket send/receive buffers for write pipelines

2016-04-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258605#comment-15258605 ] Mingliang Liu commented on HDFS-10326: -- Ping [~mingma] for more input. > Disable set

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259234#comment-15259234 ] Mingliang Liu commented on HDFS-10175: -- Either tomorrow or next week will work for me

[jira] [Updated] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10335: - Summary: Mover$Processor#chooseTarget() always chooses the first matching target storage group (w

[jira] [Created] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target datanode

2016-04-26 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10335: Summary: Mover$Processor#chooseTarget() always chooses the first matching target datanode Key: HDFS-10335 URL: https://issues.apache.org/jira/browse/HDFS-10335 Projec

[jira] [Work started] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10335 started by Mingliang Liu. > Mover$Processor#chooseTarget() always chooses the first matching target > stor

[jira] [Updated] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10335: - Description: Currently the {{org.apache.hadoop.hdfs.server.mover.Mover$Processor#chooseTarget()}}

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259401#comment-15259401 ] Mingliang Liu commented on HDFS-10335: -- The code is as following: {code} boolean

[jira] [Updated] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10335: - Attachment: HDFS-10335.000.patch > Mover$Processor#chooseTarget() always chooses the first matchin

[jira] [Updated] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10335: - Status: Patch Available (was: In Progress) > Mover$Processor#chooseTarget() always chooses the fi

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260940#comment-15260940 ] Mingliang Liu commented on HDFS-10335: -- {code} Step 16 : RUN cabal update && cabal in

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260943#comment-15260943 ] Mingliang Liu commented on HDFS-10335: -- Thanks for your discussion and review, [~szet

[jira] [Commented] (HDFS-10338) DistCp masks potential CRC check failures

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261127#comment-15261127 ] Mingliang Liu commented on HDFS-10338: -- I'm favor of propagating the IOException thro

[jira] [Updated] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10335: - Attachment: HDFS-10335.000.patch Re-uploading the same patch to trigger Jenkins. > Mover$Processo

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263428#comment-15263428 ] Mingliang Liu commented on HDFS-10335: -- Failing tests are not related. Specially, {{

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264494#comment-15264494 ] Mingliang Liu commented on HDFS-10335: -- Thanks for your review and commit, [~szetszwo

[jira] [Commented] (HDFS-10347) Namenode report bad block method doesn't log the bad block or datanode.

2016-04-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264747#comment-15264747 ] Mingliang Liu commented on HDFS-10347: -- +1 (non-binding) as the patch is simple and c

[jira] [Commented] (HDFS-10347) Namenode report bad block method doesn't log the bad block or datanode.

2016-04-29 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264785#comment-15264785 ] Mingliang Liu commented on HDFS-10347: -- If we are locking/unlocking for each reported

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267782#comment-15267782 ] Mingliang Liu commented on HDFS-9732: - Thanks for the patch. May I ask why the {{String

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-05-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15270026#comment-15270026 ] Mingliang Liu commented on HDFS-10220: -- I also think changing from {{Lease leaseToChe

[jira] [Commented] (HDFS-10367) TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.

2016-05-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271832#comment-15271832 ] Mingliang Liu commented on HDFS-10367: -- This is a workaround fix. I see no simple fix

[jira] [Commented] (HDFS-10367) TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.

2016-05-04 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15271850#comment-15271850 ] Mingliang Liu commented on HDFS-10367: -- Thanks for your comment [~iwasakims]. I was f

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-05-05 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272889#comment-15272889 ] Mingliang Liu commented on HDFS-9732: - Thanks for the explanation. String concatenation

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-05-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274736#comment-15274736 ] Mingliang Liu commented on HDFS-10220: -- Hi [~nfraison.criteo], you don't have to chan

[jira] [Commented] (HDFS-10381) DataNode exclusion log message should be a warning

2016-05-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276825#comment-15276825 ] Mingliang Liu commented on HDFS-10381: -- Is this for {{DataStreamer}}? Perhaps we can

[jira] [Created] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-09 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10383: Summary: Safely close resources in DFSTestUtil Key: HDFS-10383 URL: https://issues.apache.org/jira/browse/HDFS-10383 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-10386) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-10386. -- Resolution: Duplicate This is a duplicate of [HDFS-10387]. Re-open if I'm wrong. Thanks. > Data

[jira] [Updated] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10387: - Priority: Minor (was: Major) > DataTransferProtocol#writeBlock missing some javadocs > --

[jira] [Commented] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278755#comment-15278755 ] Mingliang Liu commented on HDFS-10387: -- Thanks for the patch. May I ask why {{allowLa

[jira] [Commented] (HDFS-10385) LocalFileSystem rename() function should return false when destination file exists

2016-05-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278785#comment-15278785 ] Mingliang Liu commented on HDFS-10385: -- For {{ChecksumFileSystem}}, the rename operat

[jira] [Commented] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278975#comment-15278975 ] Mingliang Liu commented on HDFS-10387: -- That makes sense to me. Thanks for the explan

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Attachment: HDFS-10383.000.patch The v0 patch is the first effort addressing this problem. Kindly

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Status: Patch Available (was: Open) > Safely close resources in DFSTestUtil > ---

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280945#comment-15280945 ] Mingliang Liu commented on HDFS-10383: -- Thanks [~xyao] for your comment. I'll address

[jira] [Commented] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280976#comment-15280976 ] Mingliang Liu commented on HDFS-10383: -- That makes sense. I'll post a new patch soon.

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Priority: Major (was: Minor) The v1 patch revisited the {{DFSTestUtil}} class. # {{urlGetBytes}}

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Attachment: HDFS-10383.001.patch > Safely close resources in DFSTestUtil > ---

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-11 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Issue Type: Improvement (was: Bug) > Safely close resources in DFSTestUtil >

[jira] [Updated] (HDFS-10383) Safely close resources in DFSTestUtil

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10383: - Attachment: HDFS-10383.002.patch The v2 patch is to revert {{createStripedFile()}} and {{runOperat

[jira] [Created] (HDFS-10395) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-12 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10395: Summary: GlobalStorageStatistics should check null FileSystem scheme to avoid NPE Key: HDFS-10395 URL: https://issues.apache.org/jira/browse/HDFS-10395 Project: Hadoo

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282098#comment-15282098 ] Mingliang Liu commented on HDFS-8828: - Hi, I'm aware that {{-delete}} and {{-diff}} o

[jira] [Created] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-12 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10397: Summary: Distcp should ignore -delete option if -diff option is provided instead of exiting Key: HDFS-10397 URL: https://issues.apache.org/jira/browse/HDFS-10397 Proj

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build diff copy list in distcp

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282142#comment-15282142 ] Mingliang Liu commented on HDFS-8828: - Thanks [~jingzhao], [~yzhangal] and [~jnp] for y

[jira] [Commented] (HDFS-10397) Distcp should ignore -delete option if -diff option is provided instead of exiting

2016-05-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282160#comment-15282160 ] Mingliang Liu commented on HDFS-10397: -- Sample error message: {code} 2016-05-05 06:

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.003.patch In v3 patch, the {{Namesystem}} will not leave *STARTUP* to *OFF* sta

[jira] [Commented] (HDFS-9242) Fix Findbugs warning from webhdfs.DataNodeUGIProvider.ugiCache

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957997#comment-14957997 ] Mingliang Liu commented on HDFS-9242: - I think the warning is false positive. We can wr

[jira] [Created] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-14 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9245: --- Summary: Fix findbugs warnings in hdfs-nfs/WriteCtx Key: HDFS-9245 URL: https://issues.apache.org/jira/browse/HDFS-9245 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958062#comment-14958062 ] Mingliang Liu commented on HDFS-9092: - There are new findbugs warnings in the last patc

[jira] [Updated] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9245: Description: There are findbugs warnings as follows, brought by [HDFS-9092]. It seems fine to ignore

[jira] [Updated] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9245: Target Version/s: 2.8.0 > Fix findbugs warnings in hdfs-nfs/WriteCtx > --

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.006.patch The v6 patch fixes checkstyle and findbugs warnings. > Logging HDFS

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958157#comment-14958157 ] Mingliang Liu commented on HDFS-4015: - One quick question: Consider the name node is in

[jira] [Commented] (HDFS-9246) TestGlobPaths#pTestCurlyBracket is failing

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958159#comment-14958159 ] Mingliang Liu commented on HDFS-9246: - The test failure can be reproduced locally on Li

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958238#comment-14958238 ] Mingliang Liu commented on HDFS-4015: - Thanks for the confirmation (and for the patch).

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958239#comment-14958239 ] Mingliang Liu commented on HDFS-4015: - Thanks for the confirmation (and for the patch).

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958404#comment-14958404 ] Mingliang Liu commented on HDFS-9092: - Thank you [~yzhangal] for your quick reply. You'

[jira] [Created] (HDFS-9247) Add an Apache license header to DatanodeStats.java

2015-10-14 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9247: --- Summary: Add an Apache license header to DatanodeStats.java Key: HDFS-9247 URL: https://issues.apache.org/jira/browse/HDFS-9247 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-9247) Add an Apache license header to DatanodeStats.java

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9247: Description: Addendum commit is enough. (was: This jira tracks effort of adding an Apache license h

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958423#comment-14958423 ] Mingliang Liu commented on HDFS-4015: - The patch looks good to me overall. More discuss

[jira] [Commented] (HDFS-9219) Even if permission is enabled in an environment, while resolving reserved paths there is no check on permission.

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959264#comment-14959264 ] Mingliang Liu commented on HDFS-9219: - Thank you for elaborating this. It makes sense t

[jira] [Resolved] (HDFS-9247) Add an Apache license header to DatanodeStats.java

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9247. - Resolution: Fixed > Add an Apache license header to DatanodeStats.java > --

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959329#comment-14959329 ] Mingliang Liu commented on HDFS-9092: - It happens to me sometimes when the Jenkins did

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959355#comment-14959355 ] Mingliang Liu commented on HDFS-9092: - s/Do/Does/ > Nfs silently drops overlapping wri

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959496#comment-14959496 ] Mingliang Liu commented on HDFS-9208: - Hi [~kihwal], this is on my list this week but I

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9208: Assignee: Kihwal Lee (was: Mingliang Liu) > Disabling atime may fail clients like distCp > -

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.007.patch Thanks for your view, [~jnp]. The v7 patch addresses the latest comme

[jira] [Commented] (HDFS-8831) Trash Support for files in HDFS encryption zone

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959792#comment-14959792 ] Mingliang Liu commented on HDFS-8831: - Thanks for working on this. The design doc is ve

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.004.patch The v4 patch is to address the failing tests and further refactoring

[jira] [Updated] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9245: Status: Patch Available (was: Open) > Fix findbugs warnings in hdfs-nfs/WriteCtx > -

[jira] [Updated] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9245: Attachment: HDFS-9245.000.patch Hi [~yzhangal], please review the patch v0. Thanks. > Fix findbugs w

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Status: Patch Available (was: Open) > Logging HDFS operation's caller context into audit logs >

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Status: Open (was: Patch Available) > Logging HDFS operation's caller context into audit logs >

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.005.patch The failing test is not related. The v5 patch is not tracking safe bl

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961091#comment-14961091 ] Mingliang Liu commented on HDFS-9259: - Hi [~mingma], can I work on this, if we reach co

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961110#comment-14961110 ] Mingliang Liu commented on HDFS-9129: - The failing tests can pass locally. Addressing t

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961413#comment-14961413 ] Mingliang Liu commented on HDFS-9184: - The failing tests seem unrelated and can pass lo

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961557#comment-14961557 ] Mingliang Liu commented on HDFS-9241: - {quote} Old applications can still depend on had

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961589#comment-14961589 ] Mingliang Liu commented on HDFS-9184: - Thanks for your comment [~daijy]. To address thi

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.006.patch As per offline discussion, the v6 patch prefers synchronized {{getSaf

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.008.patch Per offline discussion, the {{signature}} is changed from {{String}}

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14962145#comment-14962145 ] Mingliang Liu commented on HDFS-9184: - The failing tests seem unrelated and can pass lo

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963652#comment-14963652 ] Mingliang Liu commented on HDFS-9241: - I think you two [~wheat9] and [~steve_l] have ma

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Attachment: HDFS-9241.001.patch The v1 patch moves the {{HdfsConfiguration}} class from {{hadoop-hdfs

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Attachment: HDFS-9241.002.patch Thanks for your review [~ste...@apache.org] and [~wheat9]. The v2 pat

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Attachment: HDFS-9241.003.patch The v3 patch is to address the checkstyle warnings. > HDFS clients c

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.007.patch Thank you [~wheat9] for your detailed comments. The v7 patch addresse

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.008.patch The v8 patch is to address one checkstyle warning and one failing uni

[jira] [Commented] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14969524#comment-14969524 ] Mingliang Liu commented on HDFS-9245: - Per offline discussion with [~brandonli], the {{

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Status: Open (was: Patch Available) > HDFS clients can't construct HdfsConfiguration instances > ---

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Status: Patch Available (was: Open) > HDFS clients can't construct HdfsConfiguration instances > ---

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Attachment: HDFS-9241.004.patch The v2 patch can be built locally (Mac and Linux), and the v3 patch d

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.009.patch In the v8 patch, the findbugs warning is unrelated, the checkstyle ar

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970332#comment-14970332 ] Mingliang Liu commented on HDFS-9129: - s/this/v9 > Move the safemode block count into

[jira] [Updated] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9241: Attachment: HDFS-9241.005.patch The failing tests can pass locally. It seems the Jenkins is broken.

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.009.patch The v9 patch rebases from {{trunk}} branch and resolves trivial confl

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970512#comment-14970512 ] Mingliang Liu commented on HDFS-9129: - The failing tests can pass locally (Linux and Ma

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970571#comment-14970571 ] Mingliang Liu commented on HDFS-9184: - The failing tests can pass locally (Linux and Ma

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971836#comment-14971836 ] Mingliang Liu commented on HDFS-4015: - I revised the safe mode part and it looks good t

<    1   2   3   4   5   6   7   8   9   10   >