[jira] [Reopened] (HDFS-14084) Need for more stats in DFSClient

2019-01-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened HDFS-14084: --- I reverted this from trunk, branch-3.2, branch-3.1, branch-3.1.2, and branch-3.0. Heads up to [~leftnot

[jira] [Updated] (HDFS-14084) Need for more stats in DFSClient

2019-01-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-14084: -- Target Version/s: 3.0.4, 3.3.0, 3.2.1, 3.1.3 Fix Version/s: (was: 3.2.1)

[jira] [Commented] (HDFS-14084) Need for more stats in DFSClient

2019-01-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738768#comment-16738768 ] Jason Lowe commented on HDFS-14084: --- This is breaking more than just tests.  MapReduce

[jira] [Created] (HDFS-13975) TestBalancer#testMaxIterationTime fails sporadically

2018-10-08 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-13975: - Summary: TestBalancer#testMaxIterationTime fails sporadically Key: HDFS-13975 URL: https://issues.apache.org/jira/browse/HDFS-13975 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-13822) speedup libhdfs++ build (enable parallel build)

2018-08-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-13822: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status: Resolved (

[jira] [Assigned] (HDFS-13822) speedup libhdfs++ build (enable parallel build)

2018-08-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned HDFS-13822: - Assignee: Allen Wittenauer Thanks for the patches, [~pradeepambati] and [~aw]! This looks like

[jira] [Commented] (HDFS-13472) Compilation error in trunk in hadoop-aws

2018-04-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16442734#comment-16442734 ] Jason Lowe commented on HDFS-13472: --- I am unable to reproduce the compilation error in t

[jira] [Commented] (HDFS-13371) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16419489#comment-16419489 ] Jason Lowe commented on HDFS-13371: --- {quote}Is there a good way to handle this other tha

[jira] [Commented] (HDFS-13362) add a flag to skip the libhdfs++ build

2018-03-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417981#comment-16417981 ] Jason Lowe commented on HDFS-13362: --- The maven plugin for cmake automatically detects th

[jira] [Commented] (HDFS-13362) add a flag to skip the libhdfs++ build

2018-03-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417665#comment-16417665 ] Jason Lowe commented on HDFS-13362: --- Part of the problem with the excessive build time i

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-02-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-13164: -- Fix Version/s: (was: 2.8.4) I reverted this from branch-2.8 because it breaks the build: {noformat}

[jira] [Commented] (HDFS-13039) StripedBlockReader#createBlockReader leaks socket on IOException

2018-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334531#comment-16334531 ] Jason Lowe commented on HDFS-13039: --- Note that branch-3 should not be a target of commit

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329669#comment-16329669 ] Jason Lowe commented on HDFS-12919: --- branch-3 should not exist at all (yet).  It was acc

[jira] [Commented] (HDFS-9049) Make Datanode Netty reverse proxy port to be configurable

2018-01-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329229#comment-16329229 ] Jason Lowe commented on HDFS-9049: -- This was committed accidentally to branch-3 instead of

[jira] [Commented] (HDFS-13004) TestLeaseRecoveryStriped#testLeaseRecovery is failing when safeLength is 0MB or larger than the test file

2018-01-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329208#comment-16329208 ] Jason Lowe commented on HDFS-13004: --- This was committed accidentally to branch-3 instead

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329201#comment-16329201 ] Jason Lowe commented on HDFS-12919: --- This was committed accidentally to branch-3 instead

[jira] [Commented] (HDFS-11848) Enhance dfsadmin listOpenFiles command to list files under a given path

2018-01-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329195#comment-16329195 ] Jason Lowe commented on HDFS-11848: --- This was committed accidentally to branch-3 instead

[jira] [Commented] (HDFS-11847) Enhance dfsadmin listOpenFiles command to list files blocking datanode decommissioning

2018-01-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16328942#comment-16328942 ] Jason Lowe commented on HDFS-11847: --- I recently noticed the new {{branch-3}} branch and

[jira] [Updated] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-12881: -- Resolution: Fixed Fix Version/s: 2.7.6 2.8.4 2.9.1

[jira] [Commented] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293222#comment-16293222 ] Jason Lowe commented on HDFS-12881: --- Thanks for the branch-2 patch! +1 lgtm. I agree t

[jira] [Updated] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-12881: -- Status: Patch Available (was: Reopened) > Output streams closed with IOUtils suppressing write errors >

[jira] [Reopened] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened HDFS-12881: --- Reopening to get a precommit run on the branch-2 patch. > Output streams closed with IOUtils suppressing

[jira] [Commented] (HDFS-12924) Port HDFS-12881 to branch-2 (Output streams closed with IOUtils suppressing write errors)

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291314#comment-16291314 ] Jason Lowe commented on HDFS-12924: --- I've already resolved it as a duplicate, so we can

[jira] [Resolved] (HDFS-12924) Port HDFS-12881 to branch-2 (Output streams closed with IOUtils suppressing write errors)

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved HDFS-12924. --- Resolution: Duplicate > Port HDFS-12881 to branch-2 (Output streams closed with IOUtils suppressing >

[jira] [Commented] (HDFS-12924) Port HDFS-12881 to branch-2 (Output streams closed with IOUtils suppressing write errors)

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291297#comment-16291297 ] Jason Lowe commented on HDFS-12924: --- We should just do this on HDFS-12881 rather than cr

[jira] [Updated] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-12881: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 3.1.0

[jira] [Commented] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291035#comment-16291035 ] Jason Lowe commented on HDFS-12881: --- Thanks for updating the patch! The unit tests are

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291005#comment-16291005 ] Jason Lowe commented on HDFS-12920: --- This only occurs if the job submitter is using 3.x

[jira] [Comment Edited] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288320#comment-16288320 ] Jason Lowe edited comment on HDFS-12881 at 12/12/17 9:58 PM: -

[jira] [Commented] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288320#comment-16288320 ] Jason Lowe commented on HDFS-12881: --- Thanks for updating the patch! The patch looks muc

[jira] [Commented] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284047#comment-16284047 ] Jason Lowe commented on HDFS-12881: --- Thanks for the patch! The patch updates the handli

[jira] [Commented] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274548#comment-16274548 ] Jason Lowe commented on HDFS-12881: --- Some places with this pattern: * FsDatasetImpl#comp

[jira] [Created] (HDFS-12881) Output streams closed with IOUtils suppressing write errors

2017-12-01 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-12881: - Summary: Output streams closed with IOUtils suppressing write errors Key: HDFS-12881 URL: https://issues.apache.org/jira/browse/HDFS-12881 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-12817) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253958#comment-16253958 ] Jason Lowe commented on HDFS-12817: --- Probably a hiccup from JIRA being occasionally slow

[jira] [Resolved] (HDFS-12817) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved HDFS-12817. --- Resolution: Duplicate > Support multiple storages in DataNodeCluster / SimulatedFSDataset > --

[jira] [Commented] (HDFS-12688) HDFS File Not Removed Despite Successful "Moved to .Trash" Message

2017-10-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212654#comment-16212654 ] Jason Lowe commented on HDFS-12688: --- Then there is very likely some other job or async b

[jira] [Commented] (HDFS-12688) HDFS File Not Removed Despite Successful "Moved to .Trash" Message

2017-10-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211729#comment-16211729 ] Jason Lowe commented on HDFS-12688: --- Have you checked the HDFS audit logs? That should

[jira] [Updated] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-08-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-12217: -- Fix Version/s: (was: 2.9.0) > HDFS snapshots doesn't capture all open files when one of the open fil

[jira] [Reopened] (HDFS-12217) HDFS snapshots doesn't capture all open files when one of the open files is deleted

2017-08-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened HDFS-12217: --- I reverted this from branch-2 because the commit broke the build. {noformat} [ERROR] COMPILATION ERROR :

[jira] [Commented] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050605#comment-16050605 ] Jason Lowe commented on HDFS-11736: --- The branch-2 and branch-2.8 builds broke after this

[jira] [Updated] (HDFS-11818) TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently

2017-05-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-11818: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 3.0.0-alpha3

[jira] [Commented] (HDFS-11818) TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently

2017-05-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008847#comment-16008847 ] Jason Lowe commented on HDFS-11818: --- Test failures are unrelated. +1 lgtm. Committing

[jira] [Updated] (HDFS-11818) TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently

2017-05-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-11818: -- Affects Version/s: 2.8.2 > TestBlockManager.testSufficientlyReplBlocksUsesNewRack fails intermittently >

[jira] [Updated] (HDFS-11745) Increase HDFS test timeouts from 1 second to 10 seconds

2017-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-11745: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 3.0.0-alpha3

[jira] [Commented] (HDFS-11745) Increase HDFS test timeouts from 1 second to 10 seconds

2017-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005116#comment-16005116 ] Jason Lowe commented on HDFS-11745: --- Test failures are unrelated. +1 lgtm. Committing

[jira] [Commented] (HDFS-11745) Increase HDFS test timeouts from 1 second to 10 seconds

2017-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004643#comment-16004643 ] Jason Lowe commented on HDFS-11745: --- bq. Thanks for committing it I'm guessing this com

[jira] [Commented] (HDFS-11745) Increase HDFS test timeouts from 1 second to 10 seconds

2017-05-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003597#comment-16003597 ] Jason Lowe commented on HDFS-11745: --- Thanks for the patch! I noticed that TestNameNodeM

[jira] [Updated] (HDFS-11691) Add a proper scheme to the datanode links in NN web UI

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-11691: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1 3.0.0-alpha3

[jira] [Commented] (HDFS-11691) Add a proper scheme to the datanode links in NN web UI

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983034#comment-15983034 ] Jason Lowe commented on HDFS-11691: --- +1 lgtm. I'll commit this later today if there are

[jira] [Resolved] (HDFS-11501) Is there a way of loading cvs files to create hive tables with desired lengths for columns?

2017-03-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved HDFS-11501. --- Resolution: Invalid JIRA is for tracking bugs against the Hadoop project and not for general user sup

[jira] [Commented] (HDFS-11498) Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0

2017-03-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15897515#comment-15897515 ] Jason Lowe commented on HDFS-11498: --- I was under the impression this would go in relativ

[jira] [Updated] (HDFS-11498) Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0

2017-03-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-11498: -- Attachment: HDFS-11498.001.patch +1, branch-2 patch looks good to me. The javac warning is unrelated as

[jira] [Commented] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15751737#comment-15751737 ] Jason Lowe commented on HDFS-11252: --- Stacktrace: {noformat} java.net.BindException: Prob

[jira] [Created] (HDFS-11252) TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException

2016-12-15 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-11252: - Summary: TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException Key: HDFS-11252 URL: https://issues.apache.org/jira/browse/HDFS-11252 Pro

[jira] [Created] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-15 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-11251: - Summary: ConcurrentModificationException during DataNode#refreshVolumes Key: HDFS-11251 URL: https://issues.apache.org/jira/browse/HDFS-11251 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11251) ConcurrentModificationException during DataNode#refreshVolumes

2016-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15751703#comment-15751703 ] Jason Lowe commented on HDFS-11251: --- The test failed with this stacktrace: {noformat} or

[jira] [Updated] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-9745: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4 2.8.0

[jira] [Commented] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432932#comment-15432932 ] Jason Lowe commented on HDFS-9745: -- Seeing occasional timeouts for this test as well. +1

[jira] [Commented] (HDFS-10774) Reflective XSS and HTML injection vulnerability

2016-08-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15426512#comment-15426512 ] Jason Lowe commented on HDFS-10774: --- Security issues can be mailed to secur...@hadoop.ap

[jira] [Updated] (HDFS-9580) TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.

2016-06-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-9580: - Fix Version/s: (was: 3.0.0-alpha1) 2.8.0 Thanks, [~jojochuang]! I committed this to

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025422#comment-15025422 ] Jason Lowe commented on HDFS-9434: -- This broke the 2.6 build. The patch is assuming SLF4J

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968376#comment-14968376 ] Jason Lowe commented on HDFS-7087: -- Looks like this broke the branch-2 build: {noformat} [

[jira] [Updated] (HDFS-9193) Fix incorrect references the usages of the DN in dfshealth.js

2015-10-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-9193: - Affects Version/s: 2.8.0 Fix Version/s: 2.8.0 > Fix incorrect references the usages of the DN in df

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota without need to get file and directory counts

2015-08-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14697547#comment-14697547 ] Jason Lowe commented on HDFS-8898: -- This would solve a significant annoyance with computin

[jira] [Commented] (HDFS-8068) Do not retry rpc calls If the proxy contains unresolved address

2015-06-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603682#comment-14603682 ] Jason Lowe commented on HDFS-8068: -- Recently I ran across a similar situation except it in

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

2015-04-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507982#comment-14507982 ] Jason Lowe commented on HDFS-8182: -- Quota seems like it could be problematic for some of t

[jira] [Commented] (HDFS-7212) Huge number of BLOCKED threads rendering DataNodes useless

2015-03-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371285#comment-14371285 ] Jason Lowe commented on HDFS-7212: -- Wondering if you were seeing the same thing as HADOOP-

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with "+"

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329790#comment-14329790 ] Jason Lowe commented on HDFS-7816: -- I don't think we can rely on clients changing the way

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with escape characters

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329396#comment-14329396 ] Jason Lowe commented on HDFS-7816: -- Thanks, Haohui! Sorry for the duplicate noise, I miss

[jira] [Commented] (HDFS-7279) Use netty to implement DatanodeWebHdfsMethods

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329206#comment-14329206 ] Jason Lowe commented on HDFS-7279: -- We ran into an issue with webhdfs paths containing esc

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with escape characters

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329199#comment-14329199 ] Jason Lowe commented on HDFS-7816: -- This appears to be broken after HDFS-7279. What's hap

[jira] [Created] (HDFS-7816) Unable to open webhdfs paths with escape characters

2015-02-20 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-7816: Summary: Unable to open webhdfs paths with escape characters Key: HDFS-7816 URL: https://issues.apache.org/jira/browse/HDFS-7816 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7533) Datanode sometimes does not shutdown on receiving upgrade shutdown command

2015-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274206#comment-14274206 ] Jason Lowe commented on HDFS-7533: -- The "-1 overall" is unrelated, see HADOOP-11473. > Da

[jira] [Commented] (HDFS-7598) TestDFSClientCache.testEviction is not quite correct and fails with newer version of guava

2015-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274168#comment-14274168 ] Jason Lowe commented on HDFS-7598: -- I think the -1 overall was caused by the test-patch.sh

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163847#comment-14163847 ] Jason Lowe commented on HDFS-7199: -- bq. But I also wonder why you are getting a non-IOExc

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14160974#comment-14160974 ] Jason Lowe commented on HDFS-7199: -- I believe the problem lies in the way DataStreamer is

[jira] [Created] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-06 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-7199: Summary: DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception Key: HDFS-7199 URL: https://issues.apache.org/jira/browse/HDFS-7199 Project:

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115859#comment-14115859 ] Jason Lowe commented on HDFS-6840: -- The test failures appear to be unrelated, and they pas

[jira] [Resolved] (HDFS-6907) Source files missing license headers

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved HDFS-6907. -- Resolution: Duplicate Dup of HDFS-6905. > Source files missing license headers > --

[jira] [Commented] (HDFS-6846) NetworkTopology#sortByDistance should give nodes higher priority, which cache the block.

2014-08-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14101269#comment-14101269 ] Jason Lowe commented on HDFS-6846: -- That seems like a reasonable compromise if we don't ne

[jira] [Commented] (HDFS-6846) NetworkTopology#sortByDistance should give nodes higher priority, which cache the block.

2014-08-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095807#comment-14095807 ] Jason Lowe commented on HDFS-6846: -- This could be very undesirable if a single node is the

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094706#comment-14094706 ] Jason Lowe commented on HDFS-6840: -- Commenting out the setSeed call in NetworkTopology on

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093613#comment-14093613 ] Jason Lowe commented on HDFS-6840: -- I think the previous behavior was not deterministic du

[jira] [Updated] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-08-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-6268: - Fix Version/s: 2.5.0 We also ran into the massive skew issue during localization that [~ashwinshankar77]

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093584#comment-14093584 ] Jason Lowe commented on HDFS-6840: -- HDFS-6701 gives the option to randomize the returned d

[jira] [Created] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-11 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-6840: Summary: Clients are always sent to the same datanode when read is off rack Key: HDFS-6840 URL: https://issues.apache.org/jira/browse/HDFS-6840 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6770) stop-dfs.sh/start-dfs.sh breaks if native lib not installed

2014-07-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078228#comment-14078228 ] Jason Lowe commented on HDFS-6770: -- I believe this is a duplicate of HDFS-4427. > stop-df

[jira] [Created] (HDFS-6421) RHEL4 fails to compile vecsum.c

2014-05-16 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-6421: Summary: RHEL4 fails to compile vecsum.c Key: HDFS-6421 URL: https://issues.apache.org/jira/browse/HDFS-6421 Project: Hadoop HDFS Issue Type: Bug Component

[jira] [Commented] (HDFS-6421) RHEL4 fails to compile vecsum.c

2014-05-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14000268#comment-14000268 ] Jason Lowe commented on HDFS-6421: -- Colin mentioned on HDFS-6287 that we may also need to

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-05-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14000269#comment-14000269 ] Jason Lowe commented on HDFS-6287: -- I commented initially since I wasn't sure if you wante

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-05-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13999835#comment-13999835 ] Jason Lowe commented on HDFS-6287: -- This change breaks the build on RHEL4 because it doesn

[jira] [Commented] (HDFS-4427) start-dfs.sh generates malformed ssh command when not running with native libs

2014-03-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918094#comment-13918094 ] Jason Lowe commented on HDFS-4427: -- Native libs are preferable, but if native libs aren't

[jira] [Resolved] (HDFS-6021) NPE in FSImageFormatProtobuf upgrading from layout -52 to -53

2014-02-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved HDFS-6021. -- Resolution: Duplicate Resolving as a dup of HDFS-5988 since that seems like the most likely culprit. I

[jira] [Commented] (HDFS-6021) NPE in FSImageFormatProtobuf upgrading from layout -52 to -53

2014-02-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914592#comment-13914592 ] Jason Lowe commented on HDFS-6021: -- Seems likely. I've been upgrading all along on my tru

[jira] [Updated] (HDFS-5806) balancer should set SoTimeout to avoid indefinite hangs

2014-02-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-5806: - Fix Version/s: 0.23.11 Thanks, Nathan! I committed this to branch-0.23. > balancer should set SoTimeout

[jira] [Commented] (HDFS-5806) balancer should set SoTimeout to avoid indefinite hangs

2014-02-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13913441#comment-13913441 ] Jason Lowe commented on HDFS-5806: -- +1 for branch-0.23 patch, committing this. > balancer

[jira] [Created] (HDFS-6021) NPE in FSImageFormatProtobuf upgrading from layout -52 to -53

2014-02-26 Thread Jason Lowe (JIRA)
Jason Lowe created HDFS-6021: Summary: NPE in FSImageFormatProtobuf upgrading from layout -52 to -53 Key: HDFS-6021 URL: https://issues.apache.org/jira/browse/HDFS-6021 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-6021) NPE in FSImageFormatProtobuf upgrading from layout -52 to -53

2014-02-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13913165#comment-13913165 ] Jason Lowe commented on HDFS-6021: -- Stacktrace: {noformat} 2014-02-26 17:03:11,755 FATAL [

[jira] [Updated] (HDFS-5293) Symlink resolution requires unnecessary RPCs

2014-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-5293: - Target Version/s: 3.0.0, 2.4.0 (was: 3.0.0) > Symlink resolution requires unnecessary RPCs >

[jira] [Updated] (HDFS-5138) Support HDFS upgrade in HA

2014-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated HDFS-5138: - Target Version/s: 2.4.0 (was: ) > Support HDFS upgrade in HA > -- > >

  1   2   >