[
https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419736#comment-13419736
]
Allen Wittenauer commented on HDFS-2617:
a) Without these or similar patches, 2.0 c
[
https://issues.apache.org/jira/browse/HDFS-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419730#comment-13419730
]
Harsh J commented on HDFS-3647:
---
Suresh - Sorry, added it cause it was a perf-tuning measure.
[
https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419728#comment-13419728
]
eric baldeschwieler commented on HDFS-2617:
---
I've been talking over the options w
[
https://issues.apache.org/jira/browse/HDFS-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419704#comment-13419704
]
Hadoop QA commented on HDFS-3643:
-
-1 overall. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/HDFS-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419693#comment-13419693
]
Suresh Srinivas commented on HDFS-3647:
---
BTW removing performance from the component
[
https://issues.apache.org/jira/browse/HDFS-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Suresh Srinivas updated HDFS-3647:
--
Component/s: (was: performance)
> Backport HDFS-2868 (Add number of active transfer thre
[
https://issues.apache.org/jira/browse/HDFS-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419690#comment-13419690
]
Suresh Srinivas commented on HDFS-3647:
---
Additional comment - Lets not create a new j
[
https://issues.apache.org/jira/browse/HDFS-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419688#comment-13419688
]
Suresh Srinivas commented on HDFS-3647:
---
why does the component have performance?
[
https://issues.apache.org/jira/browse/HDFS-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419664#comment-13419664
]
Hadoop QA commented on HDFS-3697:
-
-1 overall. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/HDFS-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Isaacson updated HDFS-3643:
Status: Patch Available (was: Open)
Patch compiles.
> hdfsJniHelper.c unchecked st
[
https://issues.apache.org/jira/browse/HDFS-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andy Isaacson updated HDFS-3643:
Attachment: hdfs3643.txt
Attaching simple patch to avoid walking off the end of the string, and to d
[
https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419642#comment-13419642
]
Eli Collins commented on HDFS-2617:
---
If security was enabled the default was not no authe
[
https://issues.apache.org/jira/browse/HDFS-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419636#comment-13419636
]
Eli Collins commented on HDFS-3626:
---
Sounds good, thanks for the explanation.
[
https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419628#comment-13419628
]
Hadoop QA commented on HDFS-3553:
-
-1 overall. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated HDFS-3553:
--
Attachment: HDFS-3553-2.branch-1.0.patch
Change if logic to be closer to what it used to be, set the ugi
[
https://issues.apache.org/jira/browse/HDFS-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon updated HDFS-3697:
--
Description:
The fadvise features have been implemented for some time, and we've enabled
them in produc
[
https://issues.apache.org/jira/browse/HDFS-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419611#comment-13419611
]
Todd Lipcon commented on HDFS-3626:
---
No test was actually doing that. Just in the course
[
https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419604#comment-13419604
]
Todd Lipcon commented on HDFS-3672:
---
A few comments on the initial patch:
- I definitely
[
https://issues.apache.org/jira/browse/HDFS-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419596#comment-13419596
]
Hudson commented on HDFS-3583:
--
Integrated in Hadoop-Mapreduce-trunk-Commit #2529 (See
[https
[
https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419575#comment-13419575
]
Todd Lipcon commented on HDFS-3672:
---
Hey Suresh. I'll try to answer a few of your questio
[
https://issues.apache.org/jira/browse/HDFS-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419565#comment-13419565
]
Hudson commented on HDFS-3583:
--
Integrated in Hadoop-Hdfs-trunk-Commit #2574 (See
[https://bu
[
https://issues.apache.org/jira/browse/HDFS-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419558#comment-13419558
]
Hudson commented on HDFS-3583:
--
Integrated in Hadoop-Common-trunk-Commit #2509 (See
[https://
[
https://issues.apache.org/jira/browse/HDFS-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419556#comment-13419556
]
Eli Collins commented on HDFS-3626:
---
But why do we want DFSTestUtil#createFile to throw a
[
https://issues.apache.org/jira/browse/HDFS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419550#comment-13419550
]
Hudson commented on HDFS-3608:
--
Integrated in Hadoop-Mapreduce-trunk-Commit #2528 (See
[https
[
https://issues.apache.org/jira/browse/HDFS-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers updated HDFS-3583:
-
Resolution: Fixed
Fix Version/s: (was: 3.0.0)
2.2.0-alpha
[
https://issues.apache.org/jira/browse/HDFS-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419539#comment-13419539
]
Eli Collins commented on HDFS-3697:
---
+1 pending jenkins. It's worth calling out in the d
[
https://issues.apache.org/jira/browse/HDFS-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon updated HDFS-3697:
--
Attachment: hdfs-3697.txt
Oops, typo in the XML made it malformed. New one passes xmllint.
[
https://issues.apache.org/jira/browse/HDFS-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419503#comment-13419503
]
Hudson commented on HDFS-3597:
--
Integrated in Hadoop-Mapreduce-trunk-Commit #2527 (See
[https
[
https://issues.apache.org/jira/browse/HDFS-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419474#comment-13419474
]
Hadoop QA commented on HDFS-3697:
-
-1 overall. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/HDFS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419470#comment-13419470
]
Hudson commented on HDFS-3608:
--
Integrated in Hadoop-Common-trunk-Commit #2507 (See
[https://
[
https://issues.apache.org/jira/browse/HDFS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419467#comment-13419467
]
Hudson commented on HDFS-3608:
--
Integrated in Hadoop-Hdfs-trunk-Commit #2572 (See
[https://bu
[
https://issues.apache.org/jira/browse/HDFS-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon updated HDFS-3697:
--
Status: Patch Available (was: Open)
> Enable fadvise readahead by default
> ---
[
https://issues.apache.org/jira/browse/HDFS-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon updated HDFS-3697:
--
Attachment: hdfs-3697.txt
Attached patch enables the readahead to 4MB by default. Experimentally we've
[
https://issues.apache.org/jira/browse/HDFS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers updated HDFS-3608:
-
Resolution: Fixed
Fix Version/s: 2.2.0-alpha
Hadoop Flags: Reviewed
Status:
[
https://issues.apache.org/jira/browse/HDFS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers updated HDFS-3608:
-
Target Version/s: 2.2.0-alpha (was: 2.1.0-alpha)
> fuse_dfs: detect changes in UID ticket cac
[
https://issues.apache.org/jira/browse/HDFS-3608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron T. Myers updated HDFS-3608:
-
Attachment: HDFS-3608.patch
+1, the latest patch looks good to me.
Here's a very slightly updated
Todd Lipcon created HDFS-3697:
-
Summary: Enable fadvise readahead by default
Key: HDFS-3697
URL: https://issues.apache.org/jira/browse/HDFS-3697
Project: Hadoop HDFS
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HDFS-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419453#comment-13419453
]
Hudson commented on HDFS-3597:
--
Integrated in Hadoop-Common-trunk-Commit #2506 (See
[https://
[
https://issues.apache.org/jira/browse/HDFS-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419450#comment-13419450
]
Hudson commented on HDFS-3597:
--
Integrated in Hadoop-Hdfs-trunk-Commit #2571 (See
[https://bu
[
https://issues.apache.org/jira/browse/HDFS-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419449#comment-13419449
]
Todd Lipcon commented on HDFS-3626:
---
I added that change to DFSTestUtil because, without
[
https://issues.apache.org/jira/browse/HDFS-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon updated HDFS-3597:
--
Resolution: Fixed
Fix Version/s: 2.2.0-alpha
3.0.0
Hadoop Flags: Reviewed
[
https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419442#comment-13419442
]
Sanjay Radia commented on HDFS-1108:
This is useful for restarting a failed NN - with
[
https://issues.apache.org/jira/browse/HDFS-3597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419441#comment-13419441
]
Todd Lipcon commented on HDFS-3597:
---
+1, lgtm. Thanks Andy. I'll commit this momentarily.
[
https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419416#comment-13419416
]
Jason Lowe commented on HDFS-3688:
--
Patch failed on trunk since it's only for 23. Manuall
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419413#comment-13419413
]
Marcelo Vanzin commented on HDFS-3680:
--
Thanks for the comments everyone. Good to know
[
https://issues.apache.org/jira/browse/HDFS-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419412#comment-13419412
]
Eli Collins commented on HDFS-3577:
---
Shouldn't be an issue in branch-1 I mean. I verified
[
https://issues.apache.org/jira/browse/HDFS-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419410#comment-13419410
]
Daryn Sharp commented on HDFS-3577:
---
Yes, HDFS-3166 (add timeouts) exposed the 200s tail
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419407#comment-13419407
]
Aaron T. Myers commented on HDFS-3680:
--
bq. While conceptually this jira is good idea,
[
https://issues.apache.org/jira/browse/HDFS-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419402#comment-13419402
]
Hadoop QA commented on HDFS-3583:
-
-1 overall. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/HDFS-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419396#comment-13419396
]
Eli Collins commented on HDFS-3577:
---
Per offline conversation with Daryn the reason this
[
https://issues.apache.org/jira/browse/HDFS-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Wang updated HDFS-3583:
--
Attachment: hdfs-3583-branch-2.patch
Sorry I missed your comment Aaron, I missed it among all the Hudson
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419388#comment-13419388
]
Daryn Sharp commented on HDFS-3680:
---
Todd: good points as well about log ordering and whe
[
https://issues.apache.org/jira/browse/HDFS-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419374#comment-13419374
]
Eli Collins commented on HDFS-3671:
---
The test for this is whether you can distcp a 2gb+ f
[
https://issues.apache.org/jira/browse/HDFS-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419365#comment-13419365
]
Suresh Srinivas commented on HDFS-3667:
---
Comments for the patch:
# WebHdfsFileSystem.
[
https://issues.apache.org/jira/browse/HDFS-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419364#comment-13419364
]
Daryn Sharp commented on HDFS-3667:
---
I assumed it also implemented generic retries for no
[
https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419337#comment-13419337
]
Owen O'Malley commented on HDFS-2617:
-
Eric, we have talked through the options. We've
[
https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419333#comment-13419333
]
Hadoop QA commented on HDFS-3688:
-
-1 overall. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/HDFS-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419328#comment-13419328
]
Suresh Srinivas commented on HDFS-3667:
---
bq. it may be a challenge to merge into 23
D
[
https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Lowe updated HDFS-3688:
-
Status: Patch Available (was: Open)
> Namenode loses datanode hostname if datanode re-registers
> ---
[
https://issues.apache.org/jira/browse/HDFS-3688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jason Lowe updated HDFS-3688:
-
Attachment: HDFS-3688.patch
Patch for branch-0.23 that has the datanode preserve the original hostname whe
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419323#comment-13419323
]
Todd Lipcon commented on HDFS-3680:
---
Daryn: decent point. Do you think we should just att
[
https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419192#comment-13419192
]
eric baldeschwieler commented on HDFS-2617:
---
Let's talk the options through and m
[
https://issues.apache.org/jira/browse/HDFS-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HDFS-3696:
-
Description:
When doing "fs -put" to a WebHdfsFileSystem (webhdfs://), the FsShell goes OOM
if the file s
[
https://issues.apache.org/jira/browse/HDFS-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419182#comment-13419182
]
Kihwal Lee commented on HDFS-3696:
--
bq. The map heap
The max heap
For reading of 1G pipin
[
https://issues.apache.org/jira/browse/HDFS-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419179#comment-13419179
]
Kihwal Lee commented on HDFS-3696:
--
The following stack trace is from doing {{copyFromLoca
Kihwal Lee created HDFS-3696:
Summary: FsShell put using WebHdfsFileSystem goes OOM when file
size is big
Key: HDFS-3696
URL: https://issues.apache.org/jira/browse/HDFS-3696
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419171#comment-13419171
]
Daryn Sharp commented on HDFS-3671:
---
bq. Tested read/write a 3GB file using WebHDFS with
[
https://issues.apache.org/jira/browse/HDFS-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419169#comment-13419169
]
Daryn Sharp commented on HDFS-3680:
---
I quickly scanned the patch, and agree the implement
[
https://issues.apache.org/jira/browse/HDFS-3675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419162#comment-13419162
]
Hudson commented on HDFS-3675:
--
Integrated in Hadoop-Mapreduce-trunk #1142 (See
[https://buil
[
https://issues.apache.org/jira/browse/HDFS-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419160#comment-13419160
]
Hudson commented on HDFS-1249:
--
Integrated in Hadoop-Mapreduce-trunk #1142 (See
[https://buil
[
https://issues.apache.org/jira/browse/HDFS-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419158#comment-13419158
]
Hudson commented on HDFS-3673:
--
Integrated in Hadoop-Mapreduce-trunk #1142 (See
[https://buil
[
https://issues.apache.org/jira/browse/HDFS-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419157#comment-13419157
]
Hudson commented on HDFS-3690:
--
Integrated in Hadoop-Mapreduce-trunk #1142 (See
[https://buil
[
https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419155#comment-13419155
]
Daryn Sharp commented on HDFS-2617:
---
I would prefer compatibility by default, but a flag
[
https://issues.apache.org/jira/browse/HDFS-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419136#comment-13419136
]
Daryn Sharp commented on HDFS-3667:
---
It's just that it touched more than I thought it wou
[
https://issues.apache.org/jira/browse/HDFS-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419107#comment-13419107
]
Hudson commented on HDFS-3690:
--
Integrated in Hadoop-Hdfs-trunk #1110 (See
[https://builds.ap
[
https://issues.apache.org/jira/browse/HDFS-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419093#comment-13419093
]
Hudson commented on HDFS-3646:
--
Integrated in Hadoop-Hdfs-0.23-Build #319 (See
[https://build
[
https://issues.apache.org/jira/browse/HDFS-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419008#comment-13419008
]
Hadoop QA commented on HDFS-3671:
-
+1 overall. Here are the results of testing the latest
[
https://issues.apache.org/jira/browse/HDFS-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418981#comment-13418981
]
Eli Collins commented on HDFS-3671:
---
Checkout my latest comment on HDFS-3577, a 3gb read/
[
https://issues.apache.org/jira/browse/HDFS-3577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13418974#comment-13418974
]
Eli Collins commented on HDFS-3577:
---
Hey Nicholas,
Did you test this with distcp? Trying
79 matches
Mail list logo
