[
https://issues.apache.org/jira/browse/HADOOP-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-1061:
--
Status: Patch Available (was: Open)
> S3 listSubPaths bug
> ---
>
> K
[
https://issues.apache.org/jira/browse/HADOOP-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-1061:
--
Attachment: HADOOP-1061-v4.patch
This patch (HADOOP-1061-v4.patch) includes MigrationTool to migrate t
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492838
]
Devaraj Das commented on HADOOP-1304:
-
Pasting Nigel's comments:
---
Some comments on the JobConf method
Some comments on the JobConf methods:
1) why no setter methods?
2) why are getters getNumMax... instead of getMaxNum...?
3) can this parameters be set per job? per instantiation of the
JobTracker?
4) the @return javadoc comment should not start with the return type
5) the javadoc should documen
On Apr 30, 2007, at 7:11 AM, Tahir Hashmi (JIRA) wrote:
[ https://issues.apache.org/jira/browse/HADOOP-485?
page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tahir Hashmi updated HADOOP-485:
Attachment: 485.patch
Added javadoc do
[
https://issues.apache.org/jira/browse/HADOOP-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Bieniosek updated HADOOP-1308:
--
Attachment: generics-2.patch
Fixing patch
> Tighten generic Class restrictions in Job
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492824
]
Hadoop QA commented on HADOOP-1247:
---
+1
http://issues.apache.org/jira/secure/attachment/12356542/patch_1247.txt a
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492822
]
Konstantin Shvachko commented on HADOOP-1272:
-
+1 Reviewed the patch. Looks good.
> Extract InnerClasse
[
https://issues.apache.org/jira/browse/HADOOP-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kurtis Heimerl updated HADOOP-1298:
---
Attachment: hadoop-user-munncha.patch5
Next iteration. This fixed some of the bugs in my per
[
https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang updated HADOOP-1118:
--
Attachment: (was: NPEReportChecksum.patch)
> NullPointerException in
> DistributedFileSys
[
https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang updated HADOOP-1118:
--
Attachment: NPEChecksum.patch
updating the patch...
> NullPointerException in
> DistributedF
[
https://issues.apache.org/jira/browse/HADOOP-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492817
]
Michael Bieniosek commented on HADOOP-1309:
---
Here's another one from trying to add a new node to my cluste
[
https://issues.apache.org/jira/browse/HADOOP-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492816
]
Hadoop QA commented on HADOOP-1308:
---
-1, build or testing failed
2 attempts failed to build and test the latest a
Here is somewhat different but related issue:
it would be useful to make the framework distinguish between
deterministic and non-deterministic failures and react differently to
them.
E.g.
-- in streaming, a Perl script has a syntax error. There is no need
to check for this 4*300 times.
[
https://issues.apache.org/jira/browse/HADOOP-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492807
]
Doug Cutting commented on HADOOP-785:
-
> I think it's also important not to try to overprotect users [ ... ]
I a
[
https://issues.apache.org/jira/browse/HADOOP-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492802
]
Michael Bieniosek commented on HADOOP-785:
--
> I'd also like to see a set of hard rules for config parameter
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1272:
-
Attachment: innerclasses7.patch
Ok, removed SafeModeInfo from these changes.
Konstantin
[
https://issues.apache.org/jira/browse/HADOOP-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492792
]
Michael Bieniosek commented on HADOOP-1309:
---
I can't figure out what triggers this bug, but I've now seen
DFS logging in NameSystem.pendingTransfer consumes all disk space
-
Key: HADOOP-1309
URL: https://issues.apache.org/jira/browse/HADOOP-1309
Project: Hadoop
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Runping Qi updated HADOOP-1247:
---
Status: Patch Available (was: Open)
> Make Hadoop Abacus work with Hadoop Streaming
> -
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Runping Qi updated HADOOP-1247:
---
Attachment: patch_1247.txt
Rename Abacus to Aggregate in StreamJob.java and the related unit test c
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Runping Qi updated HADOOP-1247:
---
Attachment: (was: patch_1247.txt)
> Make Hadoop Abacus work with Hadoop Streaming
>
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492790
]
Konstantin Shvachko commented on HADOOP-1272:
-
Looks like we agreed with Dhruba that whether SafeModeInf
[
https://issues.apache.org/jira/browse/HADOOP-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492789
]
Doug Cutting commented on HADOOP-785:
-
Some comments on Milind's proposal:
I'm unclear on the difference between
[
https://issues.apache.org/jira/browse/HADOOP-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Bieniosek updated HADOOP-1308:
--
Priority: Minor (was: Major)
> Tighten generic Class restrictions in JobConf.java
> -
[
https://issues.apache.org/jira/browse/HADOOP-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Bieniosek updated HADOOP-1308:
--
Attachment: generics.patch
> Tighten generic Class restrictions in JobConf.java
>
[
https://issues.apache.org/jira/browse/HADOOP-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Bieniosek updated HADOOP-1308:
--
Status: Patch Available (was: Open)
> Tighten generic Class restrictions in JobConf.j
Tighten generic Class restrictions in JobConf.java
--
Key: HADOOP-1308
URL: https://issues.apache.org/jira/browse/HADOOP-1308
Project: Hadoop
Issue Type: Improvement
Components: mapre
[
https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492778
]
Andrzej Bialecki commented on HADOOP-1307:
---
Could we perhaps extend the XML markup to include this inform
[
https://issues.apache.org/jira/browse/HADOOP-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492776
]
Arun C Murthy commented on HADOOP-785:
--
I'd also like to see a set of hard rules for config parameter (whereever
[
https://issues.apache.org/jira/browse/HADOOP-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492775
]
Raghu Angadi commented on HADOOP-1306:
--
This will be useful. Couple of thoughts:
# requiring abandonBlock()
[
https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-1307:
--
Description:
Given the ever-increasing number of configuration knobs for both dfs and
mapred,
[
https://issues.apache.org/jira/browse/HADOOP-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492773
]
Andrzej Bialecki commented on HADOOP-1144:
---
bq. I'd rather have the user implement a simple sub-class of
[
https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492772
]
Doug Cutting commented on HADOOP-1307:
--
We already auto-generate HTML documenting all parameters.
http://lucen
[
https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492770
]
Michael Bieniosek commented on HADOOP-1307:
---
I'd rather see HADOOP-785 implemented first, since that is a
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das updated HADOOP-1304:
Attachment: 1304.patch
Attached is another patch with the JobConf accessor methods.
Regarding the
Documentation & classification of various configuration knobs
-
Key: HADOOP-1307
URL: https://issues.apache.org/jira/browse/HADOOP-1307
Project: Hadoop
Issue Type: Wish
Co
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492768
]
Doug Cutting commented on HADOOP-1304:
--
Lucene uses "Expert:" in the javadoc to mark features that most users s
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492766
]
Arun C Murthy commented on HADOOP-1304:
---
One concern with this 'feature' is that we want a reasonable cap on w
DFS Scalability: Reduce the number of getAdditionalBlock RPCs on the namenode
-
Key: HADOOP-1306
URL: https://issues.apache.org/jira/browse/HADOOP-1306
Project: Hadoop
[
https://issues.apache.org/jira/browse/HADOOP-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1184:
-
Attachment: decommissionOneReplica5.patch
Thanks Hairong for the review comments.
1.
[
https://issues.apache.org/jira/browse/HADOOP-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492742
]
dhruba borthakur commented on HADOOP-1296:
--
In the current incantation, getHosts() returns the name of the
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492739
]
Hadoop QA commented on HADOOP-1304:
---
-1, could not apply patch.
The patch command could not apply the latest atta
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492738
]
Doug Cutting commented on HADOOP-1304:
--
This looks good. Should we add accessor methods to JobConf?
> MAX_TAS
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das updated HADOOP-1304:
Status: Patch Available (was: Open)
> MAX_TASK_FAILURES should be configurable
>
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das updated HADOOP-1304:
Attachment: 1304.patch
Looks like there was a race condition between my uploading the patch and Do
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das reassigned HADOOP-1304:
---
Assignee: Devaraj Das
> MAX_TASK_FAILURES should be configurable
> -
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Devaraj Das updated HADOOP-1304:
Attachment: 1304.patch
Attached is a straightforward patch. Two new config items have been introdu
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492731
]
Doug Cutting commented on HADOOP-1304:
--
I think this is a nice complement to HADOOP-1144. Perhaps these issues
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Cutting updated HADOOP-1304:
-
Comment: was deleted
> MAX_TASK_FAILURES should be configurable
> --
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492729
]
Doug Cutting commented on HADOOP-1304:
--
I think this is a nice complement to HADOOP-1114. Perhaps these issues
[
https://issues.apache.org/jira/browse/HADOOP-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492727
]
Doug Cutting commented on HADOOP-1144:
--
bq. Christian: could be made configurable separately for mappers and re
[
https://issues.apache.org/jira/browse/HADOOP-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492726
]
Michael Bieniosek commented on HADOOP-1301:
---
It would be nice to have some documentation about how to inst
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Cutting updated HADOOP-1247:
-
Status: Open (was: Patch Available)
bq. Added a new option for StreamJob: -reduce abacus
We sh
extra space in mapred.local.dir config results in FileNotFoundException in
reduce copyOutput
Key: HADOOP-1305
URL: https://issues.apache.org/jira/browse/HADOOP-1305
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492718
]
Christian Kunz commented on HADOOP-1304:
Assuming that HADOOP-1144 is implemented for map failures only (whi
[
https://issues.apache.org/jira/browse/HADOOP-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492713
]
Devaraj Das commented on HADOOP-1304:
-
I think HADOOP-1144 only allows tolerating certain percentage of *map*
f
[
https://issues.apache.org/jira/browse/HADOOP-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492697
]
Christian Kunz commented on HADOOP-1144:
+1 for mapred.task.failures.percent (obviously).
I just added HADOO
MAX_TASK_FAILURES should be configurable
Key: HADOOP-1304
URL: https://issues.apache.org/jira/browse/HADOOP-1304
Project: Hadoop
Issue Type: Improvement
Components: mapred
Affects Versio
[
https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492678
]
Hadoop QA commented on HADOOP-485:
--
-1, new javadoc warnings
The javadoc tool appears to have generated warning mes
[
https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tahir Hashmi updated HADOOP-485:
Status: Patch Available (was: Open)
> allow a different comparator for grouping keys in calls to r
[
https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tahir Hashmi updated HADOOP-485:
Attachment: 485.patch
Added javadoc documentation for get and set methods in JobConf.
> allow a di
[
https://issues.apache.org/jira/browse/HADOOP-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492656
]
Arun C Murthy commented on HADOOP-1144:
---
> It would be nice to have a similar knob for InputFormat, so that it
[
https://issues.apache.org/jira/browse/HADOOP-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492636
]
Andrzej Bialecki commented on HADOOP-1144:
---
+1 for mapred.task.failures.percent. Another scenario where w
[
https://issues.apache.org/jira/browse/HADOOP-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492634
]
Arun C Murthy commented on HADOOP-1144:
---
I'd like to propose a 'mapred.task.failures.percent' config knob whic
65 matches
Mail list logo