[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491525
]
Runping Qi commented on HADOOP-1290:
Sure.
> Move Hadoop Abacus to hadoop.mapred.lib
> ---
[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491522
]
Nigel Daley commented on HADOOP-1290:
-
If abacus is going into the main framework, I think we should require som
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491498
]
Konstantin Shvachko commented on HADOOP-1272:
-
I looked more at the SafeModeInfo separation project.
#
[
https://issues.apache.org/jira/browse/HADOOP-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang reassigned HADOOP-1200:
-
Assignee: Hairong Kuang (was: dhruba borthakur)
> Datanode should periodically do a dis
[
https://issues.apache.org/jira/browse/HADOOP-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491488
]
Hadoop QA commented on HADOOP-1262:
---
+1
http://issues.apache.org/jira/secure/attachment/12356185/newSource.patch
[
https://issues.apache.org/jira/browse/HADOOP-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang updated HADOOP-1262:
--
Fix Version/s: 0.13.0
Affects Version/s: 0.12.3
Status: Patch Available
[
https://issues.apache.org/jira/browse/HADOOP-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491484
]
dhruba borthakur commented on HADOOP-1263:
--
I like the idea of having a small timeout at first and then hav
[
https://issues.apache.org/jira/browse/HADOOP-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491483
]
Hairong Kuang commented on HADOOP-1263:
---
The rpc time out problem is not specific to dfs. Shall we fix it in t
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1272:
-
Attachment: innerclasses3.patch
This incorporates most of Konstantin's comments.
1. I
[
https://issues.apache.org/jira/browse/HADOOP-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang reassigned HADOOP-1263:
-
Assignee: Hairong Kuang
> retry logic when dfs exist or open fails temporarily, e.g beca
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dhruba borthakur updated HADOOP-1272:
-
Attachment: (was: innerclasses2.patch)
> Extract InnerClasses from FSNamesystem into
The call stack for instantiating an Inode for a file is
FSDirectory.addFile
FSNamesystem.completeFile
NameNode.complete
Hope that it helps.
Hairong
-Original Message-
From: Kurtis Heimerl [mailto:[EMAIL PROTECTED]
Sent: Tuesday, April 24, 2007 2:16 PM
To: hadoop-dev@lucene.apache.org
Su
[
https://issues.apache.org/jira/browse/HADOOP-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491478
]
dhruba borthakur commented on HADOOP-1262:
--
+1. looks good.
> file corruption detected because dfs client
[
https://issues.apache.org/jira/browse/HADOOP-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491475
]
Hairong Kuang commented on HADOOP-1193:
---
More details about the failed job:
1. It uses record-level compressi
[
https://issues.apache.org/jira/browse/HADOOP-435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491476
]
Benjamin Reed commented on HADOOP-435:
--
Yes, bin/hadoop should invoke HadoopExe. The big if/else in bin/hadoop i
[
https://issues.apache.org/jira/browse/HADOOP-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Cutting updated HADOOP-1066:
-
Status: Open (was: Patch Available)
This isn't yet a patch.
> http://lucene.apache.org/hadoop/
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491466
]
Owen O'Malley commented on HADOOP-1127:
---
Since it was a public class, the standard practice is to leave it in
[
https://issues.apache.org/jira/browse/HADOOP-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang updated HADOOP-1262:
--
Attachment: newSource.patch
This patch makes sure that a dfs client tries to read from a diffe
[
https://issues.apache.org/jira/browse/HADOOP-1262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hairong Kuang reassigned HADOOP-1262:
-
Assignee: Hairong Kuang
> file corruption detected because dfs client does not use repli
[
https://issues.apache.org/jira/browse/HADOOP-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Cutting updated HADOOP-1282:
-
Resolution: Fixed
Fix Version/s: 0.13.0
Status: Resolved (was: Patch Available
hey, I'm working on implementing permissions for hadoops DFS system.
My first task is to associate users and groups with files. I have
accomplished this with directories by adding a User object which contains
user and group fields. This is transferred over the wire and stored with an
INode. So, t
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491456
]
Konstantin Shvachko commented on HADOOP-1272:
-
- removeNeededReplications
should take 2 more parameters
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491451
]
Tom White commented on HADOOP-1127:
---
Just noticed that PhasedFileSystem was deprecated, not removed. I would
sug
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-1127:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Ar
[
https://issues.apache.org/jira/browse/HADOOP-435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491448
]
Doug Cutting commented on HADOOP-435:
-
bq. Once we have everything in a single jar we can deal with incorporating
[
https://issues.apache.org/jira/browse/HADOOP-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-1176:
--
Attachment: HADOOP-1176_20070425_5.patch
Updated to reflect changes to trunk...
> Reduce hang
stderr from streaming skipped after first 20 lines.
-
Key: HADOOP-1293
URL: https://issues.apache.org/jira/browse/HADOOP-1293
Project: Hadoop
Issue Type: Bug
Components: contrib
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491441
]
Runping Qi commented on HADOOP-1247:
Maybe I should do hadoop-1290 first, if everybody agrees on hadoop-1290
>
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491439
]
Runping Qi commented on HADOOP-1247:
Once Abacus is moved into mapred.lib, the streaming can stop including aba
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491436
]
Owen O'Malley commented on HADOOP-1247:
---
The problem is that in the current version of the patch is that there
[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491435
]
Runping Qi commented on HADOOP-1290:
Then, lib.aggregate is fine with me.
> Move Hadoop Abacus to hadoop.mapr
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491424
]
Hadoop QA commented on HADOOP-1127:
---
+1
http://issues.apache.org/jira/secure/attachment/12356177/HADOOP-1127_2007
[
https://issues.apache.org/jira/browse/HADOOP-435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-435:
-
Attachment: hadoop-exe.patch
Here's another patch that addresses points 1, 3, 4 and 5.
> Encapsulating s
[
https://issues.apache.org/jira/browse/HADOOP-435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491421
]
Benjamin Reed commented on HADOOP-435:
--
My point is that we should really move forward on this issue. Once we ha
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-1127:
--
Status: Patch Available (was: Open)
> Speculative Execution and output of Reduce tasks
>
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-1127:
--
Attachment: HADOOP-1127_20070424_10.patch
Updated to reflect changes to trunk...
> Speculativ
[
https://issues.apache.org/jira/browse/HADOOP-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-1190:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this.
> Fix un
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-1127:
--
Status: Open (was: Patch Available)
> Speculative Execution and output of Reduce tasks
>
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-1127:
--
Attachment: (was: HADOOP-1127_200700424_10.patch)
> Speculative Execution and output of Re
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491402
]
Owen O'Malley commented on HADOOP-1127:
---
+1
> Speculative Execution and output of Reduce tasks
>
[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491399
]
Doug Cutting commented on HADOOP-1290:
--
bq. I'd put them all in lib.abacus [ ... ]
I'd encourage a more descri
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HADOOP-1127:
--
Comment: was deleted
> Speculative Execution and output of Reduce tasks
>
[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491395
]
Runping Qi commented on HADOOP-1290:
I'd put them all in lib.abacus (currently they are all in contrib.abacus).
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gautam Kowshik updated HADOOP-1127:
---
Comment: was deleted
> Speculative Execution and output of Reduce tasks
> --
[
https://issues.apache.org/jira/browse/HADOOP-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491383
]
Doug Cutting commented on HADOOP-1148:
--
Did you try changing patch's fuzz factor?
Another thing that sometimes
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491382
]
Gautam Kowshik commented on HADOOP-1127:
http://hadoopqa.yst.corp.yahoo.com:8080/hudson/view/Ambient%20Orb/j
[
https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491381
]
Gautam Kowshik commented on HADOOP-1127:
+1 .. Sort500 ran successfully with speculative execution On.
> Sp
[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491377
]
Doug Cutting commented on HADOOP-1290:
--
Looking at:
http://lucene.apache.org/hadoop/api/org/apache/hadoop/abac
[
https://issues.apache.org/jira/browse/HADOOP-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491375
]
Owen O'Malley commented on HADOOP-1226:
---
Actually, I'd suggest a much stronger goal.
1. Make makeQualified a
[
https://issues.apache.org/jira/browse/HADOOP-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491373
]
Raghu Angadi commented on HADOOP-1148:
--
I am merging a largish patch made on 2-3 weeks old trunk. I think these
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491372
]
Doug Cutting commented on HADOOP-1247:
--
bq. Since building contrib/streaming depends on the Abacus code [...]
[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491369
]
Runping Qi commented on HADOOP-1290:
Mainly, I feel the Abacus package proved useful and fits into mapred.lib
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491368
]
Runping Qi commented on HADOOP-1247:
Since building contrib/streaming depends on the Abacus code, I need to pro
dfs -copyToLocal should guarantee file is complete
--
Key: HADOOP-1292
URL: https://issues.apache.org/jira/browse/HADOOP-1292
Project: Hadoop
Issue Type: Improvement
Components: dfs
Split files in HDFS into appropriately named packages
-
Key: HADOOP-1291
URL: https://issues.apache.org/jira/browse/HADOOP-1291
Project: Hadoop
Issue Type: Bug
Components: dfs
[
https://issues.apache.org/jira/browse/HADOOP-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491365
]
Doug Cutting commented on HADOOP-1290:
--
Why? I'd like to hear more of this discussion.
> Move Hadoop Abacus t
[
https://issues.apache.org/jira/browse/HADOOP-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491363
]
Doug Cutting commented on HADOOP-1247:
--
bq. you are causing the abacus class files to be also compiled into the
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491362
]
Doug Cutting commented on HADOOP-1272:
--
bq. Once I am done with this splitting, then I will open another JIRA i
[
https://issues.apache.org/jira/browse/HADOOP-435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491361
]
Doug Cutting commented on HADOOP-435:
-
bq. Tom: it would be good to have a strategy for how to move the scripts t
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491358
]
Doug Cutting commented on HADOOP-1272:
--
bq. Or under org.apache.hadoop.fs.dfs, like the S3 code.
Oops. That's
[
https://issues.apache.org/jira/browse/HADOOP-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HADOOP-1242:
--
Priority: Blocker (was: Critical)
> dfs upgrade/downgrade problems
>
[
https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491288
]
Devaraj Das commented on HADOOP-485:
Some comments:
You needn't explicitly do the 'null' check for the return val
[
https://issues.apache.org/jira/browse/HADOOP-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-1271:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks A
[
https://issues.apache.org/jira/browse/HADOOP-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491242
]
Hadoop QA commented on HADOOP-1050:
---
Integrated in Hadoop-Nightly #68 (See
http://lucene.zones.apache.org:8080/hu
See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/68/
Changes:
[tomwhite] HADOOP-1050. Distinguish between failed and killed tasks so as to
not count a lost tasktracker against the job. Contributed by Arun C Murthy.
--
[...truncated 2435
[
https://issues.apache.org/jira/browse/HADOOP-485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tahir Hashmi updated HADOOP-485:
Attachment: 485.patch
Here's a patch that includes a test case for this feature and also changes to
[
https://issues.apache.org/jira/browse/HADOOP-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-1050:
--
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks A
[
https://issues.apache.org/jira/browse/HADOOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491181
]
Tom White commented on HADOOP-1272:
---
bq. Arguably HDFS should move into a set of packages under org.apache.hadoop.
68 matches
Mail list logo