Re: libhdfs v.s. hadoop's hdfs

2008-02-27 Thread Ahmad Humayun
thanks Arun :) On Thu, Feb 28, 2008 at 5:04 AM, Arun C Murthy <[EMAIL PROTECTED]> wrote: > > On Feb 27, 2008, at 11:27 AM, Ahmad Humayun wrote: > > > Thanks Arun for the comment :) That actually explains how the > > libhdfs code > > is minute. > > > > So, okay, does that mean that when using the

[jira] Commented: (HADOOP-2095) Reducer failed due to Out ofMemory

2008-02-27 Thread eric baldeschwieler (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573169#action_12573169 ] eric baldeschwieler commented on HADOOP-2095: - What is the RAM overhead of an

[jira] Commented: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573165#action_12573165 ] Hadoop QA commented on HADOOP-2895: --- +1 overall. Here are the results of testing the la

[jira] Created: (HADOOP-2911) [HOD] Make the information printed by allocate and info commands less verbose and clearer

2008-02-27 Thread Hemanth Yamijala (JIRA)
[HOD] Make the information printed by allocate and info commands less verbose and clearer - Key: HADOOP-2911 URL: https://issues.apache.org/jira/browse/HADOOP-2911

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-27 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Status: Patch Available (was: Open) The attached patch include a common abstract base class (Multi

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-27 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Attachment: patch.2096.txt > output format classes that can write to different files depending on k

[jira] Assigned: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-27 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2906: -- Assignee: Runping Qi > output format classes that can write to different files depending on k

[jira] Commented: (HADOOP-2845) dfsadmin disk utilization report on Solaris is wrong

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573158#action_12573158 ] Hadoop QA commented on HADOOP-2845: --- +1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2899) hdfs:///mapredsystem directory not cleaned up after deallocation

2008-02-27 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573153#action_12573153 ] Hemanth Yamijala commented on HADOOP-2899: -- Luca, bq. Afterall I'm not sure exac

[jira] Commented: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573152#action_12573152 ] Hadoop QA commented on HADOOP-2891: --- -1 overall. Here are the results of testing the la

[jira] Assigned: (HADOOP-2792) Wrong times are shown in Analyse Job's map analysis

2008-02-27 Thread Amareshwari Sri Ramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sri Ramadasu reassigned HADOOP-2792: Assignee: Amareshwari Sri Ramadasu (was: Amar Kamat) > Wrong time

[jira] Assigned: (HADOOP-2742) 'Analyse this job' link in job history shows -1 on the UI some times

2008-02-27 Thread Amareshwari Sri Ramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sri Ramadasu reassigned HADOOP-2742: Assignee: Amareshwari Sri Ramadasu > 'Analyse this job' link in jo

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573140#action_12573140 ] Hadoop QA commented on HADOOP-1986: --- +1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2781) Hadoop/Groovy integration

2008-02-27 Thread Ted Dunning (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573135#action_12573135 ] Ted Dunning commented on HADOOP-2781: - Here is the README for grool, a standalone pack

[jira] Commented: (HADOOP-2853) Add Writable for very large lists of key / value pairs

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573133#action_12573133 ] Hadoop QA commented on HADOOP-2853: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2833) JobClient.submitJob(...) should not use "Dr Who" as a default username

2008-02-27 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-2833: --- Attachment: 2833_20080227b.patch 2833_20080227b.patch: using UserGroupInform

[jira] Commented: (HADOOP-1792) df command doesn't exist under windows

2008-02-27 Thread Prem Raj (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573125#action_12573125 ] Prem Raj commented on HADOOP-1792: -- I had this problem and the comments here were not ver

debian packaging anyone?

2008-02-27 Thread Christian Goetze (CG)
Before I reinvent the wheel, has anyone attempted to make this into a debian package? -- cg

[jira] Commented: (HADOOP-2834) Iterator for MapFileOutputFormat

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573121#action_12573121 ] Hadoop QA commented on HADOOP-2834: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2904) 3 minor fixes in the rpc metrics area.

2008-02-27 Thread girish vaitheeswaran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573119#action_12573119 ] girish vaitheeswaran commented on HADOOP-2904: -- This is a minor fix and does

[jira] Commented: (HADOOP-2899) hdfs:///mapredsystem directory not cleaned up after deallocation

2008-02-27 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573116#action_12573116 ] Tsz Wo (Nicholas), SZE commented on HADOOP-2899: - Hemanth, is jobConf.get

[jira] Commented: (HADOOP-4) tool to mount dfs on linux

2008-02-27 Thread Rui Shi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573115#action_12573115 ] Rui Shi commented on HADOOP-4: -- Hi Pete, Thanks a lot for the explanation! But as I heard from

[jira] Updated: (HADOOP-2833) JobClient.submitJob(...) should not use "Dr Who" as a default username

2008-02-27 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-2833: --- Attachment: 2833_20080227.patch 2833_20080227.patch: fixed DistributedFileSy

Re: libhdfs v.s. hadoop's hdfs

2008-02-27 Thread Arun C Murthy
On Feb 27, 2008, at 11:27 AM, Ahmad Humayun wrote: Thanks Arun for the comment :) That actually explains how the libhdfs code is minute. So, okay, does that mean that when using the compiled libhdfs.so, it call dfs code to be run on JVM through JNI? If anyone has played with libhdfs, can

[jira] Updated: (HADOOP-2884) Refactor Hadoop package structure and source tree.

2008-02-27 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HADOOP-2884: - Summary: Refactor Hadoop package structure and source tree. (was: Refactor Hadoop packstructure

[jira] Commented: (HADOOP-2885) Restructure the hadoop.dfs package

2008-02-27 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573106#action_12573106 ] Sanjay Radia commented on HADOOP-2885: -- There was a typo in my description: internal

[jira] Commented: (HADOOP-2819) Remove deprecated methods in JobConf()

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573104#action_12573104 ] Hadoop QA commented on HADOOP-2819: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2886) Track individual RPC metrics.

2008-02-27 Thread girish vaitheeswaran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] girish vaitheeswaran updated HADOOP-2886: - Attachment: rpc-metrics.patch > Track individual RPC metrics. >

[jira] Commented: (HADOOP-2904) 3 minor fixes in the rpc metrics area.

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573087#action_12573087 ] Hadoop QA commented on HADOOP-2904: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2559) DFS should place one replica per rack

2008-02-27 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573082#action_12573082 ] Hairong Kuang commented on HADOOP-2559: --- The performance of Trunk and Trunk+patch1 s

[jira] Commented: (HADOOP-2903) Data type mismatch exception raised from pushMetric

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573066#action_12573066 ] Hadoop QA commented on HADOOP-2903: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2758) Reduce memory copies when data is read from DFS

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573042#action_12573042 ] Hadoop QA commented on HADOOP-2758: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-27 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2895: Attachment: HADOOP-2895.patch This patch adds a new property (mapred.task.profile.params)

[jira] Updated: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-27 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2895: Status: Patch Available (was: Open) > String for configuring profiling should be customiz

[jira] Assigned: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-27 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso reassigned HADOOP-2895: --- Assignee: Martin Traverso > String for configuring profiling should be customizable

[jira] Commented: (HADOOP-2833) JobClient.submitJob(...) should not use "Dr Who" as a default username

2008-02-27 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573037#action_12573037 ] Hairong Kuang commented on HADOOP-2833: --- DistributedFilesystem also gets a user's wo

Re: libhdfs v.s. hadoop's hdfs

2008-02-27 Thread Ahmad Humayun
Thanks Arun for the comment :) That actually explains how the libhdfs code is minute. So, okay, does that mean that when using the compiled libhdfs.so, it call dfs code to be run on JVM through JNI? If anyone has played with libhdfs, can they tell that do they somehow have to specify where the ori

[jira] Updated: (HADOOP-2845) dfsadmin disk utilization report on Solaris is wrong

2008-02-27 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2845: Status: Patch Available (was: In Progress) > dfsadmin disk utilization report on Solaris

[jira] Updated: (HADOOP-2845) dfsadmin disk utilization report on Solaris is wrong

2008-02-27 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2845: Status: In Progress (was: Patch Available) > dfsadmin disk utilization report on Solaris

[jira] Updated: (HADOOP-2845) dfsadmin disk utilization report on Solaris is wrong

2008-02-27 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2845: Attachment: HADOOP-2845-2.patch Write 128 bytes to get around the NFS issue. > dfsadmin d

[jira] Created: (HADOOP-2910) Throttle IPC Client/Server during bursts of requests or server slowdown

2008-02-27 Thread Hairong Kuang (JIRA)
Throttle IPC Client/Server during bursts of requests or server slowdown --- Key: HADOOP-2910 URL: https://issues.apache.org/jira/browse/HADOOP-2910 Project: Hadoop Core Issu

[jira] Issue Comment Edited: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-27 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573023#action_12573023 ] rangadi edited comment on HADOOP-2907 at 2/27/08 11:09 AM:

[jira] Updated: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-27 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2907: - Attachment: (was: jmap-histo.txt) > dead datanodes because of OutOfMemoryError > ---

[jira] Created: (HADOOP-2909) Improve IPC idle connection management

2008-02-27 Thread Hairong Kuang (JIRA)
Improve IPC idle connection management -- Key: HADOOP-2909 URL: https://issues.apache.org/jira/browse/HADOOP-2909 Project: Hadoop Core Issue Type: Bug Components: ipc Affects Versions: 0.16.0

Re: libhdfs v.s. hadoop's hdfs

2008-02-27 Thread Arun C Murthy
Ahmad, On Feb 27, 2008, at 10:44 AM, Ahmad Humayun wrote: Hello everyone, Apparently no one knew the answer to my question :( Am I looking at things the right way or nobody has compared the libhdfs code to hdfs? Or am I completely wrong, libhdfs and hdfs has no difference at all? libhdfs

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-27 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Status: Patch Available (was: Open) > The dfsclient on exit deletes files that are open

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-27 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Status: Open (was: Patch Available) > The dfsclient on exit deletes files that are open

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-27 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Attachment: abandonFile.patch Fix warnings. > The dfsclient on exit deletes files that

[jira] Updated: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-27 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2907: - Attachment: jmap-histo.txt Koji and I looked at one of the datanodes. Attached jmap-histo.txt is

Re: libhdfs v.s. hadoop's hdfs

2008-02-27 Thread Ahmad Humayun
Hello everyone, Apparently no one knew the answer to my question :( Am I looking at things the right way or nobody has compared the libhdfs code to hdfs? Or am I completely wrong, libhdfs and hdfs has no difference at all? regards, On Mon, Feb 25, 2008 at 11:07 PM, Ahmad Humayun <[EMAIL PROTECTE

[jira] Commented: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573010#action_12573010 ] Hadoop QA commented on HADOOP-2891: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-27 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Attachment: HADOOP-2027-8.patch sorry had missed BlockLocation again :) > FileSystem s

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-27 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Attachment: HADOOP-2027-7.patch Attaching same patch by regenerating against trunk. > F

[jira] Updated: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2008-02-27 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1986: -- Status: Patch Available (was: In Progress) > Add support for a general serialization mechanism for Ma

[jira] Updated: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2008-02-27 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1986: -- Attachment: serializer-v7.patch New patch to fix warnings. > Add support for a general serialization

[jira] Commented: (HADOOP-2899) hdfs:///mapredsystem directory not cleaned up after deallocation

2008-02-27 Thread Luca Telloli (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573005#action_12573005 ] Luca Telloli commented on HADOOP-2899: -- My opinion is that solution 2 is probably the

[jira] Updated: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2008-02-27 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1986: -- Status: In Progress (was: Patch Available) > Add support for a general serialization mechanism for Ma

[jira] Commented: (HADOOP-1967) hadoop dfs -ls, -get, -mv command's source/destination URI are inconsistent

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572979#action_12572979 ] Hadoop QA commented on HADOOP-1967: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572944#action_12572944 ] Hadoop QA commented on HADOOP-1986: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2409) Make EC2 image independent of Hadoop version

2008-02-27 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572939#action_12572939 ] Chris K Wensel commented on HADOOP-2409: I think supporting both modes would be op

[jira] Commented: (HADOOP-2119) JobTracker becomes non-responsive if the task trackers finish task too fast

2008-02-27 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572923#action_12572923 ] Runping Qi commented on HADOOP-2119: I saw a lot warning messages in hadoop.log like:

[jira] Commented: (HADOOP-2119) JobTracker becomes non-responsive if the task trackers finish task too fast

2008-02-27 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572921#action_12572921 ] Runping Qi commented on HADOOP-2119: This problem occurred again when I ran a large m

[jira] Commented: (HADOOP-2894) task trackers can't survive a job tracker bounce

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572917#action_12572917 ] Hadoop QA commented on HADOOP-2894: --- -1 overall. Here are the results of testing the la

Hudson build is back to normal: Hadoop-trunk #413

2008-02-27 Thread Apache Hudson Server
See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/413/changes

[jira] Commented: (HADOOP-2116) Job.local.dir to be exposed to tasks

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572889#action_12572889 ] Hadoop QA commented on HADOOP-2116: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2765) setting memory limits for tasks

2008-02-27 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Paranjpye updated HADOOP-2765: - Fix Version/s: (was: 0.17.0) 0.16.1 > setting memory limits for t

[jira] Issue Comment Edited: (HADOOP-2899) hdfs:///mapredsystem directory not cleaned up after deallocation

2008-02-27 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572885#action_12572885 ] yhemanth edited comment on HADOOP-2899 at 2/27/08 3:59 AM: -

[jira] Commented: (HADOOP-2899) hdfs:///mapredsystem directory not cleaned up after deallocation

2008-02-27 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572885#action_12572885 ] Hemanth Yamijala commented on HADOOP-2899: -- Possible solutions: 1. The directory

[jira] Commented: (HADOOP-2888) Enhancements to gridmix scripts

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572866#action_12572866 ] Hadoop QA commented on HADOOP-2888: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2853) Add Writable for very large lists of key / value pairs

2008-02-27 Thread Andrzej Bialecki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrzej Bialecki updated HADOOP-2853: -- Status: Patch Available (was: Open) > Add Writable for very large lists of key / valu

[jira] Updated: (HADOOP-2834) Iterator for MapFileOutputFormat

2008-02-27 Thread Andrzej Bialecki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrzej Bialecki updated HADOOP-2834: -- Status: Patch Available (was: Open) Check this with Hudson. > Iterator for MapFileOu

[jira] Updated: (HADOOP-2853) Add Writable for very large lists of key / value pairs

2008-02-27 Thread Andrzej Bialecki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrzej Bialecki updated HADOOP-2853: -- Attachment: sequenceWritable-v5.patch Add a missing period in the javadoc. > Add Writ

[jira] Updated: (HADOOP-2853) Add Writable for very large lists of key / value pairs

2008-02-27 Thread Andrzej Bialecki (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrzej Bialecki updated HADOOP-2853: -- Status: Open (was: Patch Available) > Add Writable for very large lists of key / valu

[jira] Commented: (HADOOP-1985) Abstract node to switch mapping into a topology service class used by namenode and jobtracker

2008-02-27 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572853#action_12572853 ] Devaraj Das commented on HADOOP-1985: - The one and only findbugs warning can be ignore

[jira] Updated: (HADOOP-2657) Enhancements to DFSClient to support flushing data at any point in time

2008-02-27 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2657: - Attachment: flush3.patch The implementation of a flush API requires that a partial check

[jira] Commented: (HADOOP-1985) Abstract node to switch mapping into a topology service class used by namenode and jobtracker

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572848#action_12572848 ] Hadoop QA commented on HADOOP-1985: --- -1 overall. Here are the results of testing the la

Re: mapreduce does the wrong thing with dfs permissions?

2008-02-27 Thread Andy Li
I also encountered the same problem when running the MapReduce code as a different user name. For example, assuming I have installed Hadoop with an account 'hadoop' and I am going to run my program with user account 'test'. I have created an input folder as /user/test/input/ with user 'test' and t

[jira] Commented: (HADOOP-2820) Remove deprecated classes in streaming

2008-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572821#action_12572821 ] Hadoop QA commented on HADOOP-2820: --- -1 overall. Here are the results of testing the la