Re: multiple datanodes on single node cluster

2009-02-25 Thread lohit
It is possible to run multiple datanodes. You would have to have separate conf file for each datanode, basically you need to have different datanode address (dfs.datanode.address and related) and different storage directories dfs.data.dir. Have different configs and start each datanode instance

[jira] Commented: (HADOOP-5332) Make support for file append API configurable

2009-02-25 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676909#action_12676909 ] Nigel Daley commented on HADOOP-5332: - Dhruba, what about the libhdfs append tests?

[jira] Updated: (HADOOP-5023) Add Tomcat support to hdfsproxy

2009-02-25 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HADOOP-5023: --- Status: Patch Available (was: Open) > Add Tomcat support to hdfsproxy > ---

Re: Contributing to hadoop

2009-02-25 Thread Ajit Ratnaparkhi
Raghu, Can you please tell me how to run multiple datanodes on one machine. thanks, -Ajit. On Thu, Feb 26, 2009 at 9:23 AM, Pradeep Fernando wrote: > Raghu, > > I guess you are asking if it would be more convenient if one had access to > a > > larger cluster for development. > > > exactly.

[jira] Updated: (HADOOP-5247) NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.

2009-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-5247: Fix Version/s: 0.19.2 I committed this to the 0.19 branch. > NPEs in JobTracker and JobClient whe

[jira] Updated: (HADOOP-5247) NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.

2009-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-5247: Attachment: HADOOP-5247-v1.10.branch-0.19.patch Attaching the patch for 0.19 > NPEs in JobTracker

multiple datanodes on single node cluster

2009-02-25 Thread Ajit Ratnaparkhi
Hi all, Is it possible to run multiple datanode instances on single node hadoop cluster? How to do that? thanks, -Ajit

[jira] Commented: (HADOOP-5233) Reducer not Succeded after 100%

2009-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676901#action_12676901 ] Devaraj Das commented on HADOOP-5233: - I committed this to the 0.19 branch. > Reducer

[jira] Resolved: (HADOOP-5232) preparing HadoopPatchQueueAdmin.sh,test-patch.sh scripts to run builds on hudson slaves.

2009-02-25 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley resolved HADOOP-5232. - Resolution: Fixed Fix Version/s: 0.21.0 I just committed this. Thanks Giri. > preparing

[jira] Updated: (HADOOP-5241) Reduce tasks get stuck because of over-estimated task size (regression from 0.18)

2009-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-5241: Fix Version/s: 0.19.2 I committed this to the 0.19 branch. > Reduce tasks get stuck because of ov

[jira] Updated: (HADOOP-5280) When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap.

2009-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-5280: Affects Version/s: (was: 0.20.0) Fix Version/s: 0.19.2 I committed this to the 0.19 br

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lohit Vijayarenu updated HADOOP-5331: - Status: Patch Available (was: Open) > KFS: Add support for append > ---

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lohit Vijayarenu updated HADOOP-5331: - Status: Open (was: Patch Available) > KFS: Add support for append > ---

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Sriram Rao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Rao updated HADOOP-5331: --- Attachment: patch.5331 Re-uploading the patch since the previous one wasn't generated from HADOOP_HO

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Sriram Rao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Rao updated HADOOP-5331: --- Attachment: (was: patch.5331) > KFS: Add support for append > --- > >

[jira] Updated: (HADOOP-5310) Init.d script for chukwa-data-processors is not using --config ${CHUKWA_CONF_DIR}

2009-02-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-5310: -- Resolution: Fixed Release Note: What is new in HADOOP-5310: * Added --config to start-data-p

Re: Hadoop 0.20.0

2009-02-25 Thread Raghu Angadi
+1 for config option for both 0.19 and 0.20. Raghu. Dhruba Borthakur wrote: I posted a patch for HADOOP-5332. I am suggesting that this patch be applied into the 0.19, 0.20 and trunk. This patch switches off "append" by default, but it can be switched on by setting the config parameter dfs.supp

[jira] Commented: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676889#action_12676889 ] Hadoop QA commented on HADOOP-5331: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-5233) Reducer not Succeded after 100%

2009-02-25 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-5233: Attachment: patch-5233-0.19.txt Patch for branch 0.19 > Reducer not Succe

[jira] Updated: (HADOOP-5233) Reducer not Succeded after 100%

2009-02-25 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-5233: Fix Version/s: 0.19.2 > Reducer not Succeded after 100% >

[jira] Commented: (HADOOP-4584) Slow generation of blockReport at DataNode causes delay of sending heartbeat to NameNode

2009-02-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676887#action_12676887 ] dhruba borthakur commented on HADOOP-4584: -- Option 1: +1. This sounds like the ap

[jira] Commented: (HADOOP-5232) preparing HadoopPatchQueueAdmin.sh,test-patch.sh scripts to run builds on hudson slaves.

2009-02-25 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676886#action_12676886 ] Giridharan Kesavan commented on HADOOP-5232: with the latest test.patch defect

[jira] Updated: (HADOOP-5218) libhdfs unit test failed because it was unable to start namenode/datanode

2009-02-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-5218: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch

[jira] Commented: (HADOOP-5269) TaskTracker.runningTasks holding FAILED_UNCLEAN and KILLED_UNCLEAN taskStatuses forever in some cases.

2009-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676884#action_12676884 ] Devaraj Das commented on HADOOP-5269: - I committed this to the 0.19 branch. > TaskTra

[jira] Updated: (HADOOP-5277) new InputFormat for use with Chukwa

2009-02-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-5277: -- Resolution: Fixed Release Note: What is new in HADOOP-5277: * Added ChukwaInputFormat for pr

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lohit Vijayarenu updated HADOOP-5331: - Assignee: Sriram Rao Status: Patch Available (was: Open) Looks good. Submitting t

[jira] Updated: (HADOOP-5269) TaskTracker.runningTasks holding FAILED_UNCLEAN and KILLED_UNCLEAN taskStatuses forever in some cases.

2009-02-25 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-5269: Fix Version/s: 0.19.2 > TaskTracker.runningTasks holding FAILED_UNCLEAN an

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Sriram Rao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Rao updated HADOOP-5331: --- Attachment: patch.5331 A single patch that contains the code as well as test. > KFS: Add support fo

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Sriram Rao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Rao updated HADOOP-5331: --- Attachment: (was: patch.5331.test) > KFS: Add support for append > --- >

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Sriram Rao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Rao updated HADOOP-5331: --- Attachment: (was: patch.5331) > KFS: Add support for append > --- > >

Re: Hadoop 0.20.0

2009-02-25 Thread Dhruba Borthakur
I posted a patch for HADOOP-5332. I am suggesting that this patch be applied into the 0.19, 0.20 and trunk. This patch switches off "append" by default, but it can be switched on by setting the config parameter dfs.support.append. This does not mean that "append" is bug free in the code, it just al

[jira] Commented: (HADOOP-5299) Reducer inputs should be spilled to HDFS rather than local disk.

2009-02-25 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676880#action_12676880 ] Devaraj Das commented on HADOOP-5299: - bq. Concatenate the output of a jobs maps on a

[jira] Updated: (HADOOP-5332) Make support for file append API configurable

2009-02-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-5332: - Attachment: disableAppendTrunk.patch "append" is not supported by default. If you set th

[jira] Commented: (HADOOP-5330) Zombie tasks remain after jobs finish/fail/get killed

2009-02-25 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676873#action_12676873 ] Amareshwari Sriramadasu commented on HADOOP-5330: - Are you seeing Zombie p

[jira] Updated: (HADOOP-5301) Hadoop Metrics Log file should be used by only one process

2009-02-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-5301: -- Resolution: Fixed Release Note: What is new in HADOOP-5301: * Log Hadoop metrics to one log fil

Re: [jira] Commented: (HADOOP-5087) Regex for Cmd parsing contains an error

2009-02-25 Thread Nigel Daley
Ari, "Cancel patch" and then "Submit patch" to have Hudson retest. Nige On Feb 25, 2009, at 5:11 PM, Ari Rabkin (JIRA) wrote: [ https://issues.apache.org/jira/browse/HADOOP-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676832 #action_1267683

Re: Hadoop 0.20.0

2009-02-25 Thread Hemanth Yamijala
+1 for HADOOP-5332. I am in the same position as Brian, as an outside observer. This will help us to move on Hadoop 0.20 which has a lot of other features as well that users are asking for. Thanks hemanth On Feb 25, 2009, at 10:20 PM, Nigel Daley wrote: On Feb 25, 2009, at 7:52 PM, Dhruba

Re: Hadoop 0.20.0

2009-02-25 Thread Eric Baldeschwieler
+1 Hi Folks, I don't think vetoing releases until the append issue is resolved is constructive. I'd like to invite folks who want to fix append to work with us on that and support releasing 20 without it in parallel. Please keep in mind the spirit of this project. Putting your shoulder

Re: Hadoop 0.20.0

2009-02-25 Thread Brian Bockelman
On Feb 25, 2009, at 10:20 PM, Nigel Daley wrote: On Feb 25, 2009, at 7:52 PM, Dhruba Borthakur wrote: "Whipping out a patch" says nothing about its reliability. i would like some focus from the developer's community to properly fix this issue. I am willing to spend as much as time it take

Re: Hadoop 0.20.0

2009-02-25 Thread Nigel Daley
On Feb 25, 2009, at 7:52 PM, Dhruba Borthakur wrote: "Whipping out a patch" says nothing about its reliability. i would like some focus from the developer's community to properly fix this issue. I am willing to spend as much as time it takes ot get it fixed the right way, I but I would lik

[jira] Created: (HADOOP-5332) Make support for file append API configurable

2009-02-25 Thread Nigel Daley (JIRA)
Make support for file append API configurable - Key: HADOOP-5332 URL: https://issues.apache.org/jira/browse/HADOOP-5332 Project: Hadoop Core Issue Type: Improvement Components: dfs

[jira] Updated: (HADOOP-4638) Exception thrown in/from RecoveryManager.recover() should be caught and handled

2009-02-25 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-4638: --- Priority: Blocker (was: Major) Affects Version/s: 0.20.0 > Exception thrown in/from Re

[jira] Resolved: (HADOOP-5325) Jobs are getting stuck on JobTracker restart

2009-02-25 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat resolved HADOOP-5325. Resolution: Duplicate HADOOP-4638 will take care of this. > Jobs are getting stuck on JobTracke

[jira] Commented: (HADOOP-5330) Zombie tasks remain after jobs finish/fail/get killed

2009-02-25 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676865#action_12676865 ] Amar Kamat commented on HADOOP-5330: Pre HADOOP-5247, it was assumed that all the trac

Re: Contributing to hadoop

2009-02-25 Thread Pradeep Fernando
Raghu, I guess you are asking if it would be more convenient if one had access to a > larger cluster for development. exactly. I have access to many machines and clusters.. but about 99% of my > development happens using single machine for testing. I would guess that is > true for most of

Re: Hadoop 0.20.0

2009-02-25 Thread Dhruba Borthakur
"Whipping out a patch" says nothing about its reliability. i would like some focus from the developer's community to properly fix this issue. I am willing to spend as much as time it takes ot get it fixed the right way, I but I would like even more constructive engagement from more people to get t

Re: Hadoop 0.20.0

2009-02-25 Thread Nigel Daley
On Feb 24, 2009, at 9:28 PM, Dhruba Borthakur wrote: Hi Jim, I can understand your problem. I can probably whip out a fix for HADOOP-4663 and HADOOP-4379 by the end of this week. It would be nice if somebody else (Hairong, Sanjay, Konstantin?) can volunteer to discuss and review the pat

[jira] Commented: (HADOOP-4584) Slow generation of blockReport at DataNode causes delay of sending heartbeat to NameNode

2009-02-25 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676857#action_12676857 ] Suresh Srinivas commented on HADOOP-4584: - Can you guys vote on your preferred fix

[jira] Updated: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Sriram Rao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Rao updated HADOOP-5331: --- Attachment: patch.5331.test patch.5331 A patch that fixes the issue as well as a tes

[jira] Created: (HADOOP-5331) KFS: Add support for append

2009-02-25 Thread Sriram Rao (JIRA)
KFS: Add support for append --- Key: HADOOP-5331 URL: https://issues.apache.org/jira/browse/HADOOP-5331 Project: Hadoop Core Issue Type: Bug Affects Versions: 0.19.1 Reporter: Sriram Rao KFS has supp

[jira] Commented: (HADOOP-5054) Chukwa database partitions does not create/expire automatically

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676852#action_12676852 ] Ari Rabkin commented on HADOOP-5054: It looks like this patch hardcodes the number of

[jira] Commented: (HADOOP-5051) hdfs throughput calculation is incorrect in chukwa database

2009-02-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676853#action_12676853 ] Eric Yang commented on HADOOP-5051: --- Every iine in the file is a SQL query. There is no

[jira] Commented: (HADOOP-5029) Add utilities to load chukwa sequence file to database

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676851#action_12676851 ] Ari Rabkin commented on HADOOP-5029: +1 > Add utilities to load chukwa sequence file

[jira] Commented: (HADOOP-4504) Adapt chukwa code to hadoop codestyle

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676850#action_12676850 ] Ari Rabkin commented on HADOOP-4504: I'm tempted to starting dealing with this issue f

[jira] Commented: (HADOOP-5051) hdfs throughput calculation is incorrect in chukwa database

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676848#action_12676848 ] Ari Rabkin commented on HADOOP-5051: I don't feel qualified to review this; my SQL exp

[jira] Commented: (HADOOP-5313) Variable FileTailingAdaptor adaptor in TerminatorThread should not be static

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676847#action_12676847 ] Ari Rabkin commented on HADOOP-5313: +1. At some point we should probably comment tha

[jira] Commented: (HADOOP-5309) Hourly and Daily rolling should use CHUKWA_CONF_DIR

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676846#action_12676846 ] Ari Rabkin commented on HADOOP-5309: Any idea why the JVM is crashing in tests? > Ho

[jira] Commented: (HADOOP-5308) In case of exception in any FileTailingAdaptor the tailer will exit his main loop

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676844#action_12676844 ] Ari Rabkin commented on HADOOP-5308: Not quite sure I understand what this patch does.

[jira] Commented: (HADOOP-5203) TT's version build is too restrictive

2009-02-25 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676841#action_12676841 ] Runping Qi commented on HADOOP-5203: Rick and I chatted about this a moment ago. We a

[jira] Updated: (HADOOP-4103) Alert for missing blocks

2009-02-25 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-4103: - Attachment: HADOOP-4103.patch Thanks Suresh. Updated patch includes all the suggestions. 'df

[jira] Commented: (HADOOP-5218) libhdfs unit test failed because it was unable to start namenode/datanode

2009-02-25 Thread Craig Macdonald (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676833#action_12676833 ] Craig Macdonald commented on HADOOP-5218: - +1 Looks good. > libhdfs unit test fai

[jira] Commented: (HADOOP-5087) Regex for Cmd parsing contains an error

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676832#action_12676832 ] Ari Rabkin commented on HADOOP-5087: This has been languishing for a while and I'd lik

[jira] Commented: (HADOOP-5033) chukwa writer API is confusing

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676830#action_12676830 ] Ari Rabkin commented on HADOOP-5033: I just committed this, > chukwa writer API is co

[jira] Updated: (HADOOP-5033) chukwa writer API is confusing

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ari Rabkin updated HADOOP-5033: --- Resolution: Fixed Fix Version/s: 0.21.0 Release Note: Simplify ChukwaWriter API.

[jira] Updated: (HADOOP-5205) Change CHUKWA_IDENT_STRING from "demo" to "TODO-AGENTS-INSTANCE-NAME"

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ari Rabkin updated HADOOP-5205: --- Resolution: Fixed Fix Version/s: 0.21.0 Status: Resolved (was: Patch Available) I

[jira] Commented: (HADOOP-5316) Unable to detect running process from pid file

2009-02-25 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676823#action_12676823 ] Ari Rabkin commented on HADOOP-5316: I would actually prefer to get chukwa out of the

Re: Contributing to hadoop

2009-02-25 Thread Raghu Angadi
Pradeep Fernando wrote: although this sounds good. there are clouds like Amazon EC2 for setting up a cluster.Are you devs make use of that sort of infrastructure in development testing.I dont knw this is a right question or this is relevent at all. plz bare with me if. I guess you are asking i

[jira] Issue Comment Edited: (HADOOP-4379) In HDFS, sync() not yet guarantees data available to the new readers

2009-02-25 Thread Jim Kellerman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676816#action_12676816 ] jimk edited comment on HADOOP-4379 at 2/25/09 3:33 PM: App

[jira] Commented: (HADOOP-4379) In HDFS, sync() not yet guarantees data available to the new readers

2009-02-25 Thread Jim Kellerman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676816#action_12676816 ] Jim Kellerman commented on HADOOP-4379: --- Applying this patch to hadoop-0.19.0, it do

[jira] Commented: (HADOOP-5330) Zombie tasks remain after jobs finish/fail/get killed

2009-02-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676813#action_12676813 ] Doug Cutting commented on HADOOP-5330: -- What version of Hadoop? Can you get stack du

[jira] Created: (HADOOP-5330) Zombie tasks remain after jobs finish/fail/get killed

2009-02-25 Thread Nathan Marz (JIRA)
Zombie tasks remain after jobs finish/fail/get killed - Key: HADOOP-5330 URL: https://issues.apache.org/jira/browse/HADOOP-5330 Project: Hadoop Core Issue Type: Bug Affects Versions: 0.

[jira] Commented: (HADOOP-3998) Got an exception from ClientFinalizer when the JT is terminated

2009-02-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676795#action_12676795 ] dhruba borthakur commented on HADOOP-3998: -- I agree with you that there is only a

[jira] Updated: (HADOOP-4981) Prior code fix in Capacity Scheduler prevents speculative execution in jobs

2009-02-25 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Paranjpye updated HADOOP-4981: - Priority: Major (was: Blocker) > Prior code fix in Capacity Scheduler prevents speculat

[jira] Commented: (HADOOP-5318) Poor IO Performance due to AtomicLong operations

2009-02-25 Thread Ben Maurer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676780#action_12676780 ] Ben Maurer commented on HADOOP-5318: When I benchmarked, I saw a performance gain from

RE: Hadoop 0.20.0

2009-02-25 Thread Jonathan Gray
-1 This is a huge deal for me as an HBase user. And as someone who does significant consulting and evangelism for HBase, there is probably not a more necessary feature at this stage of the project. Writes in HBase are done in memory, and we also write each edit to the HLog which is periodically

[jira] Commented: (HADOOP-3998) Got an exception from ClientFinalizer when the JT is terminated

2009-02-25 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676765#action_12676765 ] Hairong Kuang commented on HADOOP-3998: --- Dhruba, it makes very common sense to stop

[jira] Commented: (HADOOP-5203) TT's version build is too restrictive

2009-02-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676762#action_12676762 ] Doug Cutting commented on HADOOP-5203: -- Do you have a patch? > TT's version build is

[jira] Commented: (HADOOP-5218) libhdfs unit test failed because it was unable to start namenode/datanode

2009-02-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676760#action_12676760 ] dhruba borthakur commented on HADOOP-5218: -- Can some kind soul please review this

[jira] Commented: (HADOOP-5318) Poor IO Performance due to AtomicLong operations

2009-02-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676756#action_12676756 ] Doug Cutting commented on HADOOP-5318: -- Inserting a 256k output buffer in every FSDat

[jira] Updated: (HADOOP-3998) Got an exception from ClientFinalizer when the JT is terminated

2009-02-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-3998: - Attachment: closeAll.patch This patch throws a BlockAlreadyCommittedException if the blo

[jira] Updated: (HADOOP-5286) DFS client blocked for a long time reading blocks of a file on the JobTracker

2009-02-25 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Paranjpye updated HADOOP-5286: - Fix Version/s: 0.20.0 Assignee: Raghu Angadi > DFS client blocked for a long ti

[jira] Commented: (HADOOP-5203) TT's version build is too restrictive

2009-02-25 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676755#action_12676755 ] Runping Qi commented on HADOOP-5203: My thinking is that it is preferable that one can

[jira] Commented: (HADOOP-5203) TT's version build is too restrictive

2009-02-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676748#action_12676748 ] Doug Cutting commented on HADOOP-5203: -- > I prefer to provide options to allow the us

[jira] Created: (HADOOP-5329) TestLocalMRNotification.testMR failed in Hudson

2009-02-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
TestLocalMRNotification.testMR failed in Hudson --- Key: HADOOP-5329 URL: https://issues.apache.org/jira/browse/HADOOP-5329 Project: Hadoop Core Issue Type: Bug Components: mapred, test

[jira] Updated: (HADOOP-5320) TestMapReduceLocal is missing a close() that is causing it to fail while running the test on NFS

2009-02-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-5320: --- Component/s: (was: mapred) test > TestMapReduceLocal is

[jira] Updated: (HADOOP-5305) Unit test org.apache.hadoop.fs.TestCopyFiles.testMapCount fails on trunk

2009-02-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-5305: --- Fix Version/s: 0.21.0 > Unit test org.apache.hadoop.fs.TestCopyFiles.testMap

[jira] Updated: (HADOOP-5320) TestMapReduceLocal is missing a close() that is causing it to fail while running the test on NFS

2009-02-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-5320: --- Resolution: Fixed Fix Version/s: 0.21.0 Hadoop Flags: [Reviewed]

[jira] Resolved: (HADOOP-4907) TestMapReduceLocal fails

2009-02-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HADOOP-4907. Resolution: Duplicate > TestMapReduceLocal fails > ---

[jira] Updated: (HADOOP-5305) Unit test org.apache.hadoop.fs.TestCopyFiles.testMapCount fails on trunk

2009-02-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-5305: --- Resolution: Fixed Status: Resolved (was: Patch Available) I committ

[jira] Commented: (HADOOP-5305) Unit test org.apache.hadoop.fs.TestCopyFiles.testMapCount fails on trunk

2009-02-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676735#action_12676735 ] Tsz Wo (Nicholas), SZE commented on HADOOP-5305: The failed tests are not

[jira] Commented: (HADOOP-3998) Got an exception from ClientFinalizer when the JT is terminated

2009-02-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676731#action_12676731 ] dhruba borthakur commented on HADOOP-3998: -- My thinking is that it is bad if the

[jira] Updated: (HADOOP-5232) preparing HadoopPatchQueueAdmin.sh,test-patch.sh scripts to run builds on hudson slaves.

2009-02-25 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HADOOP-5232: --- Attachment: test.patch > preparing HadoopPatchQueueAdmin.sh,test-patch.sh scripts to

[jira] Commented: (HADOOP-5023) Add Tomcat support to hdfsproxy

2009-02-25 Thread zhiyong zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676724#action_12676724 ] zhiyong zhang commented on HADOOP-5023: --- I think it is because the ant version. Can

[jira] Commented: (HADOOP-5311) Write pipeline recovery fails

2009-02-25 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676720#action_12676720 ] Hairong Kuang commented on HADOOP-5311: --- Nicholas is right. So there is no worry abo

[jira] Commented: (HADOOP-3998) Got an exception from ClientFinalizer when the JT is terminated

2009-02-25 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676719#action_12676719 ] Hairong Kuang commented on HADOOP-3998: --- I read the recoverBlock code a little bit.

Re: Contributing to hadoop

2009-02-25 Thread Pradeep Fernando
Thanks Enis & steve, for your valuable guidelines. As i can understand since hadoop is a implementation of map-reduce it is aimed at working in a clustering environment. So me, having only a Desktop and Internet connection having doubts weather i can successfully contribute to the project. In

[jira] Commented: (HADOOP-5236) Unreachable code in TaskInProgress.inCompleteSubTask

2009-02-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676697#action_12676697 ] Hadoop QA commented on HADOOP-5236: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-5303) Hadoop Workflow System (HWS)

2009-02-25 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676694#action_12676694 ] Alejandro Abdelnur commented on HADOOP-5303: h4. Regarding language independen

Re: Hadoop 0.20.0

2009-02-25 Thread Ted Dunning
Indeed, I am one of these community members who are quite possibly going to find another alternative if hbase doesn't seem more supportable/supported reasonably soon. Cassandra suffers from the normal facebook open source syndrome of no documentation, but that begins to look good given the problem

[jira] Updated: (HADOOP-5154) 4-way deadlock in FairShare scheduler

2009-02-25 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Yamijala updated HADOOP-5154: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch

  1   2   >