[jira] Updated: (HADOOP-5113) logcondense should delete hod logs for a user , whose username has any of the characters in the value passed to "-l" options

2009-01-22 Thread Peeyush Bishnoi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peeyush Bishnoi updated HADOOP-5113: Component/s: contrib/hod > logcondense should delete hod logs for a user , whose username

[jira] Created: (HADOOP-5113) logcondense should delete hod logs for a user , whose username has any of the characters in the value passed to "-l" options

2009-01-22 Thread Peeyush Bishnoi (JIRA)
logcondense should delete hod logs for a user , whose username has any of the characters in the value passed to "-l" options - Key: HADOOP-5113

[VOTE] Release Hadoop 0.18.3 (candidate 0)

2009-01-22 Thread Nigel Daley
I have created a candidate build for Hadoop 0.18.3. This fixes 51 issues in 0.18.2, including several problems that may lead to data loss from the file system. *** Please download and test it before the *** vote closes on Tuesday, January 27. http://people.apache.org/~nigel/hadoop-0.18.3-ca

[jira] Commented: (HADOOP-4981) Prior code fix in Capacity Scheduler prevents speculative execution in jobs

2009-01-22 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666429#action_12666429 ] Matei Zaharia commented on HADOOP-4981: --- +1 on having a clean way to detect whether

[jira] Commented: (HADOOP-4981) Prior code fix in Capacity Scheduler prevents speculative execution in jobs

2009-01-22 Thread Vivek Ratan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666427#action_12666427 ] Vivek Ratan commented on HADOOP-4981: - If I understand correctly, you're suggesting th

[jira] Commented: (HADOOP-5049) Jobs with 0 maps will never get removed from the default scheduler

2009-01-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666424#action_12666424 ] Owen O'Malley commented on HADOOP-5049: --- No, I'm saying that the correct behavior sh

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

2009-01-22 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Availa

[jira] Updated: (HADOOP-5075) Potential infinite loop in updateMinSlots

2009-01-22 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-5075: -- Fix Version/s: (was: 0.19.1) > Potential infinite loop in updateMinSlots > ---

[jira] Commented: (HADOOP-5049) Jobs with 0 maps will never get removed from the default scheduler

2009-01-22 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666418#action_12666418 ] Amar Kamat commented on HADOOP-5049: Owen, with 0 maps we never initialize the setup/c

[jira] Resolved: (HADOOP-4761) Tool to give the block location and to check if the block at a given datanode is corrupt or not

2009-01-22 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R resolved HADOOP-4761. - Resolution: Duplicate Marking as duplicate to HADOOP-4763. > Tool to give the block location and to ch

[jira] Updated: (HADOOP-4927) Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there

2009-01-22 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jothi Padmanabhan updated HADOOP-4927: -- Status: Open (was: Patch Available) Canceling patch to incorporate review comments >

[jira] Commented: (HADOOP-4975) CompositeRecordReader: ClassLoader set in JobConf is not passed onto WrappedRecordReaders

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666404#action_12666404 ] Chris Douglas commented on HADOOP-4975: --- {noformat} [exec] +1 overall. [

[jira] Updated: (HADOOP-4999) IndexOutOfBoundsException in FSEditLog

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-4999: -- Status: Open (was: Patch Available) > IndexOutOfBoundsException in FSEditLog > --

[jira] Updated: (HADOOP-5010) Document HTTP/HTTPS methods to read directory and file data

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-5010: -- Attachment: 5010-0.patch bq. So, if this is a documentation request, then we need to decide wh

[jira] Updated: (HADOOP-5010) Document HTTP/HTTPS methods to read directory and file data

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-5010: -- Priority: Trivial (was: Major) Fix Version/s: (was: 0.20.0) 0.

[jira] Commented: (HADOOP-5086) Trash URI semantics can be relaxed

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666390#action_12666390 ] Chris Douglas commented on HADOOP-5086: --- Passed all unit tests on my machine. Shoul

[jira] Commented: (HADOOP-5112) Upgrade Clover to 2.4.2 and enable Test Optimization in HADOOP

2009-01-22 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666388#action_12666388 ] Nigel Daley commented on HADOOP-5112: - Thanks Nick. I believe this is likely a duplic

[jira] Created: (HADOOP-5112) Upgrade Clover to 2.4.2 and enable Test Optimization in HADOOP

2009-01-22 Thread Nick Pellow (JIRA)
Upgrade Clover to 2.4.2 and enable Test Optimization in HADOOP -- Key: HADOOP-5112 URL: https://issues.apache.org/jira/browse/HADOOP-5112 Project: Hadoop Core Issue Type: Task

[jira] Commented: (HADOOP-4663) Datanode should delete files under tmp when upgraded from 0.17

2009-01-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666379#action_12666379 ] Konstantin Shvachko commented on HADOOP-4663: - > Ok, so it is not about correc

[jira] Updated: (HADOOP-4692) Namenode in infinite loop for replicating/deleting corrupted block

2009-01-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-4692: -- Attachment: mismatchBlockReplication.patch With this patch, this issue does not depend on HADO

[jira] Updated: (HADOOP-5111) Generic mapreduce classes cannot be used with Job::set* methods

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-5111: -- Assignee: Chris Douglas Status: Patch Available (was: Open) > Generic mapreduce classes

[jira] Commented: (HADOOP-4681) DFSClient block read failures cause open DFSInputStream to become unusable

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666377#action_12666377 ] Chris Douglas commented on HADOOP-4681: --- The patch did resolve the issue with long-l

[jira] Commented: (HADOOP-4970) Use the full path when move files to .Trash/Current

2009-01-22 Thread Prasad Chakka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666372#action_12666372 ] Prasad Chakka commented on HADOOP-4970: --- since 0.20 is not already released, it woul

[jira] Commented: (HADOOP-5049) Jobs with 0 maps will never get removed from the default scheduler

2009-01-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666371#action_12666371 ] Owen O'Malley commented on HADOOP-5049: --- I agree with Vivek. I think that changing t

[jira] Commented: (HADOOP-4970) Use the full path when move files to .Trash/Current

2009-01-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666369#action_12666369 ] dhruba borthakur commented on HADOOP-4970: -- I am going to commit this to trunk on

[jira] Commented: (HADOOP-4944) Allow Xinclude in hadoop config file

2009-01-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666368#action_12666368 ] dhruba borthakur commented on HADOOP-4944: -- Can some kind soul please review this

[jira] Commented: (HADOOP-4681) DFSClient block read failures cause open DFSInputStream to become unusable

2009-01-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666364#action_12666364 ] dhruba borthakur commented on HADOOP-4681: -- Hi Igor, Thanks for the patch. Chri

[jira] Updated: (HADOOP-5111) Generic mapreduce classes cannot be used with Job::set* methods

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-5111: -- Attachment: 5111-0.patch > Generic mapreduce classes cannot be used with Job::set* methods > -

[jira] Commented: (HADOOP-5045) Remove deprecated FileSystem.isDirectory()

2009-01-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666362#action_12666362 ] Tsz Wo (Nicholas), SZE commented on HADOOP-5045: - We should use fs.getFil

[jira] Created: (HADOOP-5111) Generic mapreduce classes cannot be used with Job::set* methods

2009-01-22 Thread Chris Douglas (JIRA)
Generic mapreduce classes cannot be used with Job::set* methods --- Key: HADOOP-5111 URL: https://issues.apache.org/jira/browse/HADOOP-5111 Project: Hadoop Core Issue Type: Bug

[jira] Commented: (HADOOP-5045) Remove deprecated FileSystem.isDirectory()

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666360#action_12666360 ] Doug Cutting commented on HADOOP-5045: -- There are some whitespace changes and additio

[jira] Commented: (HADOOP-4663) Datanode should delete files under tmp when upgraded from 0.17

2009-01-22 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666358#action_12666358 ] dhruba borthakur commented on HADOOP-4663: -- > Which design are we talking about a

[jira] Commented: (HADOOP-5003) When computing absoluet guaranteed capacity (GC) from a percent value, Capacity Scheduler should round up floats, rather than truncate them.

2009-01-22 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666356#action_12666356 ] Owen O'Malley commented on HADOOP-5003: --- Let's move the discussion of this over to m

[jira] Created: (HADOOP-5110) The capacity schedule must start a timer when a queue is underserved

2009-01-22 Thread Owen O'Malley (JIRA)
The capacity schedule must start a timer when a queue is underserved Key: HADOOP-5110 URL: https://issues.apache.org/jira/browse/HADOOP-5110 Project: Hadoop Core Issue Type

[jira] Updated: (HADOOP-5109) TestKillCompletedJob is failing intermittetnly when run as part of test-core

2009-01-22 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HADOOP-5109: Attachment: TEST-org.apache.hadoop.mapred.TestKillCompletedJob.txt Log from failing execution of t

[jira] Commented: (HADOOP-5086) Trash URI semantics can be relaxed

2009-01-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666352#action_12666352 ] Chris Douglas commented on HADOOP-5086: --- {noformat} [exec] +1 overall. [

[jira] Updated: (HADOOP-5045) Remove deprecated FileSystem.isDirectory()

2009-01-22 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-5045: Attachment: 5045.patch FileSystem currently has two convenient methods - {{isDirectory(pat

[jira] Created: (HADOOP-5109) TestKillCompletedJob is failing intermittetnly when run as part of test-core

2009-01-22 Thread Jakob Homan (JIRA)
TestKillCompletedJob is failing intermittetnly when run as part of test-core Key: HADOOP-5109 URL: https://issues.apache.org/jira/browse/HADOOP-5109 Project: Hadoop Core

[jira] Updated: (HADOOP-5037) Deprecate FSNamesystem.getFSNamesystem() and change fsNamesystemObject to private

2009-01-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-5037: --- Attachment: 5037_20090122.patch 5037_20090122.patch: added javadoc for the d

[jira] Updated: (HADOOP-5037) Deprecate FSNamesystem.getFSNamesystem() and change fsNamesystemObject to private

2009-01-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-5037: --- Assignee: Tsz Wo (Nicholas), SZE Hadoop Flags: [Reviewed] S

[jira] Updated: (HADOOP-5051) hdfs throughput calculation is incorrect in chukwa database

2009-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-5051: -- Attachment: HADOOP-5051-1.patch Added extra time window to dfs throughput aggregation. > hdfs through

[jira] Updated: (HADOOP-5051) hdfs throughput calculation is incorrect in chukwa database

2009-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-5051: -- Attachment: (was: HADOOP-5051.patch) > hdfs throughput calculation is incorrect in chukwa database

[jira] Updated: (HADOOP-5051) hdfs throughput calculation is incorrect in chukwa database

2009-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-5051: -- Status: Patch Available (was: Open) > hdfs throughput calculation is incorrect in chukwa database > -

[jira] Updated: (HADOOP-5051) hdfs throughput calculation is incorrect in chukwa database

2009-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-5051: -- Status: Open (was: Patch Available) Hdfs throughput data calculation should process data for one extr

[jira] Commented: (HADOOP-5086) Trash URI semantics can be relaxed

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666331#action_12666331 ] Doug Cutting commented on HADOOP-5086: -- +1 this looks good to me. > Trash URI semant

[jira] Created: (HADOOP-5108) Map-side sort is hampered by io.sort.record.percent

2009-01-22 Thread Arun C Murthy (JIRA)
Map-side sort is hampered by io.sort.record.percent --- Key: HADOOP-5108 URL: https://issues.apache.org/jira/browse/HADOOP-5108 Project: Hadoop Core Issue Type: Bug Components: mapred

[jira] Commented: (HADOOP-5037) Deprecate FSNamesystem.getFSNamesystem() and change fsNamesystemObject to private

2009-01-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666314#action_12666314 ] Konstantin Shvachko commented on HADOOP-5037: - # @deprecated comment should sa

[jira] Resolved: (HADOOP-4939) Create a test that would inject random failures for tasks in large jobs and would also inject TaskTracker failures

2009-01-22 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HADOOP-4939. - Resolution: Fixed Release Note: This adds a test for doing reliability testing. Many big jo

[jira] Commented: (HADOOP-4692) Namenode in infinite loop for replicating/deleting corrupted block

2009-01-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666301#action_12666301 ] Hairong Kuang commented on HADOOP-4692: --- In the current trunk, the source datanode i

[jira] Commented: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666297#action_12666297 ] Arun C Murthy commented on HADOOP-5083: --- bq. When it's standalone, then it should ce

[jira] Updated: (HADOOP-4775) FUSE crashes reliably on 0.19.0

2009-01-22 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-4775: Fix Version/s: (was: 0.18.3) (was: 0.19.1) (was:

Hadoop 0.18.3

2009-01-22 Thread Nigel Daley
All blockers are committed for Hadoop 0.18.3. I'll roll a release and call a vote today. Nigel

[jira] Updated: (HADOOP-5100) Chukwa Log4JMetricsContext class should append new log to current log file

2009-01-22 Thread Jerome Boulon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerome Boulon updated HADOOP-5100: -- Status: Patch Available (was: Open) Set append flag to true. >From log4j Doc API /**

[jira] Updated: (HADOOP-5100) Chukwa Log4JMetricsContext class should append new log to current log file

2009-01-22 Thread Jerome Boulon (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerome Boulon updated HADOOP-5100: -- Attachment: HADOOP-5100.patch > Chukwa Log4JMetricsContext class should append new log to curr

[jira] Commented: (HADOOP-4868) Split the hadoop script into 3 parts

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666271#action_12666271 ] Doug Cutting commented on HADOOP-4868: -- > These invoke the common-config.sh present i

[jira] Updated: (HADOOP-4868) Split the hadoop script into 3 parts

2009-01-22 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated HADOOP-4868: --- Attachment: 4868_v3.patch this patch splits the scripts based on the proposal by Owen. * I

[jira] Commented: (HADOOP-4868) Split the hadoop script into 3 parts

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666267#action_12666267 ] Doug Cutting commented on HADOOP-4868: -- > Do you mean build dependencies? I think Ow

[jira] Commented: (HADOOP-5101) optimizing build.xml target dependencies

2009-01-22 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666262#action_12666262 ] Nigel Daley commented on HADOOP-5101: - Can we also combine test-c++-libhdfs target int

[jira] Created: (HADOOP-5107) split the core, hdfs, and mapred jars from each other and publish them independently to the Maven repository

2009-01-22 Thread Owen O'Malley (JIRA)
split the core, hdfs, and mapred jars from each other and publish them independently to the Maven repository Key: HADOOP-5107 URL: https://issues.apache.o

[jira] Commented: (HADOOP-4413) Capacity Scheduler to provide a scheduler history log to record actions taken and why

2009-01-22 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666251#action_12666251 ] Hemanth Yamijala commented on HADOOP-4413: -- I am in two minds about setQueueStats

[jira] Commented: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666250#action_12666250 ] Doug Cutting commented on HADOOP-5083: -- > This is what the attached patch does. Revie

[jira] Commented: (HADOOP-4931) Document TaskTracker's memory management functionality and CapacityScheduler's memory based scheduling.

2009-01-22 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666248#action_12666248 ] Hemanth Yamijala commented on HADOOP-4931: -- Vinod, maybe it is not time *yet* to

[jira] Commented: (HADOOP-4868) Split the hadoop script into 3 parts

2009-01-22 Thread Sharad Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666246#action_12666246 ] Sharad Agarwal commented on HADOOP-4868: bq. Should we not use Ivy for the depende

[jira] Commented: (HADOOP-4413) Capacity Scheduler to provide a scheduler history log to record actions taken and why

2009-01-22 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666245#action_12666245 ] Hemanth Yamijala commented on HADOOP-4413: -- Vivek, if we want to correlate events

[jira] Commented: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666242#action_12666242 ] Doug Cutting commented on HADOOP-5083: -- > you do not want the JobTracker starting the

[jira] Commented: (HADOOP-5003) When computing absoluet guaranteed capacity (GC) from a percent value, Capacity Scheduler should round up floats, rather than truncate them.

2009-01-22 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666237#action_12666237 ] Hemanth Yamijala commented on HADOOP-5003: -- Vivek, the connection between the rec

[jira] Commented: (HADOOP-4868) Split the hadoop script into 3 parts

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666236#action_12666236 ] Doug Cutting commented on HADOOP-4868: -- Should we not use Ivy for the dependency of m

[jira] Commented: (HADOOP-5103) Too many logs saying "Adding new node" on JobClient console

2009-01-22 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666233#action_12666233 ] Hairong Kuang commented on HADOOP-5103: --- I hope that the problem could be fixed in J

[jira] Commented: (HADOOP-4927) Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there

2009-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666231#action_12666231 ] Doug Cutting commented on HADOOP-4927: -- The class might better be called LazyRecordWr

[jira] Commented: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666226#action_12666226 ] Arun C Murthy commented on HADOOP-5083: --- bq. So JobTracker.main() can check the conf

[jira] Commented: (HADOOP-4490) Map and Reduce tasks should run as the user who submitted the job

2009-01-22 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666220#action_12666220 ] Arun C Murthy commented on HADOOP-4490: --- Hemanth, this is look good. Some comments

[jira] Updated: (HADOOP-3628) Add a lifecycle interface for Hadoop components: namenodes, job clients, etc.

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-3628: --- Attachment: hadoop-3628.patch Here is the latest patch in sync with svn head; still chasing

[jira] Updated: (HADOOP-3628) Add a lifecycle interface for Hadoop components: namenodes, job clients, etc.

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-3628: --- Attachment: hadoop-lifecycle-tomw.sxw This is an annotated copy of the document with comment

[jira] Commented: (HADOOP-3628) Add a lifecycle interface for Hadoop components: namenodes, job clients, etc.

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666211#action_12666211 ] Steve Loughran commented on HADOOP-3628: Suresh, I'm finally sitting down to look

[jira] Updated: (HADOOP-4475) The (deprecated) method NetUtils.getServerAddress() doesn't validate configuration values enough

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-4475: --- Status: Patch Available (was: Open) patch with tests. > The (deprecated) method NetUtils.g

[jira] Updated: (HADOOP-4475) The (deprecated) method NetUtils.getServerAddress() doesn't validate configuration values enough

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-4475: --- Attachment: hadoop-4475.patch This patch detects null address values early, and fails with a

[jira] Updated: (HADOOP-3999) Dynamic host configuration system (via node side plugins)

2009-01-22 Thread Kai Mosebach (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Mosebach updated HADOOP-3999: - Attachment: cloud_divide.jpg - Nodes collect local information (functions / performance indicato

[jira] Updated: (HADOOP-3999) Dynamic host configuration system (via node side plugins)

2009-01-22 Thread Kai Mosebach (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Mosebach updated HADOOP-3999: - Component/s: conf benchmarks Summary: Dynamic host configuration system

[jira] Commented: (HADOOP-4475) The (deprecated) method NetUtils.getServerAddress() doesn't validate configuration values enough

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666148#action_12666148 ] Steve Loughran commented on HADOOP-4475: That's HADOOP-2827 > The (deprecated) me

I dont understand all the datanode address values

2009-01-22 Thread Steve Loughran
I've just opened and then invalided a bugrep, which is due to me getting confused about the various datanode addresses. Can I list them and clarify my assumptions dfs.datanode.http.address serves up the files over HTTP dfs.datanode.https.address same, but over HTTPS dfs.datanode.address D

[jira] Resolved: (HADOOP-5106) hdfs-default.xml option names are not consistent with DataNode

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-5106. Resolution: Invalid closing, the new one does work if set > hdfs-default.xml option names

[jira] Created: (HADOOP-5106) hdfs-default.xml option names are not consistent with DataNode

2009-01-22 Thread Steve Loughran (JIRA)
hdfs-default.xml option names are not consistent with DataNode --- Key: HADOOP-5106 URL: https://issues.apache.org/jira/browse/HADOOP-5106 Project: Hadoop Core Issue Type: Bug

[jira] Commented: (HADOOP-2721) Use job control for tasks (and therefore for pipes and streaming)

2009-01-22 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666133#action_12666133 ] Ravi Gummadi commented on HADOOP-2721: -- test-patch gives: [exec] +1 overall.

[jira] Commented: (HADOOP-2721) Use job control for tasks (and therefore for pipes and streaming)

2009-01-22 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666128#action_12666128 ] Vinod K V commented on HADOOP-2721: --- +1 for the patch. > Use job control for tasks (and

[jira] Commented: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666126#action_12666126 ] Amar Kamat commented on HADOOP-5083: bq. Obviously, I'd like to see the new code integ

[jira] Updated: (HADOOP-2721) Use job control for tasks (and therefore for pipes and streaming)

2009-01-22 Thread Ravi Gummadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Gummadi updated HADOOP-2721: - Attachment: HADOOP-2721-v11.3.patch Thanks Vinod for pinting out the backwards incompatibility o

[jira] Assigned: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat reassigned HADOOP-5083: -- Assignee: Amar Kamat > Optionally a separate daemon should serve JobHistory >

[jira] Created: (HADOOP-5105) to optimimze hudsonBuildHadoopNightly.sh script

2009-01-22 Thread Giridharan Kesavan (JIRA)
to optimimze hudsonBuildHadoopNightly.sh script --- Key: HADOOP-5105 URL: https://issues.apache.org/jira/browse/HADOOP-5105 Project: Hadoop Core Issue Type: Improvement Components: build

[jira] Updated: (HADOOP-5101) optimizing build.xml target dependencies

2009-01-22 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HADOOP-5101: --- Attachment: hadoop-5101.patch This patch optimizes the findbugs targets, by calling

[jira] Commented: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666119#action_12666119 ] Steve Loughran commented on HADOOP-5083: # Obviously, I'd like to see the new code

[jira] Commented: (HADOOP-5103) Too many logs saying "Adding new node" on JobClient console

2009-01-22 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666096#action_12666096 ] Jothi Padmanabhan commented on HADOOP-5103: --- These statements are from a LOG.inf

[jira] Updated: (HADOOP-4927) Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there

2009-01-22 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jothi Padmanabhan updated HADOOP-4927: -- Status: Patch Available (was: Open) > Part files on the output filesystem are created

[jira] Updated: (HADOOP-4927) Part files on the output filesystem are created irrespective of whether the corresponding task has anything to write there

2009-01-22 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jothi Padmanabhan updated HADOOP-4927: -- Attachment: hadoop-4927.patch This patch implements the lazy file creation by wrapping

[jira] Updated: (HADOOP-5083) Optionally a separate daemon should serve JobHistory

2009-01-22 Thread Amar Kamat (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Kamat updated HADOOP-5083: --- Attachment: HADOOP-5083-v1.2.patch Attaching a patch the implements what I have mentioned [here|htt

[jira] Commented: (HADOOP-4931) Document TaskTracker's memory management functionality and CapacityScheduler's memory based scheduling.

2009-01-22 Thread Vinod K V (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666083#action_12666083 ] Vinod K V commented on HADOOP-4931: --- Some comments: - The words 'absence' and 'set' are