[jira] Commented: (HADOOP-1020) Path class on Windows seems broken

2007-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476088 ] Hadoop QA commented on HADOOP-1020: --- -1, because 2 attempts failed to build and test the latest attachment (http:

[jira] Updated: (HADOOP-1043) Optimize the shuffle phase (increase the parallelism)

2007-02-26 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1043: Attachment: 1043.patch This patch looks at all the available CopyResult objects from the copyResul

[jira] Updated: (HADOOP-1042) Improve the handling of failed map output fetches

2007-02-26 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1042: Attachment: 1042.patch This patch does the following (everything in the file ReduceTaskRunner.java

[jira] Commented: (HADOOP-958) Building Hadoop results in a lot of warnings

2007-02-26 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476083 ] Nigel Daley commented on HADOOP-958: +1 on your patch > Building Hadoop results in a lot of warnings > -

[jira] Commented: (HADOOP-940) pendingReplications of FSNamesystem is not informative

2007-02-26 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476080 ] Hairong Kuang commented on HADOOP-940: -- This patch sets the time out period to be 10 minutes and the pending re

[jira] Created: (HADOOP-1043) Optimize the shuffle phase (increase the parallelism)

2007-02-26 Thread Devaraj Das (JIRA)
Optimize the shuffle phase (increase the parallelism) - Key: HADOOP-1043 URL: https://issues.apache.org/jira/browse/HADOOP-1043 Project: Hadoop Issue Type: Improvement Components:

[jira] Created: (HADOOP-1042) Improve the handling of failed map output fetches

2007-02-26 Thread Devaraj Das (JIRA)
Improve the handling of failed map output fetches - Key: HADOOP-1042 URL: https://issues.apache.org/jira/browse/HADOOP-1042 Project: Hadoop Issue Type: Improvement Components: mapred

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread James P. White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476073 ] James P. White commented on HADOOP-1041: I think you've lost track of my specific proposal which was very si

[jira] Updated: (HADOOP-928) make checksums optional per FileSystem

2007-02-26 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-928: - Attachment: checksum2.patch > make checksums optional per FileSystem > --

[jira] Commented: (HADOOP-972) Improve the rack-aware replica placement performance

2007-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476053 ] Hadoop QA commented on HADOOP-972: -- -1, because the javadoc command appears to have generated warning messages when

[jira] Updated: (HADOOP-972) Improve the rack-aware replica placement performance

2007-02-26 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-972: - Status: Patch Available (was: Open) > Improve the rack-aware replica placement performance > ---

[jira] Updated: (HADOOP-972) Improve the rack-aware replica placement performance

2007-02-26 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-972: - Attachment: rack_performance2.patch I did not mark the patch available. It became out-dated. So h

[jira] Commented: (HADOOP-928) make checksums optional per FileSystem

2007-02-26 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476049 ] Hairong Kuang commented on HADOOP-928: -- OK, I will keep FSInputChecker and FSOutputSummer private within Checks

Re: [jira] Updated: (HADOOP-1020) Path class on Windows seems broken

2007-02-26 Thread Nigel Daley
Still broken. On Windows I still get: [junit] Job tracker crashed: [junit] java.lang.IllegalArgumentException: Pathname /C:/trunk/ build/contrib/streaming/test/mapred/system from C:/trunk/build/ contrib/streaming/test/mapred/system is not a valid DFS filename. [junit] at org.

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476043 ] Arun C Murthy commented on HADOOP-1041: --- +1 on Doug's last comment. Let us worry about i18n when we get there

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476041 ] Doug Cutting commented on HADOOP-1041: -- Perhaps we are making this harder than it needs to be. Perhaps we shou

[jira] Commented: (HADOOP-928) make checksums optional per FileSystem

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476040 ] Doug Cutting commented on HADOOP-928: - Sorry, this patch does not apply cleanly to current trunk. Other patches

[jira] Commented: (HADOOP-1020) Path class on Windows seems broken

2007-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476035 ] Hadoop QA commented on HADOOP-1020: --- -1, because 2 attempts failed to build and test the latest attachment (http:

[jira] Updated: (HADOOP-928) make checksums optional per FileSystem

2007-02-26 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-928: - Attachment: checksum1.patch This patch incorporates most of Doug's comments. I finally decided

[jira] Updated: (HADOOP-994) DFS Scalability : a BlockReport that returns large number of blocks-to-be-deleted cause datanode to lost connectivity to namenode

2007-02-26 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-994: Attachment: blockReportInvalidateBlock.patch A block report now can return a maximum of BLO

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread James P. White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476018 ] James P. White commented on HADOOP-1041: An example of how to bridge the gap between programmers and transla

[jira] Updated: (HADOOP-1020) Path class on Windows seems broken

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1020: - Fix Version/s: 0.12.0 Status: Patch Available (was: Open) > Path class on Windows se

[jira] Updated: (HADOOP-1020) Path class on Windows seems broken

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1020: - Attachment: HADOOP-1020.patch The bug was an erroneous optimization in the Path(Path,Path) const

[jira] Commented: (HADOOP-1036) task gets lost during assignment

2007-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476005 ] Hadoop QA commented on HADOOP-1036: --- -1, because 2 attempts failed to build and test the latest attachment (http:

Re: [jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Arkady Borkovsky
That means users adding their own counters and wanting to avoid the cumbersome names would need to copy the default properties file and add their own to it, but they would then have full control over all the displayed names. Many users prefer to know as little as possible about system entiti

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread James P. White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12476003 ] James P. White commented on HADOOP-1041: Resource bundles are logically associated with the presentation ("v

Re: nightly build failure in TestDecommission

2007-02-26 Thread Nigel Daley
On Feb 26, 2007, at 9:53 AM, Doug Cutting wrote: Browsing http://lucene.zones.apache.org:8080/hudson/job/Hadoop- Nightly/ this morning I see that a nightly build failed in TestDecommission. I didn't yet see a message to this list about the failure. (Nigel?) I believe Hudson doesn't have

Re: [jira] Updated: (HADOOP-1030) in unit tests, set ipc timeout in one place

2007-02-26 Thread Nigel Daley
On Feb 23, 2007, at 11:53 AM, Doug Cutting wrote: Glancing at TestNG and JUnit4, the grouping stuff looks nicer in TestNG. But does grouping help except when changes are in high- level components that little else depends on? For example, a change to HDFS should run all the mapred tests th

[jira] Updated: (HADOOP-1036) task gets lost during assignment

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1036: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475995 ] Doug Cutting commented on HADOOP-1041: -- > multiple properties per counter is [...] over-engineering They could

[jira] Updated: (HADOOP-1027) Fix the RAM FileSystem/Merge problems (reported in HADOOP-1014)

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1027: - Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available

[jira] Updated: (HADOOP-958) Building Hadoop results in a lot of warnings

2007-02-26 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-958: - Attachment: example-warnings.patch As a (very small start) here is a patch that fixes the warnings in the

[jira] Commented: (HADOOP-958) Building Hadoop results in a lot of warnings

2007-02-26 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475989 ] Tom White commented on HADOOP-958: -- On 26/02/07, Nigel Daley <[EMAIL PROTECTED]> wrote: > If I remember correctly, -

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread David Bowen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475984 ] David Bowen commented on HADOOP-1041: - I was assuming we would have a single ResourceBundle (properties file) f

[jira] Updated: (HADOOP-1040) Improvement of RandomWriter example to use custom InputFormat, OutputFormat, and Counters

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1040: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

Re: [jira] Commented: (HADOOP-958) Building Hadoop results in a lot of warnings

2007-02-26 Thread Nigel Daley
If I remember correctly, -Xlint only shows the first 100 warnings, so until our warning count is < 100, this scheme won't work. Please correct me if I'm wrong here. I like the idea of using @SuppressWarnings annotation where appropriate. On Feb 26, 2007, at 12:55 AM, Tom White (JIRA) wrote

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475982 ] Doug Cutting commented on HADOOP-1041: -- > job.properties for the job specific ones What about framework counte

[jira] Updated: (HADOOP-1039) Reduce the time taken by TestCheckpoint

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1039: - Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475977 ] Owen O'Malley commented on HADOOP-1041: --- It seems like we should have: hadoop_en.properties for the generic c

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475972 ] Doug Cutting commented on HADOOP-1041: -- One more thought: we can group counters by their enumeration class. So

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475970 ] Doug Cutting commented on HADOOP-1041: -- > the ResourceBundle file name would be something like > HaddopCounter

[jira] Updated: (HADOOP-1036) task gets lost during assignment

2007-02-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1036: -- Status: Patch Available (was: Open) > task gets lost during assignment >

[jira] Commented: (HADOOP-1036) task gets lost during assignment

2007-02-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475968 ] Owen O'Malley commented on HADOOP-1036: --- +1 > task gets lost during assignment >

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread James P. White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475962 ] James P. White commented on HADOOP-1041: On sorting I would mostly agree that a good starting point would be

[jira] Commented: (HADOOP-1027) Fix the RAM FileSystem/Merge problems (reported in HADOOP-1014)

2007-02-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475961 ] Owen O'Malley commented on HADOOP-1027: --- +1 > Fix the RAM FileSystem/Merge problems (reported in HADOOP-1014)

[jira] Updated: (HADOOP-1036) task gets lost during assignment

2007-02-26 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1036: -- Attachment: HADOOP-1036_20070226_1.patch Attached fix - better exception handling in TaskTrack

[jira] Commented: (HADOOP-1033) Rewrite AmazonEC2 wiki page

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475958 ] Doug Cutting commented on HADOOP-1033: -- +1 The wiki page looks great to me. Thanks, Tom! > Rewrite AmazonEC2

RE: nightly build failure in TestDecommission

2007-02-26 Thread Wendy Chien
This message was added in HADOOP-442. I'm looking into it. Wendy -Original Message- From: Doug Cutting [mailto:[EMAIL PROTECTED] Sent: Monday, February 26, 2007 9:54 AM To: hadoop-dev@lucene.apache.org Subject: nightly build failure in TestDecommission Browsing http://lucene.zones.apa

[jira] Commented: (HADOOP-1032) Support for caching Job JARs

2007-02-26 Thread Gautam Kowshik (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475938 ] Gautam Kowshik commented on HADOOP-1032: As per my discussion with Mahadev... - We can use the existing Dis

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread James P. White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475939 ] James P. White commented on HADOOP-1041: You might consider resource bundles for handling the name prettifyi

[jira] Commented: (HADOOP-1036) task gets lost during assignment

2007-02-26 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475936 ] Arun C Murthy commented on HADOOP-1036: --- There are two reasons, which combined, result in this scenario: a) T

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475947 ] Milind Bhandarkar commented on HADOOP-1041: --- +1 on using ResourceBundles for prettyfication. Especiallly s

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread David Bowen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475945 ] David Bowen commented on HADOOP-1041: - Good idea! Then the names can even be localized into other languages if

nightly build failure in TestDecommission

2007-02-26 Thread Doug Cutting
Browsing http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ this morning I see that a nightly build failed in TestDecommission. I didn't yet see a message to this list about the failure. (Nigel?) The log shows a failure that I'd not seen previously: http://lucene.zones.apache.org

[jira] Commented: (HADOOP-1041) Counter names are ugly

2007-02-26 Thread David Bowen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475921 ] David Bowen commented on HADOOP-1041: - The long names are certainly ugly. The part after the '#' is generated

[jira] Commented: (HADOOP-941) Make Hadoop Record I/O Easier to use outside Hadoop

2007-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475916 ] Doug Cutting commented on HADOOP-941: - > dependency on the Lucene jar. Which was deemed unacceptable, so we copie

[jira] Commented: (HADOOP-1035) StackOverflowError in FSDataSet

2007-02-26 Thread Philippe Gassmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475853 ] Philippe Gassmann commented on HADOOP-1035: --- We have about 21000 blocks stored on each datanodes. > Stack

[jira] Commented: (HADOOP-958) Building Hadoop results in a lot of warnings

2007-02-26 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12475840 ] Tom White commented on HADOOP-958: -- I saw it the other way round - put in some measures to make sure number of warn