[jira] Commented: (HADOOP-1440) JobClient should not sort input-splits

2007-06-08 Thread eric baldeschwieler (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12503017 ] eric baldeschwieler commented on HADOOP-1440: - I tend to agree with runping. The framework should reser

[jira] Commented: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12503014 ] Tahir Hashmi commented on HADOOP-1432: -- It was only as fast as Jetty 5 as per a Sort-500 run done on Thursday.

[jira] Commented: (HADOOP-1470) Rework FSInputChecker and FSOutputSummer to support checksum code sharing between ChecksumFileSystem and block level crc dfs

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502984 ] Raghu Angadi commented on HADOOP-1470: -- Also it does not suite well for async reading/polling. We can provide

[jira] Commented: (HADOOP-1470) Rework FSInputChecker and FSOutputSummer to support checksum code sharing between ChecksumFileSystem and block level crc dfs

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502981 ] Raghu Angadi commented on HADOOP-1470: -- I don't want to claim that above a as generic as one might prefer. We c

[jira] Commented: (HADOOP-1470) Rework FSInputChecker and FSOutputSummer to support checksum code sharing between ChecksumFileSystem and block level crc dfs

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502975 ] Raghu Angadi commented on HADOOP-1470: -- I prefer readData ( or readChunk) and readChecksum(). Contract is that

[jira] Commented: (HADOOP-1478) The blockStream of DFSClient.FSInputStream should not be buffered

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502972 ] Raghu Angadi commented on HADOOP-1478: -- bq. HADOOP-1134 does not remove buffering. It moves buffer from FSData

[jira] Created: (HADOOP-1481) distcp skips empty directory when copying

2007-06-08 Thread Koji Noguchi (JIRA)
distcp skips empty directory when copying - Key: HADOOP-1481 URL: https://issues.apache.org/jira/browse/HADOOP-1481 Project: Hadoop Issue Type: Bug Components: util Affects Versions: 0.12

[jira] Commented: (HADOOP-1478) The blockStream of DFSClient.FSInputStream should not be buffered

2007-06-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502967 ] Hairong Kuang commented on HADOOP-1478: --- HADOOP-1134 does not remove buffering. It moves buffer from FSDataInp

[jira] Updated: (HADOOP-1479) NPE in HStore#get if StoreFile only has keys < than passed key

2007-06-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-1479: -- Status: Patch Available (was: Open) > NPE in HStore#get if StoreFile only has keys < than passed key > --

[jira] Updated: (HADOOP-1479) NPE in HStore#get if StoreFile only has keys < than passed key

2007-06-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-1479: -- Attachment: hstore_npe.patch Handle null return from MapFile.Reader#getClosest in HStore#get. > NPE in HStore

[jira] Created: (HADOOP-1480) pipes should be able to set user counters

2007-06-08 Thread Owen O'Malley (JIRA)
pipes should be able to set user counters - Key: HADOOP-1480 URL: https://issues.apache.org/jira/browse/HADOOP-1480 Project: Hadoop Issue Type: New Feature Components: pipes Affects Versi

[jira] Updated: (HADOOP-1474) Submittable interface, for the ability to execute and monitor jobs from a java class

2007-06-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1474: -- Description: Hi, We wish to add the following interface: interface Submittable{ Ru

[jira] Created: (HADOOP-1479) NPE in HStore#get if StoreFile only has keys < than passed key

2007-06-08 Thread stack (JIRA)
NPE in HStore#get if StoreFile only has keys < than passed key -- Key: HADOOP-1479 URL: https://issues.apache.org/jira/browse/HADOOP-1479 Project: Hadoop Issue Type: Bug C

[jira] Commented: (HADOOP-1478) The blockStream of DFSClient.FSInputStream should not be buffered

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502953 ] Raghu Angadi commented on HADOOP-1478: -- This will be handled in HADOOP-1134. We could mark it as 'sub' issue.

[jira] Commented: (HADOOP-1478) The blockStream of DFSClient.FSInputStream should not be buffered

2007-06-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502949 ] Hairong Kuang commented on HADOOP-1478: --- We should also remove buffering in DFSClient.FSOutputStream for the s

[jira] Created: (HADOOP-1478) The blockStream of DFSClient.FSInputStream should not be buffered

2007-06-08 Thread Hairong Kuang (JIRA)
The blockStream of DFSClient.FSInputStream should not be buffered - Key: HADOOP-1478 URL: https://issues.apache.org/jira/browse/HADOOP-1478 Project: Hadoop Issue Type: Improveme

[jira] Commented: (HADOOP-1459) FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502937 ] Raghu Angadi commented on HADOOP-1459: -- This perticular issue was considered in HADOOP-985 : from https://issu

[jira] Commented: (HADOOP-1459) FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502934 ] Raghu Angadi commented on HADOOP-1459: -- > My proposition would be to return back to hostnames instead of ip add

[jira] Commented: (HADOOP-1459) FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502932 ] Raghu Angadi commented on HADOOP-1459: -- {quote} I think this is the right fix for the time being, although I'm

[jira] Commented: (HADOOP-1459) FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce

2007-06-08 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502930 ] Raghu Angadi commented on HADOOP-1459: -- Note that this increases serialization cost for any DatanodeInfo tranfe

[jira] Updated: (HADOOP-1459) FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce

2007-06-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1459: - Status: Patch Available (was: Open) The namenode now serializes the hostName as part of

[jira] Commented: (HADOOP-1459) FileSystem.getFileCacheHints returns IP addresses rather than hostnames, which breaks 'data-locality' in map-reduce

2007-06-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502917 ] Konstantin Shvachko commented on HADOOP-1459: - Could you please remove redundant import org.apache.hadoo

[jira] Updated: (HADOOP-1444) Block allocation method does not check pendingCreates for duplicate block ids

2007-06-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1444: - Attachment: (was: duplicateBlockId.patch) > Block allocation method does not check p

[jira] Updated: (HADOOP-1444) Block allocation method does not check pendingCreates for duplicate block ids

2007-06-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1444: - Attachment: duplicateBlockId2.patch Implemented all review comments except the one relat

[jira] Updated: (HADOOP-1444) Block allocation method does not check pendingCreates for duplicate block ids

2007-06-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1444: - Status: Patch Available (was: Open) > Block allocation method does not check pendingCre

[jira] Updated: (HADOOP-1476) Distributed version of 'Performance Evaluation' script

2007-06-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-1476: -- Component/s: contrib/hbase > Distributed version of 'Performance Evaluation' script >

[jira] Assigned: (HADOOP-1476) Distributed version of 'Performance Evaluation' script

2007-06-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reassigned HADOOP-1476: - Assignee: stack > Distributed version of 'Performance Evaluation' script > -

[jira] Commented: (HADOOP-1438) Grammatical / wording / copy edits for Hadoop Distributed File System: Architecture and Design white paper

2007-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502902 ] Hadoop QA commented on HADOOP-1438: --- -1, could not apply patch. The patch command could not apply the latest atta

Hudson build is back to normal: Hadoop-Nightly #115

2007-06-08 Thread hudson
See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/115/changes

[jira] Updated: (HADOOP-1469) Asynchronous table creation

2007-06-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-1469: -- Status: Patch Available (was: In Progress) > Asynchronous table creation > --- > >

[jira] Updated: (HADOOP-1469) Asynchronous table creation

2007-06-08 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HADOOP-1469: -- Status: In Progress (was: Patch Available) Playing w/ Hudson. Seeing if resubmit of this patch gets noticed

[jira] Commented: (HADOOP-372) should allow to specify different inputformat classes for different input dirs for Map/Reduce jobs

2007-06-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502890 ] Runping Qi commented on HADOOP-372: --- This looks good to me. Should we also have a method to set the default mappe

[jira] Commented: (HADOOP-1465) Add cluster stop/start scripts for hbase

2007-06-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502888 ] Hadoop QA commented on HADOOP-1465: --- -1, build or testing failed 2 attempts failed to build and test the latest a

[jira] Issue Comment Edited: (HADOOP-372) should allow to specify different inputformat classes for different input dirs for Map/Reduce jobs

2007-06-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502881 ] Owen O'Malley edited comment on HADOOP-372 at 6/8/07 10:06 AM: --- Ok, my current thoughts

[jira] Commented: (HADOOP-372) should allow to specify different inputformat classes for different input dirs for Map/Reduce jobs

2007-06-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502881 ] Owen O'Malley commented on HADOOP-372: -- Ok, my current thoughts are as follows: interface JobInput { void val

Re: Hudson not running submitted patches?

2007-06-08 Thread Michael Stack
Any luck w/ the below? Just wondering. Thanks, St.Ack Nigel Daley wrote: There have been a couple of problems: 1) Hudson subversion client suddenly stopped being able to checkout changes from Apache. Not sure why. But upgrading Hudson seems to have fixed it. 2) The last couple of builds

[jira] Commented: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502864 ] Doug Cutting commented on HADOOP-1432: -- The obvious question: how much faster is it? > Use Grizzly for Fetchin

[jira] Work started: (HADOOP-372) should allow to specify different inputformat classes for different input dirs for Map/Reduce jobs

2007-06-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-372 started by Owen O'Malley. > should allow to specify different inputformat classes for different input > dirs for Map/Reduce jobs > ---

[jira] Updated: (HADOOP-1462) Better progress reporting from a Task

2007-06-08 Thread Vivek Ratan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratan updated HADOOP-1462: Attachment: 1462.patch Patch file. > Better progress reporting from a Task >

[jira] Updated: (HADOOP-1462) Better progress reporting from a Task

2007-06-08 Thread Vivek Ratan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratan updated HADOOP-1462: Status: Patch Available (was: Open) This patch takes care of the problems listed in this issue:

[jira] Assigned: (HADOOP-1201) Progress reporting can be improved for both Map/Reduce tasks

2007-06-08 Thread Vivek Ratan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratan reassigned HADOOP-1201: --- Assignee: Vivek Ratan > Progress reporting can be improved for both Map/Reduce tasks > -

[jira] Assigned: (HADOOP-1462) Better progress reporting from a Task

2007-06-08 Thread Vivek Ratan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratan reassigned HADOOP-1462: --- Assignee: Vivek Ratan > Better progress reporting from a Task >

[jira] Commented: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502742 ] Tahir Hashmi commented on HADOOP-1432: -- News here. Thanks to pushing, shoving and helping from Devaraj, I've go

[jira] Updated: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1432: - Attachment: grizzly.tgz > Use Grizzly for Fetching Map Output in Shuffle > -

[jira] Updated: (HADOOP-1432) Use Grizzly for Fetching Map Output in Shuffle

2007-06-08 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1432: - Attachment: 1432.patch > Use Grizzly for Fetching Map Output in Shuffle > --