[jira] Updated: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-1443: Status: Patch Available (was: Open) > TestFileCorruption fails with ArrayIndexOut

[jira] Commented: (HADOOP-1139) All block trasitions should be logged at log level INFO

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500921 ] Hadoop QA commented on HADOOP-1139: --- +1 http://issues.apache.org/jira/secure/attachment/12358728/blockTransitionL

[jira] Updated: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-1443: Attachment: EmptyFile.patch The bug is related to a corner case. An empty file in

[jira] Commented: (HADOOP-1300) deletion of excess replicas does not take into account 'rack-locality'

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500919 ] dhruba borthakur commented on HADOOP-1300: -- The goal while deleting excess replicas should be to maximize t

[jira] Assigned: (HADOOP-1331) Multiple entries for 'dfs.client.buffer.dir'

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur reassigned HADOOP-1331: Assignee: dhruba borthakur > Multiple entries for 'dfs.client.buffer.dir' > --

[jira] Assigned: (HADOOP-1372) DFS Clients should start using the org.apache.hadoop.fs.LocalDirAllocator

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur reassigned HADOOP-1372: Assignee: dhruba borthakur > DFS Clients should start using the org.apache.hadoop.

[jira] Assigned: (HADOOP-1444) Block allocation method does not check pendingCreates for duplicate block ids

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur reassigned HADOOP-1444: Assignee: dhruba borthakur > Block allocation method does not check pendingCreates

[jira] Updated: (HADOOP-1372) DFS Clients should start using the org.apache.hadoop.fs.LocalDirAllocator

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1372: - Attachment: localDirAllocator.patch DFSClient now uses LocalDirAllocator. > DFS Clients

[jira] Updated: (HADOOP-1456) TestDecommission fails with assertion Number of replicas for block1 expected:<3> but was:<2>

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1456: - Attachment: testDecommission1456.patch Set dfs.replciation.considerLoad to be false for

[jira] Created: (HADOOP-1456) TestDecommission fails with assertion Number of replicas for block1 expected:<3> but was:<2>

2007-06-01 Thread dhruba borthakur (JIRA)
TestDecommission fails with assertion Number of replicas for block1 expected:<3> but was:<2> - Key: HADOOP-1456 URL: https://issues.apache.org/jira/browse/HADOOP-1456

RE: [jira] Commented: (HADOOP-1396) FileNotFound exception on DFS block

2007-06-01 Thread Dhruba Borthakur
This bug is *not* a regression. I vote for not including it into 0.13. Thanks, dhruba -Original Message- From: Nigel Daley [mailto:[EMAIL PROTECTED] Sent: Friday, June 01, 2007 1:11 PM To: hadoop-dev@lucene.apache.org Subject: Re: [jira] Commented: (HADOOP-1396) FileNotFound exception on

[jira] Commented: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500914 ] Hadoop QA commented on HADOOP-1446: --- +1 http://issues.apache.org/jira/secure/attachment/12358746/1446.patch appli

[jira] Updated: (HADOOP-1139) All block trasitions should be logged at log level INFO

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1139: - Status: Patch Available (was: Open) > All block trasitions should be logged at log leve

[jira] Updated: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1446: Status: Open (was: Patch Available) > Metrics from the TaskTracker are updated only when map/redu

[jira] Updated: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1446: Status: Patch Available (was: Open) > Metrics from the TaskTracker are updated only when map/redu

[jira] Updated: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1446: Attachment: 1446.patch Attached is a patch with David's comments incorporated. Also, fixed two un

[jira] Commented: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

2007-06-01 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500906 ] Runping Qi commented on HADOOP-1455: Streaming has this feature. This may be a good time to examine the commonal

[jira] Resolved: (HADOOP-1454) Reducer doesn't track failed fetches and gets stuck

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HADOOP-1454. - Resolution: Duplicate Duplicate of HADOOP-1158 > Reducer doesn't track failed fetches and gets

[jira] Created: (HADOOP-1455) Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf

2007-06-01 Thread Christian Kunz (JIRA)
Allow any key-value pair on the command line of 'hadoop pipes' to be added to the JobConf - Key: HADOOP-1455 URL: https://issues.apache.org/jira/browse/HADOOP-1455

[jira] Updated: (HADOOP-1454) Reducer doesn't track failed fetches and gets stuck

2007-06-01 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kunz updated HADOOP-1454: --- Fix Version/s: (was: 0.13.0) Affects Version/s: 0.13.0 > Reducer doesn't track f

[jira] Updated: (HADOOP-1454) Reducer doesn't track failed fetches and gets stuck

2007-06-01 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kunz updated HADOOP-1454: --- Component/s: mapred Fix Version/s: 0.13.0 > Reducer doesn't track failed fetches and g

[jira] Created: (HADOOP-1454) Reducer doesn't track failed fetches and gets stuck

2007-06-01 Thread Christian Kunz (JIRA)
Reducer doesn't track failed fetches and gets stuck --- Key: HADOOP-1454 URL: https://issues.apache.org/jira/browse/HADOOP-1454 Project: Hadoop Issue Type: Improvement Reporter: Chr

[jira] Commented: (HADOOP-1139) All block trasitions should be logged at log level INFO

2007-06-01 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500890 ] Hairong Kuang commented on HADOOP-1139: --- +1 Code looks good. > All block trasitions should be logged at log l

[jira] Created: (HADOOP-1453) exists() not necessary before DFS.open

2007-06-01 Thread Raghu Angadi (JIRA)
exists() not necessary before DFS.open -- Key: HADOOP-1453 URL: https://issues.apache.org/jira/browse/HADOOP-1453 Project: Hadoop Issue Type: Bug Components: dfs Reporter: Raghu Angad

[jira] Commented: (HADOOP-1396) FileNotFound exception on DFS block

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500884 ] Hadoop QA commented on HADOOP-1396: --- +1 http://issues.apache.org/jira/secure/attachment/12358649/tempBakcupFile.p

[jira] Commented: (HADOOP-1452) map output transfers of more than 2^31 bytes output are failing

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500876 ] Hadoop QA commented on HADOOP-1452: --- -1, could not apply patch. The patch command could not apply the latest atta

[jira] Commented: (HADOOP-1396) FileNotFound exception on DFS block

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500874 ] Hadoop QA commented on HADOOP-1396: --- -1, build or testing failed 2 attempts failed to build and test the latest a

[jira] Commented: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread David Bowen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500873 ] David Bowen commented on HADOOP-1446: - The TaskTracker fields mapTotal and reduceTotal now need to be declared

[jira] Updated: (HADOOP-1452) map output transfers of more than 2^31 bytes output are failing

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1452: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1452) map output transfers of more than 2^31 bytes output are failing

2007-06-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1452: -- Status: Patch Available (was: Open) > map output transfers of more than 2^31 bytes output are

[jira] Commented: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500860 ] Hadoop QA commented on HADOOP-1431: --- -1, could not apply patch. The patch command could not apply the latest atta

[jira] Updated: (HADOOP-1452) map output transfers of more than 2^31 bytes output are failing

2007-06-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1452: -- Attachment: 1452.patch This changes TaskTracker.MapOutputServlet.doGet.totalRead to a long. >

[jira] Updated: (HADOOP-1018) Single lost heartbeat leads to a "Lost task tracker"

2007-06-01 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Paranjpye updated HADOOP-1018: - Component/s: mapred > Single lost heartbeat leads to a "Lost task tracker" > ---

[jira] Updated: (HADOOP-1373) checkPath() throws IllegalArgumentException

2007-06-01 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Paranjpye updated HADOOP-1373: - Component/s: fs > checkPath() throws IllegalArgumentException >

[jira] Updated: (HADOOP-1196) StreamXmlRecordReader throws java.io.IOException: Resetting to invalid mark

2007-06-01 Thread Sameer Paranjpye (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Paranjpye updated HADOOP-1196: - Component/s: contrib/streaming Priority: Major (was: Blocker) > StreamXmlRecordR

[jira] Commented: (HADOOP-1449) Example for contrib/data_join

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500854 ] Hadoop QA commented on HADOOP-1449: --- +1 http://issues.apache.org/jira/secure/attachment/12358737/data_join_exampl

[jira] Updated: (HADOOP-1396) FileNotFound exception on DFS block

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1396: - Status: Patch Available (was: Open) > FileNotFound exception on DFS block > ---

[jira] Updated: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1431: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Updated: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-1443: Fix Version/s: 0.13.0 > TestFileCorruption fails with ArrayIndexOutOfBoundsException > ---

[jira] Assigned: (HADOOP-1442) Zero-byte input files are not included in InputSplit

2007-06-01 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar reassigned HADOOP-1442: - Assignee: Milind Bhandarkar > Zero-byte input files are not included in InputSpl

[jira] Assigned: (HADOOP-1441) Splittability of input should be controllable by application

2007-06-01 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar reassigned HADOOP-1441: - Assignee: Milind Bhandarkar > Splittability of input should be controllable by a

[jira] Assigned: (HADOOP-1440) JobClient should not sort input-splits

2007-06-01 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar reassigned HADOOP-1440: - Assignee: Milind Bhandarkar > JobClient should not sort input-splits > -

[jira] Commented: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500843 ] Konstantin Shvachko commented on HADOOP-1443: - This does not work if you getBlockLocation for the offset

[jira] Updated: (HADOOP-1452) map output transfers of more than 2^31 bytes output are failing

2007-06-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1452: -- Fix Version/s: 0.13.0 Assignee: Owen O'Malley Priority: Blocker (was: Major)

[jira] Updated: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1431: Status: Patch Available (was: Open) Did the Open->PA to have the patch run under the automated bu

[jira] Updated: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1431: Attachment: 1431.patch Submitting a patch on behalf of Arun (who is right now watching Pirates of

[jira] Updated: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1431: Status: Open (was: Patch Available) > Map tasks can't timeout for failing to call progress >

[jira] Commented: (HADOOP-1440) JobClient should not sort input-splits

2007-06-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500839 ] Owen O'Malley commented on HADOOP-1440: --- I'm ok with moving the sort into FileInputFormat, but I'd like to kee

[jira] Updated: (HADOOP-1449) Example for contrib/data_join

2007-06-01 Thread Senthil Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Senthil Subramanian updated HADOOP-1449: Status: Patch Available (was: Open) > Example for contrib/data_join > ---

[jira] Updated: (HADOOP-1449) Example for contrib/data_join

2007-06-01 Thread Senthil Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Senthil Subramanian updated HADOOP-1449: Attachment: data_join_example.patch > Example for contrib/data_join >

RE: [jira] Commented: (HADOOP-1396) FileNotFound exception on DFS block

2007-06-01 Thread Devaraj Das
I don't think it is that critical though. -Original Message- From: Nigel Daley [mailto:[EMAIL PROTECTED] Sent: Saturday, June 02, 2007 1:41 AM To: hadoop-dev@lucene.apache.org Subject: Re: [jira] Commented: (HADOOP-1396) FileNotFound exception on DFS block Should this go into 0.13? On

[jira] Commented: (HADOOP-1440) JobClient should not sort input-splits

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500835 ] Doug Cutting commented on HADOOP-1440: -- I'd vote for moving the sort into FileInputFormat, moving InputSplit#g

[jira] Created: (HADOOP-1452) map output transfers of more than 2^31 bytes output are failing

2007-06-01 Thread Christian Kunz (JIRA)
map output transfers of more than 2^31 bytes output are failing --- Key: HADOOP-1452 URL: https://issues.apache.org/jira/browse/HADOOP-1452 Project: Hadoop Issue Type: Bug

[jira] Commented: (HADOOP-1440) JobClient should not sort input-splits

2007-06-01 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500833 ] Runping Qi commented on HADOOP-1440: Clearly, it makes sense to use map.input.file only if the input split is a

Re: [jira] Commented: (HADOOP-1396) FileNotFound exception on DFS block

2007-06-01 Thread Nigel Daley
Should this go into 0.13? On Jun 1, 2007, at 12:23 PM, Devaraj Das (JIRA) wrote: [ https://issues.apache.org/jira/browse/HADOOP-1396? page=com.atlassian.jira.plugin.system.issuetabpanels:comment- tabpanel#action_12500816 ] Devaraj Das commented on HADOOP-1396: -

[jira] Commented: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500830 ] Hadoop QA commented on HADOOP-1446: --- +0, new Findbugs warnings http://issues.apache.org/jira/secure/attachment/12

[jira] Updated: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1446: Status: Patch Available (was: Reopened) > Metrics from the TaskTracker are updated only when map/

[jira] Updated: (HADOOP-1446) Metrics from the TaskTracker are updated only when map/reduce tasks start/end/fail

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1446: Attachment: 1446.patch Attached is a patch that makes TaskTrackerMetrics implement the Updater in

[jira] Commented: (HADOOP-1396) FileNotFound exception on DFS block

2007-06-01 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500816 ] Devaraj Das commented on HADOOP-1396: - +1 > FileNotFound exception on DFS block > -

[jira] Updated: (HADOOP-1139) All block trasitions should be logged at log level INFO

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1139: - Attachment: (was: blockTransitionLog2.patch) > All block trasitions should be logged

[jira] Commented: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500810 ] Doug Cutting commented on HADOOP-1443: -- It'd be nice to have the test case included in this issue, so we can ve

[jira] Updated: (HADOOP-1139) All block trasitions should be logged at log level INFO

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1139: - Attachment: blockTransitionLog3.patch This removes all calls to LOG.infoEnabled() except

[jira] Updated: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1443: - Attachment: 1443.patch This looks like a bug that occurs when a zero-length file is read

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500803 ] Doug Cutting commented on HADOOP-1134: -- bq. Btw, these are not really packets in any sense. These are streams w

[jira] Commented: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500801 ] Owen O'Malley commented on HADOOP-1431: --- +1 > Map tasks can't timeout for failing to call progress >

[jira] Commented: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500800 ] Doug Cutting commented on HADOOP-1431: -- So, to be conservative, let's get rid of the join and just go with inte

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-06-01 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500795 ] Raghu Angadi commented on HADOOP-1134: -- bq. It's a minor point, but if we write async-io daemons for this prot

[jira] Commented: (HADOOP-1447) Support for textInputFormat in contrib/data_join

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500793 ] Hadoop QA commented on HADOOP-1447: --- +1 http://issues.apache.org/jira/secure/attachment/12358673/data_join.patch

[jira] Assigned: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reassigned HADOOP-1443: --- Assignee: Konstantin Shvachko > TestFileCorruption fails with ArrayIndexOutO

[jira] Updated: (HADOOP-1443) TestFileCorruption fails with ArrayIndexOutOfBoundsException

2007-06-01 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1443: - Priority: Blocker (was: Major) I am marking this as a blocker for 0.13 release. Invest

[jira] Commented: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500790 ] Owen O'Malley commented on HADOOP-1431: --- Interrupted is just like a standard running flag. The only problem wi

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-06-01 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500783 ] Raghu Angadi commented on HADOOP-1134: -- >> only notable code replication I see is retry logic in >> FSInputCh

[jira] Commented: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500778 ] Raghu Angadi commented on HADOOP-1431: -- Doug's comment that was posted to HADOOP-1134 by mistake: {quote} Cal

[jira] Updated: (HADOOP-1447) Support for textInputFormat in contrib/data_join

2007-06-01 Thread Senthil Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Senthil Subramanian updated HADOOP-1447: Status: Patch Available (was: Open) > Support for textInputFormat in contrib/data

[jira] Commented: (HADOOP-573) Checksum error during sorting in reducer

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500771 ] Doug Cutting commented on HADOOP-573: - > I am running tests to see if we should invest in a cluster [ ... ] FYI,

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500763 ] Doug Cutting commented on HADOOP-1134: -- Calvin Yu noted on hadoop-user that join() seems to sometimes hang even

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-06-01 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500758 ] Doug Cutting commented on HADOOP-1134: -- > I am still not clear which length is missing. It's a minor point, bu

[jira] Commented: (HADOOP-1440) JobClient should not sort input-splits

2007-06-01 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500755 ] Owen O'Malley commented on HADOOP-1440: --- map.input.file is not always defined. In particular, it is only defin

Re: Adding new filesystem to Hadoop causing too many Map tasks

2007-06-01 Thread Owen O'Malley
On Jun 1, 2007, at 1:14 AM, Esteban Molina-Estolano wrote: I'm having trouble with a small test: RandomWriter, 4 TaskTracker nodes, 5 maps per node, 10 MB per map, for a total of 200 MB over 20 Map tasks. I tried it on Hadoop with DFS, and it took about 30 seconds. Then, I ran the same tes

[jira] Commented: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500733 ] Hadoop QA commented on HADOOP-1431: --- +1 http://issues.apache.org/jira/secure/attachment/12358717/HADOOP-1431_3_20

[jira] Updated: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1431: -- Status: Open (was: Patch Available) > Map tasks can't timeout for failing to call progress >

[jira] Updated: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1431: -- Status: Patch Available (was: Open) Re-submitting to the patch-testing system... > Map tasks

[jira] Updated: (HADOOP-1431) Map tasks can't timeout for failing to call progress

2007-06-01 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1431: -- Attachment: HADOOP-1431_3_20070601.patch Doug - point taken about the code complexity, patched

[jira] Commented: (HADOOP-1242) dfs upgrade/downgrade problems

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500680 ] Hadoop QA commented on HADOOP-1242: --- Integrated in Hadoop-Nightly #107 (See http://lucene.zones.apache.org:8080/h

[jira] Commented: (HADOOP-1332) Sporadic unit test failures (TestMiniMRClasspath, TestMiniMRLocalFS, TestMiniMRDFSCaching)

2007-06-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12500679 ] Hadoop QA commented on HADOOP-1332: --- Integrated in Hadoop-Nightly #107 (See http://lucene.zones.apache.org:8080/h

Build failed in Hudson: Hadoop-Nightly #107

2007-06-01 Thread hudson
See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/107/ Changes: [cutting] HADOOP-1242. Improve handling of DFS upgrades. Contributed by Konstantin. [cutting] HADOOP-1332. Fix so that TaskTracker exits reliably during unit tests on Windows. Contributed by Owen.

[jira] Issue Comment Edited: (HADOOP-1375) a simple parser for hbase.

2007-06-01 Thread udanax (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12498076 ] udanax edited comment on HADOOP-1375 at 6/1/07 2:00 AM: * package name change was: *pac

Adding new filesystem to Hadoop causing too many Map tasks

2007-06-01 Thread Esteban Molina-Estolano
I'm adding support in Hadoop for Ceph (http://ceph.sourceforge.net/), a distributed filesystem developed at UC Santa Cruz (http:// ssrc.cse.ucsc.edu/). Ceph runs entirely in userspace and is written in C++. My current implementation is a subclass of FileSystem that uses a bit of JNI glue to