[jira] Commented: (HADOOP-1176) Reduce hang on huge map output

2007-04-10 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488004 ] Devaraj Das commented on HADOOP-1176: - Apart from trying out things like the webserver in Java 1.6, jetty-6, one

[jira] Commented: (HADOOP-1238) maps_running metric is only updated at the end of the task

2007-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487987 ] Hadoop QA commented on HADOOP-1238: --- +1 http://issues.apache.org/jira/secure/attachment/12355270/fix-tasks-runnin

[jira] Updated: (HADOOP-1154) streaming hang. (PipeMapRed$MROutputThread gone)

2007-04-10 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HADOOP-1154: - Status: Patch Available (was: Open) > streaming hang. (PipeMapRed$MROutputThread gone) > --

[jira] Commented: (HADOOP-1155) Additional performance improvement to chooseTarget

2007-04-10 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487963 ] Raghu Angadi commented on HADOOP-1155: -- > 2. optimize sortedByDistance by taking Sameer's suggestion in HADOOP-

[jira] Created: (HADOOP-1245) value for mapred.tasktracker.tasks.maximum taken from two different sources

2007-04-10 Thread Michael Bieniosek (JIRA)
value for mapred.tasktracker.tasks.maximum taken from two different sources --- Key: HADOOP-1245 URL: https://issues.apache.org/jira/browse/HADOOP-1245 Project: Hadoop I

[jira] Assigned: (HADOOP-1225) Record IO class should provide a toString(String charset) method

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-1225: -- Assignee: David Bowen > Record IO class should provide a toString(String charset) method > ---

[jira] Updated: (HADOOP-1244) stop-dfs.sh incorrectly specifies slaves file for stopping datanode

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Bieniosek updated HADOOP-1244: -- Attachment: no-slaves-for-stop-dfs.patch > stop-dfs.sh incorrectly specifies slaves fi

[jira] Updated: (HADOOP-1244) stop-dfs.sh incorrectly specifies slaves file for stopping datanode

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Bieniosek updated HADOOP-1244: -- Affects Version/s: 0.12.3 Status: Patch Available (was: Open) > stop-d

[jira] Updated: (HADOOP-1199) want InputFormat for task logs

2007-04-10 Thread [EMAIL PROTECTED] (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] [EMAIL PROTECTED] updated HADOOP-1199: -- Attachment: hadoop1199-v2.patch Version 2. Keys, rather than LongWritable line number

[jira] Created: (HADOOP-1244) stop-dfs.sh incorrectly specifies slaves file for stopping datanode

2007-04-10 Thread Michael Bieniosek (JIRA)
stop-dfs.sh incorrectly specifies slaves file for stopping datanode --- Key: HADOOP-1244 URL: https://issues.apache.org/jira/browse/HADOOP-1244 Project: Hadoop Issue Type: Bug

[jira] Updated: (HADOOP-1155) Additional performance improvement to chooseTarget

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1155: -- Attachment: rackMap2.patch This patch makes 4 changes: 1. add a rackname to its rack node map

[jira] Created: (HADOOP-1243) ClientProtocol.versionID should be 11

2007-04-10 Thread Konstantin Shvachko (JIRA)
ClientProtocol.versionID should be 11 - Key: HADOOP-1243 URL: https://issues.apache.org/jira/browse/HADOOP-1243 Project: Hadoop Issue Type: Bug Affects Versions: 0.13.0 Reporter: Konstantin

[jira] Commented: (HADOOP-1241) Null PointerException in processReport when namenode is restarted

2007-04-10 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487953 ] Raghu Angadi commented on HADOOP-1241: -- > If this exception actually fires, doesn't the datanode get into loop

[jira] Commented: (HADOOP-1241) Null PointerException in processReport when namenode is restarted

2007-04-10 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487949 ] Raghu Angadi commented on HADOOP-1241: -- Change looks fine. If this exception actually fires, doesn't the datan

[jira] Updated: (HADOOP-1241) Null PointerException in processReport when namenode is restarted

2007-04-10 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1241: - Attachment: unregisteredNodeException.patch Check that the node is registered before pro

[jira] Commented: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

2007-04-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487942 ] Konstantin Shvachko commented on HADOOP-1093: - +1 It looks good to me. > NNBench generates millions o

[jira] Commented: (HADOOP-1232) Datanode did not get removed from blockMap when a datanode was down

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487941 ] Hairong Kuang commented on HADOOP-1232: --- The datanode persistently stayed in the blockmap after it got shuted

[jira] Updated: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

2007-04-10 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1093: - Attachment: nyr4.patch A change in a comment as pointed out by Konstantin. > NNBench ge

[jira] Updated: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

2007-04-10 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1093: - Attachment: (was: nyr4.patch) > NNBench generates millions of NotReplicatedYetExcept

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487930 ] Doug Cutting commented on HADOOP-1114: -- > I accept that using CLASSPATH for dependencies is fragile and hacky,

[jira] Commented: (HADOOP-819) LineRecordWriter should not always insert tab char between key and value

2007-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487929 ] Owen O'Malley commented on HADOOP-819: -- +1 > LineRecordWriter should not always insert tab char between key and

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487926 ] Michael Bieniosek commented on HADOOP-1114: --- While I accept that using CLASSPATH for dependencies is fragi

[jira] Updated: (HADOOP-1176) Reduce hang on huge map output

2007-04-10 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1176: -- Attachment: jetty-exception.log Uh oh, looks like a blocker from Jetty which can't seem to han

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487921 ] Doug Cutting commented on HADOOP-1114: -- > Currently our hadoop jars also depend on non-java code which can't be

[jira] Created: (HADOOP-1242) dfs upgrade/downgrade problems

2007-04-10 Thread Owen O'Malley (JIRA)
dfs upgrade/downgrade problems -- Key: HADOOP-1242 URL: https://issues.apache.org/jira/browse/HADOOP-1242 Project: Hadoop Issue Type: Bug Components: dfs Affects Versions: 0.13.0 Reporter

RE: [jira] Created: (HADOOP-1215) Streaming should allow to specify a partitioner

2007-04-10 Thread Runping Qi
Hi Arkady, With my changes that should be available soon, the user can specify the followings: 1. Mapper (a java mapper class or an executable) 2. Reducer (a Java reducer class or an executable). Reduce NONE will be introduced as per HADOOP-1216. 3. Inputformat class 4. OutputFormat class 5. Par

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487917 ] Michael Bieniosek commented on HADOOP-1114: --- We have a separate mechanism to distribute generic software;

Re: Dynamic addition and removal of Hadoop nodes

2007-04-10 Thread Doug Cutting
Timothy Chklovski wrote: We are interested in whether other users have developed approaches to get machines to join (and leave) both the DFS and Tasktracker pools. It does not seem very complicated, but we are wondering if the brute-force approach ignores some arcana about such issues as, eg, wh

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487907 ] Doug Cutting commented on HADOOP-1114: -- > We could package all the dependent code into the same jar, but that s

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1118: -- Attachment: NPEReportChecksum.patch This is an updated patch for us to pinpoint the problem.

[jira] Updated: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1118: -- Attachment: (was: NPEReportChecksum.patch) > NullPointerException in > DistributedFileSys

Re: [jira] Created: (HADOOP-1215) Streaming should allow to specify a partitioner

2007-04-10 Thread Arkady Borkovsky
To extend this, I'd suggest that Hadoop Streaming is interfaced in the following way: Map reduce process is parameterized by several algorithms. This includes at least 1. mapper 2. reducer (including special case of NONE) 3. input format 4. input partitioner 5. splitter for reduce 6. sorter for

[jira] Commented: (HADOOP-971) DFS Scalabilty: Improve name node performance by adding a hostname to datanodes map

2007-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487903 ] Hadoop QA commented on HADOOP-971: -- +1 http://issues.apache.org/jira/secure/attachment/12355263/host2Datanode.patch

[jira] Created: (HADOOP-1241) Null PointerException in processReport when namenode is restarted

2007-04-10 Thread dhruba borthakur (JIRA)
Null PointerException in processReport when namenode is restarted - Key: HADOOP-1241 URL: https://issues.apache.org/jira/browse/HADOOP-1241 Project: Hadoop Issue Type: Bug

[jira] Commented: (HADOOP-819) LineRecordWriter should not always insert tab char between key and value

2007-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487898 ] Hadoop QA commented on HADOOP-819: -- +1 http://issues.apache.org/jira/secure/attachment/12355260/patch-819.txt appli

[jira] Updated: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

2007-04-10 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1093: - Status: Patch Available (was: Open) > NNBench generates millions of NotReplicatedYetExc

[jira] Created: (HADOOP-1240) JUnit tests should not create directories in the current directory

2007-04-10 Thread Hairong Kuang (JIRA)
JUnit tests should not create directories in the current directory -- Key: HADOOP-1240 URL: https://issues.apache.org/jira/browse/HADOOP-1240 Project: Hadoop Issue Type: Bug

[jira] Updated: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

2007-04-10 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1093: - Attachment: (was: nyr3.patch) > NNBench generates millions of NotReplicatedYetExcept

[jira] Updated: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

2007-04-10 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1093: - Attachment: nyr4.patch Incorporated Konstantin's code review comments. > NNBench genera

[jira] Commented: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

2007-04-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487879 ] Konstantin Shvachko commented on HADOOP-1093: - It needs minor comment correction // we writing to local

[jira] Updated: (HADOOP-1238) maps_running metric is only updated at the end of the task

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Bieniosek updated HADOOP-1238: -- Status: Patch Available (was: Open) Adding a patch that sprinkles more metrics update

[jira] Updated: (HADOOP-1238) maps_running metric is only updated at the end of the task

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Bieniosek updated HADOOP-1238: -- Attachment: fix-tasks-running-metric.patch > maps_running metric is only updated at th

[jira] Updated: (HADOOP-1204) Re-factor InputFormat/RecordReader related classes

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-1204: --- Status: Patch Available (was: Open) a new patch fixing some comments and spurious spaces > Re-fa

[jira] Updated: (HADOOP-1239) Classes in src/test/testjar need package name

2007-04-10 Thread Jim Kellerman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Kellerman updated HADOOP-1239: -- Attachment: patch.txt Patch that assigns the package name 'testjar' to the three class files.

[jira] Updated: (HADOOP-1239) Classes in src/test/testjar need package name

2007-04-10 Thread Jim Kellerman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Kellerman updated HADOOP-1239: -- Status: Patch Available (was: In Progress) > Classes in src/test/testjar need package name >

[jira] Updated: (HADOOP-1204) Re-factor InputFormat/RecordReader related classes

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-1204: --- Attachment: patch-1204.txt one more spurious space fixed > Re-factor InputFormat/RecordReader relat

[jira] Updated: (HADOOP-1204) Re-factor InputFormat/RecordReader related classes

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-1204: --- Attachment: (was: patch-1204.txt) > Re-factor InputFormat/RecordReader related classes > ---

[jira] Work started: (HADOOP-1239) Classes in src/test/testjar need package name

2007-04-10 Thread Jim Kellerman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-1239 started by Jim Kellerman. > Classes in src/test/testjar need package name > - > > Key: HA

[jira] Created: (HADOOP-1239) Classes in src/test/testjar need package name

2007-04-10 Thread Jim Kellerman (JIRA)
Classes in src/test/testjar need package name - Key: HADOOP-1239 URL: https://issues.apache.org/jira/browse/HADOOP-1239 Project: Hadoop Issue Type: Bug Components: test Report

[jira] Updated: (HADOOP-1136) exception in UnderReplicatedBlocks:add when ther are more replicas of a block than required

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1136: -- Attachment: neededReplicationAdd1.patch Resubmit the patch. > exception in UnderReplicatedBlo

[jira] Updated: (HADOOP-1136) exception in UnderReplicatedBlocks:add when ther are more replicas of a block than required

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-1136: -- Status: Patch Available (was: Open) > exception in UnderReplicatedBlocks:add when ther are mo

[jira] Updated: (HADOOP-1204) Re-factor InputFormat/RecordReader related classes

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-1204: --- Attachment: patch-1204.txt a new patch fixing a few places in comments and extra spaces > Re-fact

[jira] Updated: (HADOOP-1238) maps_running metric is only updated at the end of the task

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Bieniosek updated HADOOP-1238: -- Priority: Minor (was: Major) > maps_running metric is only updated at the end of the

[jira] Updated: (HADOOP-1204) Re-factor InputFormat/RecordReader related classes

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-1204: --- Status: Open (was: Patch Available) > Re-factor InputFormat/RecordReader related classes >

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

2007-04-10 Thread Jim Kellerman (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487859 ] Jim Kellerman commented on HADOOP-1198: --- Thank you for this patch! I have a MacBook Pro that dual boots Mac O

[jira] Updated: (HADOOP-1204) Re-factor InputFormat/RecordReader related classes

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-1204: --- Attachment: (was: patch-1204.txt) > Re-factor InputFormat/RecordReader related classes > ---

[jira] Created: (HADOOP-1238) maps_running metric is only updated at the end of the task

2007-04-10 Thread Michael Bieniosek (JIRA)
maps_running metric is only updated at the end of the task -- Key: HADOOP-1238 URL: https://issues.apache.org/jira/browse/HADOOP-1238 Project: Hadoop Issue Type: Bug Component

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487857 ] Michael Bieniosek commented on HADOOP-1114: --- Currently, the hadoop runjar commands takes a single user jar

[jira] Updated: (HADOOP-971) DFS Scalabilty: Improve name node performance by adding a hostname to datanodes map

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-971: - Status: Patch Available (was: Open) > DFS Scalabilty: Improve name node performance by adding a

[jira] Updated: (HADOOP-971) DFS Scalabilty: Improve name node performance by adding a hostname to datanodes map

2007-04-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-971: - Attachment: host2Datanode.patch Regenerate the patch from the latest trunk. > DFS Scalabilty: Im

[jira] Commented: (HADOOP-1236) hadoop dfs -rmr dir should ask the user to confirm before deleting the dir

2007-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487852 ] Owen O'Malley commented on HADOOP-1236: --- -1 This is what the trashcan in fs shell was designed for. > hadoop

[jira] Resolved: (HADOOP-338) the number of maps in the JobConf does not match reality

2007-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-338. -- Resolution: Fixed Fix Version/s: 0.12.0 This was fixed by HADOOP-933. > the number of m

[jira] Updated: (HADOOP-819) LineRecordWriter should not always insert tab char between key and value

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-819: -- Status: Patch Available (was: Open) A new patch with updated unit test > LineRecordWriter should not

[jira] Commented: (HADOOP-1216) Hadoop should support reduce none option

2007-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487830 ] Owen O'Malley commented on HADOOP-1216: --- I think this would be best represented as specifying JobConf.setNum

[jira] Updated: (HADOOP-819) LineRecordWriter should not always insert tab char between key and value

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-819: -- Attachment: patch-819.txt A new patch with updated unit tests > LineRecordWriter should not always in

[jira] Updated: (HADOOP-819) LineRecordWriter should not always insert tab char between key and value

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-819: -- Attachment: (was: patch-819.txt) > LineRecordWriter should not always insert tab char between key a

[jira] Updated: (HADOOP-819) LineRecordWriter should not always insert tab char between key and value

2007-04-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-819: -- Status: Open (was: Patch Available) re-load a new patch > LineRecordWriter should not always insert t

[jira] Commented: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487828 ] Owen O'Malley commented on HADOOP-1001: --- +1 > the output of the map is not type checked against the specified

[jira] Commented: (HADOOP-1204) Re-factor InputFormat/RecordReader related classes

2007-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487834 ] Owen O'Malley commented on HADOOP-1204: --- This looks good, except you have some spurious whitespace differences

is release 0.12.3 stable?

2007-04-10 Thread Doug Cutting
Should we move the 'stable' link in the distribution directory to point at 0.12.3? Have folks yet used this release with good results? http://www.apache.org/dyn/closer.cgi/lucene/hadoop/ I believe it should be considerably more stable than 0.11.2, which is currently declared stable... Doug

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487817 ] Doug Cutting commented on HADOOP-1114: -- Sorry. I'm coming to this rather late. But, for what it's worth, the

[jira] Commented: (HADOOP-1235) Progress-report RPC clients should wait for the RPC to complete before sending another progress report

2007-04-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487810 ] Doug Cutting commented on HADOOP-1235: -- > then we can probably do away with pings from Tasks to the TaskTracker

[jira] Created: (HADOOP-1237) need more unit tests for Hadoop streaming

2007-04-10 Thread Runping Qi (JIRA)
need more unit tests for Hadoop streaming - Key: HADOOP-1237 URL: https://issues.apache.org/jira/browse/HADOOP-1237 Project: Hadoop Issue Type: Improvement Components: contrib/streaming

[jira] Created: (HADOOP-1236) hadoop dfs -rmr dir should ask the user to confirm before deleting the dir

2007-04-10 Thread Runping Qi (JIRA)
hadoop dfs -rmr dir should ask the user to confirm before deleting the dir -- Key: HADOOP-1236 URL: https://issues.apache.org/jira/browse/HADOOP-1236 Project: Hadoop Iss

[jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

2007-04-10 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1198: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. Thanks Ar

[jira] Commented: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487754 ] Hadoop QA commented on HADOOP-1001: --- +1 http://issues.apache.org/jira/secure/attachment/12355240/final.1001.patch

[jira] Commented: (HADOOP-1219) Spurious progress messages should be discarded after a task is done

2007-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487751 ] Hadoop QA commented on HADOOP-1219: --- Integrated in Hadoop-Nightly #53 (See http://lucene.zones.apache.org:8080/hu

[jira] Commented: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487752 ] Hadoop QA commented on HADOOP-1114: --- Integrated in Hadoop-Nightly #53 (See http://lucene.zones.apache.org:8080/hu

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-04-10 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Status: Patch Available (was: Open) > the output of the map is not type checked against the spe

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-04-10 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: final.1001.patch Unified patch for 1001 > the output of the map is not type checked

[jira] Updated: (HADOOP-1235) Progress-report RPC clients should wait for the RPC to complete before sending another progress report

2007-04-10 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1235: Description: The Progress-report IPC clients don't wait for an invoked IPC to complete before send

Re: Java 1.5?

2007-04-10 Thread Tom White
The change to use contexts looks good. Do you think it makes sense to genericize prior to conversion to contexts? Since the two changes are orthogonal I don't think it matters which order they are done in. From the user's point of view, we should make both changes in the same release so users

[jira] Updated: (HADOOP-1114) bin/hadoop script clobbers CLASSPATH

2007-04-10 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1114: -- Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available) Yes

[jira] Updated: (HADOOP-1219) Spurious progress messages should be discarded after a task is done

2007-04-10 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1219: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. Thanks De

[jira] Updated: (HADOOP-1111) Job completion notification to a job configured URL

2007-04-10 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HADOOP-: --- Fix Version/s: 0.13.0 > Job completion notification to a job configured URL > --

[jira] Updated: (HADOOP-1111) Job completion notification to a job configured URL

2007-04-10 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HADOOP-: --- Attachment: patch-.txt Added testcases for job notification, both local and clus

[jira] Commented: (HADOOP-1219) Spurious progress messages should be discarded after a task is done

2007-04-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487702 ] Owen O'Malley commented on HADOOP-1219: --- +1 > Spurious progress messages should be discarded after a task is