[jira] Created: (HADOOP-2669) DFS client lost lease during writing into DFS files

2008-01-20 Thread Runping Qi (JIRA)
DFS client lost lease during writing into DFS files --- Key: HADOOP-2669 URL: https://issues.apache.org/jira/browse/HADOOP-2669 Project: Hadoop Issue Type: Bug Components: dfs

[jira] Commented: (HADOOP-2663) Buffer class' toString method should accept a code name for "true" utf-8 codeName

2008-01-18 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560637#action_12560637 ] Runping Qi commented on HADOOP-2663: On the flip side, the Buffer should provide a co

[jira] Created: (HADOOP-2663) Buffer class' toString method should accept a code name for "true" utf-8 codeName

2008-01-18 Thread Runping Qi (JIRA)
Buffer class' toString method should accept a code name for "true" utf-8 codeName -- Key: HADOOP-2663 URL: https://issues.apache.org/jira/browse/HADOOP-2663 Project: Had

[jira] Commented: (HADOOP-2608) Reading sequence file consumes 100% cpu with maximum throughput being about 5MB/sec per process

2008-01-16 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559815#action_12559815 ] Runping Qi commented on HADOOP-2608: Forgot one point: when scanning sequence files wi

[jira] Commented: (HADOOP-2608) Reading sequence file consumes 100% cpu with maximum throughput being about 5MB/sec per process

2008-01-16 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559812#action_12559812 ] Runping Qi commented on HADOOP-2608: I profiled the program of reading sequence files

[jira] Created: (HADOOP-2608) Reading sequence file consumes 100% cpu with maximum throughput being about 5MB/sec per process

2008-01-14 Thread Runping Qi (JIRA)
Reading sequence file consumes 100% cpu with maximum throughput being about 5MB/sec per process --- Key: HADOOP-2608 URL: https://issues.apache.org/jira/browse/HADOOP-2608

[jira] Commented: (HADOOP-2491) generalize the TT / JT servers to handle more generic tasks

2008-01-14 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558749#action_12558749 ] Runping Qi commented on HADOOP-2491: A great analysis. +2 Especially like the conce

[jira] Commented: (HADOOP-2581) Counters and other useful stats should be logged into Job History log

2008-01-11 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558147#action_12558147 ] Runping Qi commented on HADOOP-2581: Cool. That will address the first 2 items. Is

[jira] Created: (HADOOP-2581) Counters and other useful stats should be logged into Job History log

2008-01-11 Thread Runping Qi (JIRA)
Counters and other useful stats should be logged into Job History log - Key: HADOOP-2581 URL: https://issues.apache.org/jira/browse/HADOOP-2581 Project: Hadoop Issue Type: I

[jira] Commented: (HADOOP-2178) Job history on HDFS

2008-01-11 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558029#action_12558029 ] Runping Qi commented on HADOOP-2178: Even with hod JT, we still need to address case

[jira] Commented: (HADOOP-2570) streaming jobs fail after HADOOP-2227

2008-01-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557720#action_12557720 ] Runping Qi commented on HADOOP-2570: Lohit's suggestion should work. > streaming

[jira] Created: (HADOOP-2560) Combining multiple input blocks into one mapper

2008-01-09 Thread Runping Qi (JIRA)
Combining multiple input blocks into one mapper --- Key: HADOOP-2560 URL: https://issues.apache.org/jira/browse/HADOOP-2560 Project: Hadoop Issue Type: Bug Reporter: Runping Qi Curre

[jira] Created: (HADOOP-2559) DFS should place one replica per rack

2008-01-09 Thread Runping Qi (JIRA)
DFS should place one replica per rack - Key: HADOOP-2559 URL: https://issues.apache.org/jira/browse/HADOOP-2559 Project: Hadoop Issue Type: Improvement Components: dfs Reporter: Runpi

[jira] Commented: (HADOOP-1876) Persisting completed jobs status

2008-01-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557292#action_12557292 ] Runping Qi commented on HADOOP-1876: I am fine with the approach of this patch if it

[jira] Assigned: (HADOOP-2094) DFS should not use round robin policy in determing on which volume (file system partition) to allocate for the next block

2008-01-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2094: -- Assignee: dhruba borthakur > DFS should not use round robin policy in determing on which volum

[jira] Assigned: (HADOOP-2014) Job Tracker should not clobber the data locality of tasks

2008-01-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2014: -- Assignee: Devaraj Das > Job Tracker should not clobber the data locality of tasks > --

[jira] Assigned: (HADOOP-2144) Data node process consumes 180% cpu

2008-01-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2144: -- Assignee: dhruba borthakur > Data node process consumes 180% cpu > --

[jira] Commented: (HADOOP-2178) Job history on HDFS

2008-01-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556914#action_12556914 ] Runping Qi commented on HADOOP-2178: +1. This is much clearer. Need coordination in

[jira] Commented: (HADOOP-2178) Job history on HDFS

2008-01-07 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556630#action_12556630 ] Runping Qi commented on HADOOP-2178: BTW, Is this issue the same as H-1876 (https://

[jira] Commented: (HADOOP-1876) Persisting completed jobs status

2008-01-07 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556584#action_12556584 ] Runping Qi commented on HADOOP-1876: The point is that you don't need to write Runnin

[jira] Commented: (HADOOP-1876) Persisting completed jobs status

2008-01-06 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556498#action_12556498 ] Runping Qi commented on HADOOP-1876: You can add counter information to JobHistory dat

[jira] Commented: (HADOOP-2178) Job history on HDFS

2008-01-02 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12555439#action_12555439 ] Runping Qi commented on HADOOP-2178: The output data may be deleted anytime when it i

[jira] Commented: (HADOOP-2501) Implement utility-tools for working with SequenceFiles

2008-01-02 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12555372#action_12555372 ] Runping Qi commented on HADOOP-2501: bin/hadoop seq -head assumes the key/value class

[jira] Commented: (HADOOP-1298) adding user info to file

2007-12-21 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12553958 ] Runping Qi commented on HADOOP-1298: Since the file sizes to read/write are very small, the NNBench should not

[jira] Commented: (HADOOP-2437) final map output not evenly distributed across multiple disks

2007-12-16 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12552244 ] Runping Qi commented on HADOOP-2437: Similar problem due to round robin placement policy happens in DFS data n

[jira] Commented: (HADOOP-1336) turn on speculative execution by defaul

2007-12-15 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12552074 ] Runping Qi commented on HADOOP-1336: Speculative execution does not work well without the patch for hadoop-1281

[jira] Commented: (HADOOP-2433) Streaming: org.apache.hadoop.mapred.lib.IdentityMapper should not inserted unnecessary keys

2007-12-14 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12552033 ] Runping Qi commented on HADOOP-2433: There is already a proper input format class: KeyValueTextInputFormat for

[jira] Commented: (HADOOP-2429) The lowest level map-reduce APIs should be byte oriented

2007-12-14 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12551923 ] Runping Qi commented on HADOOP-2429: +1 To enforce that, the API should use concrete classes (such as Buffer) i

[jira] Commented: (HADOOP-2369) Representative mix of jobs for large cluster throughput benchmarking

2007-12-11 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12550763 ] Runping Qi commented on HADOOP-2369: +1 > Representative mix of jobs for large cluster throughput benchmarking

[jira] Created: (HADOOP-2403) JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory

2007-12-10 Thread Runping Qi (JIRA)
JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory -- Key: HADOOP-2403 URL: https://issues.apache.org/jira/browse/HADOOP-2403

[jira] Commented: (HADOOP-2141) speculative execution start up condition based on completion time

2007-11-15 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542896 ] Runping Qi commented on HADOOP-2141: I don't think this Jira is that urgent and we have to have a quick patch

[jira] Commented: (HADOOP-2141) speculative execution start up condition based on completion time

2007-11-15 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542861 ] Runping Qi commented on HADOOP-2141: The above proposal sounds reasonable. Here are some points to consider: 1

[jira] Commented: (HADOOP-1984) some reducer stuck at copy phase and progress extremely slowly

2007-11-12 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541828 ] Runping Qi commented on HADOOP-1984: It will be really helpful if we know the overall job progress status, and

[jira] Commented: (HADOOP-1984) some reducer stuck at copy phase and progress extremely slowly

2007-11-12 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541817 ] Runping Qi commented on HADOOP-1984: Ten minutes waiting interval seems too much. When the interval reach a few

[jira] Commented: (HADOOP-2141) speculative execution start up condition based on completion time

2007-11-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541388 ] Runping Qi commented on HADOOP-2141: +1 Speculative execution should start of the original execution is a lot

[jira] Commented: (HADOOP-2175) Blacklisted hosts may not be able to serve map outputs

2007-11-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541386 ] Runping Qi commented on HADOOP-2175: The criteria for starting a speculative execution should also include how

[jira] Created: (HADOOP-2180) Each task tracker should not execute more than one speculative task

2007-11-09 Thread Runping Qi (JIRA)
Each task tracker should not execute more than one speculative task --- Key: HADOOP-2180 URL: https://issues.apache.org/jira/browse/HADOOP-2180 Project: Hadoop Issue Type: Bug

[jira] Commented: (HADOOP-2175) Blacklisted hosts may not be able to serve map outputs

2007-11-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541350 ] Runping Qi commented on HADOOP-2175: then we need to try the patch for hadoop-1984. Currently, a job may stall f

[jira] Commented: (HADOOP-2175) Blacklisted hosts may not be able to serve map outputs

2007-11-08 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541240 ] Runping Qi commented on HADOOP-2175: I was using hadoop 0.15.0. is the patch for hadoop-1158 in 0.15.0? if so,

[jira] Created: (HADOOP-2177) Speculative execution does not work properly

2007-11-08 Thread Runping Qi (JIRA)
Speculative execution does not work properly Key: HADOOP-2177 URL: https://issues.apache.org/jira/browse/HADOOP-2177 Project: Hadoop Issue Type: Bug Components: mapred Report

[jira] Created: (HADOOP-2175) Blacklisted hosts may not be able to serve map outputs

2007-11-08 Thread Runping Qi (JIRA)
Blacklisted hosts may not be able to serve map outputs -- Key: HADOOP-2175 URL: https://issues.apache.org/jira/browse/HADOOP-2175 Project: Hadoop Issue Type: Bug Components: mapre

[jira] Commented: (HADOOP-2164) Reducer sort failed due to wrong key class

2007-11-07 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12540774 ] Runping Qi commented on HADOOP-2164: My input data is in SequenceFile. Only one map outputt segment file had th

[jira] Commented: (HADOOP-2164) Reducer sort failed due to wrong key class

2007-11-07 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12540772 ] Runping Qi commented on HADOOP-2164: All attempts failed. The job failed eventually. > Reducer sort failed d

[jira] Created: (HADOOP-2164) Reducer sort failed due to wrong key class

2007-11-06 Thread Runping Qi (JIRA)
Reducer sort failed due to wrong key class -- Key: HADOOP-2164 URL: https://issues.apache.org/jira/browse/HADOOP-2164 Project: Hadoop Issue Type: Bug Components: mapred Reporter:

[jira] Created: (HADOOP-2163) mapper failed due to exceptions

2007-11-06 Thread Runping Qi (JIRA)
mapper failed due to exceptions --- Key: HADOOP-2163 URL: https://issues.apache.org/jira/browse/HADOOP-2163 Project: Hadoop Issue Type: Bug Components: mapred Reporter: Runping Qi >From t

[jira] Commented: (HADOOP-2144) Data node process consumes 180% cpu

2007-11-02 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539635 ] Runping Qi commented on HADOOP-2144: Overall cpu usage is 90+%. It is easy to reproduce. > Data node process

[jira] Created: (HADOOP-2144) Data node process consumes 180% cpu

2007-11-02 Thread Runping Qi (JIRA)
Data node process consumes 180% cpu Key: HADOOP-2144 URL: https://issues.apache.org/jira/browse/HADOOP-2144 Project: Hadoop Issue Type: Improvement Reporter: Runping Qi I did a test on DFS

[jira] Updated: (HADOOP-2144) Data node process consumes 180% cpu

2007-11-02 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2144: --- Component/s: dfs Description: I did a test on DFS read throughput and found that the data node

[jira] Resolved: (HADOOP-2060) DFSClient should choose a block that is local to the node where the client is running

2007-11-02 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi resolved HADOOP-2060. Resolution: Invalid The suggested feature is already in. > DFSClient should choose a block that

[jira] Commented: (HADOOP-2086) ability to add dependencies to a job after construction

2007-11-02 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12539581 ] Runping Qi commented on HADOOP-2086: +1 Looks good. > ability to add dependencies to a job after constructio

[jira] Commented: (HADOOP-2119) JobTracker becomes non-responsive if the task trackers finish task too fast

2007-10-29 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538678 ] Runping Qi commented on HADOOP-2119: Yes, the #running-mappers kept on going up and went beyond the actual numb

[jira] Created: (HADOOP-2119) JobTracker becomes non-responsive if the task trackers finish task too fast

2007-10-29 Thread Runping Qi (JIRA)
JobTracker becomes non-responsive if the task trackers finish task too fast --- Key: HADOOP-2119 URL: https://issues.apache.org/jira/browse/HADOOP-2119 Project: Hadoop I

[jira] Commented: (HADOOP-2086) ability to add dependencies to a job after construction

2007-10-29 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538534 ] Runping Qi commented on HADOOP-2086: There is no real harm to make getState synchronized, although either way i

[jira] Commented: (HADOOP-2086) ability to add dependencies to a job after construction

2007-10-26 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538051 ] Runping Qi commented on HADOOP-2086: +1. > ability to add dependencies to a job after construction >

[jira] Commented: (HADOOP-2086) ability to add dependencies to a job after construction

2007-10-26 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538017 ] Runping Qi commented on HADOOP-2086: Right. WAITING is the only valid state we can add a dependending job. sub

[jira] Issue Comment Edited: (HADOOP-2086) ability to add dependencies to a job after construction

2007-10-25 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537706 ] runping edited comment on HADOOP-2086 at 10/25/07 1:54 PM: -- I like 1). Yes, there is a

[jira] Commented: (HADOOP-2086) ability to add dependencies to a job after construction

2007-10-25 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537706 ] Runping Qi commented on HADOOP-2086: I like 1). Yes, there is a possibility of race condition when the JobCont

[jira] Commented: (HADOOP-2086) ability to add dependencies to a job after construction

2007-10-25 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537653 ] Runping Qi commented on HADOOP-2086: +0 the code looks good. However, the semantics of the new api addDepending

[jira] Commented: (HADOOP-2095) Reducer failed due to Out ofMemory

2007-10-24 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537492 ] Runping Qi commented on HADOOP-2095: Yes. > Reducer failed due to Out ofMemory > -

[jira] Commented: (HADOOP-2095) Reducer failed due to Out ofMemory

2007-10-23 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12537162 ] Runping Qi commented on HADOOP-2095: The problem was gone after I set the compressMapOutput attribute to false.

[jira] Updated: (HADOOP-2095) Reducer failed due to Out ofMemory

2007-10-23 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2095: --- Component/s: mapred Fix Version/s: 0.15.0 Description: One of the reducers of my job fa

[jira] Created: (HADOOP-2095) Reducer failed due to Out ofMemory

2007-10-23 Thread Runping Qi (JIRA)
Reducer failed due to Out ofMemory -- Key: HADOOP-2095 URL: https://issues.apache.org/jira/browse/HADOOP-2095 Project: Hadoop Issue Type: Bug Reporter: Runping Qi One of the reducers of my job

[jira] Assigned: (HADOOP-2094) DFS should not use round robin policy in determing on which volume (file system partition) to allocate for the next block

2007-10-23 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2094: -- Assignee: (was: Runping Qi) > DFS should not use round robin policy in determing on which

[jira] Created: (HADOOP-2094) DFS should not use round robin policy in determing on which volume (file system partition) to allocate for the next block

2007-10-23 Thread Runping Qi (JIRA)
DFS should not use round robin policy in determing on which volume (file system partition) to allocate for the next block -- Key: HADOOP-2094

[jira] Updated: (HADOOP-2093) DFS should provide partition information for blocks, and map/reduce should schedule avoid schedule mappers with the splits off the same file system partition at the same

2007-10-23 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2093: --- Component/s: mapred dfs Description: The summary is a bit of long. But the basi

[jira] Created: (HADOOP-2093) DFS should provide partition information for blocks, and map/reduce should schedule avoid schedule mappers with the splits off the same file system partition at the same

2007-10-23 Thread Runping Qi (JIRA)
DFS should provide partition information for blocks, and map/reduce should schedule avoid schedule mappers with the splits off the same file system partition at the same time --

[jira] Commented: (HADOOP-1965) Handle map output buffers better

2007-10-17 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12535529 ] Runping Qi commented on HADOOP-1965: It seems clear that threaded spill performed much better than sequence spi

[jira] Commented: (HADOOP-2060) DFSClient should choose a block that is local to the node where the client is running

2007-10-15 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534962 ] Runping Qi commented on HADOOP-2060: OK, that is the part I didn't get. I'll examine the location list to confi

[jira] Created: (HADOOP-2060) DFSClient should choose a block that is local to the node where the client is running

2007-10-15 Thread Runping Qi (JIRA)
DFSClient should choose a block that is local to the node where the client is running - Key: HADOOP-2060 URL: https://issues.apache.org/jira/browse/HADOOP-2060 Projec

[jira] Commented: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-14 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534716 ] Runping Qi commented on HADOOP-2050: It turned out to be a problem in CopyFile class. After a mapper got killed

[jira] Updated: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-14 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2050: --- Component/s: (was: dfs) mapred > distcp failed due to problem in creating files

[jira] Commented: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-13 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534570 ] Runping Qi commented on HADOOP-2050: This problem does not happen if the dfs write load is low. When a few mappe

[jira] Updated: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-13 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2050: --- Description: When I run a distcp program to copy files from one dfs to another, my job failed with

[jira] Updated: (HADOOP-2052) distcp mapper's status report misleading

2007-10-13 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2052: --- Description: When the mappers of distcp finish, the status page in the web gui reports the data cop

[jira] Updated: (HADOOP-2052) distcp mapper's status report misleading

2007-10-13 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2052: --- Component/s: mapred Description: When the mappers of distcp finish, the status page in the web g

[jira] Created: (HADOOP-2052) distcp mapper's status report misleading

2007-10-13 Thread Runping Qi (JIRA)
distcp mapper's status report misleading Key: HADOOP-2052 URL: https://issues.apache.org/jira/browse/HADOOP-2052 Project: Hadoop Issue Type: Bug Reporter: Runping Qi When the mappers of

[jira] Commented: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-12 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534462 ] Runping Qi commented on HADOOP-2050: Some mappers failed with the following exception: org.apache.hadoop.ipc.R

[jira] Updated: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-12 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2050: --- Component/s: dfs I suspect this is a problem in dfs. > distcp failed due to problem in creating f

[jira] Created: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-12 Thread Runping Qi (JIRA)
distcp failed due to problem in creating files -- Key: HADOOP-2050 URL: https://issues.apache.org/jira/browse/HADOOP-2050 Project: Hadoop Issue Type: Bug Reporter: Runping Qi When I

[jira] Updated: (HADOOP-2050) distcp failed due to problem in creating files

2007-10-12 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2050: --- Description: When I run a distcp program to copy files from one dfs to another, my job failed

[jira] Created: (HADOOP-2048) DISTCP mapper should report progress more often

2007-10-12 Thread Runping Qi (JIRA)
DISTCP mapper should report progress more often --- Key: HADOOP-2048 URL: https://issues.apache.org/jira/browse/HADOOP-2048 Project: Hadoop Issue Type: Bug Reporter: Runping Qi When

[jira] Commented: (HADOOP-2042) distcp job failed

2007-10-12 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534401 ] Runping Qi commented on HADOOP-2042: The current trunk. I guess it is 0.15 > distcp job failed > -

[jira] Updated: (HADOOP-2042) distcp job failed

2007-10-12 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2042: --- Component/s: dfs Description: I was running distcp to copy data from one dfs to another. The job

[jira] Created: (HADOOP-2042) distcp job failed

2007-10-12 Thread Runping Qi (JIRA)
distcp job failed - Key: HADOOP-2042 URL: https://issues.apache.org/jira/browse/HADOOP-2042 Project: Hadoop Issue Type: Bug Affects Versions: 0.15.0 Reporter: Runping Qi I was running distcp to copy data fr

[jira] Created: (HADOOP-2032) distcp split generation does not work correctly

2007-10-11 Thread Runping Qi (JIRA)
distcp split generation does not work correctly --- Key: HADOOP-2032 URL: https://issues.apache.org/jira/browse/HADOOP-2032 Project: Hadoop Issue Type: Bug Components: util Re

[jira] Commented: (HADOOP-2028) distcp fails if log dir not specified and destination not present

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12533904 ] Runping Qi commented on HADOOP-2028: the job fails too if the specified log dir is not empty > distcp fails if

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Status: Patch Available (was: Open) > Job tracker should report the number of splits that are local

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Attachment: (was: hadoop-2015.txt) > Job tracker should report the number of splits that are loc

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Status: Open (was: Patch Available) a more optimized patch is available > Job tracker should repo

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Attachment: hadoop-2015.txt a better one > Job tracker should report the number of splits that are

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Attachment: hadoop-2015.txt Fix a bug in the patch > Job tracker should report the number of split

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Status: Patch Available (was: Open) > Job tracker should report the number of splits that are local

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Attachment: (was: hadoop-2015.txt) > Job tracker should report the number of splits that are loc

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-10 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Status: Open (was: Patch Available) Need some more change > Job tracker should report the number

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Status: Patch Available (was: Open) > Job tracker should report the number of splits that are local

[jira] Updated: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2015: --- Attachment: hadoop-2015.txt a patch that adds a counter for the total number of tasks that may be

[jira] Assigned: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi reassigned HADOOP-2015: -- Assignee: Runping Qi > Job tracker should report the number of splits that are local to some t

[jira] Created: (HADOOP-2015) Job tracker should report the number of splits that are local to some task trackers

2007-10-09 Thread Runping Qi (JIRA)
Job tracker should report the number of splits that are local to some task trackers --- Key: HADOOP-2015 URL: https://issues.apache.org/jira/browse/HADOOP-2015 Project: H

[jira] Updated: (HADOOP-2014) Job Tracker should not clobber the data locality of tasks

2007-10-09 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2014: --- Component/s: mapred Description: Currently, when the Job Tracker assigns a mapper task to a task

[jira] Created: (HADOOP-2014) Job Tracker should not clobber the data locality of tasks

2007-10-09 Thread Runping Qi (JIRA)
Job Tracker should not clobber the data locality of tasks - Key: HADOOP-2014 URL: https://issues.apache.org/jira/browse/HADOOP-2014 Project: Hadoop Issue Type: Bug Reporter:

  1   2   3   4   5   >