[jira] [Created] (MAPREDUCE-5589) MapReduce Job setup error leaves no useful info to users (when LinuxTaskController is used)

2013-10-17 Thread Benoy Antony (JIRA)
Benoy Antony created MAPREDUCE-5589: --- Summary: MapReduce Job setup error leaves no useful info to users (when LinuxTaskController is used) Key: MAPREDUCE-5589 URL: https://issues.apache.org/jira/browse/MAPREDUC

RE: About block splitting, input split and TextInputFormat in MapReduce

2013-10-17 Thread Bikas Saha
The overall answer is that InputFormat implementations determine how to split their data across block boundaries and then handle the read in order to not have incomplete records. When splits are generated then they typically don’t have block information. They have an offset and length into the f

[jira] [Resolved] (MAPREDUCE-5588) TaskTrackers get killed by JettyBugMonitor because of incredibly high cpu usage

2013-10-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved MAPREDUCE-5588. -- Resolution: Duplicate Assignee: Chris Nauroth Hello, [~moian]. There is a kn

(Re)About block splitting, input split and TextInputFormat in MapReduce

2013-10-17 Thread Yoonmin Nam
Hi. Let we consider this situation: 1. Block size = 67108864 (64MB) 2. Data size = 2.2GB. (larger than block size) Then, when I put the input into HDFS, I got the below list of block replication result: http://infolab.dgist.ac.kr/~ronymin/pictures/1.png Then, I checked

About block splitting, input split and TextInputFormat in MapReduce

2013-10-17 Thread Yoonmin Nam
Hi. Let we consider this situation: 1. Block size = 67108864 (64MB) 2. Data size = 2.2GB. (larger than block size) Then, when I put the input into HDFS, I got the below list of block replication result: Then, I checked each HDFS block and unfortunately (but naturally) block

Hadoop-Mapreduce-trunk - Build # 1581 - Still Failing

2013-10-17 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1581/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 32764 lines...] TestSpecialCharactersInOutputPath.

[jira] [Created] (MAPREDUCE-5588) TaskTrackers get killed by JettyBugMonitor because of incredibly high cpu usage

2013-10-17 Thread Anthony MOI (JIRA)
Anthony MOI created MAPREDUCE-5588: -- Summary: TaskTrackers get killed by JettyBugMonitor because of incredibly high cpu usage Key: MAPREDUCE-5588 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5588