http://git-wip-us.apache.org/repos/asf/hadoop/blob/1bc45461/hadoop-mapreduce-project/CHANGES.txt ---------------------------------------------------------------------- diff --git a/hadoop-mapreduce-project/CHANGES.txt b/hadoop-mapreduce-project/CHANGES.txt deleted file mode 100644 index 8939007..0000000 --- a/hadoop-mapreduce-project/CHANGES.txt +++ /dev/null @@ -1,8906 +0,0 @@ -Hadoop MapReduce Change Log - -Trunk (Unreleased) - - INCOMPATIBLE CHANGES - - MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. - (Gera Shegalov and Karthik Kambatla via gera) - - MAPREDUCE-5653. DistCp does not honour config-overrides for - mapreduce.[map,reduce].memory.mb (Ratandeep Ratti via aw) - - MAPREDUCE-4424. 'mapred job -list' command should show the job name - as well. (Avinash Kujur via aajisaka) - - MAPREDUCE-6336. Enable v2 FileOutputCommitter by default. - (Siqi Li via gera) - - MAPREDUCE-6613. Change mapreduce.jobhistory.jhist.format default from - json to binary (rchiang via rkanter) - - NEW FEATURES - - MAPREDUCE-778. Rumen Anonymizer. (Amar Kamat and Chris Douglas via amarrk) - - MAPREDUCE-2669. Add new examples for Mean, Median, and Standard Deviation. - (Plamen Jeliazkov via shv) - - MAPREDUCE-4887. Add RehashPartitioner, to smooth distributions - with poor implementations of Object#hashCode(). (Radim Kolar via cutting) - - MAPREDUCE-5232. Add a configuration to be able to log classpath and other - system properties on mapreduce JVMs startup. (Sangjin Lee via vinodkv) - - MAPREDUCE-5910. Make MR AM resync with RM in case of work-preserving - RM-restart. (Rohith via jianhe) - - MAPREDUCE-2841. Add a native implementation of MapOutputCollector. - (see section below for detailed breakdown) - - IMPROVEMENTS - - MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk) - - MAPREDUCE-3597. [Rumen] Rumen should provide APIs to access all the - job-history related information. - - MAPREDUCE-3375. [Gridmix] Memory Emulation system tests. - (Vinay Thota via amarrk) - - MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests. - (Vinay Thota via amarrk) - - MAPREDUCE-2836. Provide option to fail jobs when submitted to non-existent - fair scheduler pools. (Ahmed Radwan via todd) - - MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs - native. (tucu) - - MAPREDUCE-3149. Add a test to verify that TokenCache handles file system - uri with no authority. (John George via jitendra) - - MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides - client APIs cross MR1 and MR2 (Ahmed via tucu) - - MAPREDUCE-2944. Improve checking of input for JobClient.displayTasks() - (XieXianshan via harsh) - - MAPREDUCE-3956. Remove the use of the deprecated Syncable.sync() method from - TeraOutputFormat in the terasort example. (szetszwo) - - MAPREDUCE-3935. Annotate Counters.Counter and Counters.Group as @Public. - (tomwhite) - - HADOOP-8285 MR changes for Use ProtoBuf for RpcPayLoadHeader (sanjay radia) - - MAPREDUCE-3302. Remove the last dependency call from - org.apache.hadoop.record package in MR. (harsh) - - MAPREDUCE-2384. The job submitter should make sure to validate - jobs before creation of necessary files. (harsh) - - MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG - (madhukara phatak via bobby) - - MAPREDUCE-4686. hadoop-mapreduce-client-core fails compilation in Eclipse - due to missing Avro-generated classes (Chris Nauroth via harsh) - - MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive. - (Brandon Li via suresh) - - MAPREDUCE-5197. Add a service for checkpointing task state. - (Carlo Curino via cdouglas) - - MAPREDUCE-5189. Add policies and wiring to respond to preemption requests - from YARN. (Carlo Curino via cdouglas) - - MAPREDUCE-5196. Add bookkeeping for managing checkpoints of task state. - (Carlo Curino via cdouglas) - - MAPREDUCE-5912. Task.calculateOutputSize does not handle Windows files after - MAPREDUCE-5196. (Remus Rusanu via cnauroth) - - MAPREDUCE-6019. MapReduce changes for exposing YARN/MR endpoints on multiple - interfaces. (Craig Welch, Milan Potocnik, Arpit Agarwal via xgong) - - MAPREDUCE-6013. [post-HADOOP-9902] mapred version is missing (Akira AJISAKA - via aw) - - MAPREDUCE-6250. deprecate sbin/mr-jobhistory-daemon.sh (aw) - - MAPREDUCE-6260. Convert site documentation to markdown (Masatake Iwasaki - via aw) - - MAPREDUCE-6057. Remove obsolete entries from mapred-default.xml - (Ray Chiang via aw) - - MAPREDUCE-2632. Avoid calling the partitioner when the numReduceTasks is 1. - (Ravi Teja Ch N V and Sunil G via kasha) - - MAPREDUCE-6407. Migrate MAPREDUCE nativetask build to new CMake framework - (Alan Burlison via Colin P. McCabe) - - MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API - (Junping Du via jianhe) - - BUG FIXES - - MAPREDUCE-5714. Removed forceful JVM exit in shutDownJob. - (Jinghui Wang via Eric Yang) - - MAPREDUCE-3194. "mapred mradmin" command is broken in mrv2 - (Jason Lowe via bobby) - - MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. - (Ravi Prakash and Ravi Gummadi via amarrk) - - MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks. - (Devaraj K and Amar Kamat via amarrk) - - MAPREDUCE-3412. Fix 'ant docs'. (amarrk) - - MAPREDUCE-3346. [Rumen] LoggedTaskAttempt#getHostName() returns null. - (amarrk) - - MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. - (Ravi Gummadi via amarrk) - - MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and - ResourceUsageMatcher. (amarrk) - - MAPREDUCE-2978. Fixed test-patch to make Jenkins report correct number of - findBugs, correct links to findBugs artifacts and no links to the - artifacts when there are no warnings. (Tom White via vinodkv). - - MAPREDUCE-3664. Federation Documentation has incorrect configuration example. - (Brandon Li via jitendra) - - MAPREDUCE-1740. NPE in getMatchingLevelForNodes when node locations are - variable depth (ahmed via tucu) [IMPORTANT: this is dead code in trunk] - - MAPREDUCE-3990. MRBench allows Long-sized input-lines value - but parses CLI argument as an Integer. (harsh) - - MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen) - - MAPREDUCE-4685. DBCount should not use ACCESS. (Viji via harsh) - - MAPREDUCE-3223. Remove MR1 configs from mapred-default.xml (tlipcon via harsh) - - MAPREDUCE-4695. Fix LocalRunner on trunk after MAPREDUCE-3223 broke it - (harsh) - - MAPREDUCE-3914. Mismatched free() / delete / delete [] in HadoopPipes - (Joe Mudd via aw) - - MAPREDUCE-1125. SerialUtils.cc: deserializeFloat is out of sync with - SerialUtils.hh (Simone Leo via aw) - - MAPREDUCE-4574. Fix TotalOrderParitioner to work with - non-WritableComparable key types. (harsh) - - MAPREDUCE-5012. Typo in javadoc for IdentityMapper class. (Adam Monsen - via suresh) - - MAPREDUCE-4987. TestMRJobs#testDistributedCache fails on Windows due to - classpath problems and unexpected behavior of symlinks (Chris Nauroth via - bikas) - - MAPREDUCE-5191. TestQueue#testQueue fails with timeout on Windows. (Ivan - Mitic via hitesh) - - MAPREDUCE-5717. Task pings are interpreted as task progress (jlowe) - - MAPREDUCE-5867. Fix NPE in KillAMPreemptionPolicy related to - ProportionalCapacityPreemptionPolicy (Sunil G via devaraj) - - MAPREDUCE-5972. Fix typo 'programatically' in job.xml (and a few other - places) (Akira AJISAKA via aw) - - MAPREDUCE-6161. mapred hsadmin command missing from trunk (Allen Wittenauer - via jlowe) - - MAPREDUCE-4413. MR lib dir contains jdiff (which is gpl) (Nemon Lou via aw) - - MAPREDUCE-6234. TestHighRamJob fails due to the change in MAPREDUCE-5785. - (Masatake Iwasaki via kasha) - - MAPREDUCE-6343. JobConf.parseMaximumHeapSizeMB() fails to parse value - greater than 2GB expressed in bytes. (Hao Xia via kasha) - - MAPREDUCE-6396. TestPipeApplication fails by NullPointerException. - (Brahma Reddy Battula via aajisaka) - - MAPREDUCE-6406. Update FileOutputCommitter.FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT - to match mapred-default.xml. (Ray Chiang via devaraj) - - MAPREDUCE-6257. Document encrypted spills (Bibin A Chundatt via aw) - - MAPREDUCE-6391. util/Timer.cc completely misunderstands _POSIX_CPUTIME - (Alan Burlison via aw) - - MAPREDUCE-6412. Make hadoop-mapreduce-client Native code -Wall-clean - (Alan Burlison via aw) - - MAPREDUCE-6416. Not all platforms have d_type in struct dirent - (Alan Burlison via aw) - - MAPREDUCE-6435. MapReduce client assumes the world is x86 - (Alan Burlison via aw) - - MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) - - MAPREDUCE-6555. TestMRAppMaster fails on trunk. (Junping Du via ozawa) - - BREAKDOWN OF MAPREDUCE-2841 (NATIVE TASK) SUBTASKS - - MAPREDUCE-5985. native-task: Fix build on macosx. Contributed by - Binglin Chang - - MAPREDUCE-5994. Simplify ByteUtils and fix failing test. (todd) - - MAPREDUCE-5996. native-task: Rename system tests into standard directory - layout (todd) - - MAPREDUCE-5997. native-task: Use DirectBufferPool from Hadoop Common (todd) - - MAPREDUCE-6000. native-task: Simplify ByteBufferDataReader/Writer (todd) - - MAPREDUCE-5991. native-task should not run unit tests if native profile is - not enabled. (Binglin Chang) - - MAPREDUCE-5995. native-task: Revert changes to Text internals (todd) - - MAPREDUCE-6005. native-task: Fix some valgrind errors (Binglin Chang) - - MAPREDUCE-5984. native-task: Reuse lz4 sources in hadoop-common (Binglin - Chang) - - MAPREDUCE-5976. native-task: should not fail to build if snappy is missing - (Manu Zhang) - - MAPREDUCE-5978. native-task: remove test case for not supported codec - Bzip2Codec and DefaultCodec (Manu Zhang) - - MAPREDUCE-6006. native-task: add native tests to maven and fix bug in - pom.xml (Binglin Chang via todd) - - MAPREDUCE-6026. native-task: fix logging (Manu Zhang via todd) - - MAPREDUCE-6035. native-task: sources/test-sources jar distribution (Manu - Zhang via todd) - - MAPREDUCE-5977. Fix or suppress native-task gcc warnings (Manu Zhang via - todd) - - MAPREDUCE-6054. native-task: Speed up tests (todd) - - MAPREDUCE-6058. native-task: KVTest and LargeKVTest should check mr job is - sucessful (Binglin Chang) - - MAPREDUCE-6056. native-task: move system test working dir to target dir and - cleanup test config xml files (Manu Zhang via bchang) - - MAPREDUCE-6055. native-task: findbugs, interface annotations, and other misc - cleanup (todd) - - MAPREDUCE-6067. native-task: fix some counter issues (Binglin Chang) - - MAPREDUCE-6069. native-task: Lint/style fixes and removal of unused code - (todd) - - MAPREDUCE-6074. native-task: fix release audit, javadoc, javac warnings - (todd) - - MAPREDUCE-6077. native-task: Remove CustomModule examples in nativetask (seanzhong) - - MAPREDUCE-6078. native-task: fix gtest build on macosx (Binglin Chang) - - MAPREDUCE-5801. Uber mode's log message is missing a vcore reason - (Steven Wong via aw) - - MAPREDUCE-6525. Fix test failure of TestMiniMRClientCluster.testRestart. - (Masatake Iwasaki via aajisaka) - -Release 2.9.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - MAPREDUCE-6431. JobClient should be an AutoClosable (haibochen via rkanter) - - MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in - mapreduce. (Sidharta Seethana via vvasudev) - - MAPREDUCE-6627. Add machine-readable output to mapred job -history - command (rkanter) - - MAPREDUCE-6640. mapred job -history command should be able to take - Job ID (rkanter) - - MAPREDUCE-6622. Add capability to set JHS job cache to a - task-based limit (rchiang via rkanter) - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6620. Jobs that did not start are shown as starting in 1969 in - the JHS web UI (haibochen via rkanter) - - MAPREDUCE-4785. TestMRApp occasionally fails (haibochen via rkanter) - -Release 2.8.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application - Master REST API. (Ryu Kobayashi via ozawa) - - MAPREDUCE-6364. Add a "Kill" link to Task Attempts page. (Ryu Kobayashi - via ozawa) - - MAPREDUCE-6304. Specifying node labels when submitting MR jobs. - (Naganarasimha G R via wangda) - - MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. - (Robert Kanter via kasha) - - IMPROVEMENTS - - MAPREDUCE-6471. Document distcp incremental copy - (Neelesh Srinivas Salian via harsh) - - MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused - (Neelesh Srinivas Salian via harsh) - - MAPREDUCE-6291. Correct mapred queue usage command. - (Brahma Reddu Battula via harsh) - - MAPREDUCE-579. Streaming "slowmatch" documentation. (harsh) - - MAPREDUCE-6287. Deprecated methods in org.apache.hadoop.examples.Sort - (Chao Zhang via harsh) - - MAPREDUCE-5190. Unnecessary condition test in RandomSampler. - (Jingguo Yao via harsh) - - MAPREDUCE-6239. Consolidate TestJobConf classes in - hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-core - (Varun Saxena via harsh) - - MAPREDUCE-5807. Print usage by TeraSort job. (Rohith via harsh) - - MAPREDUCE-4653. TestRandomAlgorithm has an unused "import" statement. - (Amir Sanjar via harsh) - - MAPREDUCE-6100. replace "mapreduce.job.credentials.binary" with - MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. - (Zhihai Xu via harsh) - - MAPREDUCE-6105. Inconsistent configuration in property - mapreduce.reduce.shuffle.merge.percent. (Ray Chiang via harsh) - - MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, - for debug purposes. (Plamen Jeliazkov via harsh) - - MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have - @Override annotation. (ozawa) - - MAPREDUCE-6282. Reuse historyFileAbsolute.getFileSystem in - CompletedJob#loadFullHistoryData for code optimization. - (zxu via rkanter) - - MAPREDUCE-6307. Remove property - mapreduce.tasktracker.taskmemorymanager.monitoringinterval. - (J.Andreina via aajisaka) - - MAPREDUCE-6192. Create unit test to automatically compare - MR related classes and mapred-default.xml (rchiang via rkanter) - - MAPREDUCE-6279. AM should explicity exit JVM after all services have - stopped (Eric Payne via jlowe) - - MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. - (Tsuyoshi Ozawa via aajisaka) - - MAPREDUCE-5981. Log levels of certain MR logs can be changed to DEBUG. - (Varun Saxena via devaraj) - - MAPREDUCE-5248. Let NNBenchWithoutMR specify the replication factor for - its test (Erik Paulson via jlowe) - - MAPREDUCE-6174. Combine common stream code into parent class for - InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera) - - MAPREDUCE-6383. Pi job (QuasiMonteCarlo) should not try to read the - results file if its job fails. (Harsh J via devaraj) - - MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections - (Chang Li via jlowe) - - MAPREDUCE-6392. Document mapred class path options. - (Brahma Reddy Battula via cnauroth) - - MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. - (Brahma Reddy Battula via gera) - - MAPREDUCE-6316. Task Attempt List entries should link to the task overview. - (Siqi Li via gera) - - MAPREDUCE-6305. AM/Task log page should be able to link back to the job. - (Siqi Li via gera) - - MAPREDUCE-6408. Queue name and user name should be printed on the job page. - (Siqi Li via gera) - - MAPREDUCE-6384. Add the last reporting reducer info for too many fetch - failure diagnostics (Chang Li via jlowe) - - MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. (Robert Kanter - via junping_du) - - MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in - TestFileSystem. (Mingliang Liu via wheat9) - - MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with - DFSUtilClient.getNNUri() in TestMRCredentials. (Mingliang Liu via wheat9) - - HADOOP-12428. Fix inconsistency between log-level guards and statements. - (Jagadesh Kiran N and Jackie Chang via ozawa) - - MAPREDUCE-6479. Add missing mapred job command options in mapreduce - document. (nijel via aajisaka) - - MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk - (Maysam Yabandeh via jlowe) - - MAPREDUCE-5763. Warn message about httpshuffle in NM logs. - (Akira AJISAKA via ozawa) - - MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. - (Lin Yiqun via aajisaka) - - MAPREDUCE-5870. Support for passing Job priority through Application - Submission Context in Mapreduce Side (Sunil G via jlowe) - - MAPREDUCE-6566. Add retry support to mapreduce CLI tool. - (Varun Vasudev via xgong) - - MAPREDUCE-6574. MR AM should print host of failed tasks. - (Mohammad Shahid Khan via wangda) - - MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. - (aajisaka) - - MAPREDUCE-6595. Fix findbugs warnings in OutputCommitter and - FileOutputCommitter. (Akira AJISAKA via junping_du) - - OPTIMIZATIONS - - MAPREDUCE-6376. Add avro binary support for jhist files (Ray Chiang via - jlowe) - - MAPREDUCE-6394. Speed up Task processing loop in HsTasksBlock#render() - (Ray Chiang via jlowe) - - MAPREDUCE-6473. Job submission can take a long time during Cluster - initialization (Kuhu Shukla via jlowe) - - MAPREDUCE-6626. Reuse ObjectMapper instance in MapReduce. - (Lin Yiqun via aajisaka) - - BUG FIXES - - MAPREDUCE-6314. TestPipeApplication fails on trunk. - (Varun Vasudev via harsh) - - MAPREDUCE-5448. MapFileOutputFormat#getReaders bug with hidden - files/folders. (Maysam Yabandeh via harsh) - - MAPREDUCE-6213. NullPointerException caused by job history server addr not - resolvable. (Peng Zhang via harsh) - - MAPREDUCE-6281. Fix javadoc in Terasort. (Albert Chu via ozawa) - - MAPREDUCE-6242. Progress report log is incredibly excessive in - application master. (Varun Saxena via devaraj) - - MAPREDUCE-6294. Remove an extra parameter described in Javadoc of - TockenCache. (Brahma Reddy Battula via ozawa) - - MAPREDUCE-5875. Make Counter limits consistent across JobClient, - MRAppMaster, and YarnChild. (Gera Shegalov via kasha) - - MAPREDUCE-6199. AbstractCounters are not reset completely on - deserialization (adhoot via rkanter) - - MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which - causes counter limits are not reset correctly. - (Zhihai Xu via harsh) - - MAPREDUCE-4844. Counters / AbstractCounters have constant references not - declared final. (Brahma Reddy Battula via gera) - - MAPREDUCE-6266. Job#getTrackingURL should consistently return a proper URL - (rchiang via rkanter) - - MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher - event thread. (Sangjin Lee via gera) - - MAPREDUCE-6297. Task Id of the failed task in diagnostics should link to - the task page. (Siqi Li via gera) - - MAPREDUCE-6330. Fix typo in Task Attempt API's URL in documentations. - (Ryu Kobayashi via ozawa) - - MAPREDUCE-6333. TestEvents,TestAMWebServicesTasks,TestAppController are - broken due to MAPREDUCE-6297. (Siqi Li via gera) - - MAPREDUCE-6341. Fix typo in mapreduce tutorial. (John Michael Luy - via ozawa) - - MAPREDUCE-6345. Documentation fix for when CRLA is enabled for MRAppMaster - logs. (Rohit Agarwal via gera) - - MAPREDUCE-5905. CountersStrings.toEscapedCompactStrings outputs - unnecessary "null" strings. (Akira AJISAKA via ozawa) - - MAPREDUCE-6349. Fix typo in property org.apache.hadoop.mapreduce. - lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS. (Ray Chiang via ozawa) - - MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. - (Akira AJISAKA via ozawa) - - MAPREDUCE-6356. Misspelling of threshold in log4j.properties for tests. - (Brahma Reddy Battula via aajisaka) - - MAPREDUCE-6342. Make POM project names consistent. (Rohith via devaraj) - - MAPREDUCE-3383. Duplicate job.getOutputValueGroupingComparator() in - ReduceTask (Binglin Chang via jlowe) - - MAPREDUCE-4750. Enable NNBenchWithoutMR in MapredTestDriver (Liang Xie - and Jason Lowe via raviprak) - - MAPREDUCE-6359. In RM HA setup, "Cluster" tab links populated with AM - hostname instead of RM. (zhaoyunjiong via junping_du) - - MAPREDUCE-6353. Divide by zero error in MR AM when calculating available - containers. (Anubhav Dhoot via kasha) - - MAPREDUCE-5465. Tasks are often killed before they exit on their own - (Ming Ma via jlowe) - - MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, - introducing compile error (Arshad Mohammad via vinayakumarb) - - MAPREDUCE-6366. mapreduce.terasort.final.sync configuration in TeraSort - doesn't work. (Takuya Fukudome via ozawa) - - MAPREDUCE-5708. Duplicate String.format in YarnOutputFiles.getSpillFileForWrite. - (Konstantin Weitz via devaraj) - - MAPREDUCE-6204. TestJobCounters should use new properties instead of - JobConf.MAPRED_TASK_JAVA_OPTS. (Sam Liu via ozawa) - - MAPREDUCE-6374. Distributed Cache File visibility should check permission - of full path (Chang Li via jlowe) - - MAPREDUCE-5965. Hadoop streaming throws error if list of input files is - high. Error is: "error=7, Argument list too long at if number of input - file is high" (wilfreds via rkanter) - - MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. - (Siqi Li via gera) - - MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes - (Ray Chiang via ozawa). - - MAPREDUCE-6350. JobHistory doesn't support fully-functional search. - (Siqi Li via devaraj) - - MAPREDUCE-6389. Fix BaileyBorweinPlouffe CLI usage message. (Brahma Reddy Battula - via devaraj) - - MAPREDUCE-6373. The logger reports total input paths but it is referring - to input files. (Bibin A Chundatt via devaraj) - - MAPREDUCE-6405. NullPointerException in App Attempts page. - (Siqi Li and Gera Shegalov via devaraj) - - MAPREDUCE-6403. Fix typo in the usage of NNBench. - (Jagadesh Kiran N via aajisaka) - - MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed - too early (Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov via - jlowe) - - MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host - (zhihai xu via jlowe) - - MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces - (rchiang via rkanter) - - MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be - logged in warn/info level (Chang Li via jlowe) - - MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown - (Chang Li via jlowe) - - MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in - MapReduce Tutorial. (Tsuyoshi Ozawa via cdouglas) - - MAPREDUCE-6421. Fix findbugs warning in - RMContainerAllocator.reduceNodeLabelExpression. - (Brahma Reddy Battula via aajisaka) - - MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. (Ray Chiang via cdouglas) - - MAPREDUCE-6433. launchTime may be negative. (Zhihai Xu) - - MAPREDUCE-5817. Mappers get rescheduled on node transition even after all - reducers are completed. (Sangjin Lee via kasha) - - MAPREDUCE-6357. MultipleOutputs.write() API should document that output - committing is not utilized when input path is absolute. - (Dustin Cote via aajisaka) - - MAPREDUCE-6357. MultipleOutputs.write() API should document that output - committing is not utilized when input path is absolute. - (Dustin Cote via aajisaka) - - MAPREDUCE-6452. NPE when intermediate encrypt enabled for LocalRunner. - (Zhihai Xu) - - MAPREDUCE-5002. AM could potentially allocate a reduce container to a map - attempt (Chang Li via jlowe) - - MAPREDUCE-6460. TestRMContainerAllocator. - testAttemptNotFoundCausesRMCommunicatorException fails. (Zhihai Xu) - - MAPREDUCE-6484. Yarn Client uses local address instead of RM address as - token renewer in a secure cluster when RM HA is enabled. (Zhihai Xu) - - MAPREDUCE-6480. archive-logs tool may miss applications (rkanter) - - MAPREDUCE-6494. Permission issue when running archive-logs tool as - different users (rkanter) - - MAPREDUCE-6485. Create a new task attempt with failed map task priority - if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks) - - MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead - of HADOOP_HOME (rkanter) - - MAPREDUCE-6302. Preempt reducers after a configurable timeout irrespective - of headroom. (kasha) - - MAPREDUCE-6495. Docs for archive-logs tool (rkanter) - - MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation - token changes on RM. (Akira AJISAKA via junping_du) - - MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat - (Sunil G via jlowe) - - MAPREDUCE-6533. testDetermineCacheVisibilities of - TestClientDistributedCacheManager is broken (Chang Li via jlowe) - - MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. - (Gabor Liptak via aajisaka) - - MAPREDUCE-6557. Tests in mapreduce-client-app are writing outside of - target. (Akira AJISAKA via junping_du) - - MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn - user when using DefaultContainerExecutor (rkanter) - - MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's - exceed 9999. (Mohammad Shahid Khan via rohithsharmaks) - - MAPREDUCE-6589. TestTaskLog outputs a log under directory other than - target/test-dir. (aajisaka) - - MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails - on trunk because of NPE. (Naganarasimha G R via aajisaka) - - MAPREDUCE-6068. Illegal progress value warnings in map tasks. (Binglin Chang - via junping_du) - - MAPREDUCE-6601. Fix typo in Job#setUseNewAPI. (Kai Sasaki via aajisaka) - - MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and - mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. - (Kai Sasaki via aajisaka) - - MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. - (Kai Sasaki via aajisaka) - - MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response - (Li Lu via jianhe) - - MAPREDUCE-6563. Streaming documentation contains a stray '%' character. - (cnauroth) - - MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte - characters in the job name. (Kousuke Saruta via aajisaka) - - MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader - and IndexOutOfBoundsException. (Junping Du via vvasudev) - -Release 2.7.3 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - MAPREDUCE-6637. Testcase Failure : TestFileInputFormat.testSplitLocationInfo. - (Brahma Reddy Battula via wang) - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6377. JHS sorting on state column not working in webUi. - (zhihai xu via devaraj) - - MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly - misleading (Nathan Roberts via jlowe) - - MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. - (Kai Sasaki via aajisaka) - - MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in - MRAppMaster#parsePreviousJobHistory (Bibin A Chundatt via jlowe) - - MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. - (Xuan Gong via jlowe) - - MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal() (Xuan Gong - via jlowe) - - MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host - (zhihai xu via jlowe) - - MAPREDUCE-6191. Improve clearing stale state of Java serialization - testcase. (Sam Liu via Eric Yang) - - MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader - and IndexOutOfBoundsException. (Junping Du via vvasudev) - -Release 2.7.2 - 2016-01-25 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to getMapOutputInfo - if mapId is not in the cache. (zhihai xu via devaraj) - - MAPREDUCE-6426. TestShuffleHandler#testGetMapOutputInfo is failing. - (zhihai xu via devaraj) - - MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the - allocate call. (Anubhav Dhoot via kasha) - - MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol - provider's constructor (Chang Li via ozawa) - - MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file - descriptors (Kuhu Shukla via jlowe) - - MAPREDUCE-6472. MapReduce AM should have java.io.tmpdir=./tmp to be - consistent with tasks (Naganarasimha G R via jlowe) - - MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle - multibyte record delimiters well (Vinayakumar B, Rushabh Shah, and Akira - AJISAKA via jlowe) - - MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong - position/key information for uncompressed input sometimes. (Zhihai Xu via - jlowe) - - MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can - disappear (Chang Li via jlowe) - - MAPREDUCE-6492. AsyncDispatcher exit with NPE on - TaskAttemptImpl#sendJHStartEventForAssignedFailTask (Bibin A Chundatt via - jlowe) - - MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections (Chang Li via - jlowe) - - MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists to - avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state. - (zhihai xu via devaraj) - - MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary() - (Junping Du via jlowe) - - MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when - strategy is dynamic (Kuhu Shukla via kihwal) - -Release 2.7.1 - 2015-07-06 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6252. JobHistoryServer should not fail when encountering a - missing directory. (Craig Welch via devaraj) - - MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon - IOException during InMemoryMapOutput shuffle handler (Eric Payne via jlowe) - - MAPREDUCE-6339. Job history file is not flushed correctly because isTimerActive - flag is not set true when flushTimerTask is scheduled. (zhihai xu via devaraj) - - MAPREDUCE-6259. IllegalArgumentException due to missing job submit time - (zhihai xu via jlowe) - - MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so - that they don't fail on history-server backed by DFSes with not so strong - guarantees. (Craig Welch via vinodkv) - - MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at - the end. (Arun Suresh via kasha) - - MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) - UGI to refresh log and cleaner settings. (Varun Saxena via vinodkv) - -Release 2.7.0 - 2015-04-20 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - MAPREDUCE-6227. DFSIO for truncate. (shv via yliu) - - MAPREDUCE-6228. Add truncate operation to SLive. (Plamen Jeliazkov via shv) - - MAPREDUCE-5583. Ability to limit running map and reduce tasks. - (Jason Lowe via junping_du) - - IMPROVEMENTS - - MAPREDUCE-6149. Document override log4j.properties in MR job. - (Junping Du via harsh) - - MAPREDUCE-6194. Bubble up final exception in failures during creation - of output collectors (Varun Saxena via harsh) - - MAPREDUCE-5420. Remove mapreduce.task.tmp.dir from mapred-default.xml - (James Carman via harsh) - - MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle - log (Gera Shegalov via jlowe) - - MAPREDUCE-6046. Change the class name for logs in RMCommunicator - (Sahil Takiar via devaraj) - - HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch - (ozawa) - - MAPREDUCE-6173. Document the configuration of deploying MR over distributed - cache with enabling wired encryption at the same time. - (Junping Du via xgong) - - MAPREDUCE-6141. History server leveldb recovery store (jlowe) - - MAPREDUCE-6150. Update document of Rumen (Masatake Iwasaki via aw) - - MAPREDUCE-6151. Update document of GridMix (Masatake Iwasaki via aw) - - MAPREDUCE-6143. add configuration for mapreduce speculative execution in - MR2 (zxu via rkanter) - - MAPREDUCE-5800. Use Job#getInstance instead of deprecated constructors - (aajisaka) - - MAPREDUCE-6253. Update use of Iterator to Iterable. (Ray Chiang via devaraj) - - MAPREDUCE-5335. Rename Job Tracker terminology in ShuffleSchedulerImpl. - (devaraj via ozawa) - - MAPREDUCE-4431. mapred command should print the reason on killing already - completed jobs. (devaraj via ozawa) - - MAPREDUCE-6255. Fix JobCounter's format to use grouping separator. - (Ryu Kobayashi via ozawa) - - MAPREDUCE-6256. Removed unused private methods in o.a.h.mapreduce.Job.java. - (Naganarasimha G R via ozawa) - - MAPREDUCE-6225. Fix new findbug warnings in hadoop-mapreduce-client-core. - (Varun Saxena via junping_du) - - MAPREDUCE-6264. Remove httpclient dependency from hadoop-mapreduce-client. - (Brahma Reddy Battula via aajisaka) - - MAPREDUCE-5612. Add javadoc for TaskCompletionEvent.Status. - (Chris Palmer via aajisaka) - - MAPREDUCE-6248. Exposed the internal MapReduce job's information as a public - API in DistCp. (Jing Zhao via vinodkv) - - MAPREDUCE-6263. Configurable timeout between YARNRunner terminate the - application and forcefully kill. (Eric Payne via junping_du) - - MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable - to better control to launch/kill containers. (Zhihai Xu via ozawa) - - MAPREDUCE-6292. Use org.junit package instead of junit.framework in - TestCombineFileInputFormat. (aajisaka) - - OPTIMIZATIONS - - MAPREDUCE-6169. MergeQueue should release reference to the current item - from key and value at the end of the iteration to save memory. - (Zhihai Xu via kasha) - - MAPREDUCE-6059. Speed up history server startup time (Siqi Li via aw) - - MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output - files. (Siqi Li via gera) - - BUG FIXES - - MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationId() - for logging AttemptId in RMContainerAllocator.java (Leitao Guo via aajisaka) - - MAPREDUCE-6177. Minor typo in the EncryptedShuffle document about - ssl-client.xml (Yangping Wu via harsh) - - MAPREDUCE-5918. LineRecordReader can return the same decompressor to - CodecPool multiple times (Sergey Murylev via raviprak) - - MAPREDUCE-6162. mapred hsadmin fails on a secure cluster (jlowe) - - MAPREDUCE-6049. AM JVM does not exit if MRClientService graceful shutdown - fails (Rohith via devaraj) - - MAPREDUCE-5568. Fixed CompletedJob in JHS to show progress percentage - correctly in case the number of mappers or reducers is zero. (MinJi Kim via - jianhe) - - MAPREDUCE-6172. TestDbClasses timeouts are too aggressive (Varun Saxena - via jlowe) - - MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol - interface implementation. (Rohith via jlowe) - - MAPREDUCE-4879. TeraOutputFormat may overwrite an existing output - directory. (gera) - - MAPREDUCE-6045. need close the DataInputStream after open it in - TestMapReduce.java (zxu via rkanter) - - MAPREDUCE-6206. TestAggregatedTransferRate fails on non-US systems (Jens - Rabe via jlowe) - - MAPREDUCE-3283. mapred classpath CLI does not display the complete classpath - (Varun Saxena via cnauroth) - - MAPREDUCE-6231. Grep example job is not working on a fully-distributed - cluster. (aajisaka) - - MAPREDUCE-6243. Fix findbugs warnings in hadoop-rumen. (Masatake Iwasaki - via aajisaka) - - MAPREDUCE-5988. Fix dead links to the javadocs in mapreduce project. - (aajisaka) - - MAPREDUCE-6186. Redundant call to requireJob() while displaying the conf - page (Rohit Agarwal via jlowe) - - MAPREDUCE-6233. org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort - failed in trunk (zxu via rkanter) - - MAPREDUCE-6221. Stringifier is left unclosed in Chain#getChainElementConf(). - (Ted Yu via ozawa) - - MAPREDUCE-4286. TestClientProtocolProviderImpls passes on failure - conditions. (Devaraj K via ozawa) - - MAPREDUCE-6261. NullPointerException if MapOutputBuffer.flush invoked - twice (Tsuyoshi OZAWA via jlowe) - - MAPREDUCE-2815. JavaDoc does not generate correctly for - MultithreadedMapRunner. (Chris Palmer via aajisaka) - - MAPREDUCE-6223. TestJobConf#testNegativeValueForTaskVmem failures. - (Varun Saxena via kasha) - - MAPREDUCE-6268. Fix typo in Task Attempt API's URL. (Ryu Kobayashi - via ozawa) - - MAPREDUCE-6136. MRAppMaster doesn't shutdown file systems. (Brahma - Reddy Battula via ozawa) - - MAPREDUCE-5657. Fix Javadoc errors caused by incorrect or illegal tags in doc - comments. (Akira AJISAKA and Andrew Purtell via ozawa) - - MAPREDUCE-4742. Fix typo in nnbench#displayUsage. (Liang Xie via ozawa) - - MAPREDUCE-6277. Job can post multiple history files if attempt loses - connection to the RM (Chang Li via jlowe) - - MAPREDUCE-6275. Race condition in FileOutputCommitter v2 for - user-specified task output subdirs (Gera Shegalov and Siqi Li via jlowe) - - MAPREDUCE-6285. ClientServiceDelegate should not retry upon - AuthenticationException. (Jonathan Eagles via ozawa) - -Release 2.6.5 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host - (zhihai xu via jlowe) - - MAPREDUCE-6191. Improve clearing stale state of Java serialization - testcase. (Sam Liu via Eric Yang) - - MAPREDUCE-6635. Unsafe long to int conversion in UncompressedSplitLineReader - and IndexOutOfBoundsException. (Junping Du via vvasudev) - -Release 2.6.4 - 2016-02-11 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - MAPREDUCE-6436. JobHistory cache issue. (Kai Sasaki via zxu) - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6577. MR AM unable to load native library without - MR_AM_ADMIN_USER_ENV set (sjlee) - - MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can - disappear (Chang Li via jlowe) - - MAPREDUCE-6492. AsyncDispatcher exit with NPE on - TaskAttemptImpl#sendJHStartEventForAssignedFailTask (Bibin A Chundatt via - jlowe) - - MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple - mappers. (Vlad Sharanhovich and Bibin A Chundatt via aajisaka) - - MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in - MRAppMaster#parsePreviousJobHistory (Bibin A Chundatt via jlowe) - - MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. - (Xuan Gong via jlowe) - - MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal() (Xuan Gong - via jlowe) - -Release 2.6.3 - 2015-12-17 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists to - avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state. - (zhihai xu via devaraj) - - MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary() - (Junping Du via jlowe) - - MAPREDUCE-6377. JHS sorting on state column not working in webUi. - (zhihai xu via devaraj) - - MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle - multibyte record delimiters well (Vinayakumar B, Rushabh Shah, and Akira - AJISAKA via jlowe) - - MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong - position/key information for uncompressed input sometimes. (Zhihai Xu via - jlowe) - - MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly - misleading (Nathan Roberts via jlowe) - - MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause - duplicate records (wilfreds via rkanter) - -Release 2.6.2 - 2015-10-28 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed - cache files so that child processes running hadoop scripts can access these - files. (Junping Du via vinodkv) - - MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon - IOException during InMemoryMapOutput shuffle handler (Eric Payne via jlowe) - - MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in - JobHistoryEventHandler. (Shinichi Yamashita via aajisaka) - -Release 2.6.1 - 2015-09-23 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of - reusing conections. (Kannan Rajah via ozawa) - - MAPREDUCE-6166. Reducers do not validate checksum of map outputs when - fetching directly to disk. (Eric Payne via gera) - - MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken - service name properly. (Jason Lowe via jianhe) - - MAPREDUCE-6303. Read timeout when retrying a fetch error can be fatal - to a reducer. (Jason Lowe via junping_du) - - MAPREDUCE-6300. Task list sort by task id broken. (Siqi Li via aajisaka) - - MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own - class. (Chris Trezzo via kasha) - - MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options - which is a regression from MR1 (zxu via rkanter) - - MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM - tokens when they roll-over. (Jason Lowe via vinodkv) - - MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge - (Gera Shegalov via jlowe) - - MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between - copySucceeded() in one thread and copyFailed() in another thread on the - same host. (Junping Du via ozawa) - -Release 2.6.0 - 2014-11-18 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. - (Robert Kanter via zjshen) - - IMPROVEMENTS - - MAPREDUCE-5971. Move the default options for distcp -p to - DistCpOptionSwitch. (clamb via wang) - - MAPREDUCE-5963. ShuffleHandler DB schema should be versioned with - compatible/incompatible changes (Junping Du via jlowe) - - MAPREDUCE-883. harchive: Document how to unarchive (Akira AJISAKA and - Koji Noguchi via aw) - - MAPREDUCE-4791. Javadoc for KeyValueTextInputFormat should include default - separator and how to change it (Akira AJISAKA via aw) - - MAPREDUCE-5906. Inconsistent configuration in property - "mapreduce.reduce.shuffle.input.buffer.percent" (Akira AJISAKA via aw) - - MAPREDUCE-5974. Allow specifying multiple MapOutputCollectors with - fallback. (Todd Lipcon via kasha) - - MAPREDUCE-5130. Add missing job config options to mapred-default.xml - (Ray Chiang via Sandy Ryza) - - MAPREDUCE-5891. Improved shuffle error handling across NM restarts - (Junping Du via jlowe) - - MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN - scheduler resource type is memory plus cpu. (Peng Zhang and Varun Vasudev - via zjshen) - - MAPREDUCE-6072. Remove INSTALL document (Akira AJISAKA via aw) - - MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling (Gera - Shegalov via jlowe) - - MAPREDUCE-6018. Added an MR specific config to enable emitting job history - data to the timeline server. (Robert Kanter via zjshen) - - MAPREDUCE-6052. Supported overriding the default container-log4j.properties - file per job. (Junping Du via zjshen) - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-5866. TestFixedLengthInputFormat fails in windows. - (Varun Vasudev via cnauroth) - - MAPREDUCE-5956. Made MR AM not use maxAttempts to determine if the current - attempt is the last retry. (Wangda Tan via zjshen) - - MAPREDUCE-5957. AM throws ClassNotFoundException with job classloader - enabled if custom output format/committer is used (Sangjin Lee via jlowe) - - MAPREDUCE-5756. CombineFileInputFormat.getSplits() including directories - in its results (Jason Dere via jlowe) - - MAPREDUCE-6014. New task status field in task attempts table can lead to - an empty web page (Mit Desai via jlowe) - - MAPREDUCE-6021. MR AM should have working directory in LD_LIBRARY_PATH - (jlowe) - - MAPREDUCE-6010. HistoryServerFileSystemStateStore fails to update tokens - (jlowe) - - MAPREDUCE-5878. some standard JDK APIs are not part of system classes - defaults (Sangjin Lee via jlowe) - - MAPREDUCE-5944. Remove MRv1 commands from CommandsManual.apt.vm - (Akira AJISAKA via aw) - - MAPREDUCE-5943. Separate mapred commands from CommandManual.apt.vm - (Akira AJISAKA via aw) - - MAPREDUCE-5363. Fix doc and spelling for TaskCompletionEvent#getTaskStatus - and getStatus (Akira AJISAKA via aw) - - MAPREDUCE-5595. Typo in MergeManagerImpl.java (Akira AJISAKA via aw) - - MAPREDUCE-5597. Missing alternatives in javadocs for deprecated constructors - in mapreduce.Job (Akira AJISAKA via aw) - - MAPREDUCE-5950. incorrect description in distcp2 document (Akira AJISAKA - via aw) - - MAPREDUCE-5998. CompositeInputFormat javadoc is broken (Akira AJISAKA via - aw) - - MAPREDUCE-5999. Fix dead link in InputFormat javadoc (Akira AJISAKA via aw) - - MAPREDUCE-6032. Made MR jobs write job history files on the default FS when - the current context's FS is different. (Benjamin Zhitomirsky via zjshen) - - MAPREDUCE-6024. Shortened the time when Fetcher is stuck in retrying before - concluding the failure by configuration. (Yunjiong Zhao via zjshen) - - MAPREDUCE-6036. TestJobEndNotifier fails intermittently in branch-2 (chang - li via jlowe) - - MAPREDUCE-6012. DBInputSplit creates invalid ranges on Oracle. - (Wei Yan via kasha) - - MAPREDUCE-6044. Fully qualified intermediate done dir path breaks per-user dir - creation on Windows. (zjshen) - - MAPREDUCE-5885. build/test/test.mapred.spill causes release audit warnings - (Chen He via jlowe) - - BREAKDOWN OF HDFS-6134 AND HADOOP-10150 SUBTASKS AND RELATED JIRAS - - MAPREDUCE-5890. Support for encrypting Intermediate - data and spills in local filesystem. (asuresh via tucu) - - MAPREDUCE-6007. Add support to distcp to preserve raw.* namespace - extended attributes. (clamb) - - MAPREDUCE-6041. Fix TestOptionsParser. (clamb) - -- - - MAPREDUCE-6051. Fix typos in log messages. (Ray Chiang via cdouglas) - - MAPREDUCE-5931. Validate SleepJob command line parameters (Gera Shegalov - via jlowe) - - MAPREDUCE-6063. Correct spill size calculation for spills wrapping the - circular buffer. (zhihai xu via cdouglas) - - MAPREDUCE-6071. JobImpl#makeUberDecision doesn't log that Uber mode is - disabled because of too much CPUs (Tsuyoshi OZAWA via jlowe) - - MAPREDUCE-6075. HistoryServerFileSystemStateStore can create zero-length - files (jlowe) - - MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but - is not documented (Tsuyoshi OZAWA via jlowe) - - MAPREDUCE-6090. mapred hsadmin getGroups fails to connect in some cases - (Robert Kanter via jlowe) - - MAPREDUCE-6086. mapreduce.job.credentials.binary should allow all URIs. - (Zhihai Xu via kasha) - - MAPREDUCE-6091. YARNRunner.getJobStatus() fails with - ApplicationNotFoundException if the job rolled off the RM view (Sangjin - Lee via jlowe) - - MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs (Gera Shegalov - via jlowe) - - MAPREDUCE-6104. TestJobHistoryParsing.testPartialJob fails in branch-2 - (Mit Desai via jlowe) - - MAPREDUCE-6109. Fix minor typo in distcp -p usage text (Charles Lamb - via aw) - - MAPREDUCE-6093. minor distcp doc edits (Charles Lamb via aw) - - MAPREDUCE-5831. Make MR client ignore unknown counters received from AM. - (Junping Du via zjshen) - - MAPREDUCE-6073. Description of mapreduce.job.speculative.slowtaskthreshold - in mapred-default should be moved into description tags (Tsuyoshi OZAWA - via aw) - - MAPREDUCE-5796. Use current version of the archive name in - DistributedCacheDeploy document (Akira AJISAKA via aw) - - MAPREDUCE-5945. Update the description of GenericOptionsParser -jt - option (Akira AJISAKA via aw) - - MAPREDUCE-6087. Fixed wrong config name of - MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by - Akira AJISAKA. (Akira AJISAKA via jianhe) - - MAPREDUCE-6094. TestMRCJCFileInputFormat.testAddInputPath() fails on trunk - (Akira AJISAKA via jlowe) - - MAPREDUCE-6029. TestCommitterEventHandler fails in trunk (Mit Desai via - jlowe) - - MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked - out of git with incorrect line endings. (cnauroth) - - MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 - MiniDFSCluster instances. (cnauroth) - - MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails (Mit Desai via - jlowe) - - MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk (Binglin - Chang via jlowe) - - MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting - for maps (Siqi Li via jlowe) - - MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE in - client (Rohith via jlowe) - - MAPREDUCE-6126. Fixed Rumen JobBuilder to ignore NormalizedResourceEvent. - (Junping Du via jianhe) - - MAPREDUCE-6142. Fixed test failures in TestJobHistoryEventHandler and - TestMRTimelineEventHandling. (Zhijie Shen via vinodkv) - - MAPREDUCE-6022. map_input_file is missing from streaming job environment. - (jlowe via kihwal) - - MAPREDUCE-6048. Fixed TestJavaSerialization failure. (Varun Vasudev via - jianhe) - - MAPREDUCE-5960. JobSubmitter's check whether job.jar is local is incorrect - with no authority in job jar path. (Gera Shegalov via jlowe) - - MAPREDUCE-5958. Wrong reduce task progress if map output is compressed - (Emilio Coppa and jlowe via kihwal) - - MAPREDUCE-6156. Fetcher - connect() doesn't handle connection refused - correctly (Junping Du via jlowe) - -Release 2.5.2 - 2014-11-19 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - -Release 2.5.1 - 2014-09-05 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-6033. Updated access check for displaying job information - (Yu Gao via Eric Yang) - -Release 2.5.0 - 2014-08-11 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - MAPREDUCE-5671. NaN can be created by client and assign to Progress (Chen - He via jeagles) - - MAPREDUCE-5665. Add audience annotations to MiniMRYarnCluster and - MiniMRCluster. (Anubhav Dhoot via kasha) - - MAPREDUCE-5765. Update hadoop-pipes examples README (Mit Desai via jeagles) - - MAPREDUCE-5713. InputFormat and JobConf JavaDoc Fixes (Chen He via jeagles) - - MAPREDUCE-5456. TestFetcher.testCopyFromHostExtraBytes is missing (Jason - Lowe via jeagles) - - MAPREDUCE-5804. TestMRJobsWithProfiler#testProfiler timesout (Mit Desai - via kihwal) - - MAPREDUCE-5825. Provide diagnostics for reducers killed during ramp down - (Gera Shegalov via jlowe) - - MAPREDUCE-5836. Fix typo in RandomTextWriter (Akira AJISAKA via jeagles) - - MAPREDUCE-5852. Prepare MapReduce codebase for JUnit 4.11. (cnauroth) - - MAPREDUCE-5639. Port DistCp2 document to trunk (Akira AJISAKA via jeagles) - - MAPREDUCE-5812. Make job context available to - OutputCommitter.isRecoverySupported() (Mohammad Kamrul Islam via jlowe) - - MAPREDUCE-5638. Port Hadoop Archives document to trunk (Akira AJISAKA via - jeagles) - - MAPREDUCE-5402. In DynamicInputFormat, change MAX_CHUNKS_TOLERABLE, - MAX_CHUNKS_IDEAL, MIN_RECORDS_PER_CHUNK and SPLIT_RATIO to be configurable. - (Tsuyoshi OZAWA via szetszwo) - - MAPREDUCE-5637. Convert Hadoop Streaming document to APT (Akira AJISAKA via - jeagles) - - MAPREDUCE-5636. Convert MapReduce Tutorial document to APT (Akira AJISAKA - via jeagles) - - MAPREDUCE-5774. Job overview in History UI should list reducer phases in - chronological order. (Gera Shegalov via kasha) - - MAPREDUCE-5652. NM Recovery. ShuffleHandler should handle NM restarts. - (Jason Lowe via kasha) - - MAPREDUCE-5861. finishedSubMaps field in LocalContainerLauncher does not - need to be volatile. (Tsuyoshi OZAWA via junping_du) - - MAPREDUCE-5809. Enhance distcp to support preserving HDFS ACLs. (cnauroth) - - MAPREDUCE-5899. Support incremental data copy in DistCp. (jing9) - - MAPREDUCE-5886. Allow wordcount example job to accept multiple input paths. - (cnauroth) - - MAPREDUCE-5834. Increased test-timeouts in TestGridMixClasses to avoid - occassional failures. (Mit Desai via vinodkv) - - MAPREDUCE-5896. InputSplits should indicate which locations have the block - cached in memory. (Sandy Ryza via kasha) - - MAPREDUCE-5844. Add a configurable delay to reducer-preemption. - (Maysam Yabandeh via kasha) - - MAPREDUCE-5790. Made it easier to enable hprof profile options by default. - (Gera Shegalov via vinodkv) - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-5759. Remove unnecessary conf load in Limits (Sandy Ryza) - - MAPREDUCE-5014. Extend Distcp to accept a custom CopyListing. - (Srikanth Sundarrajan via amareshwari) - - MAPREDUCE-5775. Remove unnecessary job.setNumReduceTasks in SleepJob.createJob - (jhanver chand sharma via devaraj) - - MAPREDUCE-4937. MR AM handles an oversized split metainfo file poorly - (Eric Payne via jlowe) - - MAPREDUCE-5642. TestMiniMRChildTask fails on Windows. - (Chuan Liu via cnauroth) - - MAPREDUCE-5846. Rumen doesn't understand JobQueueChangedEvent (Nathan Roberts via raviprak) - - MAPREDUCE-5837. MRAppMaster fails when checking on uber mode. (wheat9) - - MAPREDUCE-5749. TestRMContainerAllocator#testReportedAppProgress Failed - (jlowe) - - MAPREDUCE-5884. History server uses short user name when canceling tokens - (Mohammad Kamrul Islam via jlowe) - - MAPREDUCE-5888. Failed job leaves hung AM after it unregisters (Jason Lowe - via jeagles) - - MAPREDUCE-5814. fat jar with *-default.xml may fail when - mapreduce.job.classloader=true. (Gera Shegalov via jlowe) - - MAPREDUCE-5309. 2.0.4 JobHistoryParser can't parse certain failed job - history files generated by 2.0.3 history server (Rushabh S Shah via jlowe) - - MAPREDUCE-5862. Line records longer than 2x split size aren't handled - correctly (bc Wong via jlowe) - - MAPREDUCE-5895. Close streams properly to avoid leakage in TaskLog. - (Kousuke Saruta via devaraj) - - MAPREDUCE-5777. Support utf-8 text with Byte Order Marker. - (Zhihai Xu via kasha) - - MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs) - (Yi Liu via umamahesh) - - MAPREDUCE-5920. Add Xattr option in DistCp docs. (Yi Liu via cnauroth) - - MAPREDUCE-5924. Changed TaskAttemptImpl to ignore TA_COMMIT_PENDING event - at COMMIT_PENDING state. (Zhijie Shen via jianhe) - - MAPREDUCE-5939. StartTime showing up as the epoch time in JHS UI after - upgrade (Chen He via jlowe) - - MAPREDUCE-5900. Changed to the interpret container preemption exit code as a - task attempt killing event. (Mayank Bansal via zjshen) - - MAPREDUCE-5868. Fixed an issue with TestPipeApplication that was causing the - nightly builds to fail. (Akira Ajisaka via vinodkv) - - MAPREDUCE-5517. Fixed MapReduce ApplicationMaster to not validate reduce side - resource configuration for deciding uber-mode on map-only jobs. (Siqi Li via - vinodkv) - - MAPREDUCE-5952. LocalContainerLauncher#renameMapOutputForReduce incorrectly - assumes a single dir for mapOutIndex. (Gera Shegalov via kasha) - - MAPREDUCE-6002. Made MR task avoid reporting error to AM when the task process - is shutting down. (Wangda Tan via zjshen) - -Release 2.4.1 - 2014-06-23 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - MAPREDUCE-5830. Added back the private API HostUtil.getTaskLogUrl(..) for - binary compatibility with older clients like Hive 0.13. (Akira Ajisaka via - vinodkv) - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-5818. Added "hsadmin" command into mapred.cmd. (Jian He via zjshen) - - MAPREDUCE-5824. Fixed test-failure of TestPipesNonJavaInputFormat in - Windows. (Xuan Gong via vinodkv) - - MAPREDUCE-5815. Fixed test-failure of TestMRAppMaster by making MRAppMaster - gracefully handle empty-queue names. (Akira Ajisaka via vinodkv) - - MAPREDUCE-5826. Fixed HistoryServerFileSystemStore to use right permissions - on Windows for temporary files and thus also fix the test-issue with - TestHistoryServerFileSystemStateStoreService. (Varun Vasudev via vinodkv) - - MAPREDUCE-5828. Fixed a test issue with TestMapReduceJobControl that was - causing it to fail on Windows. (vinodkv) - - MAPREDUCE-5827. TestSpeculativeExecutionWithMRApp fails. - (Zhijie Shen via cnauroth) - - MAPREDUCE-5833. TestRMContainerAllocator fails ocassionally. - (Zhijie Shen via cnauroth) - - MAPREDUCE-5832. Fixed TestJobClient to not fail on JDK7 or on Windows. (Jian - He and Vinod Kumar Vavilapalli via vinodkv) - - MAPREDUCE-5841. uber job doesn't terminate on getting mapred job kill - (Sangjin Lee via jlowe) - - MAPREDUCE-5843. Fixed TestMRKeyValueTextInputFormat to not leak files and - thus avoid failing on Windows. (Varun Vasudev via vinodkv) - - MAPREDUCE-5835. Killing Task might cause the job to go to ERROR state - (Ming Ma via jlowe) - - MAPREDUCE-5821. Avoid unintentional reallocation of byte arrays in segments - during merge. (Todd Lipcon via cdouglas) - -Release 2.4.0 - 2014-04-07 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - MAPREDUCE-5787. Added the ability to keep alive shuffle connections in the - MapReduce shuffle-handler. (Rajesh Balamohan via vinodkv) - - IMPROVEMENTS - - MAPREDUCE-5464. Add analogs of the SLOTS_MILLIS counters that jive with the - YARN resource model (Sandy Ryza) - - MAPREDUCE-5732. Report proper queue when job has been automatically placed - (Sandy Ryza) - - MAPREDUCE-5699. Allow setting tags on MR jobs (kasha) - - MAPREDUCE-5761. Added a simple log message to denote when encrypted shuffle - is on in the shuffle-handler. (Jian He via vinodkv) - - MAPREDUCE-5754. Preserve Job diagnostics in history (Gera Shegalov via - jlowe) - - MAPREDUCE-5766. Moved ping messages from TaskAttempts to be at DEBUG level - inside the ApplicationMaster log. (Jian He via vinodkv) - - MAPREDUCE-5773. Provide dedicated MRAppMaster syslog length limit (Gera - Shegalov via jlowe) - - MAPREDUCE-5553. Allow users to easily access - completed/pending/successful/failed tasks on MR AM web-ui. (Paul Han via - acmurthy) - - MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to - handle cross platform application submissions. (Jian He via vinodkv) - - MAPREDUCE-2349. Modified FileInputFormat to be able to issue file and block - location calls in parallel. (Siddharth Seth via vinodkv) - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-5746. Job diagnostics can implicate wrong task for a failed job. - (Jason Lowe via kasha) - - MAPREDUCE-5670. CombineFileRecordReader should report progress when moving - to the next file (Chen He via jlowe) - - MAPREDUCE-5757. ConcurrentModificationException in JobControl.toList - (jlowe) - - MAPREDUCE-5770. Fixed MapReduce ApplicationMaster to correctly redirect - to the YARN's web-app proxy with the correct scheme prefix. (Jian He via - vinodkv) - - MAPREDUCE-5768. TestMRJobs.testContainerRollingLog fails on trunk (Gera - Shegalov via jlowe) - - MAPREDUCE-5780. SliveTest should use the specified path to get the - particular FileSystem instead of using the default FileSystem. (szetszwo) - - MAPREDUCE-5028. Fixed a bug in MapTask that was causing mappers to fail - when a large value of io.sort.mb is set. (Karthik Kambatla via vinodkv) - - MAPREDUCE-5778. JobSummary does not escape newlines in the job name (Akira - AJISAKA via jlowe) - - MAPREDUCE-5789. Average Reduce time is incorrect on Job Overview page - (Rushabh S Shah via jlowe) - - MAPREDUCE-5794. SliveMapper always uses default FileSystem. (szetszwo via - Arpit Agarwal) - - MAPREDUCE-5751. MR app master fails to start in some cases if - mapreduce.job.classloader is true (Sangjin Lee via jlowe) - - MAPREDUCE-5688. TestStagingCleanup fails intermittently with JDK7 (Mit - Desai via jeagles) - - MAPREDUCE-5769. Unregistration to RM should not be called if AM is crashed - before registering with RM (Rohith via jlowe) - - MAPREDUCE-5570. Map task attempt with fetch failure has incorrect attempt - finish time (Rushabh S Shah via jlowe) - - MAPREDUCE-5806. Fixed a bug in MRAppMaster so as to enable users to properly - override HADOOP_ROOT_LOGGER or HADOOP_CLIENT_OPTS. (Varun Vasudev via - vinodkv) - - MAPREDUCE-5791. Shuffle phase is slow in Windows - - FadviseFileRegion::transferTo does not read disks efficiently. - (Nikola Vujic via cnauroth) - - MAPREDUCE-5795. Fixed MRAppMaster to record the correct job-state after it - recovers from a commit during a previous attempt. (Xuan Gong via vinodkv) - - MAPREDUCE-5805. Fixed MapReduce JobHistory encoding of queue-name to escape - hyphens and thus avoid parsing errors. (Akira AJISAKA via vinodkv) - - MAPREDUCE-5810. Removed the faulty and failing streaming test - TestStreamingTaskLog. (Akira Ajisaka via vinodkv) - - MAPREDUCE-5813. Fix YarnChild to explicitly load job.xml from the - local-filesystem, rather than rely on the classpath. (Gera Shegalov via - acmurthy) - -Release 2.3.1 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - -Release 2.3.0 - 2014-02-18 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - MAPREDUCE-5265. History server admin service to refresh user and superuser - group mappings (Ashwin Shankar via jlowe) - - MAPREDUCE-5356. Ability to refresh aggregated log retention period and - check interval (Ashwin Shankar via jlowe) - - MAPREDUCE-5386. Ability to refresh history server job retention and job - cleaner settings (Ashwin Shankar via jlowe) - - MAPREDUCE-5411. Refresh size of loaded job cache on history server (Ashwin - Shankar via jlowe) - - MAPREDUCE-5332. Support token-preserving restart of history server (jlowe) - - IMPROVEMENTS - - MAPREDUCE-5329. Allow MR applications to use additional AuxServices, - which are compatible with the default MapReduce shuffle. - (Avner BenHanoch via sseth) - - MAPREDUCE-5463. Deprecate SLOTS_MILLIS counters (Tzuyoshi Ozawa via Sandy - Ryza) - - MAPREDUCE-5457. Add a KeyOnlyTextOutputReader to enable streaming to write - out text files without separators (Sandy Ryza) - - MAPREDUCE-5596. Allow configuring the number of threads used to serve - shuffle connections (Sandy Ryza via jlowe) - - MAPREDUCE-434. LocalJobRunner limited to single reducer (Sandy Ryza and - Aaron Kimball via Sandy Ryza) - - MAPREDUCE-4421. Run MapReduce framework via the distributed cache (jlowe) - - MAPREDUCE-1176. FixedLengthInputFormat and FixedLengthRecordReader - (Mariappan Asokan and BitsOfInfo via Sandy Ryza) - - MAPREDUCE-5613. DefaultSpeculator holds and checks hashmap that is always - empty (Gera Shegalov via Sandy Ryza) - - MAPREDUCE-5431. Missing pom dependency in MR-client (Timothy St. Clair - via stevel) - - MAPREDUCE-5624 Move grizzly-test and junit dependencies to test scope - (Ted Yu via stevel) - - MAPREDUCE-5481. Enable uber jobs to have multiple reducers (Sandy Ryza) - - MAPREDUCE-5052. Job History UI and web services confusing job start time and - job submit time (Chen He via jeagles) - - MAPREDUCE-5692. Add explicit diagnostics when a task attempt is killed due - to speculative execution (Gera Shegalov via Sandy Ryza) - - MAPREDUCE-5550. Task Status message (reporter.setStatus) not shown in UI - with Hadoop 2.0 (Gera Shegalov via Sandy Ryza) - - MAPREDUCE-3310. Custom grouping comparator cannot be set for Combiners (tucu) - - MAPREDUCE-5672. Provide optional RollingFileAppender for container log4j - (syslog) (Gera Shegalov via jlowe) - - MAPREDUCE-5725. Make explicit that TestNetworkedJob relies on the Capacity - Scheduler (Sandy Ryza) - - MAPREDUCE-5744. Job hangs because - RMContainerAllocator$AssignedRequests.preemptReduce() violates the - comparator contract (Gera Shegalov via kasha) - - OPTIMIZATIONS - - MAPREDUCE-4680. Job history cleaner should only check timestamps of files in - old enough directories (Robert Kanter via Sandy Ryza) - - MAPREDUCE-5484. YarnChild unnecessarily loads job conf twice (Sandy Ryza) - - MAPREDUCE-5487. In task processes, JobConf is unnecessarily loaded again - in Limits (Sandy Ryza) - - MAPREDUCE-5601. ShuffleHandler fadvises file regions as DONTNEED even when - fetch fails (Sandy Ryza) - - BUG FIXES - - MAPREDUCE-5569. FloatSplitter is not generating correct splits (Nathan - Roberts via jlowe) - - MAPREDUCE-5546. mapred.cmd on Windows set HADOOP_OPTS incorrectly (Chuan Liu - via cnauroth) - - MAPREDUCE-5518. Fixed typo "can't read paritions file". (Albert Chu - via devaraj) - - MAPREDUCE-5561. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl - testcase failing on trunk (Karthik Kambatla via jlowe) - - MAPREDUCE-5598. TestUserDefinedCounters.testMapReduceJob is flakey - (Robert Kanter via jlowe) - - MAPREDUCE-5604. TestMRAMWithNonNormalizedCapabilities fails on Windows due to - exceeding max path length. (cnauroth) - - MAPREDUCE-5451. MR uses LD_LIBRARY_PATH which doesn't mean anything in - Windows. (Yingda Chen via cnauroth) - - MAPREDUCE-5409. MRAppMaster throws InvalidStateTransitonException: Invalid - event: TA_TOO_MANY_FETCH_FAILURE at KILLED for TaskAttemptImpl (Gera - Shegalov via jlowe) - - MAPREDUCE-5674. Missing start and finish time in mapred.JobStatus. - (Chuan Liu via cnauroth) - - MAPREDUCE-5650. Job fails when hprof mapreduce.task.profile.map/reduce.params - is specified (Gera Shegalov via Sandy Ryza) - - MAPREDUCE-5316. job -list-attempt-ids command does not handle illegal - task-state (Ashwin Shankar via jlowe) - - MAPREDUCE-5380. Invalid mapred command should return non-zero exit code - (Stephen Chu via jlowe) - - MAPREDUCE-5404. HSAdminServer does not use ephemeral ports in minicluster - mode (Ted Yu via jlowe) - - MAPREDUCE-5522. Incorrect oreder expected from JobQueueInfo (Jinghui Wang - via bobby) - - MAPREDUCE-5514. Fix TestRMContainerAllocator. (Zhijie Shen via acmurthy) - - MAPREDUCE-5102. fix coverage org.apache.hadoop.mapreduce.lib.db and - org.apache.hadoop.mapred.lib.db (Aleksey Gorshkov, Andrey Klochkov, and - Nathan Roberts via jlowe) - - MAPREDUCE-5585. TestCopyCommitter#testNoCommitAction Fails on JDK7 - (jeagles) - - MAPREDUCE-5186. mapreduce.job.max.split.locations causes some splits - created by CombineFileInputFormat to fail (Robert Parker and Jason Lowe - via jlowe) - - MAPREDUCE-5610. TestSleepJob fails in jdk7 (Jonathan Eagles via jlowe) - - MAPREDUCE-5616. MR Client-AppMaster RPC max retries on socket timeout is too - high. (cnauroth) - - MAPREDUCE-5625. TestFixedLengthInputFormat fails in jdk7 environment - (Mariappan Asokan via jeagles) - - MAPREDUCE-5631. TestJobEndNotifier.testNotifyRetries fails with Should - have taken more than 5 seconds in jdk7 (Jonathan Eagles via jlowe) - - MAPREDUCE-5645. TestFixedLengthInputFormat fails with native libs (Mit - Desai via jeagles) - - MAPREDUCE-5632. TestRMContainerAllocator#testUpdatedNodes fails (jeagles) - - MAPREDUCE-5656. bzip2 codec can drop records when reading data in splits - (jlowe) - - MAPREDUCE-5623. TestJobCleanup fails because of RejectedExecutionException - and NPE. (jlowe) - - MAPREDUCE-5679. TestJobHistoryParsing has race condition (Liyin Liang via - jlowe) - - MAPREDUCE-5687. Fixed failure in TestYARNRunner caused by YARN-1446. (Jian He - via vinodkv) - - MAPREDUCE-5694. Fixed MR AppMaster to shutdown the LogManager so as to avoid - losing syslog in some conditions. (Mohammad Kamrul Islam via vinodkv) - - MAPREDUCE-5685. Fixed a bug with JobContext getCacheFiles API inside the - WrappedReducer class. (Yi Song via vinodkv) - - MAPREDUCE-5689. MRAppMaster does not preempt reducers when scheduled maps - cannot be fulfilled. (lohit via kasha) - - MAPREDUCE-5724. JobHistoryServer does not start if HDFS is not running. - (tucu) - - MAPREDUCE-5729. mapred job -list throws NPE (kasha) - - MAPREDUCE-5693. Restore MRv1 behavior for log flush (Gera Shegalov via - jlowe) - - MAPREDUCE-5723. MR AM container log can be truncated or empty. - (Mohammad Kamrul Islam via kasha) - - MAPREDUCE-5743. Fixed the test failure in TestRMContainerAllocator. - (Ted Yu and Vinod Kumar Vavilapalli via zjshen) - -Release 2.2.0 - 2013-10-13 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - MAPREDUCE-5504. mapred queue -info inconsistent with types (Kousuke Saruta - via tgraves) - - MAPREDUCE-5488. Changed MR client to keep trying to reach the application - when it sees that on attempt's AM is down. (Jian He via vinodkv) - - MAPREDUCE-5515. Fixed MR AM's webapp to depend on a new config - mapreduce.ssl.enabled to enable https and disabling it by default as MR AM - needs to set up its own certificates etc and not depend on clusters'. - (Omkar Vinit Joshi via vinodkv) - - MAPREDUCE-5505. Clients should be notified job finished only after job - successfully unregistered (Zhijie Shen via bikas) - - MAPREDUCE-5503. Fixed a test issue in TestMRJobClient. (Jian He via vinodkv) - - MAPREDUCE-5170. Fixed a wrong log message in CombineFileInputFormat class. - (Sangjin Lee via vinodkv) - - MAPREDUCE-5525. Increase timeout of TestDFSIO.testAppend and - TestMRJobsWithHistoryService.testJobHistoryData. (Chuan Liu via cnauroth) - - MAPREDUCE-5513. ConcurrentModificationException in JobControl (Robert - Parker via jlowe) - - MAPREDUCE-5531. Fix compat with hadoop-1 in mapreduce.(TaskID, - TaskAttemptID) by re-introducing missing constructors. (Robert Kanter via - acmurthy) - - MAPREDUCE-5545. org.apache.hadoop.mapred.TestTaskAttemptListenerImpl.testCommitWindow - times out (Robert Kanter via jlowe) - - MAPREDUCE-5529. Fix compat with hadoop-1 in mapred.TotalOrderPartitioner - by re-introducing (get,set)PartitionFile which takes in JobConf. (Robert - Kanter via acmurthy) - - MAPREDUCE-5538. Fixed MR AppMaster to send job-notification URL only after - the job is really done - a bug caused by MAPREDUCE-5505. (Zhijie Shen via - vinodkv) - - MAPREDUCE-5551. Fix compat with hadoop-1 in - SequenceFileAsBinaryOutputFormat.WritableValueBytes by re-introducing - missing constructors. (Zhijie Shen via acmurthy) - - MAPREDUCE-5544. JobClient#getJob loads job conf twice. (Sandy Ryza) - - MAPREDUCE-5536. Fixed MR AM and JHS to respect - mapreduce.jobhistory.webapp.https.address. (Omkar Vinit Joshi via vinodkv) - - MAPREDUCE-5530. Fix compat with hadoop-1 in - mapred.lib.CombinFileInputFormat by re-introducing - isSplittable(FileSystem, Path) api and ensuring semantic compatibility. - (Robert Kanter via acmurthy) - - MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN. - (Zhijie Shen via acmurthy) - - MAPREDUCE-5554. hdfs-site.xml included in hadoop-mapreduce-client-jobclient - tests jar is breaking tests for downstream components (Robert Kanter via - Sandy Ryza) - - MAPREDUCE-5489. MR jobs hangs as it does not use the node-blacklisting - feature in RM requests (Zhijie Shen via bikas) - - MAPREDUCE-5442. $HADOOP_MAPRED_HOME/$HADOOP_CONF_DIR setting not working on - Windows. (Yingda Chen via cnauroth) - - MAPREDUCE-5533. Fixed MR speculation code to track any TaskAttempts that - aren't heart-beating for a while, so that we can aggressively speculate - instead of waiting for task-timeout (Xuan Gong via vinodkv) - - MAPREDUCE-5562. Fixed MR App Master to perform pending tasks like staging-dir - cleanup, sending job-end notification correctly when unregister with RM - fails. (Zhijie Shen via vinodkv) - -Release 2.1.1-beta - 2013-09-23 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - MAPREDUCE-5478. TeraInputFormat unnecessarily defines its own FileSplit - subclass (Sandy Ryza) - - MAPREDUCE-5497. Changed MRAppMaster to sleep only after doing everything else - but just before ClientService to avoid race conditions during RM restart. - (Jian He via vinodkv) - - MAPREDUCE-5379. Include token tracking ids in jobconf. (kkambatl via tucu) - - MAPREDUCE-5523. Added separate configuration properties for https for JHS - without which even when https is enabled, it starts on http port itself. - (Omkar Vinit Joshi via vinodkv) - - OPTIMIZATIONS - - MAPREDUCE-5446. TestJobHistoryEvents and TestJobHistoryParsing have race - conditions (jlowe via kihwal) - - MAPREDUCE-5462. In map-side sort, swap entire meta entries instead of - indexes for better cache performance. (Sandy Ryza) - - MAPREDUCE-1981. Improve getSplits performance by using listLocatedStatus - (Hairong Kuang and Jason Lowe via jlowe) - - BUG FIXES - - MAPREDUCE-5385. Fixed a bug with JobContext getCacheFiles API. (Omkar Vinit - Joshi via vinodkv) - - MAPREDUCE-5428. HistoryFileManager doesn't stop threads when service is - stopped (Karthik Kambatla via jlowe) - - MAPREDUCE-5251. Reducer should not implicate map attempt if it has - insufficient space to fetch map output (Ashwin Shankar via jlowe) - - MAPREDUCE-5317. Stale files left behind for failed jobs (Ravi Prakash via - jlowe) - - MAPREDUCE-5358. MRAppMaster throws invalid transitions for JobImpl - (Devaraj K via jlowe) - - MAPREDUCE-3193. FileInputFormat doesn't read files recursively in the - input path dir (Devaraj K via jlowe) - - MAPREDUCE-5440. TestCopyCommitter Fails on JDK7 (Robert Parker via jlowe) - - MAPREDUCE-5367. Local jobs all use same local working directory - (Sandy Ryza) - - MAPREDUCE-5425. Junit in TestJobHistoryServer failing in jdk 7 (Robert - Parker via jlowe) - - MAPREDUCE-5454. TestDFSIO fails intermittently on JDK7 (Karthik Kambatla - via Sandy Ryza) - - MAPREDUCE-5001. LocalJobRunner has race condition resulting in job - failures (Sandy Ryza via jlowe) - - MAPREDUCE-5466. Changed MR AM to not promote history files of intermediate - AMs in case they are exiting because of errors and thus help history-server - pick up the right history file for the last successful AM. (Jian He via - vinodkv) - - MAPREDUCE-5468. Fix MR AM recovery for map-only jobs. (vinodkv via - acmurthy) - - MAPREDUCE-5470. LocalJobRunner does not work on Windows. (Sandy Ryza via - cnauroth) - - MAPREDUCE-5476. Changed MR AM recovery code to cleanup staging-directory - only after unregistering from the RM. (Jian He via vinodkv) - - MAPREDUCE-5483. revert MAPREDUCE-5357. (rkanter via tucu) - - MAPREDUCE-5441. Changed MR AM to return RUNNING state if exiting when RM - commands to reboot, so that client can continue to track the overall job. - (Jian He via vinodkv) - - MAPREDUCE-5475. MRClientService does not verify ACLs properly (jlowe) - - MAPREDUCE-5414. TestTaskAttempt fails in JDK7 with NPE (Nemon Lou via - devaraj) - - MAPREDUCE-5020. Compile failure with JDK8 (Trevor Robinson via tgraves) - - MAPREDUCE-5164. mapred job and queue commands omit HADOOP_CLIENT_OPTS - (Nemon Lou via devaraj) - - MAPREDUCE-5493. Cleanup in-memory & on-disk segments to prevent leak on - shuffle completion. (jlowe via acmurthy) - -Release 2.1.0-beta - 2013-08-22 - - INCOMPATIBLE CHANGES - - MAPREDUCE-4067. Changed MRClientProtocol api to throw IOException only (Xuan - Gong via vinodkv) - - MAPREDUCE-5234. Change mapred.TaskReport and mapreduce.TaskReport for binary - compatibility with mapred in 1.x but incompatible with 0.23.x. (Mayank Bansal - via vinodkv) - - MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run - 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of - ProgramDriver. (Zhijie Shen via vinodkv) - - MAPREDUCE-5233. Add methods that are changed or removed from JobControl.Job - when compared to 1.x. This breaks 0.23.x users of one API in Job. (Mayank - Bansal via vinodkv) - - MAPREDUCE-5237. Add methods that were removed from ClusterStatus back into - 2.x so as to be compatible with 1.x. Incompatible as - ClusterStatus.UNINITIALIZED_MEMORY_VALUE is a long now and so breaks 0.23.x - but it shouldn't be a big deal in reality. (Zhijie Shen via vinodkv) - - NEW FEATURES - - HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows - Azure environments. (See breakdown of tasks below for subtasks and - contributors) - - IMPROVEMENTS - - MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running - tasks in Gridmix. (amarrk via tgraves) - - MAPREDUCE-5033. mapred shell script should respect usage flags - (--help -help -h). (Andrew Wang via atm) - - MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits' - allocation on small clusters. (Bikas Saha via vinodkv) - - MAPREDUCE-4990. Construct debug strings conditionally in - ShuffleHandler.Shuffle#sendMapOutput(). (kkambatl via tucu) - - MAPREDUCE-4875. coverage fixing for org.apache.hadoop.mapred - (Aleksey Gorshkov via bobby) - - MAPREDUCE-5129. Allow tags to JobHistory for deeper analytics. (billie via - acmurthy) - - MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for - faster job submission. (amarrk via tgraves) - - MAPREDUCE-5079. Changes job recovery to restore state directly from job - history, instaed of simulating state machine events. - (Jason Lowe and Robert Parker via sseth) - - MAPREDUCE-4981. Add WordMean, WordMedian, WordStandardDeviation - to ExamplesDriver. (Plamen Jeliazkov via shv) - - MAPREUDUCE-5059. Change average merge time on Job overview page to be the - time delta between the end of the shuffle and the start of the reduce. - (Omkar Vinit Joshi via vinodkv) - - MAPREDUCE-4985. Add compression option to TestDFSIO usage. - (Plamen Jeliazkov via shv) - - MAPREDUCE-5152. Make MR App to simply pass through the container from RM - instead of extracting and populating information itself to start any - container. (vinodkv) - - MAPREDUCE-5175. Updated MR App to not set envs that will be set by NMs - anyways after YARN-561. (Xuan Gong via vinodkv) - - MAPREDUCE-5069. add concrete common implementations of - CombineFileInputFormat (Sangjin Lee via bobby) - - MAPREDUCE-5145. Changed default max-attempts to be more than one for MR jobs - inline with YARN. (Zhijie Shen via vinodkv) - - MAPREDUCE-5036. Default shuffle handler port should not be 8080. - (Sandy Ryza via tomwhite) - - MAPREDUCE-5159. Change ValueAggregatorJob to add APIs which can support - binary compatibility with hadoop-1 examples. (Zhijie Shen via vinodkv) - - MAPREDUCE-5157. Bring back old sampler related code so that we can support - binary compatibility with hadoop-1 sorter example. (Zhijie Shen via vinodkv) - - MAPREDUCE-5222. Bring back some methods and constants in Jobclient for - binary compatibility with mapred in 1.x. (Karthik Kambatla via vinodkv) - - MAPREDUCE-5235. Bring back old fields and exceptions in Counters for - binary compatibility with mapred in 1.x. (Mayank Bansal via vinodkv) - - MAPREDUCE-5246. Specify application-type at the time of job submission after - YARN-563. (Mayank Bansal via vinodkv) - - MAPREDUCE-5230. Bring back NLineInputFormat.createFileSplit for binary - compatibility with mapred in 1.x (Mayank Bansal via vinodkv) - - MAPREDUCE-5270. Migrated MR app from using BuilderUtil factory methods to - individual record factory methods. (Jian He via vinodkv) - - MAPREDUCE-5263. Bring back old methods and fields in - filecache.DistributedCache for binary compatibility with mapred in 1.x. - (Zhijie Shen via vinodkv) - - MAPREDUCE-5228. Bring back FileInputFormat.Counter and - FileOuputFormat.Counter for binary compatibility with 1.x mapred APIs. - (Mayank Bansal via vinodkv) - - MAPREDUCE-5176. Add annotation for tagging tasks as responsive to - preemption. (Carlo Curino, cdouglas) - - MAPREDUCE-5275. Bring back a couple of APIs in mapreduce.security.TokenCache - for binary compatibility with 1.x mapreduce APIs. (Mayank Bansal via vinodkv) - - MAPREDUCE-5231. Bring back a constructor in mapred's - DBInputFormat.DBRecordReader for binary compatibility with 1.x mapred APIs. - (Zhijie Shen via vinodkv) - - MAPREDUCE-5273. Bring back a couple of protected variables in mapred and - mapreduce CombineFileRecordReader for binary compatibility with 1.x APIs. - (Mayank Bansal via vinodkv) - - MAPREDUCE-5280. Bring back removed constructor and a method in mapreduce - ClusterMetrics for binary compatibility with 1.x APIs. (Mayank Bansal via - vinodkv) - - MAPREDUCE-5289. Updated MR App to use Token directly after YARN-717. (Jian He - via vinodkv) - - MAPREDUCE-5229. Put back FileOutputCommitter.TEMP_DIR_NAME in mapreduce for - binary compatibility with 1.x APIs. (Zhijie Shen via vinodkv) - - MAPREDUCE-5274. Bring back SecureShuffleUtils.toHex in mapreduce for binary - compatibility with 1.x APIs. (Mayank Bansal via vinodkv) - - MAPREDUCE-5300. Fix backward incompatibility for - o.a.h.mapreduce.filecache.DistributedCache. (Zhijie Shen via acmurthy) - - MAPREDUCE-5283. Over 10 different tests have near identical - implementations of AppContext (Sandy Ryza via jlowe) - - MAPREDUCE-5199. Removing ApplicationTokens file as it is no longer needed. - (Daryn Sharp via vinodkv) - - MAPREDUCE-5192. Allow for alternate resolutions of TaskCompletionEvents. - (cdouglas via acmurthy) - - MAPREDUCE-5184. Document compatibility for MapReduce applications in - hadoop-2 vis-a-vis hadoop-1. (Zhijie Shen via acmurthy) - - MAPREDUCE-5194. Heed interrupts during Fetcher shutdown. (cdouglas) - - MAPREDUCE-5326. Added version to shuffle header. (Zhijie Shen via - acmurthy) - - MAPREDUCE-5333. Add test that verifies MRAM works correctly when sending - requests with non-normalized capabilities. (ywskycn via tucu) - - MAPREDUCE-5398. MR changes for YARN-513 (Jian He via bikas) - - OPTIMIZATIONS - - MAPREDUCE-4974. Optimising the LineRecordReader initialize() method - (Gelesh via bobby) - - MAPREDUCE-5268. Improve history server startup performance (Karthik - Kambatla via jlowe) - - MAPREDUCE-5352. Optimize node local splits generated by - CombineFileInputFormat. (sseth) - - BUG FIXES - - MAPREDUCE-4671. AM does not tell the RM about container requests which are - no longer needed. (Bikas Saha via sseth) - - MAPREDUCE-4994. -jt generic command line option does not work. (sandyr via tucu) - - MAPREDUCE-5000. Fixes getCounters when speculating by fixing the selection - of the best attempt for a task. (Jason Lowe via sseth) - - MAPREDUCE-4994. Addendum fixing testcases failures. (sandyr via tucu) - - MAPREDUCE-4846. Some JobQueueInfo methods are public in MR1 but protected - in MR2. (Sandy Ryza via tomwhite) - - MAPREDUCE-5013. mapred.JobStatus compatibility: MR2 missing constructors - from MR1. (Sandy Ryza via tomwhite) - - MAPREDUCE-4951. Container preemption interpreted as task failure. - (Sandy Ryza via tomwhite) - - MAPREDUCE-5008. Merger progress miscounts with respect to EOF_MARKER. - (Sandy Ryza via tomwhite) - - MAPREDUCE-4693. History server should include counters for failed tasks. - (Xuan Gong via sseth) - - MAPREDUCE-4896. mapred queue -info spits out ugly exception when queue does - not exist. (sandyr via tucu) - - MAPREDUCE-3685. Fix bugs in MergeManager to ensure compression codec is - appropriately used and that on-disk segments are correctly sorted on - file-size. (Anty Rao and Ravi Prakash via acmurthy) - - MAPREDUCE-4571. TestHsWebServicesJobs fails on jdk7. (tgraves via tucu) - - MAPREDUCE-4716. TestHsWebServicesJobsQuery.testJobsQueryStateInvalid - fails with jdk7. (tgraves via tucu) - - MAPREDUCE-5075. DistCp leaks input file handles since ThrottledInputStream - does not close the wrapped InputStream. (Chris Nauroth via szetszwo) - - MAPREDUCE-3872. Fix an event handling races in ContainerLauncherImpl. - (Robert Kanter via sseth) - - MAPREDUCE-5062. Fix MR AM to read max-retries from the RM. (Zhijie Shen via - vinodkv) - - MAPREDUCE-3829. [Gridmix] Gridmix should give better error message when - input data directory already exists and -generate opton is - given.(ravigummadi via tgraves) - - MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead - counter is wrong when compressed input is used.(ravigummadi via tgraves) - - MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a - job if the trace contains null taskStatus for a task. (ravigummadi via - tgraves) - - MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can - become slow in some cases (ravigummadi via tgraves). - - MAPREDUCE-5077. Remove mapreduce.util.ResourceCalculatorPlugin and related - code. (Karthik Kambatla via sseth) - - MAPREDUCE-4083. [Gridmix] NPE in cpu emulation. (amarrk via tgraves) - - MAPREDUCE-4100. [Gridmix] Bug fixed in compression emulation feature for - map only jobs. (amarrk via tgraves) - - MAPREDUCE-4356. [Rumen] Provide access to the method - ParsedTask.obtainTaskAttempts(). (ravigummadi via tgraves) - - MAPREDUCE-4149. [Rumen] Rumen fails to parse certain counter - strings. (ravigummadi via tgraves) - - MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and - sortFinished times when needed. (Ravi Gummadi via tgraves) - - MAPREDUCE-5138. Fix LocalDistributedCacheManager after YARN-112. (Omkar Vinit - Joshi via vinodkv) - - MAPREDUCE-5086. MR app master deletes staging dir when sent a reboot - command from the RM. (Jian He via jlowe) - - MAPREDUCE-5113. Streaming input/output types are ignored with java - mapper/reducer. (sandyr via tucu) - - MAPREDUCE-5098. Fix findbugs w
<TRUNCATED>
