http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/RELEASENOTES.0.23.5.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/RELEASENOTES.0.23.5.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/RELEASENOTES.0.23.5.md new file mode 100644 index 0000000..d8efa40 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.5/RELEASENOTES.0.23.5.md @@ -0,0 +1,38 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop 0.23.5 Release Notes + +These release notes cover new developer and user-facing incompatibilities, features, and major improvements. + + +--- + +* [HADOOP-8926](https://issues.apache.org/jira/browse/HADOOP-8926) | *Major* | **hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data** + +Speed up Crc32 by improving the cache hit-ratio of hadoop.util.PureJavaCrc32 + + +--- + +* [HDFS-4080](https://issues.apache.org/jira/browse/HDFS-4080) | *Major* | **Add a separate logger for block state change logs to enable turning off those logs** + +Add a separate logger "BlockStateChange" for block state change logs. + + +
http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md new file mode 100644 index 0000000..2a34ad7 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/CHANGES.0.23.6.md @@ -0,0 +1,137 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop Changelog + +## Release 0.23.6 - 2013-02-06 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-8992](https://issues.apache.org/jira/browse/HADOOP-8992) | Enhance unit-test coverage of class HarFileSystem | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | +| [HADOOP-8931](https://issues.apache.org/jira/browse/HADOOP-8931) | Add Java version to startup message | Trivial | . | Eli Collins | Eli Collins | +| [HADOOP-8561](https://issues.apache.org/jira/browse/HADOOP-8561) | Introduce HADOOP\_PROXY\_USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao | +| [MAPREDUCE-4899](https://issues.apache.org/jira/browse/MAPREDUCE-4899) | Provide a plugin to the Yarn Web App Proxy to generate tracking links for M/R appllications given the ID | Major | . | Derek Dagit | Derek Dagit | +| [MAPREDUCE-4845](https://issues.apache.org/jira/browse/MAPREDUCE-4845) | ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2 | Major | client | Sandy Ryza | Sandy Ryza | +| [MAPREDUCE-4811](https://issues.apache.org/jira/browse/MAPREDUCE-4811) | JobHistoryServer should show when it was started in WebUI About page | Minor | jobhistoryserver, mrv2 | Ravi Prakash | Ravi Prakash | +| [MAPREDUCE-4810](https://issues.apache.org/jira/browse/MAPREDUCE-4810) | Add admin command options for ApplicationMaster | Minor | applicationmaster | Jason Lowe | Jerry Chen | +| [MAPREDUCE-4764](https://issues.apache.org/jira/browse/MAPREDUCE-4764) | repair test org.apache.hadoop.mapreduce.security.TestBinaryTokenFile | Major | . | Ivan A. Veselovsky | | +| [YARN-285](https://issues.apache.org/jira/browse/YARN-285) | RM should be able to provide a tracking link for apps that have already been purged | Major | . | Derek Dagit | Derek Dagit | +| [YARN-80](https://issues.apache.org/jira/browse/YARN-80) | Support delay scheduling for node locality in MR2's capacity scheduler | Major | capacityscheduler | Todd Lipcon | Arun C Murthy | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9255](https://issues.apache.org/jira/browse/HADOOP-9255) | relnotes.py missing last jira | Critical | scripts | Thomas Graves | Thomas Graves | +| [HADOOP-9242](https://issues.apache.org/jira/browse/HADOOP-9242) | Duplicate surefire plugin config in hadoop-common | Major | test | Andrey Klochkov | Andrey Klochkov | +| [HADOOP-9181](https://issues.apache.org/jira/browse/HADOOP-9181) | Set daemon flag for HttpServer's QueuedThreadPool | Major | . | Liang Xie | Liang Xie | +| [HADOOP-9169](https://issues.apache.org/jira/browse/HADOOP-9169) | Bring branch-0.23 ExitUtil up to same level as branch-2 | Major | . | Robert Joseph Evans | Robert Joseph Evans | +| [HADOOP-9152](https://issues.apache.org/jira/browse/HADOOP-9152) | HDFS can report negative DFS Used on clusters with very small amounts of data | Minor | fs | Brock Noland | Brock Noland | +| [HADOOP-9135](https://issues.apache.org/jira/browse/HADOOP-9135) | JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback | Trivial | security | Colin Patrick McCabe | Colin Patrick McCabe | +| [HADOOP-9108](https://issues.apache.org/jira/browse/HADOOP-9108) | Add a method to clear terminateCalled to ExitUtil for test cases | Major | util | Kihwal Lee | Kihwal Lee | +| [HADOOP-9105](https://issues.apache.org/jira/browse/HADOOP-9105) | FsShell -moveFromLocal erroneously fails | Major | fs | Daryn Sharp | Daryn Sharp | +| [HADOOP-9097](https://issues.apache.org/jira/browse/HADOOP-9097) | Maven RAT plugin is not checking all source files | Critical | build | Tom White | Thomas Graves | +| [HADOOP-9072](https://issues.apache.org/jira/browse/HADOOP-9072) | Hadoop-Common-0.23-Build Fails to build in Jenkins | Major | . | Robert Parker | Robert Parker | +| [HADOOP-7868](https://issues.apache.org/jira/browse/HADOOP-7868) | Hadoop native fails to compile when default linker option is -Wl,--as-needed | Major | native | James Page | Trevor Robinson | +| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal | +| [HDFS-4385](https://issues.apache.org/jira/browse/HDFS-4385) | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves | +| [HDFS-4315](https://issues.apache.org/jira/browse/HDFS-4315) | DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access | Major | datanode | Aaron T. Myers | Aaron T. Myers | +| [HDFS-4270](https://issues.apache.org/jira/browse/HDFS-4270) | Replications of the highest priority should be allowed to choose a source datanode that has reached its max replication limit | Minor | namenode | Derek Dagit | Derek Dagit | +| [HDFS-4254](https://issues.apache.org/jira/browse/HDFS-4254) | testAllEditsDirsFailOnFlush makes subsequent test cases fail (0.23.6 only) | Major | test | Kihwal Lee | Kihwal Lee | +| [HDFS-4242](https://issues.apache.org/jira/browse/HDFS-4242) | Map.Entry is incorrectly used in LeaseManager | Major | namenode | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | +| [HDFS-4233](https://issues.apache.org/jira/browse/HDFS-4233) | NN keeps serving even after no journals started while rolling edit | Blocker | namenode | Kihwal Lee | Kihwal Lee | +| [HDFS-4232](https://issues.apache.org/jira/browse/HDFS-4232) | NN fails to write a fsimage with stale leases | Blocker | namenode | Daryn Sharp | Daryn Sharp | +| [HDFS-4186](https://issues.apache.org/jira/browse/HDFS-4186) | logSync() is called with the write lock held while releasing lease | Critical | namenode | Kihwal Lee | Kihwal Lee | +| [HDFS-2757](https://issues.apache.org/jira/browse/HDFS-2757) | Cannot read a local block that's being written to when using the local read short circuit | Major | . | Jean-Daniel Cryans | Jean-Daniel Cryans | +| [MAPREDUCE-4934](https://issues.apache.org/jira/browse/MAPREDUCE-4934) | Maven RAT plugin is not checking all source files | Critical | build | Thomas Graves | Thomas Graves | +| [MAPREDUCE-4925](https://issues.apache.org/jira/browse/MAPREDUCE-4925) | The pentomino option parser may be buggy | Major | examples | Karthik Kambatla | Karthik Kambatla | +| [MAPREDUCE-4921](https://issues.apache.org/jira/browse/MAPREDUCE-4921) | JobClient should acquire HS token with RM principal | Blocker | client | Daryn Sharp | Daryn Sharp | +| [MAPREDUCE-4913](https://issues.apache.org/jira/browse/MAPREDUCE-4913) | TestMRAppMaster#testMRAppMasterMissingStaging occasionally exits | Major | mr-am | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4902](https://issues.apache.org/jira/browse/MAPREDUCE-4902) | Fix typo "receievd" should be "received" in log output | Trivial | . | Albert Chu | Albert Chu | +| [MAPREDUCE-4895](https://issues.apache.org/jira/browse/MAPREDUCE-4895) | Fix compilation failure of org.apache.hadoop.mapred.gridmix.TestResourceUsageEmulators | Major | . | Dennis Y | Dennis Y | +| [MAPREDUCE-4894](https://issues.apache.org/jira/browse/MAPREDUCE-4894) | Renewal / cancellation of JobHistory tokens | Blocker | jobhistoryserver, mrv2 | Siddharth Seth | Siddharth Seth | +| [MAPREDUCE-4890](https://issues.apache.org/jira/browse/MAPREDUCE-4890) | Invalid TaskImpl state transitions when task fails while speculating | Critical | mr-am | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4861](https://issues.apache.org/jira/browse/MAPREDUCE-4861) | Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal | Major | . | Karthik Kambatla | Karthik Kambatla | +| [MAPREDUCE-4856](https://issues.apache.org/jira/browse/MAPREDUCE-4856) | TestJobOutputCommitter uses same directory as TestJobCleanup | Major | test | Sandy Ryza | Sandy Ryza | +| [MAPREDUCE-4848](https://issues.apache.org/jira/browse/MAPREDUCE-4848) | TaskAttemptContext cast error during AM recovery | Major | mr-am | Jason Lowe | Jerry Chen | +| [MAPREDUCE-4842](https://issues.apache.org/jira/browse/MAPREDUCE-4842) | Shuffle race can hang reducer | Blocker | mrv2 | Jason Lowe | Mariappan Asokan | +| [MAPREDUCE-4836](https://issues.apache.org/jira/browse/MAPREDUCE-4836) | Elapsed time for running tasks on AM web UI tasks page is 0 | Major | . | Ravi Prakash | Ravi Prakash | +| [MAPREDUCE-4833](https://issues.apache.org/jira/browse/MAPREDUCE-4833) | Task can get stuck in FAIL\_CONTAINER\_CLEANUP | Critical | applicationmaster, mrv2 | Robert Joseph Evans | Robert Parker | +| [MAPREDUCE-4832](https://issues.apache.org/jira/browse/MAPREDUCE-4832) | MR AM can get in a split brain situation | Critical | applicationmaster | Robert Joseph Evans | Jason Lowe | +| [MAPREDUCE-4825](https://issues.apache.org/jira/browse/MAPREDUCE-4825) | JobImpl.finished doesn't expect ERROR as a final job state | Major | mr-am | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4819](https://issues.apache.org/jira/browse/MAPREDUCE-4819) | AM can rerun job after reporting final job status to the client | Blocker | mr-am | Jason Lowe | Bikas Saha | +| [MAPREDUCE-4817](https://issues.apache.org/jira/browse/MAPREDUCE-4817) | Hardcoded task ping timeout kills tasks localizing large amounts of data | Critical | applicationmaster, mr-am | Jason Lowe | Thomas Graves | +| [MAPREDUCE-4813](https://issues.apache.org/jira/browse/MAPREDUCE-4813) | AM timing out during job commit | Critical | applicationmaster | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4678](https://issues.apache.org/jira/browse/MAPREDUCE-4678) | Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException | Minor | examples | Chris McConnell | Chris McConnell | +| [MAPREDUCE-4279](https://issues.apache.org/jira/browse/MAPREDUCE-4279) | getClusterStatus() fails with null pointer exception when running jobs in local mode | Major | jobtracker | Rahul Jain | Devaraj K | +| [YARN-354](https://issues.apache.org/jira/browse/YARN-354) | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie | +| [YARN-334](https://issues.apache.org/jira/browse/YARN-334) | Maven RAT plugin is not checking all source files | Critical | . | Thomas Graves | Thomas Graves | +| [YARN-325](https://issues.apache.org/jira/browse/YARN-325) | RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing | Blocker | capacityscheduler | Jason Lowe | Arun C Murthy | +| [YARN-320](https://issues.apache.org/jira/browse/YARN-320) | RM should always be able to renew its own tokens | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | +| [YARN-293](https://issues.apache.org/jira/browse/YARN-293) | Node Manager leaks LocalizerRunner object for every Container | Critical | nodemanager | Devaraj K | Robert Joseph Evans | +| [YARN-266](https://issues.apache.org/jira/browse/YARN-266) | RM and JHS Web UIs are blank because AppsBlock is not escaping string properly | Critical | resourcemanager | Ravi Prakash | Ravi Prakash | +| [YARN-258](https://issues.apache.org/jira/browse/YARN-258) | RM web page UI shows Invalid Date for start and finish times | Major | resourcemanager | Ravi Prakash | Ravi Prakash | +| [YARN-251](https://issues.apache.org/jira/browse/YARN-251) | Proxy URI generation fails for blank tracking URIs | Major | resourcemanager | Tom White | Tom White | +| [YARN-225](https://issues.apache.org/jira/browse/YARN-225) | Proxy Link in RM UI thows NPE in Secure mode | Critical | resourcemanager | Devaraj K | Devaraj K | +| [YARN-223](https://issues.apache.org/jira/browse/YARN-223) | Change processTree interface to work better with native code | Critical | . | Radim Kolar | Radim Kolar | +| [YARN-170](https://issues.apache.org/jira/browse/YARN-170) | NodeManager stop() gets called twice on shutdown | Major | nodemanager | Sandy Ryza | Sandy Ryza | +| [YARN-72](https://issues.apache.org/jira/browse/YARN-72) | NM should handle cleaning up containers when it shuts down | Major | nodemanager | Hitesh Shah | Sandy Ryza | + + +### TESTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9217](https://issues.apache.org/jira/browse/HADOOP-9217) | Print thread dumps when hadoop-common tests fail | Major | test | Andrey Klochkov | Andrey Klochkov | +| [HADOOP-9038](https://issues.apache.org/jira/browse/HADOOP-9038) | provide unit-test coverage of class org.apache.hadoop.fs.LocalDirAllocator.AllocatorPerContext.PathIterator | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9020](https://issues.apache.org/jira/browse/HADOOP-9020) | Add a SASL PLAIN server | Major | ipc, security | Daryn Sharp | Daryn Sharp | +| [HDFS-4248](https://issues.apache.org/jira/browse/HDFS-4248) | Renames may remove file leases | Blocker | namenode | Daryn Sharp | Daryn Sharp | +| [HDFS-4247](https://issues.apache.org/jira/browse/HDFS-4247) | saveNamespace should be tolerant of dangling lease | Blocker | namenode | Daryn Sharp | Daryn Sharp | +| [YARN-280](https://issues.apache.org/jira/browse/YARN-280) | RM does not reject app submission with invalid tokens | Major | resourcemanager | Daryn Sharp | Daryn Sharp | +| [YARN-204](https://issues.apache.org/jira/browse/YARN-204) | test coverage for org.apache.hadoop.tools | Major | applications | Aleksey Gorshkov | Aleksey Gorshkov | +| [YARN-50](https://issues.apache.org/jira/browse/YARN-50) | Implement renewal / cancellation of Delegation Tokens | Blocker | . | Siddharth Seth | Siddharth Seth | + + +### OTHER: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-8427](https://issues.apache.org/jira/browse/HADOOP-8427) | Convert Forrest docs to APT, incremental | Major | documentation | Eli Collins | Andy Isaacson | + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/RELEASENOTES.0.23.6.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/RELEASENOTES.0.23.6.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/RELEASENOTES.0.23.6.md new file mode 100644 index 0000000..5038bad --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.6/RELEASENOTES.0.23.6.md @@ -0,0 +1,24 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop 0.23.6 Release Notes + +These release notes cover new developer and user-facing incompatibilities, features, and major improvements. + + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md new file mode 100644 index 0000000..ff0352f --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md @@ -0,0 +1,195 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop Changelog + +## Release 0.23.7 - 2013-04-18 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | DFS Scalability: Incremental block reports | Major | datanode, namenode | dhruba borthakur | Tomasz Nykiel | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9209](https://issues.apache.org/jira/browse/HADOOP-9209) | Add shell command to dump file checksums | Major | fs, tools | Todd Lipcon | Todd Lipcon | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta | +| [HADOOP-9374](https://issues.apache.org/jira/browse/HADOOP-9374) | Add tokens from -tokenCacheFile into UGI | Major | security | Daryn Sharp | Daryn Sharp | +| [HADOOP-9352](https://issues.apache.org/jira/browse/HADOOP-9352) | Expose UGI.setLoginUser for tests | Major | security | Daryn Sharp | Daryn Sharp | +| [HADOOP-9336](https://issues.apache.org/jira/browse/HADOOP-9336) | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp | +| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta | +| [HADOOP-9247](https://issues.apache.org/jira/browse/HADOOP-9247) | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | +| [HADOOP-9216](https://issues.apache.org/jira/browse/HADOOP-9216) | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa | +| [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen | +| [HADOOP-8849](https://issues.apache.org/jira/browse/HADOOP-8849) | FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | +| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li | +| [HADOOP-8462](https://issues.apache.org/jira/browse/HADOOP-8462) | Native-code implementation of bzip2 codec | Major | io | Govind Kamat | Govind Kamat | +| [HADOOP-8214](https://issues.apache.org/jira/browse/HADOOP-8214) | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik | +| [HADOOP-8075](https://issues.apache.org/jira/browse/HADOOP-8075) | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken | +| [HADOOP-7886](https://issues.apache.org/jira/browse/HADOOP-7886) | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari | +| [HADOOP-7358](https://issues.apache.org/jira/browse/HADOOP-7358) | Improve log levels when exceptions caught in RPC handler | Minor | ipc | Todd Lipcon | Todd Lipcon | +| [HDFS-3817](https://issues.apache.org/jira/browse/HDFS-3817) | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li | +| [MAPREDUCE-5079](https://issues.apache.org/jira/browse/MAPREDUCE-5079) | Recovery should restore task state from job history info directly | Critical | mr-am | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4990](https://issues.apache.org/jira/browse/MAPREDUCE-4990) | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla | +| [MAPREDUCE-4989](https://issues.apache.org/jira/browse/MAPREDUCE-4989) | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash | +| [MAPREDUCE-4949](https://issues.apache.org/jira/browse/MAPREDUCE-4949) | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza | +| [MAPREDUCE-4907](https://issues.apache.org/jira/browse/MAPREDUCE-4907) | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza | +| [MAPREDUCE-4822](https://issues.apache.org/jira/browse/MAPREDUCE-4822) | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong | +| [MAPREDUCE-4458](https://issues.apache.org/jira/browse/MAPREDUCE-4458) | Warn if java.library.path is used for AM or Task | Major | mrv2 | Robert Joseph Evans | Robert Parker | +| [YARN-525](https://issues.apache.org/jira/browse/YARN-525) | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves | +| [YARN-443](https://issues.apache.org/jira/browse/YARN-443) | allow OS scheduling priority of NM to be different than the containers it launches | Major | nodemanager | Thomas Graves | Thomas Graves | +| [YARN-249](https://issues.apache.org/jira/browse/YARN-249) | Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) | Major | capacityscheduler | Ravi Prakash | Ravi Prakash | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9406](https://issues.apache.org/jira/browse/HADOOP-9406) | hadoop-client leaks dependency on JDK tools jar | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-9339](https://issues.apache.org/jira/browse/HADOOP-9339) | IPC.Server incorrectly sets UGI auth type | Major | ipc | Daryn Sharp | Daryn Sharp | +| [HADOOP-9303](https://issues.apache.org/jira/browse/HADOOP-9303) | command manual dfsadmin missing entry for restoreFailedStorage option | Major | . | Thomas Graves | Andy Isaacson | +| [HADOOP-9302](https://issues.apache.org/jira/browse/HADOOP-9302) | HDFS docs not linked from top level | Major | documentation | Thomas Graves | Andy Isaacson | +| [HADOOP-9289](https://issues.apache.org/jira/browse/HADOOP-9289) | FsShell rm -f fails for non-matching globs | Blocker | fs | Daryn Sharp | Daryn Sharp | +| [HADOOP-9278](https://issues.apache.org/jira/browse/HADOOP-9278) | HarFileSystem may leak file handle | Major | fs | Chris Nauroth | Chris Nauroth | +| [HADOOP-9231](https://issues.apache.org/jira/browse/HADOOP-9231) | Parametrize staging URL for the uniformity of distributionManagement | Major | build | Konstantin Boudnik | Konstantin Boudnik | +| [HADOOP-9221](https://issues.apache.org/jira/browse/HADOOP-9221) | Convert remaining xdocs to APT | Major | . | Andy Isaacson | Andy Isaacson | +| [HADOOP-9212](https://issues.apache.org/jira/browse/HADOOP-9212) | Potential deadlock in FileSystem.Cache/IPC/UGI | Major | fs | Tom White | Tom White | +| [HADOOP-9193](https://issues.apache.org/jira/browse/HADOOP-9193) | hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script | Minor | scripts | Jason Lowe | Andy Isaacson | +| [HADOOP-9190](https://issues.apache.org/jira/browse/HADOOP-9190) | packaging docs is broken | Major | documentation | Thomas Graves | Andy Isaacson | +| [HADOOP-9155](https://issues.apache.org/jira/browse/HADOOP-9155) | FsPermission should have different default value, 777 for directory and 666 for file | Minor | . | Binglin Chang | Binglin Chang | +| [HADOOP-9154](https://issues.apache.org/jira/browse/HADOOP-9154) | SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla | +| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani | +| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta | +| [HADOOP-8857](https://issues.apache.org/jira/browse/HADOOP-8857) | hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated | Minor | security | Eli Collins | Alejandro Abdelnur | +| [HADOOP-8816](https://issues.apache.org/jira/browse/HADOOP-8816) | HTTP Error 413 full HEAD if using kerberos authentication | Major | net | Moritz Moeller | Moritz Moeller | +| [HADOOP-8346](https://issues.apache.org/jira/browse/HADOOP-8346) | Changes to support Kerberos with non Sun JVM (HADOOP-6941) broke SPNEGO | Blocker | security | Alejandro Abdelnur | Devaraj Das | +| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon | +| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das | +| [HDFS-4649](https://issues.apache.org/jira/browse/HDFS-4649) | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar | +| [HDFS-4553](https://issues.apache.org/jira/browse/HDFS-4553) | Webhdfs will NPE on some unexpected response codes | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4544](https://issues.apache.org/jira/browse/HDFS-4544) | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal | +| [HDFS-4532](https://issues.apache.org/jira/browse/HDFS-4532) | RPC call queue may fill due to current user lookup | Critical | namenode | Daryn Sharp | Daryn Sharp | +| [HDFS-4495](https://issues.apache.org/jira/browse/HDFS-4495) | Allow client-side lease renewal to be retried beyond soft-limit | Major | hdfs-client | Kihwal Lee | Kihwal Lee | +| [HDFS-4462](https://issues.apache.org/jira/browse/HDFS-4462) | 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS | Major | namenode | Aaron T. Myers | Aaron T. Myers | +| [HDFS-4444](https://issues.apache.org/jira/browse/HDFS-4444) | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu | +| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal | +| [HDFS-4288](https://issues.apache.org/jira/browse/HDFS-4288) | NN accepts incremental BR as IBR in safemode | Critical | namenode | Daryn Sharp | Daryn Sharp | +| [HDFS-4222](https://issues.apache.org/jira/browse/HDFS-4222) | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng | +| [HDFS-4128](https://issues.apache.org/jira/browse/HDFS-4128) | 2NN gets stuck in inconsistent state if edit log replay fails in the middle | Major | namenode | Todd Lipcon | Kihwal Lee | +| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao | +| [HDFS-3344](https://issues.apache.org/jira/browse/HDFS-3344) | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee | +| [HDFS-3256](https://issues.apache.org/jira/browse/HDFS-3256) | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers | +| [HDFS-3119](https://issues.apache.org/jira/browse/HDFS-3119) | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi | +| [HDFS-2434](https://issues.apache.org/jira/browse/HDFS-2434) | TestNameNodeMetrics.testCorruptBlock fails intermittently | Major | test | Uma Maheswara Rao G | Jing Zhao | +| [HDFS-1765](https://issues.apache.org/jira/browse/HDFS-1765) | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G | +| [MAPREDUCE-5137](https://issues.apache.org/jira/browse/MAPREDUCE-5137) | AM web UI: clicking on Map Task results in 500 error | Major | applicationmaster | Thomas Graves | Thomas Graves | +| [MAPREDUCE-5075](https://issues.apache.org/jira/browse/MAPREDUCE-5075) | DistCp leaks input file handles | Major | distcp | Chris Nauroth | Chris Nauroth | +| [MAPREDUCE-5060](https://issues.apache.org/jira/browse/MAPREDUCE-5060) | Fetch failures that time out only count against the first map task | Critical | . | Robert Joseph Evans | Robert Joseph Evans | +| [MAPREDUCE-5053](https://issues.apache.org/jira/browse/MAPREDUCE-5053) | java.lang.InternalError from decompression codec cause reducer to fail | Major | . | Robert Parker | Robert Parker | +| [MAPREDUCE-5043](https://issues.apache.org/jira/browse/MAPREDUCE-5043) | Fetch failure processing can cause AM event queue to backup and eventually OOM | Blocker | mr-am | Jason Lowe | Jason Lowe | +| [MAPREDUCE-5042](https://issues.apache.org/jira/browse/MAPREDUCE-5042) | Reducer unable to fetch for a map task that was recovered | Blocker | mr-am, security | Jason Lowe | Jason Lowe | +| [MAPREDUCE-5027](https://issues.apache.org/jira/browse/MAPREDUCE-5027) | Shuffle does not limit number of outstanding connections | Major | . | Jason Lowe | Robert Parker | +| [MAPREDUCE-5023](https://issues.apache.org/jira/browse/MAPREDUCE-5023) | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash | +| [MAPREDUCE-5009](https://issues.apache.org/jira/browse/MAPREDUCE-5009) | Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member | Critical | mrv1 | Robert Parker | Robert Parker | +| [MAPREDUCE-5000](https://issues.apache.org/jira/browse/MAPREDUCE-5000) | TaskImpl.getCounters() can return the counters for the wrong task attempt when task is speculating | Critical | mr-am | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4992](https://issues.apache.org/jira/browse/MAPREDUCE-4992) | AM hangs in RecoveryService when recovering tasks with speculative attempts | Critical | mr-am | Robert Parker | Robert Parker | +| [MAPREDUCE-4969](https://issues.apache.org/jira/browse/MAPREDUCE-4969) | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal | +| [MAPREDUCE-4953](https://issues.apache.org/jira/browse/MAPREDUCE-4953) | HadoopPipes misuses fprintf | Major | pipes | Andy Isaacson | Andy Isaacson | +| [MAPREDUCE-4946](https://issues.apache.org/jira/browse/MAPREDUCE-4946) | Type conversion of map completion events leads to performance problems with large jobs | Critical | mr-am | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4893](https://issues.apache.org/jira/browse/MAPREDUCE-4893) | MR AppMaster can do sub-optimal assignment of containers to map tasks leading to poor node locality | Major | applicationmaster | Bikas Saha | Bikas Saha | +| [MAPREDUCE-4871](https://issues.apache.org/jira/browse/MAPREDUCE-4871) | AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize | Major | mrv2 | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4794](https://issues.apache.org/jira/browse/MAPREDUCE-4794) | DefaultSpeculator generates error messages on normal shutdown | Major | applicationmaster | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4671](https://issues.apache.org/jira/browse/MAPREDUCE-4671) | AM does not tell the RM about container requests that are no longer needed | Major | . | Bikas Saha | Bikas Saha | +| [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | Killing an unassigned task attempt causes the job to fail | Major | mrv2 | Tom White | Mayank Bansal | +| [MAPREDUCE-4470](https://issues.apache.org/jira/browse/MAPREDUCE-4470) | Fix TestCombineFileInputFormat.testForEmptyFile | Major | test | Kihwal Lee | Ilya Katsov | +| [MAPREDUCE-4278](https://issues.apache.org/jira/browse/MAPREDUCE-4278) | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza | +| [MAPREDUCE-4007](https://issues.apache.org/jira/browse/MAPREDUCE-4007) | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | +| [MAPREDUCE-3952](https://issues.apache.org/jira/browse/MAPREDUCE-3952) | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh | +| [MAPREDUCE-3685](https://issues.apache.org/jira/browse/MAPREDUCE-3685) | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty | +| [YARN-460](https://issues.apache.org/jira/browse/YARN-460) | CS user left in list of active users for the queue even when application finished | Blocker | capacityscheduler | Thomas Graves | Thomas Graves | +| [YARN-448](https://issues.apache.org/jira/browse/YARN-448) | Remove unnecessary hflush from log aggregation | Major | nodemanager | Kihwal Lee | Kihwal Lee | +| [YARN-426](https://issues.apache.org/jira/browse/YARN-426) | Failure to download a public resource on a node prevents further downloads of the resource from that node | Critical | nodemanager | Jason Lowe | Jason Lowe | +| [YARN-410](https://issues.apache.org/jira/browse/YARN-410) | New lines in diagnostics for a failed app on the per-application page make it hard to read | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | +| [YARN-400](https://issues.apache.org/jira/browse/YARN-400) | RM can return null application resource usage report leading to NPE in client | Critical | resourcemanager | Jason Lowe | Jason Lowe | +| [YARN-376](https://issues.apache.org/jira/browse/YARN-376) | Apps that have completed can appear as RUNNING on the NM UI | Blocker | resourcemanager | Jason Lowe | Jason Lowe | +| [YARN-364](https://issues.apache.org/jira/browse/YARN-364) | AggregatedLogDeletionService can take too long to delete logs | Major | . | Jason Lowe | Jason Lowe | +| [YARN-362](https://issues.apache.org/jira/browse/YARN-362) | Unexpected extra results when using webUI table search | Minor | . | Jason Lowe | Ravi Prakash | +| [YARN-360](https://issues.apache.org/jira/browse/YARN-360) | Allow apps to concurrently register tokens for renewal | Critical | . | Daryn Sharp | Daryn Sharp | +| [YARN-357](https://issues.apache.org/jira/browse/YARN-357) | App submission should not be synchronized | Major | resourcemanager | Daryn Sharp | Daryn Sharp | +| [YARN-355](https://issues.apache.org/jira/browse/YARN-355) | RM app submission jams under load | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | +| [YARN-354](https://issues.apache.org/jira/browse/YARN-354) | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie | +| [YARN-345](https://issues.apache.org/jira/browse/YARN-345) | Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager | Critical | nodemanager | Devaraj K | Robert Parker | +| [YARN-343](https://issues.apache.org/jira/browse/YARN-343) | Capacity Scheduler maximum-capacity value -1 is invalid | Major | capacityscheduler | Thomas Graves | Xuan Gong | +| [YARN-269](https://issues.apache.org/jira/browse/YARN-269) | Resource Manager not logging the health\_check\_script result when taking it out | Major | resourcemanager | Thomas Graves | Jason Lowe | +| [YARN-236](https://issues.apache.org/jira/browse/YARN-236) | RM should point tracking URL to RM web page when app fails to start | Major | resourcemanager | Jason Lowe | Jason Lowe | +| [YARN-227](https://issues.apache.org/jira/browse/YARN-227) | Application expiration difficult to debug for end-users | Major | resourcemanager | Jason Lowe | Jason Lowe | +| [YARN-150](https://issues.apache.org/jira/browse/YARN-150) | AppRejectedTransition does not unregister app from master service and scheduler | Major | . | Bikas Saha | Bikas Saha | +| [YARN-133](https://issues.apache.org/jira/browse/YARN-133) | update web services docs for RM clusterMetrics | Major | resourcemanager | Thomas Graves | Ravi Prakash | +| [YARN-109](https://issues.apache.org/jira/browse/YARN-109) | .tmp file is not deleted for localized archives | Major | nodemanager | Jason Lowe | Mayank Bansal | +| [YARN-83](https://issues.apache.org/jira/browse/YARN-83) | Change package of YarnClient to include apache | Major | client | Bikas Saha | Bikas Saha | +| [YARN-40](https://issues.apache.org/jira/browse/YARN-40) | Provide support for missing yarn commands | Major | client | Devaraj K | Devaraj K | + + +### TESTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9067](https://issues.apache.org/jira/browse/HADOOP-9067) | provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long) | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | +| [HADOOP-8157](https://issues.apache.org/jira/browse/HADOOP-8157) | TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE | Major | . | Eli Collins | Todd Lipcon | +| [MAPREDUCE-5007](https://issues.apache.org/jira/browse/MAPREDUCE-5007) | fix coverage org.apache.hadoop.mapreduce.v2.hs | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [MAPREDUCE-4991](https://issues.apache.org/jira/browse/MAPREDUCE-4991) | coverage for gridmix | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [MAPREDUCE-4972](https://issues.apache.org/jira/browse/MAPREDUCE-4972) | Coverage fixing for org.apache.hadoop.mapreduce.jobhistory | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [MAPREDUCE-4905](https://issues.apache.org/jira/browse/MAPREDUCE-4905) | test org.apache.hadoop.mapred.pipes | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [MAPREDUCE-4875](https://issues.apache.org/jira/browse/MAPREDUCE-4875) | coverage fixing for org.apache.hadoop.mapred | Major | test | Aleksey Gorshkov | Aleksey Gorshkov | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HDFS-4577](https://issues.apache.org/jira/browse/HDFS-4577) | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4567](https://issues.apache.org/jira/browse/HDFS-4567) | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4566](https://issues.apache.org/jira/browse/HDFS-4566) | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4560](https://issues.apache.org/jira/browse/HDFS-4560) | Webhdfs cannot use tokens obtained by another user | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4548](https://issues.apache.org/jira/browse/HDFS-4548) | Webhdfs doesn't renegotiate SPNEGO token | Blocker | . | Daryn Sharp | Daryn Sharp | +| [HDFS-4542](https://issues.apache.org/jira/browse/HDFS-4542) | Webhdfs doesn't support secure proxy users | Blocker | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-2495](https://issues.apache.org/jira/browse/HDFS-2495) | Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | +| [HDFS-2477](https://issues.apache.org/jira/browse/HDFS-2477) | Optimize computing the diff between a block report and the namenode state. | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | +| [HDFS-2476](https://issues.apache.org/jira/browse/HDFS-2476) | More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | +| [YARN-468](https://issues.apache.org/jira/browse/YARN-468) | coverage fix for org.apache.hadoop.yarn.server.webproxy.amfilter | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [YARN-200](https://issues.apache.org/jira/browse/YARN-200) | yarn log does not output all needed information, and is in a binary format | Major | . | Robert Joseph Evans | Ravi Prakash | +| [YARN-29](https://issues.apache.org/jira/browse/YARN-29) | Add a yarn-client module | Major | client | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | + + +### OTHER: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md new file mode 100644 index 0000000..17ff954 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md @@ -0,0 +1,45 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop 0.23.7 Release Notes + +These release notes cover new developer and user-facing incompatibilities, features, and major improvements. + + +--- + +* [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | *Trivial* | **Add missing fields to FIleStatus.toString** + +Update FileStatus.toString to include missing fields + + +--- + +* [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | *Major* | **DFS Scalability: Incremental block reports** + +**WARNING: No release note provided for this incompatible change.** + + +--- + +* [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | *Major* | **Killing an unassigned task attempt causes the job to fail** + +Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. + + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md new file mode 100644 index 0000000..707f411 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md @@ -0,0 +1,89 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop Changelog + +## Release 0.23.8 - 2013-06-05 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9614](https://issues.apache.org/jira/browse/HADOOP-9614) | smart-test-patch.sh hangs for new version of patch (2.7.1) | Major | . | Ravi Prakash | Ravi Prakash | +| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie | +| [HADOOP-9469](https://issues.apache.org/jira/browse/HADOOP-9469) | mapreduce/yarn source jars not included in dist tarball | Major | . | Thomas Graves | Robert Parker | +| [HDFS-4835](https://issues.apache.org/jira/browse/HDFS-4835) | Port trunk WebHDFS changes to branch-0.23 | Critical | webhdfs | Robert Parker | Robert Parker | +| [HDFS-4807](https://issues.apache.org/jira/browse/HDFS-4807) | DFSOutputStream.createSocketForPipeline() should not include timeout extension on connect | Major | . | Kihwal Lee | Cristina L. Abad | +| [HDFS-4714](https://issues.apache.org/jira/browse/HDFS-4714) | Log short messages in Namenode RPC server for exceptions meant for clients | Major | namenode | Kihwal Lee | Kihwal Lee | +| [HDFS-4699](https://issues.apache.org/jira/browse/HDFS-4699) | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth | +| [HDFS-4690](https://issues.apache.org/jira/browse/HDFS-4690) | Namenode exits if entering safemode while secret manager is edit logging | Critical | namenode, security | Daryn Sharp | Daryn Sharp | +| [HDFS-4477](https://issues.apache.org/jira/browse/HDFS-4477) | Secondary namenode may retain old tokens | Critical | security | Kihwal Lee | Daryn Sharp | +| [HDFS-3875](https://issues.apache.org/jira/browse/HDFS-3875) | Issue handling checksum errors in write pipeline | Critical | datanode, hdfs-client | Todd Lipcon | Kihwal Lee | +| [MAPREDUCE-5211](https://issues.apache.org/jira/browse/MAPREDUCE-5211) | Reducer intermediate files can collide during merge | Blocker | mrv2 | Jason Lowe | Jason Lowe | +| [MAPREDUCE-5168](https://issues.apache.org/jira/browse/MAPREDUCE-5168) | Reducer can OOM during shuffle because on-disk output stream not released | Critical | mrv2 | Jason Lowe | Jason Lowe | +| [MAPREDUCE-5147](https://issues.apache.org/jira/browse/MAPREDUCE-5147) | Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly | Major | mrv2 | Robert Parker | Robert Parker | +| [MAPREDUCE-5065](https://issues.apache.org/jira/browse/MAPREDUCE-5065) | DistCp should skip checksum comparisons if block-sizes are different on source/target. | Major | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | +| [MAPREDUCE-5059](https://issues.apache.org/jira/browse/MAPREDUCE-5059) | Job overview shows average merge time larger than for any reduce attempt | Major | jobhistoryserver, webapps | Jason Lowe | Omkar Vinit Joshi | +| [MAPREDUCE-4927](https://issues.apache.org/jira/browse/MAPREDUCE-4927) | Historyserver 500 error due to NPE when accessing specific counters page for failed job | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar | +| [MAPREDUCE-4383](https://issues.apache.org/jira/browse/MAPREDUCE-4383) | HadoopPipes.cc needs to include unistd.h | Minor | pipes | Andy Isaacson | Andy Isaacson | +| [YARN-690](https://issues.apache.org/jira/browse/YARN-690) | RM exits on token cancel/renew problems | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | +| [YARN-476](https://issues.apache.org/jira/browse/YARN-476) | ProcfsBasedProcessTree info message confuses users | Minor | . | Jason Lowe | Sandy Ryza | +| [YARN-363](https://issues.apache.org/jira/browse/YARN-363) | yarn proxyserver fails to find webapps/proxy directory on startup | Major | . | Jason Lowe | Kenji Kikushima | +| [YARN-71](https://issues.apache.org/jira/browse/YARN-71) | Ensure/confirm that the NodeManager cleans up local-dirs on restart | Critical | nodemanager | Vinod Kumar Vavilapalli | Xuan Gong | + + +### TESTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9233](https://issues.apache.org/jira/browse/HADOOP-9233) | Cover package org.apache.hadoop.io.compress.zlib with unit tests | Major | . | Vadim Bondarev | Vadim Bondarev | +| [HADOOP-9222](https://issues.apache.org/jira/browse/HADOOP-9222) | Cover package with org.apache.hadoop.io.lz4 unit tests | Major | . | Vadim Bondarev | Vadim Bondarev | +| [MAPREDUCE-5015](https://issues.apache.org/jira/browse/MAPREDUCE-5015) | Coverage fix for org.apache.hadoop.mapreduce.tools.CLI | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [YARN-548](https://issues.apache.org/jira/browse/YARN-548) | Add tests for YarnUncaughtExceptionHandler | Major | . | Vadim Bondarev | Vadim Bondarev | + + +### OTHER: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/RELEASENOTES.0.23.8.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/RELEASENOTES.0.23.8.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/RELEASENOTES.0.23.8.md new file mode 100644 index 0000000..b3f8e71 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/RELEASENOTES.0.23.8.md @@ -0,0 +1,24 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop 0.23.8 Release Notes + +These release notes cover new developer and user-facing incompatibilities, features, and major improvements. + + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md new file mode 100644 index 0000000..6d02d85 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md @@ -0,0 +1,82 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop Changelog + +## Release 0.23.9 - 2013-07-08 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [MAPREDUCE-5268](https://issues.apache.org/jira/browse/MAPREDUCE-5268) | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla | +| [YARN-169](https://issues.apache.org/jira/browse/YARN-169) | Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter | Minor | nodemanager | Anthony Rojas | Anthony Rojas | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9582](https://issues.apache.org/jira/browse/HADOOP-9582) | Non-existent file to "hadoop fs -conf" doesn't throw error | Major | conf | Ashwin Shankar | Ashwin Shankar | +| [HADOOP-9581](https://issues.apache.org/jira/browse/HADOOP-9581) | hadoop --config non-existent directory should result in error | Major | scripts | Ashwin Shankar | Ashwin Shankar | +| [HDFS-4878](https://issues.apache.org/jira/browse/HDFS-4878) | On Remove Block, Block is not Removed from neededReplications queue | Major | namenode | Tao Luo | Tao Luo | +| [HDFS-4867](https://issues.apache.org/jira/browse/HDFS-4867) | metaSave NPEs when there are invalid blocks in repl queue. | Major | namenode | Kihwal Lee | Plamen Jeliazkov | +| [HDFS-4862](https://issues.apache.org/jira/browse/HDFS-4862) | SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually | Major | . | Ravi Prakash | Ravi Prakash | +| [HDFS-4832](https://issues.apache.org/jira/browse/HDFS-4832) | Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave | Critical | . | Ravi Prakash | Ravi Prakash | +| [HDFS-4765](https://issues.apache.org/jira/browse/HDFS-4765) | Permission check of symlink deletion incorrectly throws UnresolvedLinkException | Major | namenode | Andrew Wang | Andrew Wang | +| [HDFS-4205](https://issues.apache.org/jira/browse/HDFS-4205) | fsck fails with symlinks | Major | hdfs-client | Andy Isaacson | Jason Lowe | +| [MAPREDUCE-5316](https://issues.apache.org/jira/browse/MAPREDUCE-5316) | job -list-attempt-ids command does not handle illegal task-state | Major | client | Ashwin Shankar | Ashwin Shankar | +| [MAPREDUCE-5315](https://issues.apache.org/jira/browse/MAPREDUCE-5315) | DistCp reports success even on failure. | Critical | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | +| [MAPREDUCE-5308](https://issues.apache.org/jira/browse/MAPREDUCE-5308) | Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs | Major | . | Nathan Roberts | Nathan Roberts | +| [MAPREDUCE-4019](https://issues.apache.org/jira/browse/MAPREDUCE-4019) | -list-attempt-ids is not working | Minor | client | B Anil Kumar | Ashwin Shankar | +| [YARN-742](https://issues.apache.org/jira/browse/YARN-742) | Log aggregation causes a lot of redundant setPermission calls | Major | nodemanager | Kihwal Lee | Jason Lowe | + + +### TESTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [MAPREDUCE-5084](https://issues.apache.org/jira/browse/MAPREDUCE-5084) | fix coverage org.apache.hadoop.mapreduce.v2.app.webapp and org.apache.hadoop.mapreduce.v2.hs.webapp | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [YARN-478](https://issues.apache.org/jira/browse/YARN-478) | fix coverage org.apache.hadoop.yarn.webapp.log | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [YARN-427](https://issues.apache.org/jira/browse/YARN-427) | Coverage fix for org.apache.hadoop.yarn.server.api.\* | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | + + +### OTHER: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/RELEASENOTES.0.23.9.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/RELEASENOTES.0.23.9.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/RELEASENOTES.0.23.9.md new file mode 100644 index 0000000..81a267f --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/RELEASENOTES.0.23.9.md @@ -0,0 +1,31 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop 0.23.9 Release Notes + +These release notes cover new developer and user-facing incompatibilities, features, and major improvements. + + +--- + +* [HDFS-4832](https://issues.apache.org/jira/browse/HDFS-4832) | *Critical* | **Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave** + +This change makes name node keep its internal replication queues and data node state updated in manual safe mode. This allows metrics and UI to present up-to-date information while in safe mode. The behavior during start-up safe mode is unchanged. + + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md new file mode 100644 index 0000000..13f0958 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md @@ -0,0 +1,95 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop Changelog + +## Release 0.24.0 - Unreleased + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ] | Minor | io | Uma Maheswara Rao G | Uma Maheswara Rao G | +| [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | jvm metrics all use the same namespace | Major | metrics | Jeff Bean | Alejandro Abdelnur | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-7705](https://issues.apache.org/jira/browse/HADOOP-7705) | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran | +| [HADOOP-7594](https://issues.apache.org/jira/browse/HADOOP-7594) | Support HTTP REST in HttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-7772](https://issues.apache.org/jira/browse/HADOOP-7772) | javadoc the topology classes | Trivial | . | Steve Loughran | Steve Loughran | +| [HADOOP-7763](https://issues.apache.org/jira/browse/HADOOP-7763) | Add top-level navigation to APT docs | Major | documentation | Tom White | Tom White | +| [HADOOP-7743](https://issues.apache.org/jira/browse/HADOOP-7743) | Add Maven profile to create a full source tarball | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7737](https://issues.apache.org/jira/browse/HADOOP-7737) | normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | Add a NetUtils method that can tell if an InetAddress belongs to local host | Minor | util | Suresh Srinivas | Steve Loughran | +| [HADOOP-7642](https://issues.apache.org/jira/browse/HADOOP-7642) | create hadoop-dist module where TAR stitching would happen | Major | build | Alejandro Abdelnur | Tom White | +| [HADOOP-7595](https://issues.apache.org/jira/browse/HADOOP-7595) | Upgrade dependency to Avro 1.5.3 | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash | +| [HADOOP-7360](https://issues.apache.org/jira/browse/HADOOP-7360) | FsShell does not preserve relative paths with globs | Major | fs | Daryn Sharp | Kihwal Lee | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-7782](https://issues.apache.org/jira/browse/HADOOP-7782) | Aggregate project javadocs | Critical | build | Arun C Murthy | Tom White | +| [HADOOP-7778](https://issues.apache.org/jira/browse/HADOOP-7778) | FindBugs warning in Token.getKind() | Major | . | Tom White | Tom White | +| [HADOOP-7771](https://issues.apache.org/jira/browse/HADOOP-7771) | NPE when running hdfs dfs -copyToLocal, -get etc | Blocker | . | John George | John George | +| [HADOOP-7766](https://issues.apache.org/jira/browse/HADOOP-7766) | The auth to local mappings are not being respected, with webhdfs and security enabled. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | +| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash | +| [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | hadoop-setup-conf.sh should be modified to enable task memory manager | Major | conf | Ramya Sunil | Ramya Sunil | +| [HADOOP-7721](https://issues.apache.org/jira/browse/HADOOP-7721) | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey | +| [HADOOP-7663](https://issues.apache.org/jira/browse/HADOOP-7663) | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal | +| [HADOOP-7608](https://issues.apache.org/jira/browse/HADOOP-7608) | SnappyCodec check for Hadoop native lib is wrong | Major | io | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7606](https://issues.apache.org/jira/browse/HADOOP-7606) | Upgrade Jackson to version 1.7.1 to match the version required by Jersey | Major | test | Aaron T. Myers | Alejandro Abdelnur | +| [HADOOP-7599](https://issues.apache.org/jira/browse/HADOOP-7599) | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang | +| [HADOOP-7593](https://issues.apache.org/jira/browse/HADOOP-7593) | AssertionError in TestHttpServer.testMaxThreads() | Major | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | +| [HADOOP-7589](https://issues.apache.org/jira/browse/HADOOP-7589) | Prefer mvn test -DskipTests over mvn compile in test-patch.sh | Major | build | Robert Joseph Evans | Robert Joseph Evans | +| [HADOOP-7576](https://issues.apache.org/jira/browse/HADOOP-7576) | Fix findbugs warnings in Hadoop Auth (Alfredo) | Major | security | Tom White | Tsz Wo Nicholas Sze | +| [HADOOP-7568](https://issues.apache.org/jira/browse/HADOOP-7568) | SequenceFile should not print into stdout | Major | io | Konstantin Shvachko | Plamen Jeliazkov | + + +### TESTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-7564](https://issues.apache.org/jira/browse/HADOOP-7564) | Remove test-patch SVN externals | Major | . | Tom White | Tom White | +| [HADOOP-7469](https://issues.apache.org/jira/browse/HADOOP-7469) | add a standard handler for socket connection problems which improves diagnostics | Minor | util | Steve Loughran | Steve Loughran | + + +### OTHER: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-7579](https://issues.apache.org/jira/browse/HADOOP-7579) | Rename package names from alfredo to auth | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md new file mode 100644 index 0000000..7aa2984 --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md @@ -0,0 +1,52 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop 0.24.0 Release Notes + +These release notes cover new developer and user-facing incompatibilities, features, and major improvements. + + +--- + +* [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | *Major* | **hadoop-setup-conf.sh should be modified to enable task memory manager** + +Enable task memory management to be configurable via hadoop config setup script. + + +--- + +* [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | *Minor* | **Add a NetUtils method that can tell if an InetAddress belongs to local host** + +closing again + + +--- + +* [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | *Minor* | **Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\<T\> should be parameterized ]** + +**WARNING: No release note provided for this incompatible change.** + + +--- + +* [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | *Major* | **jvm metrics all use the same namespace** + +JVM metrics published to Ganglia now include the process name as part of the gmetric name. + + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md new file mode 100644 index 0000000..db6218f --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md @@ -0,0 +1,102 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop Changelog + +## Release 0.3.0 - 2006-06-02 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-256](https://issues.apache.org/jira/browse/HADOOP-256) | Implement a C api for hadoop dfs | Major | . | Arun C Murthy | Arun C Murthy | +| [HADOOP-233](https://issues.apache.org/jira/browse/HADOOP-233) | add a http status server for the task trackers | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-222](https://issues.apache.org/jira/browse/HADOOP-222) | Set replication from dfsshell | Trivial | . | Johan Oskarsson | Johan Oskarsson | +| [HADOOP-209](https://issues.apache.org/jira/browse/HADOOP-209) | Add a program to recursively copy directories across file systems | Major | fs | Milind Bhandarkar | | +| [HADOOP-115](https://issues.apache.org/jira/browse/HADOOP-115) | permit reduce input types to differ from reduce output types | Major | . | Runping Qi | Runping Qi | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-254](https://issues.apache.org/jira/browse/HADOOP-254) | use http to shuffle data between the maps and the reduces | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-218](https://issues.apache.org/jira/browse/HADOOP-218) | Inefficient calls to get configuration values in TaskInprogress | Minor | . | Mahadev konar | Mahadev konar | +| [HADOOP-216](https://issues.apache.org/jira/browse/HADOOP-216) | Task Detail web page missing progress | Trivial | . | Bryan Pendleton | Doug Cutting | +| [HADOOP-212](https://issues.apache.org/jira/browse/HADOOP-212) | allow changes to dfs block size | Critical | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-211](https://issues.apache.org/jira/browse/HADOOP-211) | logging improvements for Hadoop | Minor | . | Sameer Paranjpye | Sameer Paranjpye | +| [HADOOP-208](https://issues.apache.org/jira/browse/HADOOP-208) | add failure page to webapp | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-204](https://issues.apache.org/jira/browse/HADOOP-204) | Need to tweak a few things in the metrics package to support the Simon plugin | Major | metrics | David Bowen | David Bowen | +| [HADOOP-202](https://issues.apache.org/jira/browse/HADOOP-202) | sort should use a smaller number of reduces | Trivial | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-195](https://issues.apache.org/jira/browse/HADOOP-195) | improve performance of map output transfers | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-75](https://issues.apache.org/jira/browse/HADOOP-75) | dfs should check full file availability only at close | Minor | . | Doug Cutting | Milind Bhandarkar | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-270](https://issues.apache.org/jira/browse/HADOOP-270) | possible deadlock when shut down a datanode thread | Major | . | Hairong Kuang | Hairong Kuang | +| [HADOOP-265](https://issues.apache.org/jira/browse/HADOOP-265) | Abort tasktracker if it can not write to its local directories | Major | . | Hairong Kuang | Hairong Kuang | +| [HADOOP-264](https://issues.apache.org/jira/browse/HADOOP-264) | WritableFactory has no permissions to create DatanodeRegistration | Blocker | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-259](https://issues.apache.org/jira/browse/HADOOP-259) | map output http client does not timeout | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-251](https://issues.apache.org/jira/browse/HADOOP-251) | progress report failures kill task | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-247](https://issues.apache.org/jira/browse/HADOOP-247) | The Reduce Task thread for reporting progress during the sort exits in case of any IOException | Critical | . | Mahadev konar | Mahadev konar | +| [HADOOP-241](https://issues.apache.org/jira/browse/HADOOP-241) | TestCopyFiles fails under cygwin due to incorrect path | Minor | fs | Konstantin Shvachko | Milind Bhandarkar | +| [HADOOP-238](https://issues.apache.org/jira/browse/HADOOP-238) | map outputs transfers fail with EOFException | Blocker | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-235](https://issues.apache.org/jira/browse/HADOOP-235) | LocalFileSystem.openRaw() throws the wrong string for FileNotFoundException | Major | . | Benjamin Reed | | +| [HADOOP-229](https://issues.apache.org/jira/browse/HADOOP-229) | hadoop cp should generate a better number of map tasks | Minor | fs | Yoram Arnon | Milind Bhandarkar | +| [HADOOP-228](https://issues.apache.org/jira/browse/HADOOP-228) | hadoop cp should have a -config option | Minor | fs | Yoram Arnon | Milind Bhandarkar | +| [HADOOP-219](https://issues.apache.org/jira/browse/HADOOP-219) | SequenceFile#handleChecksumException NPE | Trivial | io | stack | Doug Cutting | +| [HADOOP-217](https://issues.apache.org/jira/browse/HADOOP-217) | IllegalAcessException when creating a Block object via WritableFactories | Major | . | Hairong Kuang | Hairong Kuang | +| [HADOOP-205](https://issues.apache.org/jira/browse/HADOOP-205) | the job tracker does not schedule enough map on the cluster | Major | . | Owen O'Malley | Mahadev konar | +| [HADOOP-200](https://issues.apache.org/jira/browse/HADOOP-200) | The map task names are sent to the reduces | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-180](https://issues.apache.org/jira/browse/HADOOP-180) | task tracker times out cleaning big job | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-179](https://issues.apache.org/jira/browse/HADOOP-179) | task tracker ghosts remain after 10 minutes | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-163](https://issues.apache.org/jira/browse/HADOOP-163) | If a DFS datanode cannot write onto its file system. it should tell the name node not to assign new blocks to it. | Major | . | Runping Qi | Hairong Kuang | +| [HADOOP-161](https://issues.apache.org/jira/browse/HADOOP-161) | dfs blocks define equal, but not hashcode | Major | . | Owen O'Malley | Milind Bhandarkar | +| [HADOOP-146](https://issues.apache.org/jira/browse/HADOOP-146) | potential conflict in block id's, leading to data corruption | Major | . | Yoram Arnon | Konstantin Shvachko | +| [HADOOP-141](https://issues.apache.org/jira/browse/HADOOP-141) | Disk thrashing / task timeouts during map output copy phase | Major | . | p sutter | Owen O'Malley | +| [HADOOP-124](https://issues.apache.org/jira/browse/HADOOP-124) | don't permit two datanodes to run from same dfs.data.dir | Critical | . | Bryan Pendleton | Konstantin Shvachko | + + +### TESTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-220](https://issues.apache.org/jira/browse/HADOOP-220) | Add -dfs and -jt command-line parameters to specify namenode and jobtracker. | Major | fs | Milind Bhandarkar | Milind Bhandarkar | + + +### OTHER: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/RELEASENOTES.0.3.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/RELEASENOTES.0.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/RELEASENOTES.0.3.0.md new file mode 100644 index 0000000..e648a8e --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/RELEASENOTES.0.3.0.md @@ -0,0 +1,24 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop 0.3.0 Release Notes + +These release notes cover new developer and user-facing incompatibilities, features, and major improvements. + + + http://git-wip-us.apache.org/repos/asf/hadoop/blob/d759b4bd/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md new file mode 100644 index 0000000..ba7aebf --- /dev/null +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.1/CHANGES.0.3.1.md @@ -0,0 +1,69 @@ + +<!--- +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +--> +# Apache Hadoop Changelog + +## Release 0.3.1 - 2006-06-05 + +### INCOMPATIBLE CHANGES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-276](https://issues.apache.org/jira/browse/HADOOP-276) | No appenders could be found for logger | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-274](https://issues.apache.org/jira/browse/HADOOP-274) | The new logging framework puts application logs into server directory in hadoop.log | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-272](https://issues.apache.org/jira/browse/HADOOP-272) | bin/hadoop dfs -rm \<dir\> crashes in log4j code | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-262](https://issues.apache.org/jira/browse/HADOOP-262) | the reduce tasks do not report progress if they the map output locations is empty. | Major | . | Mahadev konar | Mahadev konar | +| [HADOOP-245](https://issues.apache.org/jira/browse/HADOOP-245) | record io translator doesn't strip path names | Major | record | Owen O'Malley | Milind Bhandarkar | + + +### TESTS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + + +### OTHER: + +| JIRA | Summary | Priority | Component | Reporter | Contributor | +|:---- |:---- | :--- |:---- |:---- |:---- | + +
