http://git-wip-us.apache.org/repos/asf/hadoop/blob/1bc45461/hadoop-common-project/hadoop-common/CHANGES.txt ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt deleted file mode 100644 index 78ac5d7..0000000 --- a/hadoop-common-project/hadoop-common/CHANGES.txt +++ /dev/null @@ -1,18364 +0,0 @@ -Hadoop Change Log - -Trunk (Unreleased) - - INCOMPATIBLE CHANGES - - HADOOP-8124. Remove the deprecated FSDataOutputStream constructor, - FSDataOutputStream.sync() and Syncable.sync(). (szetszwo) - - HADOOP-10474 Move o.a.h.record to hadoop-streaming. (wheat9) - - HADOOP-9902. Shell script rewrite (aw) - - HADOOP-10950. rework heap management vars (John Smith via aw) - - HADOOP-6857. FsShell should report raw disk usage including replication - factor. (Byron Wong via shv) - - HADOOP-11657. Align the output of `hadoop fs -du` to be more Unix-like. - (aajisaka) - - HADOOP-11553. Formalize the shell API (aw) - - HADOOP-11731. Rework the changelog and releasenotes (aw) - - HADOOP-11627. Remove io.native.lib.available. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11698. Remove DistCpV1 and Logalyzer. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. - (Li Lu via wheat9) - - HADOOP-10787 Rename/remove non-HADOOP_*, etc from the shell scripts. - (aw via vvasudev) - - HADOOP-12294. Throw an Exception when fs.permissions.umask-mode is - misconfigured (Chang Li vha wheat9) - - NEW FEATURES - - HADOOP-6590. Add a username check for hadoop sub-commands (John Smith via - aw) - - HADOOP-11353. Add support for .hadooprc (aw) - - HADOOP-9044. add FindClass main class to provide classpath checking - of installations (Steve Loughran via aw) - - HADOOP-11485. Pluggable shell integration (aw) - - HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw) - - HADOOP-11565. Add --slaves shell option (aw) - - HADOOP-9642. Configuration to resolve environment variables via - ${env.VARIABLE} references (Kengo Seki via aw) - - HADOOP-7947. Validate XMLs if a relevant tool is available, when using - scripts (Kengo Seki via aw) - - HADOOP-10854. unit tests for the shell scripts (aw) - - HADOOP-10949. metrics2 sink plugin for Apache Kafka (Babak Behzad via aw) - - IMPROVEMENTS - - HADOOP-11203. Allow ditscp to accept bandwitdh in fraction MegaBytes - (Raju Bairishetti via amareshwari) - - HADOOP-8017. Configure hadoop-main pom to get rid of M2E plugin execution - not covered (Eric Charles via bobby) - - HADOOP-8015. ChRootFileSystem should extend FilterFileSystem - (Daryn Sharp via bobby) - - HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm) - - HADOOP-8078. Add capability to turn on security in unit tests. (Jaimin - Jetly via jitendra) - - HADOOP-7757. Test file reference count is at least 3x actual value (Jon - Eagles via bobby) - - HADOOP-8147. test-patch should run tests with -fn to avoid masking test - failures (Robert Evans via tgraves) - - HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) - - HADOOP-8308. Support cross-project Jenkins builds. (tomwhite) - - HADOOP-8297. Writable javadocs don't carry default constructor (harsh) - - HADOOP-8360. empty-configuration.xml fails xml validation - (Radim Kolar via harsh) - - HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS - filesystems (harsh) - - HADOOP-8434. Add tests for Configuration setter methods. - (Madhukara Phatak via suresh) - - HADOOP-8523. test-patch.sh doesn't validate patches before building - (Jack Dintruff via jeagles) - - HADOOP-8719. Workaround for kerberos-related log errors upon running any - hadoop command on OSX. (Jianbin Wei via harsh) - - HADOOP-8588. SerializationFactory shouldn't throw a - NullPointerException if the serializations list is empty. - (Sho Shimauchi via harsh) - - HADOOP-7930. Kerberos relogin interval in UserGroupInformation - should be configurable (Robert Kanter via harsh) - - HADOOP-8838. Colorize the test-patch output sent to JIRA (Harsh J via - bobby) - - HADOOP-8840. Fix the test-patch colorizer to cover all sorts of +1 lines. - (Harsh J via bobby) - - HADOOP-8864. Addendum to HADOOP-8840: Add a coloring case for +0 results - too. (harsh) - - HADOOP-8910. Add examples to GlobExpander#expand method. (suresh) - - HADOOP-8920. Add more javadoc to metrics2 related classes. (suresh) - - HADOOP-8776. Provide an option in test-patch that can enable/disable - compiling native code. (Chris Nauroth via suresh) - - HADOOP-6616. Improve documentation for rack awareness. (Adam Faris via - jghoman) - - HADOOP-9075. FileContext#FSLinkResolver should be made static. - (Arpit Agarwal via suresh) - - HADOOP-9277. Improve javadoc for FileContext. (Andrew Wang via suresh) - - HADOOP-9258 Add stricter tests to FileSystemContractTestBase (stevel) - - HADOOP-9486. Promoted Windows and Shell related utils from YARN to Hadoop - Common. (Chris Nauroth via vinodkv) - - HADOOP-8844. Add a plaintext fs -text test-case. - (Akira AJISAKA via harsh) - - HADOOP-9432 Add support for markdown .md files in site documentation - (stevel) - - HADOOP-9186. test-patch.sh should report build failure to JIRA. - (Binglin Chang via Colin Patrick McCabe) - - HADOOP-9833 move slf4j to version 1.7.5 (Kousuke Saruta via stevel) - - HADOOP-10325. Improve jenkins javadoc warnings from test-patch.sh (cmccabe) - - HADOOP-10342. Add a new method to UGI to use a Kerberos login subject to - build a new UGI. (Larry McCay via omalley) - - HADOOP-10485. Remove dead classes in hadoop-streaming. (wheat9) - - HADOOP-11013. CLASSPATH handling should be consolidated, debuggable (aw) - - HADOOP-11041. VersionInfo specifies subversion (Tsuyoshi OZAWA via aw) - - HADOOP-11092. hadoop shell commands should print usage if not given a - a class (aw) - - HADOOP-11231. Remove dead code in ServletUtil. (Li Lu via wheat9) - - HADOOP-11025. hadoop-daemons.sh should just call hdfs directly (Masatake - Iwasaki via aw) - - HADOOP-11150. hadoop command should show the reason on failure by - invalid COMMAND or CLASSNAME (Masatake Iwasaki via aw) - - HADOOP-11208. Replace "daemon" with better name in script subcommands (aw) - - HADOOP-10926. Improve smart-apply-patch.sh to apply binary diffs (cmccabe) - - HADOOP-11081. Document hadoop properties expected to be set by the shell - code in *-env.sh (aw) - - HADOOP-11352 Clean up test-patch.sh to disable "+1 contrib tests" - (Akira AJISAKA via stevel) - - HADOOP-10788. Rewrite kms to use new shell framework (John Smith via aw) - - HADOOP-11058. Missing HADOOP_CONF_DIR generates strange results - (Masatake Iwasaki via aw) - - HADOOP-11460. Deprecate shell vars (John Smith via aw) - - HADOOP-11346. Rewrite sls/rumen to use new shell framework (John Smith - via aw) - - HADOOP-6964. Allow compact property description in xml (Kengo Seki - via aw) - - HADOOP-11575. Daemon log documentation is misleading - (Naganarasimha G R via aw) - - HADOOP-11596. Allow smart-apply-patch.sh to add new files in binary git - patches (raviprak) - - HADOOP-11593. Convert site documentation from apt to markdown (stragglers) - (Masatake Iwasaki via aw) - - HADOOP-11673. Skip using JUnit Assume in TestCodec. (Brahma Reddy Battula - via cdouglas) - - HADOOP-10115. Exclude duplicate jars in hadoop package under different - component's lib (Vinayakumar B via aw) - - HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. - (cnauroth) - - HADOOP-11781. fix race conditions and add URL support to - smart-apply-patch.sh (Raymie Stata via aw) - - HADOOP-11850. Typos in hadoop-common java docs. (Surendra Singh Lilhore - via jghoman) - - HADOOP-11852. Disable symlinks in trunk. (Andrew Wang) - - HADOOP-11857. Fix CommandFormat#commandFormat java doc annotation. - (J.Andreina via jghoman) - - HADOOP-11813. releasedocmaker.py should use today's date instead of - unreleased (Darrell Taylor via aw) - - HADOOP-11590. Update sbin commands and documentation to use new --slaves - option (aw) - - HADOOP-10993. Dump java command line to *.out file - (Kengo Seki via vinayakumarb) - - HADOOP-12016. Typo in FileSystem::listStatusIterator - (Arthur Vigil via jghoman) - - HADOOP-11142. Remove hdfs dfs reference from file system shell - documentation (Kengo Seki via aw) - - HADOOP-12149. copy all of test-patch BINDIR prior to re-exec (aw) - - HADOOP-10979. Auto-entries in hadoop_usage (aw) - - HADOOP-12249. pull argument parsing into a function (aw) - - HADOOP-12436. GlobPattern regex library has performance issues with - wildcard characters (Matthew Paduano via aw) - - HADOOP-12385. Include nested stack trace in SaslRpcClient.getServerToken() - (stevel) - - HADOOP-12133. Add schemas to Maven Assembly XMLs (Gábor Lipták via aw) - - HADOOP-12541. make re2j dependency consistent (Matthew Paduano via aw) - - HADOOP-11887. Introduce Intel ISA-L erasure coding library for native - erasure encoding support (Kai Zheng via Colin P. McCabe) - - HADOOP-11828. Implement the Hitchhiker erasure coding algorithm. - (Jack Liuquan via zhz) - - BUG FIXES - - HADOOP-12617. SPNEGO authentication request to non-default realm gets - default realm name inserted in target server principal. (mattf) - - HADOOP-11473. test-patch says "-1 overall" even when all checks are +1 - (Jason Lowe via raviprak) - - HADOOP-9451. Fault single-layer config if node group topology is enabled. - (Junping Du via llu) - - HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) - - HADOOP-8177. MBeans shouldn't try to register when it fails to create - MBeanName. (Devaraj K via umamahesh) - - HADOOP-8018. Hudson auto test for HDFS has started throwing javadoc - (Jon Eagles via bobby) - - HADOOP-7610. Fix for hadoop debian package (Eric Yang via gkesavan) - - HADOOP-7641. Add Apache License to template config files. - (Eric Yang via atm) - - HADOOP-7621. alfredo config should be in a file not readable by users - (Alejandro Abdelnur via atm) - - HADOOP-7669 Fix newly introduced release audit warning. - (Uma Maheswara Rao G via stevel) - - HADOOP-6220. HttpServer wraps InterruptedExceptions by IOExceptions - if interrupted in startup (stevel) - - HADOOP-7703. Improved exception handling of shutting down web server. - (Devaraj K via Eric Yang) - - HADOOP-7704. Reduce number of object created by JMXJsonServlet. - (Devaraj K via Eric Yang) - - HADOOP-7769. TestJMXJsonServlet is failing. (tomwhite) - - HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in - /tmp and /user. (Ravi Prakash via jitendra) - - HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites. - (todd) - - HADOOP-7788. Add simple HealthMonitor class to watch an HAService (todd) - - HADOOP-8312. testpatch.sh should provide a simpler way to see which - warnings changed (bobby) - - HADOOP-8339. jenkins complaining about 16 javadoc warnings - (Tom White and Robert Evans via tgraves) - - HADOOP-8354. test-patch findbugs may fail if a dependent module is changed - (Tom White and Robert Evans) - - HADOOP-8375. test-patch should stop immediately once it has found - compilation errors (bobby) - - HADOOP-8395. Text shell command unnecessarily demands that a - SequenceFile's key class be WritableComparable (harsh) - - HADOOP-8413. test-patch.sh gives out the wrong links for - newPatchFindbugsWarnings (Colin Patrick McCabe via bobby) - - HADOOP-6871. When the value of a configuration key is set to its - unresolved form, it causes the IllegalStateException in - Configuration.get() stating that substitution depth is too large. - (Arvind Prabhakar via harsh) - - HADOOP-8548. test-patch.sh shows an incorrect link in Jekins builds - (Kihwal Lee via bobby) - - HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn) - - HADOOP-8584. test-patch.sh should not immediately exit when no - tests are added or modified. (Colin Patrick McCabe via eli) - - HADOOP-8521. Port StreamInputFormat to new Map Reduce API (madhukara - phatak via bobby) - - HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package. - (Brandon Li via suresh) - - HADOOP-8623. hadoop jar command should respect HADOOP_OPTS. - (Steven Willis via suresh) - - HADOOP-8684. Deadlock between WritableComparator and WritableComparable. - (Jing Zhao via suresh) - - HADOOP-8786. HttpServer continues to start even if AuthenticationFilter - fails to init (todd) - - HADOOP-8767. Secondary namenode is started on slave nodes instead of - master nodes. (Giovanni Delussu via suresh) - - HADOOP-8821. Fix findbugs warning related to concatenating string in a - for loop in Configuration#dumpDeprecatedKeys(). (suresh) - - HADOOP-7256. Resource leak during failure scenario of closing - of resources. (Ramkrishna S. Vasudevan via harsh) - - HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations - to RPC Server and Client classes. (Brandon Li via suresh) - - HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout - (default behavior in some bash setups (esp. Ubuntu)) - (Chiristopher Berner and Andy Isaacson via harsh) - - HADOOP-8839. test-patch's -1 on @author tag presence doesn't cause - a -1 to the overall result (harsh) - - HADOOP-8918. test-patch.sh is parsing modified files wrong. - (Raja Aluri via suresh) - - HADOOP-8974. TestDFVariations fails on Windows. (Chris Nauroth via suresh) - - HADOOP-9037. Bug in test-patch.sh and precommit build process (Kihwal Lee - via jlowe) - - HADOOP-9131. Turn off TestLocalFileSystem#testListStatusWithColons on - Windows. (Chris Nauroth via suresh) - - HADOOP-9139. improve killKdc.sh (Ivan A. Veselovsky via bobby) - - HADOOP-9202. test-patch.sh fails during mvn eclipse:eclipse if patch adds - a new module to the build (Chris Nauroth via bobby) - - HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure - when running with Clover. (Chris Nauroth via suresh) - - HADOOP-9393. TestRPC fails with JDK7. (Andrew Wang via atm) - - HADOOP-9394. Port findHangingTest.sh from HBase to Hadoop. (Andrew Wang - via atm) - - HADOOP-9431 TestSecurityUtil#testLocalHostNameForNullOrWild on systems where hostname - contains capital letters (Chris Nauroth via sanjay) - - HADOOP-9261 S3n filesystem can move a directory under itself -and so lose data - (fixed in HADOOP-9258) (stevel) - - HADOOP-9265 S3 blockstore filesystem breaks part of the Filesystem contract - (fixed in HADOOP-9258) (stevel) - - HADOOP-9433 TestLocalFileSystem#testHasFileDescriptor leaks file handle - (Chris Nauroth via sanjay) - - HADOOP-9583. test-patch gives +1 despite build failure when running tests. - (jlowe via kihwal) - - HADOOP-9847. TestGlobPath symlink tests fail to cleanup properly. - (cmccabe via wang) - - HADOOP-9740. Fix FsShell '-text' command to be able to read Avro - files stored in HDFS and other filesystems. (Allan Yan via cutting) - - HADOOP-10044 Improve the javadoc of rpc code (sanjay Radia) - - HADOOP-10625. Trim configuration names when putting/getting them - to properties. (Wangda Tan via xgong) - - HADOOP-10831. UserProvider is not thread safe. (Benoy Antony via umamahesh) - - HADOOP-10834. Typo in CredentialShell usage. (Benoy Antony via umamahesh) - - HADOOP-11002. shell escapes are incompatible with previous releases (aw) - - HADOOP-10996. Stop violence in the *_HOME (aw) - - HADOOP-11033. shell scripts ignore JAVA_HOME on OS X. (aw) - - HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked - in bin/hdfs (aw) - - HADOOP-11055. non-daemon pid files are missing (aw) - - HADOOP-11022. User replaced functions get lost 2-3 levels deep (e.g., - sbin) (aw) - - HADOOP-11284. Fix variable name mismatches in hadoop-functions.sh (Masatake - Iwasaki via aw) - - HADOOP-11298. slaves.sh and stop-all.sh are missing slashes (aw) - - HADOOP-11296. hadoop-daemons.sh throws 'host1: bash: host3: - command not found...' (vinayakumarb) - - HADOOP-11380. Restore Rack Awareness documenation (aw) - - HADOOP-11397. Can't override HADOOP_IDENT_STRING (Kengo Seki via aw) - - HADOOP-10908. Common needs updates for shell rewrite (aw) - - HADOOP-11559. Add links to RackAwareness and InterfaceClassification - to site index (Masatake Iwasaki via aw) - - HADOOP-11580. Remove SingleNodeSetup.md from trunk (aajisaka) - - HADOOP-11583. Fix syntax error in SecureMode.md (Masatake Iwasaki via aw) - - HADOOP-11437. Remove the version and author information from distcp's - README file (Brahma Reddy Battula via aw) - - HADOOP-11585. Fix formatting in Tracing.md (Masatake Iwasaki via aw) - - HADOOP-11625. Minor fixes to command manual & SLA doc (aw) - - HADOOP-11637. bash location hard-coded in shell scripts (aw) - - HADOOP-10774. Update KerberosTestUtils for hadoop-auth tests when using - IBM Java (sangamesh via aw) - - HADOOP-11653. shellprofiles should require .sh extension - (Brahma Reddy Battula via aw) - - HADOOP-11668. hadoop-daemons.sh bw compat broke with --slaves change - (Vinayakumar B via aw) - - HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab - via aw) - - HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) - - HADOOP-11865. Incorrect path mentioned in document for accessing script - files (J.Andreina via aw) - - HADOOP-11775. Fix Javadoc typos in hadoop-openstack module (Yanjun Wang - via aw) - - HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster - ClassNotFoundException (Darrell Taylor via aw) - - HADOOP-11406. xargs -P is not portable (Kengo Seki via aw) - - HADOOP-11983. HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is - supposed to do (Sangjin Lee via aw) - - HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout - remaining forrest bits (aw) - - HADOOP-9905. remove dependency of zookeeper for hadoop-client (vinayakumarb) - - HADOOP-11347. RawLocalFileSystem#mkdir and create should honor umask (Varun - Saxena via Colin P. McCabe) - - HADOOP-12107. long running apps may have a huge number of StatisticsData - instances under FileSystem (Sangjin Lee via Ming Ma) - - HADOOP-11762. Enable swift distcp to secure HDFS (Chen He via aw) - - HADOOP-12009. Clarify FileSystem.listStatus() sorting order & fix - FileSystemContractBaseTest:testListStatus. (J.Andreina via jghoman) - - HADOOP-12244. recover broken rebase during precommit (aw) - - HADOOP-11942. Add links to SLGUserGuide to site index. - (Masatake Iwasaki via xyao) - - HADOOP-12364. Deleting pid file after stop is causing the daemons to - keep restarting (Siqi Li via aw) - - HADOOP-12515. Mockito dependency is missing in hadoop-kafka module. - (Kai Zheng via aajisaka) - - HADOOP-12494. fetchdt stores the token based on token kind instead - of token service (HeeSoo Kim via aw) - - HADOOP-12553. [JDK8] Fix javadoc error caused by illegal tag. (aajisaka) - - HADOOP-12638. UnsatisfiedLinkError while checking ISA-L in checknative - command. (Kai Sasaki via Colin P. McCabe) - - HADOOP-12615. Fix NPE in MiniKMS.start(). (Wei-Chiu Chuang via zhz) - - HADOOP-12647. Add /usr/lib default for ISAL library and fix missing .c file - in CMakeLists (Kai Zheng via cmccabe) - - HADOOP-12070. Some of the bin/hadoop subcommands are not available - on Windows. (Kengo Seki via Arpit Agarwal) - - OPTIMIZATIONS - - HADOOP-7761. Improve the performance of raw comparisons. (todd) - - HADOOP-8589. ViewFs tests fail when tests and home dirs are nested (sanjay Radia) - - BREAKDOWN OF HADOOP-11264 SUBTASKS AND RELATED JIRAS (Common part of HDFS-7285) - - HADOOP-11514. Raw Erasure Coder API for concrete encoding and decoding - (Kai Zheng via umamahesh) - - HADOOP-11534. Minor improvements for raw erasure coders - ( Kai Zheng via vinayakumarb ) - - HADOOP-11541. Raw XOR coder - ( Kai Zheng ) - - HADOOP-11542. Raw Reed-Solomon coder in pure Java. Contributed by Kai Zheng - ( Kai Zheng ) - - HADOOP-11643. Define EC schema API for ErasureCodec. Contributed by Kai Zheng - ( Kai Zheng ) - - HADOOP-11646. Erasure Coder API for encoding and decoding of block group - ( Kai Zheng via vinayakumarb ) - - HADOOP-11705. Make erasure coder configurable. Contributed by Kai Zheng - ( Kai Zheng ) - - HADOOP-11706. Refine a little bit erasure coder API. Contributed by Kai Zheng - ( Kai Zheng ) - - HADOOP-11707. Add factory to create raw erasure coder. Contributed by Kai Zheng - ( Kai Zheng ) - - HADOOP-11647. Reed-Solomon ErasureCoder. Contributed by Kai Zheng - ( Kai Zheng ) - - HADOOP-11782 Correct two thrown messages in ECSchema class. Contributed by Xinwei Qin - ( Xinwei Qin via Kai Zheng ) - - HADOOP-11740. Combine erasure encoder and decoder interfaces (Zhe Zhang) - - HADOOP-11805 Better to rename some raw erasure coders. Contributed by Kai Zheng - ( Kai Zheng ) - - HADOOP-11645. Erasure Codec API covering the essential aspects for an erasure code - ( Kai Zheng via vinayakumarb ) - - HADOOP-11818. Minor improvements for erasurecode classes. (Rakesh R via Kai Zheng) - - HADOOP-11841. Remove unused ecschema-def.xml files. (szetszwo) - - HADOOP-11921. Enhance tests for erasure coders. (Kai Zheng via Zhe Zhang) - - HADOOP-11920. Refactor some codes for erasure coders. (Kai Zheng via Zhe Zhang) - - HADOOP-11566. Add tests and fix for erasure coders to recover erased parity - units. (Kai Zheng via Zhe Zhang) - - HADOOP-11938. Enhance ByteBuffer version encode/decode API of raw erasure - coder. (Kai Zheng via Zhe Zhang) - - HADOOP-12013. Generate fixed data to perform erasure coder test. (Kai Zheng) - - HADOOP-12029. Remove chunkSize from ECSchema as its not required for coders - (vinayakumarb) - - HADOOP-11847. Enhance raw coder allowing to read least required inputs in decoding. - (Kai Zheng) - - HADOOP-12011. Allow to dump verbose information to ease debugging in raw erasure coders - (Kai Zheng) - - HADOOP-12065. Using more meaningful keys in EC schema. (Kai Zheng) - - HADOOP-12060. Fix ByteBuffer usage for raw erasure coders. (Kai Zheng via - jing9) - - HADOOP-11921. Enhance tests for erasure coders. (Kai Zheng) - - HADOOP-12327. Initialize output buffers with ZERO bytes in erasure coder. - (Kai Zheng via waltersu4549) - - HADOOP-12047. Indicate preference not to affect input buffers during - coding in erasure coder. (Kai Zheng via waltersu4549) - - HADOOP-12544. Erasure Coding: create dummy raw coder to isolate performance - issues in testing. (Rui Li via zhz) - - HADOOP-12685. Input buffer position after encode/decode not consistent - between different kinds of buffers. (Rui Li via zhz) - - HADOOP-12757. Findbug compilation fails for 'Kafka Library support'. - (aajisaka) - - HADOOP-12041. Implement another Reed-Solomon coder in pure Java. - (Kai Zheng via zhz) - - HADOOP-12808. Rename the RS coder from HDFS-RAID as legacy. - (Rui Li via zhz) - -Release 2.9.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha) - - IMPROVEMENTS - - HADOOP-12321. Make JvmPauseMonitor an AbstractService. - (Sunil G via Stevel) - - HADOOP-12625. Add a config to disable the /logs endpoints (rkanter) - - HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha) - - HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. - (BELUGA BEHR via stevel) - - HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" - when using kerberos and attempting to bind to any port on the local IP - address (cmccabe) - - HADOOP-12683. Add number of samples in last interval in snapshot of - MutableStat. (Vikram Srivastava via kasha) - - HADOOP-8887. Use a Maven plugin to build the native code using CMake - (cmccabe) - - HADOOP-12713. Disable spurious checkstyle checks. (wang) - - HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng - via cmccabe) - - HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to - log uncaught exceptions/errors. (Sidharta Seethana via vvasudev) - - HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs - (Wei-Chiu Chuang via iwasakims) - - HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) - - HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei) - - HADOOP-10321. TestCompositeService should cover all enumerations of - adding a service to a parent service. (Ray Chiang via kasha) - - HADOOP-12859. Disable hiding field style checks in class setters. (Kai Zheng via wang) - - BUG FIXES - - HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing - (iwasakims) - - HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider - than expected. (Wei-Chiu Chuang via stevel) - - HADOOP-12613. TestFind.processArguments occasionally fails. - (Wei-Chiu Chuang via stevel) - - HADOOP-12597. In kms-site.xml configuration - "hadoop.security.keystore.JavaKeyStoreProvider.password" - should be updated with new name. (Surendra Singh Lilhore via stevel) - - HADOOP-12573. TestRPC.testClientBackOff failing. - (Xiao Chen via stevel) - - HDFS-9517. Fix missing @Test annotation on - TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe) - - HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) - - HADOOP-12714. Fix hadoop-mapreduce-client-nativetask unit test which fails - because it is not able to open the "glibc bug spill" file. (cmccabe) - - HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions - (Gregory Chanan via cmccabe) - -Release 2.8.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - HADOOP-11746. rewrite test-patch.sh (aw) - - HADOOP-12416. Trash messages should be handled by Logger instead of being - delivered on System.out. (Mingliang Liu via aajisaka) - - HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims) - - NEW FEATURES - - HADOOP-11226. Add a configuration to set ipc.Client's traffic class with - IPTOS_LOWDELAY|IPTOS_RELIABILITY. (Gopal V via ozawa) - - HADOOP-9477. Add posixGroups support for LDAP groups mapping service. - (Dapeng Sun via Yongjun Zhang) - - HADOOP-11843. Make setting up the build environment easier. - (Niels Basjes via cnauroth) - - HADOOP-11949. Add user-provided plugins to test-patch (Sean Busbey via aw) - - HADOOP-8934. Shell command ls should include sort options (Jonathan Allen - via aw) - - HADOOP-10971. Add -C flag to make `hadoop fs -ls` print filenames only. - (Kengo Seki via aajisaka) - - HADOOP-5732. Add SFTP FileSystem. (Ramtin Boustani and Inigo Goiri via - cdouglas) - - HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) - - HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via - yliu) - - HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. - (Kanaka Kumar Avvaru via aajisaka) - - HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) - - HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. - (Larry McCay via cnauroth) - - HADOOP-12635. Adding Append API support for WASB. (Dushyanth via cnauroth) - - HADOOP-12426. Add Entry point for Kerberos health check - (Steve Loughran via cnauroth) - - HADOOP-12548. Read s3a creds from a Credential Provider. - (Larry McCay via cnauroth) - - IMPROVEMENTS - - HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum - set to 0 (Mingliang Liu via gtcarrera9) - - HADOOP-12458. Retries is typoed to spell Retires in parts of - hadoop-yarn and hadoop-common - (Neelesh Srinivas Salian via harsh) - - HADOOP-12271. Hadoop Jar Error Should Be More Explanatory - (Josh Elser via harsh) - - HADOOP-6842. "hadoop fs -text" does not give a useful text representation - of MapWritable objects (Akira Ajisaka via bobby) - - HADOOP-11719. [Fsshell] Remove bin/hadoop reference from - GenericOptionsParser default help text. - (Brahma Reddy Battula via harsh) - - HADOOP-11692. Improve authentication failure WARN message to avoid user - confusion. (Yongjun Zhang) - - HADOOP-11659. o.a.h.fs.FileSystem.Cache#remove should use a single hash map - lookup. (Brahma Reddy Battula via aajisaka) - - HADOOP-11709. Time.NANOSECONDS_PER_MILLISECOND - use class-level final - constant instead of method variable (Ajith S via ozawa) - - HADOOP-11447. Add a more meaningful toString method to SampleStat and - MutableStat. (kasha) - - HADOOP-11737. mockito's version in hadoop-nfsâ pom.xml shouldn't be - specified. (Kengo Seki via ozawa) - - HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). - (Walter Su via ozawa) - - HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 - architecture (Edward Nevill via Colin P. McCabe) - - HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. - (Jean-Pierre Matsumoto via cnauroth) - - HADOOP-11717. Support JWT tokens for web single sign on to the Hadoop - servers. (Larry McCay via omalley) - - HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. - (Li Lu via wheat9) - - HADOOP-7713. dfs -count -q should label output column (Jonathan Allen - via aw) - - HADOOP-11819. HttpServerFunctionalTest#prepareTestWebapp should create web - app directory if it does not exist. (Rohith via vinayakumarb) - - HADOOP-11827. Speed-up distcp buildListing() using threadpool - (Zoran Dimitrijevic via raviprak) - - HADOOP-10597. RPC Server signals backoff to clients when all request - queues are full. (Ming Ma via Arpit Agarwal) - - HADOOP-11357. Print information of the build enviornment in test-patch.sh - (aw) - - HADOOP-11328. ZKFailoverController does not log Exception when doRun raises - errors. (Tianyin Xu via ozawa) - - HADOOP-11120. hadoop fs -rmr gives wrong advice. (Juliet Hougland via wang) - - HADOOP-11911. test-patch should allow configuration of default branch - (Sean Busbey via aw) - - HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess - setups (aw) - - HADOOP-11925. backport trunk's smart-apply-patch.sh to branch-2 (aw) - - HADOOP-11906. test-patch.sh should use 'file' command for patch - determinism (Sean Busbey via aw) - - HADOOP-11950. Add cli option to test-patch to set the project-under-test - (Sean Busbey via aw) - - HADOOP-11948. test-patch's issue matching regex should be configurable. - (Sean Busbey via aw) - - HADOOP-9723. Improve error message when hadoop archive output path already - exists. (Jean-Baptiste Onofré and Yongjun Zhang via aajisak) - - HADOOP-11713. ViewFileSystem should support snapshot methods. - (Rakesh R via cnauroth) - - HADOOP-11960. Enable Azure-Storage Client Side logging. - (Dushyanth via cnauroth) - - HADOOP-11939. Deprecate DistCpV1 and Logalyzer. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11884. test-patch.sh should pull the real findbugs version - (Kengo Seki via aw) - - HADOOP-11944. add option to test-patch to avoid relocating patch process - directory (Sean Busbey via aw) - - HADOOP-1540. Support file exclusion list in distcp. (Rich Haase via jing9) - - HADOOP-11103. Clean up RemoteException (Sean Busbey via vinayakumarb) - - HADOOP-11995. Make jetty version configurable from the maven command line. - (Sriharsha Devineni via wheat9) - - HADOOP-10366. Add whitespaces between classes for values in - core-default.xml to fit better in browser. - (kanaka kumar avvaru via aajisaka) - - HADOOP-11594. Improve the readability of site index of documentation. - (Masatake Iwasaki via aajisaka) - - HADOOP-12030. test-patch should only report on newly introduced - findbugs warnings. (Sean Busbey via aw) - - HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating - (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-12043. Display warning if defaultFs is not set when running fs - commands. (Lei Xu via wang) - - HADOOP-12037. Fix wrong classname in example configuration of hadoop-auth - documentation. (Masatake Iwasaki via wang) - - HADOOP-12059. S3Credentials should support use of CredentialProvider. - (Sean Busbey via wang) - - HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect - errors when listing a directory. (Zhihai Xu via wang) - - HADOOP-12055. Deprecate usage of NativeIO#link. (Andrew Wang via cnauroth) - - HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to - hadoop-common. (Masatake Iwasaki via aajisaka) - - HADOOP-11965. determine-flaky-tests needs a summary mode. - (Yufei Gu via Yongjun Zhang) - - HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error - occurs (Jason Lowe via jeagles) - - HADOOP-12158. Improve error message in - TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not - installed. (wang) - - HADOOP-12124. Add HTrace support for FsShell (cmccabe) - - HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) - - HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. - (Kazuho Fujii via cnauroth) - - HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. - McCabe) - - HADOOP-12193. Rename Touchz.java to Touch.java. (wang) - - HADOOP-12195. Add annotation to package-info.java file to workaround - MCOMPILER-205. (wang) - - HADOOP-12201. Add tracing to FileSystem#createFileSystem and Globber#glob - (cmccabe) - - HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. - (Chris Douglas via kasha) - - HADOOP-12210. Collect network usage on the node (Robert Grandl via cdouglas) - - HADOOP-12211. Collect disk usage on the node (Robert Grandl via cdouglas) - - HADOOP-12153. ByteBufferReadable doesn't declare @InterfaceAudience and - @InterfaceStability. (Brahma Reddy Battula via ozawa) - - HADOOP-11893. Mark org.apache.hadoop.security.token.Token as - @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) - - HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. - (aajisaka) - - HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. - (vinayakumarb) - - HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin - Walsh via Colin P. McCabe) - - HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. - (Brahma Reddy Battula via Arpit Agarwal) - - HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements - drop nearly impossible. (Zhihai Xu via wang) - - HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) - - HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be - removed (Alan Burlison via Colin P. McCabe) - - HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) - - HADOOP-12183. Annotate the HTrace span created by FsShell with the - command-line arguments passed by the user (Masatake Iwasaki via Colin P. - McCabe) - - HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. (Mike - Yoder via atm) - - HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster - ClassNotFoundException (Darrell Taylor via aw) - - HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu) - - HADOOP-12050. Enable MaxInactiveInterval for hadoop http auth token - (hzlu via benoyantony) - - HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. - (Anu Engineer via xyao) - - HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. - (wang) - - HADOOP-12367. Move TestFileUtil's test resources to resources folder. - (wang via yliu) - - HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf - within target folder. (wang) - - HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. - (xyao via wang) - - HADOOP-12384. Add "-direct" flag option for fs copy so that user can choose - not to create "._COPYING_" file (J.Andreina via vinayakumarb) - - HADOOP-12324. Better exception reporting in SaslPlainServer. - (Mike Yoder via stevel) - - HADOOP-12404. Disable caching for JarURLConnection to avoid sharing - JarFile with other users when loading resource from URL in Configuration - class. (zxu) - - HADOOP-12428. Fix inconsistency between log-level guards and statements. - (Jagadesh Kiran N and Jackie Chang via ozawa) - - HADOOP-12446. Undeprecate createNonRecursive() (Ted Yu via kihwal) - - HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 - (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and - writes (Dushyanth via cnauroth) - - HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical - parameter checking. (Ray Chiang via aajisaka) - - HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey - Brotherton via Colin P. McCabe) - - HADOOP-10775. Shell operations to fail with meaningful errors on windows if - winutils.exe not found. (stevel) - - HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query - String (Larry McCay via cnauroth) - - HADOOP-12460. Add overwrite option for 'get' shell command - (Jagadesh Kiran N via vinayakumarb) - - HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. (Xiao Chen via wang) - - HADOOP-9692. Improving log message when SequenceFile reader throws - EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa) - - HADOOP-7266. Deprecate metrics v1. (Akira AJISAKA via ozawa) - - HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. - (Steve Loughran via jing9) - - HADOOP-12514. Make static fields in GenericTestUtils for - assertExceptionContains() package-private and final. - (Mingliang Liu via stevel) - - HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate - Azure Storage account keys for service integration tests. (cnauroth) - - HADOOP-11685. StorageException complaining " no lease ID" during HBase - distributed log splitting (Duo Xu via cnauroth) - - HADOOP-12040. Adjust inputs order for the decode API in raw erasure coder. - (Kai Zheng via yliu) - - HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor - and Aaron Fabbri via lei) - - HADOOP-12562. Make hadoop dockerfile usable by Yetus. - (Allen Wittenauer via wheat9) - - HADOOP-12568. Update core-default.xml to describe posixGroups support. - (Wei-Chiu Chuang via aajisaka) - - HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in - org.apache.hadoop.io package. (Dustin Cote via ozawa) - - HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead - of get() and getSize(). (Akira AJISAKA via ozawa) - - HADOOP-12575. Add build instruction for docker toolbox instead of - boot2docker(Kai Sasaki via ozawa) - - HADOOP-10035. Cleanup TestFilterFileSystem. (Suresh Srinivas via wheat9) - - HADOOP-10555. Add offset support to MurmurHash. - (Sergey Shelukhin via wheat9) - - HADOOP-10465. Fix use of generics within SortedMapWritable. - (Bertrand Dechoux via wheat9) - - HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a - Stable interface. (cnauroth) - - HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh) - - HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh) - - HADOOP-12570. HDFS Secure Mode Documentation updates. - (Arpit Agarwal via cnauroth) - - HADOOP-12686. Update FileSystemShell documentation to mention the meaning - of each columns of fs -du. (Daisuke Kobayashi via aajisaka) - - HADOOP-12658. Clear javadoc and check style issues around DomainSocket - (Kai Zheng via umamahesh) - - HADOOP-12604. Exception may be swallowed in KMSClientProvider. - (Yongjun Zhang) - - HADOOP-12696. Add tests for S3Filesystem Contract (Matt Paduano via raviprak) - - HADOOP-12755. Fix typo in defaultFS warning message. (wang) - - HADOOP-12292. Make use of DeleteObjects optional. - (Thomas Demoor via stevel) - - HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. - (Daniel Templeton via wang) - - HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential - propagation (Steve Loughran via cnauroth) - - HADOOP-12764. Increase default value of KMX maxHttpHeaderSize and make it - configurable. (zhz) - - HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. - (Wei-Chiu Chuang via umamahesh) - - HADOOP-12699. TestKMS#testKMSProvider intermittently fails during - 'test rollover draining'. (Xiao Chen via wang) - - HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. - (Brahma Reddy Battula via vinayakumarb) - - HADOOP-11031. Design Document for Credential Provider API. - (Larry McCay via cnauroth) - - HADOOP-12828. Print user when services are started. - (Wei-Chiu Chuang via Yongjun Zhang) - - HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. - (Masatake Iwasaki via cnauroth) - - HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through - ssl-server.conf. (Vijay Singh via zhz) - - HADOOP-12555. WASB to read credentials from a credential provider. - (Larry McCay via cnauroth) - - HADOOP-12535. Run FileSystem contract tests with hadoop-azure. - (Madhumita Chakraborty via cnauroth) - - HADOOP-12824. Collect network and disk usage on the node running Windows. - (Inigo Goiri via xyao) - - HADOOP-12825. Log slow name resolutions. - (Sidharta Seethana via stevel) - - HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. - (Junping Du via jianhe) - - HADOOP-12793. Write a new group mapping service guide - (Wei-Chiu Chuang via iwasakims) - - OPTIMIZATIONS - - HADOOP-11785. Reduce the number of listStatus operation in distcp - buildListing (Zoran Dimitrijevic via Colin P. McCabe) - - HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 - ThreadLocalRandom. (Sean Busbey via Colin P. McCabe) - - HADOOP-11772. RPC Invoker relies on static ClientCache which has - synchronized(this) blocks. (wheat9) - - HADOOP-11242. Record the time of calling in tracing span of - IPC server. (Masatake Iwasaki via aajisaka) - - HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. - (wang) - - HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework - (alanburlison via cmccabe) - - HADOOP-12036. Consolidate all of the cmake extensions in one directory - (alanburlison via cmccabe) - - HADOOP-12112. Make hadoop-common-project Native code -Wall-clean - (alanburlison via cmccabe) - - HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence - of the parent. (cnauroth) - - HADOOP-12194. Support for incremental generation in the protoc plugin. - (wang) - - HADOOP-11878. FileContext#fixRelativePart should check for not null for a - more informative exception. (Brahma Reddy Battula via kasha) - - HADOOP-11984. Enable parallel JUnit tests in pre-commit. - (Chris Nauroth via vinayakumarb) - - HADOOP-12450. UserGroupInformation should not log at WARN level if no groups - are found. (Elliott Clark via stevel) - - HADOOP-12758. Extend CSRF Filter with UserAgent Checks - (Larry McCay via cnauroth) - - HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly - and non-directly buffer cases. (szetszwo) - - HADOOP-12853. Change WASB documentation regarding page blob support. - (Madhumita Chakraborty via cnauroth) - - BUG FIXES - - HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals - before deleting (Casey Brotherton via harsh) - - HADOOP-11568. Description on usage of classpath in hadoop command is - incomplete. ( Archana T via vinayakumarb ) - - HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of - jclass to GetStaticObjectField. (Hui Zheng via cnauroth) - - HADOOP-11724. DistCp throws NPE when the target directory is root. - (Lei Eddy Xu via Yongjun Zhang) - - HADOOP-11760. Fix typo of javadoc in DistCp. (Brahma Reddy Battula via - ozawa). - - HADOOP-11800. Clean up some test methods in TestCodec.java. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11811. Fix typos in hadoop-project/pom.xml and TestAccessControlList. - (Brahma Reddy Battula via ozawa) - - HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress - instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) - - HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. - (Larry McCay via stevel) - - HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. - (Eugene Koifman via jitendra) - - HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c - (Malcolm Kavalsky via Colin P. McCabe) - - HADOOP-11861. test-patch.sh rewrite addendum patch. - (Allen Wittenauer via cnauroth) - - HADOOP-11864. JWTRedirectAuthenticationHandler breaks java8 javadocs. - (Larry McCay via stevel) - - HADOOP-11876. Refactor code to make it more readable, minor - maybePrintStats bug (Zoran Dimitrijevic via raviprak) - - HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, - SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter) - - HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via - aw) - - HADOOP-11821. Fix findbugs warnings in hadoop-sls. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11866. increase readability and reliability of checkstyle, - shellcheck, and whitespace reports (aw) - - HADOOP-11889. Make checkstyle runnable from root project - (Gera Shegalov via jeagles) - - HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera) - - HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC - due to a JVM bug. (Ming Ma via ozawa) - - HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven - builds (aw) - - HADOOP-11926. test-patch.sh mv does wrong math (aw) - - HADOOP-11912. Extra configuration key used in TraceUtils should respect - prefix (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-10387. Misspelling of threshold in log4j.properties for tests in - hadoop-common-project. (Brahma Reddy Battula via aajisaka) - - HADOOP-11936. Dockerfile references a removed image (aw) - - HADOOP-11922. Misspelling of threshold in log4j.properties for tests - in hadoop-tools (Gabor Liptak via vinayakumarb) - - HADOOP-11877. SnappyDecompressor's Logger class name is wrong - (surendra singh lilhore via vinayakumarb) - - HADOOP-10356. Corrections in winutils/chmod.c. (Rene Nyffenegger via - Arpit Agarwal) - - HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs - (Hairong Kuang via jlowe) - - HADOOP-9729. The example code of org.apache.hadoop.util.Tool is incorrect - (hellojinjie via jlowe) - - HADOOP-11928. Test-patch check for @author tags incorrectly flags - removal of @author tags (Kengo Seki via aw) - - HADOOP-11951. test-patch should give better info about failures to handle - dev-support updates without resetrepo option (Sean Busbey via aw) - - HADOOP-11947. test-patch should return early from determine-issue when - run in jenkins mode. (Sean Busbey via aw) - - HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out - even in debug level. (Junping Du via wheat9) - - HADOOP-8174. Remove confusing comment in Path#isAbsolute() - (Suresh Srinivas via vinayakumarb) - - HADOOP-11988. Fix typo in the document for hadoop fs -find. - (Kengo Seki via aajisaka) - - HADOOP-10582. Fix the test case for copying to non-existent dir in - TestFsShellCopy. (Kousuke Saruta via aajisaka) - - HADOOP-11581. Multithreaded correctness Warnings - #org.apache.hadoop.fs.shell.Ls (Brahma Reddy Battula via aw) - - HADOOP-11963. Metrics documentation for FSNamesystem misspells - PendingDataNodeMessageCount. (Anu Engineer via cnauroth) - - HADOOP-12000. cannot use --java-home in test-patch (aw) - - HADOOP-12014. hadoop-config.cmd displays a wrong error message. - (Kengo Seki via aajisaka) - - HADOOP-11955. Fix a typo in the cluster setup doc. - (Yanjun Wang via aajisaka) - - HADOOP-11743. maven doesn't clean all the site files - (ramtin via vinayakumarb) - - HADOOP-11927. Fix "undefined reference to dlopen" error when compiling - libhadooppipes (Xianyin Xin via Colin P. McCabe) - - HADOOP-8751. NPE in Token.toString() when Token is constructed using null - identifier. (kanaka kumar avvaru via aajisaka) - - HADOOP-12004. test-patch breaks with reexec in certain situations (Sean - Busbey via aw) - - HADOOP-12035. shellcheck plugin displays a wrong version potentially - (Kengo Seki via aw) - - HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher - that stops the thread. (zhouyingchao via cmccabe) - - HADOOP-11930. test-patch in offline mode should tell maven to be in - offline mode (Sean Busbey via aw) - - HADOOP-11959. WASB should configure client side socket timeout in storage - client blob request options. (Ivan Mitic via cnauroth) - - HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run - (Andreina J via vinayakumarb) - - HADOOP-11991. test-patch.sh isn't re-executed even if smart-apply-patch.sh - is modified. (Kengo Seki via aajisaka) - - HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files - and is created by 'git diff --no-prefix'. (Kengo Seki via aajisaka) - - HADOOP-12019. update BUILDING.txt to include python for 'mvn site' - in windows (vinayakumarb) - - HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. - (Kengo Seki via Arpit Agarwal) - - HADOOP-11924. Tolerate JDK-8047340-related exceptions in - Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) - - HADOOP-12052 IPC client downgrades all exception types to IOE, breaks - callers trying to use them. (Brahma Reddy Battula via stevel) - - HADOOP-12054. RPC client should not retry for InvalidToken exceptions. - (Varun Saxena via Arpit Agarwal) - - HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on - EOF. (Ivan Mitic via cnauroth) - - HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream - with accurate .getPos() (kanaka kumar avvaru via vinayakumarb) - - HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as - InterruptedIOException (Lavkesh Lahngir via vinayakumarb) - - HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and - GID attributes during the search. (Patrick White via vinodkv) - - HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. - (Brahma Reddy Battula via aajisaka) - - HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. - (Larry McCay via cnauroth) - - HADOOP-12119. hadoop fs -expunge does not work for federated namespace - (J.Andreina via vinayakumarb) - - HADOOP-12089. StorageException complaining " no lease ID" when updating - FolderLastModifiedTime in WASB. (Duo Xu via cnauroth) - - HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' - (J.Andreina via vinayakumarb) - - HADOOP-10798. globStatus() should always return a sorted list of files - (cmccabe) - - HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil - and fix for HA namespaces (rchiang via rkanter) - - HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for - cygwin in branch-2. (Li Lu via cnauroth) - - HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command - name using reflection. (Lei (Eddy) Xu) - - HADOOP-12173. NetworkTopology::add calls toString always. - (Inigo Goiri via cdouglas) - - HADOOP-12185. NetworkTopology is not efficient adding/getting/removing - nodes. (Inigo Goiri via cdouglas) - - HADOOP-12117. Potential NPE from Configuration#loadProperty with - allowNullValueProperties set. (zhihai xu via vinayakumarb) - - HADOOP-12200. TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be - skipped in non-native profile. (Masatake Iwasaki via aajisaka) - - HADOOP-10615. FileInputStream in JenkinsHash#main() is never closed. - (Chen He via ozawa) - - HADOOP-12240. Fix tests requiring native library to be skipped in non-native - profile. (Masatake Iwasaki via ozawa) - - HADOOP-12235 hadoop-openstack junit & mockito dependencies should be - "provided". (Ted Yu via stevel) - - HADOOP-12209 Comparable type should be in FileStatus. - (Yong Zhang via stevel) - - HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). - (Brahma Reddy Battula via stevel) - - HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) - - HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal - tags. (Akira AJISAKA via stevel). - - HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a - retry interval. (Sunil G via wangda) - - HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the - required context item is not configured - (Brahma Reddy Battula via harsh) - - HADOOP-12252. LocalDirAllocator should not throw NPE with empty string - configuration. (Zhihai Xu) - - HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. - (Lei (Eddy) Xu via cnauroth) - - HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired - thread states before shutting down. (Xiao Chen via mingma) - - HADOOP-12447. Clean up some htrace integration issues (cmccabe) - - HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test - directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) - - HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). - (Rahul Palamuttam and Kanaka Kumar Avvaru via aajisaka) - - HADOOP-8437. getLocalPathForWrite should throw IOException for invalid - paths. (Brahma Reddy Battula via zxu) - - HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 - and 8. (ozawa) - - HADOOP-12284. UserGroupInformation doAs can throw misleading exception - (Aaron Dosset via stevel) - - HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) - - HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running - on java7. (stevel and ozawa) - - HADOOP-12478. Shell.getWinUtilsPath() has been renamed - Shell.getWinutilsPath(). (stevel) - - HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching - Connection in ipc Client (Walter Su via sjlee) - - HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation - failure. (cnauroth) - - HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. - (Daryn Sharp via stevel). - - HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable. - (Benoy Antony via stevel). - - HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. - (Daryn Sharp via yliu) - - HADOOP-12513. Dockerfile lacks initial 'apt-get update'. - (Akihiro Suda via ozawa) - - HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. - (Akira AJISAKA via ozawa) - - HADOOP-12178. NPE during handling of SASL setup if problem with SASL - resolver class. (Steve Loughran via zxu) - - HADOOP-12519. hadoop-azure tests should avoid creating a metrics - configuration file in the module root directory. (cnauroth) - - HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. - (Dushyanth via cnauroth) - - HADOOP-12508. delete fails with exception when lease is held on blob. - (Gaurav Kanade via cnauroth) - - HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. (cnauroth) - - HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics - fails intermittently due to assumption that a lease error will be thrown. - (Gaurav Kanade via cnauroth) - - HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by - HADOOP-12344 (Mingliang Liu via Colin P. McCabe) - - HADOOP-12567: NPE in SaslRpcServer (Sergey Shelukhin via cnauroth) - - HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) - - HADOOP-11149. TestZKFailoverController times out. (Steve Loughran - via ozawa) - - HADOOP-9822. Create constant MAX_CAPACITY in RetryCache rather than - hard-coding 16 in RetryCache constructor. (Tsuyoshi Ozawa via wheat9) - - HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux - (Alan Burlison via aw) - - HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. - (Xin Wang via aajisaka) - - HADOOP-12468. Partial group resolution failure should not result in user - lockout. (Wei-Chiu Chuang via Yongjun Zhang) - - HADOOP-12656. MiniKdc throws "address in use" BindException. - (Wei-Chiu Chuang via Arpit Agarwal) - - HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() - over getMessage() in logging/span events. (Varun Saxena via stevel) - - HADOOP-12017. Hadoop archives command should use configurable replication - factor when closing (Bibin A Chundatt via vinayakumarb) - - HADOOP-12239. StorageException complaining " no lease ID" when updating - FolderLastModifiedTime in WASB. (Duo Xu via cnauroth) - - HADOOP-12245. References to misspelled REMAINING_QUATA in - FileSystemShell.md. (Gabor Liptak via aajisaka) - - HADOOP-12175. FsShell must load SpanReceierHost to support tracing - (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-10945. 4-digit octal umask permissions throws a parse error (Chang - Li via jlowe) - - HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for - each platform, not hardcoded to their Linux values (Martin Walsh via Colin - P. McCabe) - - HADOOP-12268. AbstractContractAppendTest#testRenameFileBeingAppended - misses rename operation. (Zhihai Xu) - - HADOOP-12274. Remove direct download link from BULIDING.txt. - (Caleb Severn via aajisaka) - - HADOOP-12302. Fix native compilation on Windows after HADOOP-7824 - (Vinayakumar B via Colin P. McCabe) - - HADOOP-12258. Need translate java.nio.file.NoSuchFileException to - FileNotFoundException to avoid regression. (Zhihai Xu via cnauroth) - - HADOOP-12322. typos in rpcmetrics.java. (Anu Engineer via - Arpit Agarwal) - - HADOOP-12317. Applications fail on NM restart on some linux distro - because NM container recovery declares AM container as LOST - (adhoot via rkanter) - - HADOOP-12347. Fix mismatch parameter name in javadocs of - AuthToken#setMaxInactives (xyao) - - HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. - (Charlie Helin via wang) - - HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter - error message. (Wei Yan via ozawa) - - HADOOP-12388. Fix components' version information in the web page - 'About the Cluster'. (Jun Gong via zxu) - - HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) - - HADOOP-12417. TestWebDelegationToken failing with port in use. - (Mingliang Liu via wheat9) - - HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in - TestLocalFileSystem. (Chris Nauroth via wheat9) - - HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. - (Arpit Agarwal) - - HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid - (nijel via vinayakumarb) - - HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some - Linux distributions after HADOOP-12317. (Wangda Tan via vinodkv) - - HADOOP-12474. MiniKMS should use random ports for Jetty server by default. - (Mingliang Liu via wheat9) - - HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. - (kihwal) - - HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass - Azure Storage Throttling after retries. (Gaurav Kanade via cnauroth) - - HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race - Condition Scenarios. (Gaurav Kanade via cnauroth) - - HADOOP-11901. BytesWritable fails to support 2G chunks due to integer - overflow. (Reynold Xin via wheat9) - - HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. - (Vijay Singh via wheat9) - - HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop - scripts. (Radhey Shah via wheat9) - - HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. - (Masatake Iwasaki via wheat9) - - HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. - (Varun Saxena via wheat9) - - HADOOP-10068. Improve log4j regex in testFindContainingJar. - (Robert Rati via wheat9) - - HADOOP-11677. Add cookie flags for logs and static contexts. - (nijel via wheat9) - - HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). - (Gabor Liptak via wheat9) - - HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. - (Masatake Iwasaki via Arpit Agarwal) - - HADOOP-10729. Add tests for PB RPC in case version mismatch of client and - server. (Junping Du via wheat9) - - HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. - (Inigo Goiri via cdouglas) - - HADOOP-12681. start-build-env.sh fails in branch-2. - (Kengo Seki via aajisaka) - - HADOOP-12559. KMS connection failures should trigger TGT renewal. - (Zhe Zhang via xyao) - - HADOOP-12682. Fix TestKMS#testKMSRestart* failure. - (Wei-Chiu Chuang via xyao) - - HADOOP-12689. S3 filesystem operations stopped working correctly - (Matt Paduano via raviprak) - - HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to - address case of potential data loss due to partial copy - (Gaurav Kanade via cnauroth) - - HADOOP-12675. Fix description about retention period in usage of expunge - command. (Masatake Iwasaki via stevel) - - HADOOP-12678. Handle empty rename pending metadata file during atomic rename - in redo path. (Madhumita Chakraborty via cnauroth) - - HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API - (Dushyanth via cnauroth) - - HADOOP-12584. Disable browsing the static directory in HttpServer2. - (Robert Kanter via aajisaka) - - HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir - occasionally fail. (Wei-Chiu Chuang via cnauroth) - - HADOOP-12590. TestCompressorDecompressor failing without stack traces - (John Zhuge via stevel) - - HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. - (John Zhuge via aajisaka) - - HADOOP-12356. Fix computing CPU usage statistics on Windows. - (Inigo Goiri via wangda) - - HADOOP-12423. Handle failure of registering shutdownhook by - ShutdownHookManager in static block (Abhishek Agarwal via vinayakumarb) - - HADOOP-7161. Remove unnecessary oro package from dependency management - section. (Sean Busbey via aajisaka) - - HADOOP-12659. Incorrect usage of config parameters in token manager of - KMS. (Mingliang Liu via xyao) - - HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly - documented as required. (Kengo Seki via aajisaka) - - HADOOP-12731. Remove useless boxing/unboxing code. - (Kousuke Saruta via aajisaka) - - HADOOP-12718. Incorrect error message by fs -put local dir without - permission. (John Zhuge via Yongjun Zhang) - - HADOOP-12735. core-default.xml misspells - hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe) - - HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. - (Xiaobing Zhou via xyao) - - HADOOP-12766. The default value of - "hadoop.workaround.non.threadsafe.getpwuid" is different between - core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe) - - HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. - (cnauroth) - - HADOOP-12780. During atomic rename handle crash when one directory has been - renamed but not file under it. (Madhumita Chakraborty via cnauroth) - - HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. (xyao) - - HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to - determine isKeyTab in JDK8. (Xiaoyu Yao via cnauroth) - - HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. - (Mingliang Liu via cnauroth) - - HADOOP-12846. Credential Provider Recursive Dependencies. - (Larry McCay via cnauroth) - - HADOOP-12813. Migrate TestRPC and related codes to rebase on - ProtobufRpcEngine. (Kai Zheng via wheat9) - - HADOOP-12851. S3AFileSystem Uptake of - ProviderUtils.excludeIncompatibleCredentialProviders. - (Larry McCay via cnauroth) - - HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) - -Release 2.7.3 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12413. AccessControlList should avoid calling getGroupNames in - isUserInList with empty groups. (Zhihai Xu via cnauroth) - - HADOOP-12794. Support additional compression levels for GzipCodec. - (Ravi Mutyala via junping_du) - - OPTIMIZATIONS - - HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls - (Ryan Blue via vinayakumarb) - - BUG FIXES - - HADOOP-12296. when setnetgrent returns 0 in linux, exception should be - thrown (Chang Li via jlowe) - - HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, - ImpersonationProvider, DefaultImpersonationProvider, and DistCp. - (Arshad Mohammad via aajisaka) - - HADOOP-12374. Updated expunge command description. - (WeiWei Yang via eyang) - - HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong - time unit parameter. (zxu via rkanter) - - HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) - - HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. - (Mingliang Liu via aajisaka) - - HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. - (Masatake Iwasaki via aajisaka) - - HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. - (Masatake Iwasaki via aajisaka) - - HADOOP-12107. long running apps may have a huge number of StatisticsData - instances under FileSystem (Sangjin Lee via Ming Ma) - - HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp - times out occasionally (Sangjin Lee and Colin Patrick McCabe via jlowe) - - HADOOP-12761. incremental maven build is not really incremental (sjlee) - - HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop - infinitely for invalid 'loc' values (Kuhu Shukla via kihwal) - - HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in - chroot (Eric Badger via jlowe) - - HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum - and TFileDumper. (Brandon Li via suresh) - - HADOOP-9121. InodeTree.java has redundant check for vName while - throwing exception. (Arup Malakar via suresh) - - HADOOP-12870. Fix typo admininistration in CommandsManual.md. - (John Zhuge via aajisaka) - - HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. - (Brahma Reddy Battula via aajisaka) - - HADOOP-12872. Fix formatting in ServiceLevelAuth.md. - (Brahma Reddy Battula via aajisaka) - -Release 2.7.2 - 2016-01-25 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12232. Upgrade Tomcat dependency to 6.0.44. (cnauroth) - - HADOOP-5323. Trash documentation should describe its directory structure and - configurations. (Weiwei Yang via ozawa) - - OPTIMIZATIONS - - BUG FIXES - - HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync - multiple times (zhihai xu via vinayakumarb) - - HADOOP-12191. Bzip2Factory is not thread safe. (Brahma Reddy Battula - via ozawa) - - HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. - (kanaka kumar avvaru via wheat9) - - HADOOP-12304. Applications using FileContext fail with the default file - system configured to be wasb/s3/etc. (cnauroth) - - HADOOP-12061. Incorrect command in single cluster setup document. - (Kengo Seki via aajisaka) - - HADOOP-12359. hadoop fs -getmerge doc is wrong. - (Jagadesh Kiran N via aajisaka) - - HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be - closed in finally block. (Kiran Kumar M R and Sanghyun Yun via ozawa) - - HADOOP-12213. Interrupted exception can occur when Client#stop is called. - (Kuhu Shukla via ozawa) - - HADOOP-12465. Incorrect javadoc in WritableUtils.java. - (Jagadesh Kiran N via aajisaka) - - HADOOP-12464. Interrupted client may try to fail-over and retry (kihwal) - - HADOOP-12415. Fixed pom files to correctly include compile-time dependency on - netty. (Tom Zeng via cos) - - HADOOP-12786. "hadoop key" command usage is not documented. - (Xiao Chen via aajisaka) - -Release 2.7.1 - 2015-07-06 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to - allow code sharing. (Yongjun Zhang) - - OPTIMIZATIONS - - BUG FIXES - - HADOOP-11868. Invalid user logins trigger large backtraces in server log - (Chang Li via jlowe) - - HADOOP-11872. "hadoop dfs" command prints message about using "yarn jar" on - Windows(branch-2 only) (Varun Vasudev via cnauroth) - - HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) - - HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when - native code is not loaded. (Zhijie Shen via ozawa) - - HADOOP-11663. Remove description about Java 6 from docs. - (Masatake Iwasaki via aajisaka) - - HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed - through hadoop-daemon.sh. (cnauroth) - - HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get - created with ACLs. (Gregory Chanan via asuresh) - - HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. - (Kazuho Fujii via aajisaka) - - HADOOP-12078. The default retry policy does not handle RetriableException - correctly. (Arpit Agarwal) - - HADOOP-12100. ImmutableFsPermission should not override applyUmask since - that method doesn't modify the FsPermission (Bibin A Chundatt via Colin P. - McCabe) - -Release 2.7.0 - 2015-04-20 - - INCOMPATIBLE CHANGES - - HADOOP-10530 Make hadoop build on Java7+ only (stevel) - - NEW FEATURES - - HADOOP-10987. Provide an iterator-based listing API for FileSystem (kihwal) - - HADOOP-7984. Add hadoop --loglevel option to change log level. - (Akira AJISAKA via cnauroth) - - HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. - (Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, - Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, - Alexander Stojanovic, Brian Swan, and Min Wei via cnauroth) - - HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. - (Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, - Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, - Alexander Stojanovich, Brian Swan, and Min Wei via cnauroth) - - HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) - - HADOOP-11490. Expose truncate API via FileSystem and shell command. - (Milan Desai via shv) - - HADOOP-11045. Introducing a tool to detect flaky tests of hadoop jenkins testing - job. (Yongjun Zhang and Todd Lipcon via ozawa) - - HADOOP-11510. Expose truncate API via FileContext. (yliu) - - HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles - to one MapFile. (Vinayakumar B via ozawa) - - IMPROVEMENTS - - HADOOP-11483. HardLink.java should use the jdk7 createLink method (aajisaka) - - HADOOP-11156. DelegateToFileSystem should implement - getFsStatus(final Path f). (Zhihai Xu via wang) - - HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. - (Yongjun Zhang via wang) - - HADOOP-10748. HttpServer2 should not load JspServlet. (wheat9) - - HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. - (Pascal Oliva via wheat9) - - HADOOP-10563. Remove the dependency of jsp in trunk. (wheat9) - - HADOOP-11291. Log the cause of SASL connection failures. - (Stephen Chu via cnauroth) - - HADOOP-11173. Improve error messages for some KeyShell commands. (wang) - - HADOOP-11257: Update "hadoop jar" documentation to warn against using it - for launching yarn jars (iwasakims via cmccabe) - - HADOOP-11341. KMS support for whitelist key ACLs. (Arun Suresh via wang) - - HADOOP-11301. [optionally] update jmx cache to drop old metrics - (Maysam Yabandeh via stack) - - HADOOP-11313. Adding a document about NativeLibraryChecker. - (Tsuyoshi OZAWA via cnauroth) - - HADOOP-11287. Simplify UGI#reloginFromKeytab for Java 7+. - (Li Lu via wheat9) - - HADOOP-10476) Bumping the findbugs version to 3.0.0. (wheat9) - - HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe) - - HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) - - HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File - System. (Shanyu Zhao via cnauroth) - - HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics - collection. (Shanyu Zhao via cnauroth) - - HADOOP-11421. Add IOUtils#listDirectory (cmccabe) - - HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get - (cmccabe) - - HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel - (cmccabe) - - HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream - (Yi Liu via Colin P. McCabe) - - HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. - (Wei Yan via kasha) - - HADOOP-11395. Add site documentation for Azure Storage FileSystem - integration. (Chris Nauroth via Arpit Agarwal) - - HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. - (wheat9) - - HADOOP-11399. Java Configuration file and .xml files should be - automatically cross-compared (rchiang via rkanter) - - HADOOP-11455. KMS and Credential CLI should request confirmation for - deletion by default. (Charles Lamb via yliu) - - HADOOP-11390 Metrics 2 ganglia provider to include hostname in - unresolved address problems. (Varun Saxena via stevel) - - HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch - (ozawa) - - HADOOP-11464. Reinstate support for launching Hadoop processes on Windows - using Cygwin. (cnauroth) - - HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job - (Akshay Radia via brandonli) - - HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Varun Saxena via - Arpit Agarwal) - - HADOOP-11481. ClassCastException while using a key created by keytool to - create encryption zone. (Charles Lamb via Colin P. Mccabe) - - HADOOP-8757. Metrics should disallow names with invalid characters - (rchiang via rkanter) - - HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) - - HADOOP-11171 Enable using a proxy server to connect to S3a. - (Thomas Demoor via stevel) - - HADOOP-11489 Dropping dependency on io.netty from hadoop-nfs' pom.xml - (Ted Yu via ozawa) - - HADOOP-11419 Improve hadoop-maven-plugins. (Herve Boutemy via stevel) - - HADOOP-11450. Cleanup DistCpV1 not to use deprecated methods and fix - javadocs. (Varun Saxena via ozawa) - - HADOOP-4297. Enable Java assertions when running tests. - (Tsz Wo Nicholas Sze via wheat9) - - HADOOP-10626. Limit Returning Attributes for LDAP search. (Jason Hubbard - via atm) - - HADOOP-11317. Increment SLF4J version to 1.7.10. (Tim Robertson via ozawa) - - HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties - (aajisaka) - - HADOOP-10574. Bump the maven plugin versions too -moving the numbers into - properties. (aajisaka) - - HADOOP-11441. Hadoop-azure: Change few methods scope to public. - (Shashank Khandelwal via cnauroth) - - HADOOP-9137. Support connection limiting in IPC server (kihwal) - - HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake - Iwasaki via Colin P. McCabe) - - HADOOP-11442. hadoop-azure: Create test jar. - (Shashank Khandelwal via cnauroth) - - HADOOP-11544. Remove unused configuration keys for tracing. (Masatake - Iwasaki via aajisaka) - - HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and - Karthik Kambatla via kasha) - - HADOOP-11463 Replace method-local TransferManager object with - S3AFileSystem#transfers. (Ted Yu via stevel) - - HADOOP-11520. Clean incomplete multi-part uploads in S3A tests. - (Thomas Demoor via stevel) - - HADOOP-11579. Documentation for truncate. (shv) - - HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in - hadoop_config.cmd. (Kiran Kumar M R via cnauroth) - - HADOOP-11543. Improve help message for hadoop/yarn command. (Brahma - Reddy Battula via ozawa). - - HADOOP-11586. Update use of Iterator to Iterable in - AbstractMetricsContext.java. (Ray Chiang via aajisaka) - - HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use - getTrimmed(). (Tsuyoshi Ozawa via aajisaka) - - HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. - (Rakesh R via ozawa) - - HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa) - - HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel) - - HADOOP-11521. Make connection timeout configurable in s3a. - (Thomas Demoor via stevel) - - HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing - in ClientBaseWithFixes. (Kengo Seki via aajisaka) - - HADOOP-11607. Reduce log spew in S3AFileSystem. (Lei (Eddy) Xu via stevel) - - HADOOP-11495. Convert site documentation from apt to markdown - (Masatake Iwasaki via aw) - - HADOOP-11632. Cleanup Find.java to remove SupressWarnings annotations. - (Akira Ajisaka via ozawa) - - HADOOP-10976. moving the source code of hadoop-tools docs to the - directory under hadoop-tools (Masatake Iwasaki via aw) - - HADOOP-11658. Externalize io.compression.codecs property. - (Kai Zheng via aajisaka) - - HADOOP-11648. Set DomainSocketWatcher thread name explicitly. - (Liang Xie via ozawa) - - HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. - (Shashank Khandelwal and Ivan Mitic via cnauroth) - - HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe) - - HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. - (Brandon Li via suresh) - - HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat - via Colin P. McCabe) - - HADOOP-10670. Allow AuthenticationFilters to load secret from signature - secret files. (Kai Zheng via wheat9) - - HADOOP-11801. Update BUILDING.txt for Ubuntu. (Gabor Liptak via - Arpit Agarwal) - - HADOOP-9737. JarFinder#getJar should delete the jar file upon destruction - of the JVM (jbonofre via rkanter) - - OPTIMIZATIONS - - HADOOP-11323. WritableComparator#compare keeps reference to byte array. - (Wilfred Spiegelenburg via wang) - - HADOOP-10809. hadoop-azure: page blob support. (Dexter Bradshaw, - Mostafa Elhemali, Eric Hanson, and Mike Liddell via cnauroth) - - HADOOP-11188. hadoop-azure: automatically expand page blobs when they become - full. (Eric Hanson via cnauroth) - - HADOOP-11620. Add support for load balancing across a group of KMS for HA. - (Arun Suresh via wang) - - HADOOP-11183. Memory-based S3AOutputstream. (Thomas Demoor via stevel) - - BUG FIXES - - HADOOP-11512. Use getTrimmedStrings when reading serialization keys - (Ryan P via harsh) - - HADOOP-11488. Difference in default connection timeout for S3A FS - (Daisuke Kobayashi via harsh) - - HADOOP-11256. Some site docs have inconsistent appearance (Masatake - Iwasaki via aw) - - HADOOP-11318. Update the document for hadoop fs -stat (aajisaka) - - HADOOP 11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' - (Kamil Gorlo via raviprak) - - HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java (Abhiraj Butala via harsh) - - HADOOP-11166. Remove ulimit from test-patch.sh. (wang) - - HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in - SpanReceiverHost (cmccabe) - - HADOOP-11186. documentation should talk about - hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes (cmccabe) - - HADOOP-11165. TestUTF8 fails when run against java 8. - (Stephen Chu via cnauroth) - - HADOOP-10717. HttpServer2 should load jsp DTD from local jars instead of - going remote. (Dapeng Sun via wheat9) - - HADOOP-11268. Update BUILDING.txt to remove the workaround for tools.jar. - (Li Lu via wheat9) - - HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR - and YARN. (Robert Kanter via wheat9) - - HADOOP-11269. Add java 8 profile for hadoop-annotations. (Li Lu via wheat9) - - HADOOP-11271. Use Time.monotonicNow() in Shell.java instead of Time.now() - (vinayakumarb) - - HADOOP-11266. Remove no longer supported activation properties for packaging - from pom. (Masatake Iwasaki via wheat9) - - HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty - principal names. (Stephen Chu via wheat9) - - HADOOP-10714. AmazonS3Client.deleteObjects() need to be limited to 1000 - entries per call. (Juan Yu via atm) - - HADOOP-11272. Allow ZKSignerSecretProvider and - ZKDelegationTokenSecretManager to use the same curator client. (Arun Suresh via atm) - - HADOOP-11187 NameNode - KMS communication fails after a long period of - inactivity. (Arun Suresh via atm) - - HADOOP-11289. Fix typo in RpcUtil log message. (Charles Lamb via wheat9) - - HADOOP-11294. Nfs3FileAttributes should not change the values of rdev, - nlink and size in the constructor. (Brandon Li via wheat9) - - HADOOP-11157. ZKDelegationTokenSecretManager never shuts down - listenerThreadPool. (Arun Suresh via atm) - - HADOOP-11311. Restrict uppercase key names from being created with JCEKS. - (wang) - - HADOOP-11309. System class pattern package.Foo should match - package.Foo$Bar, too (Gera Shegalov via jlowe) - - HADOOP-11312. Fix unit tests to not use uppercase key names. (wang) - - HADOOP-11201. Hadoop Archives should support globs resolving to files. - (Gera Shegalov via cnauroth) - - HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT - even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) - - HADOOP-11300. KMS startup scripts must not display the keystore / - truststore passwords. (Arun Suresh via wang) - - HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done - atomically. (Dian Fu via wang) - - HADOOP-11344. KMS kms-config.sh sets a default value for the keystore - password even in non-ssl setup. (Arun Suresh via wang) - - HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL - and whitelist key ACL. (Dian Fu via wang) - - HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if - kerberos TGT is available in the subject. (Dian Fu via atm) - - HADOOP-11348. Remove unused variable from CMake error message for finding - openssl (Dian Fu via Colin P. McCabe) - - HADOOP-11355. When accessing data in HDFS and the key has been deleted, - a Null Pointer Exception is shown. (Arun Suresh via wang) - - HADOOP-11354. ThrottledInputStream doesn't perform effective throttling. - (Ted Yu via jing9) - - HADOOP-11329. Add JAVA_LIBRARY_PATH to KMS startup options. (Arun Suresh via wang) - - HADOOP-11363 Hadoop maven surefire-plugin uses must set heap size. (stevel) - - HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc - comments. (apurtell via stevel) - - HADOOP-11367. Fix warnings from findbugs 3.0 in hadoop-streaming. (Li Lu via wheat9) - - HADOOP-11369. Fix new findbugs warnings in hadoop-mapreduce-client, - non-core directories. (Li Lu via wheat9) - - HADOOP-11372. Fix new findbugs warnings in mapreduce-examples. - (Li Lu via wheat9) - - HADOOP-11273. TestMiniKdc failure: login options not compatible with IBM - JDK. (Gao Zhong Liang via wheat9) - - HADOOP-11379. Fix new findbugs warnings in hadoop-auth*. (Li Lu via wheat9) - - HADOOP-11378. Fix new findbugs warnings in hadoop-kms. (Li Lu via wheat9) - - HADOOP-11349. RawLocalFileSystem leaks file descriptor while creating a - file if creat succeeds but chmod fails. (Varun Saxena via Colin P. McCabe) - - HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, - hadoop-azure, and hadoop-openstack. (Li Lu via wheat9) - - HADOOP-10482. Fix various findbugs warnings in hadoop-common. (wheat9) - - HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. - (Li Lu via wheat9) - - HADOOP-11386. Replace \n by %n in format hadoop-common format strings. - (Li Lu via wheat9) - - HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be - be order-independent. (Yitong Zhou via gera) - - HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. - (wheat9) - - HADOOP-11394. hadoop-aws documentation missing. (cnauroth) - - HADOOP-11396. Provide navigation in the site documentation linking to the - Hadoop Compatible File Systems. (cnauroth) - - HADOOP-11412 POMs mention "The Apache Software License" rather than - "Apache License". (Herve Boutemy via stevel) - - HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user - has Full Control permissions. (cnauroth) - - HADOOP-11420. Use latest maven-site-plugin and replace link to svn with - link to git. (Herve Boutemy via wheat9) - - HADOOP-10689. InputStream is not closed in - AzureNativeFileSystemStore#retrieve(). (Chen He via cnauroth) - - HADOOP-10690. Lack of synchronization on access to InputStream in - NativeAzureFileSystem#NativeAzureFsInputStream#close(). - (Chen He via cnauroth) - - HADOOP-11358. Tests for encryption/decryption with IV calculation - overflow. (yliu) - - HADOOP-11125. Remove redundant tests in TestOsSecureRandom. - (Masanori Oyama via wheat9) - - HADOOP-11385. Prevent cross site scripting attack on JMXJSONSe
<TRUNCATED>
