Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The "Release-2.6.1-Working-Notes" page has been changed by AkiraAjisaka: https://wiki.apache.org/hadoop/Release-2.6.1-Working-Notes?action=diff&rev1=14&rev2=15 Comment: Reflected Sangjin's updates. Ordered list of commits to cherrypick ||SHA1||JIRA || Status || New patch on JIRA || Applies cleanly || + ||5f3d967aaefa0b20ef1586b4048b8fa5345d2618 ||HDFS-7278. Add a command that allows sysadmins to manually trigger full block reports from || || || ADDED!!! minor issues || - ||946463efefec9031cacb21d5a5367acd150ef904 ||HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payn || || + ||946463efefec9031cacb21d5a5367acd150ef904 ||HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payn || || || yes || - ||842a54a5f66e76eb79321b66cc3b8820fe66c5cd ||HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlo || || + ||842a54a5f66e76eb79321b66cc3b8820fe66c5cd ||HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlo || || || yes || - ||8bfef590295372a48bd447b1462048008810ee17 ||HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Lu || || + ||8bfef590295372a48bd447b1462048008810ee17 ||HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Lu || || || yes || - ||ec2621e907742aad0264c5f533783f0f18565880 ||HDFS-7035. Make adding a new data directory to the DataNode an atomic operation and improv || || + ||ec2621e907742aad0264c5f533783f0f18565880 ||HDFS-7035. Make adding a new data directory to the DataNode an atomic operation and improv || || || minor issues || ||9e63cb4492896ffb78c84e27f263a61ca12148c8 ||HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. ||Applied locally || ||Yes || ||beb184ac580b0d89351a3f3a7201da34a26db1c1 ||YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recover ||Applied locally || ||Yes || ||ad140d1fc831735fb9335e27b38d2fc040847af1 ||YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu ( ||Applied locally || ||Yes || ||242fd0e39ad1c5d51719cd0f6c197166066e3288 ||YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been cre ||Applied locally || ||Yes || - ||2e15754a92c6589308ccbbb646166353cc2f2456 ||HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. || + ||2e15754a92c6589308ccbbb646166353cc2f2456 ||HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. || || yes || ||db31ef7e7f55436bbf88c6d93e2273c4463ca9f0 ||YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Activ ||Applied locally || ||Yes || - ||8d8eb8dcec94e92d94eedef883cdece8ba333087 ||HDFS-7425. NameNode block deletion logging uses incorrect appender. Contributed by Chris N || || + ||8d8eb8dcec94e92d94eedef883cdece8ba333087 ||HDFS-7425. NameNode block deletion logging uses incorrect appender. Contributed by Chris N || || || remove; already committed || - ||946df98dce18975e37a6a14744ca7a5429f019ce ||HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi P || || + ||946df98dce18975e37a6a14744ca7a5429f019ce ||HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi P || || || remove; already committed || ||ae35b0e14d3438237f4b5d3b5d5268d45e549846 ||YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed b ||Applied locally || ||Yes || ||f6d1bf5ed1cf647d82e676df15587de42b1faa42 ||HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhao ||Applied locally || ||Yes || ||38ea1419f60d2b8176dba4931748f1f0e52ca84e ||YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corr ||Applied locally || ||Yes || ||d21ef79707a0f32939d9a5af4fed2d9f5fe6f2ec ||YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Co ||Applied locally || ||Yes || - ||06552a15d5172a2b0ad3d61aa7f9a849857385aa ||HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to ( || || + ||06552a15d5172a2b0ad3d61aa7f9a849857385aa ||HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to ( || || || minor issues || ||d6f3d4893d750f19dd8c539fe28eecfab2a54576 ||YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by R ||Applied locally || || No, minor import issues || ||25be97808b99148412c0efd4d87fc750db4d6607 ||YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps ||Applied locally || ||Yes || ||dabdd2d746d1e1194c124c5c7fe73fcc025e78d2 ||HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contri ||Applied locally || ||Yes || ||deaa172e7a2ab09656cc9eb431a3e68a73e0bd96 ||HADOOP-11368. Fix SSLFactory truststore reloader thread leak in KMSClientProvider. Contrib ||Applied locally || ||Yes || - ||a037d6030b5ae9422fdb265f5e4880d515be9e37 ||HDFS-7489. Incorrect locking in FsVolumeList#checkDirs can hang datanodes (Noah Lorang via || || + ||a037d6030b5ae9422fdb265f5e4880d515be9e37 ||HDFS-7489. Incorrect locking in FsVolumeList#checkDirs can hang datanodes (Noah Lorang via || || || remove; already committed || ||1986ea8dd223267ced3e3aef69980b46e2fef740 ||YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg v ||Applied locally || ||Yes || - ||e4f9ddfdbcdab1eacf568e8689448ffc10bbc2aa ||HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agar || || + ||e4f9ddfdbcdab1eacf568e8689448ffc10bbc2aa ||HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agar || || || remove; already committed || ||41f0d20fcb4fec5b932b8947a44f93345205222c ||YARN-2917. Fixed potential deadlock when system.exit is called in AsyncDispatcher. Contrib ||Applied locally || ||Yes || ||b521d91c0f5b6d114630b6727f6a01db56dba4f1 ||HADOOP-11238. Update the NameNode's Group Cache in the background when possible (Chris Li ||Applied locally || ||Yes || ||7c7bccfc31ede6f4afc043d81c8204046148c02e ||MAPREDUCE-6166. Reducers do not validate checksum of map outputs when fetching directly to ||Applied locally || ||Yes || ||2d832ad2eb87e0ce7c50899c54d05f612666518a ||YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read ||Applied locally || ||Yes || - ||dda1fc169db2e69964cca746be4ff8965eb8b56f ||HDFS-7531. Improve the concurrent access on FsVolumeList (Lei Xu via Colin P. McCabe) (che || || + ||dda1fc169db2e69964cca746be4ff8965eb8b56f ||HDFS-7531. Improve the concurrent access on FsVolumeList (Lei Xu via Colin P. McCabe) (che || || || minor issues || ||173664d70f0ed3b1852b6703d32e796778fb1c78 ||YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by ||Applied locally || ||Yes || - ||bcaf15e2fa94db929b8cd11ed7c07085161bf950 ||HDFS-7443. Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are pre || || + ||bcaf15e2fa94db929b8cd11ed7c07085161bf950 ||HDFS-7443. Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are pre || || || remove; already committed || ||9180d11b3bbb2a49127d5d25f53b38c5113bf7ea ||YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks (ch ||Applied locally || ||No, minor merge conflict || ||8b398a66ca3728f47363fc8b2fcf7e556e6bbf5a ||YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharma ||Applied locally || ||Yes || ||ca0349b87ab1b2d0d2b9dc93de7806d26713165c ||YARN-2992. ZKRMStateStore crashes due to session expiry. Contributed by Karthik Kambatla ( ||Applied locally || ||Yes || ||c116743bdda2b1792bf872020a5e2b14d772ac60 ||YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed b ||Applied locally || ||Yes || ||e7e6173049adca2a2ae0e1231adcaca8168bec27 ||YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on ||Applied locally || ||Yes || - ||f0acb7c2a284db61640efee15a1648c6c26d24f5 ||HDFS-7579. Improve log reporting during block report rpc failure. Contributed by Charles L || || + ||f0acb7c2a284db61640efee15a1648c6c26d24f5 ||HDFS-7579. Improve log reporting during block report rpc failure. Contributed by Charles L || || || yes || - ||4b589e7cfa27bd042e228bbbcf1c3b75b2aeaa57 ||HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma. || || + ||4b589e7cfa27bd042e228bbbcf1c3b75b2aeaa57 ||HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma. || || || minor issues || - ||75e4e55e12b2faa521af7c23fddcba06a9ce661d ||HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarw || || + ||75e4e55e12b2faa521af7c23fddcba06a9ce661d ||HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarw || || || yes || - ||33534a0c9aef5024aa6f340e7ee24930c8fa8ed5 ||HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Con || || + ||33534a0c9aef5024aa6f340e7ee24930c8fa8ed5 ||HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Con || || || yes || ||2e4df8710435c8362506fe944a935e74ad5919c0 ||HADOOP-11350. The size of header buffer of HttpServer is too small when HTTPS is enabled. ||Applied locally || ||Yes || + ||7779f38e68ca4e0f7ac08eb7e5f4801b89979d02 ||HDFS-7610. Fix removal of dynamically added DN volumes (Lei (Eddy) Xu via Colin P. McCabe) || || || ADDED!! minor issues || - ||1d9d166c0beb56aa45e65f779044905acff25d88 ||HDFS-7575. Upgrade should generate a unique storage ID for each volume. (Contributed by Ar || || + ||1d9d166c0beb56aa45e65f779044905acff25d88 ||HDFS-7575. Upgrade should generate a unique storage ID for each volume. (Contributed by Ar || || || yes || ||7b69719455a1a374c9417417ef0c8d7ba6bf593f ||HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy user. Contribute ||Applied locally || ||Yes || - ||24f0d56afb853a371f905c4569d82d09d89cf13e ||HDFS-7676. Fix TestFileTruncate to avoid bug of HDFS-7611. Contributed by Konstantin Shvac || || + ||24f0d56afb853a371f905c4569d82d09d89cf13e ||HDFS-7676. Fix TestFileTruncate to avoid bug of HDFS-7611. Contributed by Konstantin Shvac || || || remove; does not apply to 2.6 || ||8100c8a68c32978a177af9a3e6639f6de533886d ||YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM ||Applied locally || ||No, merge conflict in ResourceLocalizationService || ||12522fd9cbd8da8c040a5b7bb71fcdaa256daf89 ||YARN-3103. AMRMClientImpl does not update AMRM token properly. Contributed by Jason Lowe ( ||Applied locally || ||Yes || - ||e8300957a75353849219d616cfac08b08c182db2 ||HDFS-7611. deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap || || + ||e8300957a75353849219d616cfac08b08c182db2 ||HDFS-7611. deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap || || || remove; dropped from 2.6.1 || ||43b3b43cea1f620ce66521bcc1c4b6aec264aa9a ||MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken service name proper ||Applied locally || ||Yes || - ||c428d303f67bef3a7df12153947c6b0199a0938b ||HDFS-7707. Edit log corruption due to delayed block removal again. Contributed by Yongjun || || + ||c428d303f67bef3a7df12153947c6b0199a0938b ||HDFS-7707. Edit log corruption due to delayed block removal again. Contributed by Yongjun || || || yes || - ||5807afed0a4f08b6b2acd88f424bace506e03707 ||HDFS-7733. NFS: readdir/readdirplus return null directory attribute on failure. (Contribut || || + ||5807afed0a4f08b6b2acd88f424bace506e03707 ||HDFS-7733. NFS: readdir/readdirplus return null directory attribute on failure. (Contribut || || || remove; already committed || ||3d36d4737c160d7dc8829e9dd6b801ef6726c0c0 ||HADOOP-11506. Configuration variable expansion regex expensive for long values. (Gera Sheg ||Applied locally || ||Yes || ||b1aad1d941c5855e5dd5f5e819e9218d8fc266ee ||MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of reusing conectio ||Applied locally || ||Yes || ||61466809552f96a83aa19446d4d59cecd0d2cad5 ||YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong (c ||Applied locally || ||Yes || - ||a1bf7aecf7d018c5305fa3bd7a9e3ef9af3155c1 ||HDFS-7714. Simultaneous restart of HA NameNodes and DataNode can cause DataNode to registe || || + ||a1bf7aecf7d018c5305fa3bd7a9e3ef9af3155c1 ||HDFS-7714. Simultaneous restart of HA NameNodes and DataNode can cause DataNode to registe || || || yes || ||fd75b8c9cadd069673afc80a0fc5661d779897bd ||YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> t ||Applied locally || ||Yes || ||ba18adbb27c37a8fa92223a412ce65eaa462d18b ||YARN-3207. Secondary filter matches entites which do not have the key being filtered for. ||Applied locally || ||Yes || ||6c01e586198a3c3ebaa7561778c124ae62553246 ||HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed ||Applied locally ||Yes ||No || - ||b9157f92fc3e008e4f3029f8feeaf6acb52eb76f ||HDFS-7788. Post-2.6 namenode may not start up with an image containing inodes created with || || + ||b9157f92fc3e008e4f3029f8feeaf6acb52eb76f ||HDFS-7788. Post-2.6 namenode may not start up with an image containing inodes created with || || yes || used the 2.6 patch || ||187e081d5a8afe1ddfe5d7b5e7de7a94512aa53e ||HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during ||Applied locally || ||Yes || ||fefeba4ac8bed44ce2dd0d3c4f0a99953ff8d4df ||YARN-3238. Connection timeouts to nodemanagers are retried at multiple levels. Contributed ||Applied locally || ||Yes || - ||657a6e389b3f6eae43efb11deb6253c3b1255a51 ||HDFS-7009. Active NN and standby NN have different live nodes. Contributed by Ming Ma. (c || || + ||657a6e389b3f6eae43efb11deb6253c3b1255a51 ||HDFS-7009. Active NN and standby NN have different live nodes. Contributed by Ming Ma. (c || || || minor issues || - ||8346427929d2b6f2fd3fa228d77f3cf596ef0306 ||HDFS-7831. Fix the starting index and end condition of the loop in FileDiffList.findEarlie || || + ||8346427929d2b6f2fd3fa228d77f3cf596ef0306 ||HDFS-7831. Fix the starting index and end condition of the loop in FileDiffList.findEarlie || || || remove; does not apply to 2.6 || - ||efb7e287f45c6502f293456034a37d9209a917be ||HDFS-7763. fix zkfc hung issue due to not catching exception in a corner case. Contributed || || + ||efb7e287f45c6502f293456034a37d9209a917be ||HDFS-7763. fix zkfc hung issue due to not catching exception in a corner case. Contributed || || || yes || ||257087417e424e628f090b6b648ccb3b9c880250 ||YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and ||Applied locally || ||No, minor merge conflicts in WebAppProxyServlet.java || - ||12fe3afcd3ea224909bd125f5c6a7410bf2601b0 ||HDFS-7843. A truncated file is corrupted after rollback from a rolling upgrade. || || + ||12fe3afcd3ea224909bd125f5c6a7410bf2601b0 ||HDFS-7843. A truncated file is corrupted after rollback from a rolling upgrade. || || || remove; does not apply to 2.6 || - ||6090f51725e2b44d794433ed72a1901fae2ba7e3 ||HDFS-7871. NameNodeEditLogRoller can keep printing 'Swallowing exception' message. Contrib || || + ||6090f51725e2b44d794433ed72a1901fae2ba7e3 ||HDFS-7871. NameNodeEditLogRoller can keep printing 'Swallowing exception' message. Contrib || || || yes || ||888a44563819ba910dc3cc10d10ee0fb8f05db61 ||YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with ||Applied locally || ||Yes || ||721d7b574126c4070322f70ec5b49a7b8558a4c7 ||YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi ||Applied locally || ||Yes || ||0d62e948877e5d50f1b6fbe735a94ac6da5ff472 ||YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for || || ||b569c3ab1cb7e328dde822f6b2405d24b9560e3a ||HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static. ||Applied locally || ||Yes || ||a5f3fb4dc14503bf7c454a48cf954fb0d6710de2 ||YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan || || - ||994dadb9ba0a3b87b6548e6e0801eadd26554d55 ||HDFS-7885. Datanode should not trust the generation stamp provided by client. Contributed || || + ||994dadb9ba0a3b87b6548e6e0801eadd26554d55 ||HDFS-7885. Datanode should not trust the generation stamp provided by client. Contributed || || || yes || ||56c2050ab7c04e9741bcba9504b71e5a54d09eea ||YARN-3227. Timeline renew delegation token fails when RM user's TGT is expired. Contribute || || ||a94d23762e2cf4211fe84661eb67504c7072db49 ||YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by || || - ||eefca23e8c5e474de1e25bf2ec8a5b266bbe8cfe ||HDFS-7830. DataNode does not release the volume lock when adding a volume fails. (Lei Xu v || || + ||eefca23e8c5e474de1e25bf2ec8a5b266bbe8cfe ||HDFS-7830. DataNode does not release the volume lock when adding a volume fails. (Lei Xu v || || || non-trivial changes || ||813c93cb250d6d556604fe98845b979970bd5e18 ||HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Se ||Applied locally || ||Yes || ||44aedad5ddc8069a6dba3eaf66ed54d612b21208 ||YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of || || - ||af80a98ace50934284dde417efc802bb094c8b4e ||HDFS-7926. NameNode implementation of ClientProtocol.truncate(..) is not idempotent. Contr || || + ||af80a98ace50934284dde417efc802bb094c8b4e ||HDFS-7926. NameNode implementation of ClientProtocol.truncate(..) is not idempotent. Contr || || || remove; does not apply to 2.6 || - ||5a5b2446485531f12d37f3d4ca791672b9921872 ||HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contribu || || + ||5a5b2446485531f12d37f3d4ca791672b9921872 ||HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contribu || || yes || used the 2.6 patch || - ||219eb22c1571f76df32967a930049d983cbf5024 ||HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zha || || + ||219eb22c1571f76df32967a930049d983cbf5024 ||HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zha || || || non-trivial changes || - ||90164ffd84f6ef56e9f8f99dcc7424a8d115dbae ||HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu) || || + ||90164ffd84f6ef56e9f8f99dcc7424a8d115dbae ||HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu) || || yes || used the 2.6 patch || ||8e142d27cbddfa1a1c83c5f8752bd14ac0a13612 ||YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy || || ||cbdcdfad6de81e17fb586bc2a53b37da43defd79 ||YARN-3393. Getting application(s) goes wrong when app finishes before starting the attempt || || - ||fe693b72dec703ecbf4ab3919d61d06ea8735a9e ||HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by t || || + ||fe693b72dec703ecbf4ab3919d61d06ea8735a9e ||HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by t || || || yes || - ||2f46ee50bd4efc82ba3d30bd36f7637ea9d9714e ||HDFS-7960. The full block report should prune zombie storages even if they're not empty. C || || + ||2f46ee50bd4efc82ba3d30bd36f7637ea9d9714e ||HDFS-7960. The full block report should prune zombie storages even if they're not empty. C || || || non-trivial changes || - ||c4cedfc1d601127430c70ca8ca4d4e2ee2d1003d ||HDFS-7742. Favoring decommissioning node for replication can cause a block to stay underre || || + ||c4cedfc1d601127430c70ca8ca4d4e2ee2d1003d ||HDFS-7742. Favoring decommissioning node for replication can cause a block to stay underre || || || yes || ||cacadea632f7ab6fe4fdb1432e1a2c48e8ebd55f ||MAPREDUCE-6303. Read timeout when retrying a fetch error can be fatal to a reducer. Contri || || - ||a827089905524e10638c783ba908a895d621911d ||HDFS-7999. FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very || || + ||a827089905524e10638c783ba908a895d621911d ||HDFS-7999. FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very || || || non-trivial changes || - ||f0324738c9db4f45d2b1ec5cfb46c5f2b7669571 ||HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (A || || + ||f0324738c9db4f45d2b1ec5cfb46c5f2b7669571 ||HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (A || || || non-trivial changes (ExternalReplicaInPipeline.java doesn't exist in 2.6) || - ||7e622076d41a85fc9a8600fb270564a085f5cd83 ||HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. (cherry p || || + ||7e622076d41a85fc9a8600fb270564a085f5cd83 ||HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. (cherry p || || || non-trivial changes (FsDirStatAndListingOp.java doesn't exist in 2.6) || ||1ff3fd33ed6f2ac09c774cc42b0107c5dbd9c19d ||YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of app || || ||3de0bf9a35094f3c2ac216992d861729251b6a3d ||MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. (cherry picked || || - ||38b031d6bab8527698bd186887d301bd6a63cf01 ||HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Con || || + ||38b031d6bab8527698bd186887d301bd6a63cf01 ||HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Con || || || minor issues || ||e7cbecddc3e7ca5386c71aa4deb67f133611415c ||YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings || || ||3316cd4357ff6ccc4c76584813092adb1c2b4d43 ||YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue ( || || ||756c2542930756fef1cbff82056b418070f8d55f ||MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regressi || || @@ -106, +108 @@ ||32dc13d907a416049bdb7deff429725bd6dbcb49 ||MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they || || ||58970d69de8a1662e4548cd6d4ca460dd70562f8 ||HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula ||Applied locally || ||Yes || ||87c2d915f1cc799cb4020c945c04d3ecb82ee963 ||MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by || || - ||e68e8b3b5cff85bfd8bb5b00b9033f63577856d6 ||HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (sure || || + ||e68e8b3b5cff85bfd8bb5b00b9033f63577856d6 ||HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (sure || || || minor issues || - ||4e1f2eb3955a97a70cf127dc97ae49201a90f5e0 ||HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contribu || || + ||4e1f2eb3955a97a70cf127dc97ae49201a90f5e0 ||HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contribu || || || non-trivial changes (dropped TestBlockManager.java changes) || ||d817fbb34d6e34991c6e512c20d71387750a98f4 ||YARN-2918. RM should not fail on startup if queue's configured labels do not exist in clus || || - ||802a5775f3522c57c60ae29ecb9533dbbfecfe76 ||HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. || || + ||802a5775f3522c57c60ae29ecb9533dbbfecfe76 ||HDFS-7894. Rolling upgrade readiness is not updated in jmx until query command is issued. || || || yes || - ||f264a5aeede7e144af11f5357c7f901993de8e12 ||HDFS-8245. Standby namenode doesn't process DELETED_BLOCK if the addblock request is in ed || || + ||f264a5aeede7e144af11f5357c7f901993de8e12 ||HDFS-8245. Standby namenode doesn't process DELETED_BLOCK if the addblock request is in ed || || || minor issues || ||fb5b0ebb459cc8812084090a7ce7ac29e2ad147c ||MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in || || ||a81ad814610936a02e55964fbe08f7b33fe29b23 ||YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in || || ||802676e1be350785d8c0ad35f6676eeb85b2467b ||YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Cont || || - ||536b9ee6d6e5b8430fda23cbdcfd859c299fa8ad ||HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Na || || + ||536b9ee6d6e5b8430fda23cbdcfd859c299fa8ad ||HDFS-8404. Pending block replication can get stuck using older genstamp. Contributed by Na || || || minor issues || ||d3193fd1d7395bf3e7c8dfa70d1aec08b0f147e6 ||Move YARN-2918 from 2.8.0 to 2.7.1 (cherry picked from commit 03f897fd1a3779251023bae3582 || || ||839f81a6326b2f8b3d5183178382c1551b0bc259 ||YARN-3700. Made generic history service load a number of latest applications according to || || - ||25db34127811fbadb9a698fa3a76e24d426fb0f6 ||HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. (cherry p || || + ||25db34127811fbadb9a698fa3a76e24d426fb0f6 ||HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. (cherry p || || || minor issues || ||33648268ce0f79bf51facafa3d151612e3d00ddb ||HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contr ||Skipped || ||No, cannot apply to branch-2.6 due to java.nio package. || - ||17fb442a4c4e43105374c97fccd68dd966729a19 ||HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by || || + ||17fb442a4c4e43105374c97fccd68dd966729a19 ||HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by || || || non-trivial changes || ||4fee8b320276bac86278e1ae0a3397592a78aa18 ||YARN-2900. Application (Attempt and Container) Not Found in AHS results in Internal Server || || ||a3734f67d35e714690ecdf21d80bce8a355381e3 ||YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service || || - ||17e369511dd18d6e25e10ddb0cd9511f7ec8f469 ||HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) (cher || || + ||17e369511dd18d6e25e10ddb0cd9511f7ec8f469 ||HDFS-8486. DN startup may cause severe data loss (Daryn Sharp via Colin P. McCabe) (cher || || || remove; already committed || - ||066e45bcb667bb0c37ef70fd297b24e4f26383eb ||HDFS-8270. create() always retried with hardcoded timeout when file already exists with op || || + ||066e45bcb667bb0c37ef70fd297b24e4f26383eb ||HDFS-8270. create() always retried with hardcoded timeout when file already exists with op || || yes || used the 2.6 patch || ||752caa95a40d899e1bf98bc907e91aec2bb57073 ||YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. || || ||78d626fa892415023827e35ad549636e2a83275d ||YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty || || ||344b7509153cdd993218cd5104c7e5c07cd35d3c ||Add missing test file of YARN-3733 (cherry picked from commit 405bbcf68c32d8fd8a83e46e686 || || ||80697e4f324948ec32b4cad3faccba55287be652 ||HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru ||Applied locally || ||Yes || - ||cbd11681ce8a51d187d91748b67a708681e599de ||HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve || || + ||cbd11681ce8a51d187d91748b67a708681e599de ||HDFS-8480. Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve || || || non-trivial changes (dropped TestDFSUpgrade.java changes) || ||15b1800b1289d239cbebc5cfd66cfe156d45a2d3 ||YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Con || || ||55427fb66c6d52ce98b4d68a29b592a734014c28 ||HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed ||Applied locally || ||Yes || ||0221d19f4e398c386f4ca3990b0893562aa8dacf ||YARN-3850. NM fails to read files from full disks which can lead to container logs being l || || - ||516bbf1c20547dc513126df0d9f0934bb65c10c7 ||HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather t || || + ||516bbf1c20547dc513126df0d9f0934bb65c10c7 ||HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather t || || || minor issues || ||c31e3ba92132f232bd56b257f3854ffe430fbab9 ||YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected || || - ||d2b941f94a835f7bdde7714d21a470b505aa582b ||HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scann || || + ||d2b941f94a835f7bdde7714d21a470b505aa582b ||HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scann || || || remove; does not apply to 2.6 || ||5950c1f6f8ac6f514f8d2e8bfbd1f71747b097de ||HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy ||Applied locally ||Yes ||No, conflict in TestMetricsSystemImpl. ||
