[hadoop] branch trunk updated: HDFS-16268. Balancer stuck when moving striped blocks due to NPE (#3546)

2021-10-13 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a commit to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/trunk by this push: new 7279fe8 HDFS-16268. Balancer stuck when moving

[hadoop] branch trunk updated (8f4456d -> b143181)

2021-09-21 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git. from 8f4456d YARN-10961. TestCapacityScheduler: reuse appHelper where feasible. Contributed by Tamas Domok add

[hadoop] branch trunk updated (71a6012 -> deb52cd)

2021-09-17 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git. from 71a6012 HADOOP-17914. Print RPC response length in the exception message (#3436) add deb52cd HDFS-16224

[hadoop] branch trunk updated: HDFS-15842. HDFS mover to emit metrics. (#2738)

2021-06-19 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a commit to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/trunk by this push: new 643dfd6 HDFS-15842. HDFS mover to emit metrics

[hadoop] branch trunk updated: MAPREDUCE-7334. TestJobEndNotifier fails. (#2877)

2021-04-09 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a commit to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/trunk by this push: new 1448756 MAPREDUCE-7334. TestJobEndNotifier fails

[hadoop] branch trunk updated (c5929c0 -> af1f9f4)

2021-03-25 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git. from c5929c0 HADOOP-17602. Upgrade JUnit to 4.13.1. Contributed by Ahmed Hussein. add af1f9f4 HADOOP-17133

[hadoop] branch trunk updated: HDFS-15781. Add metrics for how blocks are moved in replaceBlock. (#2704)

2021-02-23 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a commit to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/trunk by this push: new 940c780 HDFS-15781. Add metrics for how blocks

[hadoop] branch trunk updated (19ae0fa -> 0e2b308)

2021-02-08 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a change to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git. from 19ae0fa HDFS-15820. Ensure snapshot root trash provisioning happens only post safe mode exit (#2682) add

[hadoop] branch trunk updated: HDFS-15549. Use Hardlink to move replica between DISK and ARCHIVE storage if on same filesystem mount (#2583). Contributed by Leon Gao.

2021-01-15 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a commit to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/trunk by this push: new 7743d40 HDFS-15549. Use Hardlink to move replica

[hadoop] branch trunk updated: HDFS-14904. Add Option to let Balancer prefer highly utilized nodes in each iteration (#2483). Contributed by Leon Gao.

2020-12-02 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a commit to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/trunk by this push: new 6ff2409 HDFS-14904. Add Option to let Balancer

[hadoop] branch trunk updated: HDFS-15548. Allow configuring DISK/ARCHIVE storage types on same device mount (#2288). Contributed by Leon Gao.

2020-11-09 Thread jing9
This is an automated email from the ASF dual-hosted git repository. jing9 pushed a commit to branch trunk in repository https://gitbox.apache.org/repos/asf/hadoop.git The following commit(s) were added to refs/heads/trunk by this push: new 9a9ab5b HDFS-15548. Allow configuring DISK

hadoop git commit: HDFS-11823. Extend TestDFSStripedIutputStream/TestDFSStripedOutputStream with a random EC policy. Contributed by Takanobu Asanuma.

2017-05-24 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk dcf4559eb -> 1c8dd6d3d HDFS-11823. Extend TestDFSStripedIutputStream/TestDFSStripedOutputStream with a random EC policy. Contributed by Takanobu Asanuma. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.

2017-03-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 0da850a47 -> e03d8ff48 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. (cherry picked from commit 55796a0946f80a35055701a34379e374399009c5)

hadoop git commit: HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar.

2017-03-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk b8c69557b -> 55796a094 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.

2017-03-03 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 303ee13e3 -> 30b43a2d4 HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. (cherry picked from commit ac5ae0065a127ac150a887fa6c6f3cffd86ef733) Project:

hadoop git commit: HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou.

2017-03-03 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 2148b8399 -> ac5ae0065 HDFS-11476. Fix NPE in FsDatasetImpl#checkAndUpdate. Contributed by Xiaobing Zhou. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ac5ae006

hadoop git commit: HDFS-4025. QJM: Sychronize past log segments to JNs that missed them. Contributed by Hanisha Koneru.

2017-02-22 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk b10e96222 -> 13d4bcfe3 HDFS-4025. QJM: Sychronize past log segments to JNs that missed them. Contributed by Hanisha Koneru. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao.

2017-02-15 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 0fc6f3837 -> 627da6f71 HDFS-8498. Blocks can be committed with wrong size. Contributed by Jing Zhao. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/627da6f7 Tree:

hadoop git commit: HDFS-11370. Optimize NamenodeFsck#getReplicaInfo. Contributed Takanobu Asanuma.

2017-02-01 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 59c5f1878 -> b6f290d5b HDFS-11370. Optimize NamenodeFsck#getReplicaInfo. Contributed Takanobu Asanuma. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/b6f290d5 Tree:

hadoop git commit: HDFS-11124. Report blockIds of internal blocks for EC files in Fsck. Contributed by Takanobu Asanuma.

2017-01-25 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 18e1d6820 -> b782bf215 HDFS-11124. Report blockIds of internal blocks for EC files in Fsck. Contributed by Takanobu Asanuma. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-11273. Move TransferFsImage#doGetUrl function to a Util class. Contributed by Hanisha Koneru.

2017-01-09 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 511d39e07 -> 7ec609b28 HDFS-11273. Move TransferFsImage#doGetUrl function to a Util class. Contributed by Hanisha Koneru. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10827. When there are unrecoverable ec block groups, Namenode Web UI doesn't show the block names. Contributed by Takanobu Asanuma.

2016-10-14 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 0007360c3 -> adb96e109 HDFS-10827. When there are unrecoverable ec block groups, Namenode Web UI doesn't show the block names. Contributed by Takanobu Asanuma. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin.

2016-10-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 3892fd810 -> d3c446514 HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. (cherry picked from commit 0a85d079838f532a13ca237300386d1b3bc1b178) (cherry picked from commit

hadoop git commit: HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin.

2016-10-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 dc78e0e7f -> ad69baf6a HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. (cherry picked from commit 0a85d079838f532a13ca237300386d1b3bc1b178) Project:

hadoop git commit: HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin.

2016-10-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 8c721aa00 -> 0a85d0798 HADOOP-13024. Distcp with -delete feature on raw data not implemented. Contributed by Mavin Martin. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10968. BlockManager#isInNewRack should consider decommissioning nodes. Contributed by Jing Zhao.

2016-10-07 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 6a38d118d -> 4d106213c HDFS-10968. BlockManager#isInNewRack should consider decommissioning nodes. Contributed by Jing Zhao. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10826. Correctly report missing EC blocks in FSCK. Contributed by Takanobu Asanuma.

2016-10-05 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk d6be1e75d -> 886776225 HDFS-10826. Correctly report missing EC blocks in FSCK. Contributed by Takanobu Asanuma. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.

2016-09-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 1ac8206a8 -> 26597aa59 HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou. (cherry picked from commit 08d8e0ba259f01465a83d8db09466dfd46b7ec81) (cherry

hadoop git commit: HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.

2016-09-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 abaad976c -> 55600b38a HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou. (cherry picked from commit 08d8e0ba259f01465a83d8db09466dfd46b7ec81) Project:

hadoop git commit: HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.

2016-09-13 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk db6d243cf -> 08d8e0ba2 HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10858. FBR processing may generate incorrect reportedBlock-blockGroup mapping. Contributed by Jing Zhao.

2016-09-12 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 59d59667a -> 72dfb048a HDFS-10858. FBR processing may generate incorrect reportedBlock-blockGroup mapping. Contributed by Jing Zhao. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal.

2016-08-19 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 b2efb2040 -> 8628ad079 HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal. (cherry picked from commit 0faee62a0c8c1b8fd83227babfd00fbc2b26bddf) (cherry picked from commit

hadoop git commit: HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal.

2016-08-19 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 a299146b6 -> fff041845 HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal. (cherry picked from commit 0faee62a0c8c1b8fd83227babfd00fbc2b26bddf) Project:

hadoop git commit: HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal.

2016-08-19 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 99603e902 -> 0faee62a0 HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.

2016-08-18 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 ef38aa64c -> 5d91f9fe3 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. (cherry picked from commit 9fdd1ea72497f7a8aadbfedeba36688e0c16c52e) Project:

hadoop git commit: HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.

2016-08-18 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 3f3957ad6 -> 9fdd1ea72 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.

2016-08-18 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 0f51eae0c -> c5c3e81b4 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c5c3e81b

hadoop git commit: HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui.

2016-08-03 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 5883718ee -> 5bdee64bd HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui. (cherry picked from commit

hadoop git commit: HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui.

2016-08-03 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 1ea03411c -> 180a26d9f HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui. (cherry picked from commit

hadoop git commit: HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui.

2016-08-03 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk db646540f -> f4ba5ff1d HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui. Project:

hadoop git commit: HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang.

2016-07-25 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 e098a732e -> 62800dc8b HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang. (cherry picked from commit 0cde9e12a7175e4d8bc4ccd5c36055b280d1fbd6) (cherry

hadoop git commit: HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang.

2016-07-25 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 26df6bd31 -> 30c772fc5 HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang. (cherry picked from commit 0cde9e12a7175e4d8bc4ccd5c36055b280d1fbd6) Project:

hadoop git commit: HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang.

2016-07-25 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk d383bfdcd -> 0cde9e12a HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp.

2016-07-21 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 eff65463d -> 419d6ce19 HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. (cherry picked from commit bd3dcf46e263b6e6aa3fca6a5d9936cc49e3280f) Project:

hadoop git commit: HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp.

2016-07-21 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 557a245d8 -> bd3dcf46e HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

[hadoop] Git Push Summary

2016-07-14 Thread jing9
Repository: hadoop Updated Branches: refs/heads/HDFS-10467 [created] 382dff747 - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org

hadoop git commit: HDFS-10556. DistCpOptions should be validated automatically. Contributed by Mingliang Liu.

2016-06-22 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 9c46f99cc -> d17265f46 HDFS-10556. DistCpOptions should be validated automatically. Contributed by Mingliang Liu. (cherry picked from commit 856bc4e28b356f31d3c48eed2c352fb9010232d7) Project:

hadoop git commit: HDFS-10556. DistCpOptions should be validated automatically. Contributed by Mingliang Liu.

2016-06-22 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 81497a445 -> 856bc4e28 HDFS-10556. DistCpOptions should be validated automatically. Contributed by Mingliang Liu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu.

2016-06-10 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 e91e9e596 -> 9c7002b12 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. (cherry picked from commit 0bbb4ddd793063c87927035969884a34f60f2076) Project:

hadoop git commit: HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu.

2016-06-10 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 03fc6b1bb -> 0bbb4ddd7 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao

2016-06-07 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 19eb997f6 -> 8b34040cb HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao (cherry picked from commit be34e85e682880f46eee0310bf00ecc7d39cd5bd) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo

hadoop git commit: HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao

2016-06-07 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk c14c1b298 -> be34e85e6 HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing Zhao Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/be34e85e Tree:

hadoop git commit: HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu.

2016-05-17 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2.8 744d5edc8 -> 8755905e3 HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu. (cherry picked from commit 03788d3015c962eac1a35fa5df39356e8b84731c) (cherry picked

hadoop git commit: HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu.

2016-05-17 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 937bc924c -> dd7f5a3b8 HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu. (cherry picked from commit 03788d3015c962eac1a35fa5df39356e8b84731c) Project:

hadoop git commit: HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu.

2016-05-17 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 947848484 -> 03788d301 HDFS-10397. Distcp should ignore -delete option if -diff option is provided instead of exiting. Contributed by Mingliang Liu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.

2016-05-16 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 42b2a34ed -> af70fc42e HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze. (cherry picked from commit a9a8297cad4122961b34265c0a31d87134a4a028) Project:

hadoop git commit: HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.

2016-05-16 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 1217c8f6b -> a9a8297ca HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a9a8297c

hadoop git commit: HADOOP-12469. distcp should not ignore the ignoreFailures option. Contributed by Mingliang Liu.

2016-05-04 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 cb0a035bd -> d43d8a1bc HADOOP-12469. distcp should not ignore the ignoreFailures option. Contributed by Mingliang Liu. (cherry picked from commit af942585a108d70e0946f6dd4c465a54d068eabf) Project:

hadoop git commit: HADOOP-12469. distcp should not ignore the ignoreFailures option. Contributed by Mingliang Liu.

2016-05-04 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk f343d91ec -> af942585a HADOOP-12469. distcp should not ignore the ignoreFailures option. Contributed by Mingliang Liu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

[1/2] hadoop git commit: HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.

2016-04-22 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk c610031ca -> 63e5412f1 http://git-wip-us.apache.org/repos/asf/hadoop/blob/63e5412f/hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java

hadoop git commit: HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.

2016-04-21 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 2788769d4 -> 8580320fe HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. (cherry picked from commit 7149cdb3c2d9dd390cd8668883cbe5db94090e0a) Project:

hadoop git commit: HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.

2016-04-21 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 3ba490763 -> 7149cdb3c HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu.

2016-04-18 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 a69b6b1e8 -> bf4403e03 HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu. (cherry picked from commit be0bce1b7171c49e2dca22f56d4e750e606862fc) Project:

hadoop git commit: HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu.

2016-04-18 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk cb3ca460e -> be0bce1b7 HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10293. StripedFileTestUtil#readAll flaky. Contributed by Mingliang Liu.

2016-04-15 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 89a838769 -> 55e19b7f0 HDFS-10293. StripedFileTestUtil#readAll flaky. Contributed by Mingliang Liu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/55e19b7f Tree:

hadoop git commit: HDFS-10283. o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently. Contributed by Mingliang Liu.

2016-04-15 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 8d11a771b -> eba7ecc99 HDFS-10283. o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently. Contributed by Mingliang Liu. (cherry picked from commit

hadoop git commit: HDFS-10283. o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently. Contributed by Mingliang Liu.

2016-04-15 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 4feed9b2d -> 89a838769 HDFS-10283. o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently. Contributed by Mingliang Liu. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10216. Distcp -diff throws exception when handling relative path. Contributed by Takashi Ohnishi.

2016-04-14 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 51fc96f5c -> 864baf23a HDFS-10216. Distcp -diff throws exception when handling relative path. Contributed by Takashi Ohnishi. (cherry picked from commit 404f57f328b00a42ec8b952ad08cd7a80207c7f2) Project:

hadoop git commit: HDFS-10216. Distcp -diff throws exception when handling relative path. Contributed by Takashi Ohnishi.

2016-04-14 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 0d1c1152f -> 404f57f32 HDFS-10216. Distcp -diff throws exception when handling relative path. Contributed by Takashi Ohnishi. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula.

2016-04-06 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 5574f8279 -> 7cac807eb HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula. (cherry picked from commit 221b3a8722f84f8e9ad0a98eea38a12cc4ad2f24) Project:

hadoop git commit: HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula.

2016-04-06 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk de96d7c88 -> 221b3a872 HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-8786. Erasure coding: use simple replication for internal blocks on decommissioning datanodes. Contributed by Rakesh R.

2016-03-08 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk f86850b54 -> 743a99f2d HDFS-8786. Erasure coding: use simple replication for internal blocks on decommissioning datanodes. Contributed by Rakesh R. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

hadoop git commit: HDFS-9876. shouldProcessOverReplicated should not count number of pending replicas. Contributed by Jing Zhao.

2016-03-01 Thread jing9
HDFS-9867. Missing block exception should carry locatedBlocks information. (Mingliang Liu via jing9) +HDFS-9876. shouldProcessOverReplicated should not count number of pending +replicas. (jing9) + BREAKDOWN OF HDFS-7285 SUBTASKS AND RELATED JIRAS HDFS-7347. Confi

[2/2] hadoop git commit: HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.

2016-02-29 Thread jing9
/hadoop-hdfs/CHANGES.txt index 5a8d451..5deae96 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt +++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt @@ -70,6 +70,8 @@ Release 2.9.0 - UNRELEASED HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. (jing9) +HD

[1/2] hadoop git commit: HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.

2016-02-29 Thread jing9
Repository: hadoop Updated Branches: refs/heads/branch-2 c5db4ab0b -> 3cb7ae11a http://git-wip-us.apache.org/repos/asf/hadoop/blob/3cb7ae11/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRecovery.java

[2/2] hadoop git commit: HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.

2016-02-29 Thread jing9
oject/hadoop-hdfs/CHANGES.txt +++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt @@ -1037,6 +1037,8 @@ Release 2.9.0 - UNRELEASED HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. (jing9) +HDFS-7964. Add support for async edit logging. (Daryn Sharp) + OPTIMIZATI

[1/2] hadoop git commit: HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.

2016-02-29 Thread jing9
Repository: hadoop Updated Branches: refs/heads/trunk 0fa54d45b -> 215171683 http://git-wip-us.apache.org/repos/asf/hadoop/blob/21517168/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeRecovery.java

hadoop git commit: HDFS-9867. Missing block exception should carry locatedBlocks information. Contributed by Mingliang Liu.

2016-02-28 Thread jing9
Trunk (Unreleased) HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. (jing9) +HDFS-9867. Missing block exception should carry locatedBlocks information. +(Mingliang Liu via jing9) + BREAKDOWN OF HDFS-7285 SUBTASKS AND RELATED JIRAS HDFS-7347. C

hadoop git commit: HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. Contributed by Jing Zhao.

2016-02-28 Thread jing9
ect/hadoop-hdfs/CHANGES.txt +++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt @@ -446,6 +446,9 @@ Trunk (Unreleased) HDFS-9734. Refactoring of checksum failure report related codes. (Kai Zheng via zhz) +HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault + to

hadoop git commit: HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao.

2016-02-24 Thread jing9
unk (Unreleased) HDFS-9818. Correctly handle EC reconstruction work caused by not enough racks. (jing9) +HDFS-9837. BlockManager#countNodes should be able to detect duplicated +internal blocks. (jing9) + BREAKDOWN OF HDFS-7285 SUBTASKS AND RELATED JIRAS HDFS-734

[04/50] [abbrv] hadoop git commit: YARN-4689. Fix up CHANGES.txt

2016-02-24 Thread jing9
YARN-4689. Fix up CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1c248ea4 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1c248ea4 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/1c248ea4

[08/50] [abbrv] hadoop git commit: MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana.

2016-02-24 Thread jing9
MAPREDUCE-6634. Log uncaught exceptions/errors in various thread pools in mapreduce. Contributed by Sidharta Seethana. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2440671a Tree:

[09/50] [abbrv] hadoop git commit: HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur.

2016-02-24 Thread jing9
HDFS-6832. Fix the usage of 'hdfs namenode' command. Contributed by Manjunath Ballur. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/e78d8e66 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/e78d8e66 Diff:

[20/50] [abbrv] hadoop git commit: HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)

2016-02-24 Thread jing9
HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a963baba Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a963baba Diff:

[27/50] [abbrv] hadoop git commit: HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)

2016-02-24 Thread jing9
HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal) This closes #78 Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d5abd293 Tree:

[16/50] [abbrv] hadoop git commit: MAPREDUCE-6627. Add machine-readable output to mapred job -history command (rkanter)

2016-02-24 Thread jing9
http://git-wip-us.apache.org/repos/asf/hadoop/blob/8eee59ce/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/jobhistory/TestHistoryViewerPrinter.java -- diff

[06/50] [abbrv] hadoop git commit: YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee)

2016-02-24 Thread jing9
YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/7de70680 Tree:

[37/50] [abbrv] hadoop git commit: HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.

2016-02-24 Thread jing9
HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/27b77751 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/27b77751

[36/50] [abbrv] hadoop git commit: HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo

2016-02-24 Thread jing9
HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/66289a3b Tree:

[46/50] [abbrv] hadoop git commit: HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe)

2016-02-24 Thread jing9
HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/211c78c0 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/211c78c0 Diff:

[45/50] [abbrv] hadoop git commit: HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe)

2016-02-24 Thread jing9
HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d9c409a4 Tree:

[34/50] [abbrv] hadoop git commit: HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.

2016-02-24 Thread jing9
HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/d4f5fc23 Tree:

[32/50] [abbrv] hadoop git commit: YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla.

2016-02-24 Thread jing9
YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3fab8854 Tree:

[44/50] [abbrv] hadoop git commit: YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.

2016-02-24 Thread jing9
YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/9ed17f18 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/9ed17f18 Diff:

[38/50] [abbrv] hadoop git commit: YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.

2016-02-24 Thread jing9
YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/140cb5d7 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/140cb5d7 Diff:

[49/50] [abbrv] hadoop git commit: HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li.

2016-02-24 Thread jing9
HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li. Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit:

[50/50] [abbrv] hadoop git commit: Merge changes from trunk

2016-02-24 Thread jing9
Merge changes from trunk Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/1b7df69d Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/1b7df69d Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/1b7df69d Branch:

[43/50] [abbrv] hadoop git commit: YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki.

2016-02-24 Thread jing9
YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/0e12114c Tree:

[33/50] [abbrv] hadoop git commit: HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun)

2016-02-24 Thread jing9
HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a63301a8 Tree:

[11/50] [abbrv] hadoop git commit: HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter)

2016-02-24 Thread jing9
HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/a365a394 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/a365a394 Diff:

  1   2   3   4   5   6   7   8   9   10   >