[GitHub] [hadoop] hadoop-yetus commented on pull request #2006: HDFS-15306. Make mount-table to read from central place ( Let's say from HDFS).

2020-05-08 Thread GitBox
hadoop-yetus commented on pull request #2006: URL: https://github.com/apache/hadoop/pull/2006#issuecomment-626106748 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103073#comment-17103073 ] Uma Maheswara Rao G commented on HADOOP-15565: -- [~virajith] Thanks for updating the patch.

[GitHub] [hadoop] umamaheswararao commented on a change in pull request #2006: HDFS-15306. Make mount-table to read from central place ( Let's say from HDFS).

2020-05-08 Thread GitBox
umamaheswararao commented on a change in pull request #2006: URL: https://github.com/apache/hadoop/pull/2006#discussion_r422441292 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/MountTableConfigLoader.java ## @@ -0,0 +1,40 @@ +/**

[GitHub] [hadoop] liusheng commented on pull request #1967: YARN-9898. Workaround of Netty-all dependency aarch64 support

2020-05-08 Thread GitBox
liusheng commented on pull request #1967: URL: https://github.com/apache/hadoop/pull/1967#issuecomment-626087699 @brahmareddybattula OK, thank you, I have also uploaded a patch file to the JIRA issue. This is an automated

[GitHub] [hadoop] umamaheswararao opened a new pull request #2006: HDFS-15306. Make mount-table to read from central place ( Let's say from HDFS).

2020-05-08 Thread GitBox
umamaheswararao opened a new pull request #2006: URL: https://github.com/apache/hadoop/pull/2006 HDFS-15306. Make mount-table to read from central place ( Let's say from HDFS). This is an automated message from the

[jira] [Commented] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103025#comment-17103025 ] Virajith Jalaparti commented on HADOOP-15565: - Failed test {{TestRollingUpgrade}} seems to

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Status: Patch Available (was: Open) > ViewFileSystem.close doesn't close child

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Status: Open (was: Patch Available) > ViewFileSystem.close doesn't close child

[jira] [Commented] (HADOOP-14254) Add a Distcp option to preserve Erasure Coding attributes

2020-05-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102965#comment-17102965 ] Ayush Saxena commented on HADOOP-14254: --- [~elgoiri] [~weichiu] can you help give a check. > Add

[jira] [Commented] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102920#comment-17102920 ] Hadoop QA commented on HADOOP-15565: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] hadoop-yetus commented on pull request #2004: HDFS-15344. DataNode#checkSuperuserPrivilege should use UGI#getGroups…

2020-05-08 Thread GitBox
hadoop-yetus commented on pull request #2004: URL: https://github.com/apache/hadoop/pull/2004#issuecomment-626002405 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2005: HDFS-15345. RouterPermissionChecker#checkSuperuserPrivilege should us…

2020-05-08 Thread GitBox
hadoop-yetus commented on pull request #2005: URL: https://github.com/apache/hadoop/pull/2005#issuecomment-625975190 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2003: HADOOP-16768. SnappyCompressor wrongly truncates the compressed data

2020-05-08 Thread GitBox
hadoop-yetus commented on pull request #2003: URL: https://github.com/apache/hadoop/pull/2003#issuecomment-625969539 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[jira] [Commented] (HADOOP-14254) Add a Distcp option to preserve Erasure Coding attributes

2020-05-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102799#comment-17102799 ] Hadoop QA commented on HADOOP-14254: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] xiaoyuyao opened a new pull request #2005: HDFS-15345. RouterPermissionChecker#checkSuperuserPrivilege should us…

2020-05-08 Thread GitBox
xiaoyuyao opened a new pull request #2005: URL: https://github.com/apache/hadoop/pull/2005 …e UGI#getGroups after HADOOP-13442. https://issues.apache.org/jira/browse/HDFS-15345 This is an automated message from the

[GitHub] [hadoop] jojochuang commented on pull request #2004: HDFS-15344. DataNode#checkSuperuserPrivilege should use UGI#getGroups…

2020-05-08 Thread GitBox
jojochuang commented on pull request #2004: URL: https://github.com/apache/hadoop/pull/2004#issuecomment-625936595 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] xiaoyuyao opened a new pull request #2004: HDFS-15344. DataNode#checkSuperuserPrivilege should use UGI#getGroups…

2020-05-08 Thread GitBox
xiaoyuyao opened a new pull request #2004: URL: https://github.com/apache/hadoop/pull/2004 … after HADOOP-13442. https://issues.apache.org/jira/browse/HDFS-15344 This is an automated message from the Apache Git

[GitHub] [hadoop] aajisaka edited a comment on pull request #2003: HADOOP-16768. SnappyCompressor wrongly truncates the compressed data

2020-05-08 Thread GitBox
aajisaka edited a comment on pull request #2003: URL: https://github.com/apache/hadoop/pull/2003#issuecomment-625924089 In addition, I refactored the test to print the following error before fixing this failure: ``` [ERROR] Failures: [ERROR]

[GitHub] [hadoop] aajisaka commented on pull request #2003: HADOOP-16768. SnappyCompressor wrongly truncates the compressed data

2020-05-08 Thread GitBox
aajisaka commented on pull request #2003: URL: https://github.com/apache/hadoop/pull/2003#issuecomment-625924089 In addition, I refactored the test to print the following error: ``` [ERROR] Failures: [ERROR] TestCompressorDecompressor.testCompressorDecompressor:69 Expected to

[GitHub] [hadoop] aajisaka commented on pull request #2003: HADOOP-16768. SnappyCompressor wrongly truncates the compressed data

2020-05-08 Thread GitBox
aajisaka commented on pull request #2003: URL: https://github.com/apache/hadoop/pull/2003#issuecomment-625922888 Thanks @iwasakims for the testing. Sorry I missed TestCompressorDecompressor failure on Ubuntu 18.04. I fixed the test.

[jira] [Updated] (HADOOP-14254) Add a Distcp option to preserve Erasure Coding attributes

2020-05-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-14254: -- Attachment: HADOOP-14254-02.patch > Add a Distcp option to preserve Erasure Coding

[jira] [Commented] (HADOOP-14254) Add a Distcp option to preserve Erasure Coding attributes

2020-05-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102714#comment-17102714 ] Hadoop QA commented on HADOOP-14254: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Attachment: HADOOP-15565-branch-3.2.001.patch > ViewFileSystem.close doesn't

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Attachment: (was: HADOOP-15565-branch-2.10.001.patch) > ViewFileSystem.close

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Attachment: (was: HADOOP-15565-branch-3.1.001.patch) > ViewFileSystem.close

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Status: Patch Available (was: Open) > ViewFileSystem.close doesn't close child

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Attachment: (was: HADOOP-15565-branch-3.2.001.patch) > ViewFileSystem.close

[jira] [Updated] (HADOOP-15565) ViewFileSystem.close doesn't close child filesystems and causes FileSystem objects leak.

2020-05-08 Thread Virajith Jalaparti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HADOOP-15565: Status: Open (was: Patch Available) > ViewFileSystem.close doesn't close child

[jira] [Updated] (HADOOP-14254) Add a Distcp option to preserve Erasure Coding attributes

2020-05-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-14254: -- Status: Patch Available (was: Open) > Add a Distcp option to preserve Erasure Coding

[jira] [Commented] (HADOOP-14254) Add a Distcp option to preserve Erasure Coding attributes

2020-05-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102654#comment-17102654 ] Ayush Saxena commented on HADOOP-14254: --- Thanx Everyone for the discussion. Had a 1.5 years old

[jira] [Updated] (HADOOP-14254) Add a Distcp option to preserve Erasure Coding attributes

2020-05-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-14254: -- Attachment: HADOOP-14254-01.patch > Add a Distcp option to preserve Erasure Coding

[GitHub] [hadoop] hadoop-yetus commented on pull request #2003: HADOOP-16768. SnappyCompressor wrongly truncates the compressed data

2020-05-08 Thread GitBox
hadoop-yetus commented on pull request #2003: URL: https://github.com/apache/hadoop/pull/2003#issuecomment-625817310 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m

[GitHub] [hadoop] hadoop-yetus commented on pull request #2002: HADOOP-17020. RawFileSystem could localize default block size to avoi…

2020-05-08 Thread GitBox
hadoop-yetus commented on pull request #2002: URL: https://github.com/apache/hadoop/pull/2002#issuecomment-625804206 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m

[GitHub] [hadoop] iwasakims commented on pull request #2003: HADOOP-16768. SnappyCompressor wrongly truncates the compressed data

2020-05-08 Thread GitBox
iwasakims commented on pull request #2003: URL: https://github.com/apache/hadoop/pull/2003#issuecomment-625788562 @aajisaka I observed the same issue on CentOS 8 as reported in [HADOOP-17034](https://issues.apache.org/jira/browse/HADOOP-17034). While the patch fixed the error of

[jira] [Commented] (HADOOP-17034) Fix failure of TestSnappyCompressorDecompressor on CentOS 8

2020-05-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102508#comment-17102508 ] Masatake Iwasaki commented on HADOOP-17034: --- Thanks, [~ayushtkn]. It looks like the same

[jira] [Commented] (HADOOP-16768) Compress tests failed on X86 and ARM platform

2020-05-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102502#comment-17102502 ] Akira Ajisaka commented on HADOOP-16768: PR submitted:

[jira] [Updated] (HADOOP-16768) Compress tests failed on X86 and ARM platform

2020-05-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16768: --- Target Version/s: 3.3.0 Status: Patch Available (was: Open) > Compress

[GitHub] [hadoop] aajisaka opened a new pull request #2003: HADOOP-16768. SnappyCompressor wrongly truncates the compressed data

2020-05-08 Thread GitBox
aajisaka opened a new pull request #2003: URL: https://github.com/apache/hadoop/pull/2003 JIRA: https://issues.apache.org/jira/browse/HADOOP-16768 Note that perhaps there is the same issue in other compressors. This

[jira] [Commented] (HADOOP-16768) Compress tests failed on X86 and ARM platform

2020-05-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102493#comment-17102493 ] Akira Ajisaka commented on HADOOP-16768: The problem is that Hadoop SnappyCompressor assumes

[jira] [Assigned] (HADOOP-16768) Compress tests failed on X86 and ARM platform

2020-05-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-16768: -- Assignee: Akira Ajisaka > Compress tests failed on X86 and ARM platform >

[jira] [Updated] (HADOOP-16768) Compress tests failed on X86 and ARM platform

2020-05-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-16768: --- Priority: Critical (was: Major) > Compress tests failed on X86 and ARM platform >

[jira] [Comment Edited] (HADOOP-17020) RawFileSystem could localize default block size to avoid sync bottleneck in config

2020-05-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102474#comment-17102474 ] Rajesh Balamohan edited comment on HADOOP-17020 at 5/8/20, 11:09 AM:

[jira] [Commented] (HADOOP-17020) RawFileSystem could localize default block size to avoid sync bottleneck in config

2020-05-08 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102474#comment-17102474 ] Rajesh Balamohan commented on HADOOP-17020: --- Sure. Thanks  [~ste...@apache.org] . PR:

[GitHub] [hadoop] rbalamohan opened a new pull request #2002: HADOOP-17020. RawFileSystem could localize default block size to avoi…

2020-05-08 Thread GitBox
rbalamohan opened a new pull request #2002: URL: https://github.com/apache/hadoop/pull/2002 HADOOP-17020: RawFileSystem could localize default block size to avoid sync bottleneck in config This is an automated message from

[jira] [Commented] (HADOOP-8143) Change distcp to have -pb on by default

2020-05-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102426#comment-17102426 ] Steve Loughran commented on HADOOP-8143: thanks -I'll roll back next week pending further

[GitHub] [hadoop] aajisaka commented on pull request #2001: HDFS-15343. TestConfiguredFailoverProxyProvider is failing.

2020-05-08 Thread GitBox
aajisaka commented on pull request #2001: URL: https://github.com/apache/hadoop/pull/2001#issuecomment-625702109 hadoop.io.compress.TestCompressorDecompressor and hadoop.io.compress.snappy.TestSnappyCompressorDecompressor are not related and they are tracked by

[GitHub] [hadoop] aajisaka commented on pull request #2001: HDFS-15343. TestConfiguredFailoverProxyProvider is failing.

2020-05-08 Thread GitBox
aajisaka commented on pull request #2001: URL: https://github.com/apache/hadoop/pull/2001#issuecomment-625700471 Thanks @ayushtkn for your review. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2001: HDFS-15343. TestConfiguredFailoverProxyProvider is failing.

2020-05-08 Thread GitBox
hadoop-yetus commented on pull request #2001: URL: https://github.com/apache/hadoop/pull/2001#issuecomment-625700276 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 26m

[jira] [Commented] (HADOOP-17034) Fix failure of TestSnappyCompressorDecompressor on CentOS 8

2020-05-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102354#comment-17102354 ] Ayush Saxena commented on HADOOP-17034: --- Is it similar to what reported in HADOOP-16768? > Fix

[jira] [Commented] (HADOOP-17034) Fix failure of TestSnappyCompressorDecompressor on CentOS 8

2020-05-08 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102347#comment-17102347 ] Masatake Iwasaki commented on HADOOP-17034: --- {noformat} [ERROR]

[jira] [Created] (HADOOP-17034) Fix failure of TestSnappyCompressorDecompressor on CentOS 8

2020-05-08 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created HADOOP-17034: - Summary: Fix failure of TestSnappyCompressorDecompressor on CentOS 8 Key: HADOOP-17034 URL: https://issues.apache.org/jira/browse/HADOOP-17034 Project:

[jira] [Commented] (HADOOP-15524) BytesWritable causes OOME when array size reaches Integer.MAX_VALUE

2020-05-08 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102329#comment-17102329 ] Srinivasu Majeti commented on HADOOP-15524: --- Hi [~nanda], [~arpaga] , Can we commit this Jira

[jira] [Commented] (HADOOP-16647) Support OpenSSL 1.1.1 LTS

2020-05-08 Thread Andrea (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102296#comment-17102296 ] Andrea commented on HADOOP-16647: - This patch can be used hadoop2.6.0 > Support OpenSSL 1.1.1 LTS >

[jira] [Commented] (HADOOP-16768) Compress tests failed on X86 and ARM platform

2020-05-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102295#comment-17102295 ] Akira Ajisaka commented on HADOOP-16768: After HADOOP-16054, we can see this error in Jenkins.