[GitHub] [hadoop] tomscut opened a new pull request #2739: HDFS-15870. Remove unused configuration dfs.namenode.stripe.min

2021-03-02 Thread GitBox
tomscut opened a new pull request #2739: URL: https://github.com/apache/hadoop/pull/2739 JIRA: https://issues.apache.org/jira/browse/HDFS-15870 Remove unused configuration dfs.namenode.stripe.min. This is an automated

[GitHub] [hadoop] LeonGao91 opened a new pull request #2738: HDFS-15842. HDFS mover to emit metrics.

2021-03-02 Thread GitBox
LeonGao91 opened a new pull request #2738: URL: https://github.com/apache/hadoop/pull/2738 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] tomscut commented on pull request #2668: HDFS-15808. Add metrics for FSNamesystem read/write lock hold long time

2021-03-02 Thread GitBox
tomscut commented on pull request #2668: URL: https://github.com/apache/hadoop/pull/2668#issuecomment-789484964 Hi @shvachko , I uploaded a patch for branch-3.3 in JIRA. > +1 LGTM Thanks @dineshchitlangia for the review.

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=560311=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560311 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

2021-03-02 Thread GitBox
sumangala-patki commented on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-789484324 TEST RESULTS HNS Account Location: East US 2 NonHNS Account Location: East US 2, Central US ``` HNS OAuth [WARNING] Tests run: 96, Failures: 0,

[jira] [Updated] (HADOOP-17542) IPV6 support in Netutils#createSocketAddress

2021-03-02 Thread ANANDA G B (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ANANDA G B updated HADOOP-17542: Attachment: Test Scenarios Verified in IPV6 cluster.doc > IPV6 support in

[GitHub] [hadoop] aajisaka commented on pull request #2726: HDFS-13975. TestBalancer#testMaxIterationTime fails sporadically

2021-03-02 Thread GitBox
aajisaka commented on pull request #2726: URL: https://github.com/apache/hadoop/pull/2726#issuecomment-789442307 @jojochuang Would you review this? This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] functioner opened a new pull request #2737: HDFS-15869. Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-03-02 Thread GitBox
functioner opened a new pull request #2737: URL: https://github.com/apache/hadoop/pull/2737 I propose a fix for [HDFS-15869](https://issues.apache.org/jira/browse/HDFS-15869). This is an automated message from the Apache

[GitHub] [hadoop] functioner commented on pull request #2727: HADOOP-17552. The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mista

2021-03-02 Thread GitBox
functioner commented on pull request #2727: URL: https://github.com/apache/hadoop/pull/2727#issuecomment-789426633 > > SocketTimeoutException > > How about "Change ipc.client.rpc-timeout.ms from 0 to 12 by default to avoid potential hang" Sounds good. Done.

[jira] [Work logged] (HADOOP-17552) The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken usage of the rpcTimeout configuratio

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?focusedWorklogId=560298=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560298 ] ASF GitHub Bot logged work on HADOOP-17552: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17552) Change ipc.client.rpc-timeout.ms from 0 to 120000 by default to avoid potential hang

2021-03-02 Thread Haoze Wu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoze Wu updated HADOOP-17552: -- Summary: Change ipc.client.rpc-timeout.ms from 0 to 12 by default to avoid potential hang (was:

[jira] [Work logged] (HADOOP-17552) The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken usage of the rpcTimeout configuratio

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?focusedWorklogId=560297=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560297 ] ASF GitHub Bot logged work on HADOOP-17552: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on pull request #2727: HADOOP-17552. The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken

2021-03-02 Thread GitBox
ferhui commented on pull request #2727: URL: https://github.com/apache/hadoop/pull/2727#issuecomment-789424565 > SocketTimeoutException How about "Change ipc.client.rpc-timeout.ms from 0 to 12 by default to avoid potential hang"

[jira] [Work logged] (HADOOP-17552) The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken usage of the rpcTimeout configuratio

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?focusedWorklogId=560286=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560286 ] ASF GitHub Bot logged work on HADOOP-17552: --- Author: ASF GitHub Bot

[GitHub] [hadoop] functioner commented on pull request #2727: HADOOP-17552. The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mista

2021-03-02 Thread GitBox
functioner commented on pull request #2727: URL: https://github.com/apache/hadoop/pull/2727#issuecomment-789404596 > @functioner Thanks for comments. > You can change the title here and jira issue. > And i think 60s is more reasonable in production environment. you can push commit

[jira] [Work logged] (HADOOP-17552) The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken usage of the rpcTimeout configuratio

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?focusedWorklogId=560278=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560278 ] ASF GitHub Bot logged work on HADOOP-17552: --- Author: ASF GitHub Bot

[GitHub] [hadoop] functioner commented on pull request #2727: HADOOP-17552. The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mista

2021-03-02 Thread GitBox
functioner commented on pull request #2727: URL: https://github.com/apache/hadoop/pull/2727#issuecomment-789398719 > Considering it affects failover time (for NM to reconnect to new active RM) of [YARN-2578](https://issues.apache.org/jira/browse/YARN-2587), 60 or 120 sounds reasonable.

[jira] [Updated] (HADOOP-17560) Fix some spelling errors

2021-03-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17560: --- Description: Fix some spelling errors (invaild -> invalid) (was: Fix some spelling

[jira] [Work logged] (HADOOP-17552) The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken usage of the rpcTimeout configuratio

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?focusedWorklogId=560269=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560269 ] ASF GitHub Bot logged work on HADOOP-17552: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims commented on pull request #2727: HADOOP-17552. The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistak

2021-03-02 Thread GitBox
iwasakims commented on pull request #2727: URL: https://github.com/apache/hadoop/pull/2727#issuecomment-789384093 Considering it affects failover time (for NM to reconnect to new active RM) of [YARN-2578](https://issues.apache.org/jira/browse/YARN-2587), 60 or 120 sounds reasonable.

[jira] [Assigned] (HADOOP-17560) Fix some spelling errors

2021-03-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-17560: -- Assignee: jiaguodong > Fix some spelling errors > - > >

[jira] [Work logged] (HADOOP-17560) Fix some spelling errors

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17560?focusedWorklogId=560268=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560268 ] ASF GitHub Bot logged work on HADOOP-17560: --- Author: ASF GitHub Bot

[jira] [Resolved] (HADOOP-17560) Fix some spelling errors

2021-03-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved HADOOP-17560. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to

[jira] [Work logged] (HADOOP-17560) Fix some spelling errors

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17560?focusedWorklogId=560267=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560267 ] ASF GitHub Bot logged work on HADOOP-17560: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka commented on pull request #2730: HADOOP-17560. Fix some spelling errors

2021-03-02 Thread GitBox
aajisaka commented on pull request #2730: URL: https://github.com/apache/hadoop/pull/2730#issuecomment-789383317 Thank you @JJiaguodong for your contribution and thank you @Ojasvi-Jalal for your review! This is an automated

[GitHub] [hadoop] aajisaka merged pull request #2730: HADOOP-17560. Fix some spelling errors

2021-03-02 Thread GitBox
aajisaka merged pull request #2730: URL: https://github.com/apache/hadoop/pull/2730 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (HADOOP-17560) Fix some spelling errors

2021-03-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17560: --- Priority: Trivial (was: Major) > Fix some spelling errors > - >

[jira] [Moved] (HADOOP-17560) Fix some spelling errors

2021-03-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka moved HDFS-15866 to HADOOP-17560: --- Key: HADOOP-17560 (was: HDFS-15866) Issue Type: Bug

[jira] [Work logged] (HADOOP-17552) The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken usage of the rpcTimeout configuratio

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?focusedWorklogId=560259=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560259 ] ASF GitHub Bot logged work on HADOOP-17552: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on pull request #2727: HADOOP-17552. The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken

2021-03-02 Thread GitBox
ferhui commented on pull request #2727: URL: https://github.com/apache/hadoop/pull/2727#issuecomment-789375164 @functioner Thanks for comments. You can change the title here and jira issue. And i think 60s is more reasonable in production environment. you can push commit and see CI

[jira] [Work logged] (HADOOP-17552) The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mistaken usage of the rpcTimeout configuratio

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17552?focusedWorklogId=560238=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560238 ] ASF GitHub Bot logged work on HADOOP-17552: --- Author: ASF GitHub Bot

[GitHub] [hadoop] functioner commented on pull request #2727: HADOOP-17552. The read method of hadoop.ipc.Client$Connection$PingInputStream may swallow java.net.SocketTimeoutException due to the mista

2021-03-02 Thread GitBox
functioner commented on pull request #2727: URL: https://github.com/apache/hadoop/pull/2727#issuecomment-789342964 I guess many users may not change the default configuration. If they encounter this endless hang issue, it may take a while for them to figure out what's wrong, even with the

[GitHub] [hadoop] Nargeshdb opened a new pull request #2736: HDFS-15868. Possible Resource Leak in EditLogFileOutputStream

2021-03-02 Thread GitBox
Nargeshdb opened a new pull request #2736: URL: https://github.com/apache/hadoop/pull/2736 This PR fixes the issue mentioned [here](https://issues.apache.org/jira/browse/HDFS-15868). This is an automated message from the

[GitHub] [hadoop] steveloughran commented on pull request #2734: HADOOP-17559. S3guard import OOM.

2021-03-02 Thread GitBox
steveloughran commented on pull request #2734: URL: https://github.com/apache/hadoop/pull/2734#issuecomment-789132670 Stack from the test failure fixed here *as seen in the audit PR*. Shows its not directly related to this, though I had to stop through to make sure ```

[jira] [Work logged] (HADOOP-17559) S3Guard import can OOM on large imports

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17559?focusedWorklogId=560088=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560088 ] ASF GitHub Bot logged work on HADOOP-17559: --- Author: ASF GitHub Bot

[jira] [Commented] (HADOOP-17371) Bump Jetty to the latest version 9.4.35

2021-03-02 Thread Junyang Li (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293884#comment-17293884 ] Junyang Li commented on HADOOP-17371: - Hello! Can I know what the issues are with the newer version

[jira] [Work logged] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?focusedWorklogId=560013=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560013 ] ASF GitHub Bot logged work on HADOOP-11452: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2735: HADOOP-11452 make rename/3 public

2021-03-02 Thread GitBox
steveloughran commented on pull request #2735: URL: https://github.com/apache/hadoop/pull/2735#issuecomment-789011590 Quick review of this, especially the factoring out Good: * unified logic in one place Bad * it's still complex * it's not easy for S3A to optimise

[jira] [Work logged] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?focusedWorklogId=560006=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560006 ] ASF GitHub Bot logged work on HADOOP-11452: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2735: HADOOP-11452 make rename/3 public

2021-03-02 Thread GitBox
steveloughran commented on pull request #2735: URL: https://github.com/apache/hadoop/pull/2735#issuecomment-788992374 ## full commit logs of squashed commits - PR with the previous patches. This is a WiP but ready for some iniital review; lacks tests & spec.

[jira] [Work logged] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?focusedWorklogId=560005=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560005 ] ASF GitHub Bot logged work on HADOOP-11452: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request #2735: HADOOP-11452 make rename/3 public

2021-03-02 Thread GitBox
steveloughran opened a new pull request #2735: URL: https://github.com/apache/hadoop/pull/2735 make rename/3 public. Rollup of #743 commits rebased to trunk This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?focusedWorklogId=560001=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-560001 ] ASF GitHub Bot logged work on HADOOP-11452: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?focusedWorklogId=56=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-56 ] ASF GitHub Bot logged work on HADOOP-11452: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran closed pull request #743: HADOOP-11452 make rename/3 public

2021-03-02 Thread GitBox
steveloughran closed pull request #743: URL: https://github.com/apache/hadoop/pull/743 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] steveloughran commented on pull request #743: HADOOP-11452 make rename/3 public

2021-03-02 Thread GitBox
steveloughran commented on pull request #743: URL: https://github.com/apache/hadoop/pull/743#issuecomment-788988980 closing and creating a new rebased/squashed PR. Still need to look at the comments related to permissions

[jira] [Issue Comment Deleted] (HADOOP-11452) Make FileSystem.rename(path, path, options) public, specified, tested

2021-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11452: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Work logged] (HADOOP-17559) S3Guard import can OOM on large imports

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17559?focusedWorklogId=559997=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559997 ] ASF GitHub Bot logged work on HADOOP-17559: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2734: HADOOP-17559. S3guard import OOM.

2021-03-02 Thread GitBox
steveloughran commented on pull request #2734: URL: https://github.com/apache/hadoop/pull/2734#issuecomment-788977681 tested: s3 london with s3guard. Some failures I'm fixing in the audit patch; only new failure was the intermittent one in ITestCommitOperations which I suspected was a

[jira] [Updated] (HADOOP-17559) S3Guard import can OOM on large imports

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17559: Labels: pull-request-available (was: ) > S3Guard import can OOM on large imports >

[jira] [Work logged] (HADOOP-17559) S3Guard import can OOM on large imports

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17559?focusedWorklogId=559996=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559996 ] ASF GitHub Bot logged work on HADOOP-17559: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request #2734: HADOOP-17559. S3guard import OOM.

2021-03-02 Thread GitBox
steveloughran opened a new pull request #2734: URL: https://github.com/apache/hadoop/pull/2734 Remove all tracking of files from DDB AncestorState; dirs in import tool. Reduces size of the cache to O(dirs). Test change is to reduce brittleness to clock skew on loaded test

[jira] [Commented] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-03-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293756#comment-17293756 ] Ayush Saxena commented on HADOOP-16748: --- Thanx [~aajisaka] for taking that up. Once that is in,

[jira] [Commented] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-03-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293735#comment-17293735 ] Akira Ajisaka commented on HADOOP-16748: Filed YETUS-1102 and created a PR. > Migrate to

[jira] [Work started] (HADOOP-17559) S3Guard import can OOM on large imports

2021-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17559 started by Steve Loughran. --- > S3Guard import can OOM on large imports >

[jira] [Commented] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-03-02 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293711#comment-17293711 ] Akira Ajisaka commented on HADOOP-16748: Since there are no option to add a comment in GitHub

[jira] [Work logged] (HADOOP-17527) ABFS: Fix boundary conditions in InputStream seek and skip

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17527?focusedWorklogId=559911=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559911 ] ASF GitHub Bot logged work on HADOOP-17527: --- Author: ASF GitHub Bot

[GitHub] [hadoop] Ojasvi-Jalal commented on a change in pull request #2698: HADOOP-17527. ABFS: Fix boundary conditions in InputStream seek and skip

2021-03-02 Thread GitBox
Ojasvi-Jalal commented on a change in pull request #2698: URL: https://github.com/apache/hadoop/pull/2698#discussion_r585426598 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -542,7 +542,7 @@ public

[jira] [Work logged] (HADOOP-17548) ABFS: Config for Mkdir overwrite

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17548?focusedWorklogId=559900=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559900 ] ASF GitHub Bot logged work on HADOOP-17548: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snvijaya commented on a change in pull request #2729: HADOOP-17548. ABFS: Config for Mkdir overwrite

2021-03-02 Thread GitBox
snvijaya commented on a change in pull request #2729: URL: https://github.com/apache/hadoop/pull/2729#discussion_r585454114 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -302,7 +302,16 @@ public

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=559896=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559896 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-13551) Collect AwsSdkMetrics in S3A FileSystem IOStatistics

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13551?focusedWorklogId=559894=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559894 ] ASF GitHub Bot logged work on HADOOP-13551: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran closed pull request #2687: HADOOP-13551. Wire up AWS SDK metrics to IOStatistics

2021-03-02 Thread GitBox
steveloughran closed pull request #2687: URL: https://github.com/apache/hadoop/pull/2687 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] steveloughran commented on pull request #2687: HADOOP-13551. Wire up AWS SDK metrics to IOStatistics

2021-03-02 Thread GitBox
steveloughran commented on pull request #2687: URL: https://github.com/apache/hadoop/pull/2687#issuecomment-788803037 #2675 contains the fix for this; I've lifted the test from here. Closing This is an automated message from

[jira] [Work logged] (HADOOP-17511) Add an Audit plugin point for S3A auditing/context

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17511?focusedWorklogId=559887=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559887 ] ASF GitHub Bot logged work on HADOOP-17511: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2675: HADOOP-17511. Add audit/telemetry logging to S3A connector

2021-03-02 Thread GitBox
steveloughran commented on pull request #2675: URL: https://github.com/apache/hadoop/pull/2675#issuecomment-788804721 Based on an afternoon looking at client-side logs of a single hive process 1. add the thread name as part of the referrer, so we can filter on "all S3 calls made by

[jira] [Updated] (HADOOP-17548) ABFS: Config for Mkdir overwrite

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17548: Labels: pull-request-available (was: ) > ABFS: Config for Mkdir overwrite >

[jira] [Work logged] (HADOOP-17548) ABFS: Config for Mkdir overwrite

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17548?focusedWorklogId=559874=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559874 ] ASF GitHub Bot logged work on HADOOP-17548: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #2729: HADOOP-17548. ABFS: Toggle Store Mkdirs request overwrite parameter

2021-03-02 Thread GitBox
sumangala-patki commented on a change in pull request #2729: URL: https://github.com/apache/hadoop/pull/2729#discussion_r585498405 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -302,7 +302,16 @@ public

[jira] [Commented] (HADOOP-16748) Migrate to Python 3 and upgrade Yetus to 0.13.0

2021-03-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293605#comment-17293605 ] Ayush Saxena commented on HADOOP-16748: --- Hey [~aajisaka] Seems this yetus upgrade has changed

[jira] [Created] (HADOOP-17559) S3Guard import can OOM on large imports

2021-03-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17559: --- Summary: S3Guard import can OOM on large imports Key: HADOOP-17559 URL: https://issues.apache.org/jira/browse/HADOOP-17559 Project: Hadoop Common

[jira] [Updated] (HADOOP-17556) Understanding Netty versions and upgrading them (three findings in Hadoop we could upgrade?)

2021-03-02 Thread Adam Roberts (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated HADOOP-17556: -- Description: Hi everyone, have been raising a few JIRAs recently related to dependencies in

[jira] [Updated] (HADOOP-17556) Understanding Netty versions and upgrading them (three findings in Hadoop we could upgrade?)

2021-03-02 Thread Adam Roberts (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated HADOOP-17556: -- Description: Hi everyone, have been raising a few JIRAs recently related to dependencies in

[GitHub] [hadoop] aajisaka opened a new pull request #2733: YARN-10662. [JDK 11] TestTimelineReaderWebServicesHBaseStorage fails

2021-03-02 Thread GitBox
aajisaka opened a new pull request #2733: URL: https://github.com/apache/hadoop/pull/2733 JIRA: https://issues.apache.org/jira/browse/YARN-10662 - Upgrade jmockit to the latest version. - Set argLine (reference: https://jmockit.github.io/tutorial/Introduction.html#runningTests)

[jira] [Work logged] (HADOOP-17531) DistCp: Reduce memory usage on copying huge directories

2021-03-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17531?focusedWorklogId=559854=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-559854 ] ASF GitHub Bot logged work on HADOOP-17531: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on a change in pull request #2732: HADOOP-17531. DistCp: Reduce memory usage on copying huge directories.

2021-03-02 Thread GitBox
ayushtkn commented on a change in pull request #2732: URL: https://github.com/apache/hadoop/pull/2732#discussion_r585357165 ## File path: hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm ## @@ -362,6 +362,7 @@ Command Line Options | `-copybuffersize ` | Size of the