[jira] [Created] (HADOOP-18349) Support EKS for IAM service account

2022-07-19 Thread vikas koppineedi (Jira)
vikas koppineedi created HADOOP-18349: - Summary: Support EKS for IAM service account Key: HADOOP-18349 URL: https://issues.apache.org/jira/browse/HADOOP-18349 Project: Hadoop Common Issue

[GitHub] [hadoop] slfan1989 opened a new pull request, #4594: YARN-6572. Refactoring Router services to use common util classes for pipeline creations.

2022-07-19 Thread GitBox
slfan1989 opened a new pull request, #4594: URL: https://github.com/apache/hadoop/pull/4594 Jira : YARN-6572. Refactoring Router services to use common util classes for pipeline creations. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792993&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792993 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4585: URL: https://github.com/apache/hadoop/pull/4585#issuecomment-1189722684 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18079) Upgrade Netty to 4.1.77.Final

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?focusedWorklogId=792962&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792962 ] ASF GitHub Bot logged work on HADOOP-18079: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4593: HADOOP-18079. Upgrade Netty to 4.1.77. (#3977)

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4593: URL: https://github.com/apache/hadoop/pull/4593#issuecomment-1189656061 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18079) Upgrade Netty to 4.1.77.Final

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?focusedWorklogId=792961&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792961 ] ASF GitHub Bot logged work on HADOOP-18079: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4592: HADOOP-18079. Upgrade Netty to 4.1.77. (#3977)

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4592: URL: https://github.com/apache/hadoop/pull/4592#issuecomment-1189655458 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792954&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792954 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792953&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792953 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[GitHub] [hadoop] goiri commented on a diff in pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
goiri commented on code in PR #4585: URL: https://github.com/apache/hadoop/pull/4585#discussion_r925033436 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecPool.java: ## @@ -17,20 +17,22 @@ */ package org.apache.hadoop.io.compress;

[GitHub] [hadoop] goiri commented on a diff in pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
goiri commented on code in PR #4585: URL: https://github.com/apache/hadoop/pull/4585#discussion_r925033253 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecPool.java: ## @@ -189,4 +198,54 @@ public void testDecompressorNotReturnSameInst

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792946&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792946 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792947&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792947 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[GitHub] [hadoop] kevins-29 commented on a diff in pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
kevins-29 commented on code in PR #4585: URL: https://github.com/apache/hadoop/pull/4585#discussion_r925006321 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecPool.java: ## @@ -189,4 +198,54 @@ public void testDecompressorNotReturnSame

[GitHub] [hadoop] kevins-29 commented on a diff in pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
kevins-29 commented on code in PR #4585: URL: https://github.com/apache/hadoop/pull/4585#discussion_r925006154 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecPool.java: ## @@ -189,4 +198,54 @@ public void testDecompressorNotReturnSame

[jira] [Work logged] (HADOOP-18079) Upgrade Netty to 4.1.77.Final

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?focusedWorklogId=792945&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792945 ] ASF GitHub Bot logged work on HADOOP-18079: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang opened a new pull request, #4593: HADOOP-18079. Upgrade Netty to 4.1.77. (#3977)

2022-07-19 Thread GitBox
jojochuang opened a new pull request, #4593: URL: https://github.com/apache/hadoop/pull/4593 Upgrade netty to address CVE-2019-20444, CVE-2019-20445 CVE-2022-24823 Contributed by Wei-Chiu Chuang cherrypicked from #3977 (cherry picked from commit a55ace7bc0c173f60

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792927&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792927 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[GitHub] [hadoop] goiri commented on a diff in pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
goiri commented on code in PR #4585: URL: https://github.com/apache/hadoop/pull/4585#discussion_r924977086 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecPool.java: ## @@ -189,4 +198,54 @@ public void testDecompressorNotReturnSameInst

[GitHub] [hadoop] hadoop-yetus commented on pull request #4576: HDFS-16667. Use malloc for buffer allocation in uriparser2

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4576: URL: https://github.com/apache/hadoop/pull/4576#issuecomment-1189524760 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18333) hadoop-client-runtime impact by CVE-2022-2047 due to shaded jetty

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18333?focusedWorklogId=792898&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792898 ] ASF GitHub Bot logged work on HADOOP-18333: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4553: HADOOP-18333.Upgrade jetty version to 9.4.48.v20220622

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4553: URL: https://github.com/apache/hadoop/pull/4553#issuecomment-1189511807 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18330) S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18330?focusedWorklogId=792897&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792897 ] ASF GitHub Bot logged work on HADOOP-18330: --- Author: ASF GitHub B

[GitHub] [hadoop] ashutoshpant commented on pull request #4572: HADOOP-18330-S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread GitBox
ashutoshpant commented on PR #4572: URL: https://github.com/apache/hadoop/pull/4572#issuecomment-1189511230 > ok, which s3 endpoint did you run the tests against? Just ran the tests against us-east-1 -- This is an automated message from the Apache Git Service. To respond to the mess

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792894&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792894 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[GitHub] [hadoop] sunchao commented on pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
sunchao commented on PR #4585: URL: https://github.com/apache/hadoop/pull/4585#issuecomment-1189504924 Thanks @kevins-29 , the fix looks good to me. However, is this addressing the issue mentioned in HADOOP-12007? my understanding is that the issue there is related to `CompressorStream` ove

[jira] [Work logged] (HADOOP-18079) Upgrade Netty to 4.1.77.Final

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?focusedWorklogId=792893&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792893 ] ASF GitHub Bot logged work on HADOOP-18079: --- Author: ASF GitHub B

[GitHub] [hadoop] jojochuang opened a new pull request, #4592: HADOOP-18079. Upgrade Netty to 4.1.77. (#3977)

2022-07-19 Thread GitBox
jojochuang opened a new pull request, #4592: URL: https://github.com/apache/hadoop/pull/4592 Upgrade netty to address CVE-2019-20444, CVE-2019-20445 CVE-2022-24823 Contributed by Wei-Chiu Chuang cherrypicked from #3977 (cherry picked from commit a55ace7bc0c173f60

[jira] [Work logged] (HADOOP-18330) S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18330?focusedWorklogId=792889&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792889 ] ASF GitHub Bot logged work on HADOOP-18330: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #4572: HADOOP-18330-S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread GitBox
steveloughran commented on PR #4572: URL: https://github.com/apache/hadoop/pull/4572#issuecomment-1189489423 ok, which s3 endpoint did you run the tests against? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Work logged] (HADOOP-17461) Add thread-level IOStatistics Context

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?focusedWorklogId=792888&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792888 ] ASF GitHub Bot logged work on HADOOP-17461: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a diff in pull request #4352: HADOOP-17461. Thread-level IOStatistics in S3A

2022-07-19 Thread GitBox
steveloughran commented on code in PR #4352: URL: https://github.com/apache/hadoop/pull/4352#discussion_r924896943 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/statistics/impl/IOStatisticsContext.java: ## @@ -31,34 +31,34 @@ * * The {@link #snap

[jira] [Work logged] (HADOOP-17461) Add thread-level IOStatistics Context

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?focusedWorklogId=792887&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792887 ] ASF GitHub Bot logged work on HADOOP-17461: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #4352: HADOOP-17461. Thread-level IOStatistics in S3A

2022-07-19 Thread GitBox
steveloughran commented on PR #4352: URL: https://github.com/apache/hadoop/pull/4352#issuecomment-1189482342 I now have a branch of spark set up to use this, albeit not production ready https://github.com/steveloughran/hadoop/tree/s3/HADOOP-17461-iostatisticsContext * TaskM

[jira] [Work logged] (HADOOP-18301) Upgrade commons-io to 2.11.0

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18301?focusedWorklogId=792885&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792885 ] ASF GitHub Bot logged work on HADOOP-18301: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4455: HADOOP-18301.Upgrade commons-io to 2.11.0

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4455: URL: https://github.com/apache/hadoop/pull/4455#issuecomment-1189468822 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18347) Restrict vectoredIO threadpool to reduce memory pressure

2022-07-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568690#comment-17568690 ] Steve Loughran commented on HADOOP-18347: - makes snese. that bounded pool is fa

[GitHub] [hadoop] goiri commented on a diff in pull request #4531: HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets

2022-07-19 Thread GitBox
goiri commented on code in PR #4531: URL: https://github.com/apache/hadoop/pull/4531#discussion_r924855528 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/ConnectionPool.java: ## @@ -210,24 +217,22 @@ public AtomicInteger getC

[jira] [Commented] (HADOOP-18340) deleteOnExit does not work with S3AFileSystem

2022-07-19 Thread Huaxiang Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568655#comment-17568655 ] Huaxiang Sun commented on HADOOP-18340: --- Step back, I think yours way is a better

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792831&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792831 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[GitHub] [hadoop] dbtsai commented on pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
dbtsai commented on PR #4585: URL: https://github.com/apache/hadoop/pull/4585#issuecomment-1189355811 cc @sunchao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [hadoop] hadoop-yetus commented on pull request #4576: HDFS-16667. Use malloc for buffer allocation in uriparser2

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4576: URL: https://github.com/apache/hadoop/pull/4576#issuecomment-1189346335 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Comment Edited] (HADOOP-18340) deleteOnExit does not work with S3AFileSystem

2022-07-19 Thread Huaxiang Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568637#comment-17568637 ] Huaxiang Sun edited comment on HADOOP-18340 at 7/19/22 5:05 PM: -

[jira] [Commented] (HADOOP-18273) Support S3 access point alias

2022-07-19 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568641#comment-17568641 ] Daniel Carl Jones commented on HADOOP-18273: Sorry for the late reply, [~ke

[jira] [Commented] (HADOOP-18340) deleteOnExit does not work with S3AFileSystem

2022-07-19 Thread Huaxiang Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568637#comment-17568637 ] Huaxiang Sun commented on HADOOP-18340: --- _"what if two threads call close()"_ (So

[jira] [Work logged] (HADOOP-18190) s3a prefetching streams to collect iostats on prefetching operations

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18190?focusedWorklogId=792796&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792796 ] ASF GitHub Bot logged work on HADOOP-18190: --- Author: ASF GitHub B

[GitHub] [hadoop] ahmarsuhail commented on pull request #4458: HADOOP-18190. Adds iostats for prefetching

2022-07-19 Thread GitBox
ahmarsuhail commented on PR #4458: URL: https://github.com/apache/hadoop/pull/4458#issuecomment-1189301358 @steveloughran by > can you split success/failure logging of the invocation and duration of calls do you mean to add in stats for number of failed prefetch ops & duration

[jira] [Work logged] (HADOOP-18190) s3a prefetching streams to collect iostats on prefetching operations

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18190?focusedWorklogId=792794&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792794 ] ASF GitHub Bot logged work on HADOOP-18190: --- Author: ASF GitHub B

[GitHub] [hadoop] ahmarsuhail commented on a diff in pull request #4458: HADOOP-18190. Adds iostats for prefetching

2022-07-19 Thread GitBox
ahmarsuhail commented on code in PR #4458: URL: https://github.com/apache/hadoop/pull/4458#discussion_r924708222 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/common/CachingBlockManager.java: ## @@ -330,6 +341,10 @@ private void readBlock(BufferData data, boolean

[GitHub] [hadoop] GauthamBanasandra merged pull request #4573: HDFS-16665. Fix duplicate sources for HDFS test

2022-07-19 Thread GitBox
GauthamBanasandra merged PR #4573: URL: https://github.com/apache/hadoop/pull/4573 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubsc

[GitHub] [hadoop] GauthamBanasandra merged pull request #4571: HDFS-16464. Create only libhdfspp static libraries for Windows

2022-07-19 Thread GitBox
GauthamBanasandra merged PR #4571: URL: https://github.com/apache/hadoop/pull/4571 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubsc

[GitHub] [hadoop] hadoop-yetus commented on pull request #4591: update cloud 123

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4591: URL: https://github.com/apache/hadoop/pull/4591#issuecomment-1189242595 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18330) S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18330?focusedWorklogId=792756&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792756 ] ASF GitHub Bot logged work on HADOOP-18330: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4572: HADOOP-18330-S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4572: URL: https://github.com/apache/hadoop/pull/4572#issuecomment-1189191525 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4531: HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4531: URL: https://github.com/apache/hadoop/pull/4531#issuecomment-1189183336 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4587: YARN-11200 Backport numa to branch-2.10

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4587: URL: https://github.com/apache/hadoop/pull/4587#issuecomment-1189169863 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] raheeltariq opened a new pull request, #4591: update cloud 123

2022-07-19 Thread GitBox
raheeltariq opened a new pull request, #4591: URL: https://github.com/apache/hadoop/pull/4591 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HAD

[jira] [Work logged] (HADOOP-12007) GzipCodec native CodecPool leaks memory

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12007?focusedWorklogId=792735&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792735 ] ASF GitHub Bot logged work on HADOOP-12007: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4585: HADOOP-12007. GzipCodec native CodecPool leaks memory

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4585: URL: https://github.com/apache/hadoop/pull/4585#issuecomment-1189140977 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] ZanderXu commented on a diff in pull request #4531: HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets

2022-07-19 Thread GitBox
ZanderXu commented on code in PR #4531: URL: https://github.com/apache/hadoop/pull/4531#discussion_r924473977 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/FederationConnectionId.java: ## @@ -0,0 +1,61 @@ +/** + * Licensed t

[GitHub] [hadoop] hadoop-yetus commented on pull request #4587: YARN-11200 Backport numa to branch-2.10

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4587: URL: https://github.com/apache/hadoop/pull/4587#issuecomment-1189023126 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4576: HDFS-16667. Use malloc for buffer allocation in uriparser2

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4576: URL: https://github.com/apache/hadoop/pull/4576#issuecomment-1189018718 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] Hexiaoqiao commented on a diff in pull request #4531: HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets

2022-07-19 Thread GitBox
Hexiaoqiao commented on code in PR #4531: URL: https://github.com/apache/hadoop/pull/4531#discussion_r924425480 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/FederationConnectionId.java: ## @@ -0,0 +1,61 @@ +/** + * Licensed

[GitHub] [hadoop] yuanboliu commented on pull request #4558: HDFS-16657 Changing pool-level lock to volume-level lock for invalida…

2022-07-19 Thread GitBox
yuanboliu commented on PR #4558: URL: https://github.com/apache/hadoop/pull/4558#issuecomment-1188963756 @Hexiaoqiao 1. The default max delation rate is 2 blocks per minute with 3s heartbeat, so practically memory wouldn't be the problem. 2. -- hold write lock too long this m

[jira] [Assigned] (HADOOP-18344) AWS SDK update to 1.12.262 to address jackson CVE-2018-7489

2022-07-19 Thread Daniel Carl Jones (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Carl Jones reassigned HADOOP-18344: -- Assignee: Ahmar Suhail > AWS SDK update to 1.12.262 to address jackson CVE-

[GitHub] [hadoop] Neilxzn opened a new pull request, #4590: add swapBlocklistForeditLog

2022-07-19 Thread GitBox
Neilxzn opened a new pull request, #4590: URL: https://github.com/apache/hadoop/pull/4590 ### Description of PR https://issues.apache.org/jira/browse/HDFS-15006 I am Interested in this jira, we want solution in our cluster. Try to complete it. ### How was this patch test

[jira] [Work logged] (HADOOP-18348) Echo java process's parent pid to the pid file intermediate state

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18348?focusedWorklogId=792550&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792550 ] ASF GitHub Bot logged work on HADOOP-18348: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17461) Add thread-level IOStatistics Context

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?focusedWorklogId=792549&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792549 ] ASF GitHub Bot logged work on HADOOP-17461: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4589: HADOOP-18348. Change hadoop_start_daemon function $ to BASHPID

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4589: URL: https://github.com/apache/hadoop/pull/4589#issuecomment-1188845501 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4352: HADOOP-17461. Thread-level IOStatistics in S3A

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4352: URL: https://github.com/apache/hadoop/pull/4352#issuecomment-1188844927 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.9.2

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=792547&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792547 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-13386) Upgrade Avro to 1.9.2

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?focusedWorklogId=792546&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792546 ] ASF GitHub Bot logged work on HADOOP-13386: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran closed pull request #4579: HADOOP-13386. Upgrade Avro to 1.9.2 (#3990)

2022-07-19 Thread GitBox
steveloughran closed pull request #4579: HADOOP-13386. Upgrade Avro to 1.9.2 (#3990) URL: https://github.com/apache/hadoop/pull/4579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [hadoop] steveloughran commented on pull request #4579: HADOOP-13386. Upgrade Avro to 1.9.2 (#3990)

2022-07-19 Thread GitBox
steveloughran commented on PR #4579: URL: https://github.com/apache/hadoop/pull/4579#issuecomment-1188834271 closing as too traumatic -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HADOOP-18340) deleteOnExit does not work with S3AFileSystem

2022-07-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17568444#comment-17568444 ] Steve Loughran commented on HADOOP-18340: - bq. , processDeleteOnExit before isC

[jira] [Work logged] (HADOOP-18330) S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18330?focusedWorklogId=792542&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792542 ] ASF GitHub Bot logged work on HADOOP-18330: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #4572: HADOOP-18330-S3AFileSystem removes Path when calling createS3Client

2022-07-19 Thread GitBox
steveloughran commented on PR #4572: URL: https://github.com/apache/hadoop/pull/4572#issuecomment-1188824862 get yetus to stop failing the build, then run the integration tests against an s3 bucket, then i will review -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] pranavsaxena-microsoft closed pull request #4588: Advanced PR for https://github.com/apache/hadoop/pull/3440

2022-07-19 Thread GitBox
pranavsaxena-microsoft closed pull request #4588: Advanced PR for https://github.com/apache/hadoop/pull/3440 URL: https://github.com/apache/hadoop/pull/4588 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] ayushtkn commented on pull request #4588: Advanced PR for https://github.com/apache/hadoop/pull/3440

2022-07-19 Thread GitBox
ayushtkn commented on PR #4588: URL: https://github.com/apache/hadoop/pull/4588#issuecomment-1188813299 the title of the PR is weird, isn't very conclusive what's happening. Please set it correctly according to : https://cwiki.apache.org/confluence/display/hadoop/how+to+contribute#HowToC

[jira] [Work logged] (HADOOP-18343) upgrade to jetty 9.4.48 due to CVE

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18343?focusedWorklogId=792534&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792534 ] ASF GitHub Bot logged work on HADOOP-18343: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4582: HADOOP-18343: upgrade jetty

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4582: URL: https://github.com/apache/hadoop/pull/4582#issuecomment-1188802285 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4576: HDFS-16667. Use malloc for buffer allocation in uriparser2

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4576: URL: https://github.com/apache/hadoop/pull/4576#issuecomment-1188797715 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18301) Upgrade commons-io to 2.11.0

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18301?focusedWorklogId=792524&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792524 ] ASF GitHub Bot logged work on HADOOP-18301: --- Author: ASF GitHub B

[GitHub] [hadoop] ashutoshcipher commented on pull request #4455: HADOOP-18301.Upgrade commons-io to 2.11.0

2022-07-19 Thread GitBox
ashutoshcipher commented on PR #4455: URL: https://github.com/apache/hadoop/pull/4455#issuecomment-1188795186 @aajisaka - Sorry I missed addressing you comment earlier. In my latest commit, I have addressed you comment. Thanks. -- This is an automated message from the Apache Git Service.

[GitHub] [hadoop] hadoop-yetus commented on pull request #4588: Advanced PR for https://github.com/apache/hadoop/pull/3440

2022-07-19 Thread GitBox
hadoop-yetus commented on PR #4588: URL: https://github.com/apache/hadoop/pull/4588#issuecomment-1188773154 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-18348) Echo java process's parent pid to the pid file intermediate state

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18348?focusedWorklogId=792496&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-792496 ] ASF GitHub Bot logged work on HADOOP-18348: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-18348) Echo java process's parent pid to the pid file intermediate state

2022-07-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18348: Labels: pull-request-available (was: ) > Echo java process's parent pid to the pid file

[GitHub] [hadoop] Pr-Jiang opened a new pull request, #4589: HADOOP-18348. Change hadoop_start_daemon function $ to BASHPID

2022-07-19 Thread GitBox
Pr-Jiang opened a new pull request, #4589: URL: https://github.com/apache/hadoop/pull/4589 ### Description of PR https://issues.apache.org/jira/browse/HADOOP-18348 ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts w

[jira] [Updated] (HADOOP-18348) Echo java process's parent pid to the pid file intermediate state

2022-07-19 Thread jiangrui (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangrui updated HADOOP-18348: -- Summary: Echo java process's parent pid to the pid file intermediate state (was: echo java process's

[jira] [Created] (HADOOP-18348) echo java process's parent pid to the pid file intermediate state

2022-07-19 Thread jiangrui (Jira)
jiangrui created HADOOP-18348: - Summary: echo java process's parent pid to the pid file intermediate state Key: HADOOP-18348 URL: https://issues.apache.org/jira/browse/HADOOP-18348 Project: Hadoop Common

[GitHub] [hadoop] aajisaka commented on pull request #4459: YARN-11186: Upgrade frontend toolchains used by YARN application catalog webapp

2022-07-19 Thread GitBox
aajisaka commented on PR #4459: URL: https://github.com/apache/hadoop/pull/4459#issuecomment-1188702847 The upgrade affects YARN Web UI v2 as well. Now I don't think the Web UI v2 supports Node v16. cc: @iwasakims Probably you need to overwrite the version in the yarn application catalog