[GitHub] [hadoop] slfan1989 commented on pull request #4457: HADOOP-18302. Remove WhiteBox in hadoop-common module.

2022-08-31 Thread GitBox
slfan1989 commented on PR #4457: URL: https://github.com/apache/hadoop/pull/4457#issuecomment-1232569102 @aajisaka Can you help review this pr? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[jira] [Commented] (HADOOP-18302) Remove WhiteBox in hadoop-common module.

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598222#comment-17598222 ] ASF GitHub Bot commented on HADOOP-18302: - slfan1989 commented on PR #4457: URL

[GitHub] [hadoop] hadoop-yetus commented on pull request #4836: YARN-11289. [Federation] Improve NM FederationInterceptor removeAppFromRegistry.

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4836: URL: https://github.com/apache/hadoop/pull/4836#issuecomment-1232576027 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] pingguoCooler opened a new pull request, #4837: Preparing for 2.10 upgrade development

2022-08-31 Thread GitBox
pingguoCooler opened a new pull request, #4837: URL: https://github.com/apache/hadoop/pull/4837 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'H

[GitHub] [hadoop] hadoop-yetus commented on pull request #4836: YARN-11289. [Federation] Improve NM FederationInterceptor removeAppFromRegistry.

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4836: URL: https://github.com/apache/hadoop/pull/4836#issuecomment-1232584031 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4837: Preparing for 2.10 upgrade development

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4837: URL: https://github.com/apache/hadoop/pull/4837#issuecomment-1232589298 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4835: HDFS-16740. Mini cluster test flakiness

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4835: URL: https://github.com/apache/hadoop/pull/4835#issuecomment-1232615893 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Created] (HADOOP-18433) Fix main thread name.

2022-08-31 Thread zhengchenyu (Jira)
zhengchenyu created HADOOP-18433: Summary: Fix main thread name. Key: HADOOP-18433 URL: https://issues.apache.org/jira/browse/HADOOP-18433 Project: Hadoop Common Issue Type: Improvement

[GitHub] [hadoop] zhengchenyu opened a new pull request, #4838: HADOOP-18433. Fix main thread name.

2022-08-31 Thread GitBox
zhengchenyu opened a new pull request, #4838: URL: https://github.com/apache/hadoop/pull/4838 https://issues.apache.org/jira/browse/HADOOP-18433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[jira] [Commented] (HADOOP-18433) Fix main thread name.

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598265#comment-17598265 ] ASF GitHub Bot commented on HADOOP-18433: - zhengchenyu opened a new pull reques

[jira] [Updated] (HADOOP-18433) Fix main thread name.

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18433: Labels: pull-request-available (was: ) > Fix main thread name. > - >

[GitHub] [hadoop] steveloughran commented on pull request #761: HADOOP-13386 Upgrade avro version in Hadoop

2022-08-31 Thread GitBox
steveloughran commented on PR #761: URL: https://github.com/apache/hadoop/pull/761#issuecomment-1232726858 > If not can you please prioritize on updating the version to 1.11.0? We are using hadoop-common in our project and getting flagged for dependency on Avro version 1.7.7 this is

[jira] [Commented] (HADOOP-13386) Upgrade Avro to 1.9.2

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598291#comment-17598291 ] ASF GitHub Bot commented on HADOOP-13386: - steveloughran commented on PR #761:

[GitHub] [hadoop] steveloughran commented on pull request #4766: HADOOP-18410. S3AInputStream.unbuffer() not releasing http connections

2022-08-31 Thread GitBox
steveloughran commented on PR #4766: URL: https://github.com/apache/hadoop/pull/4766#issuecomment-1232730741 ok, i'm merging this; mukund's vote, mehakmeets comments and yetus are all happy -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598292#comment-17598292 ] ASF GitHub Bot commented on HADOOP-18410: - steveloughran commented on PR #4766:

[GitHub] [hadoop] steveloughran merged pull request #4766: HADOOP-18410. S3AInputStream.unbuffer() not releasing http connections

2022-08-31 Thread GitBox
steveloughran merged PR #4766: URL: https://github.com/apache/hadoop/pull/4766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598304#comment-17598304 ] ASF GitHub Bot commented on HADOOP-18410: - steveloughran merged PR #4766: URL:

[jira] [Updated] (HADOOP-16202) Enhance openFile() for better read performance against object stores

2022-08-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16202: Description: The {{openFile()}} builder API lets us add new options when reading a file

[GitHub] [hadoop] steveloughran opened a new pull request, #4839: HADOOP-18410. S3AInputStream.unbuffer() does not release http connections (#4766)

2022-08-31 Thread GitBox
steveloughran opened a new pull request, #4839: URL: https://github.com/apache/hadoop/pull/4839 #4766 cherrypicked to branch-3.3 HADOOP-16202 "Enhance openFile()" added asynchronous draining of the remaining bytes of an S3 HTTP input stream for those operations (u

[GitHub] [hadoop] steveloughran commented on pull request #4839: HADOOP-18410. S3AInputStream.unbuffer() does not release http connections (#4766)

2022-08-31 Thread GitBox
steveloughran commented on PR #4839: URL: https://github.com/apache/hadoop/pull/4839#issuecomment-1232759523 full itests in progress; will merge unless yetus vetoes it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598309#comment-17598309 ] ASF GitHub Bot commented on HADOOP-18410: - steveloughran opened a new pull requ

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598311#comment-17598311 ] ASF GitHub Bot commented on HADOOP-18410: - steveloughran commented on PR #4839:

[GitHub] [hadoop] ZanderXu commented on pull request #4660: HDFS-16703. Enable RPC Timeout for some protocols of NameNode.

2022-08-31 Thread GitBox
ZanderXu commented on PR #4660: URL: https://github.com/apache/hadoop/pull/4660#issuecomment-1232760518 @slfan1989 Sir, can help take a look about this PR? It's helpful for hadoop admin. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] ZanderXu commented on pull request #4813: HDFS-16748. DFSClient should uniquely identify writing files by namespace id and iNodeId via RBF

2022-08-31 Thread GitBox
ZanderXu commented on PR #4813: URL: https://github.com/apache/hadoop/pull/4813#issuecomment-1232764467 @goiri Master, can help review this patch? After using RBF, this logic has bugs and needs to be fixed. -- This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [hadoop] ZanderXu opened a new pull request, #4840: HDFS-16754. UnderConstruct file with completed but missed block should be able to recover lease

2022-08-31 Thread GitBox
ZanderXu opened a new pull request, #4840: URL: https://github.com/apache/hadoop/pull/4840 ### Description of PR During looking into the logic of RecoverLease, I guess there is a bug: ``` int nrCompleteBlocks; BlockInfo curBlock = null; for(nrCompleteBlocks = 0; nrCompleteBlock

[GitHub] [hadoop] steveloughran commented on pull request #4839: HADOOP-18410. S3AInputStream.unbuffer() does not release http connections (#4766)

2022-08-31 Thread GitBox
steveloughran commented on PR #4839: URL: https://github.com/apache/hadoop/pull/4839#issuecomment-1232864415 tests s3 london at scale; buffer underflow at the usual transient location ``` [INFO] [ERROR] Failures: [ERROR] ITestS3AContractUnbuffer>AbstractContractUnbufferTest.t

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598348#comment-17598348 ] ASF GitHub Bot commented on HADOOP-18410: - steveloughran commented on PR #4839:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4839: HADOOP-18410. S3AInputStream.unbuffer() does not release http connections (#4766)

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4839: URL: https://github.com/apache/hadoop/pull/4839#issuecomment-1232881103 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598353#comment-17598353 ] ASF GitHub Bot commented on HADOOP-18410: - hadoop-yetus commented on PR #4839:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4838: HADOOP-18433. Fix main thread name.

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4838: URL: https://github.com/apache/hadoop/pull/4838#issuecomment-1232891960 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18433) Fix main thread name.

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598356#comment-17598356 ] ASF GitHub Bot commented on HADOOP-18433: - hadoop-yetus commented on PR #4838:

[GitHub] [hadoop] 9uapaw commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
9uapaw commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1232893808 Hi @ashutoshcipher thanks for the contribution! The change looks good to me, however I have one request. We would need some test on cases where the key is longer than 64 bits. Perhaps the d

[GitHub] [hadoop] ashutoshcipher commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
ashutoshcipher commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1232900544 > Hi @ashutoshcipher thanks for the contribution! The change looks good to me, however I have one request. We would need some test on cases where the key is longer than 64 bits. Per

[GitHub] [hadoop] 9uapaw commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
9uapaw commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1232904463 I think the default length 64 is all right in terms of backwards compatibility. My idea was to run the whole test suite with the default value set to 256, just to be sure, that it will not

[GitHub] [hadoop] ashutoshcipher commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
ashutoshcipher commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1232914280 Thanks, Let me make change it 256 to trigger for this value and get results. After that will revert back to 64. -- This is an automated message from the Apache Git Service. To res

[GitHub] [hadoop] ashutoshcipher commented on pull request #4703: YARN-11241. Add uncleaning option for local app log file with log-aggregation enabled

2022-08-31 Thread GitBox
ashutoshcipher commented on PR #4703: URL: https://github.com/apache/hadoop/pull/4703#issuecomment-1232944156 @aajisaka - I have addressed you comments. Can you please review it again. Thank you so much. -- This is an automated message from the Apache Git Service. To respond to the messag

[jira] [Commented] (HADOOP-18159) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-08-31 Thread comet (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598388#comment-17598388 ] comet commented on HADOOP-18159: yes, it works, appreciated [~andre.amorimfons...@gmail

[GitHub] [hadoop] hadoop-yetus commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1233059624 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] slfan1989 commented on pull request #4817: YARN-11273. Federation StateStore: Support storage/retrieval of Reservations With SQL.

2022-08-31 Thread GitBox
slfan1989 commented on PR #4817: URL: https://github.com/apache/hadoop/pull/4817#issuecomment-1233065489 @goiri Please help to review the code, thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hadoop] slfan1989 commented on pull request #4746: YARN-9708. Yarn Federation Router Support DelegationToken.

2022-08-31 Thread GitBox
slfan1989 commented on PR #4746: URL: https://github.com/apache/hadoop/pull/4746#issuecomment-1233066237 @goiri Please help to review the code again, Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] ashutoshcipher commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
ashutoshcipher commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1233081521 @9uapaw - Jenkins build with test runs is complete with default value set to 256. Let me know if its looks good to you, I will make change back to 64 and raise the final PR. -- T

[GitHub] [hadoop] 9uapaw commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
9uapaw commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1233082738 I think it is sufficient, let us revert back to 64 and I will commit this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hadoop] ashutoshcipher commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
ashutoshcipher commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1233087437 > I think it is sufficient, let us revert back to 64 and I will commit this. Thanks for reviewing PR and sharing your comments. Reverted back to 64 in latest commit. -- Thi

[GitHub] [hadoop] 9uapaw commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
9uapaw commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1233097325 Thank you @ashutoshcipher. Committed to trunk, closing this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] 9uapaw closed pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
9uapaw closed pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable URL: https://github.com/apache/hadoop/pull/4816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [hadoop] ashutoshcipher commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
ashutoshcipher commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1233101892 Thanks. Please update the JIRA as well with fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[jira] [Resolved] (HADOOP-18432) hadoop 3.3.4 doesn't have a binary-aarch64 download link

2022-08-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18432. - Resolution: Duplicate > hadoop 3.3.4 doesn't have a binary-aarch64 download link >

[jira] [Commented] (HADOOP-18342) Upgrade to Avro 1.11.1

2022-08-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598470#comment-17598470 ] Steve Loughran commented on HADOOP-18342: - i think we will have to do a shaded

[GitHub] [hadoop] steveloughran commented on pull request #4833: HADOOP-18431. Unit test can fail due to unexpected host resolution

2022-08-31 Thread GitBox
steveloughran commented on PR #4833: URL: https://github.com/apache/hadoop/pull/4833#issuecomment-1233119482 LGTM. as this is an hdfs test, can you move the jira to hdfs, change the pr title, and include the test which is failing in the title too? -- This is an automated message from t

[jira] [Commented] (HADOOP-18431) Unit test can fail due to unexpected host resolution

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598476#comment-17598476 ] ASF GitHub Bot commented on HADOOP-18431: - steveloughran commented on PR #4833:

[GitHub] [hadoop] steveloughran merged pull request #4839: HADOOP-18410. S3AInputStream.unbuffer() does not release http connections (#4766)

2022-08-31 Thread GitBox
steveloughran merged PR #4839: URL: https://github.com/apache/hadoop/pull/4839 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598478#comment-17598478 ] ASF GitHub Bot commented on HADOOP-18410: - steveloughran merged PR #4839: URL:

[GitHub] [hadoop] snmvaughan commented on pull request #4834: HDFS-16753. WebHDFSHandler should reject non-compliant requests

2022-08-31 Thread GitBox
snmvaughan commented on PR #4834: URL: https://github.com/apache/hadoop/pull/4834#issuecomment-1233123294 The original test is `TestWebHdfsFileSystemContract#testResponseCode`, which tests when NamenodeAddressParam is not set: 1. Initiates a request and gets a redirect in the response

[GitHub] [hadoop] mukund-thakur merged pull request #4787: HADOOP-18391. Improvements in VectoredReadUtils#readVectored() for direct buffers

2022-08-31 Thread GitBox
mukund-thakur merged PR #4787: URL: https://github.com/apache/hadoop/pull/4787 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Commented] (HADOOP-18391) Improve VectoredReadUtils

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598487#comment-17598487 ] ASF GitHub Bot commented on HADOOP-18391: - mukund-thakur merged PR #4787: URL:

[jira] [Updated] (HADOOP-18391) Improve VectoredReadUtils#readVectored() for direct buffers

2022-08-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18391: --- Summary: Improve VectoredReadUtils#readVectored() for direct buffers (was: Improve Vectore

[jira] [Created] (HADOOP-18434) Proxy users do not share RPC connections

2022-08-31 Thread Owen O'Malley (Jira)
Owen O'Malley created HADOOP-18434: -- Summary: Proxy users do not share RPC connections Key: HADOOP-18434 URL: https://issues.apache.org/jira/browse/HADOOP-18434 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-18391) Improve VectoredReadUtils#readVectored() for direct buffers

2022-08-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18391: --- Fix Version/s: 3.4.0 > Improve VectoredReadUtils#readVectored() for direct buffers > --

[jira] [Updated] (HADOOP-18407) Improve vectored IO api spec.

2022-08-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18407: --- Fix Version/s: 3.4.0 > Improve vectored IO api spec. > -- > >

[jira] [Resolved] (HADOOP-18391) Improve VectoredReadUtils#readVectored() for direct buffers

2022-08-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18391. Resolution: Fixed merged to branch-3.3 > Improve VectoredReadUtils#readVectored() for di

[jira] [Resolved] (HADOOP-18407) Improve vectored IO api spec.

2022-08-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18407. Resolution: Fixed merged to branch-3.3 > Improve vectored IO api spec. > --

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-08-31 Thread GitBox
GauthamBanasandra commented on code in PR #4765: URL: https://github.com/apache/hadoop/pull/4765#discussion_r959822548 ## dev-support/Jenkinsfile: ## @@ -71,7 +71,7 @@ pipeline { checkout([ $class: 'GitSCM',

[GitHub] [hadoop] GauthamBanasandra commented on a diff in pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-08-31 Thread GitBox
GauthamBanasandra commented on code in PR #4765: URL: https://github.com/apache/hadoop/pull/4765#discussion_r959822548 ## dev-support/Jenkinsfile: ## @@ -71,7 +71,7 @@ pipeline { checkout([ $class: 'GitSCM',

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598507#comment-17598507 ] ASF GitHub Bot commented on HADOOP-18133: - GauthamBanasandra commented on code

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598509#comment-17598509 ] ASF GitHub Bot commented on HADOOP-18133: - GauthamBanasandra commented on code

[GitHub] [hadoop] hadoop-yetus commented on pull request #4836: YARN-11289. [Federation] Improve NM FederationInterceptor removeAppFromRegistry.

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4836: URL: https://github.com/apache/hadoop/pull/4836#issuecomment-1233207174 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] goiri merged pull request #4781: YARN-11272. Federation StateStore: Support storage/retrieval of Reservations With Zk.

2022-08-31 Thread GitBox
goiri merged PR #4781: URL: https://github.com/apache/hadoop/pull/4781 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] hadoop-yetus commented on pull request #4816: MAPREDUCE-7409. Make shuffle key length configurable

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4816: URL: https://github.com/apache/hadoop/pull/4816#issuecomment-1233209885 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18342) Upgrade to Avro 1.11.1

2022-08-31 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PJ Fanning updated HADOOP-18342: Labels: (was: pull-request-available) > Upgrade to Avro 1.11.1 > -- > >

[jira] [Commented] (HADOOP-18431) Unit test can fail due to unexpected host resolution

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598531#comment-17598531 ] ASF GitHub Bot commented on HADOOP-18431: - snmvaughan commented on PR #4833: UR

[GitHub] [hadoop] snmvaughan commented on pull request #4833: HADOOP-18431. Unit test can fail due to unexpected host resolution

2022-08-31 Thread GitBox
snmvaughan commented on PR #4833: URL: https://github.com/apache/hadoop/pull/4833#issuecomment-1233229717 Could someone transform HADOOP-18431 to HDFS-*? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1233238806 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apache.org/job

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598541#comment-17598541 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4798: HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping.

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4798: URL: https://github.com/apache/hadoop/pull/4798#issuecomment-1233252221 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598548#comment-17598548 ] ASF GitHub Bot commented on HADOOP-18388: - hadoop-yetus commented on PR #4798:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4798: HADOOP-18388. Allow dynamic groupSearchFilter in LdapGroupsMapping.

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4798: URL: https://github.com/apache/hadoop/pull/4798#issuecomment-1233271499 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18388) Allow dynamic groupSearchFilter in LdapGroupsMapping

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598553#comment-17598553 ] ASF GitHub Bot commented on HADOOP-18388: - hadoop-yetus commented on PR #4798:

[GitHub] [hadoop] goiri commented on a diff in pull request #4836: YARN-11289. [Federation] Improve NM FederationInterceptor removeAppFromRegistry.

2022-08-31 Thread GitBox
goiri commented on code in PR #4836: URL: https://github.com/apache/hadoop/pull/4836#discussion_r959903262 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/amrmproxy/FederationInterceptor.java: #

[GitHub] [hadoop] goiri commented on a diff in pull request #4817: YARN-11273. Federation StateStore: Support storage/retrieval of Reservations With SQL.

2022-08-31 Thread GitBox
goiri commented on code in PR #4817: URL: https://github.com/apache/hadoop/pull/4817#discussion_r959907753 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/federation/store/impl/SQLFederationStateStore.java:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4840: HDFS-16754. UnderConstruct file with completed but missed block should be able to recover lease

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4840: URL: https://github.com/apache/hadoop/pull/4840#issuecomment-1233291202 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4835: HDFS-16740. Mini cluster test flakiness

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4835: URL: https://github.com/apache/hadoop/pull/4835#issuecomment-1233340958 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1233411371 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598631#comment-17598631 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1233412952 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apache.org/job

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598632#comment-17598632 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765:

[GitHub] [hadoop] slfan1989 commented on pull request #4781: YARN-11272. Federation StateStore: Support storage/retrieval of Reservations With Zk.

2022-08-31 Thread GitBox
slfan1989 commented on PR #4781: URL: https://github.com/apache/hadoop/pull/4781#issuecomment-1233479348 @goiri Thank you very much for helping to review the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4817: YARN-11273. Federation StateStore: Support storage/retrieval of Reservations With SQL.

2022-08-31 Thread GitBox
slfan1989 commented on code in PR #4817: URL: https://github.com/apache/hadoop/pull/4817#discussion_r960073054 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/federation/store/impl/SQLFederationStateStore.java:

[GitHub] [hadoop] saintstack commented on pull request #4834: HDFS-16753. WebHDFSHandler should reject non-compliant requests

2022-08-31 Thread GitBox
saintstack commented on PR #4834: URL: https://github.com/apache/hadoop/pull/4834#issuecomment-1233493473 So now the test passes TestWebHdfsFileSystemContract#testResponseCode when 'null' doesn't resolve -- as expected -- but also passes when 'null' resolves? (What does resolve of 'nu

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1233577458 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598665#comment-17598665 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4765: HADOOP-18133. Add Dockerfile for Windows 10

2022-08-31 Thread GitBox
hadoop-yetus commented on PR #4765: URL: https://github.com/apache/hadoop/pull/4765#issuecomment-1233578933 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at https://ci-hadoop.apache.org/job

[jira] [Commented] (HADOOP-18133) Add Dockerfile for Windows 10

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598666#comment-17598666 ] ASF GitHub Bot commented on HADOOP-18133: - hadoop-yetus commented on PR #4765:

[GitHub] [hadoop] snmvaughan commented on pull request #4834: HDFS-16753. WebHDFSHandler should reject non-compliant requests

2022-08-31 Thread GitBox
snmvaughan commented on PR #4834: URL: https://github.com/apache/hadoop/pull/4834#issuecomment-1233589923 No. The update doesn't allow a null value (as opposed to a host name "null") to be misinterpreted as a string. You could still have a host named "null", but that doesn't apply in the

[jira] [Created] (HADOOP-18435) Remove usage of fs.s3a.executor.capacity

2022-08-31 Thread Viraj Jasani (Jira)
Viraj Jasani created HADOOP-18435: - Summary: Remove usage of fs.s3a.executor.capacity Key: HADOOP-18435 URL: https://issues.apache.org/jira/browse/HADOOP-18435 Project: Hadoop Common Issue Ty

[GitHub] [hadoop] ashutoshcipher commented on pull request #4248: MAPREDUCE-7370. Parallelize MultipleOutputs#close call

2022-08-31 Thread GitBox
ashutoshcipher commented on PR #4248: URL: https://github.com/apache/hadoop/pull/4248#issuecomment-1233602950 > This looks good overall. I see there is a compilation error to address in the test code. Thanks! Thanks for reviewing and sharing your comments on PR. I have addressed this

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4841: YARN-11278. Fixed Ambiguous error message in mutation API

2022-08-31 Thread GitBox
ashutoshcipher opened a new pull request, #4841: URL: https://github.com/apache/hadoop/pull/4841 ### Description of PR Fixed Ambiguous error message in mutation API JIRA - YARN-11278 ### For code changes: - [X] Does the title or this PR starts with the correspondin

[jira] [Assigned] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2022-08-31 Thread groot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] groot reassigned HADOOP-16769: -- Assignee: groot > LocalDirAllocator to provide diagnostics when file creation fails > --

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4842: HADOOP-16769. LocalDirAllocator to provide diagnostics when file creation fails

2022-08-31 Thread GitBox
ashutoshcipher opened a new pull request, #4842: URL: https://github.com/apache/hadoop/pull/4842 ### Description of PR LocalDirAllocator to provide diagnostics when file creation fails. JIRA - HADOOP-16769 ### How was this patch tested? ### For code changes

[jira] [Commented] (HADOOP-16769) LocalDirAllocator to provide diagnostics when file creation fails

2022-08-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598682#comment-17598682 ] ASF GitHub Bot commented on HADOOP-16769: - ashutoshcipher opened a new pull req

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #4836: YARN-11289. [Federation] Improve NM FederationInterceptor removeAppFromRegistry.

2022-08-31 Thread GitBox
slfan1989 commented on code in PR #4836: URL: https://github.com/apache/hadoop/pull/4836#discussion_r960155077 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/amrmproxy/FederationInterceptor.jav

  1   2   >