[jira] [Commented] (HADOOP-18891) hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765450#comment-17765450 ] ASF GitHub Bot commented on HADOOP-18891: - hadoop-yetus commented on PR #6070:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6070: HADOOP-18891 hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6070: URL: https://github.com/apache/hadoop/pull/6070#issuecomment-1720652188 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Resolved] (HADOOP-18851) Performance improvement for DelegationTokenSecretManager.

2023-09-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18851. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Performance impro

[jira] [Updated] (HADOOP-18851) Performance improvement for DelegationTokenSecretManager.

2023-09-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-18851: - Summary: Performance improvement for DelegationTokenSecretManager. (was: AbstractDelegationTok

[jira] [Commented] (HADOOP-18851) AbstractDelegationTokenSecretManager- Performance improvement by optimising the synchronization context

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765448#comment-17765448 ] ASF GitHub Bot commented on HADOOP-18851: - Hexiaoqiao commented on PR #6001: UR

[GitHub] [hadoop] Hexiaoqiao commented on pull request #6001: HADOOP-18851: Performance improvement for DelegationTokenSecretManager.

2023-09-14 Thread via GitHub
Hexiaoqiao commented on PR #6001: URL: https://github.com/apache/hadoop/pull/6001#issuecomment-1720598948 Committed to trunk. Thanks @vikaskr22 for your works and @jojochuang for your review! -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[jira] [Commented] (HADOOP-18851) AbstractDelegationTokenSecretManager- Performance improvement by optimising the synchronization context

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765447#comment-17765447 ] ASF GitHub Bot commented on HADOOP-18851: - Hexiaoqiao merged PR #6001: URL: htt

[GitHub] [hadoop] Hexiaoqiao merged pull request #6001: HADOOP-18851: Performance improvement for DelegationTokenSecretManager.

2023-09-14 Thread via GitHub
Hexiaoqiao merged PR #6001: URL: https://github.com/apache/hadoop/pull/6001 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765445#comment-17765445 ] ASF GitHub Bot commented on HADOOP-18797: - shameersss1 commented on PR #6006: U

[GitHub] [hadoop] shameersss1 commented on pull request #6006: HADOOP-18797: Support Concurrent Writes With S3A Magic Committer

2023-09-14 Thread via GitHub
shameersss1 commented on PR #6006: URL: https://github.com/apache/hadoop/pull/6006#issuecomment-1720570877 > So one aspect of this change is that __magic on its own is no longer valid. I think I might still like it as "Magic "even if our own committer do not use it any more. That is in case

[GitHub] [hadoop] shameersss1 commented on a diff in pull request #6006: HADOOP-18797: Support Concurrent Writes With S3A Magic Committer

2023-09-14 Thread via GitHub
shameersss1 commented on code in PR #6006: URL: https://github.com/apache/hadoop/pull/6006#discussion_r1326773991 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/commit/magic/ITestMagicCommitProtocol.java: ## @@ -94,11 +95,11 @@ public MagicS3GuardCommitter cre

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765442#comment-17765442 ] ASF GitHub Bot commented on HADOOP-18797: - shameersss1 commented on code in PR

[GitHub] [hadoop] hadoop-yetus commented on pull request #6081: HDFS-17192. Add bock info when constructing remote block reader meets IOException.

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6081: URL: https://github.com/apache/hadoop/pull/6081#issuecomment-1720543364 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18891) hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765439#comment-17765439 ] ASF GitHub Bot commented on HADOOP-18891: - hadoop-yetus commented on PR #6070:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6070: HADOOP-18891 hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6070: URL: https://github.com/apache/hadoop/pull/6070#issuecomment-1720531523 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18891) hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765427#comment-17765427 ] ASF GitHub Bot commented on HADOOP-18891: - AuthurWang2009 commented on PR #6058

[GitHub] [hadoop] AuthurWang2009 commented on pull request #6058: HADOOP-18891 hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread via GitHub
AuthurWang2009 commented on PR #6058: URL: https://github.com/apache/hadoop/pull/6058#issuecomment-1720410890 I made a new PR [6070](https://github.com/apache/hadoop/pull/6070) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[jira] [Commented] (HADOOP-18891) hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765424#comment-17765424 ] ASF GitHub Bot commented on HADOOP-18891: - AuthurWang2009 commented on PR #6070

[GitHub] [hadoop] AuthurWang2009 commented on pull request #6070: HADOOP-18891 hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread via GitHub
AuthurWang2009 commented on PR #6070: URL: https://github.com/apache/hadoop/pull/6070#issuecomment-1720409634 Due to my mistakes, I incorrectly commit my pull requests to branch, but not trunk. Compared to the previous commit, I have made the following improvements: 1、import orderi

[GitHub] [hadoop] hfutatzhanghb opened a new pull request, #6081: HDFS-17192. Add bock info when constructing remote block reader meets IOException.

2023-09-14 Thread via GitHub
hfutatzhanghb opened a new pull request, #6081: URL: https://github.com/apache/hadoop/pull/6081 ### Description of PR please refer to HDFS-17192. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] zhangxiping1 commented on pull request #5921: HDFS-17138 RBF: We changed the hadoop.security.auth_to_local configur…

2023-09-14 Thread via GitHub
zhangxiping1 commented on PR #5921: URL: https://github.com/apache/hadoop/pull/5921#issuecomment-1720367350 > I'm a little worried about the tests, those like TestRollingUpgrade seem fairly consistent but it might be because of something else. Can we double check? ok ,I'll check. -

[GitHub] [hadoop] hadoop-yetus commented on pull request #4835: HDFS-16740. Mini cluster test flakiness

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #4835: URL: https://github.com/apache/hadoop/pull/4835#issuecomment-1720350027 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #6077: HDFS-17110. Null Pointer Exception when running TestHarFileSystemWithHA#testHarUriWithHaUriWithNoPort

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6077: URL: https://github.com/apache/hadoop/pull/6077#issuecomment-1720325352 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #6078: HDFS-17108. Null Pointer Exception when running TestDecommissionWithBackoffMonitor

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6078: URL: https://github.com/apache/hadoop/pull/6078#issuecomment-1720322111 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #6079: HDFS-17133. TestFsDatasetImpl missing null check when cleaning up

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6079: URL: https://github.com/apache/hadoop/pull/6079#issuecomment-1720292695 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18904) get local file system fails with a casting error

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765389#comment-17765389 ] ASF GitHub Bot commented on HADOOP-18904: - hadoop-yetus commented on PR #6080:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6080: HADOOP-18904. get local file system fails with a casting error

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6080: URL: https://github.com/apache/hadoop/pull/6080#issuecomment-1720281261 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Assigned] (HADOOP-18824) ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HADOOP-18824: Assignee: ConfX > ZKDelegationTokenSecretManager causes ArithmeticException due to impro

[jira] [Commented] (HADOOP-18824) ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765383#comment-17765383 ] ASF GitHub Bot commented on HADOOP-18824: - goiri merged PR #6052: URL: https://

[jira] [Resolved] (HADOOP-18824) ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HADOOP-18824. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > ZKDelegationToken

[GitHub] [hadoop] goiri merged pull request #6052: HADOOP-18824. ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread via GitHub
goiri merged PR #6052: URL: https://github.com/apache/hadoop/pull/6052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[jira] [Commented] (HADOOP-18824) ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765372#comment-17765372 ] ASF GitHub Bot commented on HADOOP-18824: - hadoop-yetus commented on PR #6052:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6052: HADOOP-18824. ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6052: URL: https://github.com/apache/hadoop/pull/6052#issuecomment-1720199644 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18814) Direct class cast causes ClassCastException in TestRPC#testReaderExceptions

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765369#comment-17765369 ] ASF GitHub Bot commented on HADOOP-18814: - hadoop-yetus commented on PR #6076:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6076: HADOOP-18814. Direct class cast causes ClassCastException in TestRPC#testReaderExceptions

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6076: URL: https://github.com/apache/hadoop/pull/6076#issuecomment-1720185661 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #6063: YARN-11498 backport jettison exclusions

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6063: URL: https://github.com/apache/hadoop/pull/6063#issuecomment-1720175190 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #6071: HDFS-17103. messy file system cleanup in TestNameEditsConfigs

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6071: URL: https://github.com/apache/hadoop/pull/6071#issuecomment-1720170527 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18803) ClassCastException in test TestRPC#testWrappedStopProxy

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765363#comment-17765363 ] ASF GitHub Bot commented on HADOOP-18803: - hadoop-yetus commented on PR #6075:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6075: HADOOP-18803. ClassCastException in test TestRPC#testWrappedStopProxy

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6075: URL: https://github.com/apache/hadoop/pull/6075#issuecomment-1720154862 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #6072: HDFS-17102. Timeout encountered when running TestDataNodeOutlierDetectionViaMetrics

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6072: URL: https://github.com/apache/hadoop/pull/6072#issuecomment-1720151244 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] goiri commented on pull request #5921: HDFS-17138 RBF: We changed the hadoop.security.auth_to_local configur…

2023-09-14 Thread via GitHub
goiri commented on PR #5921: URL: https://github.com/apache/hadoop/pull/5921#issuecomment-1720133126 I'm a little worried about the tests, those like TestRollingUpgrade seem fairly consistent but it might be because of something else. Can we double check? -- This is an automated message

[jira] [Commented] (HADOOP-18824) ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765340#comment-17765340 ] ASF GitHub Bot commented on HADOOP-18824: - teamconfx commented on PR #6052: URL

[GitHub] [hadoop] teamconfx commented on pull request #6052: HADOOP-18824. ZKDelegationTokenSecretManager causes ArithmeticException due to improper numRetries value checking

2023-09-14 Thread via GitHub
teamconfx commented on PR #6052: URL: https://github.com/apache/hadoop/pull/6052#issuecomment-1720015087 > Would you mind to add this case as unit test to cover it? Thanks. I added a test with the same logic as `org.apache.hadoop.security.token.delegation.TestZKDelegationTokenSecretManage

[GitHub] [hadoop] hadoop-yetus commented on pull request #6074: YARN-11532. Incorrect Check for Permission in Test

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6074: URL: https://github.com/apache/hadoop/pull/6074#issuecomment-1720009156 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18904) get local file system fails with a casting error

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18904: Labels: pull-request-available (was: ) > get local file system fails with a casting erro

[GitHub] [hadoop] teamconfx opened a new pull request, #6080: HADOOP-18904. get local file system fails with a casting error

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6080: URL: https://github.com/apache/hadoop/pull/6080 ### Description of PR https://issues.apache.org/jira/browse/HADOOP-18904 This PR adds a check for the local system get when the configuration for the local fs implementation is set wrongly. This

[jira] [Commented] (HADOOP-18904) get local file system fails with a casting error

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765325#comment-17765325 ] ASF GitHub Bot commented on HADOOP-18904: - teamconfx opened a new pull request,

[jira] [Created] (HADOOP-18904) get local file system fails with a casting error

2023-09-14 Thread ConfX (Jira)
ConfX created HADOOP-18904: -- Summary: get local file system fails with a casting error Key: HADOOP-18904 URL: https://issues.apache.org/jira/browse/HADOOP-18904 Project: Hadoop Common Issue Type: Bu

[GitHub] [hadoop] teamconfx opened a new pull request, #6079: HDFS-17133. TestFsDatasetImpl missing null check when cleaning up

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6079: URL: https://github.com/apache/hadoop/pull/6079 ### Description of PR https://issues.apache.org/jira/browse/HDFS-17133 This PR adds a check that `cluster` is not `null` before cleaning up and shutting down the cluster. ### How was this

[GitHub] [hadoop] teamconfx opened a new pull request, #6078: HDFS-17108. Null Pointer Exception when running TestDecommissionWithBackoffMonitor

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6078: URL: https://github.com/apache/hadoop/pull/6078 ### Description of PR https://issues.apache.org/jira/browse/HDFS-17108 This PR adds a check for `filesys` not `null` and file exists before cleaning up in `finally` clause. ### How was th

[GitHub] [hadoop] teamconfx opened a new pull request, #6077: HDFS-17110. Null Pointer Exception when running TestHarFileSystemWithHA#testHarUriWithHaUriWithNoPort

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6077: URL: https://github.com/apache/hadoop/pull/6077 ### Description of PR https://issues.apache.org/jira/browse/HDFS-17110 This PR adds a check for `cluster` not null to avoid hiding the actual exception with the `NullPointerException`. ##

[jira] [Commented] (HADOOP-18814) Direct class cast causes ClassCastException in TestRPC#testReaderExceptions

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765295#comment-17765295 ] ASF GitHub Bot commented on HADOOP-18814: - teamconfx opened a new pull request,

[GitHub] [hadoop] teamconfx opened a new pull request, #6076: HADOOP-18814. Direct class cast causes ClassCastException in TestRPC#testReaderExceptions

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6076: URL: https://github.com/apache/hadoop/pull/6076 ### Description of PR https://issues.apache.org/jira/browse/HADOOP-18814 This PR adds a check before casting to RemoteException to avoid hiding the actual exception. ### How was this patc

[jira] [Updated] (HADOOP-18814) Direct class cast causes ClassCastException in TestRPC#testReaderExceptions

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18814: Labels: pull-request-available (was: ) > Direct class cast causes ClassCastException in

[jira] [Commented] (HADOOP-18883) Expect-100 JDK bug resolution: prevent multiple server calls

2023-09-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765286#comment-17765286 ] Steve Loughran commented on HADOOP-18883: - thanks. > Expect-100 JDK bug resol

[jira] [Commented] (HADOOP-18860) Upgrade mockito to 4.11.0

2023-09-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765285#comment-17765285 ] Steve Loughran commented on HADOOP-18860: - no, i mean it failed in hadoop clien

[jira] [Updated] (HADOOP-18803) ClassCastException in test TestRPC#testWrappedStopProxy

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18803: Labels: pull-request-available (was: ) > ClassCastException in test TestRPC#testWrappedS

[jira] [Commented] (HADOOP-18803) ClassCastException in test TestRPC#testWrappedStopProxy

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765284#comment-17765284 ] ASF GitHub Bot commented on HADOOP-18803: - teamconfx opened a new pull request,

[GitHub] [hadoop] teamconfx opened a new pull request, #6075: HADOOP-18803. ClassCastException in test TestRPC#testWrappedStopProxy

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6075: URL: https://github.com/apache/hadoop/pull/6075 ### Description of PR https://issues.apache.org/jira/browse/HADOOP-18803 This PR adds an extra setting of protocol engine to ensure that when running the test by itself the test would not fail d

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765279#comment-17765279 ] ASF GitHub Bot commented on HADOOP-18797: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on pull request #4996: HADOOP-18487. protobuf 2.5.0 marked as provided.

2023-09-14 Thread via GitHub
steveloughran commented on PR #4996: URL: https://github.com/apache/hadoop/pull/4996#issuecomment-1719833983 @ayushtkn thanks. i will do it everywhere; its the same as the s3a invoker stuff and it is more elegant, especially for anyone writing new rpc stuff -- This is an automated message

[jira] [Commented] (HADOOP-18487) protobuf-2.5.0 dependencies => provided

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765280#comment-17765280 ] ASF GitHub Bot commented on HADOOP-18487: - steveloughran commented on PR #4996:

[GitHub] [hadoop] steveloughran commented on a diff in pull request #6006: HADOOP-18797: Support Concurrent Writes With S3A Magic Committer

2023-09-14 Thread via GitHub
steveloughran commented on code in PR #6006: URL: https://github.com/apache/hadoop/pull/6006#discussion_r1326267233 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/commit/magic/ITestMagicCommitProtocol.java: ## @@ -94,11 +95,11 @@ public MagicS3GuardCommitter c

[jira] [Commented] (HADOOP-18903) Added yarn.app.mapreduce.container.jvm.jre17.args as a config

2023-09-14 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765278#comment-17765278 ] Benjamin Teke commented on HADOOP-18903: [~pulparindo] thanks for the jira. Thi

[GitHub] [hadoop] teamconfx opened a new pull request, #6074: YARN-11532. Incorrect Check for Permission in Test

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6074: URL: https://github.com/apache/hadoop/pull/6074 ### Description of PR https://issues.apache.org/jira/browse/YARN-11532 This PR changes the code to check ancestor's execute permissions to actually match the functionality of the method.

[jira] [Commented] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765273#comment-17765273 ] ASF GitHub Bot commented on HADOOP-18895: - pjfanning commented on PR #6062: URL

[GitHub] [hadoop] pjfanning commented on pull request #6062: HADOOP-18895: upgrade to commons-compress 1.24.0

2023-09-14 Thread via GitHub
pjfanning commented on PR #6062: URL: https://github.com/apache/hadoop/pull/6062#issuecomment-1719819848 @steveloughran I created https://github.com/apache/hadoop/pull/6073 - probably worth a backport -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] pjfanning opened a new pull request, #6073: HADOOP-18895. Upgrade to commons-compress 1.24.0

2023-09-14 Thread via GitHub
pjfanning opened a new pull request, #6073: URL: https://github.com/apache/hadoop/pull/6073 Backport -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail

[jira] [Commented] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765272#comment-17765272 ] ASF GitHub Bot commented on HADOOP-18895: - pjfanning opened a new pull request,

[jira] [Commented] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765268#comment-17765268 ] ASF GitHub Bot commented on HADOOP-18895: - steveloughran commented on PR #6062:

[GitHub] [hadoop] steveloughran commented on pull request #6062: HADOOP-18895: upgrade to commons-compress 1.24.0

2023-09-14 Thread via GitHub
steveloughran commented on PR #6062: URL: https://github.com/apache/hadoop/pull/6062#issuecomment-1719802654 merged. this another 3.3 change? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[jira] [Updated] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18895: Fix Version/s: 3.4.0 > upgrade to commons-compress 1.24.0 due to CVE > --

[jira] [Commented] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765267#comment-17765267 ] ASF GitHub Bot commented on HADOOP-18895: - steveloughran merged PR #6062: URL:

[jira] [Assigned] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18895: --- Assignee: PJ Fanning > upgrade to commons-compress 1.24.0 due to CVE > ---

[jira] [Updated] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18895: Component/s: build > upgrade to commons-compress 1.24.0 due to CVE >

[GitHub] [hadoop] steveloughran merged pull request #6062: HADOOP-18895: upgrade to commons-compress 1.24.0

2023-09-14 Thread via GitHub
steveloughran merged PR #6062: URL: https://github.com/apache/hadoop/pull/6062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Commented] (HADOOP-18891) hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765264#comment-17765264 ] ASF GitHub Bot commented on HADOOP-18891: - steveloughran commented on PR #6058:

[GitHub] [hadoop] steveloughran commented on pull request #6058: HADOOP-18891 hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread via GitHub
steveloughran commented on PR #6058: URL: https://github.com/apache/hadoop/pull/6058#issuecomment-1719797378 thanks. link to it from here so i'll see it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] teamconfx opened a new pull request, #6072: HDFS-17102. Timeout encountered when running TestDataNodeOutlierDetectionViaMetrics

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6072: URL: https://github.com/apache/hadoop/pull/6072 ### Description of PR https://issues.apache.org/jira/browse/HDFS-17102 This PR adds a lower bound for the number of packets injected in the test to avoid timeout. ### How was this patch t

[GitHub] [hadoop] hadoop-yetus commented on pull request #6067: HDFS-17190. EC: Fix bug of OIV processing XAttr.

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6067: URL: https://github.com/apache/hadoop/pull/6067#issuecomment-1719784383 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Created] (HADOOP-18903) Added yarn.app.mapreduce.container.jvm.jre17.args as a config

2023-09-14 Thread Bruno Ramirez (Jira)
Bruno Ramirez created HADOOP-18903: -- Summary: Added yarn.app.mapreduce.container.jvm.jre17.args as a config Key: HADOOP-18903 URL: https://issues.apache.org/jira/browse/HADOOP-18903 Project: Hadoop C

[GitHub] [hadoop] teamconfx opened a new pull request, #6071: HDFS-17103. messy file system cleanup in TestNameEditsConfigs

2023-09-14 Thread via GitHub
teamconfx opened a new pull request, #6071: URL: https://github.com/apache/hadoop/pull/6071 ### Description of PR https://issues.apache.org/jira/browse/HDFS-17103 This PR adds a null check for `fileSys` and `cluster` during test cleanup. ### How was this patch tested? (1) Set

[jira] [Updated] (HADOOP-18901) Create maven profile for running unit tests

2023-09-14 Thread Bruno Ramirez (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Ramirez updated HADOOP-18901: --- Description: Added build plugin to use JAVA17_HOME for testing while using JDK 17 profile

[GitHub] [hadoop] hadoop-yetus commented on pull request #6070: HADOOP-18891 hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6070: URL: https://github.com/apache/hadoop/pull/6070#issuecomment-1719742098 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18891) hadoop distcp needs support to filter by file/directory attribute

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765246#comment-17765246 ] ASF GitHub Bot commented on HADOOP-18891: - hadoop-yetus commented on PR #6070:

[jira] [Commented] (HADOOP-18897) Pass additional arguments to YARN / Child JVM containers

2023-09-14 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765245#comment-17765245 ] Benjamin Teke commented on HADOOP-18897: [~pulparindo] Thanks for creating this

[jira] [Created] (HADOOP-18902) KMS server not running on Java 17 by default

2023-09-14 Thread Bruno Ramirez (Jira)
Bruno Ramirez created HADOOP-18902: -- Summary: KMS server not running on Java 17 by default Key: HADOOP-18902 URL: https://issues.apache.org/jira/browse/HADOOP-18902 Project: Hadoop Common Is

[jira] [Created] (HADOOP-18901) Create maven profile for running unit tests

2023-09-14 Thread Bruno Ramirez (Jira)
Bruno Ramirez created HADOOP-18901: -- Summary: Create maven profile for running unit tests Key: HADOOP-18901 URL: https://issues.apache.org/jira/browse/HADOOP-18901 Project: Hadoop Common Iss

[jira] [Created] (HADOOP-18900) Add JAVA 17 in hadoop-env.sh

2023-09-14 Thread Bruno Ramirez (Jira)
Bruno Ramirez created HADOOP-18900: -- Summary: Add JAVA 17 in hadoop-env.sh Key: HADOOP-18900 URL: https://issues.apache.org/jira/browse/HADOOP-18900 Project: Hadoop Common Issue Type: Task

[jira] [Created] (HADOOP-18899) Configure add opens in setup JVM launch command

2023-09-14 Thread Bruno Ramirez (Jira)
Bruno Ramirez created HADOOP-18899: -- Summary: Configure add opens in setup JVM launch command Key: HADOOP-18899 URL: https://issues.apache.org/jira/browse/HADOOP-18899 Project: Hadoop Common

[jira] [Created] (HADOOP-18898) Add argLine configuration to maven-surefire-plugin

2023-09-14 Thread Bruno Ramirez (Jira)
Bruno Ramirez created HADOOP-18898: -- Summary: Add argLine configuration to maven-surefire-plugin Key: HADOOP-18898 URL: https://issues.apache.org/jira/browse/HADOOP-18898 Project: Hadoop Common

[jira] [Created] (HADOOP-18897) Pass additional arguments to YARN / Child JVM containers

2023-09-14 Thread Bruno Ramirez (Jira)
Bruno Ramirez created HADOOP-18897: -- Summary: Pass additional arguments to YARN / Child JVM containers Key: HADOOP-18897 URL: https://issues.apache.org/jira/browse/HADOOP-18897 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #6006: HADOOP-18797: Support Concurrent Writes With S3A Magic Committer

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6006: URL: https://github.com/apache/hadoop/pull/6006#issuecomment-1719696944 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

2023-09-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765236#comment-17765236 ] ASF GitHub Bot commented on HADOOP-18797: - hadoop-yetus commented on PR #6006:

[jira] [Commented] (HADOOP-18877) AWS SDK V2 - Move to S3 Java async client

2023-09-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17765234#comment-17765234 ] Steve Loughran commented on HADOOP-18877: - the interface here needs to be plugg

[GitHub] [hadoop] hadoop-yetus commented on pull request #6069: [ABFS] Supporting Checksum Validation for Read and Write

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1719511135 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PJ Fanning updated HADOOP-18895: Description: Includes some important bug fixes including https://lists.apache.org/thread/g9lrsz8j

[jira] [Updated] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PJ Fanning updated HADOOP-18895: Description: Includes some important bug fixes including https://lists.apache.org/thread/g9lrsz8j

[jira] [Updated] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-09-14 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PJ Fanning updated HADOOP-18895: Summary: upgrade to commons-compress 1.24.0 due to CVE (was: upgrade to commons-compress 1.24.0)

[GitHub] [hadoop] hadoop-yetus commented on pull request #6068: YARN-11566. Yarn app kill command can not kill the application in sec…

2023-09-14 Thread via GitHub
hadoop-yetus commented on PR #6068: URL: https://github.com/apache/hadoop/pull/6068#issuecomment-1719486934 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

  1   2   >