[GitHub] [hadoop] slfan1989 opened a new pull request, #5551: YARN-11378. [Federation] Support checkForDecommissioningNodes、refreshClusterMaxPriority API's for Federation.

2023-04-12 Thread via GitHub
slfan1989 opened a new pull request, #5551: URL: https://github.com/apache/hadoop/pull/5551 JIRA: YARN-11378. [Federation] Support checkForDecommissioningNodes、refreshClusterMaxPriority API's for Federation. -- This is an automated message from the Apache Git Service. To respond to the me

[jira] [Commented] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711695#comment-17711695 ] ASF GitHub Bot commented on HADOOP-18689: - hadoop-yetus commented on PR #5502:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5502: HADOOP-18689. Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5502: URL: https://github.com/apache/hadoop/pull/5502#issuecomment-1506396400 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5546: HDFS-16975. FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5546: URL: https://github.com/apache/hadoop/pull/5546#issuecomment-1506335328 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5550: YARN-11465. Improved YarnClient Log Format

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5550: URL: https://github.com/apache/hadoop/pull/5550#issuecomment-1506312104 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] slfan1989 commented on pull request #5550: YARN-11465. Improved YarnClient Log Format

2023-04-12 Thread via GitHub
slfan1989 commented on PR #5550: URL: https://github.com/apache/hadoop/pull/5550#issuecomment-1506296837 LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

[GitHub] [hadoop] YuanbenWang commented on a diff in pull request #5547: HDFS-16977. Forbid assigned characters in pathname.

2023-04-12 Thread via GitHub
YuanbenWang commented on code in PR #5547: URL: https://github.com/apache/hadoop/pull/5547#discussion_r1164952080 ## hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml: ## @@ -2888,6 +2888,16 @@ + + dfs.pathname.forbidden.characters + Review Comment:

[GitHub] [hadoop] YuanbenWang commented on a diff in pull request #5547: HDFS-16977. Forbid assigned characters in pathname.

2023-04-12 Thread via GitHub
YuanbenWang commented on code in PR #5547: URL: https://github.com/apache/hadoop/pull/5547#discussion_r1164951032 ## hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml: ## @@ -2888,6 +2888,16 @@ + + dfs.pathname.forbidden.characters + Review Comment:

[jira] [Commented] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711645#comment-17711645 ] ASF GitHub Bot commented on HADOOP-18399: - hadoop-yetus commented on PR #5054:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5054: HADOOP-18399 Prefetch - SingleFilePerBlockCache to use LocalDirAllocator for file allocation

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5054: URL: https://github.com/apache/hadoop/pull/5054#issuecomment-1506255713 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5532: HDFS-16972. Delete a snapshot may deleteCurrentFile.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5532: URL: https://github.com/apache/hadoop/pull/5532#issuecomment-1506227426 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Reopened] (HADOOP-18700) add rpc metrics for response time

2023-04-12 Thread liuguanghua (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuguanghua reopened HADOOP-18700: -- > add rpc metrics for response time > - > > Key:

[jira] [Resolved] (HADOOP-18700) add rpc metrics for response time

2023-04-12 Thread liuguanghua (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuguanghua resolved HADOOP-18700. -- Resolution: Fixed > add rpc metrics for response time > - > >

[jira] [Created] (HADOOP-18700) add rpc metrics for response time

2023-04-12 Thread liuguanghua (Jira)
liuguanghua created HADOOP-18700: Summary: add rpc metrics for response time Key: HADOOP-18700 URL: https://issues.apache.org/jira/browse/HADOOP-18700 Project: Hadoop Common Issue Type: Impro

[GitHub] [hadoop] yl09099 opened a new pull request, #5550: YARN-11465. Improved YarnClient Log Format

2023-04-12 Thread via GitHub
yl09099 opened a new pull request, #5550: URL: https://github.com/apache/hadoop/pull/5550 JIRA: YARN-11465. Improved YarnClient Log Format -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [hadoop] slfan1989 commented on pull request #4687: YARN-10846. Add dispatcher metrics to NM.

2023-04-12 Thread via GitHub
slfan1989 commented on PR #4687: URL: https://github.com/apache/hadoop/pull/4687#issuecomment-1506184067 @goiri Thank you very much for helping to review the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5547: HDFS-16977. Forbid assigned characters in pathname when new file or directory is created.

2023-04-12 Thread via GitHub
slfan1989 commented on code in PR #5547: URL: https://github.com/apache/hadoop/pull/5547#discussion_r1164829717 ## hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml: ## @@ -2888,6 +2888,16 @@ + + dfs.pathname.forbidden.characters + Review Comment:

[GitHub] [hadoop] slfan1989 commented on pull request #5547: HDFS-16977. Forbid assigned characters in pathname when new file or directory is created.

2023-04-12 Thread via GitHub
slfan1989 commented on PR #5547: URL: https://github.com/apache/hadoop/pull/5547#issuecomment-1506178316 @YuanbenWang Thanks for the contribution, need to fix checkstyle, and pay attention to junit test error. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] goiri commented on pull request #5536: [HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534

2023-04-12 Thread via GitHub
goiri commented on PR #5536: URL: https://github.com/apache/hadoop/pull/5536#issuecomment-1506159914 @simbadzina any further comments? Can you take a final look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hadoop] hadoop-yetus commented on pull request #5532: HDFS-16972. Delete a snapshot may deleteCurrentFile.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5532: URL: https://github.com/apache/hadoop/pull/5532#issuecomment-1506136128 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] melissayou commented on pull request #5536: [HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534

2023-04-12 Thread via GitHub
melissayou commented on PR #5536: URL: https://github.com/apache/hadoop/pull/5536#issuecomment-1506064911 Hi @goiri , I addressed your comments(1 open). Can you review again? Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [hadoop] hadoop-yetus commented on pull request #5536: [HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5536: URL: https://github.com/apache/hadoop/pull/5536#issuecomment-1506037561 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5547: HDFS-16977. Forbid assigned characters in pathname when new file or directory is created.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5547: URL: https://github.com/apache/hadoop/pull/5547#issuecomment-1506014678 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711575#comment-17711575 ] ASF GitHub Bot commented on HADOOP-18695: - hadoop-yetus commented on PR #5548:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5548: HADOOP-18695. S3A: reject multipart copy requests initiated by tranfser manager when disabled

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5548: URL: https://github.com/apache/hadoop/pull/5548#issuecomment-1505969728 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18687) Remove unnecessary dependency on json-smart

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711570#comment-17711570 ] ASF GitHub Bot commented on HADOOP-18687: - pjfanning opened a new pull request,

[GitHub] [hadoop] pjfanning opened a new pull request, #5549: HADOOP-18687: remove json-smart dependency

2023-04-12 Thread via GitHub
pjfanning opened a new pull request, #5549: URL: https://github.com/apache/hadoop/pull/5549 complete removal of json-smart jar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [hadoop] hadoop-yetus commented on pull request #5546: HDFS-16975. FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5546: URL: https://github.com/apache/hadoop/pull/5546#issuecomment-1505921927 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5546: HDFS-16975. FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5546: URL: https://github.com/apache/hadoop/pull/5546#issuecomment-1505918561 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18699) InvalidProtocolBufferException caused by JDK 11 < 11.0.18 AES-CTR cipher state corruption with AVX-512 bug

2023-04-12 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-18699: Description: This serves as a PSA for a JDK bug. Not really a bug in Hadoop / HDFS. Symptom/Work

[jira] [Updated] (HADOOP-18699) InvalidProtocolBufferException caused by JDK 11 < 11.0.18 AES-CTR cipher state corruption with AVX-512 bug

2023-04-12 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-18699: Description: This serves as a PSA for a JDK bug. Not really a bug in Hadoop / HDFS. Symptom/Work

[jira] [Updated] (HADOOP-18699) InvalidProtocolBufferException caused by JDK 11 < 11.0.18 AES-CTR cipher state corruption with AVX-512 bug

2023-04-12 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-18699: Description: This serves as a PSA for a JDK bug. Not really a bug in Hadoop / HDFS. Symptom/Work

[jira] [Created] (HADOOP-18699) InvalidProtocolBufferException caused by JDK 11 < 11.0.18 AES-CTR cipher state corruption with AVX-512 bug

2023-04-12 Thread Siyao Meng (Jira)
Siyao Meng created HADOOP-18699: --- Summary: InvalidProtocolBufferException caused by JDK 11 < 11.0.18 AES-CTR cipher state corruption with AVX-512 bug Key: HADOOP-18699 URL: https://issues.apache.org/jira/browse/HADO

[jira] [Updated] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18695: Labels: pull-request-available (was: ) > S3A: reject multipart copy requests initiated b

[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711534#comment-17711534 ] ASF GitHub Bot commented on HADOOP-18695: - steveloughran opened a new pull requ

[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711535#comment-17711535 ] ASF GitHub Bot commented on HADOOP-18695: - steveloughran commented on PR #5548:

[GitHub] [hadoop] steveloughran commented on pull request #5548: HADOOP-18695. S3A: reject multipart copy requests initiated by tranfser manager when disabled

2023-04-12 Thread via GitHub
steveloughran commented on PR #5548: URL: https://github.com/apache/hadoop/pull/5548#issuecomment-1505826149 tests in progress after final changes all test failures have separate jiras created * [HADOOP-18697](https://issues.apache.org/jira/browse/HADOOP-18697) transient failure

[GitHub] [hadoop] steveloughran opened a new pull request, #5548: HADOOP-18695. S3A: reject multipart copy requests initiated by tranfser manager when disabled

2023-04-12 Thread via GitHub
steveloughran opened a new pull request, #5548: URL: https://github.com/apache/hadoop/pull/5548 Adds a new subclass of AuditFailureException, AuditOperationRejectedException to indicate audit rejection of the operation. This is mapped to a new PathIOE subclass, UnsupportedRequestExcep

[GitHub] [hadoop] hadoop-yetus commented on pull request #5544: hdfs auditlog add remote port info

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5544: URL: https://github.com/apache/hadoop/pull/5544#issuecomment-1505817155 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Summary: S3A: reject multipart copy requests initiated by transfer manager when disabled

[jira] [Commented] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711527#comment-17711527 ] ASF GitHub Bot commented on HADOOP-17195: - ivanthewebber commented on PR #3467:

[GitHub] [hadoop] ivanthewebber commented on pull request #3467: HADOOP-17195. ABFS: OutOfMemory error while uploading huge files (#3446)

2023-04-12 Thread via GitHub
ivanthewebber commented on PR #3467: URL: https://github.com/apache/hadoop/pull/3467#issuecomment-1505798380 I couldn't find anything about this in public documentation. It would be nice if it could be added there. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on pull request #5544: hdfs auditlog add remote port info

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5544: URL: https://github.com/apache/hadoop/pull/5544#issuecomment-1505778316 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Created] (HADOOP-18698) S3ABlockOutputStream doesn't collect stats on multipart block uploads

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18698: --- Summary: S3ABlockOutputStream doesn't collect stats on multipart block uploads Key: HADOOP-18698 URL: https://issues.apache.org/jira/browse/HADOOP-18698 Project

[jira] [Commented] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711523#comment-17711523 ] Steve Loughran commented on HADOOP-18696: - oh, i understand this. the test conf

[jira] [Created] (HADOOP-18697) transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18697: --- Summary: transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile Key: HADOOP-18697 URL: https://issues.apache.org/jira/browse/HADOOP-18697 P

[jira] [Commented] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711521#comment-17711521 ] Steve Loughran commented on HADOOP-18696: - and storediag list of properties wit

[jira] [Created] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18696: --- Summary: S3A ITestS3ABucketExistence access point test failure Key: HADOOP-18696 URL: https://issues.apache.org/jira/browse/HADOOP-18696 Project: Hadoop Common

[jira] [Commented] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711520#comment-17711520 ] Steve Loughran commented on HADOOP-18696: - full stack {code} [ERROR] Tests run

[jira] [Updated] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Summary: S3A: reject multipart copy requests initiated by transfer manager when multipart

[GitHub] [hadoop] hadoop-yetus commented on pull request #5544: hdfs auditlog add remote port info

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5544: URL: https://github.com/apache/hadoop/pull/5544#issuecomment-1505724775 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] melissayou commented on a diff in pull request #5536: [HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534

2023-04-12 Thread via GitHub
melissayou commented on code in PR #5536: URL: https://github.com/apache/hadoop/pull/5536#discussion_r1164487062 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java: ## @@ -3942,6 +3942,7 @@ public static class StatisticsData { privat

[GitHub] [hadoop] melissayou commented on a diff in pull request #5536: [HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534

2023-04-12 Thread via GitHub
melissayou commented on code in PR #5536: URL: https://github.com/apache/hadoop/pull/5536#discussion_r1164453134 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFileSystemStorageStatistics.java: ## @@ -74,6 +75,7 @@ public void setup() { statis

[GitHub] [hadoop] goiri merged pull request #4687: YARN-10846. Add dispatcher metrics to NM.

2023-04-12 Thread via GitHub
goiri merged PR #4687: URL: https://github.com/apache/hadoop/pull/4687 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] hadoop-yetus commented on pull request #5545: add rpc metrics for response time

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5545: URL: https://github.com/apache/hadoop/pull/5545#issuecomment-1505562751 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4687: YARN-10846. Add dispatcher metrics to NM.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #4687: URL: https://github.com/apache/hadoop/pull/4687#issuecomment-1505553707 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] YuanbenWang opened a new pull request, #5547: HDFS-16977. Forbid assigned characters in pathname when new file or directory is created.

2023-04-12 Thread via GitHub
YuanbenWang opened a new pull request, #5547: URL: https://github.com/apache/hadoop/pull/5547 JIRA: [HDFS-16977](https://issues.apache.org/jira/browse/HDFS-16977). Forbid assigned characters in pathname when new file or directory is created. -- This is an automated message from the Apache

[GitHub] [hadoop] szetszwo opened a new pull request, #5546: HDFS-16975. FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.

2023-04-12 Thread via GitHub
szetszwo opened a new pull request, #5546: URL: https://github.com/apache/hadoop/pull/5546 ### Description of PR FileWithSnapshotFeature.isCurrentFileDeleted is not serialized to FSImage. If it is true for any files, it will becomes false after saving to a FSImage and loading it ba

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-04-12 Thread Harshit Gupta (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711434#comment-17711434 ] Harshit Gupta commented on HADOOP-18637: Sure, I will get on it.  > S3A to sup

[jira] [Commented] (HADOOP-18695) s3a fs to reject multipart copy-in-rename when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711424#comment-17711424 ] Steve Loughran commented on HADOOP-18695: - auditor will raise access denied exc

[jira] [Commented] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711396#comment-17711396 ] ASF GitHub Bot commented on HADOOP-18689: - ayushtkn commented on PR #5502: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #5502: HADOOP-18689. Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-04-12 Thread via GitHub
ayushtkn commented on PR #5502: URL: https://github.com/apache/hadoop/pull/5502#issuecomment-1505308898 I tried ``TestRuntimeEstimators`` locally and it passed. ``` [INFO] --- [INFO] T E S T S [INFO]

[jira] [Updated] (HADOOP-18695) s3a fs to reject multipart copy-in-rename when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Priority: Minor (was: Major) > s3a fs to reject multipart copy-in-rename when multipart

[jira] [Created] (HADOOP-18695) s3a fs to reject multipart copy-in-rename when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18695: --- Summary: s3a fs to reject multipart copy-in-rename when multipart api disabled Key: HADOOP-18695 URL: https://issues.apache.org/jira/browse/HADOOP-18695 Project

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711390#comment-17711390 ] Steve Loughran commented on HADOOP-18637: - [~harshit.gupta] can you do a PR of

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711389#comment-17711389 ] ASF GitHub Bot commented on HADOOP-18637: - steveloughran commented on PR #5543:

[GitHub] [hadoop] steveloughran commented on pull request #5543: HADOOP-18637. S3A to support upload of files greater than 2 GB using DiskBlocks

2023-04-12 Thread via GitHub
steveloughran commented on PR #5543: URL: https://github.com/apache/hadoop/pull/5543#issuecomment-1505272396 I have a followup for this feature, primarily to reject multipart copy requests when disabled, test to verify that for a large enough threshold, calls don't get rejected. -- This

[jira] [Commented] (HADOOP-17377) ABFS: MsiTokenProvider doesn't retry HTTP 429 from the Instance Metadata Service

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711386#comment-17711386 ] ASF GitHub Bot commented on HADOOP-17377: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5273: HADOOP-17377: AABFS: MsiTokenProvider doesn't retry HTTP 429/410 from the Instance Metadata Service

2023-04-12 Thread via GitHub
steveloughran commented on code in PR #5273: URL: https://github.com/apache/hadoop/pull/5273#discussion_r1164119014 ## hadoop-tools/hadoop-azure/pom.xml: ## @@ -321,8 +321,23 @@ org.mockito mockito-core + 4.11.0 Review Comment: sorry, hadoop-project

[jira] [Commented] (HADOOP-18154) S3A Authentication to support WebIdentity

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711381#comment-17711381 ] ASF GitHub Bot commented on HADOOP-18154: - steveloughran commented on PR #4070:

[GitHub] [hadoop] steveloughran commented on pull request #4070: HADOOP-18154. S3A Authentication to support WebIdentity

2023-04-12 Thread via GitHub
steveloughran commented on PR #4070: URL: https://github.com/apache/hadoop/pull/4070#issuecomment-1505242360 @insider89 not been any changes on this PR since it was last reviewed. if the author takes up the pr, addresses those issues etc then we can work on getting it in to hadoop.

[jira] [Commented] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711372#comment-17711372 ] ASF GitHub Bot commented on HADOOP-18689: - steveloughran commented on PR #5502:

[GitHub] [hadoop] steveloughran commented on pull request #5502: HADOOP-18689. Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-04-12 Thread via GitHub
steveloughran commented on PR #5502: URL: https://github.com/apache/hadoop/pull/5502#issuecomment-1505233783 you think those test failures are related? (unlikely, i know...) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] lgh-cn opened a new pull request, #5545: add rpc metrics for response time

2023-04-12 Thread via GitHub
lgh-cn opened a new pull request, #5545: URL: https://github.com/apache/hadoop/pull/5545 ### Description of PR Rpc ResponseTime record the time to encode and send response. This should be added in the rpc metrics. -- This is an automated message from the Apache Git Ser

[GitHub] [hadoop] hadoop-yetus commented on pull request #4687: YARN-10846. Add dispatcher metrics to NM.

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #4687: URL: https://github.com/apache/hadoop/pull/4687#issuecomment-1504918972 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5544: hdfs auditlog add remote port info

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5544: URL: https://github.com/apache/hadoop/pull/5544#issuecomment-1504819624 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18694) Client.Connection#updateAddress needs to ensure that address is resolved before updating

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711225#comment-17711225 ] ASF GitHub Bot commented on HADOOP-18694: - hadoop-yetus commented on PR #5542:

[jira] [Updated] (HADOOP-18694) Client.Connection#updateAddress needs to ensure that address is resolved before updating

2023-04-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18694: Labels: pull-request-available (was: ) > Client.Connection#updateAddress needs to ensure

[GitHub] [hadoop] hadoop-yetus commented on pull request #5542: HADOOP-18694. Client.Connection#updateAddress needs to ensure that address is resolved before updating

2023-04-12 Thread via GitHub
hadoop-yetus commented on PR #5542: URL: https://github.com/apache/hadoop/pull/5542#issuecomment-1504769966 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe