[GitHub] [hadoop] hadoop-yetus commented on pull request #5476: YARN-11446. [Federation] Add updateSchedulerConfiguration, getSchedulerConfiguration REST APIs for Router.

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5476: URL: https://github.com/apache/hadoop/pull/5476#issuecomment-1471338016 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700979#comment-17700979 ] ASF GitHub Bot commented on HADOOP-18631: - hadoop-yetus commented on PR #5451:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern and remove hdfs async audit log configs

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1471302452 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700976#comment-17700976 ] ASF GitHub Bot commented on HADOOP-18666: - tasanuma commented on PR #5480: URL:

[GitHub] [hadoop] tasanuma commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
tasanuma commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1471293892 @eubnara Thanks for doing the test with 3.3.0! Hmm... your configurations seem good. I'm not sure the cause. The whitelist also works with ResourceManager even if it is   `yarn.reso

[jira] [Commented] (HADOOP-18662) ListFiles with recursive fails with FNF

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700958#comment-17700958 ] ASF GitHub Bot commented on HADOOP-18662: - ayushtkn commented on PR #5477: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #5477: HADOOP-18662. ListFiles with recursive fails with FNF.

2023-03-15 Thread via GitHub
ayushtkn commented on PR #5477: URL: https://github.com/apache/hadoop/pull/5477#issuecomment-1471253960 ``TestDirectoryScanner`` failure is not related that is known flaky. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [hadoop] hadoop-yetus commented on pull request #5482: HDFS-16953. RBF Mount table store APIs should update cache only if state store record is successfully updated

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5482: URL: https://github.com/apache/hadoop/pull/5482#issuecomment-1471219931 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5482: HDFS-16953. RBF Mount table store APIs should update cache only if state store record is successfully updated

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5482: URL: https://github.com/apache/hadoop/pull/5482#issuecomment-1471189213 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] zhangshuyan0 commented on pull request #5474: HDFS-16948 Do not print "excess types chosen ... is empty" when EC internal block is moved by balancer

2023-03-15 Thread via GitHub
zhangshuyan0 commented on PR #5474: URL: https://github.com/apache/hadoop/pull/5474#issuecomment-1471165483 @Hexiaoqiao Would you mind reviewing this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (HADOOP-18660) Filesystem Spelling Mistake

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700927#comment-17700927 ] ASF GitHub Bot commented on HADOOP-18660: - hadoop-yetus commented on PR #5475:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5475: [HADOOP-18660] Filesystem Spelling Mistake

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5475: URL: https://github.com/apache/hadoop/pull/5475#issuecomment-1471165103 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5479: HDFS-16949 Update ReadTransferRate to ReadLatencyPerGB for effectiv…

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5479: URL: https://github.com/apache/hadoop/pull/5479#issuecomment-1471150215 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] virajjasani commented on pull request #5482: HDFS-16953. RBF Mount table store APIs should update cache only if state store record is successfully updated

2023-03-15 Thread via GitHub
virajjasani commented on PR #5482: URL: https://github.com/apache/hadoop/pull/5482#issuecomment-1471120065 While exactly verifying this patch's behavior might not be feasible (non-flaky test), let me at least validate that source and destination both are present with one successful and one

[GitHub] [hadoop] virajjasani commented on pull request #5482: HDFS-16953. RBF Mount table store APIs should update cache only if state store record is successfully updated

2023-03-15 Thread via GitHub
virajjasani commented on PR #5482: URL: https://github.com/apache/hadoop/pull/5482#issuecomment-1471101708 > If I got it all right Absolutely sir, all points are correct. Sorry for adding more details above. I wish I had a way to write a test to validate this, I tried but could not fi

[GitHub] [hadoop] virajjasani commented on pull request #5482: HDFS-16953. RBF Mount table store APIs should update cache only if state store record is successfully updated

2023-03-15 Thread via GitHub
virajjasani commented on PR #5482: URL: https://github.com/apache/hadoop/pull/5482#issuecomment-1471023065 @goiri @ayushtkn could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] virajjasani opened a new pull request, #5482: HDFS-16953. RBF Mount table store APIs should update cache only if state store record is successfully updated

2023-03-15 Thread via GitHub
virajjasani opened a new pull request, #5482: URL: https://github.com/apache/hadoop/pull/5482 RBF Mount table state store APIs addMountTableEntry, updateMountTableEntry and removeMountTableEntry performs cache refresh for all routers regardless of the actual record update result. If the rec

[jira] [Updated] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18631: -- Release Note: 1. Migrating Async appenders from code to log4j properties for namenode audit

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700899#comment-17700899 ] ASF GitHub Bot commented on HADOOP-18631: - virajjasani commented on PR #5451: U

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700900#comment-17700900 ] ASF GitHub Bot commented on HADOOP-18631: - ayushtkn commented on PR #5451: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
ayushtkn commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470976342 Wei-Chui go ahead committing, no objections from my side. Test gets fixed. I am happy with just that. -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [hadoop] virajjasani commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
virajjasani commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470976296 Ok sir, updated the PR. Let me update title to reflect this and also update release notes accordingly. Thank you @ayushtkn @jojochuang -- This is an automated message from the Ap

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700897#comment-17700897 ] ASF GitHub Bot commented on HADOOP-18631: - ayushtkn commented on PR #5451: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
ayushtkn commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470973606 Still Ok, I don't want to get into this activity, I will trust you on this, But fundamentally why are you marking the config deprecated, just remove it, It isn't working why you want to k

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700896#comment-17700896 ] ASF GitHub Bot commented on HADOOP-18631: - jojochuang commented on PR #5451: UR

[GitHub] [hadoop] jojochuang commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
jojochuang commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470965254 +1 merging this one. In any case, it is unfortunately impossible to upgrade to log4j2 without any friction. We do what we can do at code review, but ultimately it's up to the downstream

[GitHub] [hadoop] virajjasani commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
virajjasani commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470948962 I have added release notes for HADOOP-18631 to explain the same. Also, both parent Jira (HADOOP-16206) as well as this current Jira (HADOOP-18631) both are marked Incompatible change.

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700893#comment-17700893 ] ASF GitHub Bot commented on HADOOP-18631: - virajjasani commented on PR #5451: U

[jira] [Updated] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18631: -- Hadoop Flags: Incompatible change > Migrate Async appenders to log4j properties > ---

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700892#comment-17700892 ] ASF GitHub Bot commented on HADOOP-18631: - virajjasani commented on PR #5451: U

[GitHub] [hadoop] virajjasani commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
virajjasani commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470946672 "Incompatible change as three hdfs-site configs are no longer in use, they are to be replaced with log4j properties." The overall log4j2 migration is anyways incompatible. There has

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700891#comment-17700891 ] ASF GitHub Bot commented on HADOOP-18631: - virajjasani commented on PR #5451: U

[GitHub] [hadoop] virajjasani commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
virajjasani commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470945541 > it took away some abilities which we could do today and the Deprecated is also misunderstood Ayush, I have added a temporary appender (which will later be removed when we move

[jira] [Commented] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700890#comment-17700890 ] ASF GitHub Bot commented on HADOOP-18631: - ayushtkn commented on PR #5451: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #5451: HADOOP-18631 (ADDENDUM) Use LogCapturer to match audit log pattern

2023-03-15 Thread via GitHub
ayushtkn commented on PR #5451: URL: https://github.com/apache/hadoop/pull/5451#issuecomment-1470939719 @virajjasani was going to commit this, considering @jojochuang ain't interested in this, but the original now looks incompatible to me, it took away some abilities which we could do today

[jira] [Commented] (HADOOP-18657) Tune ABFS create() retry logic

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700884#comment-17700884 ] ASF GitHub Bot commented on HADOOP-18657: - hadoop-yetus commented on PR #5462:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5462: HADOOP-18657. Tune ABFS create() retry logic

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5462: URL: https://github.com/apache/hadoop/pull/5462#issuecomment-1470924983 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700881#comment-17700881 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1470913104 I cannot figure out why your version of hadoop just works without your full source code and configurations. Sorry. -- This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700880#comment-17700880 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1470910613 RM ``` [root@ambari-agent-2 conf]# curl http://ambari-agent-2.example.com:8088/jmx -v * About to connect() to ambari-agent-2.example.com port 8088 (#0) * Trying 172.20.0.2

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700879#comment-17700879 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1470908526 @tasanuma I tested on Hadoop 3.3.0 with some patches to fix build failure. But this issue has been reproduced. core-site.xml ``` http://www.w3.org/2001/XInclude";>

[GitHub] [hadoop] sadanand48 commented on pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-15 Thread via GitHub
sadanand48 commented on PR #5364: URL: https://github.com/apache/hadoop/pull/5364#issuecomment-1470839515 > I'm worried that removing a constant and the ability to set a new sync class will break something. Thanks @steveloughran for reviewing this PR. This constant is not present in

[jira] [Commented] (HADOOP-18565) AWS SDK V2 - Complete outstanding items

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700864#comment-17700864 ] ASF GitHub Bot commented on HADOOP-18565: - steveloughran commented on PR #5421:

[GitHub] [hadoop] steveloughran commented on pull request #5421: HADOOP-18565. Completes outstanding items for the SDK V2 upgrade.

2023-03-15 Thread via GitHub
steveloughran commented on PR #5421: URL: https://github.com/apache/hadoop/pull/5421#issuecomment-1470822345 there's some new warnings about deprecation and cast. you can add @ tags to suppress these ``` hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AUtils.java:801:

[jira] [Commented] (HADOOP-18655) Upgrade Kerby to 2.0.3 due to CVE-2023-25613

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700861#comment-17700861 ] ASF GitHub Bot commented on HADOOP-18655: - steveloughran commented on PR #5458:

[GitHub] [hadoop] steveloughran commented on pull request #5458: HADOOP-18655. Upgrade kerby to 2.0.3 due to CVE-2023-25613

2023-03-15 Thread via GitHub
steveloughran commented on PR #5458: URL: https://github.com/apache/hadoop/pull/5458#issuecomment-1470814982 do a pr for 3.3 anyway, to stop people seeing warnings in audits of depenencies. it is not needed in the 3.3.5 release -- This is an automated message from the Apache Git Se

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-15 Thread via GitHub
steveloughran commented on code in PR #5364: URL: https://github.com/apache/hadoop/pull/5364#discussion_r1137750976 ## hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpSync.java: ## @@ -1276,4 +1283,63 @@ private void snapshotDiffWithPaths(Path sourceFS

[jira] [Commented] (HADOOP-18657) Tune ABFS create() retry logic

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700851#comment-17700851 ] ASF GitHub Bot commented on HADOOP-18657: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5462: HADOOP-18657. Tune ABFS create() retry logic

2023-03-15 Thread via GitHub
steveloughran commented on code in PR #5462: URL: https://github.com/apache/hadoop/pull/5462#discussion_r1137732758 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystemStore.java: ## @@ -621,37 +622,57 @@ private AbfsRestOperation conditi

[jira] [Commented] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700845#comment-17700845 ] ASF GitHub Bot commented on HADOOP-18647: - steveloughran commented on PR #5437:

[GitHub] [hadoop] steveloughran commented on pull request #5437: HADOOP-18647. x-ms-client-request-id to have some way that identifies retry of an API.

2023-03-15 Thread via GitHub
steveloughran commented on PR #5437: URL: https://github.com/apache/hadoop/pull/5437#issuecomment-1470762664 merged to trunk. Can you cherrypick to branch-3.3. and do a retest + pull request there and I will merge it in -- This is an automated message from the Apache Git Service. To respo

[jira] [Commented] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700842#comment-17700842 ] ASF GitHub Bot commented on HADOOP-18647: - steveloughran merged PR #5437: URL:

[jira] [Updated] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18647: Affects Version/s: 3.3.5 > x-ms-client-request-id to have some way that identifies retry

[GitHub] [hadoop] steveloughran merged pull request #5437: HADOOP-18647. x-ms-client-request-id to have some way that identifies retry of an API.

2023-03-15 Thread via GitHub
steveloughran merged PR #5437: URL: https://github.com/apache/hadoop/pull/5437 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Assigned] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18012: --- Assignee: Sree Bhattacharyya (was: Sneha Vijayarajan) > ABFS: Enable config contr

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700837#comment-17700837 ] Steve Loughran commented on HADOOP-18012: - Things I'd like * the option set by

[jira] [Resolved] (HADOOP-18667) ABFS: eTag Check to mitigate Rename Failures

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18667. - Resolution: Duplicate > ABFS: eTag Check to mitigate Rename Failures >

[jira] [Commented] (HADOOP-18667) ABFS: eTag Check to mitigate Rename Failures

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700835#comment-17700835 ] Steve Loughran commented on HADOOP-18667: - Sneha created HADOOP-18012 for this

[GitHub] [hadoop] mkuchenbecker commented on a diff in pull request #5479: HDFS-16949 Update ReadTransferRate to ReadLatencyPerGB for effectiv…

2023-03-15 Thread via GitHub
mkuchenbecker commented on code in PR #5479: URL: https://github.com/apache/hadoop/pull/5479#discussion_r1137608854 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/metrics/DataNodeMetrics.java: ## @@ -323,10 +323,10 @@ public void addIncre

[jira] [Commented] (HADOOP-18660) Filesystem Spelling Mistake

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700799#comment-17700799 ] ASF GitHub Bot commented on HADOOP-18660: - hadoop-yetus commented on PR #5475:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5475: [HADOOP-18660] Filesystem Spelling Mistake

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5475: URL: https://github.com/apache/hadoop/pull/5475#issuecomment-1470490288 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18631: -- Release Note: 1. Migrating Async appenders from code to log4j properties for namenode audit

[jira] [Updated] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18631: -- Release Note: - Migrating Async appenders from code to log4j properties for namenode audit l

[jira] [Updated] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18631: -- Release Note: (was: - Migrating Async appenders from code to log4j properties for namenode

[jira] [Updated] (HADOOP-18631) Migrate Async appenders to log4j properties

2023-03-15 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18631: -- Release Note: - Migrating Async appenders from code to log4j properties for namenode audit l

[jira] [Updated] (HADOOP-17746) compatibility table in directory_markers.md doesn't render right

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17746: Fix Version/s: 3.3.9 Assignee: Masatake Iwasaki (was: Steve Loughran) Res

[jira] [Commented] (HADOOP-17746) compatibility table in directory_markers.md doesn't render right

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700787#comment-17700787 ] ASF GitHub Bot commented on HADOOP-17746: - steveloughran commented on PR #3116:

[GitHub] [hadoop] steveloughran commented on pull request #3116: HADOOP-17746. compatibility table in directory_markers.md doesn't render right.

2023-03-15 Thread via GitHub
steveloughran commented on PR #3116: URL: https://github.com/apache/hadoop/pull/3116#issuecomment-1470429652 sorry, missed that this PR was here. merging to branch-3.3+ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] [Updated] (HADOOP-17746) compatibility table in directory_markers.md doesn't render right

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17746: Labels: pull-request-available (was: ) > compatibility table in directory_markers.md doe

[jira] [Commented] (HADOOP-17746) compatibility table in directory_markers.md doesn't render right

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700786#comment-17700786 ] ASF GitHub Bot commented on HADOOP-17746: - steveloughran merged PR #3116: URL:

[GitHub] [hadoop] steveloughran merged pull request #3116: HADOOP-17746. compatibility table in directory_markers.md doesn't render right.

2023-03-15 Thread via GitHub
steveloughran merged PR #3116: URL: https://github.com/apache/hadoop/pull/3116 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[GitHub] [hadoop] jojochuang merged pull request #5470: HDFS-16947. RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store

2023-03-15 Thread via GitHub
jojochuang merged PR #5470: URL: https://github.com/apache/hadoop/pull/5470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Updated] (HADOOP-18654) Remove unused custom appender TaskLogAppender

2023-03-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18654: - Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch A

[jira] [Updated] (HADOOP-18649) CLA and CRLA appenders to be replaced with RFA

2023-03-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18649: - Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch A

[jira] [Commented] (HADOOP-18649) CLA and CRLA appenders to be replaced with RFA

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700779#comment-17700779 ] ASF GitHub Bot commented on HADOOP-18649: - jojochuang merged PR #5448: URL: htt

[GitHub] [hadoop] jojochuang merged pull request #5448: HADOOP-18649. CLA and CRLA appenders to be replaced with RFA

2023-03-15 Thread via GitHub
jojochuang merged PR #5448: URL: https://github.com/apache/hadoop/pull/5448 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Commented] (HADOOP-18654) Remove unused custom appender TaskLogAppender

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700778#comment-17700778 ] ASF GitHub Bot commented on HADOOP-18654: - jojochuang merged PR #5457: URL: htt

[GitHub] [hadoop] jojochuang merged pull request #5457: HADOOP-18654. Remove unused custom appender TaskLogAppender

2023-03-15 Thread via GitHub
jojochuang merged PR #5457: URL: https://github.com/apache/hadoop/pull/5457 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700742#comment-17700742 ] ASF GitHub Bot commented on HADOOP-18146: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

2023-03-15 Thread via GitHub
steveloughran commented on code in PR #4039: URL: https://github.com/apache/hadoop/pull/4039#discussion_r1137255250 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -681,35 +685,38 @@ public AbfsRestOperation append(final S

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700735#comment-17700735 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1470188538 I tested hadoop 3.3.4 with jetty 9.4.20.v20190813 but this issue has been reproduced. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Commented] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700728#comment-17700728 ] ASF GitHub Bot commented on HADOOP-18146: - steveloughran commented on PR #4039:

[GitHub] [hadoop] steveloughran commented on pull request #4039: HADOOP-18146: ABFS: Added changes for expect hundred continue header

2023-03-15 Thread via GitHub
steveloughran commented on PR #4039: URL: https://github.com/apache/hadoop/pull/4039#issuecomment-1470177496 sorry, missed this during my january-month-off break. don't be afraid to email me over the critical issues where I seem to have not noticed them...my colleagues know to do this!

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700668#comment-17700668 ] ASF GitHub Bot commented on HADOOP-18666: - tasanuma commented on PR #5480: URL:

[GitHub] [hadoop] tasanuma commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
tasanuma commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1469970106 Thanks for your investigation. Actually, my modified version has already included HADOOP-17371. But surely the different versions of jetty could introduce the problem. -- This is an au

[jira] [Created] (HADOOP-18667) ABFS: eTag Check to mitigate Rename Failures

2023-03-15 Thread Sree Bhattacharyya (Jira)
Sree Bhattacharyya created HADOOP-18667: --- Summary: ABFS: eTag Check to mitigate Rename Failures Key: HADOOP-18667 URL: https://issues.apache.org/jira/browse/HADOOP-18667 Project: Hadoop Common

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700633#comment-17700633 ] ASF GitHub Bot commented on HADOOP-18666: - hadoop-yetus commented on PR #5480:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1469869301 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700630#comment-17700630 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-1469857746 [HADOOP-17371](https://github.com/apache/hadoop/commit/6340ac857b7ff3f73bbcf95b59b98aac134f33af) upgrades jetty version. I found that `updateBeans(_filters,holders);` may affect this beha

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700622#comment-17700622 ] ASF GitHub Bot commented on HADOOP-18637: - hadoop-yetus commented on PR #5481:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5481: HADOOP-18637:S3A to support upload of files greater than 2 GB using DiskBlocks

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5481: URL: https://github.com/apache/hadoop/pull/5481#issuecomment-1469831351 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700621#comment-17700621 ] ASF GitHub Bot commented on HADOOP-18637: - hadoop-yetus commented on PR #5481:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5481: HADOOP-18637:S3A to support upload of files greater than 2 GB using DiskBlocks

2023-03-15 Thread via GitHub
hadoop-yetus commented on PR #5481: URL: https://github.com/apache/hadoop/pull/5481#issuecomment-1469829840 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700613#comment-17700613 ] ASF GitHub Bot commented on HADOOP-18666: - eubnara commented on PR #5480: URL:

[GitHub] [hadoop] eubnara commented on pull request #5480: HADOOP-18666. A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread via GitHub
eubnara commented on PR #5480: URL: https://github.com/apache/hadoop/pull/5480#issuecomment-146980 Thanks for reply, I'll try to reproduce it with vanilla hadoop 3.3.0. 😢 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[jira] [Commented] (HADOOP-18666) A whitelist of endpoints to skip Kerberos authentication doesn't work for ResourceManager and Job History Server

2023-03-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700612#comment-17700612 ] ASF GitHub Bot commented on HADOOP-18666: - tasanuma commented on PR #5480: URL:

  1   2   >