[GitHub] [hadoop] Hexiaoqiao commented on pull request #5607: YARN-11482. Fix bug of DRF comparision DominantResourceFairnessComparator2 in fair scheduler.

Hexiaoqiao commented on PR #5607: URL: https://github.com/apache/hadoop/pull/5607#issuecomment-1528582761 Committed to trunk. Thanks @slfan1989 for your reviews. Will check if other active branches include this issue. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] Hexiaoqiao merged pull request #5607: YARN-11482. Fix bug of DRF comparision DominantResourceFairnessComparator2 in fair scheduler.

Hexiaoqiao merged PR #5607: URL: https://github.com/apache/hadoop/pull/5607 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[GitHub] [hadoop] zhtttylz commented on a diff in pull request #5602: HDFS-16990. HttpFS Add Support getFileLinkStatus API

zhtttylz commented on code in PR #5602: URL: https://github.com/apache/hadoop/pull/5602#discussion_r1180901319 ## hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/client/HttpFSFileSystem.java: ## @@ -1743,6 +1744,19 @@ public BlockLocation[] getFile

[jira] [Commented] (HADOOP-18359) Update commons-cli from 1.2 to 1.5.

[ https://issues.apache.org/jira/browse/HADOOP-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717853#comment-17717853 ] ASF GitHub Bot commented on HADOOP-18359: - hadoop-yetus commented on PR #5095:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5095: HADOOP-18359. Update commons-cli from 1.2 to 1.5.

hadoop-yetus commented on PR #5095: URL: https://github.com/apache/hadoop/pull/5095#issuecomment-1528294617 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5598: YARN-11437. [hotfix][Federation] SQLFederationStateStore Support Version.

hadoop-yetus commented on PR #5598: URL: https://github.com/apache/hadoop/pull/5598#issuecomment-1528252567 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5602: HDFS-16990. HttpFS Add Support getFileLinkStatus API

slfan1989 commented on code in PR #5602: URL: https://github.com/apache/hadoop/pull/5602#discussion_r1180869834 ## hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java: ## @@ -2056,6 +2060,29 @@ private void testGetSnapsho

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5602: HDFS-16990. HttpFS Add Support getFileLinkStatus API

slfan1989 commented on code in PR #5602: URL: https://github.com/apache/hadoop/pull/5602#discussion_r1180869746 ## hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java: ## @@ -2056,6 +2060,29 @@ private void testGetSnapsho

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5602: HDFS-16990. HttpFS Add Support getFileLinkStatus API

slfan1989 commented on code in PR #5602: URL: https://github.com/apache/hadoop/pull/5602#discussion_r1180869291 ## hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/client/HttpFSFileSystem.java: ## @@ -1743,6 +1744,19 @@ public BlockLocation[] getFil

[GitHub] [hadoop] hadoop-yetus commented on pull request #3618: YARN-11000. Replace queue resource calculation logic in updateClusterResource

hadoop-yetus commented on PR #3618: URL: https://github.com/apache/hadoop/pull/3618#issuecomment-1528170494 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717837#comment-17717837 ] ASF GitHub Bot commented on HADOOP-18671: - taklwu commented on PR #5553: URL: h

[GitHub] [hadoop] taklwu commented on pull request #5553: HADOOP-18671 Add recoverLease(), setSafeMode(), isFileClosed() as interfaces to hadoop-common

taklwu commented on PR #5553: URL: https://github.com/apache/hadoop/pull/5553#issuecomment-1528152683 > I wonder if we should move most of the deprecated test invocations to the new api I moved most of the functions to use the new APIs, let's see if the precommit test passes. (I expe

[GitHub] [hadoop] slfan1989 commented on pull request #5570: YARN-11469. Refactor FederationStateStoreFacade Cache Code.

slfan1989 commented on PR #5570: URL: https://github.com/apache/hadoop/pull/5570#issuecomment-1528149295 @goiri Thank you very much for helping to review the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [hadoop] goiri commented on pull request #5596: YARN-11379. [Federation] Support mapAttributesToNodes, getGroupsForUser API's for Federation.

goiri commented on PR #5596: URL: https://github.com/apache/hadoop/pull/5596#issuecomment-1528101114 Let's fix the checkstyle. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [hadoop] goiri merged pull request #5570: YARN-11469. Refactor FederationStateStoreFacade Cache Code.

goiri merged PR #5570: URL: https://github.com/apache/hadoop/pull/5570 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] hadoop-yetus commented on pull request #5602: HDFS-16990. HttpFS Add Support getFileLinkStatus API

hadoop-yetus commented on PR #5602: URL: https://github.com/apache/hadoop/pull/5602#issuecomment-1527944189 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5329: HDFS-16897. fix abundant Broken pipe exception in BlockSender

hadoop-yetus commented on PR #5329: URL: https://github.com/apache/hadoop/pull/5329#issuecomment-1527927530 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5329: HDFS-16897. fix abundant Broken pipe exception in BlockSender

hadoop-yetus commented on PR #5329: URL: https://github.com/apache/hadoop/pull/5329#issuecomment-1527884866 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5591: HDFS-16991. fix testMkdirsRaceWithObserverRead

hadoop-yetus commented on PR #5591: URL: https://github.com/apache/hadoop/pull/5591#issuecomment-1527819201 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18718) Fix several maven build warnings

[ https://issues.apache.org/jira/browse/HADOOP-18718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717727#comment-17717727 ] ASF GitHub Bot commented on HADOOP-18718: - dongjoon-hyun commented on PR #5592:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5592: HADOOP-18718. Fix several maven build warnings

dongjoon-hyun commented on PR #5592: URL: https://github.com/apache/hadoop/pull/5592#issuecomment-1527745355 Thank you, @ayushtkn . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Updated] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-18724: -- Affects Version/s: 3.3.5 > Open file fails with NumberFormatException for S3AFileSystem > ---

[jira] [Updated] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-18724: -- Component/s: fs/s3 > Open file fails with NumberFormatException for S3AFileSystem > -

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717711#comment-17717711 ] Steve Loughran commented on HADOOP-18724: - usual homework: version, module etc

[jira] [Commented] (HADOOP-18715) Introduce gettokenKindMap in org.apache.hadoop.security.token.Token for easier debugging

[ https://issues.apache.org/jira/browse/HADOOP-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717697#comment-17717697 ] Pralabh Kumar commented on HADOOP-18715: [~ayushtkn]     can u please review

[GitHub] [hadoop] hadoop-yetus commented on pull request #5363: YARN-11424. [Federation] Router Supports DeregisterSubCluster.

hadoop-yetus commented on PR #5363: URL: https://github.com/apache/hadoop/pull/5363#issuecomment-1527610500 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5363: YARN-11424. [Federation] Router Supports DeregisterSubCluster.

hadoop-yetus commented on PR #5363: URL: https://github.com/apache/hadoop/pull/5363#issuecomment-1527607405 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18715) Introduce gettokenKindMap in org.apache.hadoop.security.token.Token for easier debugging

[ https://issues.apache.org/jira/browse/HADOOP-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717678#comment-17717678 ] ASF GitHub Bot commented on HADOOP-18715: - hadoop-yetus commented on PR #5608:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5608: HADOOP-18715 Added debug log for getting details of tokenKindMap

hadoop-yetus commented on PR #5608: URL: https://github.com/apache/hadoop/pull/5608#issuecomment-1527584640 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18715) Introduce gettokenKindMap in org.apache.hadoop.security.token.Token for easier debugging

[ https://issues.apache.org/jira/browse/HADOOP-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717677#comment-17717677 ] ASF GitHub Bot commented on HADOOP-18715: - hadoop-yetus commented on PR #5608:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5608: HADOOP-18715 Added debug log for getting details of tokenKindMap

hadoop-yetus commented on PR #5608: URL: https://github.com/apache/hadoop/pull/5608#issuecomment-1527581878 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18715) Introduce gettokenKindMap in org.apache.hadoop.security.token.Token for easier debugging

[ https://issues.apache.org/jira/browse/HADOOP-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717676#comment-17717676 ] ASF GitHub Bot commented on HADOOP-18715: - hadoop-yetus commented on PR #5608:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5608: HADOOP-18715 Added debug log for getting details of tokenKindMap

hadoop-yetus commented on PR #5608: URL: https://github.com/apache/hadoop/pull/5608#issuecomment-1527581284 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Created] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

Ayush Saxena created HADOOP-18724: - Summary: Open file fails with NumberFormatException for S3AFileSystem Key: HADOOP-18724 URL: https://issues.apache.org/jira/browse/HADOOP-18724 Project: Hadoop Comm

[GitHub] [hadoop] hadoop-yetus commented on pull request #5596: YARN-11379. [Federation] Support mapAttributesToNodes、getGroupsForUser API's for Federation.

hadoop-yetus commented on PR #5596: URL: https://github.com/apache/hadoop/pull/5596#issuecomment-1527501296 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5606: YARN-9049. Add application submit data to state store.

hadoop-yetus commented on PR #5606: URL: https://github.com/apache/hadoop/pull/5606#issuecomment-1527492093 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] fanluoo commented on a diff in pull request #5591: HDFS-16991. fix testMkdirsRaceWithObserverRead

fanluoo commented on code in PR #5591: URL: https://github.com/apache/hadoop/pull/5591#discussion_r1180338771 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestObserverNode.java: ## @@ -583,7 +583,6 @@ public void testMkdirsRaceWithOb

[GitHub] [hadoop] fanluoo commented on a diff in pull request #5591: HDFS-16991. fix testMkdirsRaceWithObserverRead

fanluoo commented on code in PR #5591: URL: https://github.com/apache/hadoop/pull/5591#discussion_r1180337304 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestObserverNode.java: ## @@ -583,7 +583,6 @@ public void testMkdirsRaceWithOb

[GitHub] [hadoop] fanluoo commented on a diff in pull request #5329: HDFS-16897. fix abundant Broken pipe exception in BlockSender

fanluoo commented on code in PR #5329: URL: https://github.com/apache/hadoop/pull/5329#discussion_r1180325922 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockSender.java: ## @@ -655,8 +655,11 @@ private int sendPacket(ByteBuffer pkt,

[GitHub] [hadoop] fanluoo commented on a diff in pull request #5329: HDFS-16897. fix abundant Broken pipe exception in BlockSender

fanluoo commented on code in PR #5329: URL: https://github.com/apache/hadoop/pull/5329#discussion_r1180323693 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockSender.java: ## @@ -655,8 +655,11 @@ private int sendPacket(ByteBuffer pkt,

[GitHub] [hadoop] fanluoo commented on a diff in pull request #5329: HDFS-16897. fix abundant Broken pipe exception in BlockSender

fanluoo commented on code in PR #5329: URL: https://github.com/apache/hadoop/pull/5329#discussion_r1180318725 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockSender.java: ## @@ -655,8 +655,11 @@ private int sendPacket(ByteBuffer pkt,

[GitHub] [hadoop] fanluoo commented on a diff in pull request #5329: HDFS-16897. fix abundant Broken pipe exception in BlockSender

fanluoo commented on code in PR #5329: URL: https://github.com/apache/hadoop/pull/5329#discussion_r1180318725 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BlockSender.java: ## @@ -655,8 +655,11 @@ private int sendPacket(ByteBuffer pkt,

[jira] [Commented] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717629#comment-17717629 ] Steve Loughran commented on HADOOP-18410: - +final trunk to branch-3.3 changes c

[jira] [Resolved] (HADOOP-18703) Backport S3A prefetching stream to branch-3.3

[ https://issues.apache.org/jira/browse/HADOOP-18703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18703. - Fix Version/s: 3.3.9 Resolution: Fixed > Backport S3A prefetching stream to bran

[jira] [Updated] (HADOOP-18482) ITestS3APrefetchingInputStream does not skip if no CSV test file available

[ https://issues.apache.org/jira/browse/HADOOP-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18482: Fix Version/s: 3.3.9 > ITestS3APrefetchingInputStream does not skip if no CSV test file a

[jira] [Updated] (HADOOP-18399) S3A Prefetch - SingleFilePerBlockCache to use LocalDirAllocator

[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18399: Fix Version/s: 3.3.9 > S3A Prefetch - SingleFilePerBlockCache to use LocalDirAllocator >

[jira] [Updated] (HADOOP-18189) S3PrefetchingInputStream to support status probes when closed

[ https://issues.apache.org/jira/browse/HADOOP-18189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18189: Fix Version/s: 3.3.9 > S3PrefetchingInputStream to support status probes when closed > --

[jira] [Updated] (HADOOP-18351) S3A prefetching: Error logging during reads

[ https://issues.apache.org/jira/browse/HADOOP-18351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18351: Fix Version/s: 3.3.9 > S3A prefetching: Error logging during reads >

[jira] [Updated] (HADOOP-18378) Implement readFully(long position, byte[] buffer, int offset, int length)

[ https://issues.apache.org/jira/browse/HADOOP-18378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18378: Fix Version/s: 3.3.9 > Implement readFully(long position, byte[] buffer, int offset, int

[jira] [Updated] (HADOOP-18531) assertion failure in ITestS3APrefetchingInputStream

[ https://issues.apache.org/jira/browse/HADOOP-18531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18531: Fix Version/s: 3.3.9 > assertion failure in ITestS3APrefetchingInputStream >

[jira] [Commented] (HADOOP-18416) ITestS3AIOStatisticsContext failure

[ https://issues.apache.org/jira/browse/HADOOP-18416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717627#comment-17717627 ] Steve Loughran commented on HADOOP-18416: - note: the final bit of this went in

[jira] [Updated] (HADOOP-18377) hadoop-aws maven build to add a prefetch profile to run all tests with prefetching

[ https://issues.apache.org/jira/browse/HADOOP-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18377: Fix Version/s: 3.3.9 > hadoop-aws maven build to add a prefetch profile to run all tests

[jira] [Updated] (HADOOP-18466) Limit the findbugs suppression IS2_INCONSISTENT_SYNC to S3AFileSystem field

[ https://issues.apache.org/jira/browse/HADOOP-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18466: Fix Version/s: 3.3.9 > Limit the findbugs suppression IS2_INCONSISTENT_SYNC to S3AFileSys

[jira] [Updated] (HADOOP-18455) s3a prefetching Executor should be closed

[ https://issues.apache.org/jira/browse/HADOOP-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18455: Fix Version/s: 3.4.0 3.3.9 > s3a prefetching Executor should be closed

[jira] [Updated] (HADOOP-18380) fs.s3a.prefetch.block.size to be read through longBytesOption

[ https://issues.apache.org/jira/browse/HADOOP-18380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18380: Fix Version/s: 3.3.9 > fs.s3a.prefetch.block.size to be read through longBytesOption > --

[jira] [Updated] (HADOOP-18186) s3a prefetching to use SemaphoredDelegatingExecutor for submitting work

[ https://issues.apache.org/jira/browse/HADOOP-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18186: Fix Version/s: 3.3.9 > s3a prefetching to use SemaphoredDelegatingExecutor for submitting

[jira] [Updated] (HADOOP-18028) High performance S3A input stream with prefetching & caching

[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18028: Fix Version/s: 3.4.0 3.3.9 > High performance S3A input stream with pr

[GitHub] [hadoop] hadoop-yetus commented on pull request #5363: YARN-11424. [Federation] Router Supports DeregisterSubCluster.

hadoop-yetus commented on PR #5363: URL: https://github.com/apache/hadoop/pull/5363#issuecomment-152743 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717618#comment-17717618 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran commented on PR #5605:

[GitHub] [hadoop] steveloughran commented on pull request #5605: HADOOP-18028. High performance S3A input stream (#4752)

steveloughran commented on PR #5605: URL: https://github.com/apache/hadoop/pull/5605#issuecomment-1527390953 OK, yetus is happy! I will merge locally so the commit chain is not squashed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717616#comment-17717616 ] ASF GitHub Bot commented on HADOOP-18671: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5553: HADOOP-18671 Add recoverLease(), setSafeMode(), isFileClosed() as interfaces to hadoop-common

steveloughran commented on code in PR #5553: URL: https://github.com/apache/hadoop/pull/5553#discussion_r1180268449 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java: ## @@ -1633,6 +1636,53 @@ public DatanodeInfo[] getDataN

[jira] [Commented] (HADOOP-18707) Cannot write to Azure Datalake Gen2 (abfs/abfss) after Spark 3.1.2

[ https://issues.apache.org/jira/browse/HADOOP-18707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717615#comment-17717615 ] Steve Loughran commented on HADOOP-18707: - on hadoop azure 3.3.2+ we default to

[jira] [Commented] (HADOOP-17705) S3A to add option fs.s3a.endpoint.region to set AWS region

[ https://issues.apache.org/jira/browse/HADOOP-17705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717605#comment-17717605 ] ASF GitHub Bot commented on HADOOP-17705: - steveloughran commented on PR #5046:

[jira] [Commented] (HADOOP-17705) S3A to add option fs.s3a.endpoint.region to set AWS region

[ https://issues.apache.org/jira/browse/HADOOP-17705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717606#comment-17717606 ] ASF GitHub Bot commented on HADOOP-17705: - steveloughran closed pull request #5

[GitHub] [hadoop] steveloughran closed pull request #5046: HADOOP-17705. S3A to add Config to set AWS region

steveloughran closed pull request #5046: HADOOP-17705. S3A to add Config to set AWS region URL: https://github.com/apache/hadoop/pull/5046 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hadoop] steveloughran commented on pull request #5046: HADOOP-17705. S3A to add Config to set AWS region

steveloughran commented on PR #5046: URL: https://github.com/apache/hadoop/pull/5046#issuecomment-1527355855 this is done now. closing. all seems to work too! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hadoop] brumi1024 commented on a diff in pull request #3618: YARN-11000. Replace queue resource calculation logic in updateClusterResource

brumi1024 commented on code in PR #3618: URL: https://github.com/apache/hadoop/pull/3618#discussion_r1180225027 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/Abstrac

[jira] [Commented] (HADOOP-18715) Introduce gettokenKindMap in org.apache.hadoop.security.token.Token for easier debugging

[ https://issues.apache.org/jira/browse/HADOOP-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717590#comment-17717590 ] ASF GitHub Bot commented on HADOOP-18715: - pralabhkumar opened a new pull reque

[jira] [Updated] (HADOOP-18715) Introduce gettokenKindMap in org.apache.hadoop.security.token.Token for easier debugging

[ https://issues.apache.org/jira/browse/HADOOP-18715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18715: Labels: pull-request-available (was: ) > Introduce gettokenKindMap in org.apache.hadoop.

[GitHub] [hadoop] pralabhkumar opened a new pull request, #5608: HADOOP-18715 Added debug log for getting details of tokenKindMap

pralabhkumar opened a new pull request, #5608: URL: https://github.com/apache/hadoop/pull/5608 ### Description of PR Added debug Log org.apache.hadoop.security.token.Token for easier debugging of knowing what is contained in tokenKindMap ### How was this patch tested? NA

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5607: YARN-11482. Fix bug of DRF comparision DominantResourceFairnessComparator2 in fair scheduler.

Hexiaoqiao commented on PR #5607: URL: https://github.com/apache/hadoop/pull/5607#issuecomment-1527276016 @slfan1989 Thanks for your reviews. I will commit for a while if no more other comments. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] hadoop-yetus commented on pull request #5570: YARN-11469. Refactor FederationStateStoreFacade Cache Code.

hadoop-yetus commented on PR #5570: URL: https://github.com/apache/hadoop/pull/5570#issuecomment-1527274490 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5587: YARN-10144. Federation: Add missing FederationClientInterceptor APIs.

hadoop-yetus commented on PR #5587: URL: https://github.com/apache/hadoop/pull/5587#issuecomment-1527269182 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5598: YARN-11437. [hotfix][Federation] SQLFederationStateStore Support Version.

hadoop-yetus commented on PR #5598: URL: https://github.com/apache/hadoop/pull/5598#issuecomment-1527262858 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5564: HDFS-16985. delete local block file when FileNotFoundException occurred may lead to missing block.

hadoop-yetus commented on PR #5564: URL: https://github.com/apache/hadoop/pull/5564#issuecomment-1527165386 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717490#comment-17717490 ] ASF GitHub Bot commented on HADOOP-18671: - taklwu commented on code in PR #5553

[GitHub] [hadoop] hadoop-yetus commented on pull request #5607: YARN-11482. Fix bug of DRF comparision DominantResourceFairnessComparator2 in fair scheduler.

hadoop-yetus commented on PR #5607: URL: https://github.com/apache/hadoop/pull/5607#issuecomment-1527083970 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] taklwu commented on a diff in pull request #5553: HADOOP-18671 Add recoverLease(), setSafeMode(), isFileClosed() as interfaces to hadoop-common

taklwu commented on code in PR #5553: URL: https://github.com/apache/hadoop/pull/5553#discussion_r1180006650 ## hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java: ## @@ -1633,6 +1636,53 @@ public DatanodeInfo[] getDataNodeStat