[jira] [Commented] (HADOOP-18750) Spark History Server 3.3.1 fails to starts with Hadoop 3.3.x

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737480#comment-17737480 ] ASF GitHub Bot commented on HADOOP-18750: - kamalsharma2 commented on PR #5695:

[GitHub] [hadoop] kamalsharma2 commented on pull request #5695: HADOOP-18750. Remove javax/servlet shading in hadoop-client-api

2023-06-26 Thread via GitHub
kamalsharma2 commented on PR #5695: URL: https://github.com/apache/hadoop/pull/5695#issuecomment-1608904258 @jojochuang thanks for pointing out the issue. I've removed the shading of javax.servlet from other hadoop client modules too, can you please review it? -- This is an automated mess

[jira] [Commented] (HADOOP-18750) Spark History Server 3.3.1 fails to starts with Hadoop 3.3.x

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737474#comment-17737474 ] ASF GitHub Bot commented on HADOOP-18750: - hadoop-yetus commented on PR #5695:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5695: HADOOP-18750. Remove javax/servlet shading in hadoop-client-api

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5695: URL: https://github.com/apache/hadoop/pull/5695#issuecomment-1608885790 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] slfan1989 opened a new pull request, #5782: YARN-11090. [GPG] Support Secure Mode.

2023-06-26 Thread via GitHub
slfan1989 opened a new pull request, #5782: URL: https://github.com/apache/hadoop/pull/5782 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOO

[GitHub] [hadoop] zhangshuyan0 commented on pull request #5759: HDFS-17052. Erasure coding reconstruction failed when num of storageT…

2023-06-26 Thread via GitHub
zhangshuyan0 commented on PR #5759: URL: https://github.com/apache/hadoop/pull/5759#issuecomment-1608786418 @zhtttylz How about combining the above two solutions? May avoid the drawbacks of both options. ``` private void chooseEvenlyFromRemainingRacks(Node writer, Set excluded

[GitHub] [hadoop] zhangshuyan0 commented on pull request #5759: HDFS-17052. Erasure coding reconstruction failed when num of storageT…

2023-06-26 Thread via GitHub
zhangshuyan0 commented on PR #5759: URL: https://github.com/apache/hadoop/pull/5759#issuecomment-1608767547 > Thank you for your review. We appreciate your suggestion. However, in situations where the number of available racks is insufficient to meet the requirements of the Erasure Coding s

[jira] [Commented] (HADOOP-18756) CachingBlockManager to use AtomicBoolean for closed flag

2023-06-26 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737387#comment-17737387 ] Viraj Jasani commented on HADOOP-18756: --- Steve, could you please help close this

[GitHub] [hadoop] xinglin commented on pull request #5764: HDFS-17055 Export HAState as a metric from Namenode for monitoring

2023-06-26 Thread via GitHub
xinglin commented on PR #5764: URL: https://github.com/apache/hadoop/pull/5764#issuecomment-1608427457 Thanks @goiri / @melissayou for reviewing this PR. thanks @goiri for merging into trunk! -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [hadoop] goiri merged pull request #5764: HDFS-17055 Export HAState as a metric from Namenode for monitoring

2023-06-26 Thread via GitHub
goiri merged PR #5764: URL: https://github.com/apache/hadoop/pull/5764 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[jira] [Commented] (HADOOP-18751) Fix incorrect output path in javadoc build phase

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737372#comment-17737372 ] ASF GitHub Bot commented on HADOOP-18751: - goiri merged PR #5688: URL: https://

[jira] [Resolved] (HADOOP-18751) Fix incorrect output path in javadoc build phase

2023-06-26 Thread Jira
[ https://issues.apache.org/jira/browse/HADOOP-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HADOOP-18751. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix incorrect out

[GitHub] [hadoop] goiri merged pull request #5688: HADOOP-18751. Fix incorrect output path in javadoc build phase

2023-06-26 Thread via GitHub
goiri merged PR #5688: URL: https://github.com/apache/hadoop/pull/5688 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] hadoop-yetus commented on pull request #5204: HDFS-16864. Drop cache behind entire block on close

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5204: URL: https://github.com/apache/hadoop/pull/5204#issuecomment-1608309531 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Resolved] (HADOOP-18765) Release 3.3.6

2023-06-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18765. -- Fix Version/s: 3.3.6 Resolution: Done > Release 3.3.6 > - > >

[jira] [Resolved] (HADOOP-18766) 3.3.6 Dependency vulnerability check

2023-06-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18766. -- Fix Version/s: 3.3.6 Resolution: Done > 3.3.6 Dependency vulnerability check >

[GitHub] [hadoop] hadoop-yetus commented on pull request #5752: YARN-11515. [Federation] Improve DefaultRequestInterceptor#init Code.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5752: URL: https://github.com/apache/hadoop/pull/5752#issuecomment-1607919853 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] melissayou commented on pull request #5764: HDFS-17055 Export HAState as a metric from Namenode for monitoring

2023-06-26 Thread via GitHub
melissayou commented on PR #5764: URL: https://github.com/apache/hadoop/pull/5764#issuecomment-1607862076 lgtm to merge. Thanks! @goiri -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [hadoop] goiri merged pull request #5766: YARN-11517. Improve Federation#RouterCLI DeregisterSubCluster Code.

2023-06-26 Thread via GitHub
goiri merged PR #5766: URL: https://github.com/apache/hadoop/pull/5766 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] goiri commented on pull request #5764: HDFS-17055 Export HAState as a metric from Namenode for monitoring

2023-06-26 Thread via GitHub
goiri commented on PR #5764: URL: https://github.com/apache/hadoop/pull/5764#issuecomment-1607841334 @melissayou further comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [hadoop] goiri merged pull request #5775: HDFS-17057. RBF: Add DataNode maintenance states to Federation UI

2023-06-26 Thread via GitHub
goiri merged PR #5775: URL: https://github.com/apache/hadoop/pull/5775 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[jira] [Commented] (HADOOP-18751) Fix incorrect output path in javadoc build phase

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737240#comment-17737240 ] ASF GitHub Bot commented on HADOOP-18751: - goiri commented on PR #5688: URL: ht

[GitHub] [hadoop] goiri commented on pull request #5688: HADOOP-18751. Fix incorrect output path in javadoc build phase

2023-06-26 Thread via GitHub
goiri commented on PR #5688: URL: https://github.com/apache/hadoop/pull/5688#issuecomment-1607823970 This approach LGTM. @ayushtkn do you mind taking a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[jira] [Commented] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

2023-06-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737231#comment-17737231 ] Wei-Chiu Chuang commented on HADOOP-18769: -- For future reference: https://hub.

[jira] [Resolved] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

2023-06-26 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18769. -- Fix Version/s: 3.3.6 Resolution: Fixed > Upgrade hadoop3 docker scripts to use

[GitHub] [hadoop] slfan1989 commented on pull request #5766: YARN-11517. Improve Federation#RouterCLI DeregisterSubCluster Code.

2023-06-26 Thread via GitHub
slfan1989 commented on PR #5766: URL: https://github.com/apache/hadoop/pull/5766#issuecomment-1607756701 @goiri Can you help review this pr again ? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] [Commented] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737198#comment-17737198 ] ASF GitHub Bot commented on HADOOP-18769: - jojochuang commented on PR #5781: UR

[GitHub] [hadoop] jojochuang commented on pull request #5781: HADOOP-18769. Upgrade hadoop3 docker scripts to use 3.3.6.

2023-06-26 Thread via GitHub
jojochuang commented on PR #5781: URL: https://github.com/apache/hadoop/pull/5781#issuecomment-1607728927 Thanks Ayush. Setting up the dockerhub tag rules for 3.3.6 and triggering a manual build now. -- This is an automated message from the Apache Git Service. To respond to the message, p

[jira] [Commented] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737196#comment-17737196 ] ASF GitHub Bot commented on HADOOP-18769: - jojochuang merged PR #5781: URL: htt

[GitHub] [hadoop] jojochuang merged pull request #5781: HADOOP-18769. Upgrade hadoop3 docker scripts to use 3.3.6.

2023-06-26 Thread via GitHub
jojochuang merged PR #5781: URL: https://github.com/apache/hadoop/pull/5781 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Updated] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18769: Labels: pull-request-available (was: ) > Upgrade hadoop3 docker scripts to use 3.3.6 > -

[jira] [Commented] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737189#comment-17737189 ] ASF GitHub Bot commented on HADOOP-18769: - jojochuang opened a new pull request

[GitHub] [hadoop] jojochuang opened a new pull request, #5781: HADOOP-18769. Upgrade hadoop3 docker scripts to use 3.3.6.

2023-06-26 Thread via GitHub
jojochuang opened a new pull request, #5781: URL: https://github.com/apache/hadoop/pull/5781 ### Description of PR Upate apache/hadoop docker image to build using Hadoop 3.3.6. ### How was this patch tested? Ran locally. ### For code changes: - [ ] Does the title or

[GitHub] [hadoop] pjfanning commented on pull request #5623: YARN-11498. Exclude jettison from jersey-json artifact as on older version is being pulled

2023-06-26 Thread via GitHub
pjfanning commented on PR #5623: URL: https://github.com/apache/hadoop/pull/5623#issuecomment-1607652858 Thanks for the feedback Steve. This PR adds the exclusion to just one place where jersey-json is imported. Should it not add the exclusion in all places where jersey-json is import

[GitHub] [hadoop] steveloughran commented on pull request #5623: YARN-11498. Exclude jettison from jersey-json artifact as on older version is being pulled

2023-06-26 Thread via GitHub
steveloughran commented on PR #5623: URL: https://github.com/apache/hadoop/pull/5623#issuecomment-1607642836 maven picks up closest version to the root; ivy (hence gradle and SBT) does it differently. Sometimes downstream projects break even though hadoop is happy. this makes it worthwhile

[jira] [Commented] (HADOOP-18757) S3A Committer finalyzing the commits in a single thread

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737179#comment-17737179 ] ASF GitHub Bot commented on HADOOP-18757: - steveloughran commented on PR #5706:

[GitHub] [hadoop] steveloughran commented on pull request #5706: HADOOP-18757: Bump corePoolSize of HadoopThreadPoolExecutor in s3a committer

2023-06-26 Thread via GitHub
steveloughran commented on PR #5706: URL: https://github.com/apache/hadoop/pull/5706#issuecomment-1607637530 # ITestS3AFileSystemStatistic > The test succeeds when its run by itself. I suppose it could be becuase the fs might be reused between tests and we count the fsStats.getBytesRead()

[jira] [Commented] (HADOOP-18781) ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737175#comment-17737175 ] ASF GitHub Bot commented on HADOOP-18781: - steveloughran commented on PR #5780:

[GitHub] [hadoop] steveloughran commented on pull request #5780: HADOOP-18781. ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread via GitHub
steveloughran commented on PR #5780: URL: https://github.com/apache/hadoop/pull/5780#issuecomment-1607619476 * Actually, existing HadoopExecutors could store stack of close() and include it in exceptions raised, this would benefit all uses. * could we have abfs.close() log at debug the st

[jira] [Commented] (HADOOP-18781) ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737167#comment-17737167 ] ASF GitHub Bot commented on HADOOP-18781: - hadoop-yetus commented on PR #5780:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5780: HADOOP-18781. ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5780: URL: https://github.com/apache/hadoop/pull/5780#issuecomment-1607583413 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] zhtttylz commented on pull request #5759: HDFS-17052. Erasure coding reconstruction failed when num of storageT…

2023-06-26 Thread via GitHub
zhtttylz commented on PR #5759: URL: https://github.com/apache/hadoop/pull/5759#issuecomment-1607494203 @ayushtkn @Hexiaoqiao @zhangshuyan0 Would you be willing to discuss this issue together and provide me with some advice? -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] zhtttylz commented on pull request #5759: HDFS-17052. Erasure coding reconstruction failed when num of storageT…

2023-06-26 Thread via GitHub
zhtttylz commented on PR #5759: URL: https://github.com/apache/hadoop/pull/5759#issuecomment-1607490022 > Great catch here! It's make sense to me. I have some thoughts to discuss with you. The solution here may involve multiple calls to `chooseOnce`, some of which may be unnecessary and was

[GitHub] [hadoop] pjfanning commented on pull request #5623: YARN-11498. Exclude jettison from jersey-json artifact as on older version is being pulled

2023-06-26 Thread via GitHub
pjfanning commented on PR #5623: URL: https://github.com/apache/hadoop/pull/5623#issuecomment-1607477365 I ran `mvn dependencyTree` in the `branch-3.3` and the new version of jettison is what appears in the tree even without this change. So I don't think a backport is needed. https:/

[GitHub] [hadoop] steveloughran commented on pull request #5623: YARN-11498. Exclude jettison from jersey-json artifact as on older version is being pulled

2023-06-26 Thread via GitHub
steveloughran commented on PR #5623: URL: https://github.com/apache/hadoop/pull/5623#issuecomment-1607441099 ok: can someone do a backport PR for a test run? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Commented] (HADOOP-18778) Test failures with CSE enabled

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737136#comment-17737136 ] ASF GitHub Bot commented on HADOOP-18778: - ahmarsuhail commented on PR #5763: U

[GitHub] [hadoop] ahmarsuhail commented on pull request #5763: HADOOP-18778. Fixes failing tests when CSE is enabled.

2023-06-26 Thread via GitHub
ahmarsuhail commented on PR #5763: URL: https://github.com/apache/hadoop/pull/5763#issuecomment-1607422076 Thanks @mehakmeet , have updated the constant name, and fixed the test in `ITestPartialRenamesDeletes` to include the instruction file in the policy -- This is an automated message f

[jira] [Commented] (HADOOP-18781) ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737135#comment-17737135 ] ASF GitHub Bot commented on HADOOP-18781: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5780: HADOOP-18781. ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread via GitHub
steveloughran commented on code in PR #5780: URL: https://github.com/apache/hadoop/pull/5780#discussion_r1242136105 ## hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azurebfs/services/ITestAbfsOutputStream.java: ## @@ -84,4 +88,34 @@ public void testMaxRequestsAndQ

[jira] [Commented] (HADOOP-18778) Test failures with CSE enabled

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737134#comment-17737134 ] ASF GitHub Bot commented on HADOOP-18778: - hadoop-yetus commented on PR #5763:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5763: HADOOP-18778. Fixes failing tests when CSE is enabled.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5763: URL: https://github.com/apache/hadoop/pull/5763#issuecomment-1607413650 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18781) ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737127#comment-17737127 ] ASF GitHub Bot commented on HADOOP-18781: - mehakmeet commented on PR #5780: URL

[GitHub] [hadoop] mehakmeet commented on pull request #5780: HADOOP-18781. ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread via GitHub
mehakmeet commented on PR #5780: URL: https://github.com/apache/hadoop/pull/5780#issuecomment-1607373617 CC: @steveloughran @mukund-thakur Cannot think of another test other than checking if the correct fs instance is passed. But I did have a test in my local where I tried to explicitly run

[jira] [Commented] (HADOOP-18781) ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737126#comment-17737126 ] ASF GitHub Bot commented on HADOOP-18781: - mehakmeet opened a new pull request,

[jira] [Updated] (HADOOP-18781) ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18781: Labels: pull-request-available (was: ) > ABFS Output stream thread pools getting shutdow

[GitHub] [hadoop] mehakmeet opened a new pull request, #5780: HADOOP-18781. ABFS Output stream thread pools getting shutdown during GC.

2023-06-26 Thread via GitHub
mehakmeet opened a new pull request, #5780: URL: https://github.com/apache/hadoop/pull/5780 ### Description of PR Applications using AzureBlobFileSystem to create the AbfsOutputStream can use the AbfsOutputStream for the purpose of writing, however, the OutputStream doesn't hold any refe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5778: HDFS-17060. BlockPlacementPolicyDefault#chooseReplicaToDelete should consider datanode load.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5778: URL: https://github.com/apache/hadoop/pull/5778#issuecomment-1607349894 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5778: HDFS-17060. BlockPlacementPolicyDefault#chooseReplicaToDelete should consider datanode load.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5778: URL: https://github.com/apache/hadoop/pull/5778#issuecomment-1607305414 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] ayushtkn commented on pull request #5750: HADOOP-18773. Upgrade maven-shade-plugin to 3.4.1

2023-06-26 Thread via GitHub
ayushtkn commented on PR #5750: URL: https://github.com/apache/hadoop/pull/5750#issuecomment-1607283944 whats the plan here? anyone has any comments? or should we merge this, I don't think this induces any new bugs or issues? Let me know your thoughts, if anyone wants me to hold merging thi

[jira] [Commented] (HADOOP-18773) Upgrade maven-shade-plugin to 3.4.1

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737105#comment-17737105 ] ASF GitHub Bot commented on HADOOP-18773: - ayushtkn commented on PR #5750: URL:

[jira] [Commented] (HADOOP-15984) Update jersey from 1.19 to 2.x

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737103#comment-17737103 ] ASF GitHub Bot commented on HADOOP-15984: - hadoop-yetus commented on PR #5768:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5768: HADOOP-15984. Jersey 2.x upgrade

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5768: URL: https://github.com/apache/hadoop/pull/5768#issuecomment-1607260893 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18778) Test failures with CSE enabled

2023-06-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737099#comment-17737099 ] ASF GitHub Bot commented on HADOOP-18778: - hadoop-yetus commented on PR #5763:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5763: HADOOP-18778. Fixes failing tests when CSE is enabled.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5763: URL: https://github.com/apache/hadoop/pull/5763#issuecomment-1607239464 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5779: Add CodeQL workflow

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5779: URL: https://github.com/apache/hadoop/pull/5779#issuecomment-1607208128 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Updated] (HADOOP-18521) ABFS ReadBufferManager buffer sharing across concurrent HTTP requests

2023-06-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18521: Description: {{AbfsInputStream.close()}} can trigger the return of buffers used for activ

[GitHub] [hadoop] jorgectf opened a new pull request, #5779: Add CodeQL workflow

2023-06-26 Thread via GitHub
jorgectf opened a new pull request, #5779: URL: https://github.com/apache/hadoop/pull/5779 Hello from [GitHub Security Lab](https://securitylab.github.com/)! Your repository is critical to the security of the Open Source Software (OSS) ecosystem and as part of our mission to make OSS

[GitHub] [hadoop] hadoop-yetus commented on pull request #5776: HDFS-17058. Some statements in testChooseReplicaToDelete method seems useless.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5776: URL: https://github.com/apache/hadoop/pull/5776#issuecomment-1607051550 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5778: HDFS-17060. BlockPlacementPolicyDefault#chooseReplicaToDelete should consider datanode load.

2023-06-26 Thread via GitHub
hadoop-yetus commented on PR #5778: URL: https://github.com/apache/hadoop/pull/5778#issuecomment-1606958314 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] xinglin commented on a diff in pull request #5778: HDFS-17060. BlockPlacementPolicyDefault#chooseReplicaToDelete should consider datanode load.

2023-06-26 Thread via GitHub
xinglin commented on code in PR #5778: URL: https://github.com/apache/hadoop/pull/5778#discussion_r1241778060 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java: ## @@ -276,6 +276,10 @@ public class DFSConfigKeys extends CommonConfiguratio