[jira] [Assigned] (YARN-9035) Allow better troubleshooting of FS container assignments and lack of container assignments

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9035: Assignee: (was: Szilard Nemeth) > Allow better troubleshooting of FS container assignme

[jira] [Assigned] (YARN-9856) Remove log-aggregation related duplicate function

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9856: Assignee: (was: Szilard Nemeth) > Remove log-aggregation related duplicate function > -

[jira] [Assigned] (YARN-10843) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler - part II

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10843: - Assignee: (was: Szilard Nemeth) > [Umbrella] Tools to help migration from Fair Sched

[jira] [Assigned] (YARN-10249) Various ResourceManager tests are failing on branch-3.2

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10249: - Assignee: (was: Szilard Nemeth) > Various ResourceManager tests are failing on branc

[jira] [Updated] (YARN-7505) RM REST endpoints generate malformed JSON

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7505: - Description: For all endpoints that return DAOs that contain maps, the generated JSON is malforme

[jira] [Assigned] (YARN-7505) RM REST endpoints generate malformed JSON

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7505: Assignee: (was: Szilard Nemeth) > RM REST endpoints generate malformed JSON > -

[jira] [Assigned] (YARN-9450) TestCapacityOverTimePolicy#testAllocation fails sporadically

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9450: Assignee: (was: Szilard Nemeth) > TestCapacityOverTimePolicy#testAllocation fails spora

[jira] [Assigned] (YARN-10877) SLSSchedulerCommons: Consider using application map from AbstractYarnScheduler and make event handling more consistent

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10877: - Assignee: (was: Szilard Nemeth) > SLSSchedulerCommons: Consider using application ma

[jira] [Assigned] (YARN-10799) Eliminate queue name replacement in ApplicationSubmissionContext based on placement context

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10799: - Assignee: (was: Szilard Nemeth) > Eliminate queue name replacement in ApplicationSub

[jira] [Assigned] (YARN-9511) TestAuxServices#testRemoteAuxServiceClassPath YarnRuntimeException: The remote jarfile should not be writable by group or others. The current Permission is 436

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9511: Assignee: (was: Szilard Nemeth) > TestAuxServices#testRemoteAuxServiceClassPath YarnRun

[jira] [Assigned] (YARN-10264) Add container launch related env / classpath debug info to container logs when a container fails

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10264: - Assignee: (was: Szilard Nemeth) > Add container launch related env / classpath debug

[jira] [Assigned] (YARN-10798) Enhancements in RMAppManager: createAndPopulateNewRMApp and copyPlacementQueueToSubmissionContext

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10798: - Assignee: (was: Szilard Nemeth) > Enhancements in RMAppManager: createAndPopulateNew

[jira] [Assigned] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9047: Assignee: (was: Szilard Nemeth) > FairScheduler: default resource calculator is not res

[jira] [Assigned] (YARN-8078) TestDistributedShell#testDSShellWithoutDomainV2 fails on trunk

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8078: Assignee: (was: Szilard Nemeth) > TestDistributedShell#testDSShellWithoutDomainV2 fails

[jira] [Assigned] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9421: Assignee: (was: Szilard Nemeth) > Implement SafeMode for ResourceManager by defining a

[jira] [Assigned] (YARN-5684) testDecreaseAfterIncreaseWithAllocationExpiration fails intermittently

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-5684: Assignee: (was: Szilard Nemeth) > testDecreaseAfterIncreaseWithAllocationExpiration fai

[jira] [Assigned] (YARN-6286) TestCapacityScheduler.testAMLimitUsage throws UndeclaredThrowableException

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-6286: Assignee: (was: Szilard Nemeth) > TestCapacityScheduler.testAMLimitUsage throws Undecla

[jira] [Updated] (YARN-5897) Use drainEvent to replace sleep-wait in MockRM#waitForState

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-5897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5897: - Summary: Use drainEvent to replace sleep-wait in MockRM#waitForState (was: using drainEvent to re

[jira] [Assigned] (YARN-8818) Yarn log aggregation of spark streaming job

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8818: Assignee: (was: Szilard Nemeth) > Yarn log aggregation of spark streaming job > ---

[jira] [Assigned] (YARN-7631) ResourceRequest with different Capacity (Resource) overrides each other in RM and thus lost

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7631: Assignee: (was: Szilard Nemeth) > ResourceRequest with different Capacity (Resource) ov

[jira] [Assigned] (YARN-7903) Method getStarvedResourceRequests() only consider the first encountered resource

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7903: Assignee: (was: Szilard Nemeth) > Method getStarvedResourceRequests() only consider the

[jira] [Assigned] (YARN-10837) Break down effectiveMinRatio calculation in ResourceConfigMode

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10837: - Assignee: (was: Szilard Nemeth) > Break down effectiveMinRatio calculation in Resour

[jira] [Assigned] (YARN-4929) Explore a better way than sleeping for a while in some test cases

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-4929: Assignee: (was: Szilard Nemeth) > Explore a better way than sleeping for a while in som

[jira] [Assigned] (YARN-7908) TestSystemMetricsPublisher#testPublishContainerMetrics can fail with an NPE

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7908: Assignee: (was: Szilard Nemeth) > TestSystemMetricsPublisher#testPublishContainerMetric

[jira] [Assigned] (YARN-10836) Clean up queue config mode methods

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10836: - Assignee: (was: Szilard Nemeth) > Clean up queue config mode methods > -

[jira] [Commented] (YARN-7548) TestCapacityOverTimePolicy.testAllocation is flaky

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820070#comment-17820070 ] Szilard Nemeth commented on YARN-7548: -- [~susheel_7] Sure, feel free to assign it to

[jira] [Assigned] (YARN-10853) Add more tests to TestUsersManager

2024-02-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10853: - Assignee: (was: Szilard Nemeth) > Add more tests to TestUsersManager > -

[jira] [Resolved] (YARN-11590) RM process stuck after calling confStore.format() when ZK SSL/TLS is enabled, as netty thread waits indefinitely

2023-10-16 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-11590. --- Hadoop Flags: Reviewed Resolution: Fixed > RM process stuck after calling confStore.for

[jira] [Updated] (YARN-11590) RM process stuck after calling confStore.format() when ZK SSL/TLS is enabled, as netty thread waits indefinitely

2023-10-16 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11590: -- Fix Version/s: 3.4.0 > RM process stuck after calling confStore.format() when ZK SSL/TLS is ena

[jira] [Resolved] (YARN-11468) Zookeeper SSL/TLS support

2023-09-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-11468. --- Fix Version/s: 3.4.0 Resolution: Fixed > Zookeeper SSL/TLS support > -

[jira] [Updated] (YARN-11573) Add config option to make container allocation prefer nodes without reserved containers

2023-09-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11573: -- Fix Version/s: 3.4.0 > Add config option to make container allocation prefer nodes without rese

[jira] [Updated] (YARN-11573) Add config option to make container allocation prefer nodes without reserved containers

2023-09-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11573: -- Description: Applications could be stuck when the container allocation logic does not consider

[jira] [Updated] (YARN-11573) Add config option to make container allocation prefer nodes without reserved containers

2023-09-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11573: -- Description: Applications could be stuck when the container allocation logic does not consider

[jira] [Created] (YARN-11573) Add config option to make container allocation prefer nodes without reserved containers

2023-09-18 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-11573: - Summary: Add config option to make container allocation prefer nodes without reserved containers Key: YARN-11573 URL: https://issues.apache.org/jira/browse/YARN-11573

[jira] [Created] (YARN-11523) CapacityScheduler.md is incorrectly formatted

2023-06-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-11523: - Summary: CapacityScheduler.md is incorrectly formatted Key: YARN-11523 URL: https://issues.apache.org/jira/browse/YARN-11523 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-11490) JMX QueueMetrics breaks after mutable config validation in CS

2023-05-11 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721946#comment-17721946 ] Szilard Nemeth commented on YARN-11490: --- Hi [~tdomok], Nice finding. I do agree wi

[jira] [Updated] (YARN-11482) Fix bug of DRF comparison DominantResourceFairnessComparator2 in fair scheduler

2023-05-04 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11482: -- Summary: Fix bug of DRF comparison DominantResourceFairnessComparator2 in fair scheduler (was:

[jira] [Commented] (YARN-11464) queue element is added to any other  leaf queue, it's queueType becomes QueueType.PARENT_QUEUE

2023-05-04 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17719603#comment-17719603 ] Szilard Nemeth commented on YARN-11464: --- Hi [~susheel_7] , Is this a test only iss

[jira] [Resolved] (YARN-11079) Make an AbstractParentQueue to store common ParentQueue and ManagedParentQueue functionality

2023-05-04 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-11079. --- Hadoop Flags: Reviewed Resolution: Fixed > Make an AbstractParentQueue to store common

[jira] [Updated] (YARN-11079) Make an AbstractParentQueue to store common ParentQueue and ManagedParentQueue functionality

2023-05-04 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11079: -- Fix Version/s: 3.4.0 > Make an AbstractParentQueue to store common ParentQueue and > ManagedPa

[jira] [Updated] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract

2023-05-04 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10178: -- Description: Stack trace: {code:java} ERROR org.apache.hadoop.yarn.server.resourcemanager.Resou

[jira] [Updated] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract

2023-05-04 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10178: -- Description: Stack trace: {code:java} ERROR org.apache.hadoop.yarn.server.resourcemanager.Resou

[jira] [Resolved] (YARN-11415) Refactor TestConfigurationFieldsBase and the connected test classes

2023-03-06 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-11415. --- Resolution: Not A Problem > Refactor TestConfigurationFieldsBase and the connected test class

[jira] [Commented] (YARN-11415) Refactor TestConfigurationFieldsBase and the connected test classes

2023-03-06 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696896#comment-17696896 ] Szilard Nemeth commented on YARN-11415: --- Based on our offline discussion with [~bte

[jira] [Created] (YARN-11450) Improvements for TestYarnConfigurationFields and TestConfigurationFieldsBase

2023-03-05 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-11450: - Summary: Improvements for TestYarnConfigurationFields and TestConfigurationFieldsBase Key: YARN-11450 URL: https://issues.apache.org/jira/browse/YARN-11450 Project:

[jira] [Comment Edited] (YARN-11415) Refactor TestConfigurationFieldsBase and the connected test classes

2023-03-05 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696584#comment-17696584 ] Szilard Nemeth edited comment on YARN-11415 at 3/5/23 4:21 PM:

[jira] [Commented] (YARN-11415) Refactor TestConfigurationFieldsBase and the connected test classes

2023-03-05 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696584#comment-17696584 ] Szilard Nemeth commented on YARN-11415: --- Hi [~bteke], I just briefly checked this.

[jira] [Updated] (YARN-11427) Pull up the versioned imports in pom of hadoop-mapreduce-client-app to hadoop-project pom

2023-02-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11427: -- Description: The versioned imports in pom.xml of hadoop-mapreduce-client-app can be pulled up

[jira] [Updated] (YARN-11427) Pull up the versioned imports in pom of hadoop-mapreduce-client-app to hadoop-project pom

2023-02-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11427: -- Summary: Pull up the versioned imports in pom of hadoop-mapreduce-client-app to hadoop-project

[jira] [Assigned] (YARN-11372) Migrate legacy AQC to flexible AQC

2023-01-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-11372: - Assignee: Peter Szucs > Migrate legacy AQC to flexible AQC > ---

[jira] [Updated] (YARN-11372) Migrate legacy AQC to flexible AQC

2023-01-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11372: -- Parent Issue: YARN-10889 (was: YARN-10888) > Migrate legacy AQC to flexible AQC >

[jira] [Resolved] (YARN-10965) Centralize queue resource calculation based on CapacityVectors

2023-01-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10965. --- Hadoop Flags: Reviewed Resolution: Fixed > Centralize queue resource calculation based

[jira] [Updated] (YARN-10965) Centralize queue resource calculation based on CapacityVectors

2023-01-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10965: -- Fix Version/s: 3.4.0 > Centralize queue resource calculation based on CapacityVectors > ---

[jira] [Updated] (YARN-6971) Clean up different ways to create resources

2023-01-25 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6971: - Fix Version/s: 3.4.0 > Clean up different ways to create resources > -

[jira] [Resolved] (YARN-6971) Clean up different ways to create resources

2023-01-25 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-6971. -- Hadoop Flags: Reviewed Resolution: Fixed > Clean up different ways to create resources > -

[jira] [Updated] (YARN-11416) FS2CS should use CapacitySchedulerConfiguration in FSQueueConverterBuilder

2023-01-25 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11416: -- Description: org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.converter.FSQueueConv

[jira] [Updated] (YARN-5607) Document TestContainerResourceUsage#waitForContainerCompletion

2023-01-25 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5607: - Fix Version/s: 3.4.0 > Document TestContainerResourceUsage#waitForContainerCompletion > --

[jira] [Updated] (YARN-11404) Add junit5 dependency to hadoop-mapreduce-client-app to fix few unit test failure

2023-01-25 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11404: -- Fix Version/s: 3.4.0 > Add junit5 dependency to hadoop-mapreduce-client-app to fix few unit tes

[jira] [Resolved] (YARN-11404) Add junit5 dependency to hadoop-mapreduce-client-app to fix few unit test failure

2023-01-25 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-11404. --- Hadoop Flags: Reviewed Resolution: Fixed > Add junit5 dependency to hadoop-mapreduce-cl

[jira] [Updated] (YARN-11409) Fix Typo of ResourceManager#webapp module

2023-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11409: -- Summary: Fix Typo of ResourceManager#webapp module (was: Fix Typo of ResourceManager#webapp mo

[jira] [Updated] (YARN-11404) Add junit5 dependency to hadoop-mapreduce-client-app to fix few unit test failure

2023-01-12 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11404: -- Attachment: patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client

[jira] [Assigned] (YARN-11415) Refactor TestConfigurationFieldsBase and the connected test classes

2023-01-11 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-11415: - Assignee: Szilard Nemeth > Refactor TestConfigurationFieldsBase and the connected test c

[jira] [Commented] (YARN-11355) YARN Client Failovers immediately to rm2 but takes ~30000ms to rm3

2023-01-10 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656635#comment-17656635 ] Szilard Nemeth commented on YARN-11355: --- Hi [~vineethNaroju], You have to move this

[jira] [Updated] (YARN-11410) Add default methods for StateMachine

2023-01-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11410: -- Description: YARN-11395 created a new method in the StateMachine interface, what can break the

[jira] [Updated] (YARN-11395) Resource Manager UI, cluster/appattempt/*, can not present FINAL_SAVING state

2023-01-06 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11395: -- Description: If an attempt is in *FINAL_SAVING* state, the *RMAppAttemptBlock#createAttemptHea

[jira] [Commented] (YARN-10905) Investigate if AbstractCSQueue#configuredNodeLabels vs. QueueCapacities#getExistingNodeLabels holds the same data

2023-01-03 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17654073#comment-17654073 ] Szilard Nemeth commented on YARN-10905: --- Hi [~pszucs], Thanks for your investigati

[jira] [Resolved] (YARN-10946) AbstractCSQueue: Create separate class for constructing Queue API objects

2022-12-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10946. --- Hadoop Flags: Reviewed Resolution: Fixed > AbstractCSQueue: Create separate class for c

[jira] [Updated] (YARN-10946) AbstractCSQueue: Create separate class for constructing Queue API objects

2022-12-01 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10946: -- Fix Version/s: 3.4.0 > AbstractCSQueue: Create separate class for constructing Queue API object

[jira] [Reopened] (YARN-10959) Extract common method of two that check if preemption disabled in CSQueuePreemption

2022-11-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reopened YARN-10959: --- > Extract common method of two that check if preemption disabled in > CSQueuePreemption > --

[jira] [Resolved] (YARN-10959) Extract common method of two that check if preemption disabled in CSQueuePreemption

2022-11-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10959. --- Resolution: Won't Fix > Extract common method of two that check if preemption disabled in >

[jira] [Resolved] (YARN-8262) get_executable in container-executor should provide meaningful error codes

2022-11-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-8262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-8262. -- Hadoop Flags: Reviewed Resolution: Fixed > get_executable in container-executor should pro

[jira] [Updated] (YARN-8262) get_executable in container-executor should provide meaningful error codes

2022-11-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-8262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8262: - Fix Version/s: 3.4.0 > get_executable in container-executor should provide meaningful error codes

[jira] [Updated] (YARN-11369) Commons.compress throws an IllegalArgumentException with large uids after 1.21

2022-11-16 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11369: -- Fix Version/s: 3.4.0 > Commons.compress throws an IllegalArgumentException with large uids afte

[jira] [Assigned] (YARN-10886) Cluster based and parent based max capacity in Capacity Scheduler

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10886: - Assignee: (was: Szilard Nemeth) > Cluster based and parent based max capacity in Cap

[jira] [Assigned] (YARN-10959) Extract common method of two that check if preemption disabled in CSQueuePreemption

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10959: - Assignee: (was: Szilard Nemeth) > Extract common method of two that check if preempt

[jira] [Assigned] (YARN-10946) AbstractCSQueue: Create separate class for constructing Queue API objects

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10946: - Assignee: (was: Szilard Nemeth) > AbstractCSQueue: Create separate class for constru

[jira] [Assigned] (YARN-10921) AbstractCSQueue: Node Labels logic is scattered and iteration logic is repeated all over the place

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10921: - Assignee: (was: Szilard Nemeth) > AbstractCSQueue: Node Labels logic is scattered an

[jira] [Assigned] (YARN-10926) Test validation after YARN-10504 and YARN-10506: Check if modified test expectations are correct or not

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10926: - Assignee: (was: Szilard Nemeth) > Test validation after YARN-10504 and YARN-10506: C

[jira] [Resolved] (YARN-10920) Create a dedicated class for Node Labels

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10920. --- Resolution: Won't Fix Since this is a huge effort and pretty hard, I think there's would be a

[jira] [Assigned] (YARN-10920) Create a dedicated class for Node Labels

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10920: - Assignee: (was: Szilard Nemeth) > Create a dedicated class for Node Labels > ---

[jira] [Assigned] (YARN-10905) Investigate if AbstractCSQueue#configuredNodeLabels vs. QueueCapacities#getExistingNodeLabels holds the same data

2022-11-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10905: - Assignee: (was: Szilard Nemeth) > Investigate if AbstractCSQueue#configuredNodeLabel

[jira] [Resolved] (YARN-10005) Code improvements in MutableCSConfigurationProvider

2022-11-12 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10005. --- Hadoop Flags: Reviewed Resolution: Fixed > Code improvements in MutableCSConfigurationP

[jira] [Updated] (YARN-10005) Code improvements in MutableCSConfigurationProvider

2022-11-12 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10005: -- Fix Version/s: 3.4.0 > Code improvements in MutableCSConfigurationProvider > --

[jira] [Updated] (YARN-11362) Fix several typos in YARN codebase of misspelled resource

2022-10-28 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11362: -- Labels: newbie newbie++ (was: ) > Fix several typos in YARN codebase of misspelled resource >

[jira] [Updated] (YARN-11362) Fix several typos in YARN codebase of misspelled resource

2022-10-28 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-11362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-11362: -- Description: I noticed that in YARN's codebase, there are several occassions of misspelled reso

[jira] [Created] (YARN-11362) Fix several typos in YARN codebase of misspelled resource

2022-10-28 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-11362: - Summary: Fix several typos in YARN codebase of misspelled resource Key: YARN-11362 URL: https://issues.apache.org/jira/browse/YARN-11362 Project: Hadoop YARN

[jira] [Updated] (YARN-9361) Write testcase for FSLeafQueue that explicitly checks if non-zero AM-share values are not overwritten for custom resources

2022-10-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9361: - Component/s: fairscheduler > Write testcase for FSLeafQueue that explicitly checks if non-zero AM-

[jira] [Updated] (YARN-9457) Integrate custom resource metrics better for FairScheduler

2022-10-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9457: - Component/s: fairscheduler > Integrate custom resource metrics better for FairScheduler >

[jira] [Updated] (YARN-9352) Multiple versions of createSchedulingRequest in FairSchedulerTestBase could be cleaned up

2022-10-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9352: - Component/s: fairscheduler > Multiple versions of createSchedulingRequest in FairSchedulerTestBase

[jira] [Updated] (YARN-7239) Possible launch/cleanup race condition in ContainersLauncher

2022-10-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7239: - Component/s: nodemanager > Possible launch/cleanup race condition in ContainersLauncher >

[jira] [Updated] (YARN-6474) CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed after YARN-5301

2022-10-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6474: - Component/s: nodemanager > CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed af

[jira] [Updated] (YARN-6525) Linux container executor should not propagate application errors

2022-10-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6525: - Component/s: LCE > Linux container executor should not propagate application errors >

[jira] [Updated] (YARN-10680) Revisit try blocks without catch blocks but having finally blocks

2022-10-15 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10680: -- Fix Version/s: 3.4.0 > Revisit try blocks without catch blocks but having finally blocks >

[jira] [Resolved] (YARN-10680) Revisit try blocks without catch blocks but having finally blocks

2022-10-15 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10680. --- Hadoop Flags: Reviewed Resolution: Fixed > Revisit try blocks without catch blocks but

[jira] [Assigned] (YARN-4944) Handle lack of ResourceCalculatorPlugin gracefully

2022-10-11 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-4944: Assignee: Susheel Gupta > Handle lack of ResourceCalculatorPlugin gracefully >

[jira] [Assigned] (YARN-5607) Document TestContainerResourceUsage#waitForContainerCompletion

2022-10-11 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-5607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-5607: Assignee: Susheel Gupta (was: Gergely Pollák) > Document TestContainerResourceUsage#waitFo

[jira] [Assigned] (YARN-6412) aux-services classpath not documented

2022-10-11 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-6412: Assignee: Riya Khandelwal (was: Siddharth Ahuja) > aux-services classpath not documented >

[jira] [Assigned] (YARN-6971) Clean up different ways to create resources

2022-10-11 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-6971: Assignee: Riya Khandelwal > Clean up different ways to create resources > -

[jira] [Resolved] (YARN-6766) Add helper method in FairSchedulerAppsBlock to print app info

2022-10-10 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-6766. -- Hadoop Flags: Reviewed Resolution: Fixed > Add helper method in FairSchedulerAppsBlock to

[jira] [Updated] (YARN-6766) Add helper method in FairSchedulerAppsBlock to print app info

2022-10-10 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6766: - Fix Version/s: 3.4.0 > Add helper method in FairSchedulerAppsBlock to print app info > ---

  1   2   3   4   5   6   7   8   9   10   >