Szilard Nemeth created YARN-10905:
-
Summary: Investigate if AbstractCSQueue#configuredNodeLabels vs.
QueueCapacities#getExistingNodeLabels holds the same data
Key: YARN-10905
URL: https://issues.apache.org/jira
[
https://issues.apache.org/jira/browse/YARN-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-10891.
---
Hadoop Flags: Reviewed
Resolution: Fixed
> Extend QueueInfo with max-parallel-a
[
https://issues.apache.org/jira/browse/YARN-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-9904.
--
Resolution: Duplicate
Duplicate of YARN-10888
> Investigate how resource allocat
[
https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-10505.
---
Resolution: Duplicate
> Extend the maximum-capacity property to support Fair Schedu
Szilard Nemeth created YARN-10889:
-
Summary: [Umbrella] Flexible Auto Queue Creation in Capacity
Scheduler - Tech debts
Key: YARN-10889
URL: https://issues.apache.org/jira/browse/YARN-10889
Project
Szilard Nemeth created YARN-10888:
-
Summary: [Umbrella] New capacity modes for CS
Key: YARN-10888
URL: https://issues.apache.org/jira/browse/YARN-10888
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-10887:
-
Summary: Investigation: Decouple capacity and max-capacity modes
Key: YARN-10887
URL: https://issues.apache.org/jira/browse/YARN-10887
Project: Hadoop YARN
Szilard Nemeth created YARN-10886:
-
Summary: Cluster based and parent based max capacity in Capacity
Scheduler
Key: YARN-10886
URL: https://issues.apache.org/jira/browse/YARN-10886
Project: Hadoop
[
https://issues.apache.org/jira/browse/YARN-10882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-10882.
---
Hadoop Flags: Reviewed
Resolution: Fixed
> Fix branch-3.1 build: zstd libr
Szilard Nemeth created YARN-10877:
-
Summary: SLSSchedulerCommons: Consider using application map from
AbstractYarnScheduler and make event handling more consistent
Key: YARN-10877
URL: https://issues.apache.org
[
https://issues.apache.org/jira/browse/YARN-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-10874.
---
Hadoop Flags: Reviewed
Resolution: Fixed
> Refactor NM ContainerLau
[
https://issues.apache.org/jira/browse/YARN-6221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-6221.
--
Hadoop Flags: Reviewed
Resolution: Fixed
> Entities missing from ATS when summary
Szilard Nemeth created YARN-10849:
-
Summary: Clarify testcase documentation for
TestServiceAM#testContainersReleasedWhenPreLaunchFails
Key: YARN-10849
URL: https://issues.apache.org/jira/browse/YARN-10849
Thanks for this initiative, Sean.
+1 for increasing the length to 100 characters.
I can't see a VOTE thread regarding this subject. Am I missing something?
Best,
Szilard
On Mon, May 24, 2021 at 11:49 PM Jonathan Eagles wrote:
> In apache tez, formal line length is 120 characters. So, I
Szilard Nemeth created YARN-10799:
-
Summary: Follow up of YARN-10787: Eliminate queue name replacement
in ApplicationSubmissionContext based on placement context
Key: YARN-10799
URL: https://issues.apache.org
Szilard Nemeth created YARN-10798:
-
Summary: Enhancements in RMAppManager: createAndPopulateNewRMApp
and copyPlacementQueueToSubmissionContext
Key: YARN-10798
URL: https://issues.apache.org/jira/browse/YARN-10798
Szilard Nemeth created YARN-10797:
-
Summary: Logging parameter issues in scheduler package
Key: YARN-10797
URL: https://issues.apache.org/jira/browse/YARN-10797
Project: Hadoop YARN
Issue
Szilard Nemeth created YARN-10787:
-
Summary: Queue submit ACL check is wrong when CS queue is ambiguous
Key: YARN-10787
URL: https://issues.apache.org/jira/browse/YARN-10787
Project: Hadoop YARN
[
https://issues.apache.org/jira/browse/YARN-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-10766.
---
Hadoop Flags: Reviewed
Resolution: Fixed
> [UI2] Bump moment-timezone to 0.5
Szilard Nemeth created YARN-10681:
-
Summary: Fix assertion failure message in BaseSLSRunnerTest
Key: YARN-10681
URL: https://issues.apache.org/jira/browse/YARN-10681
Project: Hadoop YARN
Szilard Nemeth created YARN-10680:
-
Summary: CLONE - Better logging of uncaught exceptions throughout
SLS
Key: YARN-10680
URL: https://issues.apache.org/jira/browse/YARN-10680
Project: Hadoop YARN
Szilard Nemeth created YARN-10679:
-
Summary: Better logging of uncaught exceptions throughout SLS
Key: YARN-10679
URL: https://issues.apache.org/jira/browse/YARN-10679
Project: Hadoop YARN
Szilard Nemeth created YARN-10678:
-
Summary: Try blocks without catch blocks in SLS scheduler classes
can swallow other exceptions
Key: YARN-10678
URL: https://issues.apache.org/jira/browse/YARN-10678
Szilard Nemeth created YARN-10677:
-
Summary: Logger of SLSFairScheduler is provided with the wrong
class
Key: YARN-10677
URL: https://issues.apache.org/jira/browse/YARN-10677
Project: Hadoop YARN
Szilard Nemeth created YARN-10676:
-
Summary: Improve code quality in
TestTimelineAuthenticationFilterForV1
Key: YARN-10676
URL: https://issues.apache.org/jira/browse/YARN-10676
Project: Hadoop YARN
Szilard Nemeth created YARN-10675:
-
Summary: Consolidate YARN-10672 and YARN-10447
Key: YARN-10675
URL: https://issues.apache.org/jira/browse/YARN-10675
Project: Hadoop YARN
Issue Type: Bug
Szilard Nemeth created YARN-10672:
-
Summary: All testcases in TestReservations are flaky
Key: YARN-10672
URL: https://issues.apache.org/jira/browse/YARN-10672
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-10581:
-
Summary: CLONE - CS Flexible Auto Queue Creation: Modify RM
/scheduler endpoint to include weight values for queues
Key: YARN-10581
URL: https://issues.apache.org/jira/browse
Szilard Nemeth created YARN-10580:
-
Summary: Fix some issues in
TestRMWebServicesCapacitySchedDynamicConfig
Key: YARN-10580
URL: https://issues.apache.org/jira/browse/YARN-10580
Project: Hadoop YARN
Szilard Nemeth created YARN-10579:
-
Summary: CLONE - CS Flexible Auto Queue Creation: Modify RM
/scheduler endpoint to include mode of operation for CS
Key: YARN-10579
URL: https://issues.apache.org/jira/browse
Szilard Nemeth created YARN-10550:
-
Summary: Decouple NM runner logic from SLSRunner
Key: YARN-10550
URL: https://issues.apache.org/jira/browse/YARN-10550
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-10549:
-
Summary: Decouple RM runner logic from SLSRunner
Key: YARN-10549
URL: https://issues.apache.org/jira/browse/YARN-10549
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-10548:
-
Summary: CLONE - Decouple job parsing logic from SLSRunner
Key: YARN-10548
URL: https://issues.apache.org/jira/browse/YARN-10548
Project: Hadoop YARN
Szilard Nemeth created YARN-10547:
-
Summary: Decouple job parsing logic from SLSRunner
Key: YARN-10547
URL: https://issues.apache.org/jira/browse/YARN-10547
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-10488:
-
Summary: Several typos in package:
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair
Key: YARN-10488
URL: https://issues.apache.org/jira/browse/YARN-10488
+1 (binding).
**TEST STEPS**
1. Build from sources (see Maven / Java and OS details below)
2. Distribute Hadoop to all nodes
3. Start HDFS services + YARN services on nodes
4. Run Mapreduce pi job (QuasiMontecarlo)
5. Verifed that application was successful through YARN RM Web UI
6. Verified
Szilard Nemeth created YARN-10323:
-
Summary: [Umbrella] YARN Debuggability and Supportability
Improvements
Key: YARN-10323
URL: https://issues.apache.org/jira/browse/YARN-10323
Project: Hadoop YARN
Szilard Nemeth created YARN-10321:
-
Summary: Break down TestUserGroupMappingPlacementRule#testMapping
into test scenarios
Key: YARN-10321
URL: https://issues.apache.org/jira/browse/YARN-10321
Project
Szilard Nemeth created YARN-10264:
-
Summary: Add container launch related env / classpath debug info
to container logs when a container fails
Key: YARN-10264
URL: https://issues.apache.org/jira/browse/YARN-10264
Szilard Nemeth created YARN-10179:
-
Summary: CLONE - Queue mapping based on userid passed through
application tag
Key: YARN-10179
URL: https://issues.apache.org/jira/browse/YARN-10179
Project: Hadoop
[
https://issues.apache.org/jira/browse/YARN-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth closed YARN-9886.
Assignee: Szilard Nemeth (was: Kinga Marton)
> Queue mapping based on userid passed thro
Szilard Nemeth created YARN-10130:
-
Summary: Do not allow output dir to be the same as input dir
Key: YARN-10130
URL: https://issues.apache.org/jira/browse/YARN-10130
Project: Hadoop YARN
Szilard Nemeth created YARN-10107:
-
Summary: Invoking NMWebServices#getNMResourceInfo tries to execute
gpu discovery binary even if auto discovery is turned off
Key: YARN-10107
URL: https://issues.apache.org/jira
[
https://issues.apache.org/jira/browse/YARN-10081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-10081.
---
Fix Version/s: 3.3.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Except
Szilard Nemeth created YARN-10005:
-
Summary: Code improvements in MutableCSConfigurationProvider
Key: YARN-10005
URL: https://issues.apache.org/jira/browse/YARN-10005
Project: Hadoop YARN
Szilard Nemeth created YARN-10004:
-
Summary: Javadoc of YarnConfigurationStore#initialize is not
straightforward
Key: YARN-10004
URL: https://issues.apache.org/jira/browse/YARN-10004
Project: Hadoop
Szilard Nemeth created YARN-10003:
-
Summary: YarnConfigurationStore#checkVersion throws exception that
belongs to RMStateStore
Key: YARN-10003
URL: https://issues.apache.org/jira/browse/YARN-10003
Szilard Nemeth created YARN-10002:
-
Summary: Code cleanup and improvements ConfigurationStoreBaseTest
Key: YARN-10002
URL: https://issues.apache.org/jira/browse/YARN-10002
Project: Hadoop YARN
Szilard Nemeth created YARN-10001:
-
Summary: Add explanation of unimplemented methods in
InMemoryConfigurationStore
Key: YARN-10001
URL: https://issues.apache.org/jira/browse/YARN-10001
Project
Szilard Nemeth created YARN-1:
-
Summary: Code cleanup in FSSchedulerConfigurationStore
Key: YARN-1
URL: https://issues.apache.org/jira/browse/YARN-1
Project: Hadoop YARN
Issue
Szilard Nemeth created YARN-:
Summary: TestFSSchedulerConfigurationStore: Extend from
ConfigurationStoreBaseTest, general code cleanup
Key: YARN-
URL: https://issues.apache.org/jira/browse/YARN-
Szilard Nemeth created YARN-9998:
Summary: Code cleanup in LeveldbConfigurationStore
Key: YARN-9998
URL: https://issues.apache.org/jira/browse/YARN-9998
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-9997:
Summary: Code cleanup in ZKConfigurationStore
Key: YARN-9997
URL: https://issues.apache.org/jira/browse/YARN-9997
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-9996:
Summary: Code cleanup in QueueAdminConfigurationMutationACLPolicy
Key: YARN-9996
URL: https://issues.apache.org/jira/browse/YARN-9996
Project: Hadoop YARN
Szilard Nemeth created YARN-9995:
Summary: Code cleanup in TestSchedConfCLI
Key: YARN-9995
URL: https://issues.apache.org/jira/browse/YARN-9995
Project: Hadoop YARN
Issue Type: Improvement
Szilard Nemeth created YARN-9991:
Summary: CLONE - Queue mapping based on userid passed through
application tag
Key: YARN-9991
URL: https://issues.apache.org/jira/browse/YARN-9991
Project: Hadoop
Szilard Nemeth created YARN-9989:
Summary: Typo in CapacityScheduler documentation
Key: YARN-9989
URL: https://issues.apache.org/jira/browse/YARN-9989
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-9966:
Summary: Code duplication in UserGroupMappingPlacementRule
Key: YARN-9966
URL: https://issues.apache.org/jira/browse/YARN-9966
Project: Hadoop YARN
Issue
Szilard Nemeth created YARN-9899:
Summary: [Phase 2] Migration tool that help to generate CS config
based on FS config
Key: YARN-9899
URL: https://issues.apache.org/jira/browse/YARN-9899
Project
Hi Steve!
Reverted YARN-9128 commits on branch-3.2 / branch-3.1
Sorry for the hassle!
Best,
Szilard
On Wed, Oct 9, 2019 at 7:46 PM Sunil Govindan wrote:
> YARN-9128 caused this, Szilard is checking this.
>
>
> Thanks
>
> Sunil
>
>
> On Wed, Oct 9, 2019 at 10:51 PM Steve Loughran >
> wrote:
>
[
https://issues.apache.org/jira/browse/YARN-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth resolved YARN-9093.
--
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.3.0
> Remove commen
Szilard Nemeth created YARN-9717:
Summary: Add more logging to container-executor about issues with
directory creation or permissions
Key: YARN-9717
URL: https://issues.apache.org/jira/browse/YARN-9717
+1, this is a very great idea.
As Hadoop repository has already grown huge and contains many projects, I
think in general it's a good idea to separate projects in the early phase.
On Wed, Jul 17, 2019, 08:50 runlin zhang wrote:
> +1 ,That will be great !
>
> > 在 2019年7月10日,下午3:34,Xun Liu 写道:
Szilard Nemeth created YARN-9680:
Summary: Code cleanup in ResourcePluginManager init methods
Key: YARN-9680
URL: https://issues.apache.org/jira/browse/YARN-9680
Project: Hadoop YARN
Issue
Szilard Nemeth created YARN-9679:
Summary: Regular code cleanup in TestResourcePluginManager
Key: YARN-9679
URL: https://issues.apache.org/jira/browse/YARN-9679
Project: Hadoop YARN
Issue
Szilard Nemeth created YARN-9678:
Summary: TestGpuResourceHandler / TestFpgaResourceHandler should
be renamed
Key: YARN-9678
URL: https://issues.apache.org/jira/browse/YARN-9678
Project: Hadoop YARN
Szilard Nemeth created YARN-9677:
Summary: Make FpgaDevice and GpuDevice classes more similar to
each other
Key: YARN-9677
URL: https://issues.apache.org/jira/browse/YARN-9677
Project: Hadoop YARN
+1 (non-binding)
On Fri, Jun 21, 2019, 09:09 Weiwei Yang wrote:
> +1 (binding)
>
> Thanks
> Weiwei
> On Jun 21, 2019, 5:33 AM +0800, Wangda Tan , wrote:
> +1 Binding. Tested in local cluster and reviewed docs.
>
> Thanks!
>
> On Wed, Jun 19, 2019 at 3:20 AM Sunil Govindan wrote:
>
> +1 binding
Szilard Nemeth created YARN-9535:
Summary: Typos in Docker documentation
Key: YARN-9535
URL: https://issues.apache.org/jira/browse/YARN-9535
Project: Hadoop YARN
Issue Type: Bug
Szilard Nemeth created YARN-9460:
Summary: QueueACLsManager and ReservationsACLManager should not
use instanceof checks
Key: YARN-9460
URL: https://issues.apache.org/jira/browse/YARN-9460
Project
Szilard Nemeth created YARN-9459:
Summary: ConfiguredYarnAuthorizer should not now any details about
queues
Key: YARN-9459
URL: https://issues.apache.org/jira/browse/YARN-9459
Project: Hadoop YARN
Szilard Nemeth created YARN-9457:
Summary: Integrate custom resource metrics better for FairScheduler
Key: YARN-9457
URL: https://issues.apache.org/jira/browse/YARN-9457
Project: Hadoop YARN
Szilard Nemeth created YARN-9456:
Summary: Class ResourceMappings uses a List of Serializables
instead of more specific types
Key: YARN-9456
URL: https://issues.apache.org/jira/browse/YARN-9456
Szilard Nemeth created YARN-9455:
Summary: SchedulerInvalidResoureRequestException has a typo in its
class (and file) name
Key: YARN-9455
URL: https://issues.apache.org/jira/browse/YARN-9455
Project
Szilard Nemeth created YARN-9454:
Summary: Add detailed log about list applications command
Key: YARN-9454
URL: https://issues.apache.org/jira/browse/YARN-9454
Project: Hadoop YARN
Issue
Szilard Nemeth created YARN-9453:
Summary: Clean up code long if-else chain in ApplicationCLI#run
Key: YARN-9453
URL: https://issues.apache.org/jira/browse/YARN-9453
Project: Hadoop YARN
could host this
application? The memory / cpu footprint is quite moderate, it requires some
network bandwidth, though.
Here's the link for the git repo of the project:
https://github.com/szilard-nemeth/hadoop-reviewsync
The project is still in a PoC phase so the code is not the cleanest, I'm
planning
Szilard Nemeth created YARN-9430:
Summary: Recovering containers does not check available resources
on node
Key: YARN-9430
URL: https://issues.apache.org/jira/browse/YARN-9430
Project: Hadoop YARN
Hi,
This could be interesting for anyone interested in RM / Resource Types:
I filed a jira recently: https://issues.apache.org/jira/browse/YARN-9421
(Implement SafeMode for ResourceManager by defining a resource threshold).
The issue in one sentence: If an app is submitted while RM still haven't
Szilard Nemeth created YARN-9421:
Summary: Implement SafeMode for ResourceManager by defining a
resource threshold
Key: YARN-9421
URL: https://issues.apache.org/jira/browse/YARN-9421
Project: Hadoop
Szilard Nemeth created YARN-9420:
Summary: Avoid potentially dangerous filename concatenation in
native code (cgroups-operations.c)
Key: YARN-9420
URL: https://issues.apache.org/jira/browse/YARN-9420
Szilard Nemeth created YARN-9419:
Summary: Log a warning if GPU isolation is enabled but
LinuxContainerExecutor is disabled
Key: YARN-9419
URL: https://issues.apache.org/jira/browse/YARN-9419
Project
Hi,
Sure, I can do that tomorrow.
Szilard
On Tue, Mar 26, 2019 at 3:41 PM Wanqiang Ji wrote:
> Hi folks,
>
> Can someone help to review YARN-9214 and YARN-9401?
> YARN-9214. Add AbstractYarnScheduler#getValidQueues method to resolve
> duplicate code
> YARN-9401. Fix `yarn version` print the
Szilard Nemeth created YARN-9410:
Summary: Typo in documentation: Using FPGA On YARN
Key: YARN-9410
URL: https://issues.apache.org/jira/browse/YARN-9410
Project: Hadoop YARN
Issue Type: Bug
Szilard Nemeth created YARN-9393:
Summary: Asking for more resources than cluster capacity errors
are handled in a different layer for custom resources
Key: YARN-9393
URL: https://issues.apache.org/jira/browse
Szilard Nemeth created YARN-9372:
Summary: ServerSocketUtil#getPort is too smart
Key: YARN-9372
URL: https://issues.apache.org/jira/browse/YARN-9372
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-9371:
Summary: Better logging for initialization of cgroups in
CGroupsHandlerImpl
Key: YARN-9371
URL: https://issues.apache.org/jira/browse/YARN-9371
Project: Hadoop YARN
Szilard Nemeth created YARN-9370:
Summary: Better logging in recoverAssignedGpus in class
GpuResourceAllocator
Key: YARN-9370
URL: https://issues.apache.org/jira/browse/YARN-9370
Project: Hadoop YARN
Szilard Nemeth created YARN-9362:
Summary: Code cleanup in TestNMLeveldbStateStoreService
Key: YARN-9362
URL: https://issues.apache.org/jira/browse/YARN-9362
Project: Hadoop YARN
Issue Type
Szilard Nemeth created YARN-9361:
Summary: Write testcase for FSLeafQueue that explicitly checks if
non-zero values are not overwritten for custom resources
Key: YARN-9361
URL: https://issues.apache.org/jira
Szilard Nemeth created YARN-9360:
Summary: Do not expose innards of QueueMetrics object into
FSLeafQueue#computeMaxAMResource
Key: YARN-9360
URL: https://issues.apache.org/jira/browse/YARN-9360
Szilard Nemeth created YARN-9359:
Summary: Avoid code duplication in Resources for calculation
methods
Key: YARN-9359
URL: https://issues.apache.org/jira/browse/YARN-9359
Project: Hadoop YARN
Szilard Nemeth created YARN-9358:
Summary: Add javadoc to new methods introduced in FSQueueMetrics
with YARN-9322
Key: YARN-9358
URL: https://issues.apache.org/jira/browse/YARN-9358
Project: Hadoop
Szilard Nemeth created YARN-9356:
Summary: Add more tests to ratio method in TestResourceCalculator
Key: YARN-9356
URL: https://issues.apache.org/jira/browse/YARN-9356
Project: Hadoop YARN
Szilard Nemeth created YARN-9355:
Summary: RMContainerRequestor#makeRemoteRequest has confusing log
message
Key: YARN-9355
URL: https://issues.apache.org/jira/browse/YARN-9355
Project: Hadoop YARN
Szilard Nemeth created YARN-9353:
Summary: TestNMWebFilter should be renamed
Key: YARN-9353
URL: https://issues.apache.org/jira/browse/YARN-9353
Project: Hadoop YARN
Issue Type: Improvement
Szilard Nemeth created YARN-9354:
Summary: TestUtils#createResource calls should be replaced with
ResourceTypesTestHelper#newResource
Key: YARN-9354
URL: https://issues.apache.org/jira/browse/YARN-9354
Szilard Nemeth created YARN-9352:
Summary: Multiple versions of createSchedulingRequest in
FairSchedulerTestBase could be cleaned up
Key: YARN-9352
URL: https://issues.apache.org/jira/browse/YARN-9352
Szilard Nemeth created YARN-9323:
Summary: FSLeafQueue#computeMaxAMResource does not override zero
values for custom resources
Key: YARN-9323
URL: https://issues.apache.org/jira/browse/YARN-9323
Szilard Nemeth created YARN-9322:
Summary: Store metrics for custom resource types into
FSQueueMetrics
Key: YARN-9322
URL: https://issues.apache.org/jira/browse/YARN-9322
Project: Hadoop YARN
101 - 200 of 260 matches
Mail list logo