[
https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-18066:
---------------------------------------
Description:
The following Pool usage cases need to have Unit test coverage :
- FIFO Scheduler just uses *root pool* so even if
{code:java}spark.scheduler.pool{code} property is set, related pool is not
created and {code:java}TaskSetManagers{code} are added to root pool.
- FAIR Scheduler uses default pool when spark.scheduler.pool property is not
set. This can be happened when Properties object is null or empty(new
Properties()) or points default pool(spark.scheduler.pool=default).
- FAIR Scheduler creates a new pool with default values when
spark.scheduler.pool property points non-existent pool. This can be happened
when scheduler allocation file is not set or it does not contain related pool.
was:
The following Pool usage cases need to have Unit test coverage :
- FIFO Scheduler just uses root pool so even if spark.scheduler.pool property
is set, related pool is not created and TaskSetManagers are added to root pool.
- FAIR Scheduler uses default pool when spark.scheduler.pool property is not
set. This can be happened when Properties object is null or empty(new
Properties()) or points default pool(spark.scheduler.pool=default).
- FAIR Scheduler creates a new pool with default values when
spark.scheduler.pool property points non-existent pool. This can be happened
when scheduler allocation file is not set or it does not contain related pool.
> Add Pool usage policies test coverage to FIFO & FAIR Schedulers
> ---------------------------------------------------------------
>
> Key: SPARK-18066
> URL: https://issues.apache.org/jira/browse/SPARK-18066
> Project: Spark
> Issue Type: Test
> Components: Scheduler
> Affects Versions: 2.1.0
> Reporter: Eren Avsarogullari
> Priority: Minor
>
> The following Pool usage cases need to have Unit test coverage :
> - FIFO Scheduler just uses *root pool* so even if
> {code:java}spark.scheduler.pool{code} property is set, related pool is not
> created and {code:java}TaskSetManagers{code} are added to root pool.
> - FAIR Scheduler uses default pool when spark.scheduler.pool property is not
> set. This can be happened when Properties object is null or empty(new
> Properties()) or points default pool(spark.scheduler.pool=default).
> - FAIR Scheduler creates a new pool with default values when
> spark.scheduler.pool property points non-existent pool. This can be happened
> when scheduler allocation file is not set or it does not contain related pool.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
