[
https://issues.apache.org/jira/browse/SPARK-18066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eren Avsarogullari updated SPARK-18066:
---------------------------------------
Description:
The following Pool usage cases need to have Unit test coverage :
- FIFO Scheduler just uses *root pool* so even if *spark.scheduler.pool*
property is set, related pool is not created and *TaskSetManagers* are added to
root pool.
- FAIR Scheduler uses default pool when *spark.scheduler.pool* property is not
set. This can be happened when Properties object is null or empty(*new
Properties()*) or points default pool(*spark.scheduler.pool*=_default_).
- FAIR Scheduler creates a new pool with default values when
*spark.scheduler.pool* property points _non-existent_ pool. This can be
happened when scheduler allocation file is not set or it does not contain
related pool.
was:
The following Pool usage cases need to have Unit test coverage :
- FIFO Scheduler just uses *root pool* so even if
{code:java}spark.scheduler.pool{code} property is set, related pool is not
created and {code:java}TaskSetManagers{code} are added to root pool.
- FAIR Scheduler uses default pool when spark.scheduler.pool property is not
set. This can be happened when Properties object is null or empty(new
Properties()) or points default pool(spark.scheduler.pool=default).
- FAIR Scheduler creates a new pool with default values when
spark.scheduler.pool property points non-existent pool. This can be happened
when scheduler allocation file is not set or it does not contain related pool.
> Add Pool usage policies test coverage to FIFO & FAIR Schedulers
> ---------------------------------------------------------------
>
> Key: SPARK-18066
> URL: https://issues.apache.org/jira/browse/SPARK-18066
> Project: Spark
> Issue Type: Test
> Components: Scheduler
> Affects Versions: 2.1.0
> Reporter: Eren Avsarogullari
> Priority: Minor
>
> The following Pool usage cases need to have Unit test coverage :
> - FIFO Scheduler just uses *root pool* so even if *spark.scheduler.pool*
> property is set, related pool is not created and *TaskSetManagers* are added
> to root pool.
> - FAIR Scheduler uses default pool when *spark.scheduler.pool* property is
> not set. This can be happened when Properties object is null or empty(*new
> Properties()*) or points default pool(*spark.scheduler.pool*=_default_).
> - FAIR Scheduler creates a new pool with default values when
> *spark.scheduler.pool* property points _non-existent_ pool. This can be
> happened when scheduler allocation file is not set or it does not contain
> related pool.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
