[
https://issues.apache.org/jira/browse/SPARK-20327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360933#comment-16360933
]
Sean Owen commented on SPARK-20327:
-----------------------------------
I think the point is, without reflection, using 3.x+ APIs with 2.x results in
complete failures at runtime because classes won't link. You can't even present
an error.
This isn't Hadoop-specific; this is how you have to deal with handling multiple
incompatible APIs at the same time in the JVM in general.
> Add CLI support for YARN custom resources, like GPUs
> ----------------------------------------------------
>
> Key: SPARK-20327
> URL: https://issues.apache.org/jira/browse/SPARK-20327
> Project: Spark
> Issue Type: Improvement
> Components: Spark Shell, Spark Submit
> Affects Versions: 2.1.0
> Reporter: Daniel Templeton
> Priority: Major
> Labels: newbie
>
> YARN-3926 adds the ability for administrators to configure custom resources,
> like GPUs. This JIRA is to add support to Spark for requesting resources
> other than CPU virtual cores and memory. See YARN-3926.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
