[
https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-10171.
-------------------------------
Resolution: Won't Fix
I'd like to resolve this for the reasons above, that EC2 support already exists
to an extent but is itself moving out of Spark. It doesn't make this less
searchable though and can be reopened later if for some reason all that changed.
> AWS Lambda Executors
> --------------------
>
> Key: SPARK-10171
> URL: https://issues.apache.org/jira/browse/SPARK-10171
> Project: Spark
> Issue Type: Wish
> Components: EC2
> Reporter: Jaka Jancar
> Priority: Minor
>
> It would be great if Spark supported using AWS Lambda for execution in
> addition to Standalone, Mesos and YARN, getting rid of the concept of a
> "cluster" and having a single infinite-sized one.
> Couple of problems I see today:
> - Execution time is limited to 60s. This will probably change in the future.
> - "Burstiness" is still not very high.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
