[
https://issues.apache.org/jira/browse/SPARK-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391456#comment-14391456
]
Matei Zaharia commented on SPARK-6646:
--------------------------------------
Not to rain on the parade here, but I worry that focusing on mobile phones is
short-sighted. Does this design present a path forward for the Internet of
Things as well? You'd want something that runs on Arduino, Raspberry Pi, etc.
We already have MQTT input in Spark Streaming so we could consider using MQTT
to replace Netty for shuffle as well. Has anybody benchmarked that?
> Spark 2.0: Rearchitecting Spark for Mobile Platforms
> ----------------------------------------------------
>
> Key: SPARK-6646
> URL: https://issues.apache.org/jira/browse/SPARK-6646
> Project: Spark
> Issue Type: Improvement
> Components: Project Infra
> Reporter: Reynold Xin
> Assignee: Reynold Xin
> Priority: Blocker
> Attachments: Spark on Mobile - Design Doc - v1.pdf
>
>
> Mobile computing is quickly rising to dominance, and by the end of 2017, it
> is estimated that 90% of CPU cycles will be devoted to mobile hardware.
> Spark’s project goal can be accomplished only when Spark runs efficiently for
> the growing population of mobile users.
> Designed and optimized for modern data centers and Big Data applications,
> Spark is unfortunately not a good fit for mobile computing today. In the past
> few months, we have been prototyping the feasibility of a mobile-first Spark
> architecture, and today we would like to share with you our findings. This
> ticket outlines the technical design of Spark’s mobile support, and shares
> results from several early prototypes.
> Mobile friendly version of the design doc:
> https://databricks.com/blog/2015/04/01/spark-2-rearchitecting-spark-for-mobile.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
