[
https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15608760#comment-15608760
]
Thomas Graves commented on SPARK-18085:
---------------------------------------
I should also say I don't think we should throw out the idea of supporting ATS
v2. From my understanding they are building a lot of things into or on top of
this to do more then just UI. You could a lot fancier analysis of jobs which
could be tied back into scheduling, workflow analysis, etc . But there as you
mention you are sending the raw event streams there. Right now it doesn't
support anything other then HBASE though (no quick one node setup) and we
haven't used it so not exactly sure its state. Since its doing the raw event
streams it seems easy enough to support that as a separate event stream writing
type plugin.
> Scalability enhancements for the History Server
> -----------------------------------------------
>
> Key: SPARK-18085
> URL: https://issues.apache.org/jira/browse/SPARK-18085
> Project: Spark
> Issue Type: Umbrella
> Components: Spark Core, Web UI
> Affects Versions: 2.0.0
> Reporter: Marcelo Vanzin
> Attachments: spark_hs_next_gen.pdf
>
>
> It's a known fact that the History Server currently has some annoying issues
> when serving lots of applications, and when serving large applications.
> I'm filing this umbrella to track work related to addressing those issues.
> I'll be attaching a document shortly describing the issues and suggesting a
> path to how to solve them.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
