[ https://issues.apache.org/jira/browse/SPARK-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15418827#comment-15418827 ]
Rajesh Balamohan commented on SPARK-12920: ------------------------------------------ Thanks [~vanzin] . I have created SPARK-17036 for caching issue. > Honor "spark.ui.retainedStages" to reduce mem-pressure > ------------------------------------------------------ > > Key: SPARK-12920 > URL: https://issues.apache.org/jira/browse/SPARK-12920 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Rajesh Balamohan > Assignee: Rajesh Balamohan > Fix For: 2.1.0 > > Attachments: SPARK-12920.profiler.png, > SPARK-12920.profiler_job_progress_listner.png > > > - Configured with fair-share-scheduler. > - 4-5 users submitting/running jobs concurrently via spark-thrift-server > - Spark thrift server spikes to1600+% CPU and stays there for long time -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org