[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615264#comment-14615264 ]
Shivaram Venkataraman commented on SPARK-8596: ---------------------------------------------- Hmm the problem is I'm not sure the ulimit applies across shells, which is why we were doing it in spark-env.sh. Hmm here are a couple of things 1. We could change it in the AMI in /etc/security/limits.conf 2. Does leaving it in there lead to any error or does it just print a warning statement ? If its just a warning, I'd say lets leave it in there. The ulimit used to be only needed for really large shuffles, so some of the RStudio use cases might work even without it. > Install and configure RStudio server on Spark EC2 > ------------------------------------------------- > > Key: SPARK-8596 > URL: https://issues.apache.org/jira/browse/SPARK-8596 > Project: Spark > Issue Type: Improvement > Components: EC2, SparkR > Reporter: Shivaram Venkataraman > > This will make it convenient for R users to use SparkR from their browsers -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org