[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7647 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-213659877 ping @kmaehashi --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-193291146 We should close this PR since spark-ec2 has been moved out of this repo and to a [dedicated one](https://github.com/amplab/spark-ec2). Feel free to reopen this

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-165166398 Perhaps I misunderstood you, but I think you *can* automatically boot up an instance with a differently sized root volume. [Flintrock does it](https://github.com/nchamm

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user kmaehashi commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-164987439 Even if you use the option `--ebs-root-vol-size` proposed in this PR, you still need to expand partition size (using `parted`) and file system size (using `resize2fs`)

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-164870180 What's the status of this patch? @kmaehashi have you had the chance to address the comments? If you're not actively working on it then we should close it for now and

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user felixmaximilian commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-146461342 I tried this with an instance type where the /root dir isn't on an EBS. There the volume size parameter hasn't had an effect. It might be a good extension to spe

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user felixmaximilian commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-146189243 What is the current state of this fix? I got trouble with the standard root dir size when building my custom spark. This pr should fix this! --- If your project

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-126415405 Not sure I get it -- Does this mean the increased size will only work if we use the `resizefs` in a script ? --- If your project is set up for it, you can reply to th

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user kmaehashi commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-126179462 @shivaram Yes, you can do that via the script specified in `--user-data`. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-126043897 @kmaehashi Does this work in practice ? AFAIK the AMI dictates the size of the root volume and one needs to do a copy + resize to expand it ? See [1] [1] http:

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user kmaehashi commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-125813218 @shivaram @nchammas Could you please confirm this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-124585389 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7647#issuecomment-124585163 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9314] [EC2] add root EBS config options...

GitHub user kmaehashi opened a pull request: https://github.com/apache/spark/pull/7647 [SPARK-9314] [EC2] add root EBS config options to spark-ec2 This fixes [[SPARK-9314]](https://issues.apache.org/jira/browse/SPARK-9314). This patch adds two options to spark-ec2 command: