[jira] [Commented] (SPARK-3213) spark_ec2.py cannot find slave instances launched with Launch More Like This

[ https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512188#comment-14512188 ] Nicholas Chammas commented on SPARK-3213: - Hey people, is the main motivation for

[jira] [Commented] (SPARK-6900) spark ec2 script enters infinite loop when run-instance fails

[ https://issues.apache.org/jira/browse/SPARK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14505979#comment-14505979 ] Nicholas Chammas commented on SPARK-6900: - Your analysis is correct. I don't

[jira] [Comment Edited] (SPARK-6900) spark ec2 script enters infinite loop when run-instance fails

[ https://issues.apache.org/jira/browse/SPARK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500550#comment-14500550 ] Nicholas Chammas edited comment on SPARK-6900 at 4/17/15 7:54 PM:

[jira] [Commented] (SPARK-6900) spark ec2 script enters infinite loop when run-instance fails

[ https://issues.apache.org/jira/browse/SPARK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500550#comment-14500550 ] Nicholas Chammas commented on SPARK-6900: - Hi [~wangg...@gmail.com], I would not

[jira] [Commented] (SPARK-6342) Leverage cfncluster in spark_ec2

[ https://issues.apache.org/jira/browse/SPARK-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500559#comment-14500559 ] Nicholas Chammas commented on SPARK-6342: - [~agrothberg] - Do you mind closing

[jira] [Comment Edited] (SPARK-6900) spark ec2 script enters infinite loop when run-instance fails

[ https://issues.apache.org/jira/browse/SPARK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500550#comment-14500550 ] Nicholas Chammas edited comment on SPARK-6900 at 4/17/15 7:53 PM:

[jira] [Commented] (SPARK-6900) spark ec2 script enters infinite loop when run-instance fails

[ https://issues.apache.org/jira/browse/SPARK-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14501096#comment-14501096 ] Nicholas Chammas commented on SPARK-6900: - spark-ec2 polls the status (running,

[jira] [Commented] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496373#comment-14496373 ] Nicholas Chammas commented on SPARK-6889: - {quote} I think that really the most

[jira] [Commented] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494168#comment-14494168 ] Nicholas Chammas commented on SPARK-6889: - {quote} I also agree that most projects

[jira] [Commented] (SPARK-4897) Python 3 support

[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495439#comment-14495439 ] Nicholas Chammas commented on SPARK-4897: - [~watsonix] You can follow the [active

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493147#comment-14493147 ] Nicholas Chammas commented on SPARK-1701: - [~tgraves] - Shouldn't this issue be

[jira] [Commented] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493394#comment-14493394 ] Nicholas Chammas commented on SPARK-6889: - Thanks for continuing to work on

[jira] [Commented] (SPARK-6636) Use public DNS hostname everywhere in spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14488245#comment-14488245 ] Nicholas Chammas commented on SPARK-6636: - [~aasted] - Can you elaborate on this?

[jira] [Commented] (SPARK-5452) We are migrating Tera Data SQL to Spark SQL. Query is taking long time. Please have a look on this issue

[ https://issues.apache.org/jira/browse/SPARK-5452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392901#comment-14392901 ] Nicholas Chammas commented on SPARK-5452: - Yeah, as Sean said, this post as it

[jira] [Issue Comment Deleted] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6481: Comment: was deleted (was: Oh, never mind then. :-}) Set In Progress when a PR is opened

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382476#comment-14382476 ] Nicholas Chammas commented on SPARK-6481: - SPARK-3441 looks fine to me. It was

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381934#comment-14381934 ] Nicholas Chammas commented on SPARK-6481: - Im willing to update this if there is a

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381939#comment-14381939 ] Nicholas Chammas commented on SPARK-6481: - Also, there was a one time mass update

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381975#comment-14381975 ] Nicholas Chammas commented on SPARK-6481: - Oh, never mind then. :-} Set In

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381976#comment-14381976 ] Nicholas Chammas commented on SPARK-6481: - Oh, never mind then. :-} Set In

[jira] [Commented] (SPARK-3849) Automate remaining Spark Code Style Guide rules

[ https://issues.apache.org/jira/browse/SPARK-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380051#comment-14380051 ] Nicholas Chammas commented on SPARK-3849: - [~boyork] - You may be interested in

[jira] [Resolved] (SPARK-5747) Review all Bash scripts for word splitting bugs

[ https://issues.apache.org/jira/browse/SPARK-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-5747. - Resolution: Incomplete Resolving since this issue's scope is too large / loosely defined.

[jira] [Commented] (SPARK-3849) Automate remaining Spark Code Style Guide rules

[ https://issues.apache.org/jira/browse/SPARK-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380573#comment-14380573 ] Nicholas Chammas commented on SPARK-3849: - Yeah, I suggest reading through this

[jira] [Commented] (SPARK-3849) Automate remaining Spark Code Style Guide rules

[ https://issues.apache.org/jira/browse/SPARK-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380603#comment-14380603 ] Nicholas Chammas commented on SPARK-3849: - Sounds good. My quick summary (which

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380464#comment-14380464 ] Nicholas Chammas commented on SPARK-6481: - The Spark user can initiate state

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380585#comment-14380585 ] Nicholas Chammas commented on SPARK-6481: - PR for this:

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378838#comment-14378838 ] Nicholas Chammas commented on SPARK-6481: - Since there is no guaranteed way to map

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378114#comment-14378114 ] Nicholas Chammas commented on SPARK-6481: - [~pwendell] - Where is the GitHub JIRA

[jira] [Comment Edited] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378393#comment-14378393 ] Nicholas Chammas edited comment on SPARK-6481 at 3/24/15 7:07 PM:

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378393#comment-14378393 ] Nicholas Chammas commented on SPARK-6481: - So should that script be removed from

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14378436#comment-14378436 ] Nicholas Chammas commented on SPARK-6481: - The change Michael/Patrick want is for

[jira] [Commented] (SPARK-2394) Make it easier to read LZO-compressed files from EC2 clusters

[ https://issues.apache.org/jira/browse/SPARK-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375929#comment-14375929 ] Nicholas Chammas commented on SPARK-2394: - Thank you for posting this information

[jira] [Updated] (SPARK-6474) Replace image.run with connection.run_instances in spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6474: Issue Type: Improvement (was: Bug) Replace image.run with connection.run_instances in

[jira] [Commented] (SPARK-6474) Replace image.run with connection.run_instances in spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376584#comment-14376584 ] Nicholas Chammas commented on SPARK-6474: - This change also fits the pattern of

[jira] [Updated] (SPARK-6474) Replace image.run with connection.run_instances in spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6474: Priority: Minor (was: Major) Replace image.run with connection.run_instances in

[jira] [Comment Edited] (SPARK-6474) Replace image.run with connection.run_instances in spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376572#comment-14376572 ] Nicholas Chammas edited comment on SPARK-6474 at 3/23/15 8:29 PM:

[jira] [Commented] (SPARK-6474) Replace image.run with connection.run_instances in spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376572#comment-14376572 ] Nicholas Chammas commented on SPARK-6474: - LGTM. Replace image.run with

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14377034#comment-14377034 ] Nicholas Chammas commented on SPARK-6481: - I'm guessing this will be done via

[jira] [Updated] (SPARK-6342) Leverage cfncluster in spark_ec2

[ https://issues.apache.org/jira/browse/SPARK-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6342: Component/s: EC2 Leverage cfncluster in spark_ec2 -

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360534#comment-14360534 ] Nicholas Chammas commented on SPARK-6282: - [~joshrosen], [~davies]: Does this

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359404#comment-14359404 ] Nicholas Chammas commented on SPARK-6282: - Shouldn't be related to boto. _winreg

[jira] [Updated] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

[ https://issues.apache.org/jira/browse/SPARK-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5189: Description: As of 1.2.0, we launch Spark clusters on EC2 by setting up the master first,

[jira] [Commented] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

[ https://issues.apache.org/jira/browse/SPARK-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359665#comment-14359665 ] Nicholas Chammas commented on SPARK-5189: - For the record, this is the script I

[jira] [Commented] (SPARK-4325) Improve spark-ec2 cluster launch times

[ https://issues.apache.org/jira/browse/SPARK-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354956#comment-14354956 ] Nicholas Chammas commented on SPARK-4325: - At this point it's more an umbrella

[jira] [Commented] (SPARK-4325) Improve spark-ec2 cluster launch times

[ https://issues.apache.org/jira/browse/SPARK-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354939#comment-14354939 ] Nicholas Chammas commented on SPARK-4325: - [~srowen] - I should perhaps change the

[jira] [Created] (SPARK-6246) spark-ec2 can't handle clusters with 100 nodes

Nicholas Chammas created SPARK-6246: --- Summary: spark-ec2 can't handle clusters with 100 nodes Key: SPARK-6246 URL: https://issues.apache.org/jira/browse/SPARK-6246 Project: Spark Issue

[jira] [Commented] (SPARK-6246) spark-ec2 can't handle clusters with 100 nodes

[ https://issues.apache.org/jira/browse/SPARK-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354969#comment-14354969 ] Nicholas Chammas commented on SPARK-6246: - FYI [~shivaram]. spark-ec2 can't

[jira] [Reopened] (SPARK-4325) Improve spark-ec2 cluster launch times

[ https://issues.apache.org/jira/browse/SPARK-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-4325: - Reopening after updating contains issue links. Improve spark-ec2 cluster launch times

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354991#comment-14354991 ] Nicholas Chammas commented on SPARK-6220: - Another thought to add, there are

[jira] [Updated] (SPARK-5312) Use sbt to detect new or changed public classes in PRs

[ https://issues.apache.org/jira/browse/SPARK-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5312: Description: We currently use an [unwieldy grep/sed

[jira] [Commented] (SPARK-5312) Use sbt to detect new or changed public classes in PRs

[ https://issues.apache.org/jira/browse/SPARK-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355622#comment-14355622 ] Nicholas Chammas commented on SPARK-5312: - Thanks for looking into this [~boyork].

[jira] [Commented] (SPARK-6246) spark-ec2 can't handle clusters with 100 nodes

[ https://issues.apache.org/jira/browse/SPARK-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355642#comment-14355642 ] Nicholas Chammas commented on SPARK-6246: - I dunno, I haven't looked into the

[jira] [Commented] (SPARK-5313) Create simple framework for highlighting changes introduced in a PR

[ https://issues.apache.org/jira/browse/SPARK-5313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355819#comment-14355819 ] Nicholas Chammas commented on SPARK-5313: - I had an idea to generalize the process

[jira] [Updated] (SPARK-4325) Improve spark-ec2 cluster launch times

[ https://issues.apache.org/jira/browse/SPARK-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4325: Description: This is an umbrella task to capture several pieces of work related to

[jira] [Commented] (SPARK-6219) Expand Python lint checks to check for compilation errors

[ https://issues.apache.org/jira/browse/SPARK-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353325#comment-14353325 ] Nicholas Chammas commented on SPARK-6219: - That's a good point, I haven't checked

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354217#comment-14354217 ] Nicholas Chammas commented on SPARK-6220: - I took another look at the 2 boto

[jira] [Commented] (SPARK-6206) spark-ec2 script reporting SSL error?

[ https://issues.apache.org/jira/browse/SPARK-6206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352481#comment-14352481 ] Nicholas Chammas commented on SPARK-6206: - OK, let us know what you find,

[jira] [Updated] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6220: Description: There are many EC2 options exposed by the boto library that spark-ec2 uses.

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352489#comment-14352489 ] Nicholas Chammas commented on SPARK-6220: - cc [~joshrosen] and [~shivaram] for

[jira] [Updated] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6220: Description: There are many EC2 options exposed by the boto library that spark-ec2 uses.

[jira] [Updated] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6220: Description: There are many EC2 options exposed by the boto library that spark-ec2 uses.

[jira] [Updated] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6220: Description: There are many EC2 options exposed by the boto library that spark-ec2 uses.

[jira] [Created] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

Nicholas Chammas created SPARK-6218: --- Summary: Upgrade spark-ec2 from optparse to argparse Key: SPARK-6218 URL: https://issues.apache.org/jira/browse/SPARK-6218 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352331#comment-14352331 ] Nicholas Chammas commented on SPARK-6218: - [~shivaram], [~joshrosen]: What do you

[jira] [Updated] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6218: Description: spark-ec2 [currently uses

[jira] [Commented] (SPARK-6220) Allow extended EC2 options to be passed through spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352524#comment-14352524 ] Nicholas Chammas commented on SPARK-6220: - As far as places where we create

[jira] [Created] (SPARK-6219) Expand Python lint checks to check for compilation errors

Nicholas Chammas created SPARK-6219: --- Summary: Expand Python lint checks to check for compilation errors Key: SPARK-6219 URL: https://issues.apache.org/jira/browse/SPARK-6219 Project: Spark

[jira] [Updated] (SPARK-6191) Generalize spark-ec2's ability to download libraries from PyPI

[ https://issues.apache.org/jira/browse/SPARK-6191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6191: Description: Right now we have a method to specifically download boto. Let's generalize it

[jira] [Created] (SPARK-6191) Generalize spark-ec2's ability to download libraries from PyPI

Nicholas Chammas created SPARK-6191: --- Summary: Generalize spark-ec2's ability to download libraries from PyPI Key: SPARK-6191 URL: https://issues.apache.org/jira/browse/SPARK-6191 Project: Spark

[jira] [Updated] (SPARK-6191) Generalize spark-ec2's ability to download libraries from PyPI

[ https://issues.apache.org/jira/browse/SPARK-6191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-6191: Description: Right now we have a method to specifically download boto. Let's generalize it

[jira] [Commented] (SPARK-3369) Java mapPartitions Iterator-Iterable is inconsistent with Scala's Iterator-Iterator

[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349577#comment-14349577 ] Nicholas Chammas commented on SPARK-3369: - {quote} How about breaking backward

[jira] [Created] (SPARK-6193) Speed up how spark-ec2 searches for clusters

Nicholas Chammas created SPARK-6193: --- Summary: Speed up how spark-ec2 searches for clusters Key: SPARK-6193 URL: https://issues.apache.org/jira/browse/SPARK-6193 Project: Spark Issue Type:

[jira] [Updated] (SPARK-5473) Expose SSH failures after status checks pass

[ https://issues.apache.org/jira/browse/SPARK-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5473: Description: If there is some fatal problem with launching a cluster, `spark-ec2` just

[jira] [Updated] (SPARK-3533) Add saveAsTextFileByKey() method to RDDs

[ https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3533: Target Version/s: 1.4.0 Add saveAsTextFileByKey() method to RDDs

[jira] [Commented] (SPARK-882) Have link for feedback/suggestions in docs

[ https://issues.apache.org/jira/browse/SPARK-882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344475#comment-14344475 ] Nicholas Chammas commented on SPARK-882: Is the intended use here that users could

[jira] [Commented] (SPARK-2545) Add a diagnosis mode for closures to figure out what they're bringing in

[ https://issues.apache.org/jira/browse/SPARK-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344482#comment-14344482 ] Nicholas Chammas commented on SPARK-2545: - [~adav] - Would this potentially also

[jira] [Commented] (SPARK-2545) Add a diagnosis mode for closures to figure out what they're bringing in

[ https://issues.apache.org/jira/browse/SPARK-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344504#comment-14344504 ] Nicholas Chammas commented on SPARK-2545: - cc [~tobias.schlatter] Add a

[jira] [Commented] (SPARK-2095) sc.getExecutorCPUCounts()

[ https://issues.apache.org/jira/browse/SPARK-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344480#comment-14344480 ] Nicholas Chammas commented on SPARK-2095: - cc [~pwendell], [~joshrosen] This

[jira] [Commented] (SPARK-6077) Multiple spark streaming tabs on UI when reuse the same sparkcontext

[ https://issues.apache.org/jira/browse/SPARK-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342704#comment-14342704 ] Nicholas Chammas commented on SPARK-6077: - Please disregard the comments on

[jira] [Commented] (SPARK-2463) Creating then stopping StreamingContext multiple times from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342714#comment-14342714 ] Nicholas Chammas commented on SPARK-2463: - For people reading through these

[jira] [Updated] (SPARK-2463) Creating then stopping StreamingContext multiple times from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2463: Description: Start a {{StreamingContext}} from the interactive shell and then stop it. Go

[jira] [Updated] (SPARK-2463) Creating then stopping StreamingContext multiple times from shell generates duplicate Streaming tabs in UI

[ https://issues.apache.org/jira/browse/SPARK-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2463: Description: Start a {{StreamingContext}} from the interactive shell and then stop it. Go

[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341787#comment-14341787 ] Nicholas Chammas commented on SPARK-6084: - Ah, there's also SPARK-5396, though

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341789#comment-14341789 ] Nicholas Chammas commented on SPARK-5389: - Yeah, I think we found another instance

[jira] [Reopened] (SPARK-6084) spark-shell broken on Windows

[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-6084: - Don't see how this is a dup of SPARK-4833. spark-shell broken on Windows

[jira] [Resolved] (SPARK-6084) spark-shell broken on Windows

[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-6084. - Resolution: Duplicate Resolving as duplicate of SPARK-5389. That seems a more likely

[jira] [Commented] (SPARK-5396) Syntax error in spark scripts on windows.

[ https://issues.apache.org/jira/browse/SPARK-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341788#comment-14341788 ] Nicholas Chammas commented on SPARK-5396: - What does that error message say in

[jira] [Updated] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5389: Description: spark-shell.cmd crashes in DOS prompt Windows 7. Works fine under PowerShell.

[jira] [Reopened] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-5389: - spark-shell.cmd does not run from DOS Windows 7

[jira] [Comment Edited] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341790#comment-14341790 ] Nicholas Chammas edited comment on SPARK-5389 at 2/28/15 9:48 PM:

[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341776#comment-14341776 ] Nicholas Chammas commented on SPARK-6084: - I took a look at the linked issue

[jira] [Created] (SPARK-6084) spark-shell broken on Windows

Nicholas Chammas created SPARK-6084: --- Summary: spark-shell broken on Windows Key: SPARK-6084 URL: https://issues.apache.org/jira/browse/SPARK-6084 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341746#comment-14341746 ] Nicholas Chammas commented on SPARK-6084: - cc [~pwendell], [~andrewor14] I

[jira] [Updated] (SPARK-5971) Add Mesos support to spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5971: Description: Right now, spark-ec2 can only launch Spark clusters that use the standalone

[jira] [Commented] (SPARK-3850) Scala style: disallow trailing spaces

[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335074#comment-14335074 ] Nicholas Chammas commented on SPARK-3850: - Ah I see. I'm fine with closing this

[jira] [Updated] (SPARK-3850) Scala style: disallow trailing spaces

[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3850: Description: Background discussions: * https://github.com/apache/spark/pull/2619 *

[jira] [Commented] (SPARK-3850) Scala style: disallow trailing spaces

[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335045#comment-14335045 ] Nicholas Chammas commented on SPARK-3850: - I guess the root is the [Style

[jira] [Updated] (SPARK-5971) Add Mesos support to spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5971: Summary: Add Mesos support to spark-ec2 (was: Add support for launching Spark-on-Mesos

[jira] [Created] (SPARK-5971) Add support for launching Spark-on-Mesos clusters to spark-ec2

Nicholas Chammas created SPARK-5971: --- Summary: Add support for launching Spark-on-Mesos clusters to spark-ec2 Key: SPARK-5971 URL: https://issues.apache.org/jira/browse/SPARK-5971 Project: Spark

[jira] [Commented] (SPARK-3674) Add support for launching YARN clusters in spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335199#comment-14335199 ] Nicholas Chammas commented on SPARK-3674: - There is an open PR for this here:

<    2   3   4   5   6   7   8   9   10   11   >