[jira] [Comment Edited] (SPARK-1532) provide option for more restrictive firewall rule in ec2/spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282103#comment-14282103 ] Nicholas Chammas edited comment on SPARK-1532 at 1/19/15 3:1

[jira] [Resolved] (SPARK-2396) Spark EC2 scripts fail when trying to log in to EC2 instances

[ https://issues.apache.org/jira/browse/SPARK-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-2396. - Resolution: Cannot Reproduce Resolving this issue as "Cannot Reproduce". Fe

[jira] [Updated] (SPARK-3244) Add fate sharing across related files in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3244: Component/s: (was: Spark Core) Project Infra > Add fate sharing acr

[jira] [Commented] (SPARK-3244) Add fate sharing across related files in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282105#comment-14282105 ] Nicholas Chammas commented on SPARK-3244: - [~andrewor14] - I updated

[jira] [Commented] (SPARK-5246) spark/spark-ec2.py cannot start Spark master in VPC if local DNS name does not resolve

[ https://issues.apache.org/jira/browse/SPARK-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14282107#comment-14282107 ] Nicholas Chammas commented on SPARK-5246: - [~shivaram] - Should this issu

[jira] [Commented] (SPARK-5366) check for mode of private key file

[ https://issues.apache.org/jira/browse/SPARK-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288480#comment-14288480 ] Nicholas Chammas commented on SPARK-5366: - If the problem is no warnings an

[jira] [Created] (SPARK-5390) Encourage users to post on Stack Overflow in Community Docs

Nicholas Chammas created SPARK-5390: --- Summary: Encourage users to post on Stack Overflow in Community Docs Key: SPARK-5390 URL: https://issues.apache.org/jira/browse/SPARK-5390 Project: Spark

[jira] [Updated] (SPARK-5390) Encourage users to post on Stack Overflow in Community Docs

[ https://issues.apache.org/jira/browse/SPARK-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5390: Description: As [discussed extensively on the user list|http://apache-spark-user-list

[jira] [Updated] (SPARK-5390) Encourage users to post on Stack Overflow in Community Docs

[ https://issues.apache.org/jira/browse/SPARK-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5390: Description: As [discussed extensively on the user list|http://apache-spark-user-list

[jira] [Updated] (SPARK-5390) Encourage users to post on Stack Overflow in Community Docs

[ https://issues.apache.org/jira/browse/SPARK-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5390: Description: As [discussed extensively on the user list|http://apache-spark-user-list

[jira] [Commented] (SPARK-5390) Encourage users to post on Stack Overflow in Community Docs

[ https://issues.apache.org/jira/browse/SPARK-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290185#comment-14290185 ] Nicholas Chammas commented on SPARK-5390: - Updated accordingly. > En

[jira] [Commented] (SPARK-5390) Encourage users to post on Stack Overflow in Community Docs

[ https://issues.apache.org/jira/browse/SPARK-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290187#comment-14290187 ] Nicholas Chammas commented on SPARK-5390: - cc [~pwendell] > Encourage u

[jira] [Comment Edited] (SPARK-5390) Encourage users to post on Stack Overflow in Community Docs

[ https://issues.apache.org/jira/browse/SPARK-5390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290187#comment-14290187 ] Nicholas Chammas edited comment on SPARK-5390 at 1/23/15 11:0

[jira] [Created] (SPARK-5398) Support the eu-central-1 region for spark-ec2

Nicholas Chammas created SPARK-5398: --- Summary: Support the eu-central-1 region for spark-ec2 Key: SPARK-5398 URL: https://issues.apache.org/jira/browse/SPARK-5398 Project: Spark Issue Type

[jira] [Commented] (SPARK-2008) Enhance spark-ec2 to be able to add and remove slaves to an existing cluster

[ https://issues.apache.org/jira/browse/SPARK-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293805#comment-14293805 ] Nicholas Chammas commented on SPARK-2008: - This isn't implemented

[jira] [Created] (SPARK-5434) Preserve spaces in path to spark-ec2

Nicholas Chammas created SPARK-5434: --- Summary: Preserve spaces in path to spark-ec2 Key: SPARK-5434 URL: https://issues.apache.org/jira/browse/SPARK-5434 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-5473) Expose SSH failures after status checks pass

Nicholas Chammas created SPARK-5473: --- Summary: Expose SSH failures after status checks pass Key: SPARK-5473 URL: https://issues.apache.org/jira/browse/SPARK-5473 Project: Spark Issue Type

[jira] [Commented] (SPARK-5541) Allow running Maven or SBT in run-tests

[ https://issues.apache.org/jira/browse/SPARK-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302525#comment-14302525 ] Nicholas Chammas commented on SPARK-5541: - Dup of SPARK-3355? > Allow

[jira] [Commented] (SPARK-2004) QA Automation

[ https://issues.apache.org/jira/browse/SPARK-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302549#comment-14302549 ] Nicholas Chammas commented on SPARK-2004: - [~mengxr] - Do you mind if I ren

[jira] [Commented] (SPARK-2005) Investigate linux container-based solution

[ https://issues.apache.org/jira/browse/SPARK-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302554#comment-14302554 ] Nicholas Chammas commented on SPARK-2005: - [~mengxr] - Do you mind if I ren

[jira] [Commented] (SPARK-4868) Twitter DStream.map() throws "Task not serializable"

[ https://issues.apache.org/jira/browse/SPARK-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305798#comment-14305798 ] Nicholas Chammas commented on SPARK-4868: - [~tobias.schlatter] - Here's

[jira] [Updated] (SPARK-3185) SPARK launch on Hadoop 2 in EC2 throws Tachyon exception when Formatting JOURNAL_FOLDER

[ https://issues.apache.org/jira/browse/SPARK-3185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3185: Component/s: EC2 > SPARK launch on Hadoop 2 in EC2 throws Tachyon exception when Formatt

[jira] [Commented] (SPARK-5403) Ignore UserKnownHostsFile in SSH calls

[ https://issues.apache.org/jira/browse/SPARK-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307904#comment-14307904 ] Nicholas Chammas commented on SPARK-5403: - I believe this issue duplicate

[jira] [Created] (SPARK-5627) Enhance spark-ec2 for some programmatic use cases

Nicholas Chammas created SPARK-5627: --- Summary: Enhance spark-ec2 for some programmatic use cases Key: SPARK-5627 URL: https://issues.apache.org/jira/browse/SPARK-5627 Project: Spark Issue

[jira] [Created] (SPARK-5628) Add option to return spark-ec2 version

Nicholas Chammas created SPARK-5628: --- Summary: Add option to return spark-ec2 version Key: SPARK-5628 URL: https://issues.apache.org/jira/browse/SPARK-5628 Project: Spark Issue Type

[jira] [Updated] (SPARK-5629) Add spark-ec2 option to return info about cluster for programmatic consumption

[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5629: Description: If someone is programmatically launching a cluster with {{spark-ec2}}, they

[jira] [Created] (SPARK-5629) Add spark-ec2 option to return info about cluster for programmatic consumption

Nicholas Chammas created SPARK-5629: --- Summary: Add spark-ec2 option to return info about cluster for programmatic consumption Key: SPARK-5629 URL: https://issues.apache.org/jira/browse/SPARK-5629

[jira] [Commented] (SPARK-5335) Destroying cluster in VPC with "--delete-groups" fails to remove security groups

[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308133#comment-14308133 ] Nicholas Chammas commented on SPARK-5335: - For the record: [AWS says|h

[jira] [Updated] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5637: Component/s: EC2 > Expose spark_ec2 as as StarCluster Plu

[jira] [Commented] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308394#comment-14308394 ] Nicholas Chammas commented on SPARK-5637: - [~agrothberg] - Can you expand on

[jira] [Comment Edited] (SPARK-5335) Destroying cluster in VPC with "--delete-groups" fails to remove security groups

[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308133#comment-14308133 ] Nicholas Chammas edited comment on SPARK-5335 at 2/6/15 1:1

[jira] [Comment Edited] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308394#comment-14308394 ] Nicholas Chammas edited comment on SPARK-5637 at 2/6/15 1:1

[jira] [Commented] (SPARK-4983) Tag EC2 instances in the same call that launches them

[ https://issues.apache.org/jira/browse/SPARK-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309649#comment-14309649 ] Nicholas Chammas commented on SPARK-4983: - To summarize the discussion we ha

[jira] [Updated] (SPARK-560) Specialize RDDs / iterators

[ https://issues.apache.org/jira/browse/SPARK-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-560: --- Component/s: Spark Core > Specialize RDDs / iterat

[jira] [Commented] (SPARK-560) Specialize RDDs / iterators

[ https://issues.apache.org/jira/browse/SPARK-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309709#comment-14309709 ] Nicholas Chammas commented on SPARK-560: [~matei], [~pwendell], [~rxin]: Is

[jira] [Updated] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-540: --- Component/s: Spark Core > Add API to customize in-memory representation of R

[jira] [Commented] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309728#comment-14309728 ] Nicholas Chammas commented on SPARK-540: [~matei], [~rxin]: Is this issue s

[jira] [Updated] (SPARK-706) Failures in block manager put leads to task hanging

[ https://issues.apache.org/jira/browse/SPARK-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-706: --- Component/s: Block Manager > Failures in block manager put leads to task hang

[jira] [Commented] (SPARK-706) Failures in block manager put leads to task hanging

[ https://issues.apache.org/jira/browse/SPARK-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309733#comment-14309733 ] Nicholas Chammas commented on SPARK-706: [~rxin] Is this issue still v

[jira] [Commented] (SPARK-761) Print a nicer error message when incompatible Spark binaries try to talk

[ https://issues.apache.org/jira/browse/SPARK-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309741#comment-14309741 ] Nicholas Chammas commented on SPARK-761: Not sure what component this falls u

[jira] [Updated] (SPARK-1425) PySpark can crash Executors if worker.py fails while serializing data

[ https://issues.apache.org/jira/browse/SPARK-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1425: Component/s: PySpark > PySpark can crash Executors if worker.py fails while serializ

[jira] [Updated] (SPARK-2326) DiskBlockManager could add DiskChecker function for kicking off bad directories

[ https://issues.apache.org/jira/browse/SPARK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2326: Component/s: Block Manager > DiskBlockManager could add DiskChecker function for kick

[jira] [Updated] (SPARK-729) Closures not always serialized at capture time

[ https://issues.apache.org/jira/browse/SPARK-729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-729: --- Component/s: Spark Core > Closures not always serialized at capture t

[jira] [Commented] (SPARK-1799) Add init script to the debian packaging

[ https://issues.apache.org/jira/browse/SPARK-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309753#comment-14309753 ] Nicholas Chammas commented on SPARK-1799: - cc [~markhamstra], [~sr

[jira] [Commented] (SPARK-1927) Implicits declared in companion objects not found in Spark shell

[ https://issues.apache.org/jira/browse/SPARK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309755#comment-14309755 ] Nicholas Chammas commented on SPARK-1927: - cc [~tobias.schlatter] > Im

[jira] [Updated] (SPARK-1927) Implicits declared in companion objects not found in Spark shell

[ https://issues.apache.org/jira/browse/SPARK-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1927: Component/s: Spark Shell > Implicits declared in companion objects not found in Spark sh

[jira] [Updated] (SPARK-1346) Backport SPARK-1210 into 0.9 branch

[ https://issues.apache.org/jira/browse/SPARK-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1346: Labels: backport-needed (was: ) > Backport SPARK-1210 into 0.9 bra

[jira] [Updated] (SPARK-2064) web ui should not remove executors if they are dead

[ https://issues.apache.org/jira/browse/SPARK-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2064: Component/s: Web UI > web ui should not remove executors if they are d

[jira] [Updated] (SPARK-2654) Leveled logging in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-2654: Component/s: PySpark > Leveled logging in PySp

[jira] [Updated] (SPARK-3246) Support weighted SVMWithSGD for classification of unbalanced dataset

[ https://issues.apache.org/jira/browse/SPARK-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3246: Component/s: MLlib > Support weighted SVMWithSGD for classification of unbalanced data

[jira] [Updated] (SPARK-3600) RDD[Double] doesn't use primitive arrays for caching

[ https://issues.apache.org/jira/browse/SPARK-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3600: Component/s: Spark Core > RDD[Double] doesn't use primitive arrays for

[jira] [Updated] (SPARK-4024) Remember user preferences for metrics to show in the UI

[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4024: Component/s: Web UI > Remember user preferences for metrics to show in the

[jira] [Updated] (SPARK-3956) Python API for Distributed Matrix

[ https://issues.apache.org/jira/browse/SPARK-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3956: Component/s: PySpark > Python API for Distributed Mat

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Fix Version/s: 1.2.2 > Add option to return spark-ec2 vers

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Labels: backport-needed (was: ) > Add option to return spark-ec2 vers

[jira] [Updated] (SPARK-5664) Restore stty settings when exiting for launching spark-shell from SBT

[ https://issues.apache.org/jira/browse/SPARK-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5664: Component/s: Build > Restore stty settings when exiting for launching spark-shell from

[jira] [Updated] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1061: Component/s: Spark Core > allow Hadoop RDDs to be read w/ a partitio

[jira] [Updated] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5259: Component/s: Spark Core > Fix endless retry stage by add task equal() and hashcode()

[jira] [Updated] (SPARK-5175) bug in updating counters when starting multiple workers/supervisors in actor-based receiver

[ https://issues.apache.org/jira/browse/SPARK-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5175: Component/s: Spark Core > bug in updating counters when starting multiple work

[jira] [Updated] (SPARK-5363) Spark 1.2 freeze without error notification

[ https://issues.apache.org/jira/browse/SPARK-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5363: Component/s: PySpark > Spark 1.2 freeze without error notificat

[jira] [Updated] (SPARK-5175) bug in updating counters when starting multiple workers/supervisors in actor-based receiver

[ https://issues.apache.org/jira/browse/SPARK-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5175: Component/s: (was: Spark Core) Streaming > bug in updating count

[jira] [Commented] (SPARK-5363) Spark 1.2 freeze without error notification

[ https://issues.apache.org/jira/browse/SPARK-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311050#comment-14311050 ] Nicholas Chammas commented on SPARK-5363: - [~TJKlein] - Can you provide

[jira] [Updated] (SPARK-4808) Spark fails to spill with small number of large objects

[ https://issues.apache.org/jira/browse/SPARK-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4808: Component/s: Spark Core > Spark fails to spill with small number of large obje

[jira] [Updated] (SPARK-5080) Expose more cluster resource information to user

[ https://issues.apache.org/jira/browse/SPARK-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5080: Component/s: Spark Core > Expose more cluster resource information to u

[jira] [Updated] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5524: Component/s: Build > Remove messy dependencies to lo

[jira] [Updated] (SPARK-5156) Priority queue for cross application scheduling

[ https://issues.apache.org/jira/browse/SPARK-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5156: Component/s: Scheduler > Priority queue for cross application schedul

[jira] [Updated] (SPARK-1142) Allow adding jars on app submission, outside of code

[ https://issues.apache.org/jira/browse/SPARK-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1142: Component/s: Spark Submit > Allow adding jars on app submission, outside of c

[jira] [Updated] (SPARK-4383) Delay scheduling doesn't work right when jobs have tasks with different locality levels

[ https://issues.apache.org/jira/browse/SPARK-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4383: Component/s: Scheduler > Delay scheduling doesn't work right when jobs have ta

[jira] [Commented] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311054#comment-14311054 ] Nicholas Chammas commented on SPARK-5668: - This sounds good to me, Miguel.

[jira] [Commented] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311055#comment-14311055 ] Nicholas Chammas commented on SPARK-5628: - We still need a backport to 1.2.2

[jira] [Updated] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5668: Labels: starter (was: ) > spark_ec2.py region parameter could be either mandatory or

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311122#comment-14311122 ] Nicholas Chammas commented on SPARK-5524: - Oh my bad. Thanks for the correc

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311121#comment-14311121 ] Nicholas Chammas commented on SPARK-5524: - Oh my bad. Thanks for the correc

[jira] [Issue Comment Deleted] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5524: Comment: was deleted (was: Oh my bad. Thanks for the correction.) > Remove me

[jira] [Commented] (SPARK-3431) Parallelize Scala/Java test execution

[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311135#comment-14311135 ] Nicholas Chammas commented on SPARK-3431: - [~srowen] - Have you tried anyt

[jira] [Created] (SPARK-5685) Show warning when users open text files compressed with non-splittable algorithms like gzip

Nicholas Chammas created SPARK-5685: --- Summary: Show warning when users open text files compressed with non-splittable algorithms like gzip Key: SPARK-5685 URL: https://issues.apache.org/jira/browse/SPARK-5685

[jira] [Commented] (SPARK-5685) Show warning when users open text files compressed with non-splittable algorithms like gzip

[ https://issues.apache.org/jira/browse/SPARK-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311931#comment-14311931 ] Nicholas Chammas commented on SPARK-5685: - [~joshrosen] - What do you thin

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312854#comment-14312854 ] Nicholas Chammas commented on SPARK-3044: - [~rxin] / [~pwendell] Is there an

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312878#comment-14312878 ] Nicholas Chammas commented on SPARK-3044: - I use RSS plenty to track compa

[jira] [Commented] (SPARK-1805) Error launching cluster when master and slave machines are of different virtualization types

[ https://issues.apache.org/jira/browse/SPARK-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313079#comment-14313079 ] Nicholas Chammas commented on SPARK-1805: - I've created a PR to catch t

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313214#comment-14313214 ] Nicholas Chammas commented on SPARK-5676: - [~srowen] - I don't t

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313254#comment-14313254 ] Nicholas Chammas commented on SPARK-5676: - It ended up in Mesos because [S

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313271#comment-14313271 ] Nicholas Chammas commented on SPARK-5676: - Yeah, AFAIK it has nothing to do

[jira] [Created] (SPARK-5747) Review all Bash scripts for word splitting bugs

Nicholas Chammas created SPARK-5747: --- Summary: Review all Bash scripts for word splitting bugs Key: SPARK-5747 URL: https://issues.apache.org/jira/browse/SPARK-5747 Project: Spark Issue

[jira] [Updated] (SPARK-5747) Review all Bash scripts for word splitting bugs

[ https://issues.apache.org/jira/browse/SPARK-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5747: Description: Triggered by [this discussion|http://apache-spark-developers-list.1001551.n3

[jira] [Created] (SPARK-5749) Fix Bash word splitting bugs in compute-classpath.sh

Nicholas Chammas created SPARK-5749: --- Summary: Fix Bash word splitting bugs in compute-classpath.sh Key: SPARK-5749 URL: https://issues.apache.org/jira/browse/SPARK-5749 Project: Spark

[jira] [Updated] (SPARK-5749) Fix Bash word splitting bugs in compute-classpath.sh

[ https://issues.apache.org/jira/browse/SPARK-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5749: Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-5747) > Fix Bash w

[jira] [Commented] (SPARK-5765) word split problem in run-example and compute-classpath

[ https://issues.apache.org/jira/browse/SPARK-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318869#comment-14318869 ] Nicholas Chammas commented on SPARK-5765: - FWIW [~srowen], the last time I

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320905#comment-14320905 ] Nicholas Chammas commented on SPARK-3821: - If you want Java 8 alongside 7,

[jira] [Commented] (SPARK-5813) Spark-ec2: Switch to OracleJDK

[ https://issues.apache.org/jira/browse/SPARK-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321807#comment-14321807 ] Nicholas Chammas commented on SPARK-5813: - Given the above discussion, this s

[jira] [Commented] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321811#comment-14321811 ] Nicholas Chammas commented on SPARK-5637: - OK, so I watched [the intro video

[jira] [Commented] (SPARK-925) Allow ec2 scripts to load default options from a json file

[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321810#comment-14321810 ] Nicholas Chammas commented on SPARK-925: Loading config from a file seems li

[jira] [Resolved] (SPARK-5749) Fix Bash word splitting bugs in compute-classpath.sh

[ https://issues.apache.org/jira/browse/SPARK-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-5749. - Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/4561 [~andrewor14

[jira] [Created] (SPARK-5865) Add doc warnings for methods that collect an RDD to the driver

Nicholas Chammas created SPARK-5865: --- Summary: Add doc warnings for methods that collect an RDD to the driver Key: SPARK-5865 URL: https://issues.apache.org/jira/browse/SPARK-5865 Project: Spark

[jira] [Commented] (SPARK-5865) Add doc warnings for methods that collect an RDD to the driver

[ https://issues.apache.org/jira/browse/SPARK-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324631#comment-14324631 ] Nicholas Chammas commented on SPARK-5865: - cc [~rxin], [~pwendell], [~joshr

[jira] [Updated] (SPARK-5708) Add Slf4jSink to Spark Metrics Sink

[ https://issues.apache.org/jira/browse/SPARK-5708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5708: Component/s: Spark Core > Add Slf4jSink to Spark Metrics S

[jira] [Updated] (SPARK-5763) Sort-based Groupby and Join to resolve skewed data

[ https://issues.apache.org/jira/browse/SPARK-5763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5763: Component/s: Spark Core Shuffle > Sort-based Groupby and Join to reso

[jira] [Updated] (SPARK-5856) In Maven build script, launch Zinc with more memory

[ https://issues.apache.org/jira/browse/SPARK-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5856: Component/s: Build > In Maven build script, launch Zinc with more mem

[jira] [Updated] (SPARK-5711) Sort Shuffle performance issues about using AppendOnlyMap for large data sets

[ https://issues.apache.org/jira/browse/SPARK-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5711: Component/s: Shuffle > Sort Shuffle performance issues about using AppendOnlyMap for la

[jira] [Comment Edited] (SPARK-925) Allow ec2 scripts to load default options from a json file

[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321810#comment-14321810 ] Nicholas Chammas edited comment on SPARK-925 at 2/17/15 6:5

<    12   13   14   15   16   17   18   19   20   21   >