[jira] [Created] (SPARK-4841) Batch serializer bug in PySpark's RDD.zip

Xiangrui Meng created SPARK-4841: Summary: Batch serializer bug in PySpark's RDD.zip Key: SPARK-4841 URL: https://issues.apache.org/jira/browse/SPARK-4841 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4810) Failed to run collect

[ https://issues.apache.org/jira/browse/SPARK-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] newjunwei updated SPARK-4810: - Description: my application failed like below.i want to know the possible reason.Not enough memory may ca

[jira] [Commented] (SPARK-785) ClosureCleaner not invoked on most PairRDDFunctions

[ https://issues.apache.org/jira/browse/SPARK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245762#comment-14245762 ] Apache Spark commented on SPARK-785: User 'srowen' has created a pull request for this

[jira] [Resolved] (SPARK-4325) Improve spark-ec2 cluster launch times

[ https://issues.apache.org/jira/browse/SPARK-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4325. --- Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Nicholas Chammas Fixed by https://git

[jira] [Commented] (SPARK-4810) Failed to run collect

[ https://issues.apache.org/jira/browse/SPARK-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245660#comment-14245660 ] Josh Rosen commented on SPARK-4810: --- Can you update this ticket with additional informat

[jira] [Resolved] (SPARK-3556) Monitoring and debugging improvements (Spark 1.2)

[ https://issues.apache.org/jira/browse/SPARK-3556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3556. --- Resolution: Fixed Fix Version/s: 1.2.0 > Monitoring and debugging improvements (Spark 1.2) > --

[jira] [Resolved] (SPARK-2642) Add jobId in web UI

[ https://issues.apache.org/jira/browse/SPARK-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2642. --- Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Josh Rosen I believe that this was ad

[jira] [Resolved] (SPARK-1362) Web UI should provide page of showing statistics and stage list for a given job

[ https://issues.apache.org/jira/browse/SPARK-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1362. --- Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Josh Rosen This was fixed by SPARK-41

[jira] [Resolved] (SPARK-1613) Difficulty starting up cluster on Amazon EC2

[ https://issues.apache.org/jira/browse/SPARK-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1613. --- Resolution: Incomplete I'm resolving this as "Incomplete" since this JIRA doesn't have enough informa

[jira] [Updated] (SPARK-3840) Spark EC2 templates fail when variables are missing

[ https://issues.apache.org/jira/browse/SPARK-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3840: -- Affects Version/s: 1.2.0 > Spark EC2 templates fail when variables are missing > ---

[jira] [Resolved] (SPARK-3840) Spark EC2 templates fail when variables are missing

[ https://issues.apache.org/jira/browse/SPARK-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3840. --- Resolution: Fixed Fix Version/s: 1.2.0 I think that this should have been fixed in 1.2.0 via a

[jira] [Resolved] (SPARK-2611) VPC Issue while creating an ec2 cluster

[ https://issues.apache.org/jira/browse/SPARK-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2611. --- Resolution: Duplicate I'm resolving this as a duplicate of SPARK-3405, which has an PR under review.

[jira] [Commented] (SPARK-1555) enable ec2/spark_ec2.py to stop/delete cluster non-interactively

[ https://issues.apache.org/jira/browse/SPARK-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245595#comment-14245595 ] Josh Rosen commented on SPARK-1555: --- Why not use the {{yes}} unix utility for this? {co

[jira] [Resolved] (SPARK-1751) spark ec2 scripts should check for SSh to be up

[ https://issues.apache.org/jira/browse/SPARK-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1751. --- Resolution: Fixed Assignee: Nicholas Chammas This was addressed by SPARK-3398, so I'm marking th

[jira] [Resolved] (SPARK-1574) ec2/spark_ec2.py should provide option to control number of attempts for ssh operations

[ https://issues.apache.org/jira/browse/SPARK-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1574. --- Resolution: Fixed Assignee: Nicholas Chammas I think that SPARK-3398 should have fixed this in S

[jira] [Resolved] (SPARK-4718) spark-ec2 script creates empty spark folder

[ https://issues.apache.org/jira/browse/SPARK-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4718. --- Resolution: Duplicate This looks like a duplicate of SPARK-4731. > spark-ec2 script creates empty spa

[jira] [Updated] (SPARK-4837) NettyBlockTransferService does not abide by spark.blockManager.port config option

[ https://issues.apache.org/jira/browse/SPARK-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-4837: -- Priority: Blocker (was: Critical) > NettyBlockTransferService does not abide by spark.blockManager.port

[jira] [Commented] (SPARK-4837) NettyBlockTransferService does not abide by spark.blockManager.port config option

[ https://issues.apache.org/jira/browse/SPARK-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245497#comment-14245497 ] Andrew Ash commented on SPARK-4837: --- This is a regression from features that landed in 1

[jira] [Commented] (SPARK-4835) Streaming saveAs*HadoopFiles() methods may throw FileAlreadyExistsException during checkpoint recovery

[ https://issues.apache.org/jira/browse/SPARK-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245437#comment-14245437 ] Josh Rosen commented on SPARK-4835: --- I thought about the "figure out whether the batch h

[jira] [Commented] (SPARK-4605) Proposed Contribution: Spark Kernel to enable interactive Spark applications

[ https://issues.apache.org/jira/browse/SPARK-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245400#comment-14245400 ] Raymond Yee commented on SPARK-4605: Does the Spark Kernel project allow one to run py

[jira] [Commented] (SPARK-4840) Incorrect documentation of master url on Running Spark on Mesos page

[ https://issues.apache.org/jira/browse/SPARK-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245335#comment-14245335 ] Sam Stoelinga commented on SPARK-4840: -- It's my first time deploying, so better wait

[jira] [Commented] (SPARK-4840) Incorrect documentation of master url on Running Spark on Mesos page

[ https://issues.apache.org/jira/browse/SPARK-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245323#comment-14245323 ] Sean Owen commented on SPARK-4840: -- Is that specific to your environment? For example I k

[jira] [Created] (SPARK-4840) Incorrect documentation of master url on Running Spark on Mesos page

Sam Stoelinga created SPARK-4840: Summary: Incorrect documentation of master url on Running Spark on Mesos page Key: SPARK-4840 URL: https://issues.apache.org/jira/browse/SPARK-4840 Project: Spark

[jira] [Commented] (SPARK-4838) StackOverflowError when serialization task

[ https://issues.apache.org/jira/browse/SPARK-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245288#comment-14245288 ] Sean Owen commented on SPARK-4838: -- Where does the repeating stack trace begin? Can you s

[jira] [Commented] (SPARK-4835) Streaming saveAs*HadoopFiles() methods may throw FileAlreadyExistsException during checkpoint recovery

[ https://issues.apache.org/jira/browse/SPARK-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245267#comment-14245267 ] Tathagata Das commented on SPARK-4835: -- I wonder whether there is a semantically clea

[jira] [Commented] (SPARK-4833) spark-shell.cmd not starting again after a while in windows 8.1

[ https://issues.apache.org/jira/browse/SPARK-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245258#comment-14245258 ] Thousif Ahmed commented on SPARK-4833: -- I ran spark sql example and word count exampl

[jira] [Commented] (SPARK-4835) Streaming saveAs*HadoopFiles() methods may throw FileAlreadyExistsException during checkpoint recovery

[ https://issues.apache.org/jira/browse/SPARK-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245250#comment-14245250 ] Josh Rosen commented on SPARK-4835: --- Alright, pushed an experimental version of the {{Dy