Wenchen Fan created SPARK-1912:
--
Summary: Compression memory issue during shuffle
Key: SPARK-1912
URL: https://issues.apache.org/jira/browse/SPARK-1912
Project: Spark
Issue Type: Bug
C
[
https://issues.apache.org/jira/browse/SPARK-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-1896.
--
Resolution: Fixed
Fix Version/s: 1.0.0
https://github.com/apache/spark/pull/846/
> MAST
[
https://issues.apache.org/jira/browse/SPARK-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-1897.
--
Resolution: Fixed
Fix Version/s: 1.0.0
https://github.com/apache/spark/pull/849
> Spark
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006664#comment-14006664
]
Madhu Siddalingaiah commented on SPARK-983:
---
Looking at
[OrderedRDDFunctions|htt
[
https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1911:
-
Affects Version/s: 1.0.0
> Emphasize that jars should be built with Java 6 for YARN
> ---
[
https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1911:
-
Fix Version/s: (was: 1.0.0)
1.0.1
> Emphasize that jars should be built with Java
Andrew Or created SPARK-1911:
Summary: Emphasize that jars should be built with Java 6 for YARN
Key: SPARK-1911
URL: https://issues.apache.org/jira/browse/SPARK-1911
Project: Spark
Issue Type: Su
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or closed SPARK-1904.
Resolution: Not a Problem
> ZooKeeper URI in spark-env.sh no longer working w/ bin/pyspark
> --
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006565#comment-14006565
]
Matei Zaharia commented on SPARK-1904:
--
This is actually desired behavior, I believe.
Hari Shreedharan created SPARK-1910:
---
Summary: Add onBlockComplete API to receiver
Key: SPARK-1910
URL: https://issues.apache.org/jira/browse/SPARK-1910
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das reassigned SPARK-1904:
Assignee: Tathagata Das
> ZooKeeper URI in spark-env.sh no longer working w/ bin/pyspark
>
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-1904:
-
Assignee: Andrew Or (was: Tathagata Das)
> ZooKeeper URI in spark-env.sh no longer working w/ bi
[
https://issues.apache.org/jira/browse/SPARK-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1909:
-
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-1652
> "--jars" is not supported i
[
https://issues.apache.org/jira/browse/SPARK-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-1905.
--
Resolution: Duplicate
> Issues with `spark-submit`
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1908:
-
Issue Type: Bug (was: Sub-task)
Parent: (was: SPARK-1905)
> Support local app jar in
[
https://issues.apache.org/jira/browse/SPARK-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1908:
-
Issue Type: Sub-task (was: Bug)
Parent: SPARK-1652
> Support local app jar in standalone
[
https://issues.apache.org/jira/browse/SPARK-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1906:
-
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-1652
> spark-submit doesn't send m
[
https://issues.apache.org/jira/browse/SPARK-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1906:
-
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-1905)
> spark-submit doe
[
https://issues.apache.org/jira/browse/SPARK-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1909:
-
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-1905)
> "--jars" is not
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-1900:
-
Component/s: Deploy
> Fix running PySpark files on YARN
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1870:
-
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-1905)
> Jars specified v
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1900:
-
Issue Type: Bug (was: Sub-task)
Parent: (was: SPARK-1905)
> Fix running PySpark file
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1900:
-
Issue Type: Sub-task (was: Bug)
Parent: SPARK-1652
> Fix running PySpark files on YARN
[
https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1870:
-
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-1652
> Jars specified via --jars i
[
https://issues.apache.org/jira/browse/SPARK-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006540#comment-14006540
]
Colin Patrick McCabe commented on SPARK-1898:
-
Yeah, we have the {{yarn-alpha}
Xiangrui Meng created SPARK-1909:
Summary: "--jars" is not supported in standalone cluster mode
Key: SPARK-1909
URL: https://issues.apache.org/jira/browse/SPARK-1909
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-1901:
---
Assignee: Zhen Peng
> Standalone worker update exector's state ahead of executor process exit
> -
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Lee updated SPARK-1904:
Environment:
Ubuntu AMI in EC2, build taken from tags/spark-v1.0.0 tag
{code}
$ lsb_release -r
Release:
Xiangrui Meng created SPARK-1908:
Summary: Support local app jar in standalone cluster mode
Key: SPARK-1908
URL: https://issues.apache.org/jira/browse/SPARK-1908
Project: Spark
Issue Type: Su
[
https://issues.apache.org/jira/browse/SPARK-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006526#comment-14006526
]
Colin Patrick McCabe commented on SPARK-1907:
-
https://github.com/apache/spark
Xiangrui Meng created SPARK-1906:
Summary: spark-submit doesn't send master URL to Driver in
standalone cluster mode
Key: SPARK-1906
URL: https://issues.apache.org/jira/browse/SPARK-1906
Project: Spar
Colin Patrick McCabe created SPARK-1907:
---
Summary: spark-submit: add exec at the end of the script
Key: SPARK-1907
URL: https://issues.apache.org/jira/browse/SPARK-1907
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1905:
-
Affects Version/s: (was: 1.0.0)
> Issues with `spark-submit`
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1905:
-
Summary: Issues with `spark-submit` (was: Issues with `spark-submit` in
v1.0)
> Issues with `sp
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1900:
-
Issue Type: Sub-task (was: Bug)
Parent: SPARK-1905
> Fix running PySpark files on YARN
[
https://issues.apache.org/jira/browse/SPARK-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1905:
-
Description:
Main JIRA for tracking the issues with `spark-submit` in different deploy modes.
Fo
[
https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1870:
-
Issue Type: Sub-task (was: Bug)
Parent: SPARK-1905
> Jars specified via --jars in spark-
[
https://issues.apache.org/jira/browse/SPARK-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1905:
-
Description:
Main JIRA for tracking the issues with `spark-submit` in different deploy modes.
Fo
[
https://issues.apache.org/jira/browse/SPARK-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-1905:
-
Description:
Main JIRA for tracking the issues with `spark-submit` in different deploy modes.
Fo
Xiangrui Meng created SPARK-1905:
Summary: Issues with `spark-submit` in v1.0
Key: SPARK-1905
URL: https://issues.apache.org/jira/browse/SPARK-1905
Project: Spark
Issue Type: Task
C
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006514#comment-14006514
]
Tathagata Das commented on SPARK-1904:
--
This seems to be a regression. Since we are m
[
https://issues.apache.org/jira/browse/SPARK-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006494#comment-14006494
]
Sandy Ryza commented on SPARK-1898:
---
The change only applies to Spark's stable/2.2+ code
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Lee updated SPARK-1904:
Description:
Attempting to run my bin/pyspark interactive shell against a Mesos cluster this
assignment to
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Lee updated SPARK-1904:
Description:
Attempting to run my bin/pyspark interactive shell against a Mesos cluster this
assignment to
[
https://issues.apache.org/jira/browse/SPARK-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Lee updated SPARK-1904:
Description:
Attempting to run my bin/pyspark interactive shell against a Mesos cluster this
assignment to
Eric Lee created SPARK-1904:
---
Summary: ZooKeeper URI in spark-env.sh no longer working w/
bin/pyspark
Key: SPARK-1904
URL: https://issues.apache.org/jira/browse/SPARK-1904
Project: Spark
Issue Typ
[
https://issues.apache.org/jira/browse/SPARK-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006334#comment-14006334
]
Andrew Ash commented on SPARK-1903:
---
Draft version here: https://github.com/apache/spark
Andrew Ash created SPARK-1903:
-
Summary: Document Spark's network connections
Key: SPARK-1903
URL: https://issues.apache.org/jira/browse/SPARK-1903
Project: Spark
Issue Type: Documentation
[
https://issues.apache.org/jira/browse/SPARK-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Ash updated SPARK-1902:
--
Description:
When running two shells on the same machine, I get the below error. The issue
is that th
Andrew Ash created SPARK-1902:
-
Summary: Spark shell prints error when :4040 port already in use
Key: SPARK-1902
URL: https://issues.apache.org/jira/browse/SPARK-1902
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Davidson updated SPARK-983:
-
Assignee: (was: Aaron Davidson)
> Support external sorting for RDD#sortByKey()
> -
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006262#comment-14006262
]
Aaron Davidson commented on SPARK-983:
--
[~aash] Note that the current implementation a
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Davidson updated SPARK-983:
-
Description: Currently, RDD#sortByKey() is implemented by a mapPartitions
which creates a buffer t
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Davidson updated SPARK-983:
-
Summary: Support external sorting for RDD#sortByKey() (was: External
hashing & sorting support)
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006251#comment-14006251
]
Aaron Davidson commented on SPARK-983:
--
This JIRA is pretty vague. We've already imple
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006221#comment-14006221
]
Andrew Ash commented on SPARK-983:
--
I think the main intention is to make the .sortByKey()
[
https://issues.apache.org/jira/browse/SPARK-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006161#comment-14006161
]
Madhu Siddalingaiah commented on SPARK-983:
---
Can someone comment on the scope of
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Description:
If I run the following on a YARN cluster
{code}
bin/spark-submit sheep.py --master yarn-clie
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Description:
If I run the following on a YARN cluster
{code}
bin/spark-submit sheep.py --master yarn-clie
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-1900:
-
Assignee: Andrew Or
> Fix running PySpark files on YARN
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Description:
If I run the following on a YARN cluster
```
bin/spark-submit sheep.py --master yarn-client
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Description:
If I run the following on a YARN cluster
{code}
bin/spark-submit sheep.py --master yarn-clie
[
https://issues.apache.org/jira/browse/SPARK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005749#comment-14005749
]
Zhen Peng commented on SPARK-1901:
--
https://github.com/apache/spark/pull/854
> Standalon
[
https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das resolved SPARK-1870.
--
Resolution: Fixed
Fix Version/s: 1.0.0
Fixed in https://github.com/apache/spark/pull/848
[
https://issues.apache.org/jira/browse/SPARK-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-1870:
-
Affects Version/s: (was: 1.0.0)
> Jars specified via --jars in spark-submit are not added to
Zhen Peng created SPARK-1901:
Summary: Standalone worker update exector's state ahead of
executor process exit
Key: SPARK-1901
URL: https://issues.apache.org/jira/browse/SPARK-1901
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Affects Version/s: (was: 0.9.1)
1.0.0
> Fix running PySpark files on YARN
> -
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Affects Version/s: 0.9.1
> Fix running PySpark files on YARN
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Component/s: PySpark
> Fix running PySpark files on YARN
> --
>
>
Andrew Or created SPARK-1900:
Summary: Fix running PySpark files on YARN
Key: SPARK-1900
URL: https://issues.apache.org/jira/browse/SPARK-1900
Project: Spark
Issue Type: Bug
Reporter
[
https://issues.apache.org/jira/browse/SPARK-1900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-1900:
-
Fix Version/s: 1.0.0
> Fix running PySpark files on YARN
> --
>
>
71 matches
Mail list logo
