[
https://issues.apache.org/jira/browse/SPARK-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-2947:
---
Summary: DAGScheduler scheduling infinite loop (was: DAGScheduler
scheduling dead cycle)
> DAGSched
[
https://issues.apache.org/jira/browse/SPARK-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092034#comment-14092034
]
Apache Spark commented on SPARK-2953:
-
User 'rxin' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2953:
---
Description: Instead of requiring
"org.apache.spark.io.LZ4CompressionCodec", it is easier for users i
Reynold Xin created SPARK-2953:
--
Summary: Allow using short names for io compression codecs
Key: SPARK-2953
URL: https://issues.apache.org/jira/browse/SPARK-2953
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2953:
---
Component/s: Spark Core
> Allow using short names for io compression codecs
> ---
[
https://issues.apache.org/jira/browse/SPARK-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2953:
---
Issue Type: Improvement (was: Bug)
> Allow using short names for io compression codecs
> ---
[
https://issues.apache.org/jira/browse/SPARK-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092014#comment-14092014
]
Apache Spark commented on SPARK-2907:
-
User 'Ishiihara' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2952:
---
Component/s: Spark Core
> Enable logging actor messages at DEBUG level
>
[
https://issues.apache.org/jira/browse/SPARK-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2952:
---
Target Version/s: 1.1.0
> Enable logging actor messages at DEBUG level
>
[
https://issues.apache.org/jira/browse/SPARK-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092012#comment-14092012
]
Apache Spark commented on SPARK-2952:
-
User 'rxin' has created a pull request for this
Reynold Xin created SPARK-2952:
--
Summary: Enable logging actor messages at DEBUG level
Key: SPARK-2952
URL: https://issues.apache.org/jira/browse/SPARK-2952
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091997#comment-14091997
]
Patrick Wendell commented on SPARK-2678:
This issue was fixed by:
https://github.c
[
https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2678:
---
Fix Version/s: (was: 1.0.3)
> `Spark-submit` overrides user application options
> ---
[
https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2678:
---
Assignee: Kousuke Saruta (was: Cheng Lian)
> `Spark-submit` overrides user application optio
[
https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2678:
---
Target Version/s: 1.1.0 (was: 1.1.0, 1.0.3)
> `Spark-submit` overrides user application opti
[
https://issues.apache.org/jira/browse/SPARK-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091996#comment-14091996
]
Patrick Wendell commented on SPARK-2894:
I closed this in favor of SPARK-2678 sinc
[
https://issues.apache.org/jira/browse/SPARK-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2894.
Resolution: Duplicate
> spark-shell doesn't accept flags
>
[
https://issues.apache.org/jira/browse/SPARK-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-1766.
Resolution: Fixed
Fix Version/s: 1.1.0
Assignee: Chris Cope
Tar
[
https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091986#comment-14091986
]
Josh Rosen commented on SPARK-2871:
---
There's actually an open PR for this that's current
[
https://issues.apache.org/jira/browse/SPARK-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-2947:
---
Description:
Stage to resubmit more than 5 times.
This seems to be caused by {{FetchFailed.bmAddr
Josh Rosen created SPARK-2951:
-
Summary: SerDeUtils.pythonToPairRDD fails on RDDs of pickled
array.arrays in Python 2.6
Key: SPARK-2951
URL: https://issues.apache.org/jira/browse/SPARK-2951
Project: Spark
Shivaram Venkataraman created SPARK-2950:
Summary: Add GC time and Shuffle Write time to JobLogger output
Key: SPARK-2950
URL: https://issues.apache.org/jira/browse/SPARK-2950
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091940#comment-14091940
]
Michael Yannakopoulos commented on SPARK-2871:
--
I can help with this issue. M
[
https://issues.apache.org/jira/browse/SPARK-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091937#comment-14091937
]
Michael Yannakopoulos commented on SPARK-2923:
--
Hi Xiangrui,
I didn't have i
[
https://issues.apache.org/jira/browse/SPARK-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-2948:
--
Affects Version/s: (was: 1.0.2)
1.1.0
> PySpark doesn't work on Python 2.6
>
Aaron Davidson created SPARK-2949:
-
Summary: SparkContext does not fate-share with ActorSystem
Key: SPARK-2949
URL: https://issues.apache.org/jira/browse/SPARK-2949
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091907#comment-14091907
]
Apache Spark commented on SPARK-2948:
-
User 'sarutak' has created a pull request for t
Kousuke Saruta created SPARK-2948:
-
Summary: PySpark doesn't work on Python 2.6
Key: SPARK-2948
URL: https://issues.apache.org/jira/browse/SPARK-2948
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091881#comment-14091881
]
Mridul Muralidharan commented on SPARK-2931:
[~joshrosen] [~kayousterhout] Add
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated SPARK-2931:
---
Attachment: test.patch
A patch to showcase the exception
> getAllowedLocalityLevel()
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091849#comment-14091849
]
Mridul Muralidharan commented on SPARK-2931:
Checking more, it might have been
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-2931:
--
Attachment: scala-sort-by-key.err
@ [~kayousterhout]: I can see how that code in {{executorLost()}} cou
[
https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091817#comment-14091817
]
Sandy Ryza commented on SPARK-2945:
---
spark.executor.instances apparently isn't used for
[
https://issues.apache.org/jira/browse/SPARK-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091784#comment-14091784
]
Xiangrui Meng commented on SPARK-2944:
--
I checked that one first. It was okay after t
[
https://issues.apache.org/jira/browse/SPARK-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-2947:
---
Description:
Stage to resubmit more than 5 times.
This seems to be caused by {{FetchFailed.bmAddr
[
https://issues.apache.org/jira/browse/SPARK-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-2947:
---
Fix Version/s: 1.1.0
> DAGScheduler scheduling dead cycle
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-2947:
---
Fix Version/s: 1.0.3
> DAGScheduler scheduling dead cycle
> --
>
>
Guoqiang Li created SPARK-2947:
--
Summary: DAGScheduler scheduling dead cycle
Key: SPARK-2947
URL: https://issues.apache.org/jira/browse/SPARK-2947
Project: Spark
Issue Type: Bug
Compon
[
https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091753#comment-14091753
]
Saisai Shao edited comment on SPARK-2926 at 8/9/14 2:09 PM:
Hi
[
https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091753#comment-14091753
]
Saisai Shao commented on SPARK-2926:
Hi Matei, thanks a lot for your comments.
The or
[
https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091747#comment-14091747
]
Vincenzo Selvaggio commented on SPARK-1406:
---
Thanks for clarifying.
> PMML mode
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091746#comment-14091746
]
Mridul Muralidharan commented on SPARK-2931:
[~kayousterhout] this is weird, I
[
https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091741#comment-14091741
]
Sean Owen commented on SPARK-1406:
--
BSD 3-Clause is compatible with AL2. Spark's distribu
[
https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091738#comment-14091738
]
Vincenzo Selvaggio commented on SPARK-1406:
---
I agree with Sean, I could see the
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091703#comment-14091703
]
Kay Ousterhout commented on SPARK-2931:
---
Josh and I chatted a bit about this offline
[
https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091702#comment-14091702
]
Shay Rojansky commented on SPARK-2945:
--
That would be great news indeed, I didn't fin
[
https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2945:
---
Component/s: YARN
> Allow specifying num of executors in the context configuration
>
[
https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091701#comment-14091701
]
Patrick Wendell commented on SPARK-2945:
Hey [~roji] I believe this already exists
[
https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091700#comment-14091700
]
Patrick Wendell commented on SPARK-2931:
[~matei] Hey Matei - IIRC you looked at t
Shay Rojansky created SPARK-2946:
Summary: Allow specifying * for --num-executors in YARN
Key: SPARK-2946
URL: https://issues.apache.org/jira/browse/SPARK-2946
Project: Spark
Issue Type: Impr
Shay Rojansky created SPARK-2945:
Summary: Allow specifying num of executors in the context
configuration
Key: SPARK-2945
URL: https://issues.apache.org/jira/browse/SPARK-2945
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091699#comment-14091699
]
Patrick Wendell commented on SPARK-2944:
Hey [~mengxr], do you know how the behavi
[
https://issues.apache.org/jira/browse/SPARK-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2861:
---
Assignee: Chandan Kumar
> Doc comment of DoubleRDDFunctions.histogram is incorrect
>
[
https://issues.apache.org/jira/browse/SPARK-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2861.
Resolution: Fixed
Fix Version/s: 1.1.0
Issue resolved by pull request 1786
[https://
[
https://issues.apache.org/jira/browse/SPARK-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-2944:
-
Description:
16 nodes EC2 cluster:
{code}
val rdd = sc.makeRDD(0 until 1e9.toInt, 1000).cache()
Xiangrui Meng created SPARK-2944:
Summary: sc.makeRDD doesn't distribute partitions evenly
Key: SPARK-2944
URL: https://issues.apache.org/jira/browse/SPARK-2944
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091693#comment-14091693
]
Matei Zaharia commented on SPARK-2926:
--
Basically because of these things, it would b
[
https://issues.apache.org/jira/browse/SPARK-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2942:
---
Target Version/s: 1.2.0
> Report error messages back from server to client
>
Reynold Xin created SPARK-2943:
--
Summary: Create config options for Netty sendBufferSize and
receiveBufferSize
Key: SPARK-2943
URL: https://issues.apache.org/jira/browse/SPARK-2943
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2939:
---
Target Version/s: 1.2.0
> Support fetching in-memory blocks for Netty network module
> --
Reynold Xin created SPARK-2942:
--
Summary: Report error messages back from server to client
Key: SPARK-2942
URL: https://issues.apache.org/jira/browse/SPARK-2942
Project: Spark
Issue Type: Sub-ta
[
https://issues.apache.org/jira/browse/SPARK-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2936:
---
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-2468
> Migrate Netty network module fr
Reynold Xin created SPARK-2940:
--
Summary: Support fetching multiple blocks in a single request in
Netty network module
Key: SPARK-2940
URL: https://issues.apache.org/jira/browse/SPARK-2940
Project: Spark
Reynold Xin created SPARK-2941:
--
Summary: Add config option to support NIO vs OIO in Netty network
module
Key: SPARK-2941
URL: https://issues.apache.org/jira/browse/SPARK-2941
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091685#comment-14091685
]
Matei Zaharia commented on SPARK-2926:
--
Hey Saisai, a couple of questions about this:
[
https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2468:
---
Description:
Right now shuffle send goes through the block manager. This is inefficient
because it r
Reynold Xin created SPARK-2939:
--
Summary: Support fetching in-memory blocks for Netty network module
Key: SPARK-2939
URL: https://issues.apache.org/jira/browse/SPARK-2939
Project: Spark
Issue Ty
Reynold Xin created SPARK-2938:
--
Summary: Support SASL authentication in Netty network module
Key: SPARK-2938
URL: https://issues.apache.org/jira/browse/SPARK-2938
Project: Spark
Issue Type: Sub
[
https://issues.apache.org/jira/browse/SPARK-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091684#comment-14091684
]
Saisai Shao commented on SPARK-2926:
Hi Sandy,
Thanks a lot for your comments, basic
69 matches
Mail list logo