[
https://issues.apache.org/jira/browse/SPARK-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034890#comment-14034890
]
Patrick Wendell commented on SPARK-2171:
That's pretty cool! So if I understand co
[
https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034864#comment-14034864
]
Patrick Wendell commented on SPARK-2038:
It was my fault for proposing this change
[
https://issues.apache.org/jira/browse/SPARK-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2009.
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
Issue resolved by pu
[
https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Malaska closed SPARK-2173.
--
Resolution: Invalid
Not an issue. GraphX doesn't need these features because it is not as limiting
at
[
https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034816#comment-14034816
]
Ted Malaska commented on SPARK-2173:
Sorry I'm slow I just realized I don't even need
[
https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034798#comment-14034798
]
Ted Malaska commented on SPARK-2173:
Nope a broadcast wont work either. Let me think
[
https://issues.apache.org/jira/browse/SPARK-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034779#comment-14034779
]
Mark Baker commented on SPARK-791:
--
I began porting Pyspark to Python 3, but with my modes
[
https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034751#comment-14034751
]
Ted Malaska commented on SPARK-2173:
Never mind. I had to close the pull request. I
[
https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034748#comment-14034748
]
Ted Malaska commented on SPARK-2173:
This is my first attempt. Let me know what you t
[
https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034739#comment-14034739
]
Nan Zhu commented on SPARK-2038:
Ah, I seethat's fine...
> Don't shadow "conf" variab
[
https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2038.
Resolution: Won't Fix
> Don't shadow "conf" variable in saveAsHadoop functions
> --
[
https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034735#comment-14034735
]
Patrick Wendell commented on SPARK-2038:
Unfortunately after discussion with Reyno
[
https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell reopened SPARK-2038:
> Don't shadow "conf" variable in saveAsHadoop functions
>
[
https://issues.apache.org/jira/browse/SPARK-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034730#comment-14034730
]
Vlad Frolov commented on SPARK-2172:
I've tried to run the code in standalone and loca
Brandon Amos created SPARK-2175:
---
Summary: Null values when using App trait.
Key: SPARK-2175
URL: https://issues.apache.org/jira/browse/SPARK-2175
Project: Spark
Issue Type: Bug
Compo
[
https://issues.apache.org/jira/browse/SPARK-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-2060.
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
> Querying JSON Datasets wit
[
https://issues.apache.org/jira/browse/SPARK-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2170.
Resolution: Not a Problem
This was fixed already in a hotfix. But thanks for submitting the
[
https://issues.apache.org/jira/browse/SPARK-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng updated SPARK-2174:
-
Description:
In `reduce` and `aggregate`, the driver node spends linear time on the number
of pa
Xiangrui Meng created SPARK-2174:
Summary: Implement treeReduce and treeAggregate
Key: SPARK-2174
URL: https://issues.apache.org/jira/browse/SPARK-2174
Project: Spark
Issue Type: New Feature
Ted Malaska created SPARK-2173:
--
Summary: Add Master Computer and SuperStep Accumulator to Pregel
GraphX Implement
Key: SPARK-2173
URL: https://issues.apache.org/jira/browse/SPARK-2173
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Malaska updated SPARK-2173:
---
Summary: Add Master Computer and SuperStep Accumulator to Pregel GraphX
Implemention (was: Add Maste
[
https://issues.apache.org/jira/browse/SPARK-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vlad Frolov updated SPARK-2172:
---
Description:
Here is the simple reproduce code:
{noformat}
$ HADOOP_CONF_DIR=/etc/hadoop/conf MASTER
Vlad Frolov created SPARK-2172:
--
Summary: PySpark cannot import mllib modules in YARN-client mode
Key: SPARK-2172
URL: https://issues.apache.org/jira/browse/SPARK-2172
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lukasz Jastrzebski updated SPARK-2168:
--
Description:
Small issue but still.
I run history server through Marathon and balance
[
https://issues.apache.org/jira/browse/SPARK-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-1990.
--
Resolution: Fixed
HOTFIX: https://github.com/apache/spark/pull/1108
> spark-ec2 should only ne
[
https://issues.apache.org/jira/browse/SPARK-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng reopened SPARK-1990:
--
In your PR, you should use subprocess.PIPE instead of calling PIPE directly.
Could you submit a pa
[
https://issues.apache.org/jira/browse/SPARK-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Andrzejak updated SPARK-2171:
---
Attachment: examples-Groovy4Spark.zip
Groovy4Spark - Introduction.pdf
A short
Artur Andrzejak created SPARK-2171:
--
Summary: Groovy bindings for Spark
Key: SPARK-2171
URL: https://issues.apache.org/jira/browse/SPARK-2171
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034372#comment-14034372
]
Grega Kespret commented on SPARK-2170:
--
Added a Pull request that resolves this issue
Grega Kespret created SPARK-2170:
Summary: Fix for global name 'PIPE' is not defined.
Key: SPARK-2170
URL: https://issues.apache.org/jira/browse/SPARK-2170
Project: Spark
Issue Type: Bug
Marcelo Vanzin created SPARK-2169:
-
Summary: SparkUI.setAppName() has no effect
Key: SPARK-2169
URL: https://issues.apache.org/jira/browse/SPARK-2169
Project: Spark
Issue Type: Bug
Lukasz Jastrzebski created SPARK-2168:
-
Summary: History Server renered page not suitable for load
balancing
Key: SPARK-2168
URL: https://issues.apache.org/jira/browse/SPARK-2168
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034343#comment-14034343
]
Lukasz Jastrzebski commented on SPARK-2168:
---
I can open pull request for this, l
[
https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294
]
Sebastien Rainville edited comment on SPARK-2022 at 6/17/14 8:41 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2166:
---
Target Version/s: 1.1.0
> Enumerating instances to be terminated before the prompting the use
[
https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2166:
---
Assignee: Jean-Martin Archer
> Enumerating instances to be terminated before the prompting th
[
https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2166:
---
Affects Version/s: 1.0.0
> Enumerating instances to be terminated before the prompting the us
[
https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294
]
Sebastien Rainville edited comment on SPARK-2022 at 6/17/14 8:08 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294
]
Sebastien Rainville edited comment on SPARK-2022 at 6/17/14 8:08 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294
]
Sebastien Rainville commented on SPARK-2022:
I'm seeing the same behavior when
[
https://issues.apache.org/jira/browse/SPARK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Davidson resolved SPARK-2147.
---
Resolution: Fixed
https://github.com/apache/spark/pull/1102
> Master UI forgets about Execut
[
https://issues.apache.org/jira/browse/SPARK-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Davidson resolved SPARK-2161.
---
Resolution: Fixed
https://github.com/apache/spark/pull/1102
> UI should remember executors t
[
https://issues.apache.org/jira/browse/SPARK-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-1907.
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
> spark-submit: add exec at
Thomas Graves created SPARK-2167:
Summary: spark-submit should return exit code based on
failure/success
Key: SPARK-2167
URL: https://issues.apache.org/jira/browse/SPARK-2167
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-1907:
-
Assignee: Colin Patrick McCabe
> spark-submit: add exec at the end of the script
> --
[
https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2038.
Resolution: Fixed
Fix Version/s: 1.1.0
Issue resolved by pull request 1087
[https://
[
https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2146:
---
Priority: Minor (was: Major)
> Fix the takeOrdered doc
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2146.
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
Issue resolved by pu
[
https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2146:
---
Component/s: Documentation
> Fix the takeOrdered doc
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2146:
---
Assignee: Sandy Ryza (was: Patrick Wendell)
> Fix the takeOrdered doc
>
[
https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell reassigned SPARK-2146:
--
Assignee: Patrick Wendell
> Fix the takeOrdered doc
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2146:
---
Labels: (was: documentation)
> Fix the takeOrdered doc
> ---
>
>
Jean-Martin Archer created SPARK-2166:
-
Summary: Enumerating instances to be terminated before the
prompting the users to continue.
Key: SPARK-2166
URL: https://issues.apache.org/jira/browse/SPARK-2166
Thomas Graves created SPARK-2165:
Summary: spark on yarn: add support for setting maxAppAttempts in
the ApplicationSubmissionContext
Key: SPARK-2165
URL: https://issues.apache.org/jira/browse/SPARK-2165
[
https://issues.apache.org/jira/browse/SPARK-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034135#comment-14034135
]
Andrew Ash commented on SPARK-2157:
---
I pulled together Egor's work for HttpBroadcast and
[
https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1199:
---
Target Version/s: 1.0.1, 1.1.0
> Type mismatch in Spark shell when using case class defined i
[
https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell reassigned SPARK-1199:
--
Assignee: Prashant Sharma
Prashant said he could look into this - so I'm assigning it t
[
https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1199:
---
Fix Version/s: (was: 1.1.0)
> Type mismatch in Spark shell when using case class defined
[
https://issues.apache.org/jira/browse/SPARK-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034036#comment-14034036
]
Ryan Fishel commented on SPARK-2058:
Was Eugen's fix implemented?
> SPARK_CONF_DIR sh
[
https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-1471:
---
Fix Version/s: 1.1.0
> Worker not recognize Driver state at standalone mode
> --
[
https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-1471:
---
Fix Version/s: (was: 1.0.0)
1.0.1
> Worker not recognize Driver state at stan
[
https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li updated SPARK-1471:
---
Fix Version/s: 1.0.0
> Worker not recognize Driver state at standalone mode
> --
[
https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guoqiang Li resolved SPARK-1471.
Resolution: Fixed
> Worker not recognize Driver state at standalone mode
> ---
[
https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033986#comment-14033986
]
Nan Zhu commented on SPARK-1471:
this has been fixed by
https://github.com/apache/spark/c
[
https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033984#comment-14033984
]
Nan Zhu commented on SPARK-1471:
I will fix it right now
> Worker not recognize Driver s
[
https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033938#comment-14033938
]
Federico Ragona commented on SPARK-1471:
Hello,
I'm facing the same issue in versi
[
https://issues.apache.org/jira/browse/SPARK-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033703#comment-14033703
]
Gang Bai commented on SPARK-2163:
-
I've created a pull request on GitHub for this.
https:
[
https://issues.apache.org/jira/browse/SPARK-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-2053.
-
Resolution: Fixed
Fix Version/s: 1.1.0
1.0.1
> Add Catalyst exp
Michael Armbrust created SPARK-2164:
---
Summary: Applying UDF on a struct throws a MatchError
Key: SPARK-2164
URL: https://issues.apache.org/jira/browse/SPARK-2164
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-2164.
-
Resolution: Fixed
Fixed by: https://github.com/apache/spark/pull/796
> Applying UDF on a
[
https://issues.apache.org/jira/browse/SPARK-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033625#comment-14033625
]
Mridul Muralidharan commented on SPARK-1353:
This is due to limitation in spar
[
https://issues.apache.org/jira/browse/SPARK-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gang Bai updated SPARK-2163:
Summary: Set ``setConvergenceTol'' with a parameter of type Double instead
of Int (was: Change ``setConver
Gang Bai created SPARK-2163:
---
Summary: Change ``setConvergenceTol'' with a parameter of type
Double instead of Int
Key: SPARK-2163
URL: https://issues.apache.org/jira/browse/SPARK-2163
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033607#comment-14033607
]
Gavin commented on SPARK-1353:
--
I have the same problem. spark-assembly-1.0.0-hadoop2.2.0 .
[
https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2144:
---
Assignee: Andrew Or
> SparkUI Executors tab displays incorrect RDD blocks
> -
[
https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2144.
Resolution: Fixed
Fix Version/s: 1.1.0
Issue resolved by pull request 1080
[https://
[
https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2144:
---
Component/s: Web UI
> SparkUI Executors tab displays incorrect RDD blocks
> -
[
https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2144:
---
Component/s: (was: Spark Core)
> SparkUI Executors tab displays incorrect RDD blocks
> --
[
https://issues.apache.org/jira/browse/SPARK-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033550#comment-14033550
]
Sean Owen commented on SPARK-2160:
--
You already added this as https://issues.apache.org/j
[
https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-2155:
Priority: Minor (was: Major)
> Support effectful / non-deterministic key expressions in CA
[
https://issues.apache.org/jira/browse/SPARK-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2035.
Resolution: Fixed
Fix Version/s: 1.1.0
Issue resolved by pull request 981
[https://g
[
https://issues.apache.org/jira/browse/SPARK-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2035:
---
Assignee: Daniel Darabos
> Make a stage's call stack available on the UI
> --
82 matches
Mail list logo