[jira] [Commented] (SPARK-2171) Groovy bindings for Spark

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034890#comment-14034890 ] Patrick Wendell commented on SPARK-2171: That's pretty cool! So if I understand co

[jira] [Commented] (SPARK-2038) Don't shadow "conf" variable in saveAsHadoop functions

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034864#comment-14034864 ] Patrick Wendell commented on SPARK-2038: It was my fault for proposing this change

[jira] [Resolved] (SPARK-2009) Key not found exception when slow receiver starts

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2009. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by pu

[jira] [Closed] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

2014-06-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska closed SPARK-2173. -- Resolution: Invalid Not an issue. GraphX doesn't need these features because it is not as limiting at

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

2014-06-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034816#comment-14034816 ] Ted Malaska commented on SPARK-2173: Sorry I'm slow I just realized I don't even need

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

2014-06-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034798#comment-14034798 ] Ted Malaska commented on SPARK-2173: Nope a broadcast wont work either. Let me think

[jira] [Commented] (SPARK-791) [pyspark] operator.getattr not serialized

2014-06-17 Thread Mark Baker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034779#comment-14034779 ] Mark Baker commented on SPARK-791: -- I began porting Pyspark to Python 3, but with my modes

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

2014-06-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034751#comment-14034751 ] Ted Malaska commented on SPARK-2173: Never mind. I had to close the pull request. I

[jira] [Commented] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

2014-06-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034748#comment-14034748 ] Ted Malaska commented on SPARK-2173: This is my first attempt. Let me know what you t

[jira] [Commented] (SPARK-2038) Don't shadow "conf" variable in saveAsHadoop functions

2014-06-17 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034739#comment-14034739 ] Nan Zhu commented on SPARK-2038: Ah, I seethat's fine... > Don't shadow "conf" variab

[jira] [Resolved] (SPARK-2038) Don't shadow "conf" variable in saveAsHadoop functions

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2038. Resolution: Won't Fix > Don't shadow "conf" variable in saveAsHadoop functions > --

[jira] [Commented] (SPARK-2038) Don't shadow "conf" variable in saveAsHadoop functions

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034735#comment-14034735 ] Patrick Wendell commented on SPARK-2038: Unfortunately after discussion with Reyno

[jira] [Reopened] (SPARK-2038) Don't shadow "conf" variable in saveAsHadoop functions

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2038: > Don't shadow "conf" variable in saveAsHadoop functions >

[jira] [Commented] (SPARK-2172) PySpark cannot import mllib modules in YARN-client mode

2014-06-17 Thread Vlad Frolov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034730#comment-14034730 ] Vlad Frolov commented on SPARK-2172: I've tried to run the code in standalone and loca

[jira] [Created] (SPARK-2175) Null values when using App trait.

2014-06-17 Thread Brandon Amos (JIRA)
Brandon Amos created SPARK-2175: --- Summary: Null values when using App trait. Key: SPARK-2175 URL: https://issues.apache.org/jira/browse/SPARK-2175 Project: Spark Issue Type: Bug Compo

[jira] [Resolved] (SPARK-2060) Querying JSON Datasets with SQL and DSL in Spark SQL

2014-06-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2060. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 > Querying JSON Datasets wit

[jira] [Resolved] (SPARK-2170) Fix for global name 'PIPE' is not defined.

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2170. Resolution: Not a Problem This was fixed already in a hotfix. But thanks for submitting the

[jira] [Updated] (SPARK-2174) Implement treeReduce and treeAggregate

2014-06-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2174: - Description: In `reduce` and `aggregate`, the driver node spends linear time on the number of pa

[jira] [Created] (SPARK-2174) Implement treeReduce and treeAggregate

2014-06-17 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-2174: Summary: Implement treeReduce and treeAggregate Key: SPARK-2174 URL: https://issues.apache.org/jira/browse/SPARK-2174 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implement

2014-06-17 Thread Ted Malaska (JIRA)
Ted Malaska created SPARK-2173: -- Summary: Add Master Computer and SuperStep Accumulator to Pregel GraphX Implement Key: SPARK-2173 URL: https://issues.apache.org/jira/browse/SPARK-2173 Project: Spark

[jira] [Updated] (SPARK-2173) Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention

2014-06-17 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated SPARK-2173: --- Summary: Add Master Computer and SuperStep Accumulator to Pregel GraphX Implemention (was: Add Maste

[jira] [Updated] (SPARK-2172) PySpark cannot import mllib modules in YARN-client mode

2014-06-17 Thread Vlad Frolov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vlad Frolov updated SPARK-2172: --- Description: Here is the simple reproduce code: {noformat} $ HADOOP_CONF_DIR=/etc/hadoop/conf MASTER

[jira] [Created] (SPARK-2172) PySpark cannot import mllib modules in YARN-client mode

2014-06-17 Thread Vlad Frolov (JIRA)
Vlad Frolov created SPARK-2172: -- Summary: PySpark cannot import mllib modules in YARN-client mode Key: SPARK-2172 URL: https://issues.apache.org/jira/browse/SPARK-2172 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2168) History Server renered page not suitable for load balancing

2014-06-17 Thread Lukasz Jastrzebski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Jastrzebski updated SPARK-2168: -- Description: Small issue but still. I run history server through Marathon and balance

[jira] [Resolved] (SPARK-1990) spark-ec2 should only need Python 2.6, not 2.7

2014-06-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-1990. -- Resolution: Fixed HOTFIX: https://github.com/apache/spark/pull/1108 > spark-ec2 should only ne

[jira] [Reopened] (SPARK-1990) spark-ec2 should only need Python 2.6, not 2.7

2014-06-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-1990: -- In your PR, you should use subprocess.PIPE instead of calling PIPE directly. Could you submit a pa

[jira] [Updated] (SPARK-2171) Groovy bindings for Spark

2014-06-17 Thread Artur Andrzejak (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artur Andrzejak updated SPARK-2171: --- Attachment: examples-Groovy4Spark.zip Groovy4Spark - Introduction.pdf A short

[jira] [Created] (SPARK-2171) Groovy bindings for Spark

2014-06-17 Thread Artur Andrzejak (JIRA)
Artur Andrzejak created SPARK-2171: -- Summary: Groovy bindings for Spark Key: SPARK-2171 URL: https://issues.apache.org/jira/browse/SPARK-2171 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2170) Fix for global name 'PIPE' is not defined.

2014-06-17 Thread Grega Kespret (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034372#comment-14034372 ] Grega Kespret commented on SPARK-2170: -- Added a Pull request that resolves this issue

[jira] [Created] (SPARK-2170) Fix for global name 'PIPE' is not defined.

2014-06-17 Thread Grega Kespret (JIRA)
Grega Kespret created SPARK-2170: Summary: Fix for global name 'PIPE' is not defined. Key: SPARK-2170 URL: https://issues.apache.org/jira/browse/SPARK-2170 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2169) SparkUI.setAppName() has no effect

2014-06-17 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-2169: - Summary: SparkUI.setAppName() has no effect Key: SPARK-2169 URL: https://issues.apache.org/jira/browse/SPARK-2169 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2168) History Server renered page not suitable for load balancing

2014-06-17 Thread Lukasz Jastrzebski (JIRA)
Lukasz Jastrzebski created SPARK-2168: - Summary: History Server renered page not suitable for load balancing Key: SPARK-2168 URL: https://issues.apache.org/jira/browse/SPARK-2168 Project: Spark

[jira] [Commented] (SPARK-2168) History Server renered page not suitable for load balancing

2014-06-17 Thread Lukasz Jastrzebski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034343#comment-14034343 ] Lukasz Jastrzebski commented on SPARK-2168: --- I can open pull request for this, l

[jira] [Comment Edited] (SPARK-2022) Spark 1.0.0 is failing if mesos.coarse set to true

2014-06-17 Thread Sebastien Rainville (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294 ] Sebastien Rainville edited comment on SPARK-2022 at 6/17/14 8:41 PM: ---

[jira] [Updated] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2166: --- Target Version/s: 1.1.0 > Enumerating instances to be terminated before the prompting the use

[jira] [Updated] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2166: --- Assignee: Jean-Martin Archer > Enumerating instances to be terminated before the prompting th

[jira] [Updated] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2166: --- Affects Version/s: 1.0.0 > Enumerating instances to be terminated before the prompting the us

[jira] [Comment Edited] (SPARK-2022) Spark 1.0.0 is failing if mesos.coarse set to true

2014-06-17 Thread Sebastien Rainville (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294 ] Sebastien Rainville edited comment on SPARK-2022 at 6/17/14 8:08 PM: ---

[jira] [Comment Edited] (SPARK-2022) Spark 1.0.0 is failing if mesos.coarse set to true

2014-06-17 Thread Sebastien Rainville (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294 ] Sebastien Rainville edited comment on SPARK-2022 at 6/17/14 8:08 PM: ---

[jira] [Commented] (SPARK-2022) Spark 1.0.0 is failing if mesos.coarse set to true

2014-06-17 Thread Sebastien Rainville (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034294#comment-14034294 ] Sebastien Rainville commented on SPARK-2022: I'm seeing the same behavior when

[jira] [Resolved] (SPARK-2147) Master UI forgets about Executors when application exits cleanly

2014-06-17 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-2147. --- Resolution: Fixed https://github.com/apache/spark/pull/1102 > Master UI forgets about Execut

[jira] [Resolved] (SPARK-2161) UI should remember executors that have been removed

2014-06-17 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-2161. --- Resolution: Fixed https://github.com/apache/spark/pull/1102 > UI should remember executors t

[jira] [Resolved] (SPARK-1907) spark-submit: add exec at the end of the script

2014-06-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-1907. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 > spark-submit: add exec at

[jira] [Created] (SPARK-2167) spark-submit should return exit code based on failure/success

2014-06-17 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-2167: Summary: spark-submit should return exit code based on failure/success Key: SPARK-2167 URL: https://issues.apache.org/jira/browse/SPARK-2167 Project: Spark

[jira] [Updated] (SPARK-1907) spark-submit: add exec at the end of the script

2014-06-17 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-1907: - Assignee: Colin Patrick McCabe > spark-submit: add exec at the end of the script > --

[jira] [Resolved] (SPARK-2038) Don't shadow "conf" variable in saveAsHadoop functions

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2038. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1087 [https://

[jira] [Updated] (SPARK-2146) Fix the takeOrdered doc

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2146: --- Priority: Minor (was: Major) > Fix the takeOrdered doc > --- > >

[jira] [Resolved] (SPARK-2146) Fix the takeOrdered doc

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2146. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by pu

[jira] [Updated] (SPARK-2146) Fix the takeOrdered doc

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2146: --- Component/s: Documentation > Fix the takeOrdered doc > --- > >

[jira] [Updated] (SPARK-2146) Fix the takeOrdered doc

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2146: --- Assignee: Sandy Ryza (was: Patrick Wendell) > Fix the takeOrdered doc >

[jira] [Assigned] (SPARK-2146) Fix the takeOrdered doc

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-2146: -- Assignee: Patrick Wendell > Fix the takeOrdered doc > --- > >

[jira] [Updated] (SPARK-2146) Fix the takeOrdered doc

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2146: --- Labels: (was: documentation) > Fix the takeOrdered doc > --- > >

[jira] [Created] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

2014-06-17 Thread Jean-Martin Archer (JIRA)
Jean-Martin Archer created SPARK-2166: - Summary: Enumerating instances to be terminated before the prompting the users to continue. Key: SPARK-2166 URL: https://issues.apache.org/jira/browse/SPARK-2166

[jira] [Created] (SPARK-2165) spark on yarn: add support for setting maxAppAttempts in the ApplicationSubmissionContext

2014-06-17 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-2165: Summary: spark on yarn: add support for setting maxAppAttempts in the ApplicationSubmissionContext Key: SPARK-2165 URL: https://issues.apache.org/jira/browse/SPARK-2165

[jira] [Commented] (SPARK-2157) Can't write tight firewall rules for Spark

2014-06-17 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034135#comment-14034135 ] Andrew Ash commented on SPARK-2157: --- I pulled together Egor's work for HttpBroadcast and

[jira] [Updated] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1199: --- Target Version/s: 1.0.1, 1.1.0 > Type mismatch in Spark shell when using case class defined i

[jira] [Assigned] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1199: -- Assignee: Prashant Sharma Prashant said he could look into this - so I'm assigning it t

[jira] [Updated] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1199: --- Fix Version/s: (was: 1.1.0) > Type mismatch in Spark shell when using case class defined

[jira] [Commented] (SPARK-2058) SPARK_CONF_DIR should override all present configs

2014-06-17 Thread Ryan Fishel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034036#comment-14034036 ] Ryan Fishel commented on SPARK-2058: Was Eugen's fix implemented? > SPARK_CONF_DIR sh

[jira] [Updated] (SPARK-1471) Worker not recognize Driver state at standalone mode

2014-06-17 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1471: --- Fix Version/s: 1.1.0 > Worker not recognize Driver state at standalone mode > --

[jira] [Updated] (SPARK-1471) Worker not recognize Driver state at standalone mode

2014-06-17 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1471: --- Fix Version/s: (was: 1.0.0) 1.0.1 > Worker not recognize Driver state at stan

[jira] [Updated] (SPARK-1471) Worker not recognize Driver state at standalone mode

2014-06-17 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-1471: --- Fix Version/s: 1.0.0 > Worker not recognize Driver state at standalone mode > --

[jira] [Resolved] (SPARK-1471) Worker not recognize Driver state at standalone mode

2014-06-17 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li resolved SPARK-1471. Resolution: Fixed > Worker not recognize Driver state at standalone mode > ---

[jira] [Commented] (SPARK-1471) Worker not recognize Driver state at standalone mode

2014-06-17 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033986#comment-14033986 ] Nan Zhu commented on SPARK-1471: this has been fixed by https://github.com/apache/spark/c

[jira] [Commented] (SPARK-1471) Worker not recognize Driver state at standalone mode

2014-06-17 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033984#comment-14033984 ] Nan Zhu commented on SPARK-1471: I will fix it right now > Worker not recognize Driver s

[jira] [Commented] (SPARK-1471) Worker not recognize Driver state at standalone mode

2014-06-17 Thread Federico Ragona (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033938#comment-14033938 ] Federico Ragona commented on SPARK-1471: Hello, I'm facing the same issue in versi

[jira] [Commented] (SPARK-2163) Set ``setConvergenceTol'' with a parameter of type Double instead of Int

2014-06-17 Thread Gang Bai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033703#comment-14033703 ] Gang Bai commented on SPARK-2163: - I've created a pull request on GitHub for this. https:

[jira] [Resolved] (SPARK-2053) Add Catalyst expression for CASE WHEN

2014-06-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2053. - Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 > Add Catalyst exp

[jira] [Created] (SPARK-2164) Applying UDF on a struct throws a MatchError

2014-06-17 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-2164: --- Summary: Applying UDF on a struct throws a MatchError Key: SPARK-2164 URL: https://issues.apache.org/jira/browse/SPARK-2164 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-2164) Applying UDF on a struct throws a MatchError

2014-06-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2164. - Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/796 > Applying UDF on a

[jira] [Commented] (SPARK-1353) IllegalArgumentException when writing to disk

2014-06-17 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033625#comment-14033625 ] Mridul Muralidharan commented on SPARK-1353: This is due to limitation in spar

[jira] [Updated] (SPARK-2163) Set ``setConvergenceTol'' with a parameter of type Double instead of Int

2014-06-17 Thread Gang Bai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Bai updated SPARK-2163: Summary: Set ``setConvergenceTol'' with a parameter of type Double instead of Int (was: Change ``setConver

[jira] [Created] (SPARK-2163) Change ``setConvergenceTol'' with a parameter of type Double instead of Int

2014-06-17 Thread Gang Bai (JIRA)
Gang Bai created SPARK-2163: --- Summary: Change ``setConvergenceTol'' with a parameter of type Double instead of Int Key: SPARK-2163 URL: https://issues.apache.org/jira/browse/SPARK-2163 Project: Spark

[jira] [Commented] (SPARK-1353) IllegalArgumentException when writing to disk

2014-06-17 Thread Gavin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033607#comment-14033607 ] Gavin commented on SPARK-1353: -- I have the same problem. spark-assembly-1.0.0-hadoop2.2.0 .

[jira] [Updated] (SPARK-2144) SparkUI Executors tab displays incorrect RDD blocks

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2144: --- Assignee: Andrew Or > SparkUI Executors tab displays incorrect RDD blocks > -

[jira] [Resolved] (SPARK-2144) SparkUI Executors tab displays incorrect RDD blocks

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2144. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1080 [https://

[jira] [Updated] (SPARK-2144) SparkUI Executors tab displays incorrect RDD blocks

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2144: --- Component/s: Web UI > SparkUI Executors tab displays incorrect RDD blocks > -

[jira] [Updated] (SPARK-2144) SparkUI Executors tab displays incorrect RDD blocks

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2144: --- Component/s: (was: Spark Core) > SparkUI Executors tab displays incorrect RDD blocks > --

[jira] [Commented] (SPARK-2160) error of Decision tree algorithm in Spark MLlib

2014-06-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033550#comment-14033550 ] Sean Owen commented on SPARK-2160: -- You already added this as https://issues.apache.org/j

[jira] [Updated] (SPARK-2155) Support effectful / non-deterministic key expressions in CASE WHEN statements

2014-06-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2155: Priority: Minor (was: Major) > Support effectful / non-deterministic key expressions in CA

[jira] [Resolved] (SPARK-2035) Make a stage's call stack available on the UI

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2035. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 981 [https://g

[jira] [Updated] (SPARK-2035) Make a stage's call stack available on the UI

2014-06-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2035: --- Assignee: Daniel Darabos > Make a stage's call stack available on the UI > --