[jira] [Resolved] (SPARK-9010) Improve the Spark Configuration document about `spark.kryoserializer.buffer`

2015-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9010. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.2 Issue resolved by pull request

[jira] [Commented] (SPARK-8851) in Yarn client mode, Client.scala does not login even when credentials are specified

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625999#comment-14625999 ] Apache Spark commented on SPARK-8851: - User 'harishreedharan' has created a pull

[jira] [Assigned] (SPARK-9031) Merge BlockObjectWriter and DiskBlockObject writer to remove abstract class

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9031: --- Assignee: Apache Spark (was: Josh Rosen) Merge BlockObjectWriter and DiskBlockObject

[jira] [Assigned] (SPARK-9031) Merge BlockObjectWriter and DiskBlockObject writer to remove abstract class

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9031: --- Assignee: Josh Rosen (was: Apache Spark) Merge BlockObjectWriter and DiskBlockObject

[jira] [Commented] (SPARK-9031) Merge BlockObjectWriter and DiskBlockObject writer to remove abstract class

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625920#comment-14625920 ] Apache Spark commented on SPARK-9031: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-9010) Improve the Spark Configuration document about `spark.kryoserializer.buffer`

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625994#comment-14625994 ] Apache Spark commented on SPARK-9010: - User 'stanzhai' has created a pull request for

[jira] [Commented] (SPARK-9003) Add map/update function to MLlib/Vector

2015-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625939#comment-14625939 ] Sean Owen commented on SPARK-9003: -- [~josephkb] Please not another one! the world has too

[jira] [Commented] (SPARK-9001) sbt doc fails due to javadoc errors

2015-07-14 Thread Joseph E. Gonzalez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625970#comment-14625970 ] Joseph E. Gonzalez commented on SPARK-9001: --- While the issue is generally minor

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625980#comment-14625980 ] Bolke de Bruin commented on SPARK-9019: --- Tracing this down it seems that the tokens

[jira] [Created] (SPARK-9031) Merge BlockObjectWriter and DiskBlockObject writer to remove abstract class

2015-07-14 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-9031: - Summary: Merge BlockObjectWriter and DiskBlockObject writer to remove abstract class Key: SPARK-9031 URL: https://issues.apache.org/jira/browse/SPARK-9031 Project: Spark

[jira] [Commented] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

2015-07-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625930#comment-14625930 ] François Garillot commented on SPARK-8975: -- Typesafe PR :

[jira] [Assigned] (SPARK-9020) Support mutable state in code gen expressions

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9020: --- Assignee: Apache Spark (was: Wenchen Fan) Support mutable state in code gen expressions

[jira] [Updated] (SPARK-9010) Improve the Spark Configuration document about `spark.kryoserializer.buffer`

2015-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9010: - Assignee: StanZhai Improve the Spark Configuration document about `spark.kryoserializer.buffer`

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626005#comment-14626005 ] Sean Owen commented on SPARK-9019: -- Same as SPARK-8851? spark-submit fails on yarn with

[jira] [Assigned] (SPARK-9020) Support mutable state in code gen expressions

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9020: --- Assignee: Wenchen Fan (was: Apache Spark) Support mutable state in code gen expressions

[jira] [Commented] (SPARK-9020) Support mutable state in code gen expressions

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625929#comment-14625929 ] Apache Spark commented on SPARK-9020: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-9025) Storage tab shows no blocks for cached RDDs

2015-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625976#comment-14625976 ] Sean Owen commented on SPARK-9025: -- I can't reproduce this on master. In Storage I get

[jira] [Assigned] (SPARK-8808) Fix assignments in SparkR

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8808: --- Assignee: Apache Spark Fix assignments in SparkR -

[jira] [Commented] (SPARK-8979) Implement a PIDRateEstimator

2015-07-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626118#comment-14626118 ] François Garillot commented on SPARK-8979: -- Parameter derivation available here:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626043#comment-14626043 ] Bolke de Bruin commented on SPARK-9019: --- Will try in a few minutes, however it did

[jira] [Updated] (SPARK-8974) There is a bug in The spark-dynamic-executor-allocation may be not supported

2015-07-14 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-8974: - Summary: There is a bug in The spark-dynamic-executor-allocation may be not supported (was: The

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626183#comment-14626183 ] Bolke de Bruin commented on SPARK-9019: --- [~srowen] unfortunately the patch from

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626183#comment-14626183 ] Bolke de Bruin edited comment on SPARK-9019 at 7/14/15 10:41 AM:

[jira] [Comment Edited] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

2015-07-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625930#comment-14625930 ] François Garillot edited comment on SPARK-8975 at 7/14/15 11:14 AM:

[jira] [Created] (SPARK-9032) scala.MatchError in DataFrameReader.json(String path)

2015-07-14 Thread Philipp Poetter (JIRA)
Philipp Poetter created SPARK-9032: -- Summary: scala.MatchError in DataFrameReader.json(String path) Key: SPARK-9032 URL: https://issues.apache.org/jira/browse/SPARK-9032 Project: Spark

[jira] [Updated] (SPARK-8974) There is a bug in dynamicAllocation. The spark-dynamic-executor-allocation may be not supported

2015-07-14 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-8974: - Summary: There is a bug in dynamicAllocation. The spark-dynamic-executor-allocation may be not

[jira] [Updated] (SPARK-8974) There is a bug in dynamicAllocation. When there is no running tasks, the number of executor is not zero.

2015-07-14 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-8974: - Summary: There is a bug in dynamicAllocation. When there is no running tasks, the number of

[jira] [Commented] (SPARK-8808) Fix assignments in SparkR

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626095#comment-14626095 ] Apache Spark commented on SPARK-8808: - User 'sun-rui' has created a pull request for

[jira] [Assigned] (SPARK-8808) Fix assignments in SparkR

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8808: --- Assignee: (was: Apache Spark) Fix assignments in SparkR -

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626113#comment-14626113 ] Bolke de Bruin commented on SPARK-9019: --- Now with debug info (not yet with patch):

[jira] [Updated] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-9034: Description: GenericUDTF#initialize() in Hive defines field names in a returned schema

[jira] [Updated] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-9034: Description: Hive GenericUDTF#initialize() defines field names in a returned schema though,

[jira] [Created] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-9034: --- Summary: Reflect field names defined in GenericUDTF Key: SPARK-9034 URL: https://issues.apache.org/jira/browse/SPARK-9034 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626300#comment-14626300 ] Bolke de Bruin edited comment on SPARK-9019 at 7/14/15 1:00 PM:

[jira] [Updated] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

2015-07-14 Thread Pavel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel updated SPARK-9033: - Description: I've a java.util.MapString, String field in a POJO class and I'm trying to use it to

[jira] [Updated] (SPARK-8974) There is a bug in dynamicAllocation. When there is no running tasks, the number of executor a long time without running tasks, the number of executor does not reduce to t

2015-07-14 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-8974: - Summary: There is a bug in dynamicAllocation. When there is no running tasks, the number of

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626256#comment-14626256 ] Bolke de Bruin commented on SPARK-9019: --- And some more debugging information. Please

[jira] [Created] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

2015-07-14 Thread Pavel (JIRA)
Pavel created SPARK-9033: Summary: scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL Key: SPARK-9033 URL: https://issues.apache.org/jira/browse/SPARK-9033 Project: Spark

[jira] [Commented] (SPARK-9034) Reflect field names defined in GenericUDTF

2015-07-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626279#comment-14626279 ] Takeshi Yamamuro commented on SPARK-9034: - I'll make a PR for this after

[jira] [Commented] (SPARK-5210) Support log rolling in EventLogger

2015-07-14 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626325#comment-14626325 ] Tao Wang commented on SPARK-5210: - Hi [~joshrosen], we found same problem in streaming /

[jira] [Comment Edited] (SPARK-5210) Support log rolling in EventLogger

2015-07-14 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626325#comment-14626325 ] Tao Wang edited comment on SPARK-5210 at 7/14/15 1:21 PM: -- Hi

[jira] [Commented] (SPARK-8977) Define the RateEstimator interface, and implement the ReceiverRateController

2015-07-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626202#comment-14626202 ] François Garillot commented on SPARK-8977: -- Typesafe PR:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626300#comment-14626300 ] Bolke de Bruin commented on SPARK-9019: --- It might be that we have a configuration

[jira] [Commented] (SPARK-8844) head/collect is broken in SparkR

2015-07-14 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626273#comment-14626273 ] Sun Rui commented on SPARK-8844: This is a bug about reading empty DataFrame. will submit

[jira] [Updated] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

2015-07-14 Thread Pavel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel updated SPARK-9033: - Description: I've a java.util.MapString, String field in a POJO class and I'm trying to use it to

[jira] [Updated] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

2015-07-14 Thread Pavel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel updated SPARK-9033: - Description: I've a java.util.MapString, String field in a POJO class and I'm trying to use it to

[jira] [Created] (SPARK-9035) Spark on Mesos Thread Context Class Loader issues

2015-07-14 Thread John Omernik (JIRA)
John Omernik created SPARK-9035: --- Summary: Spark on Mesos Thread Context Class Loader issues Key: SPARK-9035 URL: https://issues.apache.org/jira/browse/SPARK-9035 Project: Spark Issue Type:

[jira] [Commented] (SPARK-8996) Add Python API for Kolmogorov-Smirnov Test

2015-07-14 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626409#comment-14626409 ] Manoj Kumar commented on SPARK-8996: Hi, Can I work on this? Add Python API for

[jira] [Assigned] (SPARK-8125) Accelerate ParquetRelation2 metadata discovery

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8125: --- Assignee: Apache Spark (was: Cheng Lian) Accelerate ParquetRelation2 metadata discovery

[jira] [Commented] (SPARK-8125) Accelerate ParquetRelation2 metadata discovery

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626456#comment-14626456 ] Apache Spark commented on SPARK-8125: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8125) Accelerate ParquetRelation2 metadata discovery

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8125: --- Assignee: Cheng Lian (was: Apache Spark) Accelerate ParquetRelation2 metadata discovery

[jira] [Updated] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

2015-07-14 Thread Pavel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel updated SPARK-9033: - Description: I've a java.util.MapString, String field in a POJO class and I'm trying to use it to

[jira] [Updated] (SPARK-9033) scala.MatchError: interface java.util.Map (of class java.lang.Class) with Spark SQL

2015-07-14 Thread Pavel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel updated SPARK-9033: - Description: I've a java.util.MapString, String field in a POJO class and I'm trying to use it to

[jira] [Commented] (SPARK-8978) Implement the DirectKafkaController

2015-07-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626542#comment-14626542 ] François Garillot commented on SPARK-8978: -- Typesafe PR:

[jira] [Commented] (SPARK-8979) Implement a PIDRateEstimator

2015-07-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626543#comment-14626543 ] François Garillot commented on SPARK-8979: -- Typesafe PR:

[jira] [Commented] (SPARK-7751) Add @since to stable and experimental methods in MLlib

2015-07-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626533#comment-14626533 ] Xiangrui Meng commented on SPARK-7751: -- This is great! Thanks for providing the

[jira] [Created] (SPARK-9036) SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol

2015-07-14 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-9036: Summary: SparkListenerExecutorMetricsUpdate messages not included in JsonProtocol Key: SPARK-9036 URL: https://issues.apache.org/jira/browse/SPARK-9036 Project:

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626574#comment-14626574 ] Bolke de Bruin commented on SPARK-9019: --- Can this be related to YARN-3103?

[jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

2015-07-14 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626482#comment-14626482 ] Vincent Warmerdam commented on SPARK-8724: -- So a tutorial just went live for

[jira] [Issue Comment Deleted] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin updated SPARK-9019: -- Comment: was deleted (was: - this was incorrect - ) spark-submit fails on yarn with kerberos

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-14 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625980#comment-14625980 ] Bolke de Bruin edited comment on SPARK-9019 at 7/14/15 7:33 AM:

[jira] [Resolved] (SPARK-9001) sbt doc fails due to javadoc errors

2015-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9001. Resolution: Fixed Assignee: Joseph E. Gonzalez Fix Version/s: 1.5.0 sbt doc fails

[jira] [Commented] (SPARK-8624) DataFrameReader doesn't respect MERGE_SCHEMA setting for Parquet

2015-07-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626416#comment-14626416 ] Liang-Chi Hsieh commented on SPARK-8624: I think you can use

[jira] [Commented] (SPARK-8967) Implement @since as an annotation

2015-07-14 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626662#comment-14626662 ] Xiangrui Meng commented on SPARK-8967: -- The issue with Java annotation is that it

[jira] [Assigned] (SPARK-8945) Add and Subtract expression should support IntervalType

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8945: --- Assignee: Apache Spark Add and Subtract expression should support IntervalType

[jira] [Commented] (SPARK-8945) Add and Subtract expression should support IntervalType

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626683#comment-14626683 ] Apache Spark commented on SPARK-8945: - User 'viirya' has created a pull request for

[jira] [Created] (SPARK-9038) Missing TaskEnd event when task attempt is superseded by another (speculative) attempt

2015-07-14 Thread Ryan Williams (JIRA)
Ryan Williams created SPARK-9038: Summary: Missing TaskEnd event when task attempt is superseded by another (speculative) attempt Key: SPARK-9038 URL: https://issues.apache.org/jira/browse/SPARK-9038

[jira] [Assigned] (SPARK-8945) Add and Subtract expression should support IntervalType

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8945: --- Assignee: (was: Apache Spark) Add and Subtract expression should support IntervalType

[jira] [Commented] (SPARK-9037) Task table pagination for the Stage page

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626686#comment-14626686 ] Apache Spark commented on SPARK-9037: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-9037) Task table pagination for the Stage page

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9037: --- Assignee: Apache Spark Task table pagination for the Stage page

[jira] [Updated] (SPARK-9029) shortcut CaseKeyWhen if key is null

2015-07-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9029: Assignee: Wenchen Fan shortcut CaseKeyWhen if key is null

[jira] [Created] (SPARK-9037) Task table pagination for the Stage page

2015-07-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-9037: --- Summary: Task table pagination for the Stage page Key: SPARK-9037 URL: https://issues.apache.org/jira/browse/SPARK-9037 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-9037) Task table pagination for the Stage page

2015-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9037. -- Resolution: Duplicate [~zsxwing] Please search JIRA first; this has been filed a few times now. You

[jira] [Resolved] (SPARK-9029) shortcut CaseKeyWhen if key is null

2015-07-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9029. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7389

[jira] [Comment Edited] (SPARK-8965) Add ml-guide Python Example: Estimator, Transformer, and Param

2015-07-14 Thread Arijit Saha (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625831#comment-14625831 ] Arijit Saha edited comment on SPARK-8965 at 7/14/15 6:17 PM: -

[jira] [Resolved] (SPARK-9027) Generalize predicate pushdown into the metastore

2015-07-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-9027. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7386

[jira] [Commented] (SPARK-9005) RegressionMetrics computing incorrect explainedVariance and r2

2015-07-14 Thread Ayman Farahat (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626815#comment-14626815 ] Ayman Farahat commented on SPARK-9005: -- I compared the R2 and RMSE after fitting an

[jira] [Assigned] (SPARK-9022) UnsafeProject

2015-07-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9022: - Assignee: Davies Liu UnsafeProject - Key: SPARK-9022

[jira] [Resolved] (SPARK-8718) Improve EdgePartition2D for non perfect square number of partitions

2015-07-14 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-8718. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7104

[jira] [Updated] (SPARK-8343) Improve the Spark Streaming Guides

2015-07-14 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Dusenberry updated SPARK-8343: --- Labels: spark.tc (was: ) Improve the Spark Streaming Guides

[jira] [Updated] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-07-14 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Dusenberry updated SPARK-6485: --- Labels: spark.tc (was: ) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

[jira] [Commented] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-07-14 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627120#comment-14627120 ] Mike Dusenberry commented on SPARK-6485: Hey [~mengxr]. This is still coming,

[jira] [Commented] (SPARK-9022) UnsafeProject

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627035#comment-14627035 ] Apache Spark commented on SPARK-9022: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9022) UnsafeProject

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9022: --- Assignee: Apache Spark (was: Davies Liu) UnsafeProject -

[jira] [Assigned] (SPARK-9022) UnsafeProject

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9022: --- Assignee: Davies Liu (was: Apache Spark) UnsafeProject -

[jira] [Assigned] (SPARK-9043) Serialize key, value and combiner classes in ShuffleDependency

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9043: --- Assignee: Apache Spark Serialize key, value and combiner classes in ShuffleDependency

[jira] [Commented] (SPARK-9043) Serialize key, value and combiner classes in ShuffleDependency

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627051#comment-14627051 ] Apache Spark commented on SPARK-9043: - User 'massie' has created a pull request for

[jira] [Assigned] (SPARK-9043) Serialize key, value and combiner classes in ShuffleDependency

2015-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9043: --- Assignee: (was: Apache Spark) Serialize key, value and combiner classes in

[jira] [Updated] (SPARK-9045) Fix Scala 2.11 build break due in UnsafeExternalRowSorter

2015-07-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9045: -- Affects Version/s: 1.5.0 Target Version/s: 1.5.0 Fix Scala 2.11 build break due in

[jira] [Updated] (SPARK-7265) Improving documentation for Spark SQL Hive support

2015-07-14 Thread Christian Kadner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kadner updated SPARK-7265: Labels: spark.tc (was: ) Improving documentation for Spark SQL Hive support

[jira] [Updated] (SPARK-2859) Update url of Kryo project in related docs

2015-07-14 Thread Christian Kadner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kadner updated SPARK-2859: Labels: spark.tc (was: ) Update url of Kryo project in related docs

[jira] [Updated] (SPARK-8639) Instructions for executing jekyll in docs/README.md could be slightly more clear, typo in docs/api.md

2015-07-14 Thread Christian Kadner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kadner updated SPARK-8639: Labels: spark.tc (was: ) Instructions for executing jekyll in docs/README.md could be

[jira] [Updated] (SPARK-5562) LDA should handle empty documents

2015-07-14 Thread Christian Kadner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kadner updated SPARK-5562: Labels: spark.tc (was: starter) LDA should handle empty documents

[jira] [Updated] (SPARK-7357) Improving HBaseTest example

2015-07-14 Thread Christian Kadner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kadner updated SPARK-7357: Labels: spark.tc (was: ) Improving HBaseTest example ---

[jira] [Updated] (SPARK-7920) Make MLlib ChiSqSelector Serializable ( Fix Related Documentation Example).

2015-07-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7920: --- Labels: (was: spark.tc) Make MLlib ChiSqSelector Serializable ( Fix Related Documentation

[jira] [Updated] (SPARK-8927) Doc format wrong for some config descriptions

2015-07-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-8927: --- Labels: (was: spark.tc) Doc format wrong for some config descriptions

[jira] [Updated] (SPARK-7985) Remove fittingParamMap references. Update ML Doc Estimator, Transformer, and Param examples.

2015-07-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7985: --- Labels: (was: spark.tc) Remove fittingParamMap references. Update ML Doc Estimator,

[jira] [Updated] (SPARK-7969) Drop method on Dataframes should handle Column

2015-07-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7969: --- Labels: (was: spark.tc) Drop method on Dataframes should handle Column

[jira] [Updated] (SPARK-7969) Drop method on Dataframes should handle Column

2015-07-14 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Dusenberry updated SPARK-7969: --- Labels: spark.tc (was: ) Drop method on Dataframes should handle Column

[jira] [Updated] (SPARK-7883) Fixing broken trainImplicit example in MLlib Collaborative Filtering documentation.

2015-07-14 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Dusenberry updated SPARK-7883: --- Target Version/s: 1.4.0, 1.0.3, 1.1.2, 1.2.3, 1.3.2 (was: 1.0.3, 1.1.2, 1.2.3, 1.3.2, 1.4.0)

  1   2   3   >