[jira] [Comment Edited] (SPARK-9265) Dataframe.limit joined with another dataframe can be non-deterministic

2015-10-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973829#comment-14973829 ] Yanbo Liang edited comment on SPARK-9265 at 10/26/15 6:59 AM: --

[jira] [Assigned] (SPARK-11311) spark cannot describe temporary functions

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11311: Assignee: Apache Spark > spark cannot describe temporary functions > -

[jira] [Assigned] (SPARK-11311) spark cannot describe temporary functions

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11311: Assignee: (was: Apache Spark) > spark cannot describe temporary functions > --

[jira] [Commented] (SPARK-11311) spark cannot describe temporary functions

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973831#comment-14973831 ] Apache Spark commented on SPARK-11311: -- User 'adrian-wang' has created a pull reques

[jira] [Created] (SPARK-11312) Cannot drop temporary function

2015-10-26 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-11312: --- Summary: Cannot drop temporary function Key: SPARK-11312 URL: https://issues.apache.org/jira/browse/SPARK-11312 Project: Spark Issue Type: Bug Compon

[jira] [Commented] (SPARK-11312) Cannot drop temporary function

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973845#comment-14973845 ] Apache Spark commented on SPARK-11312: -- User 'adrian-wang' has created a pull reques

[jira] [Assigned] (SPARK-11312) Cannot drop temporary function

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11312: Assignee: (was: Apache Spark) > Cannot drop temporary function > -

[jira] [Assigned] (SPARK-11312) Cannot drop temporary function

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11312: Assignee: Apache Spark > Cannot drop temporary function > -- >

[jira] [Resolved] (SPARK-11312) Cannot drop temporary function

2015-10-26 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang resolved SPARK-11312. - Resolution: Duplicate > Cannot drop temporary function > -- > >

[jira] [Commented] (SPARK-11303) sample (without replacement) + filter returns wrong results in DataFrame

2015-10-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973896#comment-14973896 ] Yanbo Liang commented on SPARK-11303: - I think the reason of this bug is the same as

[jira] [Resolved] (SPARK-11310) only build spark core,Modify spark pom file:delete graphx

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11310. --- Resolution: Invalid It's not clear what you're trying to ask, but this is not the place anyway. Ask

[jira] [Commented] (SPARK-11305) Remove Third-Party Hadoop Distributions Doc Page

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973908#comment-14973908 ] Sean Owen commented on SPARK-11305: --- I support this and would tack on a few more reason

[jira] [Resolved] (SPARK-5966) Spark-submit deploy-mode incorrectly affecting submission when master = local[4]

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5966. -- Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 Issue resolved by pull request 92

[jira] [Commented] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2015-10-26 Thread Yuri Saito (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973943#comment-14973943 ] Yuri Saito commented on SPARK-11227: Resolved myself. I change from SQLContext to Hiv

[jira] [Commented] (SPARK-11302) Multivariate Gaussian Model with Covariance matrix return zero always

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973974#comment-14973974 ] Sean Owen commented on SPARK-11302: --- In R, it notes that your covariance matrix isn't p

[jira] [Commented] (SPARK-11303) sample (without replacement) + filter returns wrong results in DataFrame

2015-10-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973993#comment-14973993 ] Yanbo Liang commented on SPARK-11303: - It looks like this bug caused by mutable row c

[jira] [Comment Edited] (SPARK-11303) sample (without replacement) + filter returns wrong results in DataFrame

2015-10-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973993#comment-14973993 ] Yanbo Liang edited comment on SPARK-11303 at 10/26/15 10:29 AM: ---

[jira] [Issue Comment Deleted] (SPARK-11303) sample (without replacement) + filter returns wrong results in DataFrame

2015-10-26 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11303: Comment: was deleted (was: I think the reason of this bug is the same as SPARK-4963, I will send a

[jira] [Created] (SPARK-11313) Implement cogroup

2015-10-26 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11313: --- Summary: Implement cogroup Key: SPARK-11313 URL: https://issues.apache.org/jira/browse/SPARK-11313 Project: Spark Issue Type: Sub-task Components: SQ

[jira] [Commented] (SPARK-11313) Implement cogroup

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974097#comment-14974097 ] Apache Spark commented on SPARK-11313: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11313) Implement cogroup

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11313: Assignee: Apache Spark > Implement cogroup > - > > Key: SP

[jira] [Assigned] (SPARK-11313) Implement cogroup

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11313: Assignee: (was: Apache Spark) > Implement cogroup > - > >

[jira] [Commented] (SPARK-4751) Support dynamic allocation for standalone mode

2015-10-26 Thread Matthias Niehoff (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974119#comment-14974119 ] Matthias Niehoff commented on SPARK-4751: - The PR is merged, but the documentation

[jira] [Updated] (SPARK-9883) Distance to each cluster given a point (KMeansModel)

2015-10-26 Thread Bertrand Dechoux (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bertrand Dechoux updated SPARK-9883: Summary: Distance to each cluster given a point (KMeansModel) (was: Distance to each cluste

[jira] [Commented] (SPARK-11302) Multivariate Gaussian Model with Covariance matrix return zero always

2015-10-26 Thread eyal sharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974191#comment-14974191 ] eyal sharon commented on SPARK-11302: - Hi Sean , Thanks for reaching out. For conve

[jira] [Created] (SPARK-11314) Add service API and test service for Yarn Cluster schedulers

2015-10-26 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-11314: -- Summary: Add service API and test service for Yarn Cluster schedulers Key: SPARK-11314 URL: https://issues.apache.org/jira/browse/SPARK-11314 Project: Spark

[jira] [Assigned] (SPARK-11314) Add service API and test service for Yarn Cluster schedulers

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11314: Assignee: Apache Spark > Add service API and test service for Yarn Cluster schedulers > -

[jira] [Commented] (SPARK-11314) Add service API and test service for Yarn Cluster schedulers

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974208#comment-14974208 ] Apache Spark commented on SPARK-11314: -- User 'steveloughran' has created a pull requ

[jira] [Created] (SPARK-11315) Add YARN extension service to publish Spark events to YARN timeline service

2015-10-26 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-11315: -- Summary: Add YARN extension service to publish Spark events to YARN timeline service Key: SPARK-11315 URL: https://issues.apache.org/jira/browse/SPARK-11315 Proje

[jira] [Assigned] (SPARK-11314) Add service API and test service for Yarn Cluster schedulers

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11314: Assignee: (was: Apache Spark) > Add service API and test service for Yarn Cluster sche

[jira] [Updated] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-10-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-11265: --- Summary: YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster (was: YarnCli

[jira] [Created] (SPARK-11316) isEmpty before coalesce seems to cause huge performance issue in setupGroups

2015-10-26 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-11316: - Summary: isEmpty before coalesce seems to cause huge performance issue in setupGroups Key: SPARK-11316 URL: https://issues.apache.org/jira/browse/SPARK-11316 Projec

[jira] [Updated] (SPARK-11316) isEmpty before coalesce seems to cause huge performance issue in setupGroups

2015-10-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11316: -- Priority: Critical (was: Major) > isEmpty before coalesce seems to cause huge performance issu

[jira] [Updated] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-10-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-11265: --- Description: As reported on the dev list, trying to run a YARN client which wants to talk to

[jira] [Commented] (SPARK-11316) isEmpty before coalesce seems to cause huge performance issue in setupGroups

2015-10-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974236#comment-14974236 ] Thomas Graves commented on SPARK-11316: --- Note I"m wondering if since the isEmpty ca

[jira] [Commented] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-10-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974239#comment-14974239 ] Steve Loughran commented on SPARK-11265: What's changed? The spark code uses ref

[jira] [Comment Edited] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-10-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974239#comment-14974239 ] Steve Loughran edited comment on SPARK-11265 at 10/26/15 2:08 PM: -

[jira] [Comment Edited] (SPARK-11265) YarnClient can't get tokens to talk to Hive 1.2.1 in a secure cluster

2015-10-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974239#comment-14974239 ] Steve Loughran edited comment on SPARK-11265 at 10/26/15 2:08 PM: -

[jira] [Commented] (SPARK-11302) Multivariate Gaussian Model with Covariance matrix return zero always

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974275#comment-14974275 ] Sean Owen commented on SPARK-11302: --- Yeah I recognize that, but is this not the answer

[jira] [Assigned] (SPARK-9241) Supporting multiple DISTINCT columns

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9241: --- Assignee: Apache Spark > Supporting multiple DISTINCT columns > -

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974378#comment-14974378 ] Apache Spark commented on SPARK-9241: - User 'hvanhovell' has created a pull request fo

[jira] [Assigned] (SPARK-9241) Supporting multiple DISTINCT columns

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9241: --- Assignee: (was: Apache Spark) > Supporting multiple DISTINCT columns > --

[jira] [Commented] (SPARK-11302) Multivariate Gaussian Model with Covariance matrix return zero always

2015-10-26 Thread eyal sharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974382#comment-14974382 ] eyal sharon commented on SPARK-11302: - Sure , I will try to elaborate more MU is th

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-10-26 Thread Tamas Szuromi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974381#comment-14974381 ] Tamas Szuromi commented on SPARK-10309: --- I guess same issue here also. {code} 15/1

[jira] [Commented] (SPARK-11302) Multivariate Gaussian Model with Covariance matrix return zero always

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974396#comment-14974396 ] Sean Owen commented on SPARK-11302: --- I understand mu is the mean vector, but what is th

[jira] [Created] (SPARK-11317) YARN HBase token code shouldn't swallow invocation target exceptions

2015-10-26 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-11317: -- Summary: YARN HBase token code shouldn't swallow invocation target exceptions Key: SPARK-11317 URL: https://issues.apache.org/jira/browse/SPARK-11317 Project: Spa

[jira] [Commented] (SPARK-11300) Support for string length when writing to JDBC

2015-10-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974443#comment-14974443 ] Maciej Bryński commented on SPARK-11300: Not really. SPARK-10101 is about situati

[jira] [Comment Edited] (SPARK-11300) Support for string length when writing to JDBC

2015-10-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974443#comment-14974443 ] Maciej Bryński edited comment on SPARK-11300 at 10/26/15 3:58 PM: -

[jira] [Comment Edited] (SPARK-11300) Support for string length when writing to JDBC

2015-10-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974443#comment-14974443 ] Maciej Bryński edited comment on SPARK-11300 at 10/26/15 3:57 PM: -

[jira] [Commented] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974480#comment-14974480 ] Iulian Dragos commented on SPARK-10986: --- Digging a bit deeper. The problem is that

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-26 Thread Fabien COMTE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974481#comment-14974481 ] Fabien COMTE commented on SPARK-11193: -- Same problem with EMR 4.1.0 and Java 8. I am

[jira] [Comment Edited] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974480#comment-14974480 ] Iulian Dragos edited comment on SPARK-10986 at 10/26/15 4:17 PM: --

[jira] [Commented] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Joseph Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974488#comment-14974488 ] Joseph Wu commented on SPARK-10986: --- Definitely accidental. I've tried running in cour

[jira] [Created] (SPARK-11318) [DOC] Include hive profile in make-distribution.sh command

2015-10-26 Thread Ted Yu (JIRA)
Ted Yu created SPARK-11318: -- Summary: [DOC] Include hive profile in make-distribution.sh command Key: SPARK-11318 URL: https://issues.apache.org/jira/browse/SPARK-11318 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-11318) [DOC] Include hive profile in make-distribution.sh command

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11318: Assignee: (was: Apache Spark) > [DOC] Include hive profile in make-distribution.sh com

[jira] [Commented] (SPARK-11318) [DOC] Include hive profile in make-distribution.sh command

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974499#comment-14974499 ] Apache Spark commented on SPARK-11318: -- User 'tedyu' has created a pull request for

[jira] [Assigned] (SPARK-11318) [DOC] Include hive profile in make-distribution.sh command

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11318: Assignee: Apache Spark > [DOC] Include hive profile in make-distribution.sh command >

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-26 Thread Fabien Comte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974481#comment-14974481 ] Fabien Comte edited comment on SPARK-11193 at 10/26/15 4:29 PM: ---

[jira] [Commented] (SPARK-11283) List column gets additional level of nesting when converted to Spark DataFrame

2015-10-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974507#comment-14974507 ] Shivaram Venkataraman commented on SPARK-11283: --- cc [~sunrui] > List colum

[jira] [Commented] (SPARK-11300) Support for string length when writing to JDBC

2015-10-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974510#comment-14974510 ] Josh Rosen commented on SPARK-11300: If not an exact duplicate, there's probably some

[jira] [Commented] (SPARK-5966) Spark-submit deploy-mode incorrectly affecting submission when master = local[4]

2015-10-26 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974509#comment-14974509 ] Rick Hillegas commented on SPARK-5966: -- Should this issue be assigned to Kevin now, s

[jira] [Commented] (SPARK-5206) Accumulators are not re-registered during recovering from checkpoint

2015-10-26 Thread Anna Kepler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974515#comment-14974515 ] Anna Kepler commented on SPARK-5206: In our case we have a broadcast variable that nee

[jira] [Created] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

2015-10-26 Thread Kevin Cox (JIRA)
Kevin Cox created SPARK-11319: - Summary: PySpark silently Accepts null values in non-nullable DataFrame fields. Key: SPARK-11319 URL: https://issues.apache.org/jira/browse/SPARK-11319 Project: Spark

[jira] [Assigned] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10986: Assignee: Apache Spark > ClassNotFoundException when running on Client mode, with a Mesos

[jira] [Assigned] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10986: Assignee: (was: Apache Spark) > ClassNotFoundException when running on Client mode, wi

[jira] [Commented] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974548#comment-14974548 ] Apache Spark commented on SPARK-10986: -- User 'dragos' has created a pull request for

[jira] [Created] (SPARK-11320) DROP TABLE IF EXISTS throws exception if the table does not exist.

2015-10-26 Thread Alex Liu (JIRA)
Alex Liu created SPARK-11320: Summary: DROP TABLE IF EXISTS throws exception if the table does not exist. Key: SPARK-11320 URL: https://issues.apache.org/jira/browse/SPARK-11320 Project: Spark I

[jira] [Created] (SPARK-11321) Allow addition of non-nullable UDFs

2015-10-26 Thread Kevin Cox (JIRA)
Kevin Cox created SPARK-11321: - Summary: Allow addition of non-nullable UDFs Key: SPARK-11321 URL: https://issues.apache.org/jira/browse/SPARK-11321 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11320) DROP TABLE IF EXISTS throws exception if the table does not exist.

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974560#comment-14974560 ] Sean Owen commented on SPARK-11320: --- Does that mean it's a Hive problem then? Spark can

[jira] [Updated] (SPARK-11318) Include hive profile in make-distribution.sh command

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11318: -- Priority: Trivial (was: Minor) Component/s: Documentation Summary: Include hive profile

[jira] [Commented] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

2015-10-26 Thread Kevin Cox (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974579#comment-14974579 ] Kevin Cox commented on SPARK-11319: --- Furthermore it appears that some functions are "op

[jira] [Commented] (SPARK-11302) Multivariate Gaussian Model with Covariance matrix return zero always

2015-10-26 Thread eyal sharon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974589#comment-14974589 ] eyal sharon commented on SPARK-11302: - Cool , I will try although I hope I fully cap

[jira] [Updated] (SPARK-5966) Spark-submit deploy-mode incorrectly affecting submission when master = local[4]

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5966: - Assignee: kevin yu (was: Andrew Or) > Spark-submit deploy-mode incorrectly affecting submission when mast

[jira] [Commented] (SPARK-11320) DROP TABLE IF EXISTS throws exception if the table does not exist.

2015-10-26 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974594#comment-14974594 ] Alex Liu commented on SPARK-11320: -- It's a hive problem. > DROP TABLE IF EXISTS throws

[jira] [Resolved] (SPARK-11320) DROP TABLE IF EXISTS throws exception if the table does not exist.

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11320. --- Resolution: Not A Problem OK, then this shouldn't be logged as a Spark issue, since it can already wo

[jira] [Created] (SPARK-11322) Keep full stack track in captured exception in PySpark

2015-10-26 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-11322: --- Summary: Keep full stack track in captured exception in PySpark Key: SPARK-11322 URL: https://issues.apache.org/jira/browse/SPARK-11322 Project: Spark

[jira] [Assigned] (SPARK-11322) Keep full stack track in captured exception in PySpark

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11322: Assignee: Apache Spark > Keep full stack track in captured exception in PySpark >

[jira] [Created] (SPARK-11323) Add History Service Provider to service application histories from YARN timeline server

2015-10-26 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-11323: -- Summary: Add History Service Provider to service application histories from YARN timeline server Key: SPARK-11323 URL: https://issues.apache.org/jira/browse/SPARK-11323

[jira] [Assigned] (SPARK-11322) Keep full stack track in captured exception in PySpark

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11322: Assignee: (was: Apache Spark) > Keep full stack track in captured exception in PySpark

[jira] [Commented] (SPARK-11322) Keep full stack track in captured exception in PySpark

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974616#comment-14974616 ] Apache Spark commented on SPARK-11322: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-26 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974653#comment-14974653 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Hanks for thé update. I'm in

[jira] [Commented] (SPARK-3342) m3 instances don't get local SSDs

2015-10-26 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974660#comment-14974660 ] Nicholas Chammas commented on SPARK-3342: - FWIW, that statement on M3 instances is

[jira] [Commented] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974673#comment-14974673 ] Iulian Dragos commented on SPARK-10986: --- [~kaysoky] can you try my PR and see if it

[jira] [Commented] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Joseph Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974763#comment-14974763 ] Joseph Wu commented on SPARK-10986: --- It works! I'll also notify Gabriel to try his mor

[jira] [Commented] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-26 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974777#comment-14974777 ] Iulian Dragos commented on SPARK-10986: --- Great! Please leave a note on the PR as we

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-10-26 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974793#comment-14974793 ] shane knapp commented on SPARK-11255: - [~shivaram] and i are looking in to this right

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-10-26 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974815#comment-14974815 ] shane knapp commented on SPARK-11255: - also, IFF we roll back to 3.1.1,during rollbac

[jira] [Comment Edited] (SPARK-7106) Support model save/load in Python's FPGrowth

2015-10-26 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14973525#comment-14973525 ] Kai Jiang edited comment on SPARK-7106 at 10/26/15 7:36 PM: I

[jira] [Commented] (SPARK-11317) YARN HBase token code shouldn't swallow invocation target exceptions

2015-10-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974905#comment-14974905 ] Steve Loughran commented on SPARK-11317: I'll do this as soon as SPARK-11265 is i

[jira] [Comment Edited] (SPARK-4751) Support dynamic allocation for standalone mode

2015-10-26 Thread Matthias Niehoff (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974119#comment-14974119 ] Matthias Niehoff edited comment on SPARK-4751 at 10/26/15 8:05 PM: -

[jira] [Commented] (SPARK-4751) Support dynamic allocation for standalone mode

2015-10-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974961#comment-14974961 ] Andrew Or commented on SPARK-4751: -- it is available, sorry we will update the documentati

[jira] [Commented] (SPARK-11302) Multivariate Gaussian Model with Covariance matrix return zero always

2015-10-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974982#comment-14974982 ] Sean Owen commented on SPARK-11302: --- OK I reproduced all of this, thank you. This is ro

[jira] [Created] (SPARK-11324) Flag to close Write Ahead Log after writing

2015-10-26 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-11324: --- Summary: Flag to close Write Ahead Log after writing Key: SPARK-11324 URL: https://issues.apache.org/jira/browse/SPARK-11324 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-11324) Flag to close Write Ahead Log after writing

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974993#comment-14974993 ] Apache Spark commented on SPARK-11324: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-11324) Flag to close Write Ahead Log after writing

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11324: Assignee: Apache Spark > Flag to close Write Ahead Log after writing > ---

[jira] [Assigned] (SPARK-11324) Flag to close Write Ahead Log after writing

2015-10-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11324: Assignee: (was: Apache Spark) > Flag to close Write Ahead Log after writing >

[jira] [Updated] (SPARK-11316) isEmpty before coalesce seems to cause huge performance issue in setupGroups

2015-10-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-11316: -- Description: So I haven't fully debugged this yet but reporting what I'm seeing and think migh

[jira] [Created] (SPARK-11325) Alias alias in Scala's DataFrame to as to match python

2015-10-26 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11325: Summary: Alias alias in Scala's DataFrame to as to match python Key: SPARK-11325 URL: https://issues.apache.org/jira/browse/SPARK-11325 Project: Spark Issue Type: Im

[jira] [Comment Edited] (SPARK-11325) Alias alias in Scala's DataFrame to as to match python

2015-10-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975145#comment-14975145 ] Yin Huai edited comment on SPARK-11325 at 10/26/15 9:38 PM: [

[jira] [Commented] (SPARK-11325) Alias alias in Scala's DataFrame to as to match python

2015-10-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975145#comment-14975145 ] Yin Huai commented on SPARK-11325: -- @nongli > Alias alias in Scala's DataFrame to as to

  1   2   3   >