[jira] [Assigned] (SPARK-10891) Add MessageHandler to KinesisUtils.createStream similar to Direct Kafka

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10891: Assignee: Apache Spark > Add MessageHandler to KinesisUtils.createStream similar to Direct

[jira] [Assigned] (SPARK-10891) Add MessageHandler to KinesisUtils.createStream similar to Direct Kafka

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10891: Assignee: (was: Apache Spark) > Add MessageHandler to KinesisUtils.createStream simila

[jira] [Commented] (SPARK-10891) Add MessageHandler to KinesisUtils.createStream similar to Direct Kafka

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939359#comment-14939359 ] Apache Spark commented on SPARK-10891: -- User 'brkyvz' has created a pull request for

[jira] [Commented] (SPARK-5569) Checkpoints cannot reference classes defined outside of Spark's assembly

2015-09-30 Thread Deming Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939353#comment-14939353 ] Deming Zhu commented on SPARK-5569: --- I encount the exactly same problem with you, and I

[jira] [Commented] (SPARK-10894) Add 'drop' support for DataFrame's subset function

2015-09-30 Thread Weiqiang Zhuang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939339#comment-14939339 ] Weiqiang Zhuang commented on SPARK-10894: - I am working on this. > Add 'drop' su

[jira] [Created] (SPARK-10894) Add 'drop' support for DataFrame's subset function

2015-09-30 Thread Weiqiang Zhuang (JIRA)
Weiqiang Zhuang created SPARK-10894: --- Summary: Add 'drop' support for DataFrame's subset function Key: SPARK-10894 URL: https://issues.apache.org/jira/browse/SPARK-10894 Project: Spark Issu

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Updated] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jo Desmet updated SPARK-10893: -- Description: Trying to aggregate with the LAG Analytic function gives the wrong result. In my testcase

[jira] [Created] (SPARK-10893) Lag Analytic function broken

2015-09-30 Thread Jo Desmet (JIRA)
Jo Desmet created SPARK-10893: - Summary: Lag Analytic function broken Key: SPARK-10893 URL: https://issues.apache.org/jira/browse/SPARK-10893 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-10807) Add as.data.frame() as a synonym for collect()

2015-09-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10807: -- Assignee: Oscar D. Lara Yejas > Add as.data.frame() as a synonym for collect()

[jira] [Resolved] (SPARK-10807) Add as.data.frame() as a synonym for collect()

2015-09-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10807. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939130#comment-14939130 ] Josh Rosen commented on SPARK-9344: --- I think this is the relevant part of the stacktrace

[jira] [Updated] (SPARK-10892) Join with Data Frame returns wrong results

2015-09-30 Thread Ofer Mendelevitch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ofer Mendelevitch updated SPARK-10892: -- Attachment: data.json Data file to run with the code, for reproducing. > Join with Dat

[jira] [Created] (SPARK-10892) Join with Data Frame returns wrong results

2015-09-30 Thread Ofer Mendelevitch (JIRA)
Ofer Mendelevitch created SPARK-10892: - Summary: Join with Data Frame returns wrong results Key: SPARK-10892 URL: https://issues.apache.org/jira/browse/SPARK-10892 Project: Spark Issue Ty

[jira] [Commented] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

2015-09-30 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939067#comment-14939067 ] Bryan Cutler commented on SPARK-10560: -- Hi [~yanboliang], I'd be happy to do this un

[jira] [Commented] (SPARK-10790) Dynamic Allocation does not request any executors if first stage needs less than or equal to spark.dynamicAllocation.initialExecutors

2015-09-30 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939060#comment-14939060 ] Jonathan Kelly commented on SPARK-10790: Thank you for the explanation and for su

[jira] [Updated] (SPARK-10337) Views are broken

2015-09-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10337: - Assignee: Wenchen Fan > Views are broken > > > Key: SPARK-10337 >

[jira] [Commented] (SPARK-10887) Build HashedRelation outside of HashJoinNode

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939047#comment-14939047 ] Apache Spark commented on SPARK-10887: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-10887) Build HashedRelation outside of HashJoinNode

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10887: Assignee: Apache Spark (was: Yin Huai) > Build HashedRelation outside of HashJoinNode > -

[jira] [Assigned] (SPARK-10887) Build HashedRelation outside of HashJoinNode

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10887: Assignee: Yin Huai (was: Apache Spark) > Build HashedRelation outside of HashJoinNode > -

[jira] [Assigned] (SPARK-10887) Build HashedRelation outside of HashJoinNode

2015-09-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-10887: Assignee: Yin Huai > Build HashedRelation outside of HashJoinNode > --

[jira] [Updated] (SPARK-10887) Build HashedRelation outside of HashJoinNode

2015-09-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10887: - Summary: Build HashedRelation outside of HashJoinNode (was: Build HashRelation outside of HashJoinNode)

[jira] [Created] (SPARK-10891) Add MessageHandler to KinesisUtils.createStream similar to Direct Kafka

2015-09-30 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-10891: --- Summary: Add MessageHandler to KinesisUtils.createStream similar to Direct Kafka Key: SPARK-10891 URL: https://issues.apache.org/jira/browse/SPARK-10891 Project: Spark

[jira] [Commented] (SPARK-10889) Upgrade Kinesis Client Library

2015-09-30 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939023#comment-14939023 ] Burak Yavuz commented on SPARK-10889: - In addition, KCL 1.4.0 supports de-aggregation

[jira] [Resolved] (SPARK-9617) Implement json_tuple

2015-09-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9617. - Resolution: Fixed Assignee: Nathan Howell Fix Version/s: 1.6.0 This issue has been resolve

[jira] [Created] (SPARK-10890) "Column count does not match; SQL statement:" error in JDBCWriteSuite

2015-09-30 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-10890: - Summary: "Column count does not match; SQL statement:" error in JDBCWriteSuite Key: SPARK-10890 URL: https://issues.apache.org/jira/browse/SPARK-10890 Project: Spar

[jira] [Created] (SPARK-10889) Upgrade Kinesis Client Library

2015-09-30 Thread Avrohom Katz (JIRA)
Avrohom Katz created SPARK-10889: Summary: Upgrade Kinesis Client Library Key: SPARK-10889 URL: https://issues.apache.org/jira/browse/SPARK-10889 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2015-09-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas mad

[jira] [Assigned] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10888: Assignee: Apache Spark > Add as.DataFrame as a synonym for createDataFrame > -

[jira] [Assigned] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10888: Assignee: (was: Apache Spark) > Add as.DataFrame as a synonym for createDataFrame > --

[jira] [Commented] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938923#comment-14938923 ] Apache Spark commented on SPARK-10888: -- User 'NarineK' has created a pull request fo

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938918#comment-14938918 ] Simeon Simeonov commented on SPARK-9344: [~joshrosen] Here is the reproducible tes

[jira] [Commented] (SPARK-10669) Link to each language's API in codetabs in ML docs: spark.mllib

2015-09-30 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938897#comment-14938897 ] Xin Ren commented on SPARK-10669: - may I have a try on this one? Thanks a lot > Link to

[jira] [Created] (SPARK-10888) Add as.DataFrame as a synonym for createDataFrame

2015-09-30 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-10888: - Summary: Add as.DataFrame as a synonym for createDataFrame Key: SPARK-10888 URL: https://issues.apache.org/jira/browse/SPARK-10888 Project: Spark I

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938839#comment-14938839 ] Josh Rosen commented on SPARK-9344: --- [~simeons], I just grepped through Spark's code bas

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938825#comment-14938825 ] Simeon Simeonov commented on SPARK-9344: [~joshrosen] when I logged the bug I was

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938819#comment-14938819 ] Josh Rosen commented on SPARK-9344: --- [~simeons], are you using HiveContext or SQLContext

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938814#comment-14938814 ] Simeon Simeonov commented on SPARK-9344: /cc [~joshrosen] [~andrewor14] > Spark S

[jira] [Created] (SPARK-10887) Build HashRelation outside of HashJoinNode

2015-09-30 Thread Yin Huai (JIRA)
Yin Huai created SPARK-10887: Summary: Build HashRelation outside of HashJoinNode Key: SPARK-10887 URL: https://issues.apache.org/jira/browse/SPARK-10887 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-10886) Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10886: Assignee: (was: Apache Spark) > Random RDD creation example fix in MLlib statistics pr

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938811#comment-14938811 ] Xin Ren commented on SPARK-9344: Hi I'll try to fix the docs, to get a sense how the commi

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938806#comment-14938806 ] Simeon Simeonov commented on SPARK-9344: Are you suggesting to fix the docs or the

[jira] [Assigned] (SPARK-10665) Connect the local iterators with the planner

2015-09-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-10665: Assignee: Yin Huai > Connect the local iterators with the planner > --

[jira] [Comment Edited] (SPARK-10886) Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md

2015-09-30 Thread Jayant Shekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938782#comment-14938782 ] Jayant Shekhar edited comment on SPARK-10886 at 9/30/15 8:27 PM: --

[jira] [Commented] (SPARK-10886) Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938797#comment-14938797 ] Apache Spark commented on SPARK-10886: -- User 'jayantshekhar' has created a pull requ

[jira] [Assigned] (SPARK-10886) Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10886: Assignee: Apache Spark > Random RDD creation example fix in MLlib statistics programming g

[jira] [Commented] (SPARK-10886) Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md

2015-09-30 Thread Jayant Shekhar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938782#comment-14938782 ] Jayant Shekhar commented on SPARK-10886: Am in the process of PR for it. > Rando

[jira] [Created] (SPARK-10886) Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md

2015-09-30 Thread Jayant Shekhar (JIRA)
Jayant Shekhar created SPARK-10886: -- Summary: Random RDD creation example fix in MLlib statistics programming guide - mllib-statistics.md Key: SPARK-10886 URL: https://issues.apache.org/jira/browse/SPARK-10886

[jira] [Commented] (SPARK-9344) Spark SQL documentation does not clarify INSERT INTO behavior

2015-09-30 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938337#comment-14938337 ] Xin Ren commented on SPARK-9344: first time try, is it ok I work on this one? Thanks a lo

[jira] [Commented] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-09-30 Thread Rick Hillegas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938334#comment-14938334 ] Rick Hillegas commented on SPARK-10855: --- I intend to create a pull request for this

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-09-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938249#comment-14938249 ] Reynold Xin commented on SPARK-10474: - Ah ic. It is possible that the # core estimati

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-09-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14938243#comment-14938243 ] Reynold Xin commented on SPARK-3862: David, Thanks. Let's chat there. Since I created

[jira] [Closed] (SPARK-3862) MultiWayBroadcastInnerHashJoin

2015-09-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-3862. -- Resolution: Won't Fix Closing this one for now since I think we can do something better with codegen wi

[jira] [Resolved] (SPARK-10770) SparkPlan.executeCollect/executeTake should return InternalRow rather than external Row

2015-09-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10770. - Resolution: Fixed Fix Version/s: 1.6.0 > SparkPlan.executeCollect/executeTake should retur

[jira] [Resolved] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10851. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Exception not faili

[jira] [Updated] (SPARK-10851) Exception not failing R applications (in yarn cluster mode)

2015-09-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10851: -- Assignee: Sun Rui > Exception not failing R applications (in yarn cluster mode) > -

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-09-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937732#comment-14937732 ] Suresh Thalamati commented on SPARK-10857: -- One issue I ran into with getSchema(

[jira] [Resolved] (SPARK-9741) approx count distinct function

2015-09-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9741. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8362 [https://github.com/

[jira] [Closed] (SPARK-10268) Add @Since annotation to ml.tree

2015-09-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-10268. - Resolution: Not A Problem > Add @Since annotation to ml.tree > >

[jira] [Commented] (SPARK-10268) Add @Since annotation to ml.tree

2015-09-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937723#comment-14937723 ] Xiangrui Meng commented on SPARK-10268: --- Thanks! We don't need to annotate private

[jira] [Updated] (SPARK-10268) Add @Since annotation to ml.tree

2015-09-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10268: -- Assignee: Hiroshi Takahashi > Add @Since annotation to ml.tree > --

[jira] [Commented] (SPARK-6363) make scala 2.11 default language

2015-09-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937708#comment-14937708 ] Jacek Lewandowski commented on SPARK-6363: -- So what? > make scala 2.11 default l

[jira] [Resolved] (SPARK-10773) Repartition operation failing on RDD with "argument type mismatch" error

2015-09-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10773. --- Resolution: Duplicate > Repartition operation failing on RDD with "argument type mismatch" error > --

[jira] [Commented] (SPARK-10880) Hive module build test failed

2015-09-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937485#comment-14937485 ] Sean Owen commented on SPARK-10880: --- Hm, Jenkins is passing. How are you building? just

[jira] [Commented] (SPARK-9472) Consistent hadoop config for streaming

2015-09-30 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937483#comment-14937483 ] Cody Koeninger commented on SPARK-9472: --- I'd suggest patching your distribution then

[jira] [Assigned] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10058: Assignee: Shixiong Zhu (was: Apache Spark) > Flaky test: HeartbeatReceiverSuite: normal h

[jira] [Assigned] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10058: Assignee: Apache Spark (was: Shixiong Zhu) > Flaky test: HeartbeatReceiverSuite: normal h

[jira] [Commented] (SPARK-9472) Consistent hadoop config for streaming

2015-09-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937471#comment-14937471 ] Russell Alexander Spitzer commented on SPARK-9472: -- Yeah that's the worka

[jira] [Commented] (SPARK-10058) Flaky test: HeartbeatReceiverSuite: normal heartbeat

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937473#comment-14937473 ] Apache Spark commented on SPARK-10058: -- User 'zsxwing' has created a pull request fo

[jira] [Comment Edited] (SPARK-9695) Add random seed Param to ML Pipeline

2015-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937046#comment-14937046 ] Yanbo Liang edited comment on SPARK-9695 at 9/30/15 4:15 PM: -

[jira] [Commented] (SPARK-10885) Display the failed output op in Streaming UI

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937374#comment-14937374 ] Apache Spark commented on SPARK-10885: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-10885) Display the failed output op in Streaming UI

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10885: Assignee: (was: Apache Spark) > Display the failed output op in Streaming UI > ---

[jira] [Assigned] (SPARK-10885) Display the failed output op in Streaming UI

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10885: Assignee: Apache Spark > Display the failed output op in Streaming UI > --

[jira] [Commented] (SPARK-9695) Add random seed Param to ML Pipeline

2015-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937046#comment-14937046 ] Yanbo Liang commented on SPARK-9695: [~josephkb] I agree to make HasSeed the main API

[jira] [Comment Edited] (SPARK-4644) Implement skewed join

2015-09-30 Thread vidmantas zemleris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937033#comment-14937033 ] vidmantas zemleris edited comment on SPARK-4644 at 9/30/15 3:54 PM:

[jira] [Comment Edited] (SPARK-4644) Implement skewed join

2015-09-30 Thread vidmantas zemleris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937033#comment-14937033 ] vidmantas zemleris edited comment on SPARK-4644 at 9/30/15 3:53 PM:

[jira] [Created] (SPARK-10885) Display the failed output op in Streaming UI

2015-09-30 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-10885: Summary: Display the failed output op in Streaming UI Key: SPARK-10885 URL: https://issues.apache.org/jira/browse/SPARK-10885 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-4644) Implement skewed join

2015-09-30 Thread vidmantas zemleris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937033#comment-14937033 ] vidmantas zemleris edited comment on SPARK-4644 at 9/30/15 3:52 PM:

[jira] [Commented] (SPARK-4644) Implement skewed join

2015-09-30 Thread vidmantas zemleris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937033#comment-14937033 ] vidmantas zemleris commented on SPARK-4644: --- IMHO a good start could be implemen

[jira] [Commented] (SPARK-10773) Repartition operation failing on RDD with "argument type mismatch" error

2015-09-30 Thread Da Fox (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14937011#comment-14937011 ] Da Fox commented on SPARK-10773: Hello, I have verified it is really fixed in 1.5.0 (usi

[jira] [Comment Edited] (SPARK-10413) Model should support prediction on single instance

2015-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936947#comment-14936947 ] Yanbo Liang edited comment on SPARK-10413 at 9/30/15 3:13 PM: -

[jira] [Commented] (SPARK-10883) Be able to build each module individually

2015-09-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936966#comment-14936966 ] Marcelo Vanzin commented on SPARK-10883: Yes, that's the same thing as using {{-f

[jira] [Updated] (SPARK-10884) Support prediction on single instance for regression and classification related models

2015-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10884: Summary: Support prediction on single instance for regression and classification related models (w

[jira] [Comment Edited] (SPARK-10883) Be able to build each module individually

2015-09-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936959#comment-14936959 ] Jean-Baptiste Onofré edited comment on SPARK-10883 at 9/30/15 3:07 PM:

[jira] [Updated] (SPARK-10884) Support prediction on single instance for PredictionModel and ClassificationModel

2015-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10884: Description: Support prediction on single instance for regression and classification related model

[jira] [Commented] (SPARK-10883) Be able to build each module individually

2015-09-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936959#comment-14936959 ] Jean-Baptiste Onofré commented on SPARK-10883: -- By individual, I mean just g

[jira] [Assigned] (SPARK-10884) Support prediction on single instance for PredictionModel and ClassificationModel

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10884: Assignee: (was: Apache Spark) > Support prediction on single instance for PredictionMo

[jira] [Assigned] (SPARK-10884) Support prediction on single instance for PredictionModel and ClassificationModel

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10884: Assignee: Apache Spark > Support prediction on single instance for PredictionModel and >

[jira] [Commented] (SPARK-10884) Support prediction on single instance for PredictionModel and ClassificationModel

2015-09-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936951#comment-14936951 ] Apache Spark commented on SPARK-10884: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-10884) Support prediction on single instance for PredictionModel and ClassificationModel

2015-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10884: Description: Support prediction on single instance for regression and classification related model

[jira] [Commented] (SPARK-10413) Model should support prediction on single instance

2015-09-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936947#comment-14936947 ] Yanbo Liang commented on SPARK-10413: - [~mengxr] [~josephkb] I found this issue invol

[jira] [Commented] (SPARK-10883) Be able to build each module individually

2015-09-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936944#comment-14936944 ] Marcelo Vanzin commented on SPARK-10883: How are you trying to build the individu

[jira] [Created] (SPARK-10884) Support prediction on single instance for PredictionModel and ClassificationModel

2015-09-30 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10884: --- Summary: Support prediction on single instance for PredictionModel and ClassificationModel Key: SPARK-10884 URL: https://issues.apache.org/jira/browse/SPARK-10884 Proje

[jira] [Commented] (SPARK-10883) Be able to build each module individually

2015-09-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14936899#comment-14936899 ] Jean-Baptiste Onofré commented on SPARK-10883: -- https://github.com/apache/sp

  1   2   >