[jira] [Created] (SPARK-11046) Pass schema from R to JVM using JSON format

2015-10-09 Thread Sun Rui (JIRA)
Sun Rui created SPARK-11046: --- Summary: Pass schema from R to JVM using JSON format Key: SPARK-11046 URL: https://issues.apache.org/jira/browse/SPARK-11046 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10876: Assignee: (was: Apache Spark) > display total application time in spark history UI > -

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951650#comment-14951650 ] Apache Spark commented on SPARK-10876: -- User 'jbonofre' has created a pull request f

[jira] [Assigned] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10876: Assignee: Apache Spark > display total application time in spark history UI >

[jira] [Updated] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

2015-10-09 Thread Dibyendu Bhattacharya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-11045: -- Description: This JIRA is to track the progress of making the Receiver based Lo

[jira] [Created] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

2015-10-09 Thread Dibyendu Bhattacharya (JIRA)
Dibyendu Bhattacharya created SPARK-11045: - Summary: Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project Key: SPARK-11045 URL: https://issues.apache.org/jira/br

[jira] [Updated] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-10-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10079: -- Assignee: Sun Rui > Make `column` and `col` functions be S4 functions > ---

[jira] [Resolved] (SPARK-10079) Make `column` and `col` functions be S4 functions

2015-10-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10079. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Commented] (SPARK-10382) Make example code in user guide testable

2015-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951624#comment-14951624 ] Xiangrui Meng commented on SPARK-10382: --- The first one inserts the entire file. The

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951616#comment-14951616 ] Jean-Baptiste Onofré commented on SPARK-10876: -- AFAIR, Duration field is on

[jira] [Resolved] (SPARK-10927) Spark history uses the application name instead of the ID

2015-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved SPARK-10927. -- Resolution: Duplicate > Spark history uses the application name instead of the

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-10-09 Thread Yutao SUN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951610#comment-14951610 ] Yutao SUN commented on SPARK-6613: -- Same issue in 1.5.0 > Starting stream from checkpoin

[jira] [Comment Edited] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

2015-10-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951606#comment-14951606 ] Shixiong Zhu edited comment on SPARK-11013 at 10/10/15 5:12 AM: ---

[jira] [Commented] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

2015-10-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951606#comment-14951606 ] Shixiong Zhu commented on SPARK-11013: -- I see. So we implement something like {{Long

[jira] [Created] (SPARK-11044) Parquet writer version fixed as version1

2015-10-09 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-11044: Summary: Parquet writer version fixed as version1 Key: SPARK-11044 URL: https://issues.apache.org/jira/browse/SPARK-11044 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

2015-10-09 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951593#comment-14951593 ] Jack Hu commented on SPARK-6847: Hi [~glyton.camilleri] You can check whether there are tw

[jira] [Assigned] (SPARK-11042) Introduce a mechanism to ban creating new root SQLContexts in a JVM

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11042: Assignee: Apache Spark (was: Yin Huai) > Introduce a mechanism to ban creating new root S

[jira] [Assigned] (SPARK-11042) Introduce a mechanism to ban creating new root SQLContexts in a JVM

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11042: Assignee: Yin Huai (was: Apache Spark) > Introduce a mechanism to ban creating new root S

[jira] [Commented] (SPARK-11042) Introduce a mechanism to ban creating new root SQLContexts in a JVM

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951592#comment-14951592 ] Apache Spark commented on SPARK-11042: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-6567) Large linear model parallelism via a join and reduceByKey

2015-10-09 Thread Ashish Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951540#comment-14951540 ] Ashish Gupta commented on SPARK-6567: - did this effort succeed? > Large linear model

[jira] [Commented] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

2015-10-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951534#comment-14951534 ] Wenchen Fan commented on SPARK-11013: - The problem is we report accumulators that sho

[jira] [Assigned] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11043: Assignee: (was: Apache Spark) > Hive Thrift Server will log warn "Couldn't find log as

[jira] [Assigned] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11043: Assignee: Apache Spark > Hive Thrift Server will log warn "Couldn't find log associated wi

[jira] [Commented] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951526#comment-14951526 ] Apache Spark commented on SPARK-11043: -- User 'SaintBacchus' has created a pull reque

[jira] [Updated] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-11043: - Description: The warnning log is below: {code:title=Warnning Log|borderStyle=solid} 15/10/09 16:4

[jira] [Created] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-11043: Summary: Hive Thrift Server will log warn "Couldn't find log associated with operation handle" Key: SPARK-11043 URL: https://issues.apache.org/jira/browse/SPARK-11043

[jira] [Created] (SPARK-11042) Introduce a mechanism to ban creating new root SQLContexts in a JVM

2015-10-09 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11042: Summary: Introduce a mechanism to ban creating new root SQLContexts in a JVM Key: SPARK-11042 URL: https://issues.apache.org/jira/browse/SPARK-11042 Project: Spark

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951468#comment-14951468 ] Apache Spark commented on SPARK-4226: - User 'chenghao-intel' has created a pull reques

[jira] [Closed] (SPARK-11041) Add (NOT) IN / EXISTS support for predicates

2015-10-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao closed SPARK-11041. - Resolution: Duplicate > Add (NOT) IN / EXISTS support for predicates > --

[jira] [Created] (SPARK-11041) Add (NOT) IN / EXISTS support for predicates

2015-10-09 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-11041: - Summary: Add (NOT) IN / EXISTS support for predicates Key: SPARK-11041 URL: https://issues.apache.org/jira/browse/SPARK-11041 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-10-09 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951438#comment-14951438 ] DB Tsai commented on SPARK-2309: I don't quite get you, can you elaborate? But I'm pretty

[jira] [Updated] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

2015-10-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10985: -- Assignee: Bowen Zhang > Avoid passing evicted blocks throughout BlockManager / CacheManager > -

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951434#comment-14951434 ] Jakob Odersky commented on SPARK-10876: --- Do you mean to display the total run time

[jira] [Issue Comment Deleted] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-10876: -- Comment: was deleted (was: I'm not sure what you mean. The UI already has a "Duration" field fo

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951419#comment-14951419 ] Jakob Odersky commented on SPARK-10876: --- I'm not sure what you mean. The UI already

[jira] [Commented] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951405#comment-14951405 ] Apache Spark commented on SPARK-11040: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11040: Assignee: Apache Spark > SaslRpcHandler does not delegate all methods to underlying handle

[jira] [Assigned] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11040: Assignee: (was: Apache Spark) > SaslRpcHandler does not delegate all methods to underl

[jira] [Commented] (SPARK-10306) sbt hive/update issue

2015-10-09 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951371#comment-14951371 ] holdenk commented on SPARK-10306: - So the pull request that I posted has a solution that

[jira] [Reopened] (SPARK-10306) sbt hive/update issue

2015-10-09 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reopened SPARK-10306: - re-opened since other users are also experiencing the issue > sbt hive/update issue > -

[jira] [Commented] (SPARK-10306) sbt hive/update issue

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951362#comment-14951362 ] Jakob Odersky commented on SPARK-10306: --- Same issue here > sbt hive/update issue >

[jira] [Created] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11040: -- Summary: SaslRpcHandler does not delegate all methods to underlying handler Key: SPARK-11040 URL: https://issues.apache.org/jira/browse/SPARK-11040 Project: Spark

[jira] [Commented] (SPARK-10984) Simplify *MemoryManager class structure

2015-10-09 Thread Bowen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951343#comment-14951343 ] Bowen Zhang commented on SPARK-10984: - [~andrewor14], sure, assign that to me. > Sim

[jira] [Updated] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11009: - Target Version/s: 1.5.2, 1.6.0 Priority: Blocker (was: Major) > RowNumber in HiveContext ret

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

2015-10-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951290#comment-14951290 ] Yin Huai commented on SPARK-9241: - Yeah. When we compile the query, we can split the queri

[jira] [Assigned] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11039: Assignee: (was: Apache Spark) > Document all UI "retained*" configurations > -

[jira] [Assigned] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11039: Assignee: Apache Spark > Document all UI "retained*" configurations >

[jira] [Commented] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951282#comment-14951282 ] Apache Spark commented on SPARK-11039: -- User 'pnpritchard' has created a pull reques

[jira] [Created] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Nick Pritchard (JIRA)
Nick Pritchard created SPARK-11039: -- Summary: Document all UI "retained*" configurations Key: SPARK-11039 URL: https://issues.apache.org/jira/browse/SPARK-11039 Project: Spark Issue Type: Do

[jira] [Commented] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951265#comment-14951265 ] Apache Spark commented on SPARK-10930: -- User 'd2r' has created a pull request for th

[jira] [Assigned] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10930: Assignee: Apache Spark > History "Stages" page "duration" can be confusing > -

[jira] [Assigned] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10930: Assignee: (was: Apache Spark) > History "Stages" page "duration" can be confusing > --

[jira] [Created] (SPARK-11038) Consolidate the format of UnsafeArrayData and UnsafeMapData

2015-10-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11038: -- Summary: Consolidate the format of UnsafeArrayData and UnsafeMapData Key: SPARK-11038 URL: https://issues.apache.org/jira/browse/SPARK-11038 Project: Spark Issu

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-10-09 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951238#comment-14951238 ] Charles Allen commented on SPARK-8142: -- I had a similar failure as topic and solved i

[jira] [Created] (SPARK-11037) Cleanup Option usage in JdbcUtils

2015-10-09 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-11037: - Summary: Cleanup Option usage in JdbcUtils Key: SPARK-11037 URL: https://issues.apache.org/jira/browse/SPARK-11037 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-10-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10858. Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 > YARN: archives/jar

[jira] [Resolved] (SPARK-10167) We need to explicitly use transformDown when rewrite aggregation results

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10167. Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 1.6.0 I changed {{transform}}

[jira] [Commented] (SPARK-11028) When planning queries without partial aggregation support, we should try to use TungstenAggregate.

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951210#comment-14951210 ] Josh Rosen commented on SPARK-11028: [~yhuai], if we fix SPARK-10992 first then will

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951212#comment-14951212 ] Josh Rosen commented on SPARK-9241: --- [~yhuai], [~rxin], would you like to update this ti

[jira] [Resolved] (SPARK-10535) Support for recommendUsersForProducts and recommendProductsForUsers in matrix factorization model for PySpark

2015-10-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10535. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8700 [https://github.c

[jira] [Resolved] (SPARK-10970) Executors overload Hive metastore by making massive connections at execution time

2015-10-09 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved SPARK-10970. --- Resolution: Fixed Closing the jira because this is fixed by SPARK-10679. SPARK-10679 address

[jira] [Updated] (SPARK-10941) .Refactor AggregateFunction2 and AlgebraicAggregate interfaces to improve code clarity

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10941: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > .Refactor AggregateFunction2 an

[jira] [Updated] (SPARK-10988) Reduce duplication in Aggregate2's expression rewriting logic

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10988: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-4366 > Reduce duplication in Aggregate2's expr

[jira] [Updated] (SPARK-11017) Support ImperativeAggregates in TungstenAggregate

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11017: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Support ImperativeAggregates in

[jira] [Assigned] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11009: -- Assignee: Davies Liu > RowNumber in HiveContext returns negative values in cluster mode >

[jira] [Commented] (SPARK-4429) Build for Scala 2.11 using sbt fails.

2015-10-09 Thread Peter Halliday (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951203#comment-14951203 ] Peter Halliday commented on SPARK-4429: --- I'm wondering where this is at? > Build

[jira] [Assigned] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11009: Assignee: Apache Spark > RowNumber in HiveContext returns negative values in cluster mode

[jira] [Commented] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951202#comment-14951202 ] Apache Spark commented on SPARK-11009: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11009: Assignee: (was: Apache Spark) > RowNumber in HiveContext returns negative values in cl

[jira] [Created] (SPARK-11036) AttributeReference should not be created outside driver

2015-10-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11036: -- Summary: AttributeReference should not be created outside driver Key: SPARK-11036 URL: https://issues.apache.org/jira/browse/SPARK-11036 Project: Spark Issue Typ

[jira] [Created] (SPARK-11035) Launcher: allow apps to be launched in-process

2015-10-09 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11035: -- Summary: Launcher: allow apps to be launched in-process Key: SPARK-11035 URL: https://issues.apache.org/jira/browse/SPARK-11035 Project: Spark Issue Type

[jira] [Resolved] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-10-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10855. - Resolution: Fixed Assignee: Rick Hillegas Fix Version/s: 1.6.0 > Add a JDBC diale

[jira] [Created] (SPARK-11034) Launcher: add support for monitoring Mesos apps

2015-10-09 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11034: -- Summary: Launcher: add support for monitoring Mesos apps Key: SPARK-11034 URL: https://issues.apache.org/jira/browse/SPARK-11034 Project: Spark Issue Typ

[jira] [Created] (SPARK-11033) Launcher: add support for monitoring standalone/cluster apps

2015-10-09 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11033: -- Summary: Launcher: add support for monitoring standalone/cluster apps Key: SPARK-11033 URL: https://issues.apache.org/jira/browse/SPARK-11033 Project: Spark

[jira] [Resolved] (SPARK-8673) Launcher: add support for monitoring launched applications

2015-10-09 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-8673. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7052 [https://github.

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-10-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951092#comment-14951092 ] Michael Armbrust commented on SPARK-9776: - I want to get rid of hive context and o

[jira] [Assigned] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11023: Assignee: (was: Apache Spark) > Error initializing SparkContext. java.net.URISyntaxExc

[jira] [Commented] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951069#comment-14951069 ] Apache Spark commented on SPARK-11023: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11023: Assignee: Apache Spark > Error initializing SparkContext. java.net.URISyntaxException > --

[jira] [Updated] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11023: -- Affects Version/s: (was: 1.6.0) [~jamartinh] tiny point of process: there is no 1.6.0 release that

[jira] [Updated] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-09 Thread Jose Antonio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Antonio updated SPARK-11023: - Affects Version/s: 1.6.0 > Error initializing SparkContext. java.net.URISyntaxException > ---

[jira] [Commented] (SPARK-8546) PMML export for Naive Bayes

2015-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14951018#comment-14951018 ] Xiangrui Meng commented on SPARK-8546: -- Assigned. Thanks! > PMML export for Naive Ba

[jira] [Updated] (SPARK-8546) PMML export for Naive Bayes

2015-10-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8546: - Assignee: Xusen Yin > PMML export for Naive Bayes > --- > >

[jira] [Created] (SPARK-11032) Failure to resolve having correctly

2015-10-09 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-11032: Summary: Failure to resolve having correctly Key: SPARK-11032 URL: https://issues.apache.org/jira/browse/SPARK-11032 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11031) SparkR str() method on DataFrame objects

2015-10-09 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oscar D. Lara Yejas updated SPARK-11031: Issue Type: Sub-task (was: New Feature) Parent: SPARK-9315 > SparkR str()

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-10-09 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950996#comment-14950996 ] Alexander Pivovarov commented on SPARK-9776: That is right. Thank you! {code}

[jira] [Commented] (SPARK-11031) SparkR str() method on DataFrame objects

2015-10-09 Thread Oscar D. Lara Yejas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950988#comment-14950988 ] Oscar D. Lara Yejas commented on SPARK-11031: - I'm working on this one. It de

[jira] [Created] (SPARK-11031) SparkR str() method on DataFrame objects

2015-10-09 Thread Oscar D. Lara Yejas (JIRA)
Oscar D. Lara Yejas created SPARK-11031: --- Summary: SparkR str() method on DataFrame objects Key: SPARK-11031 URL: https://issues.apache.org/jira/browse/SPARK-11031 Project: Spark Issue

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-10-09 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950901#comment-14950901 ] Peng Cheng commented on SPARK-7708: --- Also, this problem doesn't only affect ClosureSeria

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-10-09 Thread Peng Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950886#comment-14950886 ] Peng Cheng commented on SPARK-7708: --- This problem is affecting me and so far there is no

[jira] [Assigned] (SPARK-11030) SQLTab should be shared by across sessions

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11030: Assignee: Davies Liu (was: Apache Spark) > SQLTab should be shared by across sessions > -

[jira] [Updated] (SPARK-11029) Add computeCost to KMeansModel in spark.ml

2015-10-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11029: -- Target Version/s: 1.6.0 > Add computeCost to KMeansModel in spark.ml >

[jira] [Closed] (SPARK-11015) Add computeCost and clusterCenters to KMeansModel in spark.ml package

2015-10-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-11015. - Resolution: Done > Add computeCost and clusterCenters to KMeansModel in spark.ml package

[jira] [Assigned] (SPARK-11030) SQLTab should be shared by across sessions

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11030: Assignee: Apache Spark (was: Davies Liu) > SQLTab should be shared by across sessions > -

[jira] [Commented] (SPARK-11030) SQLTab should be shared by across sessions

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950862#comment-14950862 ] Apache Spark commented on SPARK-11030: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-11015) Add computeCost and clusterCenters to KMeansModel in spark.ml package

2015-10-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950860#comment-14950860 ] Joseph K. Bradley commented on SPARK-11015: --- Oh actually, clusterCenters is pro

[jira] [Created] (SPARK-11030) SQLTab should be shared by across sessions

2015-10-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11030: -- Summary: SQLTab should be shared by across sessions Key: SPARK-11030 URL: https://issues.apache.org/jira/browse/SPARK-11030 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-11029) Add computeCost to KMeansModel in spark.ml

2015-10-09 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11029: - Summary: Add computeCost to KMeansModel in spark.ml Key: SPARK-11029 URL: https://issues.apache.org/jira/browse/SPARK-11029 Project: Spark Issue Ty

[jira] [Commented] (SPARK-11015) Add computeCost and clusterCenters to KMeansModel in spark.ml package

2015-10-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950840#comment-14950840 ] Joseph K. Bradley commented on SPARK-11015: --- I'll split this into 2 subtasks.

[jira] [Resolved] (SPARK-6230) Provide authentication and encryption for Spark's RPC

2015-10-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-6230. --- Resolution: Implemented This was implemented as part of SPARK-6028. > Provide authentication

  1   2   >