[jira] [Created] (SPARK-11023) Error initializing SparkContext. java.net.URISyntaxException

2015-10-09 Thread Jose Antonio (JIRA)
Jose Antonio created SPARK-11023: Summary: Error initializing SparkContext. java.net.URISyntaxException Key: SPARK-11023 URL: https://issues.apache.org/jira/browse/SPARK-11023 Project: Spark

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-10-09 Thread Dony.Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950075#comment-14950075 ] Dony.Xu commented on SPARK-8333: when i run the Streaming javaAPI test in windows 7, this issue also can

[jira] [Created] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-11025: --- Summary: Exception key can't be empty at getSystemProperties function in utils Key: SPARK-11025 URL: https://issues.apache.org/jira/browse/SPARK-11025

[jira] [Updated] (SPARK-10679) javax.jdo.JDOFatalUserException in executor

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10679: -- Assignee: Reynold Xin > javax.jdo.JDOFatalUserException in executor >

[jira] [Updated] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11016: -- Component/s: Spark Core > Spark fails when running with a task that requires a more recent version of

[jira] [Updated] (SPARK-11018) Support UDT in codegen and unsafe projection

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11018: -- Component/s: SQL > Support UDT in codegen and unsafe projection >

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950152#comment-14950152 ] Sean Owen commented on SPARK-11016: --- This is my ignorance, but is a proper serializer registered for

[jira] [Comment Edited] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950157#comment-14950157 ] Stavros Kontopoulos edited comment on SPARK-11025 at 10/9/15 10:04 AM:

[jira] [Updated] (SPARK-10944) Provide self contained deployment not tighly coupled with Hadoop

2015-10-09 Thread Pranas Baliuka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranas Baliuka updated SPARK-10944: --- Flags: Patch (was: Patch,Important) Labels: patch (was:

[jira] [Reopened] (SPARK-10944) Provide self contained deployment not tighly coupled with Hadoop

2015-10-09 Thread Pranas Baliuka (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranas Baliuka reopened SPARK-10944: Updated as features request. > Provide self contained deployment not tighly coupled with

[jira] [Updated] (SPARK-11022) Spark Worker process find Memory leaking after long time running

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11022: -- Priority: Minor (was: Major) Can you update the title to be more clear about the cause and

[jira] [Created] (SPARK-11024) Optimize NULL in by folding it to Literal(null)

2015-10-09 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-11024: Summary: Optimize NULL in by folding it to Literal(null) Key: SPARK-11024 URL: https://issues.apache.org/jira/browse/SPARK-11024 Project: Spark Issue

[jira] [Commented] (SPARK-11024) Optimize NULL in by folding it to Literal(null)

2015-10-09 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950124#comment-14950124 ] Dilip Biswal commented on SPARK-11024: -- I am currently working on a PR for this issue. > Optimize

[jira] [Updated] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-11025: Description: At file core/src/main/scala/org/apache/spark/util/Utils.scala

[jira] [Updated] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-11025: Description: At file core/src/main/scala/org/apache/spark/util/Utils.scala

[jira] [Updated] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-11025: Description: At file ../core/src/main/scala/org/apache/spark/util/Utils.scala

[jira] [Updated] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-11025: Description: At file core/src/main/scala/org/apache/spark/util/Utils.scala

[jira] [Updated] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8654: - Assignee: Dilip Biswal > Analysis exception when using "NULL IN (...)": invalid cast >

[jira] [Updated] (SPARK-11014) RPC Time Out Exceptions

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11014: -- Component/s: YARN > RPC Time Out Exceptions > --- > > Key:

[jira] [Updated] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10973: -- Labels: backport-needed (was: ) > __gettitem__ method throws IndexError exception when we try to

[jira] [Commented] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950157#comment-14950157 ] Stavros Kontopoulos commented on SPARK-11025: - falling back to previous impl:

[jira] [Commented] (SPARK-10326) Cannot launch YARN job on Windows

2015-10-09 Thread Jose Antonio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950065#comment-14950065 ] Jose Antonio commented on SPARK-10326: -- Bug reported. Thanks, Jose -- / .- .-.. .-.. / -.--

[jira] [Closed] (SPARK-10944) Provide self contained deployment not tighly coupled with Hadoop

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-10944. - > Provide self contained deployment not tighly coupled with Hadoop >

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2015-10-09 Thread Khaled Ammar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950095#comment-14950095 ] Khaled Ammar commented on SPARK-10945: -- Hi [~ankurd], I wonder if you had a chance to work on this

[jira] [Resolved] (SPARK-10944) Provide self contained deployment not tighly coupled with Hadoop

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10944. --- Resolution: Not A Problem [~pranas] please don't reopen an issue unless there is a clear change in

[jira] [Updated] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-11025: Description: At file core/src/main/scala/org/apache/spark/util/Utils.scala

[jira] [Commented] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950145#comment-14950145 ] Sean Owen commented on SPARK-11025: --- What behavior do you suggest - ignoring it? Clearly {{-D}} by

[jira] [Updated] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

2015-10-09 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-11025: Description: At file core/src/main/scala/org/apache/spark/util/Utils.scala

[jira] [Updated] (SPARK-11006) Rename NullColumnAccess as NullColumnAccessor

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11006: -- Assignee: Ted Yu > Rename NullColumnAccess as NullColumnAccessor >

[jira] [Updated] (SPARK-10902) Hive UDF current_database() does not work

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10902: -- Assignee: Davies Liu > Hive UDF current_database() does not work >

[jira] [Updated] (SPARK-11004) MapReduce Hive-like join operations for RDDs

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11004: -- Component/s: Shuffle > MapReduce Hive-like join operations for RDDs >

[jira] [Updated] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8654: - Fix Version/s: (was: 1.6.0) > Analysis exception when using "NULL IN (...)": invalid cast >

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

2015-10-09 Thread Glyton Camilleri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950156#comment-14950156 ] Glyton Camilleri commented on SPARK-6847: - Hi, I've also bumped into this very same issue but

[jira] [Commented] (SPARK-7751) Add @Since annotation to stable and experimental methods in MLlib

2015-10-09 Thread Alex Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950169#comment-14950169 ] Alex Hu commented on SPARK-7751: This is late as the epic is almost complete but an alternative of

[jira] [Closed] (SPARK-11041) Add (NOT) IN / EXISTS support for predicates

2015-10-09 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao closed SPARK-11041. - Resolution: Duplicate > Add (NOT) IN / EXISTS support for predicates >

[jira] [Assigned] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11043: Assignee: (was: Apache Spark) > Hive Thrift Server will log warn "Couldn't find log

[jira] [Assigned] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11043: Assignee: Apache Spark > Hive Thrift Server will log warn "Couldn't find log associated

[jira] [Commented] (SPARK-10306) sbt hive/update issue

2015-10-09 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951371#comment-14951371 ] holdenk commented on SPARK-10306: - So the pull request that I posted has a solution that works for me,

[jira] [Reopened] (SPARK-10306) sbt hive/update issue

2015-10-09 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reopened SPARK-10306: - re-opened since other users are also experiencing the issue > sbt hive/update issue > -

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

2015-10-09 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951438#comment-14951438 ] DB Tsai commented on SPARK-2309: I don't quite get you, can you elaborate? But I'm pretty sure that the

[jira] [Created] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-11043: Summary: Hive Thrift Server will log warn "Couldn't find log associated with operation handle" Key: SPARK-11043 URL: https://issues.apache.org/jira/browse/SPARK-11043

[jira] [Commented] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951526#comment-14951526 ] Apache Spark commented on SPARK-11043: -- User 'SaintBacchus' has created a pull request for this

[jira] [Commented] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

2015-10-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951534#comment-14951534 ] Wenchen Fan commented on SPARK-11013: - The problem is we report accumulators that should not be

[jira] [Commented] (SPARK-6567) Large linear model parallelism via a join and reduceByKey

2015-10-09 Thread Ashish Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951540#comment-14951540 ] Ashish Gupta commented on SPARK-6567: - did this effort succeed? > Large linear model parallelism via

[jira] [Assigned] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11040: Assignee: Apache Spark > SaslRpcHandler does not delegate all methods to underlying

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951419#comment-14951419 ] Jakob Odersky commented on SPARK-10876: --- I'm not sure what you mean. The UI already has a

[jira] [Issue Comment Deleted] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Odersky updated SPARK-10876: -- Comment: was deleted (was: I'm not sure what you mean. The UI already has a "Duration" field

[jira] [Created] (SPARK-11041) Add (NOT) IN / EXISTS support for predicates

2015-10-09 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-11041: - Summary: Add (NOT) IN / EXISTS support for predicates Key: SPARK-11041 URL: https://issues.apache.org/jira/browse/SPARK-11041 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11043) Hive Thrift Server will log warn "Couldn't find log associated with operation handle"

2015-10-09 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-11043: - Description: The warnning log is below: {code:title=Warnning Log|borderStyle=solid} 15/10/09

[jira] [Assigned] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11040: Assignee: (was: Apache Spark) > SaslRpcHandler does not delegate all methods to

[jira] [Commented] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951405#comment-14951405 ] Apache Spark commented on SPARK-11040: -- User 'vanzin' has created a pull request for this issue:

[jira] [Updated] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

2015-10-09 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10985: -- Assignee: Bowen Zhang > Avoid passing evicted blocks throughout BlockManager / CacheManager >

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951434#comment-14951434 ] Jakob Odersky commented on SPARK-10876: --- Do you mean to display the total run time of uncompleted

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951468#comment-14951468 ] Apache Spark commented on SPARK-4226: - User 'chenghao-intel' has created a pull request for this

[jira] [Created] (SPARK-11042) Introduce a mechanism to ban creating new root SQLContexts in a JVM

2015-10-09 Thread Yin Huai (JIRA)
Yin Huai created SPARK-11042: Summary: Introduce a mechanism to ban creating new root SQLContexts in a JVM Key: SPARK-11042 URL: https://issues.apache.org/jira/browse/SPARK-11042 Project: Spark

[jira] [Created] (SPARK-11038) Consolidate the format of UnsafeArrayData and UnsafeMapData

2015-10-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11038: -- Summary: Consolidate the format of UnsafeArrayData and UnsafeMapData Key: SPARK-11038 URL: https://issues.apache.org/jira/browse/SPARK-11038 Project: Spark

[jira] [Commented] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951265#comment-14951265 ] Apache Spark commented on SPARK-10930: -- User 'd2r' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10930: Assignee: Apache Spark > History "Stages" page "duration" can be confusing >

[jira] [Assigned] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11039: Assignee: (was: Apache Spark) > Document all UI "retained*" configurations >

[jira] [Assigned] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11039: Assignee: Apache Spark > Document all UI "retained*" configurations >

[jira] [Commented] (SPARK-10306) sbt hive/update issue

2015-10-09 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951362#comment-14951362 ] Jakob Odersky commented on SPARK-10306: --- Same issue here > sbt hive/update issue >

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

2015-10-09 Thread Luvsandondov Lkhamsuren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949940#comment-14949940 ] Luvsandondov Lkhamsuren commented on SPARK-9963: Thanks for the tip. I fixed the original

[jira] [Commented] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

2015-10-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949946#comment-14949946 ] Xiao Li commented on SPARK-8658: Hi, Michael and Antonio, Trying to understand the problem and fix it if

[jira] [Updated] (SPARK-11022) Spark Worker process find Memory leak after long time running

2015-10-09 Thread colin shaw (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] colin shaw updated SPARK-11022: --- Description: Worker process often down,while there were not any abnormal tasks,just crash without

[jira] [Updated] (SPARK-11022) Spark Worker process find Memory leaking after long time running

2015-10-09 Thread colin shaw (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] colin shaw updated SPARK-11022: --- Summary: Spark Worker process find Memory leaking after long time running (was: Spark Worker

[jira] [Updated] (SPARK-11022) Spark Worker process find Memory leak after long time running

2015-10-09 Thread colin shaw (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] colin shaw updated SPARK-11022: --- Description: Worker process often down,while there were not any abnormal tasks,just crash without

[jira] [Created] (SPARK-11021) SparkSQL cli throws exception when using with Hive 0.12 metastore in spark-1.5.0 version

2015-10-09 Thread iward (JIRA)
iward created SPARK-11021: - Summary: SparkSQL cli throws exception when using with Hive 0.12 metastore in spark-1.5.0 version Key: SPARK-11021 URL: https://issues.apache.org/jira/browse/SPARK-11021 Project:

[jira] [Created] (SPARK-11022) Spark Worker process find Memory leak after long time running

2015-10-09 Thread colin shaw (JIRA)
colin shaw created SPARK-11022: -- Summary: Spark Worker process find Memory leak after long time running Key: SPARK-11022 URL: https://issues.apache.org/jira/browse/SPARK-11022 Project: Spark

[jira] [Commented] (SPARK-11028) When planning queries without partial aggregation support, we should try to use TungstenAggregate.

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951210#comment-14951210 ] Josh Rosen commented on SPARK-11028: [~yhuai], if we fix SPARK-10992 first then will we still need to

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951212#comment-14951212 ] Josh Rosen commented on SPARK-9241: --- [~yhuai], [~rxin], would you like to update this ticket based on

[jira] [Resolved] (SPARK-10535) Support for recommendUsersForProducts and recommendProductsForUsers in matrix factorization model for PySpark

2015-10-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10535. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8700

[jira] [Resolved] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

2015-10-09 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10858. Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 > YARN:

[jira] [Created] (SPARK-11037) Cleanup Option usage in JdbcUtils

2015-10-09 Thread Rick Hillegas (JIRA)
Rick Hillegas created SPARK-11037: - Summary: Cleanup Option usage in JdbcUtils Key: SPARK-11037 URL: https://issues.apache.org/jira/browse/SPARK-11037 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-10984) Simplify *MemoryManager class structure

2015-10-09 Thread Bowen Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951343#comment-14951343 ] Bowen Zhang commented on SPARK-10984: - [~andrewor14], sure, assign that to me. > Simplify

[jira] [Created] (SPARK-11035) Launcher: allow apps to be launched in-process

2015-10-09 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11035: -- Summary: Launcher: allow apps to be launched in-process Key: SPARK-11035 URL: https://issues.apache.org/jira/browse/SPARK-11035 Project: Spark Issue

[jira] [Created] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Nick Pritchard (JIRA)
Nick Pritchard created SPARK-11039: -- Summary: Document all UI "retained*" configurations Key: SPARK-11039 URL: https://issues.apache.org/jira/browse/SPARK-11039 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

2015-10-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951290#comment-14951290 ] Yin Huai commented on SPARK-9241: - Yeah. When we compile the query, we can split the queries with multiple

[jira] [Resolved] (SPARK-8673) Launcher: add support for monitoring launched applications

2015-10-09 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-8673. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7052

[jira] [Updated] (SPARK-11017) Support ImperativeAggregates in TungstenAggregate

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11017: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > Support ImperativeAggregates

[jira] [Assigned] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-11009: -- Assignee: Davies Liu > RowNumber in HiveContext returns negative values in cluster mode >

[jira] [Updated] (SPARK-10988) Reduce duplication in Aggregate2's expression rewriting logic

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10988: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-4366 > Reduce duplication in Aggregate2's

[jira] [Updated] (SPARK-10941) .Refactor AggregateFunction2 and AlgebraicAggregate interfaces to improve code clarity

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10941: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > .Refactor AggregateFunction2

[jira] [Commented] (SPARK-4429) Build for Scala 2.11 using sbt fails.

2015-10-09 Thread Peter Halliday (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951203#comment-14951203 ] Peter Halliday commented on SPARK-4429: --- I'm wondering where this is at? > Build for Scala 2.11

[jira] [Commented] (SPARK-8142) Spark Job Fails with ResultTask ClassCastException

2015-10-09 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951238#comment-14951238 ] Charles Allen commented on SPARK-8142: -- I had a similar failure as topic and solved it by setting

[jira] [Assigned] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10930: Assignee: (was: Apache Spark) > History "Stages" page "duration" can be confusing >

[jira] [Commented] (SPARK-11039) Document all UI "retained*" configurations

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951282#comment-14951282 ] Apache Spark commented on SPARK-11039: -- User 'pnpritchard' has created a pull request for this

[jira] [Created] (SPARK-11040) SaslRpcHandler does not delegate all methods to underlying handler

2015-10-09 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-11040: -- Summary: SaslRpcHandler does not delegate all methods to underlying handler Key: SPARK-11040 URL: https://issues.apache.org/jira/browse/SPARK-11040 Project:

[jira] [Resolved] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-10-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10855. - Resolution: Fixed Assignee: Rick Hillegas Fix Version/s: 1.6.0 > Add a JDBC

[jira] [Created] (SPARK-11036) AttributeReference should not be created outside driver

2015-10-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11036: -- Summary: AttributeReference should not be created outside driver Key: SPARK-11036 URL: https://issues.apache.org/jira/browse/SPARK-11036 Project: Spark Issue

[jira] [Assigned] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11009: Assignee: Apache Spark > RowNumber in HiveContext returns negative values in cluster mode

[jira] [Commented] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951202#comment-14951202 ] Apache Spark commented on SPARK-11009: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11009: Assignee: (was: Apache Spark) > RowNumber in HiveContext returns negative values in

[jira] [Resolved] (SPARK-10167) We need to explicitly use transformDown when rewrite aggregation results

2015-10-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10167. Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 1.6.0 I changed

[jira] [Updated] (SPARK-11009) RowNumber in HiveContext returns negative values in cluster mode

2015-10-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11009: - Target Version/s: 1.5.2, 1.6.0 Priority: Blocker (was: Major) > RowNumber in HiveContext

[jira] [Resolved] (SPARK-10970) Executors overload Hive metastore by making massive connections at execution time

2015-10-09 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved SPARK-10970. --- Resolution: Fixed Closing the jira because this is fixed by SPARK-10679. SPARK-10679

[jira] [Commented] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

2015-10-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951606#comment-14951606 ] Shixiong Zhu commented on SPARK-11013: -- I see. So we implement something like

[jira] [Comment Edited] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

2015-10-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951606#comment-14951606 ] Shixiong Zhu edited comment on SPARK-11013 at 10/10/15 5:12 AM: I see. So

[jira] [Resolved] (SPARK-10927) Spark history uses the application name instead of the ID

2015-10-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved SPARK-10927. -- Resolution: Duplicate > Spark history uses the application name instead of the

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

2015-10-09 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951593#comment-14951593 ] Jack Hu commented on SPARK-6847: Hi [~glyton.camilleri] You can check whether there are two dstreams in

[jira] [Commented] (SPARK-6613) Starting stream from checkpoint causes Streaming tab to throw error

2015-10-09 Thread Yutao SUN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951610#comment-14951610 ] Yutao SUN commented on SPARK-6613: -- Same issue in 1.5.0 > Starting stream from checkpoint causes

  1   2   >