[jira] [Commented] (SPARK-21405) Add LBFGS solver for GeneralizedLinearRegression

[ https://issues.apache.org/jira/browse/SPARK-21405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089386#comment-16089386 ] Nick Pentreath commented on SPARK-21405: Ok, sounds good to me. Do you think we

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089332#comment-16089332 ] Reynold Xin commented on SPARK-18085: - [~vanzin] That's actually not true anymore. It

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089328#comment-16089328 ] Reynold Xin commented on SPARK-9686: The best way to advance the issue is probably for

[jira] [Comment Edited] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089298#comment-16089298 ] Shawn Lavelle edited comment on SPARK-9686 at 7/17/17 4:38 AM: -

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089298#comment-16089298 ] Shawn Lavelle commented on SPARK-9686: -- Is there any way to advance this issue? This

[jira] [Commented] (SPARK-21398) Data on Rest end point is not updating after first fetch

[ https://issues.apache.org/jira/browse/SPARK-21398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089286#comment-16089286 ] Hyukjin Kwon commented on SPARK-21398: -- I can't reproduce this given information abo

[jira] [Updated] (SPARK-21433) Spark SQL should support higher version of Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-21433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gu Chao updated SPARK-21433: External issue ID: (was: HIVE-16422) > Spark SQL should support higher version of Hive metastore > --

[jira] [Updated] (SPARK-21433) Spark SQL should support higher version of Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-21433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gu Chao updated SPARK-21433: External issue URL: (was: https://issues.apache.org/jira/browse/HIVE-16422) External issue ID: HIVE-

[jira] [Updated] (SPARK-21433) Spark SQL should support higher version of Hive metastore

[ https://issues.apache.org/jira/browse/SPARK-21433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gu Chao updated SPARK-21433: External issue URL: https://issues.apache.org/jira/browse/HIVE-16422 > Spark SQL should support higher vers

[jira] [Created] (SPARK-21433) Spark SQL should support higher version of Hive metastore

Gu Chao created SPARK-21433: --- Summary: Spark SQL should support higher version of Hive metastore Key: SPARK-21433 URL: https://issues.apache.org/jira/browse/SPARK-21433 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-21432) Reviving broken partial functions in UDF in PySpark

[ https://issues.apache.org/jira/browse/SPARK-21432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089255#comment-16089255 ] Apache Spark commented on SPARK-21432: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-21432) Reviving broken partial functions in UDF in PySpark

[ https://issues.apache.org/jira/browse/SPARK-21432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21432: Assignee: (was: Apache Spark) > Reviving broken partial functions in UDF in PySpark >

[jira] [Assigned] (SPARK-21432) Reviving broken partial functions in UDF in PySpark

[ https://issues.apache.org/jira/browse/SPARK-21432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21432: Assignee: Apache Spark > Reviving broken partial functions in UDF in PySpark > ---

[jira] [Created] (SPARK-21432) Reviving broken partial functions in UDF in PySpark

Hyukjin Kwon created SPARK-21432: Summary: Reviving broken partial functions in UDF in PySpark Key: SPARK-21432 URL: https://issues.apache.org/jira/browse/SPARK-21432 Project: Spark Issue Typ

[jira] [Commented] (SPARK-21401) add poll function for BoundedPriorityQueue

[ https://issues.apache.org/jira/browse/SPARK-21401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089209#comment-16089209 ] Peng Meng commented on SPARK-21401: --- Hi [~srowen], here we also want to get a fully sor

[jira] [Closed] (SPARK-21431) Unable to parallelize a list in Scala

[ https://issues.apache.org/jira/browse/SPARK-21431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mounika closed SPARK-21431. --- Resolution: Fixed > Unable to parallelize a list in Scala > - > >

[jira] [Created] (SPARK-21431) Unable to parallelize a list in Scala

Mounika created SPARK-21431: --- Summary: Unable to parallelize a list in Scala Key: SPARK-21431 URL: https://issues.apache.org/jira/browse/SPARK-21431 Project: Spark Issue Type: Task Compon

[jira] [Assigned] (SPARK-21395) Spark SQL hive-thriftserver doesn't register operation log before execute sql statement

[ https://issues.apache.org/jira/browse/SPARK-21395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21395: Assignee: (was: Apache Spark) > Spark SQL hive-thriftserver doesn't register operation

[jira] [Assigned] (SPARK-21395) Spark SQL hive-thriftserver doesn't register operation log before execute sql statement

[ https://issues.apache.org/jira/browse/SPARK-21395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21395: Assignee: Apache Spark > Spark SQL hive-thriftserver doesn't register operation log before

[jira] [Commented] (SPARK-21395) Spark SQL hive-thriftserver doesn't register operation log before execute sql statement

[ https://issues.apache.org/jira/browse/SPARK-21395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089106#comment-16089106 ] Apache Spark commented on SPARK-21395: -- User 'debugger87' has created a pull request

[jira] [Created] (SPARK-21430) Add PMML support to SparkR

chris snow created SPARK-21430: -- Summary: Add PMML support to SparkR Key: SPARK-21430 URL: https://issues.apache.org/jira/browse/SPARK-21430 Project: Spark Issue Type: Sub-task Compone

[jira] [Created] (SPARK-21429) show on structured Dataset is equivalent to writeStream to console once

Jacek Laskowski created SPARK-21429: --- Summary: show on structured Dataset is equivalent to writeStream to console once Key: SPARK-21429 URL: https://issues.apache.org/jira/browse/SPARK-21429 Project

[jira] [Resolved] (SPARK-21344) BinaryType comparison does signed byte array comparison

[ https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21344. - Resolution: Fixed Fix Version/s: 2.2.1 2.1.2 2.0.3 > BinaryT

[jira] [Assigned] (SPARK-21344) BinaryType comparison does signed byte array comparison

[ https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21344: --- Assignee: Kazuaki Ishizaki > BinaryType comparison does signed byte array comparison > -

[jira] [Updated] (SPARK-21426) Fix test failure due to unsupported hex literals.

[ https://issues.apache.org/jira/browse/SPARK-21426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21426: Affects Version/s: (was: 2.0.2) 2.0.3 > Fix test failure due to unsupported hex

[jira] [Resolved] (SPARK-21426) Fix test failure due to unsupported hex literals.

[ https://issues.apache.org/jira/browse/SPARK-21426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21426. - Resolution: Fixed Fix Version/s: 2.0.3 > Fix test failure due to unsupported hex literals. >

[jira] [Commented] (SPARK-21390) Dataset filter api inconsistency

[ https://issues.apache.org/jira/browse/SPARK-21390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089012#comment-16089012 ] Kazuaki Ishizaki commented on SPARK-21390: -- cc: [~ueshin] Is there any thought o

[jira] [Assigned] (SPARK-21428) CliSessionState never be recognized because of IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-21428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21428: Assignee: (was: Apache Spark) > CliSessionState never be recognized because of Isolate

[jira] [Commented] (SPARK-21428) CliSessionState never be recognized because of IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-21428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088980#comment-16088980 ] Apache Spark commented on SPARK-21428: -- User 'yaooqinn' has created a pull request f

[jira] [Assigned] (SPARK-21428) CliSessionState never be recognized because of IsolatedClientLoader

[ https://issues.apache.org/jira/browse/SPARK-21428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21428: Assignee: Apache Spark > CliSessionState never be recognized because of IsolatedClientLoad

[jira] [Commented] (SPARK-21390) Dataset filter api inconsistency

[ https://issues.apache.org/jira/browse/SPARK-21390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088977#comment-16088977 ] Kazuaki Ishizaki commented on SPARK-21390: -- When I ran the following test suite

[jira] [Commented] (SPARK-21410) In RangePartitioner(partitions: Int, rdd: RDD[]), RangePartitioner.numPartitions is wrong if the number of elements in RDD (rdd.count()) is less than number of partiti

[ https://issues.apache.org/jira/browse/SPARK-21410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088970#comment-16088970 ] Jiang Xingbo commented on SPARK-21410: -- This is not a bug since it doesn't generate

[jira] [Updated] (SPARK-21410) In RangePartitioner(partitions: Int, rdd: RDD[]), RangePartitioner.numPartitions is wrong if the number of elements in RDD (rdd.count()) is less than number of partition

[ https://issues.apache.org/jira/browse/SPARK-21410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-21410: - Issue Type: Improvement (was: Bug) > In RangePartitioner(partitions: Int, rdd: RDD[]), > RangeP

[jira] [Created] (SPARK-21428) CliSessionState never be recognized because of IsolatedClientLoader

Kent Yao created SPARK-21428: Summary: CliSessionState never be recognized because of IsolatedClientLoader Key: SPARK-21428 URL: https://issues.apache.org/jira/browse/SPARK-21428 Project: Spark

[jira] [Commented] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088952#comment-16088952 ] Daniel Darabos commented on SPARK-21418: I'm on holiday without a computer throug

[jira] [Commented] (SPARK-19810) Remove support for Scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-19810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088939#comment-16088939 ] Apache Spark commented on SPARK-19810: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14280: Assignee: Apache Spark (was: Sean Owen) > Update change-version.sh and pom.xml to add Sca

[jira] [Commented] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088937#comment-16088937 ] Apache Spark commented on SPARK-14280: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14280: Assignee: Sean Owen (was: Apache Spark) > Update change-version.sh and pom.xml to add Sca

[jira] [Commented] (SPARK-21392) Unable to infer schema when loading large Parquet file

[ https://issues.apache.org/jira/browse/SPARK-21392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088921#comment-16088921 ] Hyukjin Kwon commented on SPARK-21392: -- Thanks for investigations and details. I tri

[jira] [Commented] (SPARK-21425) LongAccumulator, DoubleAccumulator not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-21425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088920#comment-16088920 ] Sean Owen commented on SPARK-21425: --- I see, it's really Main. It looks like having the

[jira] [Updated] (SPARK-21425) LongAccumulator, DoubleAccumulator not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-21425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Williams updated SPARK-21425: -- Priority: Minor (was: Major) > LongAccumulator, DoubleAccumulator not threadsafe > ---

[jira] [Commented] (SPARK-21425) LongAccumulator, DoubleAccumulator not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-21425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088919#comment-16088919 ] Ryan Williams commented on SPARK-21425: --- Digging a bit more, it seems like: - ther

[jira] [Comment Edited] (SPARK-21425) LongAccumulator, DoubleAccumulator not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-21425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088909#comment-16088909 ] Ryan Williams edited comment on SPARK-21425 at 7/16/17 12:25 PM: --

[jira] [Commented] (SPARK-21425) LongAccumulator, DoubleAccumulator not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-21425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088909#comment-16088909 ] Ryan Williams commented on SPARK-21425: --- [~sowen] interesting, I didn't think my ex

[jira] [Created] (SPARK-21427) Describe mapGroupsWithState and flatMapGroupsWithState for stateful aggregation in Structured Streaming

Jacek Laskowski created SPARK-21427: --- Summary: Describe mapGroupsWithState and flatMapGroupsWithState for stateful aggregation in Structured Streaming Key: SPARK-21427 URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (SPARK-21417) Detect transitive join conditions via expressions

[ https://issues.apache.org/jira/browse/SPARK-21417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088878#comment-16088878 ] Anton Okolnychyi commented on SPARK-21417: -- [~Aklakan] Do you want to work on it

[jira] [Commented] (SPARK-21424) Blockmanger has memory problems in high concurrent scenes

[ https://issues.apache.org/jira/browse/SPARK-21424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088869#comment-16088869 ] Sean Owen commented on SPARK-21424: --- This is pretty vague. Can you provide a clearer de

[jira] [Commented] (SPARK-21425) LongAccumulator, DoubleAccumulator not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-21425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088868#comment-16088868 ] Sean Owen commented on SPARK-21425: --- I'd expect the implementations to be prepared for

[jira] [Comment Edited] (SPARK-21418) NoSuchElementException: None.get on DataFrame.rdd

[ https://issues.apache.org/jira/browse/SPARK-21418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088659#comment-16088659 ] Kazuaki Ishizaki edited comment on SPARK-21418 at 7/16/17 8:25 AM:

[jira] [Commented] (SPARK-21425) LongAccumulator, DoubleAccumulator not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-21425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16088842#comment-16088842 ] holdenk commented on SPARK-21425: - Thanks for finding this. I've given some thought in th