[jira] [Assigned] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

[ https://issues.apache.org/jira/browse/SPARK-13398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13398: Assignee: (was: Apache Spark) > Move away from deprecated ThreadPoolTaskSupport >

[jira] [Commented] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

[ https://issues.apache.org/jira/browse/SPARK-13398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155929#comment-15155929 ] Apache Spark commented on SPARK-13398: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

[ https://issues.apache.org/jira/browse/SPARK-13398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13398: Assignee: Apache Spark > Move away from deprecated ThreadPoolTaskSupport >

[jira] [Commented] (SPARK-13418) SQL generation for uncorrelated scalar subqueries

[ https://issues.apache.org/jira/browse/SPARK-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155928#comment-15155928 ] Reynold Xin commented on SPARK-13418: - cc [~liancheng] it seems to me this would be easier if we have

[jira] [Created] (SPARK-13419) SubquerySuite should use checkAnswer rather than ScalaTest's assertResult

Reynold Xin created SPARK-13419: --- Summary: SubquerySuite should use checkAnswer rather than ScalaTest's assertResult Key: SPARK-13419 URL: https://issues.apache.org/jira/browse/SPARK-13419 Project:

[jira] [Created] (SPARK-13420) Rename Subquery logical plan to SubqueryAlias

Reynold Xin created SPARK-13420: --- Summary: Rename Subquery logical plan to SubqueryAlias Key: SPARK-13420 URL: https://issues.apache.org/jira/browse/SPARK-13420 Project: Spark Issue Type:

[jira] [Created] (SPARK-13418) SQL generation for uncorrelated scalar subqueries

Reynold Xin created SPARK-13418: --- Summary: SQL generation for uncorrelated scalar subqueries Key: SPARK-13418 URL: https://issues.apache.org/jira/browse/SPARK-13418 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13415) Visualize subquery in SQL web UI

[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13415: Issue Type: Sub-task (was: Improvement) Parent: SPARK-13417 > Visualize subquery in SQL

[jira] [Updated] (SPARK-13306) Initial implementation for uncorrelated scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-13306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13306: Issue Type: Sub-task (was: New Feature) Parent: SPARK-13417 > Initial implementation for

[jira] [Updated] (SPARK-13306) Initial implementation for uncorrelated scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-13306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13306: Summary: Initial implementation for uncorrelated scalar subquery (was: Uncorrelated scalar

[jira] [Created] (SPARK-13417) SQL subquery support

Reynold Xin created SPARK-13417: --- Summary: SQL subquery support Key: SPARK-13417 URL: https://issues.apache.org/jira/browse/SPARK-13417 Project: Spark Issue Type: Umbrella

[jira] [Assigned] (SPARK-13399) Investigate type erasure warnings in CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-13399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13399: Assignee: Apache Spark > Investigate type erasure warnings in CheckpointSuite >

[jira] [Assigned] (SPARK-13399) Investigate type erasure warnings in CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-13399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13399: Assignee: (was: Apache Spark) > Investigate type erasure warnings in CheckpointSuite

[jira] [Commented] (SPARK-13399) Investigate type erasure warnings in CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-13399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155918#comment-15155918 ] Apache Spark commented on SPARK-13399: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-13306) Uncorrelated scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-13306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155916#comment-15155916 ] Apache Spark commented on SPARK-13306: -- User 'rxin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13306) Uncorrelated scalar subquery

[ https://issues.apache.org/jira/browse/SPARK-13306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13306. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11190

[jira] [Assigned] (SPARK-13416) Add positive check for option 'numIter' in StronglyConnectedComponents

[ https://issues.apache.org/jira/browse/SPARK-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13416: Assignee: (was: Apache Spark) > Add positive check for option 'numIter' in

[jira] [Assigned] (SPARK-13416) Add positive check for option 'numIter' in StronglyConnectedComponents

[ https://issues.apache.org/jira/browse/SPARK-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13416: Assignee: Apache Spark > Add positive check for option 'numIter' in

[jira] [Commented] (SPARK-13416) Add positive check for option 'numIter' in StronglyConnectedComponents

[ https://issues.apache.org/jira/browse/SPARK-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155866#comment-15155866 ] Apache Spark commented on SPARK-13416: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-13416) Add positive check for option 'numIter' in StronglyConnectedComponents

zhengruifeng created SPARK-13416: Summary: Add positive check for option 'numIter' in StronglyConnectedComponents Key: SPARK-13416 URL: https://issues.apache.org/jira/browse/SPARK-13416 Project:

[jira] [Assigned] (SPARK-12459) Add ExpressionDescription to string functions

[ https://issues.apache.org/jira/browse/SPARK-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12459: Assignee: (was: Apache Spark) > Add ExpressionDescription to string functions >

[jira] [Assigned] (SPARK-12459) Add ExpressionDescription to string functions

[ https://issues.apache.org/jira/browse/SPARK-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12459: Assignee: Apache Spark > Add ExpressionDescription to string functions >

[jira] [Commented] (SPARK-12459) Add ExpressionDescription to string functions

[ https://issues.apache.org/jira/browse/SPARK-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155856#comment-15155856 ] Apache Spark commented on SPARK-12459: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13310) Missing Sorting Columns in Generate

[ https://issues.apache.org/jira/browse/SPARK-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13310. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11198

[jira] [Commented] (SPARK-5506) java.lang.ClassCastException using lambda expressions in combination of spark and Servlet

[ https://issues.apache.org/jira/browse/SPARK-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155820#comment-15155820 ] Eugene Morozov commented on SPARK-5506: --- The symptom means there are no classes to deserialize

[jira] [Resolved] (SPARK-13414) Add support for launching multiple Mesos dispatchers

[ https://issues.apache.org/jira/browse/SPARK-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13414. - Resolution: Fixed Assignee: Timothy Chen Fix Version/s: 2.0.0 > Add support for

[jira] [Resolved] (SPARK-13386) ConnectedComponents should support maxIteration option

[ https://issues.apache.org/jira/browse/SPARK-13386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13386. - Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.0.0 >

[jira] [Assigned] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12720: Assignee: Apache Spark (was: Xiao Li) > SQL generation support for cube, rollup, and

[jira] [Commented] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155666#comment-15155666 ] Apache Spark commented on SPARK-12720: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12720: Assignee: Xiao Li (was: Apache Spark) > SQL generation support for cube, rollup, and

[jira] [Commented] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155645#comment-15155645 ] Varadharajan commented on SPARK-13393: -- Hi, Here is the plan for errorDF: {noformat} scala>

[jira] [Commented] (SPARK-13393) Column mismatch issue in left_outer join using Spark DataFrame

[ https://issues.apache.org/jira/browse/SPARK-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155636#comment-15155636 ] Xiao Li commented on SPARK-13393: - Can you output the plans? {{errorDF.explain(true)}} and

[jira] [Resolved] (SPARK-12969) Exception while casting a spark supported date formatted "string" to "date" data type.

[ https://issues.apache.org/jira/browse/SPARK-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12969. --- Resolution: Not A Problem I'm not clear what is being reported here, but it sounds like this occurs

[jira] [Closed] (SPARK-12969) Exception while casting a spark supported date formatted "string" to "date" data type.

[ https://issues.apache.org/jira/browse/SPARK-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-12969. - > Exception while casting a spark supported date formatted "string" to "date" > data type. >

[jira] [Updated] (SPARK-13261) Expose maxCharactersPerColumn as a user configurable option

[ https://issues.apache.org/jira/browse/SPARK-13261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13261: -- Assignee: Hossein Falaki > Expose maxCharactersPerColumn as a user configurable option >

[jira] [Updated] (SPARK-12594) Outer Join Elimination by Filter Condition

[ https://issues.apache.org/jira/browse/SPARK-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12594: -- Assignee: Xiao Li > Outer Join Elimination by Filter Condition >

[jira] [Updated] (SPARK-12966) Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type'

[ https://issues.apache.org/jira/browse/SPARK-12966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12966: -- Assignee: Brandon Bradley > Postgres JDBC ArrayType(DecimalType) 'Unable to find server array type' >

[jira] [Resolved] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13349. --- Resolution: Invalid No, this is not a bug. > adding a split and union to a streaming application

[jira] [Updated] (SPARK-13392) KafkaSink for Metrics

[ https://issues.apache.org/jira/browse/SPARK-13392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13392: -- Component/s: Streaming > KafkaSink for Metrics > - > > Key:

[jira] [Updated] (SPARK-13399) Investigate type erasure warnings in CheckpointSuite

[ https://issues.apache.org/jira/browse/SPARK-13399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13399: -- Component/s: Tests > Investigate type erasure warnings in CheckpointSuite >

[jira] [Closed] (SPARK-13349) adding a split and union to a streaming application cause big performance hit

[ https://issues.apache.org/jira/browse/SPARK-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-13349. - > adding a split and union to a streaming application cause big performance hit >

[jira] [Updated] (SPARK-13414) Add support for launching multiple Mesos dispatchers

[ https://issues.apache.org/jira/browse/SPARK-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13414: -- Component/s: Mesos > Add support for launching multiple Mesos dispatchers >

[jira] [Updated] (SPARK-13385) Enable AssociationRules to generate consequents with user-defined lengths

[ https://issues.apache.org/jira/browse/SPARK-13385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13385: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) > Enable AssociationRules

[jira] [Updated] (SPARK-13410) unionAll AnalysisException with DataFrames containing UDT columns.

[ https://issues.apache.org/jira/browse/SPARK-13410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13410: -- Target Version/s: (was: 1.6.0) > unionAll AnalysisException with DataFrames containing UDT columns.

[jira] [Updated] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12567: -- Fix Version/s: (was: 2.0.0) > Add aes_encrypt and aes_decrypt UDFs >

[jira] [Updated] (SPARK-13375) PySpark API Utils missing item: kFold

[ https://issues.apache.org/jira/browse/SPARK-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13375: -- Target Version/s: (was: 1.6.0) > PySpark API Utils missing item: kFold >

[jira] [Resolved] (SPARK-13302) Cleanup persistence Docstests in ml

[ https://issues.apache.org/jira/browse/SPARK-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13302. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11197

[jira] [Updated] (SPARK-13302) Cleanup persistence Docstests in ml

[ https://issues.apache.org/jira/browse/SPARK-13302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13302: -- Assignee: holdenk > Cleanup persistence Docstests in ml > --- > >

[jira] [Updated] (SPARK-12540) Support all TPCDS queries

[ https://issues.apache.org/jira/browse/SPARK-12540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12540: Description: As of Spark SQL 1.6, Spark can run 55 out of 99 TPCDS queries. The goal of this epic

[jira] [Updated] (SPARK-13415) Visualize subquery in SQL web UI

[ https://issues.apache.org/jira/browse/SPARK-13415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13415: Summary: Visualize subquery in SQL web UI (was: Visualize subquery on SQL tab) > Visualize

[jira] [Created] (SPARK-13415) Visualize subquery on SQL tab

Davies Liu created SPARK-13415: -- Summary: Visualize subquery on SQL tab Key: SPARK-13415 URL: https://issues.apache.org/jira/browse/SPARK-13415 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-13414) Add support for launching multiple Mesos dispatchers

[ https://issues.apache.org/jira/browse/SPARK-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13414: Assignee: (was: Apache Spark) > Add support for launching multiple Mesos dispatchers

[jira] [Assigned] (SPARK-13414) Add support for launching multiple Mesos dispatchers

[ https://issues.apache.org/jira/browse/SPARK-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13414: Assignee: Apache Spark > Add support for launching multiple Mesos dispatchers >

[jira] [Commented] (SPARK-13414) Add support for launching multiple Mesos dispatchers

[ https://issues.apache.org/jira/browse/SPARK-13414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155485#comment-15155485 ] Apache Spark commented on SPARK-13414: -- User 'tnachen' has created a pull request for this issue:

[jira] [Created] (SPARK-13414) Add support for launching multiple Mesos dispatchers

Timothy Chen created SPARK-13414: Summary: Add support for launching multiple Mesos dispatchers Key: SPARK-13414 URL: https://issues.apache.org/jira/browse/SPARK-13414 Project: Spark Issue

[jira] [Commented] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155479#comment-15155479 ] Sean Owen commented on SPARK-10001: --- (Let's keep the discussion here; forking a discussion into a new

[jira] [Resolved] (SPARK-13412) Spark Shell Ctrl-C behaviour suggestion

[ https://issues.apache.org/jira/browse/SPARK-13412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13412. --- Resolution: Duplicate This is just a comment on the other JIRA; you shouldn't open a new one. >

[jira] [Assigned] (SPARK-13413) Remove SparkContext.metricsSystem

[ https://issues.apache.org/jira/browse/SPARK-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13413: Assignee: Reynold Xin (was: Apache Spark) > Remove SparkContext.metricsSystem >

[jira] [Commented] (SPARK-13413) Remove SparkContext.metricsSystem

[ https://issues.apache.org/jira/browse/SPARK-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155475#comment-15155475 ] Apache Spark commented on SPARK-13413: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13413) Remove SparkContext.metricsSystem

[ https://issues.apache.org/jira/browse/SPARK-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13413: Assignee: Apache Spark (was: Reynold Xin) > Remove SparkContext.metricsSystem >

[jira] [Created] (SPARK-13413) Remove SparkContext.metricsSystem

Reynold Xin created SPARK-13413: --- Summary: Remove SparkContext.metricsSystem Key: SPARK-13413 URL: https://issues.apache.org/jira/browse/SPARK-13413 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-13413) Remove SparkContext.metricsSystem

[ https://issues.apache.org/jira/browse/SPARK-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-13413: --- Assignee: Reynold Xin > Remove SparkContext.metricsSystem >