[jira] [Assigned] (SPARK-12951) Support spilling in generate aggregate

[ https://issues.apache.org/jira/browse/SPARK-12951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12951: -- Assignee: Davies Liu > Support spilling in generate aggregate > --

[jira] [Resolved] (SPARK-13098) remove GenericInternalRowWithSchema

[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13098. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10992 [https://github.

[jira] [Resolved] (SPARK-12914) Generate TungstenAggregate with grouping keys

[ https://issues.apache.org/jira/browse/SPARK-12914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12914. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10855 [https://github.

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124703#comment-15124703 ] Alex Bozarth commented on SPARK-13085: -- Thanks, should we leave this open until that

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124699#comment-15124699 ] Marcelo Vanzin commented on SPARK-13085: This is fixed in the scalastyle repo, bu

[jira] [Commented] (SPARK-12469) Consistent Accumulators for Spark

[ https://issues.apache.org/jira/browse/SPARK-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124635#comment-15124635 ] holdenk commented on SPARK-12469: - Also a related JIRA https://issues.apache.org/jira/bro

[jira] [Created] (SPARK-13099) ccjlbr

Michael Armbrust created SPARK-13099: Summary: ccjlbr Key: SPARK-13099 URL: https://issues.apache.org/jira/browse/SPARK-13099 Project: Spark Issue Type: Bug Reporter: Michael

[jira] [Resolved] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13096. --- Resolution: Fixed Fix Version/s: 2.0.0 > Make AccumulatorSuite#verifyPeakExecutionMemorySet le

[jira] [Resolved] (SPARK-13088) DAG viz does not work with latest version of chrome

[ https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13088. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 1.5.3

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124613#comment-15124613 ] Shivaram Venkataraman commented on SPARK-5629: -- I manually cleaned up some of

[jira] [Resolved] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10620. --- Resolution: Fixed Fix Version/s: 2.0.0 > Look into whether accumulator mechanism can replace T

[jira] [Updated] (SPARK-13090) Add initial support for constraint propagation in SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13090: - Assignee: Sameer Agarwal > Add initial support for constraint propagation in SparkSQL > -

[jira] [Updated] (SPARK-13092) Track constraints in ExpressionSet

[ https://issues.apache.org/jira/browse/SPARK-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13092: - Assignee: Sameer Agarwal > Track constraints in ExpressionSet > -

[jira] [Updated] (SPARK-13091) Rewrite/Propagate constraints for Aliases

[ https://issues.apache.org/jira/browse/SPARK-13091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13091: - Assignee: Sameer Agarwal > Rewrite/Propagate constraints for Aliases > --

[jira] [Commented] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124556#comment-15124556 ] Cheng Lian commented on SPARK-12624: Yes, it should. > When schema is specified, we

[jira] [Resolved] (SPARK-13076) Rename ClientInterface to HiveClient

[ https://issues.apache.org/jira/browse/SPARK-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13076. - Resolution: Fixed Fix Version/s: 2.0.0 > Rename ClientInterface to HiveClient > --

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124543#comment-15124543 ] Alex Bozarth commented on SPARK-13085: -- Ah, I get it. I've been confused by this par

[jira] [Resolved] (SPARK-5331) Spark workers can't find tachyon master as spark-ec2 doesn't set spark.tachyonStore.url

[ https://issues.apache.org/jira/browse/SPARK-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-5331. -- Resolution: Fixed Fix Version/s: 1.4.0 Fixed by https://github.com/mesos/

[jira] [Resolved] (SPARK-8980) Setup cluster with spark-ec2 scripts as non-root user

[ https://issues.apache.org/jira/browse/SPARK-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8980. -- Resolution: Won't Fix Now tracked by https://github.com/amplab/spark-ec2/issues/

[jira] [Resolved] (SPARK-9494) 'spark-ec2 launch' fails with anaconda python 3.4

[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9494. -- Resolution: Duplicate Fix Version/s: 1.6.0 > 'spark-ec2 launch' fails wit

[jira] [Commented] (SPARK-12624) When schema is specified, we should give better error message if actual row length doesn't match

[ https://issues.apache.org/jira/browse/SPARK-12624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124528#comment-15124528 ] Haidar Hadi commented on SPARK-12624: - I am using the scala api and I do see the same

[jira] [Resolved] (SPARK-10462) spark-ec2 not creating ephemeral volumes

[ https://issues.apache.org/jira/browse/SPARK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10462. --- Resolution: Won't Fix According to http://www.ec2instances.info/?filter=c4.2x

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124518#comment-15124518 ] Charles Allen commented on SPARK-13085: --- I wanted to know what command was failing

[jira] [Resolved] (SPARK-9688) Improve spark-ec2 script to handle users that are not root

[ https://issues.apache.org/jira/browse/SPARK-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9688. -- Resolution: Won't Fix Now tracked at https://github.com/amplab/spark-ec2/issues/

[jira] [Commented] (SPARK-5095) Support launching multiple mesos executors in coarse grained mesos mode

[ https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124473#comment-15124473 ] Apache Spark commented on SPARK-5095: - User 'mgummelt' has created a pull request for

[jira] [Commented] (SPARK-13098) remove GenericInternalRowWithSchema

[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124452#comment-15124452 ] Apache Spark commented on SPARK-13098: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-13098) remove GenericInternalRowWithSchema

[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13098: Assignee: (was: Apache Spark) > remove GenericInternalRowWithSchema >

[jira] [Assigned] (SPARK-13098) remove GenericInternalRowWithSchema

[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13098: Assignee: Apache Spark > remove GenericInternalRowWithSchema > ---

[jira] [Created] (SPARK-13098) remove GenericInternalRowWithSchema

Wenchen Fan created SPARK-13098: --- Summary: remove GenericInternalRowWithSchema Key: SPARK-13098 URL: https://issues.apache.org/jira/browse/SPARK-13098 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13084) Utilize @SerialVersionUID to avoid local class incompatibility

[ https://issues.apache.org/jira/browse/SPARK-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-13084: --- Component/s: Spark Core > Utilize @SerialVersionUID to avoid local class incompatibility > --

[jira] [Assigned] (SPARK-12299) Remove history serving functionality from standalone Master

[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12299: Assignee: Apache Spark > Remove history serving functionality from standalone Master > ---

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124392#comment-15124392 ] Alex Bozarth commented on SPARK-13085: -- The script is located at $SPARK_HOME/dev/sca

[jira] [Assigned] (SPARK-12299) Remove history serving functionality from standalone Master

[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12299: Assignee: (was: Apache Spark) > Remove history serving functionality from standalone M

[jira] [Commented] (SPARK-12299) Remove history serving functionality from standalone Master

[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124393#comment-15124393 ] Apache Spark commented on SPARK-12299: -- User 'BryanCutler' has created a pull reques

[jira] [Commented] (SPARK-9975) Add Normalized Closeness Centrality to Spark GraphX

[ https://issues.apache.org/jira/browse/SPARK-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124375#comment-15124375 ] Stavros Kontopoulos commented on SPARK-9975: Betweenness centrality seems stra

[jira] [Updated] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Seddon updated SPARK-13097: Description: To enhance the existing SparkML Binarizer [SPARK-5891] to allow Vector in addition to

[jira] [Assigned] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13097: Assignee: (was: Apache Spark) > Extend Binarizer to allow Double AND Vector inputs > -

[jira] [Commented] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124323#comment-15124323 ] Apache Spark commented on SPARK-13097: -- User 'seddonm1' has created a pull request f

[jira] [Updated] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13096: -- Affects Version/s: 1.6.0 Target Version/s: 2.0.0 > Make AccumulatorSuite#verifyPeakExecutionMemory

[jira] [Assigned] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13097: Assignee: Apache Spark > Extend Binarizer to allow Double AND Vector inputs >

[jira] [Updated] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Seddon updated SPARK-13097: Description: To enhance the existing SparkML Binarizer [SPARK-5891] to allow Vector in addition to

[jira] [Assigned] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13096: Assignee: Andrew Or (was: Apache Spark) > Make AccumulatorSuite#verifyPeakExecutionMemory

[jira] [Assigned] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13096: Assignee: Apache Spark (was: Andrew Or) > Make AccumulatorSuite#verifyPeakExecutionMemory

[jira] [Commented] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124306#comment-15124306 ] Apache Spark commented on SPARK-13096: -- User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

Mike Seddon created SPARK-13097: --- Summary: Extend Binarizer to allow Double AND Vector inputs Key: SPARK-13097 URL: https://issues.apache.org/jira/browse/SPARK-13097 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

[ https://issues.apache.org/jira/browse/SPARK-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Cebzanov updated SPARK-10658: -- Comment: was deleted (was: I'm also noticing that the %addjar magic doesn't seem to work with

[jira] [Commented] (SPARK-12964) SparkContext.localProperties leaked

[ https://issues.apache.org/jira/browse/SPARK-12964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124296#comment-15124296 ] Shixiong Zhu commented on SPARK-12964: -- +1 for removing the inheritance. > SparkCon

[jira] [Created] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

Andrew Or created SPARK-13096: - Summary: Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky Key: SPARK-13096 URL: https://issues.apache.org/jira/browse/SPARK-13096 Project: Spark Issu

[jira] [Commented] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

[ https://issues.apache.org/jira/browse/SPARK-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124298#comment-15124298 ] Tony Cebzanov commented on SPARK-10658: --- I'm also noticing that the %addjar magic d

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124284#comment-15124284 ] Jai Murugesh Rajasekaran commented on SPARK-12984: -- Thanks > Not able t

[jira] [Closed] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jai Murugesh Rajasekaran closed SPARK-12984. > Not able to read CSV file using Spark 1.4.0 > ---

[jira] [Resolved] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jai Murugesh Rajasekaran resolved SPARK-12984. -- Resolution: Fixed > Not able to read CSV file using Spark 1.4.0 > -

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124282#comment-15124282 ] Jai Murugesh Rajasekaran commented on SPARK-12984: -- Issue resolved Tried

[jira] [Commented] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124278#comment-15124278 ] Deenar Toraskar commented on SPARK-13094: - [~marmbrus] Still the same error on ni

[jira] [Resolved] (SPARK-13082) sqlCtx.real.json() doesn't work with PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13082. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.0.0

[jira] [Updated] (SPARK-13055) SQLHistoryListener throws ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13055: - Affects Version/s: (was: 1.5.0) > SQLHistoryListener throws ClassCastException >

[jira] [Resolved] (SPARK-13055) SQLHistoryListener throws ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13055. -- Resolution: Fixed Fix Version/s: 2.0.0 > SQLHistoryListener throws ClassCastException >

[jira] [Updated] (SPARK-13095) improve performance of hash join with dimension table

[ https://issues.apache.org/jira/browse/SPARK-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13095: --- Component/s: SQL > improve performance of hash join with dimension table > --

[jira] [Created] (SPARK-13095) improve performance of hash join with dimension table

Davies Liu created SPARK-13095: -- Summary: improve performance of hash join with dimension table Key: SPARK-13095 URL: https://issues.apache.org/jira/browse/SPARK-13095 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Target Version/s: 1.6.1 > Dataset Aggregators do not work with complex types > --

[jira] [Commented] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124206#comment-15124206 ] Deenar Toraskar commented on SPARK-13094: - Downloading it now, will update the JI

[jira] [Commented] (SPARK-12798) Broadcast hash join

[ https://issues.apache.org/jira/browse/SPARK-12798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124207#comment-15124207 ] Apache Spark commented on SPARK-12798: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124205#comment-15124205 ] Michael Armbrust commented on SPARK-13094: -- Sorry, I think I was unclear. When

[jira] [Assigned] (SPARK-13082) sqlCtx.real.json() doesn't work with PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13082: Assignee: (was: Apache Spark) > sqlCtx.real.json() doesn't work with PythonRDD > -

[jira] [Commented] (SPARK-13082) sqlCtx.real.json() doesn't work with PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124189#comment-15124189 ] Apache Spark commented on SPARK-13082: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-13082) sqlCtx.real.json() doesn't work with PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124191#comment-15124191 ] Shixiong Zhu commented on SPARK-13082: -- This one actually fixed by SPARK-12600. I ju

[jira] [Assigned] (SPARK-13082) sqlCtx.real.json() doesn't work with PythonRDD

[ https://issues.apache.org/jira/browse/SPARK-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13082: Assignee: Apache Spark > sqlCtx.real.json() doesn't work with PythonRDD >

[jira] [Created] (SPARK-13094) Dataset Aggregators do not work with complex types

Deenar Toraskar created SPARK-13094: --- Summary: Dataset Aggregators do not work with complex types Key: SPARK-13094 URL: https://issues.apache.org/jira/browse/SPARK-13094 Project: Spark Issu

[jira] [Assigned] (SPARK-13093) improve null check in nullSafeCodeGen for unary, binary and ternary expression

[ https://issues.apache.org/jira/browse/SPARK-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13093: Assignee: (was: Apache Spark) > improve null check in nullSafeCodeGen for unary, binar

[jira] [Assigned] (SPARK-13093) improve null check in nullSafeCodeGen for unary, binary and ternary expression

[ https://issues.apache.org/jira/browse/SPARK-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13093: Assignee: Apache Spark > improve null check in nullSafeCodeGen for unary, binary and terna

[jira] [Commented] (SPARK-13093) improve null check in nullSafeCodeGen for unary, binary and ternary expression

[ https://issues.apache.org/jira/browse/SPARK-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124165#comment-15124165 ] Apache Spark commented on SPARK-13093: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-13093) improve null check in nullSafeCodeGen for unary, binary and ternary expression

Wenchen Fan created SPARK-13093: --- Summary: improve null check in nullSafeCodeGen for unary, binary and ternary expression Key: SPARK-13093 URL: https://issues.apache.org/jira/browse/SPARK-13093 Project:

[jira] [Created] (SPARK-13092) Track constraints in ExpressionSet

Sameer Agarwal created SPARK-13092: -- Summary: Track constraints in ExpressionSet Key: SPARK-13092 URL: https://issues.apache.org/jira/browse/SPARK-13092 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13091) Rewrite/Propagate constraints for Aliases

Sameer Agarwal created SPARK-13091: -- Summary: Rewrite/Propagate constraints for Aliases Key: SPARK-13091 URL: https://issues.apache.org/jira/browse/SPARK-13091 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-13090) Add initial support for constraint propagation in SparkSQL

Sameer Agarwal created SPARK-13090: -- Summary: Add initial support for constraint propagation in SparkSQL Key: SPARK-13090 URL: https://issues.apache.org/jira/browse/SPARK-13090 Project: Spark

[jira] [Updated] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

[ https://issues.apache.org/jira/browse/SPARK-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13087: - Target Version/s: 1.6.1 > Grouping by a complex expression may lead to incorrect Attribut

[jira] [Assigned] (SPARK-13088) DAG viz does not work with latest version of chrome

[ https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13088: Assignee: Apache Spark (was: Andrew Or) > DAG viz does not work with latest version of ch

[jira] [Assigned] (SPARK-13088) DAG viz does not work with latest version of chrome

[ https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13088: Assignee: Andrew Or (was: Apache Spark) > DAG viz does not work with latest version of ch

[jira] [Commented] (SPARK-13088) DAG viz does not work with latest version of chrome

[ https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124095#comment-15124095 ] Apache Spark commented on SPARK-13088: -- User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-13089) spark.ml Naive Bayes user guide

Joseph K. Bradley created SPARK-13089: - Summary: spark.ml Naive Bayes user guide Key: SPARK-13089 URL: https://issues.apache.org/jira/browse/SPARK-13089 Project: Spark Issue Type: Documen

[jira] [Commented] (SPARK-13084) Utilize @SerialVersionUID to avoid local class incompatibility

[ https://issues.apache.org/jira/browse/SPARK-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124068#comment-15124068 ] Sean Owen commented on SPARK-13084: --- Serialversionuid is generally a bad idea. It opens

[jira] [Commented] (SPARK-12818) Implement Bloom filter and count-min sketch in DataFrames

[ https://issues.apache.org/jira/browse/SPARK-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124059#comment-15124059 ] Apache Spark commented on SPARK-12818: -- User 'liancheng' has created a pull request

[jira] [Comment Edited] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124039#comment-15124039 ] Shixiong Zhu edited comment on SPARK-12695 at 1/29/16 7:25 PM:

[jira] [Comment Edited] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124037#comment-15124037 ] Shixiong Zhu edited comment on SPARK-12695 at 1/29/16 7:25 PM:

[jira] [Resolved] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12695. -- Resolution: Duplicate I'm going to mark this one duplicate because SPARK-12695 has a better re

[jira] [Commented] (SPARK-12695) java.lang.ClassCastException: [B cannot be cast to java.lang.String

[ https://issues.apache.org/jira/browse/SPARK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124039#comment-15124039 ] Shixiong Zhu commented on SPARK-12695: -- This is a SQL issue. See SPARK-12695 > java

[jira] [Resolved] (SPARK-12656) Rewrite Intersect phyiscal plan using semi-join

[ https://issues.apache.org/jira/browse/SPARK-12656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12656. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Rewrite Intersect phyi

[jira] [Updated] (SPARK-13088) DAG viz does not work with latest version of chrome

[ https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13088: -- Attachment: Screen Shot 2016-01-29 at 10.54.14 AM.png > DAG viz does not work with latest version of ch

[jira] [Created] (SPARK-13088) DAG viz does not work with latest version of chrome

Andrew Or created SPARK-13088: - Summary: DAG viz does not work with latest version of chrome Key: SPARK-13088 URL: https://issues.apache.org/jira/browse/SPARK-13088 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-10009) PySpark Param of Vector type can be set with Python array or numpy.array

[ https://issues.apache.org/jira/browse/SPARK-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123974#comment-15123974 ] holdenk commented on SPARK-10009: - cc [~sethah] you might want to handle this while looki

[jira] [Resolved] (SPARK-13072) simplify and improve murmur3 hash expression codegen

[ https://issues.apache.org/jira/browse/SPARK-13072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13072. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10974 [https://github.

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123946#comment-15123946 ] Charles Allen commented on SPARK-13085: --- {code} mvn scalastyle:check {code} was ab

[jira] [Created] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

Mark Hamstra created SPARK-13087: Summary: Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations Key: SPARK-13087 URL: https://issues.apache.org/jira/browse/SPARK-13087

[jira] [Assigned] (SPARK-12913) Reimplement stat functions as declarative function

[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12913: -- Assignee: Davies Liu > Reimplement stat functions as declarative function > --

[jira] [Resolved] (SPARK-10873) can't sort columns on history page

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-10873. --- Resolution: Fixed Fix Version/s: 2.0.0 > can't sort columns on history page >

[jira] [Updated] (SPARK-10873) Change history to use datatables to support sorting columns and searching

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-10873: -- Summary: Change history to use datatables to support sorting columns and searching (was: Chang

[jira] [Updated] (SPARK-10873) Change history table to use datatables to support sorting columns and searching

[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-10873: -- Summary: Change history table to use datatables to support sorting columns and searching (was:

[jira] [Commented] (SPARK-13033) PySpark ml.regression support export/import

[ https://issues.apache.org/jira/browse/SPARK-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123823#comment-15123823 ] Joseph K. Bradley commented on SPARK-13033: --- It's now merged! > PySpark ml.reg

[jira] [Commented] (SPARK-13037) PySpark ml.recommendation support export/import

[ https://issues.apache.org/jira/browse/SPARK-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123824#comment-15123824 ] Joseph K. Bradley commented on SPARK-13037: --- The blocking PR is now merged! >

[jira] [Updated] (SPARK-12626) MLlib 2.0 Roadmap

[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12626: -- Description: This is a master list for MLlib improvements we plan to have in Spark 2.0.

  1   2   >