[jira] [Assigned] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13891: Assignee: (was: Apache Spark) > Issue an exception when hitting max iteration limit

[jira] [Commented] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194761#comment-15194761 ] Apache Spark commented on SPARK-13891: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13891: Assignee: Apache Spark > Issue an exception when hitting max iteration limit in testing >

[jira] [Created] (SPARK-13891) Issue an exception when hitting max iteration limit in testing

2016-03-14 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13891: --- Summary: Issue an exception when hitting max iteration limit in testing Key: SPARK-13891 URL: https://issues.apache.org/jira/browse/SPARK-13891 Project: Spark Issue

[jira] [Commented] (SPARK-13034) PySpark ml.classification support export/import

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194746#comment-15194746 ] Apache Spark commented on SPARK-13034: -- User 'GayathriMurali' has created a pull request for this

[jira] [Resolved] (SPARK-13353) Fast serialization for collecting DataFrame

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13353. - Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 > Fast serialization

[jira] [Resolved] (SPARK-13661) Avoid the copy of UnsafeRow in HashedRelation

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13661. - Resolution: Fixed Assignee: Davies Liu Fix Version/s: 2.0.0 > Avoid the copy of

[jira] [Assigned] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13889: Assignee: Apache Spark > Integer overflow when calculating the max number of executor

[jira] [Commented] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194737#comment-15194737 ] Apache Spark commented on SPARK-13889: -- User 'carsonwang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13889: Assignee: (was: Apache Spark) > Integer overflow when calculating the max number of

[jira] [Commented] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194735#comment-15194735 ] Apache Spark commented on SPARK-13890: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13890: Assignee: Apache Spark (was: Reynold Xin) > Remove some internal classes' dependency on

[jira] [Assigned] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13890: Assignee: Reynold Xin (was: Apache Spark) > Remove some internal classes' dependency on

[jira] [Commented] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194734#comment-15194734 ] Joseph K. Bradley commented on SPARK-13712: --- Hm, my understanding is that ECOC-based ones can

[jira] [Created] (SPARK-13890) Remove some internal classes' dependency on SQLContext

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13890: --- Summary: Remove some internal classes' dependency on SQLContext Key: SPARK-13890 URL: https://issues.apache.org/jira/browse/SPARK-13890 Project: Spark Issue

[jira] [Commented] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194731#comment-15194731 ] Apache Spark commented on SPARK-13888: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13888: Assignee: Apache Spark > Remove Streaming Akka docs from Spark >

[jira] [Assigned] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13888: Assignee: (was: Apache Spark) > Remove Streaming Akka docs from Spark >

[jira] [Created] (SPARK-13888) Remove Streaming Akka docs from Spark

2016-03-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-13888: Summary: Remove Streaming Akka docs from Spark Key: SPARK-13888 URL: https://issues.apache.org/jira/browse/SPARK-13888 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13889) Integer overflow when calculating the max number of executor failure

2016-03-14 Thread Carson Wang (JIRA)
Carson Wang created SPARK-13889: --- Summary: Integer overflow when calculating the max number of executor failure Key: SPARK-13889 URL: https://issues.apache.org/jira/browse/SPARK-13889 Project: Spark

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Commented] (SPARK-5433) Spark EC2 doesn't mount local disks for all instance types

2016-03-14 Thread Geet Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194722#comment-15194722 ] Geet Kumar commented on SPARK-5433: --- The spark-ec2 script does not mount disks for the d2.xlarge

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL, One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Description: There are multiple types that are supoprted by Spark SQL One of them is

[jira] [Created] (SPARK-13887) PyLint should fail fast to make errors easier to discover

2016-03-14 Thread holdenk (JIRA)
holdenk created SPARK-13887: --- Summary: PyLint should fail fast to make errors easier to discover Key: SPARK-13887 URL: https://issues.apache.org/jira/browse/SPARK-13887 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13887) PyLint should fail fast to make errors easier to discover

2016-03-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-13887: Component/s: PySpark Build > PyLint should fail fast to make errors easier to discover >

[jira] [Updated] (SPARK-13886) ArrayType of BinaryType not supported in Row.equals method

2016-03-14 Thread MahmoudHanafy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MahmoudHanafy updated SPARK-13886: -- Summary: ArrayType of BinaryType not supported in Row.equals method (was: Binary Type ) >

[jira] [Created] (SPARK-13886) Binary Type

2016-03-14 Thread MahmoudHanafy (JIRA)
MahmoudHanafy created SPARK-13886: - Summary: Binary Type Key: SPARK-13886 URL: https://issues.apache.org/jira/browse/SPARK-13886 Project: Spark Issue Type: Bug Components: SQL

[jira] [Created] (SPARK-13885) Spark On Yarn attempt id representation regression

2016-03-14 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-13885: --- Summary: Spark On Yarn attempt id representation regression Key: SPARK-13885 URL: https://issues.apache.org/jira/browse/SPARK-13885 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13102) Run query using ThriftServer, and open web using IE11, i click ”+detail" in SQLPage, but not response

2016-03-14 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194665#comment-15194665 ] KaiXinXIaoLei commented on SPARK-13102: --- I just use F12 to debug, and the error info is :

[jira] [Commented] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

2016-03-14 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194653#comment-15194653 ] Saisai Shao commented on SPARK-13877: - I agreed to move this out, so it could easily support

[jira] [Commented] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194647#comment-15194647 ] Apache Spark commented on SPARK-13884: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13884: Assignee: Apache Spark (was: Reynold Xin) > Remove DescribeCommand's dependency on

[jira] [Assigned] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13884: Assignee: Reynold Xin (was: Apache Spark) > Remove DescribeCommand's dependency on

[jira] [Created] (SPARK-13884) Remove DescribeCommand's dependency on LogicalPlan

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13884: --- Summary: Remove DescribeCommand's dependency on LogicalPlan Key: SPARK-13884 URL: https://issues.apache.org/jira/browse/SPARK-13884 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13034) PySpark ml.classification support export/import

2016-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13034: -- Shepherd: Joseph K. Bradley Target Version/s: 2.0.0 > PySpark

[jira] [Assigned] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13883: Assignee: Michael Armbrust (was: Apache Spark) > buildReader implementation for parquet

[jira] [Commented] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194638#comment-15194638 ] Apache Spark commented on SPARK-13883: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13883: Assignee: Apache Spark (was: Michael Armbrust) > buildReader implementation for parquet

[jira] [Created] (SPARK-13883) buildReader implementation for parquet

2016-03-14 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-13883: Summary: buildReader implementation for parquet Key: SPARK-13883 URL: https://issues.apache.org/jira/browse/SPARK-13883 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13791) Add MetadataLog and HDFSMetadataLog

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13791. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11625

[jira] [Updated] (SPARK-10380) Confusing examples in pyspark SQL docs

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10380: - Assignee: Reynold Xin > Confusing examples in pyspark SQL docs >

[jira] [Resolved] (SPARK-10380) Confusing examples in pyspark SQL docs

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10380. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11698

[jira] [Resolved] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13882. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove org.apache.spark.sql.execution.local >

[jira] [Resolved] (SPARK-11826) Subtract BlockMatrix

2016-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11826. --- Resolution: Fixed Fix Version/s: 2.0.0 > Subtract BlockMatrix >

[jira] [Resolved] (SPARK-13664) Simplify and Speedup HadoopFSRelation

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13664. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11646

[jira] [Updated] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

2016-03-14 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-13877: -- Summary: Consider removing Kafka modules from Spark / Spark Streaming (was: Consider removing Kafka

[jira] [Updated] (SPARK-13877) Consider removing Kafka modules from Spark

2016-03-14 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-13877: -- Component/s: Streaming > Consider removing Kafka modules from Spark >

[jira] [Issue Comment Deleted] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-13712: - Comment: was deleted (was: OK, I have closed the PR. I had also planned to implement ECC after

[jira] [Commented] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194554#comment-15194554 ] zhengruifeng commented on SPARK-13712: -- OK, I have closed the PR. I had also planned to implement

[jira] [Commented] (SPARK-13712) Add OneVsOne to ML

2016-03-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194555#comment-15194555 ] zhengruifeng commented on SPARK-13712: -- OK, I have closed the PR. I had also planned to implement

[jira] [Assigned] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13118: Assignee: (was: Apache Spark) > Support for classes defined in package objects >

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194479#comment-15194479 ] Apache Spark commented on SPARK-13118: -- User 'jodersky' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13118: Assignee: Apache Spark > Support for classes defined in package objects >

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194465#comment-15194465 ] Jakob Odersky commented on SPARK-13118: --- Sure, I'll submit a PR with the test > Support for

[jira] [Updated] (SPARK-12718) SQL generation support for window functions

2016-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12718: --- Assignee: Wenchen Fan (was: Xiao Li) > SQL generation support for window functions >

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194436#comment-15194436 ] Michael Armbrust commented on SPARK-13118: -- Its likely that we have fixed this with other

[jira] [Updated] (SPARK-13244) Unify DataFrame and Dataset API

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13244: Issue Type: Sub-task (was: Improvement) Parent: SPARK-13485 > Unify DataFrame and Dataset

[jira] [Updated] (SPARK-13843) Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13843: Summary: Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter

[jira] [Resolved] (SPARK-13843) Remove streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13843. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove streaming-flume, streaming-mqtt,

[jira] [Commented] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194404#comment-15194404 ] Apache Spark commented on SPARK-13882: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13882: Assignee: Reynold Xin (was: Apache Spark) > Remove org.apache.spark.sql.execution.local

[jira] [Assigned] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13882: Assignee: Apache Spark (was: Reynold Xin) > Remove org.apache.spark.sql.execution.local

[jira] [Created] (SPARK-13882) Remove org.apache.spark.sql.execution.local

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13882: --- Summary: Remove org.apache.spark.sql.execution.local Key: SPARK-13882 URL: https://issues.apache.org/jira/browse/SPARK-13882 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13880: Assignee: Reynold Xin (was: Apache Spark) > Rename DataFrame.scala as Dataset.scala >

[jira] [Assigned] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13881: Assignee: Apache Spark (was: Reynold Xin) > Remove LegacyFunctions >

[jira] [Assigned] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13881: Assignee: Reynold Xin (was: Apache Spark) > Remove LegacyFunctions >

[jira] [Commented] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194397#comment-15194397 ] Apache Spark commented on SPARK-13881: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13880: Assignee: Apache Spark (was: Reynold Xin) > Rename DataFrame.scala as Dataset.scala >

[jira] [Commented] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194396#comment-15194396 ] Apache Spark commented on SPARK-13880: -- User 'rxin' has created a pull request for this issue:

[jira] [Created] (SPARK-13881) Remove LegacyFunctions

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13881: --- Summary: Remove LegacyFunctions Key: SPARK-13881 URL: https://issues.apache.org/jira/browse/SPARK-13881 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13880) Rename DataFrame.scala as Dataset.scala

2016-03-14 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13880: --- Summary: Rename DataFrame.scala as Dataset.scala Key: SPARK-13880 URL: https://issues.apache.org/jira/browse/SPARK-13880 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-13879) Decide DDL/DML commands that need Spark native implementation in 2.0

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13879: Summary: Decide DDL/DML commands that need Spark native implementation in 2.0 (was: Decide

[jira] [Commented] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194382#comment-15194382 ] Yin Huai commented on SPARK-13879: -- Just uploaded the initial doc

[jira] [Closed] (SPARK-13854) Add constraints to outer join

2016-03-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-13854. --- Resolution: Not A Problem > Add constraints to outer join > - >

[jira] [Updated] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13879: - Attachment: Implementing native DDL and DML statements for Spark 2.pdf > Decide commands that need Spark

[jira] [Updated] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13859: Description: Testing Spark SQL using TPC queries. Query 38 returns wrong results compared to

[jira] [Updated] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13858: Description: Testing Spark SQL using TPC queries. Query 21 returns wrong results compared to

[jira] [Created] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
Yin Huai created SPARK-13879: Summary: Decide commands that need Spark native implementation in 2.0 Key: SPARK-13879 URL: https://issues.apache.org/jira/browse/SPARK-13879 Project: Spark Issue

[jira] [Updated] (SPARK-13879) Decide commands that need Spark native implementation in 2.0

2016-03-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13879: - Target Version/s: 2.0.0 > Decide commands that need Spark native implementation in 2.0 >

[jira] [Updated] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13861: Description: Testing Spark SQL using TPC queries. Query 40 returns wrong results compared to

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194370#comment-15194370 ] Reynold Xin commented on SPARK-13865: - [~jfc...@us.ibm.com] thanks for filing these. Can you use the

[jira] [Updated] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13863: Description: Testing Spark SQL using TPC queries. Query 66 returns wrong results compared to

[jira] [Updated] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13862: Description: Testing Spark SQL using TPC queries. Query 49 returns wrong results compared to

[jira] [Updated] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13865: Description: Testing Spark SQL using TPC queries. Query 87 returns wrong results compared to

[jira] [Updated] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13864: Description: Testing Spark SQL using TPC queries. Query 74 returns wrong results compared to

[jira] [Updated] (SPARK-13531) Some DataFrame joins stopped working with UnsupportedOperationException: No size estimation available for objects

2016-03-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13531: - Target Version/s: 2.0.0 > Some DataFrame joins stopped working with

[jira] [Updated] (SPARK-8360) Structured Streaming (aka Streaming DataFrames)

2016-03-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8360: --- Summary: Structured Streaming (aka Streaming DataFrames) (was: Streaming DataFrames) > Structured

[jira] [Reopened] (SPARK-13135) Don't print expressions recursively in generated code

2016-03-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-13135: That PR is not merged. > Don't print expressions recursively in generated code >

[jira] [Resolved] (SPARK-13878) Window functions failed in cluster

2016-03-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13878. Resolution: Duplicate > Window functions failed in cluster > -- >

[jira] [Updated] (SPARK-13878) Window functions failed in cluster

2016-03-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13878: --- Description: When cume_dist is used, we got the following error. {code}

  1   2   3   4   >