[jira] [Comment Edited] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2016-01-08 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090485#comment-15090485 ] Liang-Chi Hsieh edited comment on SPARK-12648 at 1/9/16 7:26 AM: --

[jira] [Commented] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2016-01-08 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090485#comment-15090485 ] Liang-Chi Hsieh commented on SPARK-12648: - You don't need to handle the null valu

[jira] [Closed] (SPARK-12733) Remove duplicate codes in ProjectCollapsing

2016-01-08 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-12733. --- Resolution: Won't Fix > Remove duplicate codes in ProjectCollapsing > ---

[jira] [Updated] (SPARK-12645) SparkR support hash function

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12645: -- Assignee: Yanbo Liang > SparkR support hash function > ---

[jira] [Resolved] (SPARK-12645) SparkR support hash function

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12645. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090464#comment-15090464 ] Shivaram Venkataraman commented on SPARK-12609: --- There are other ways to ch

[jira] [Assigned] (SPARK-12735) Move spark-ec2 scripts to AMPLab

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12735: Assignee: Reynold Xin (was: Apache Spark) > Move spark-ec2 scripts to AMPLab > --

[jira] [Commented] (SPARK-12735) Move spark-ec2 scripts to AMPLab

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090463#comment-15090463 ] Apache Spark commented on SPARK-12735: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-12735) Move spark-ec2 scripts to AMPLab

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12735: Assignee: Apache Spark (was: Reynold Xin) > Move spark-ec2 scripts to AMPLab > --

[jira] [Commented] (SPARK-12635) More efficient (column batch) serialization for Python/R

2016-01-08 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090461#comment-15090461 ] Shivaram Venkataraman commented on SPARK-12635: --- cc [~sunrui] who is workin

[jira] [Created] (SPARK-12735) Move spark-ec2 scripts to AMPLab

2016-01-08 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12735: --- Summary: Move spark-ec2 scripts to AMPLab Key: SPARK-12735 URL: https://issues.apache.org/jira/browse/SPARK-12735 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12734: --- Description: Netty classes are published under artifacts with different names, so our build needs to

[jira] [Commented] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090453#comment-15090453 ] Apache Spark commented on SPARK-12734: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12734: Assignee: Josh Rosen (was: Apache Spark) > Fix Netty exclusions and use Maven Enforcer to

[jira] [Assigned] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12734: Assignee: Apache Spark (was: Josh Rosen) > Fix Netty exclusions and use Maven Enforcer to

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-922: -- Priority: Blocker (was: Major) > Update Spark AMI to Python 2.7 > -- > >

[jira] [Commented] (SPARK-922) Update Spark AMI to Python 2.7

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090451#comment-15090451 ] Reynold Xin commented on SPARK-922: --- cc [~shivaram] > Update Spark AMI to Python 2.7 > -

[jira] [Assigned] (SPARK-12733) Remove duplicate codes in ProjectCollapsing

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12733: Assignee: Apache Spark > Remove duplicate codes in ProjectCollapsing > ---

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-922: -- Affects Version/s: (was: 1.1.0) (was: 0.9.1) (wa

[jira] [Assigned] (SPARK-12733) Remove duplicate codes in ProjectCollapsing

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12733: Assignee: (was: Apache Spark) > Remove duplicate codes in ProjectCollapsing >

[jira] [Commented] (SPARK-12733) Remove duplicate codes in ProjectCollapsing

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090449#comment-15090449 ] Apache Spark commented on SPARK-12733: -- User 'viirya' has created a pull request for

[jira] [Created] (SPARK-12734) Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced

2016-01-08 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12734: -- Summary: Fix Netty exclusions and use Maven Enforcer to prevent bug from being reintroduced Key: SPARK-12734 URL: https://issues.apache.org/jira/browse/SPARK-12734 Projec

[jira] [Created] (SPARK-12733) Remove duplicate codes in ProjectCollapsing

2016-01-08 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-12733: --- Summary: Remove duplicate codes in ProjectCollapsing Key: SPARK-12733 URL: https://issues.apache.org/jira/browse/SPARK-12733 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12340) overstep the bounds of Int in SparkPlan.executeTake

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090436#comment-15090436 ] Apache Spark commented on SPARK-12340: -- User 'rxin' has created a pull request for t

[jira] [Resolved] (SPARK-12577) better support of parentheses in partition by and order by clause of window function's over clause

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12577. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10620 [https://github.

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090420#comment-15090420 ] Apache Spark commented on SPARK-12504: -- User 'sureshthalamati' has created a pull re

[jira] [Resolved] (SPARK-12730) De-duplicate some test code in BlockManagerSuite

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12730. - Resolution: Fixed Fix Version/s: 2.0.0 > De-duplicate some test code in BlockManagerSuite

[jira] [Assigned] (SPARK-12706) support grouping/grouping_id function together group set

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12706: -- Assignee: Davies Liu > support grouping/grouping_id function together group set >

[jira] [Comment Edited] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-08 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090346#comment-15090346 ] Imran Younus edited comment on SPARK-12732 at 1/9/16 2:17 AM: -

[jira] [Comment Edited] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-08 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090346#comment-15090346 ] Imran Younus edited comment on SPARK-12732 at 1/9/16 2:16 AM: -

[jira] [Commented] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-08 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090346#comment-15090346 ] Imran Younus commented on SPARK-12732: -- [~holdenk] [~sethah] [~dbtsai] I would propo

[jira] [Updated] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-08 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Younus updated SPARK-12732: - Description: If the target variable is constant, then the linear regression must check if the fi

[jira] [Created] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-08 Thread Imran Younus (JIRA)
Imran Younus created SPARK-12732: Summary: Fix LinearRegression.train for the case when label is constant and fitIntercept=false Key: SPARK-12732 URL: https://issues.apache.org/jira/browse/SPARK-12732

[jira] [Updated] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

2016-01-08 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Younus updated SPARK-12732: - Description: If the target variable is constant, then the linear regression must check if the fi

[jira] [Commented] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

2016-01-08 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090292#comment-15090292 ] Bryan Cutler commented on SPARK-11219: -- That's my fault [~josephkb], I was instructi

[jira] [Commented] (SPARK-12731) PySpark docstring cleanup

2016-01-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090280#comment-15090280 ] holdenk commented on SPARK-12731: - I've got a shell script started to do this I'll just t

[jira] [Created] (SPARK-12731) PySpark docstring cleanup

2016-01-08 Thread holdenk (JIRA)
holdenk created SPARK-12731: --- Summary: PySpark docstring cleanup Key: SPARK-12731 URL: https://issues.apache.org/jira/browse/SPARK-12731 Project: Spark Issue Type: Improvement Components:

[jira] [Assigned] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12716: Assignee: Apache Spark > Executor UI improvement suggestions - Totals > --

[jira] [Assigned] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12716: Assignee: (was: Apache Spark) > Executor UI improvement suggestions - Totals > ---

[jira] [Commented] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090245#comment-15090245 ] Apache Spark commented on SPARK-12716: -- User 'ajbozarth' has created a pull request

[jira] [Commented] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090225#comment-15090225 ] Joseph K. Bradley commented on SPARK-11219: --- [~bryanc] [~vijaykiran] [~somi...@

[jira] [Commented] (SPARK-11214) Join with Unicode-String results wrong empty

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090222#comment-15090222 ] Davies Liu commented on SPARK-11214: [~xDSticker] Could you try this in master or 1.6

[jira] [Assigned] (SPARK-12730) De-duplicate some test code in BlockManagerSuite

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12730: Assignee: Apache Spark (was: Josh Rosen) > De-duplicate some test code in BlockManagerSui

[jira] [Assigned] (SPARK-12730) De-duplicate some test code in BlockManagerSuite

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12730: Assignee: Josh Rosen (was: Apache Spark) > De-duplicate some test code in BlockManagerSui

[jira] [Commented] (SPARK-12730) De-duplicate some test code in BlockManagerSuite

2016-01-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090217#comment-15090217 ] Apache Spark commented on SPARK-12730: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-12730) De-duplicate some test code in BlockManagerSuite

2016-01-08 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12730: -- Summary: De-duplicate some test code in BlockManagerSuite Key: SPARK-12730 URL: https://issues.apache.org/jira/browse/SPARK-12730 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-12696) Dataset serialization error

2016-01-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12696. -- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10650 [htt

[jira] [Updated] (SPARK-11826) Subtract BlockMatrix

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11826: -- Target Version/s: (was: 2.0.0) > Subtract BlockMatrix > > >

[jira] [Updated] (SPARK-11826) Subtract BlockMatrix

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11826: -- Shepherd: Joseph K. Bradley Assignee: Ehsan Mohyedin Kermani Tar

[jira] [Updated] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11944: -- Assignee: holdenk Target Version/s: 2.0.0 > Python API for mllib.clustering

[jira] [Commented] (SPARK-12426) Docker JDBC integration tests are failing again

2016-01-08 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090179#comment-15090179 ] Mark Grover commented on SPARK-12426: - [~sowen]/[~joshrosen] Just a reminder about th

[jira] [Comment Edited] (SPARK-11214) Join with Unicode-String results wrong empty

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087675#comment-15087675 ] Reynold Xin edited comment on SPARK-11214 at 1/8/16 11:29 PM: -

[jira] [Updated] (SPARK-12727) SQL generation support for distinct aggregation patterns that fit DistinctAggregationRewriter analysis rule

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12727: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for distinct aggregati

[jira] [Updated] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12725: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation suffers from name conficts int

[jira] [Updated] (SPARK-12728) Integrate SQL generation feature with native view

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12728: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Integrate SQL generation feature with native

[jira] [Updated] (SPARK-12721) SQL generation support for script transformation

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12721: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for script transformat

[jira] [Updated] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12723: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Comprehensive SQL generation support for expr

[jira] [Updated] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12724: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for persisted data sou

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for cube, rollup, and

[jira] [Updated] (SPARK-12719) SQL generation support for generators (including UDTF)

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12719: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for generators (includ

[jira] [Updated] (SPARK-12718) SQL generation support for window functions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12718: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > SQL generation support for window functions >

[jira] [Commented] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-08 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090165#comment-15090165 ] Jason C Lee commented on SPARK-12655: - The VertexRDD and EdgeRDD you see are created

[jira] [Created] (SPARK-12729) phantom references to replace the finalize call in python broadcast

2016-01-08 Thread Davies Liu (JIRA)
Davies Liu created SPARK-12729: -- Summary: phantom references to replace the finalize call in python broadcast Key: SPARK-12729 URL: https://issues.apache.org/jira/browse/SPARK-12729 Project: Spark

[jira] [Created] (SPARK-12728) Integrate SQL generation feature with native view

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12728: -- Summary: Integrate SQL generation feature with native view Key: SPARK-12728 URL: https://issues.apache.org/jira/browse/SPARK-12728 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-11012) Canonicalize view definitions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11012: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Canonicalize view definitions > -

[jira] [Commented] (SPARK-12488) LDA describeTopics() Generates Invalid Term IDs

2016-01-08 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090126#comment-15090126 ] Joseph K. Bradley commented on SPARK-12488: --- It was just reported on this threa

[jira] [Commented] (SPARK-11012) Canonicalize view definitions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090110#comment-15090110 ] Cheng Lian commented on SPARK-11012: Done. > Canonicalize view definitions > ---

[jira] [Created] (SPARK-12727) SQL generation support for distinct aggregation patterns that fit DistinctAggregationRewriter analysis rule

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12727: -- Summary: SQL generation support for distinct aggregation patterns that fit DistinctAggregationRewriter analysis rule Key: SPARK-12727 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12723: --- Description: Ensure that all built-in expressions can be mapped to its SQL representation if there i

[jira] [Updated] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12723: --- Description: Ensure that all built-in expressions can be mapped to its SQL representation if there i

[jira] [Updated] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12723: --- Description: Ensure that all built-in expressions can be mapped to its SQL representation if there i

[jira] [Commented] (SPARK-8279) udf_round_3 test fails

2016-01-08 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090098#comment-15090098 ] Mark Hamstra commented on SPARK-8279: - Why is `round` in Spark SQL using HALF_UP inste

[jira] [Updated] (SPARK-12726) ParquetConversions doesn't always propagate metastore table identifier to ParquetRelation

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12726: --- Description: (I hit this issue while working on SPARK-12593, but haven't got time to investigate it.

[jira] [Created] (SPARK-12726) ParquetConversions doesn't always propagate metastore table identifier to ParquetRelation

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12726: -- Summary: ParquetConversions doesn't always propagate metastore table identifier to ParquetRelation Key: SPARK-12726 URL: https://issues.apache.org/jira/browse/SPARK-12726

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently t

[jira] [Created] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12725: -- Summary: SQL generation suffers from name conficts introduced by some analysis rules Key: SPARK-12725 URL: https://issues.apache.org/jira/browse/SPARK-12725 Project: Spar

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently t

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently t

[jira] [Updated] (SPARK-12722) Typo in Spark Pipeline example

2016-01-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12722: -- Labels: starter (was: ) Priority: Trivial (was: Major) > Typo in Spark Pipeline example > -

[jira] [Created] (SPARK-12724) SQL generation support for persisted data source relations

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12724: -- Summary: SQL generation support for persisted data source relations Key: SPARK-12724 URL: https://issues.apache.org/jira/browse/SPARK-12724 Project: Spark Issue

[jira] [Created] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12723: -- Summary: Comprehensive SQL generation support for expressions Key: SPARK-12723 URL: https://issues.apache.org/jira/browse/SPARK-12723 Project: Spark Issue Type:

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently t

[jira] [Created] (SPARK-12722) Typo in Spark Pipeline example

2016-01-08 Thread Tom Chan (JIRA)
Tom Chan created SPARK-12722: Summary: Typo in Spark Pipeline example Key: SPARK-12722 URL: https://issues.apache.org/jira/browse/SPARK-12722 Project: Spark Issue Type: Documentation Co

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently t

[jira] [Created] (SPARK-12721) SQL generation support for script transformation

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12721: -- Summary: SQL generation support for script transformation Key: SPARK-12721 URL: https://issues.apache.org/jira/browse/SPARK-12721 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12720: -- Summary: SQL generation support for cube, rollup, and grouping set Key: SPARK-12720 URL: https://issues.apache.org/jira/browse/SPARK-12720 Project: Spark Issue T

[jira] [Updated] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Walker updated SPARK-12717: -- Description: The following multi-threaded program that uses broadcast variables consistently t

[jira] [Updated] (SPARK-12593) Convert basic resolved logical plans back to SQL query strings

2016-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12593: --- Summary: Convert basic resolved logical plans back to SQL query strings (was: Convert resolved logic

[jira] [Created] (SPARK-12718) SQL generation support for window functions

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12718: -- Summary: SQL generation support for window functions Key: SPARK-12718 URL: https://issues.apache.org/jira/browse/SPARK-12718 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12719) SQL generation support for generators (including UDTF)

2016-01-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-12719: -- Summary: SQL generation support for generators (including UDTF) Key: SPARK-12719 URL: https://issues.apache.org/jira/browse/SPARK-12719 Project: Spark Issue Type

[jira] [Created] (SPARK-12717) pyspark broadcast fails when using multiple threads

2016-01-08 Thread Edward Walker (JIRA)
Edward Walker created SPARK-12717: - Summary: pyspark broadcast fails when using multiple threads Key: SPARK-12717 URL: https://issues.apache.org/jira/browse/SPARK-12717 Project: Spark Issue T

[jira] [Updated] (SPARK-12593) Convert resolved logical plans back to SQL query strings

2016-01-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12593: - Issue Type: Sub-task (was: New Feature) Parent: SPARK-11012 > Convert resolved logical plans bac

[jira] [Commented] (SPARK-11012) Canonicalize view definitions

2016-01-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090033#comment-15090033 ] Yin Huai commented on SPARK-11012: -- [~lian cheng] Let's create jiras for all sub-tasks.

[jira] [Resolved] (SPARK-12593) Convert resolved logical plans back to SQL query strings

2016-01-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12593. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10541 [https://github.com/

[jira] [Updated] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12705: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-12540 > Sorting column can't be resolved if it

[jira] [Updated] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-12705: --- Description: The following query can't be resolved: ``` scala> sqlContext.sql("select sum(a) over ()

[jira] [Commented] (SPARK-12705) Sorting column can't be resolved if it's not in projection

2016-01-08 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089994#comment-15089994 ] Davies Liu commented on SPARK-12705: [~smilegator]I had updated JIRA to have a reprod

[jira] [Resolved] (SPARK-4819) Remove Guava's "Optional" from public API

2016-01-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-4819. Resolution: Fixed Fix Version/s: 2.0.0 > Remove Guava's "Optional" from public API >

[jira] [Commented] (SPARK-1832) Executor UI improvement suggestions

2016-01-08 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089967#comment-15089967 ] Alex Bozarth commented on SPARK-1832: - Opened a sub-task for the totals UI half. Unles

[jira] [Created] (SPARK-12716) Executor UI improvement suggestions - Totals

2016-01-08 Thread Alex Bozarth (JIRA)
Alex Bozarth created SPARK-12716: Summary: Executor UI improvement suggestions - Totals Key: SPARK-12716 URL: https://issues.apache.org/jira/browse/SPARK-12716 Project: Spark Issue Type: Sub-

  1   2   3   >