[jira] [Created] (SPARK-20761) Union uses column order rather than schema

2017-05-15 Thread Nakul Jeirath (JIRA)
Nakul Jeirath created SPARK-20761: - Summary: Union uses column order rather than schema Key: SPARK-20761 URL: https://issues.apache.org/jira/browse/SPARK-20761 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-20502) ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-20502. --- Resolution: Done Fix Version/s: 2.2.0 > ML, Graph 2.2 QA: API: Experimental,

[jira] [Commented] (SPARK-20502) ML, Graph 2.2 QA: API: Experimental, DeveloperApi, final, sealed audit

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011768#comment-16011768 ] Joseph K. Bradley commented on SPARK-20502: --- Thanks for doing this audit! Note that the list

[jira] [Commented] (SPARK-20505) ML, Graph 2.2 QA: Update user guide for new features & APIs

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011751#comment-16011751 ] Apache Spark commented on SPARK-20505: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-20503) ML 2.2 QA: API: Python API coverage

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011749#comment-16011749 ] Joseph K. Bradley commented on SPARK-20503: --- [~mlnick] Did you do this audit? If not, let me

[jira] [Commented] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011727#comment-16011727 ] Joseph K. Bradley commented on SPARK-20501: --- I checked those classes docs as well, so I went

[jira] [Resolved] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-20501. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17934

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. We have a long term

[jira] [Issue Comment Deleted] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Comment: was deleted (was: RDD blocks are growing crazily after running for a couple of hours) >

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: RDD Blocks .png RDD blocks are increasing crazily after running the app for a couple of

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: (was: Screen Shot 2017-05-16 at 1.47.06 pm.png) > Memory Leak of RDD blocks >

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: Screen Shot 2017-05-16 at 1.47.06 pm.png RDD blocks are growing crazily after running for

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. I have a long term

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. I have a long term

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. I have a long term

[jira] [Created] (SPARK-20760) Memory Leak of RDD blocks

2017-05-15 Thread Binzi Cao (JIRA)
Binzi Cao created SPARK-20760: - Summary: Memory Leak of RDD blocks Key: SPARK-20760 URL: https://issues.apache.org/jira/browse/SPARK-20760 Project: Spark Issue Type: Bug Components:

[jira] [Assigned] (SPARK-20758) Add Constant propagation optimization

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20758: Assignee: (was: Apache Spark) > Add Constant propagation optimization >

[jira] [Assigned] (SPARK-20759) SCALA_VERSION in _config.yml should be consistent with pom.xml

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20759: Assignee: Apache Spark > SCALA_VERSION in _config.yml should be consistent with pom.xml >

[jira] [Assigned] (SPARK-20759) SCALA_VERSION in _config.yml should be consistent with pom.xml

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20759: Assignee: (was: Apache Spark) > SCALA_VERSION in _config.yml should be consistent

[jira] [Assigned] (SPARK-20758) Add Constant propagation optimization

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20758: Assignee: Apache Spark > Add Constant propagation optimization >

[jira] [Commented] (SPARK-20759) SCALA_VERSION in _config.yml should be consistent with pom.xml

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011675#comment-16011675 ] Apache Spark commented on SPARK-20759: -- User 'liu-zhaokun' has created a pull request for this

[jira] [Commented] (SPARK-20758) Add Constant propagation optimization

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011674#comment-16011674 ] Apache Spark commented on SPARK-20758: -- User 'tejasapatil' has created a pull request for this

[jira] [Created] (SPARK-20759) SCALA_VERSION in _config.yml should be consistent with pom.xml

2017-05-15 Thread liuzhaokun (JIRA)
liuzhaokun created SPARK-20759: -- Summary: SCALA_VERSION in _config.yml should be consistent with pom.xml Key: SPARK-20759 URL: https://issues.apache.org/jira/browse/SPARK-20759 Project: Spark

[jira] [Created] (SPARK-20758) Add Constant propagation optimization

2017-05-15 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-20758: --- Summary: Add Constant propagation optimization Key: SPARK-20758 URL: https://issues.apache.org/jira/browse/SPARK-20758 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-20757) Spark timeout several small optimization

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20757: Assignee: (was: Apache Spark) > Spark timeout several small optimization >

[jira] [Assigned] (SPARK-20757) Spark timeout several small optimization

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20757: Assignee: Apache Spark > Spark timeout several small optimization >

[jira] [Commented] (SPARK-20757) Spark timeout several small optimization

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011670#comment-16011670 ] Apache Spark commented on SPARK-20757: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Issue Comment Deleted] (SPARK-20757) Spark timeout several small optimization

2017-05-15 Thread liuzhaokun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuzhaokun updated SPARK-20757: --- Comment: was deleted (was: I think it's very meaningful.Look forward to community merge it.) >

[jira] [Commented] (SPARK-20757) Spark timeout several small optimization

2017-05-15 Thread liuzhaokun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011665#comment-16011665 ] liuzhaokun commented on SPARK-20757: I think it's very meaningful.Look forward to community merge it.

[jira] [Issue Comment Deleted] (SPARK-20504) ML 2.2 QA: API: Java compatibility, docs

2017-05-15 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-20504: --- Comment: was deleted (was: You’re right this is really a headache. Java tools cannot extract several

[jira] [Created] (SPARK-20757) Spark timeout several small optimization

2017-05-15 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-20757: -- Summary: Spark timeout several small optimization Key: SPARK-20757 URL: https://issues.apache.org/jira/browse/SPARK-20757 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-20707) ML deprecated APIs should be removed in major release.

2017-05-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-20707. - Resolution: Fixed Fix Version/s: 2.2.0 > ML deprecated APIs should be removed in major

[jira] [Commented] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-05-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011622#comment-16011622 ] Yanbo Liang commented on SPARK-20501: - All of the classes you mentioned have been reviewed. [~mlnick]

[jira] [Assigned] (SPARK-20756) yarn-shuffle jar has references to unshaded guava and contains scala classes

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20756: Assignee: Apache Spark > yarn-shuffle jar has references to unshaded guava and contains

[jira] [Assigned] (SPARK-20756) yarn-shuffle jar has references to unshaded guava and contains scala classes

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20756: Assignee: (was: Apache Spark) > yarn-shuffle jar has references to unshaded guava and

[jira] [Commented] (SPARK-20756) yarn-shuffle jar has references to unshaded guava and contains scala classes

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011582#comment-16011582 ] Apache Spark commented on SPARK-20756: -- User 'markgrover' has created a pull request for this issue:

[jira] [Created] (SPARK-20756) yarn-shuffle jar has references to unshaded guava and contains scala classes

2017-05-15 Thread Mark Grover (JIRA)
Mark Grover created SPARK-20756: --- Summary: yarn-shuffle jar has references to unshaded guava and contains scala classes Key: SPARK-20756 URL: https://issues.apache.org/jira/browse/SPARK-20756 Project:

[jira] [Updated] (SPARK-20504) ML 2.2 QA: API: Java compatibility, docs

2017-05-15 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-20504: --- You’re right this is really a headache. Java tools cannot extract several information `scalac`

[jira] [Commented] (SPARK-6628) ClassCastException occurs when executing sql statement "insert into" on hbase table

2017-05-15 Thread Weiqing Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011556#comment-16011556 ] Weiqing Yang commented on SPARK-6628: - Hi [~srowen], I just submitted a PR for this. could you please

[jira] [Assigned] (SPARK-20700) InferFiltersFromConstraints stackoverflows for query (v2)

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20700: --- Assignee: Jiang Xingbo > InferFiltersFromConstraints stackoverflows for query (v2) >

[jira] [Commented] (SPARK-20755) UDF registration should throw exception if UDF not found on classpath

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011547#comment-16011547 ] Xiao Li commented on SPARK-20755: - Will do it. This is duplicate to the previous PR. > UDF registration

[jira] [Commented] (SPARK-6628) ClassCastException occurs when executing sql statement "insert into" on hbase table

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011545#comment-16011545 ] Apache Spark commented on SPARK-6628: - User 'weiqingy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20755) UDF registration should throw exception if UDF not found on classpath

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20755: --- Assignee: Xiao Li > UDF registration should throw exception if UDF not found on classpath >

[jira] [Created] (SPARK-20755) UDF registration should throw exception if UDF not found on classpath

2017-05-15 Thread Jeremy Beard (JIRA)
Jeremy Beard created SPARK-20755: Summary: UDF registration should throw exception if UDF not found on classpath Key: SPARK-20755 URL: https://issues.apache.org/jira/browse/SPARK-20755 Project: Spark

[jira] [Resolved] (SPARK-20588) from_utc_timestamp causes bottleneck

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20588. - Resolution: Fixed Fix Version/s: 2.2.0 > from_utc_timestamp causes bottleneck >

[jira] [Assigned] (SPARK-20588) from_utc_timestamp causes bottleneck

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20588: --- Assignee: Takuya Ueshin > from_utc_timestamp causes bottleneck >

[jira] [Commented] (SPARK-18825) Eliminate duplicate links in SparkR API doc index

2017-05-15 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011504#comment-16011504 ] Maciej Szymkiewicz commented on SPARK-18825: It is a bit hack but I made some experiments and

[jira] [Comment Edited] (SPARK-20504) ML 2.2 QA: API: Java compatibility, docs

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011293#comment-16011293 ] Joseph K. Bradley edited comment on SPARK-20504 at 5/15/17 11:23 PM: -

[jira] [Commented] (SPARK-6628) ClassCastException occurs when executing sql statement "insert into" on hbase table

2017-05-15 Thread Weiqing Yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011490#comment-16011490 ] Weiqing Yang commented on SPARK-6628: - We met with this issue too. The major issue is: {code}

[jira] [Updated] (SPARK-20754) Add Function Alias For MOD/TRUNCT/POSITION

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20754: Labels: starter (was: ) > Add Function Alias For MOD/TRUNCT/POSITION >

[jira] [Updated] (SPARK-20754) Add Function Alias For MOD/TRUNCT/POSITION

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20754: Parent Issue: SPARK-20746 (was: SPARK-2076) > Add Function Alias For MOD/TRUNCT/POSITION >

[jira] [Updated] (SPARK-20754) Add Function Alias For MOD/TRUNCT/POSITION

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20754: Issue Type: Sub-task (was: Bug) Parent: SPARK-2076 > Add Function Alias For MOD/TRUNCT/POSITION >

[jira] [Updated] (SPARK-19238) Ignore sorting the edges if edges are sorted when building edge partition

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-19238: -- Fix Version/s: (was: 2.2.0) > Ignore sorting the edges if edges are sorted when

[jira] [Updated] (SPARK-20754) Add Function Alias For MOD/TRUNCT/POSITION

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20754: Summary: Add Function Alias For MOD/TRUNCT/POSITION (was: Add Function Alias For ) > Add Function Alias

[jira] [Created] (SPARK-20754) Add Function Alias For

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20754: --- Summary: Add Function Alias For Key: SPARK-20754 URL: https://issues.apache.org/jira/browse/SPARK-20754 Project: Spark Issue Type: Bug Components: SQL

[jira] [Deleted] (SPARK-20753) Build-in SQL Function Support - LOCALTIMESTAMP

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li deleted SPARK-20753: > Build-in SQL Function Support - LOCALTIMESTAMP > -- > >

[jira] [Updated] (SPARK-20752) Build-in SQL Function Support - SQRT

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20752: Summary: Build-in SQL Function Support - SQRT (was: Build-in SQL Function Support - SQUARE) > Build-in

[jira] [Updated] (SPARK-20752) Build-in SQL Function Support - SQUARE

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20752: Description: {noformat} SQRT() {noformat} Returns Power(, 2) was: {noformat} SQUARE() {noformat}

[jira] [Updated] (SPARK-20752) Build-in SQL Function Support - SQUARE

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20752: Summary: Build-in SQL Function Support - SQUARE (was: Build-in Function Support - SQUARE) > Build-in SQL

[jira] [Created] (SPARK-20753) Build-in SQL Function Support - LOCALTIMESTAMP

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20753: --- Summary: Build-in SQL Function Support - LOCALTIMESTAMP Key: SPARK-20753 URL: https://issues.apache.org/jira/browse/SPARK-20753 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-20752) Build-in Function Support - SQUARE

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20752: --- Summary: Build-in Function Support - SQUARE Key: SPARK-20752 URL: https://issues.apache.org/jira/browse/SPARK-20752 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-20751) Built-in SQL Function Support - COT

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20751: --- Summary: Built-in SQL Function Support - COT Key: SPARK-20751 URL: https://issues.apache.org/jira/browse/SPARK-20751 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-20750) Built-in SQL Function Support - REPLACE

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20750: Labels: starter (was: ) > Built-in SQL Function Support - REPLACE >

[jira] [Created] (SPARK-20750) Built-in SQL Function Support - REPLACE

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20750: --- Summary: Built-in SQL Function Support - REPLACE Key: SPARK-20750 URL: https://issues.apache.org/jira/browse/SPARK-20750 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-20748) Built-in SQL Function Support - CH[A]R

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20748: Summary: Built-in SQL Function Support - CH[A]R (was: Support CH[A]R) > Built-in SQL Function Support -

[jira] [Updated] (SPARK-20749) Built-in SQL Function Support - all variants of LEN[GTH]

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20749: Labels: starter (was: ) > Built-in SQL Function Support - all variants of LEN[GTH] >

[jira] [Created] (SPARK-20749) Built-in SQL Function Support - all variants of LEN[GTH]

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20749: --- Summary: Built-in SQL Function Support - all variants of LEN[GTH] Key: SPARK-20749 URL: https://issues.apache.org/jira/browse/SPARK-20749 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20748) Support CH[A]R

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20748: Description: {noformat} CH[A]R() {noformat} Returns a character when given its ASCII code. Ref:

[jira] [Created] (SPARK-20748) Support CH[A]R

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20748: --- Summary: Support CH[A]R Key: SPARK-20748 URL: https://issues.apache.org/jira/browse/SPARK-20748 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Updated] (SPARK-20748) Support CH[A]R

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20748: Labels: starter (was: ) > Support CH[A]R > -- > > Key: SPARK-20748 >

[jira] [Created] (SPARK-20747) Distinct in Aggregate Functions

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20747: --- Summary: Distinct in Aggregate Functions Key: SPARK-20747 URL: https://issues.apache.org/jira/browse/SPARK-20747 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-20746) Built-in SQL Function Improvement

2017-05-15 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20746: --- Summary: Built-in SQL Function Improvement Key: SPARK-20746 URL: https://issues.apache.org/jira/browse/SPARK-20746 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-20504) ML 2.2 QA: API: Java compatibility, docs

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011293#comment-16011293 ] Joseph K. Bradley commented on SPARK-20504: --- I found one issue: This won't pick up on methods

[jira] [Resolved] (SPARK-20735) Enable cross join in TPCDSQueryBenchmark

2017-05-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20735. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.2.0 2.1.2

[jira] [Commented] (SPARK-20589) Allow limiting task concurrency per stage

2017-05-15 Thread Amit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011024#comment-16011024 ] Amit Kumar commented on SPARK-20589: I can probably give more reference. This originally arose from

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20666: - Fix Version/s: (was: 2.2.1) (was: 2.3.0) 2.2.0 >

[jira] [Updated] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20666: - Affects Version/s: (was: 2.3.0) 2.2.0 > Flaky test - SparkListenerBus

[jira] [Issue Comment Deleted] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-20666: - Comment: was deleted (was: User 'shivaram' has created a pull request for this issue:

[jira] [Resolved] (SPARK-20716) StateStore.abort() should not throw further exception

2017-05-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20716. -- Resolution: Fixed > StateStore.abort() should not throw further exception >

[jira] [Assigned] (SPARK-17729) Enable creating hive bucketed tables

2017-05-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-17729: --- Assignee: Tejas Patil > Enable creating hive bucketed tables >

[jira] [Resolved] (SPARK-20717) Tweak MapGroupsWithState update function behavior

2017-05-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-20717. -- Resolution: Fixed > Tweak MapGroupsWithState update function behavior >

[jira] [Resolved] (SPARK-17729) Enable creating hive bucketed tables

2017-05-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17729. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 17644

[jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-05-15 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010967#comment-16010967 ] Reynold Xin commented on SPARK-12297: - Can you clarify what you mean that with other formats (e.g.

[jira] [Commented] (SPARK-11034) Launcher: add support for monitoring Mesos apps

2017-05-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010930#comment-16010930 ] Marcelo Vanzin commented on SPARK-11034: It's up for someone interested in supporting this on

[jira] [Commented] (SPARK-11034) Launcher: add support for monitoring Mesos apps

2017-05-15 Thread Avinash Venkateshaiah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010927#comment-16010927 ] Avinash Venkateshaiah commented on SPARK-11034: --- Is there any plan to support this ? >

[jira] [Commented] (SPARK-20501) ML, Graph 2.2 QA: API: New Scala APIs, docs

2017-05-15 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010914#comment-16010914 ] Joseph K. Bradley commented on SPARK-20501: --- Also: * {{LinearSVC}} * {{AssociationRules}} *

[jira] [Resolved] (SPARK-20666) Flaky test - SparkListenerBus randomly failing java.lang.IllegalAccessError

2017-05-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20666. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20742) SparkAppHandle.getState() doesnt return the right state when the launch is done on a mesos master in cluster mode

2017-05-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20742. Resolution: Duplicate > SparkAppHandle.getState() doesnt return the right state when the

[jira] [Commented] (SPARK-18922) Fix more resource-closing-related and path-related test failures in identified ones on Windows

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010748#comment-16010748 ] Apache Spark commented on SPARK-18922: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-19707) Improve the invalid path check for sc.addJar

2017-05-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010747#comment-16010747 ] Apache Spark commented on SPARK-19707: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-20744) Predicates with multiple columns do not work

2017-05-15 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated SPARK-20744: Description: The following code reproduces the problem: {code} scala>

[jira] [Commented] (SPARK-18359) Let user specify locale in CSV parsing

2017-05-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010709#comment-16010709 ] Sean Owen commented on SPARK-18359: --- This behavior was not correct, or at least more problematic,

[jira] [Commented] (SPARK-18359) Let user specify locale in CSV parsing

2017-05-15 Thread Alexander Enns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010704#comment-16010704 ] Alexander Enns commented on SPARK-18359: IMHO the changes done for SPARK-18076 need to be

[jira] [Resolved] (SPARK-20669) LogisticRegression family should be case insensitive

2017-05-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-20669. - Resolution: Fixed Fix Version/s: 2.2.0 > LogisticRegression family should be case

[jira] [Assigned] (SPARK-20669) LogisticRegression family should be case insensitive

2017-05-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-20669: --- Assignee: zhengruifeng > LogisticRegression family should be case insensitive >

[jira] [Comment Edited] (SPARK-20740) Expose UserDefinedType make sure could extends it

2017-05-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010477#comment-16010477 ] Hyukjin Kwon edited comment on SPARK-20740 at 5/15/17 2:57 PM: --- Probably,

[jira] [Created] (SPARK-20745) Data gets wrongly copied from one row to others, possibly related to named structs

2017-05-15 Thread Martin Mauch (JIRA)
Martin Mauch created SPARK-20745: Summary: Data gets wrongly copied from one row to others, possibly related to named structs Key: SPARK-20745 URL: https://issues.apache.org/jira/browse/SPARK-20745

[jira] [Comment Edited] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2017-05-15 Thread Peter Halverson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010621#comment-16010621 ] Peter Halverson edited comment on SPARK-18004 at 5/15/17 2:37 PM: --

[jira] [Commented] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2017-05-15 Thread Peter Halverson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010621#comment-16010621 ] Peter Halverson commented on SPARK-18004: - Here's the culprit, a private function that converts a

[jira] [Updated] (SPARK-20742) SparkAppHandle.getState() doesnt return the right state when the launch is done on a mesos master in cluster mode

2017-05-15 Thread Avinash Venkateshaiah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avinash Venkateshaiah updated SPARK-20742: -- Affects Version/s: 2.1.0 > SparkAppHandle.getState() doesnt return the right

  1   2   >