[jira] [Updated] (SPARK-22449) Add BIC for GLM

[ https://issues.apache.org/jira/browse/SPARK-22449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Peng updated SPARK-22449: -- Description: Currently, we only have AIC for GLM. BIC is another "similar" criterion widely used and

[jira] [Resolved] (SPARK-22378) Redundant nullcheck is generated for extracting value in complex types

[ https://issues.apache.org/jira/browse/SPARK-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22378. - Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.3.0 > Redundant nullcheck

[jira] [Resolved] (SPARK-22211) LimitPushDown optimization for FullOuterJoin generates wrong results

[ https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22211. - Resolution: Fixed Assignee: Henry Robinson Fix Version/s: 2.3.0 2.2.1

[jira] [Created] (SPARK-22449) Add BIC for GLM

Teng Peng created SPARK-22449: - Summary: Add BIC for GLM Key: SPARK-22449 URL: https://issues.apache.org/jira/browse/SPARK-22449 Project: Spark Issue Type: Improvement Components: ML

[jira] [Commented] (SPARK-18755) Add Randomized Grid Search to Spark ML

[ https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239389#comment-16239389 ] Teng Peng commented on SPARK-18755: --- [~yuhaoyan] Is this what you are looking for: after we build the

[jira] [Commented] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239312#comment-16239312 ] Hongbo commented on SPARK-22443: In our case, we want to map MySQL YEAR to ShortType instead of DateType.

[jira] [Commented] (SPARK-22441) JDBC REAL type is mapped to Double instead of Float

[ https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239275#comment-16239275 ] Tor Myklebust commented on SPARK-22441: --- > In MySQL, even desc a table with a column defined as

[jira] [Comment Edited] (SPARK-22441) JDBC REAL type is mapped to Double instead of Float

[ https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239143#comment-16239143 ] Hongbo edited comment on SPARK-22441 at 11/4/17 6:21 PM: - I also noticed that

[jira] [Commented] (SPARK-22441) JDBC REAL type is mapped to Double instead of Float

[ https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239143#comment-16239143 ] Hongbo commented on SPARK-22441: I also noticed that JDBC FLOAT maps to FloatType. I think it should map

[jira] [Resolved] (SPARK-22411) Heuristic to combine splits in DataSourceScanExec isn't accurate when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22411. - Resolution: Fixed Assignee: Vinitha Reddy Gankidi Fix Version/s: 2.3.0 > Heuristic to

[jira] [Reopened] (SPARK-22411) Heuristic to combine splits in DataSourceScanExec isn't accurate when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-22411: - > Heuristic to combine splits in DataSourceScanExec isn't accurate when dynamic > allocation is enabled >

[jira] [Resolved] (SPARK-22412) Fix incorrect comment in DataSourceScanExec

[ https://issues.apache.org/jira/browse/SPARK-22412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22412. - Resolution: Fixed Assignee: Vinitha Reddy Gankidi Fix Version/s: 2.3.0 > Fix incorrect

[jira] [Commented] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239133#comment-16239133 ] Sean Owen commented on SPARK-22443: --- The semantics here are already odd. The methods might return

[jira] [Commented] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239097#comment-16239097 ] Hongbo commented on SPARK-22443: [~srowen] Thanks for the quick response! I think returning the first

[jira] [Commented] (SPARK-22441) JDBC REAL type is mapped to Double instead of Float

[ https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239063#comment-16239063 ] Tor Myklebust commented on SPARK-22441: --- I don't know. I'm not clear on what that code is used

[jira] [Created] (SPARK-22448) Add functions like Mode(), NumNulls(), etc. in Summarizer

Abdeali Kothari created SPARK-22448: --- Summary: Add functions like Mode(), NumNulls(), etc. in Summarizer Key: SPARK-22448 URL: https://issues.apache.org/jira/browse/SPARK-22448 Project: Spark

[jira] [Commented] (SPARK-22447) SAS reading functionality

[ https://issues.apache.org/jira/browse/SPARK-22447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239019#comment-16239019 ] Sean Owen commented on SPARK-22447: --- Why would this need to be in Spark? > SAS reading functionality >

[jira] [Assigned] (SPARK-19668) Multiple NGram sizes

[ https://issues.apache.org/jira/browse/SPARK-19668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19668: Assignee: Apache Spark > Multiple NGram sizes > > >

[jira] [Assigned] (SPARK-19668) Multiple NGram sizes

[ https://issues.apache.org/jira/browse/SPARK-19668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19668: Assignee: (was: Apache Spark) > Multiple NGram sizes > > >

[jira] [Commented] (SPARK-19668) Multiple NGram sizes

[ https://issues.apache.org/jira/browse/SPARK-19668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239013#comment-16239013 ] Apache Spark commented on SPARK-19668: -- User 'mpetruska' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22410) Excessive spill for Pyspark UDF when a row has shrunk

[ https://issues.apache.org/jira/browse/SPARK-22410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22410. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19642

[jira] [Assigned] (SPARK-22410) Excessive spill for Pyspark UDF when a row has shrunk

[ https://issues.apache.org/jira/browse/SPARK-22410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22410: --- Assignee: Liang-Chi Hsieh > Excessive spill for Pyspark UDF when a row has shrunk >

[jira] [Created] (SPARK-22447) SAS reading functionality

Abdeali Kothari created SPARK-22447: --- Summary: SAS reading functionality Key: SPARK-22447 URL: https://issues.apache.org/jira/browse/SPARK-22447 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-22423) Scala test source files like TestHiveSingleton.scala should be in scala source root

[ https://issues.apache.org/jira/browse/SPARK-22423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22423: - Assignee: xubo245 > Scala test source files like TestHiveSingleton.scala should be in scala >

[jira] [Resolved] (SPARK-22423) Scala test source files like TestHiveSingleton.scala should be in scala source root

[ https://issues.apache.org/jira/browse/SPARK-22423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22423. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19639

[jira] [Commented] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238858#comment-16238858 ] Apache Spark commented on SPARK-22443: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22443: Assignee: Apache Spark > AggregatedDialect doesn't override quoteIdentifier and other

[jira] [Assigned] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22443: Assignee: (was: Apache Spark) > AggregatedDialect doesn't override quoteIdentifier

[jira] [Commented] (SPARK-22441) JDBC REAL type is mapped to Double instead of Float

[ https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238844#comment-16238844 ] Sean Owen commented on SPARK-22441: --- That's great info. The current mapping is, I think, more natural,

[jira] [Commented] (SPARK-22344) Prevent R CMD check from using /tmp

[ https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238843#comment-16238843 ] Apache Spark commented on SPARK-22344: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-22437) jdbc write fails to set default mode

[ https://issues.apache.org/jira/browse/SPARK-22437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22437: Assignee: Marco Gaido > jdbc write fails to set default mode >

[jira] [Resolved] (SPARK-22437) jdbc write fails to set default mode

[ https://issues.apache.org/jira/browse/SPARK-22437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22437. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19654

[jira] [Resolved] (SPARK-22254) clean up the implementation of `growToSize` in CompactBuffer

[ https://issues.apache.org/jira/browse/SPARK-22254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22254. - Resolution: Fixed Fix Version/s: 2.3.0 > clean up the implementation of `growToSize` in

[jira] [Assigned] (SPARK-22254) clean up the implementation of `growToSize` in CompactBuffer

[ https://issues.apache.org/jira/browse/SPARK-22254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-22254: --- Assignee: Kazuaki Ishizaki > clean up the implementation of `growToSize` in CompactBuffer >