[jira] [Created] (SPARK-17207) Comparing Vector in relative tolerance or absolute tolerance in UnitTests error

2016-08-23 Thread Peng Meng (JIRA)
Peng Meng created SPARK-17207: - Summary: Comparing Vector in relative tolerance or absolute tolerance in UnitTests error Key: SPARK-17207 URL: https://issues.apache.org/jira/browse/SPARK-17207 Project:

[jira] [Commented] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434195#comment-15434195 ] Hyukjin Kwon commented on SPARK-17174: -- [~cloud_fan] I realised that {{Ruturns date ...}} might

[jira] [Commented] (SPARK-17198) ORC fixed char literal filter does not work

2016-08-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434191#comment-15434191 ] Dongjoon Hyun commented on SPARK-17198: --- Hi, [~tuming]. The reported error scenario in HIVE-11312

[jira] [Commented] (SPARK-17167) Issue Exceptions when Analyze Table on In-Memory Cataloged Tables

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434181#comment-15434181 ] Apache Spark commented on SPARK-17167: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-3162) Train DecisionTree locally when possible

2016-08-23 Thread Siddharth Murching (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434154#comment-15434154 ] Siddharth Murching commented on SPARK-3162: --- Here's a design doc with proposed changes - any

[jira] [Closed] (SPARK-16822) Support latex in scaladoc with MathJax

2016-08-23 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S closed SPARK-16822. -- Resolution: Fixed > Support latex in scaladoc with MathJax >

[jira] [Commented] (SPARK-17206) Support ANALYZE TABLE on analyzable temoprary table/view

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434131#comment-15434131 ] Apache Spark commented on SPARK-17206: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17206) Support ANALYZE TABLE on analyzable temoprary table/view

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17206: Assignee: Apache Spark > Support ANALYZE TABLE on analyzable temoprary table/view >

[jira] [Assigned] (SPARK-17206) Support ANALYZE TABLE on analyzable temoprary table/view

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17206: Assignee: (was: Apache Spark) > Support ANALYZE TABLE on analyzable temoprary

[jira] [Created] (SPARK-17206) Support ANALYZE TABLE on analyzable temoprary table/view

2016-08-23 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-17206: --- Summary: Support ANALYZE TABLE on analyzable temoprary table/view Key: SPARK-17206 URL: https://issues.apache.org/jira/browse/SPARK-17206 Project: Spark

[jira] [Updated] (SPARK-6235) Address various 2G limits

2016-08-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-6235: --- Attachment: SPARK-6235_Design_V0.01.pdf Preliminary Design Document. > Address various 2G limits >

[jira] [Issue Comment Deleted] (SPARK-3162) Train DecisionTree locally when possible

2016-08-23 Thread Siddharth Murching (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Murching updated SPARK-3162: -- Comment: was deleted (was: Here's a design doc with proposed changes - any

[jira] [Commented] (SPARK-17201) Investigate numerical instability for MLOR without regularization

2016-08-23 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434073#comment-15434073 ] Weichen Xu commented on SPARK-17201: yeah, you are right... I search some proof for this such as

[jira] [Resolved] (SPARK-16862) Configurable buffer size in `UnsafeSorterSpillReader`

2016-08-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16862. - Resolution: Fixed Assignee: Tejas Patil Fix Version/s: 2.1.0 > Configurable

[jira] [Assigned] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17174: Assignee: Apache Spark > Provide support for Timestamp type Column in add_months function

[jira] [Commented] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434038#comment-15434038 ] Apache Spark commented on SPARK-17174: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17174: Assignee: (was: Apache Spark) > Provide support for Timestamp type Column in

[jira] [Comment Edited] (SPARK-3162) Train DecisionTree locally when possible

2016-08-23 Thread Siddharth Murching (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434031#comment-15434031 ] Siddharth Murching edited comment on SPARK-3162 at 8/24/16 1:37 AM:

[jira] [Comment Edited] (SPARK-3162) Train DecisionTree locally when possible

2016-08-23 Thread Siddharth Murching (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434031#comment-15434031 ] Siddharth Murching edited comment on SPARK-3162 at 8/24/16 1:37 AM:

[jira] [Comment Edited] (SPARK-3162) Train DecisionTree locally when possible

2016-08-23 Thread Siddharth Murching (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434031#comment-15434031 ] Siddharth Murching edited comment on SPARK-3162 at 8/24/16 1:37 AM:

[jira] [Commented] (SPARK-3162) Train DecisionTree locally when possible

2016-08-23 Thread Siddharth Murching (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434031#comment-15434031 ] Siddharth Murching commented on SPARK-3162: --- Here's a design doc with proposed changes - any

[jira] [Commented] (SPARK-16581) Making JVM backend calling functions public

2016-08-23 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434030#comment-15434030 ] Xusen Yin commented on SPARK-16581: --- Sure, no problem. > Making JVM backend calling functions public >

[jira] [Assigned] (SPARK-17205) Literal.sql does not properly convert NaN and Infinity literals

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17205: Assignee: Josh Rosen (was: Apache Spark) > Literal.sql does not properly convert NaN and

[jira] [Commented] (SPARK-17205) Literal.sql does not properly convert NaN and Infinity literals

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433962#comment-15433962 ] Apache Spark commented on SPARK-17205: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17205) Literal.sql does not properly convert NaN and Infinity literals

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17205: Assignee: Apache Spark (was: Josh Rosen) > Literal.sql does not properly convert NaN and

[jira] [Updated] (SPARK-17205) Literal.sql does not properly convert NaN and Infinity literals

2016-08-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17205: --- Description: {{Literal.sql}} mishandles NaN and Infinity literals: the handling of these needs to be

[jira] [Created] (SPARK-17205) Literal.sql does not properly convert NaN and Infinity literals

2016-08-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-17205: -- Summary: Literal.sql does not properly convert NaN and Infinity literals Key: SPARK-17205 URL: https://issues.apache.org/jira/browse/SPARK-17205 Project: Spark

[jira] [Updated] (SPARK-17204) Spark 2.0 off heap RDD persistence with replication factor 2 leads to in-memory data corruption

2016-08-23 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-17204: --- Summary: Spark 2.0 off heap RDD persistence with replication factor 2 leads to in-memory

[jira] [Updated] (SPARK-17204) Spark 2.0 off heap RDD persistence with replication factor 2 leads to data corruption

2016-08-23 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-17204: --- Description: We use the OFF_HEAP storage level extensively. We've tried off-heap storage

[jira] [Commented] (SPARK-17204) Spark 2.0 off heap RDD persistence with replication factor 2 leads to data corruption

2016-08-23 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433878#comment-15433878 ] Michael Allman commented on SPARK-17204: [~rxin] I rebuilt from master as of commit

[jira] [Commented] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433849#comment-15433849 ] Herman van Hovell commented on SPARK-17099: --- A small update. Disregard my previous diagnoses.

[jira] [Commented] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433833#comment-15433833 ] Herman van Hovell commented on SPARK-17120: --- PR https://github.com/apache/spark/pull/14661

[jira] [Comment Edited] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433780#comment-15433780 ] Herman van Hovell edited comment on SPARK-17120 at 8/23/16 11:02 PM: -

[jira] [Comment Edited] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433780#comment-15433780 ] Herman van Hovell edited comment on SPARK-17120 at 8/23/16 11:01 PM: -

[jira] [Commented] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433780#comment-15433780 ] Herman van Hovell commented on SPARK-17120: --- TL;DR the {{PushDownPredicate}} rule pushed the

[jira] [Comment Edited] (SPARK-17201) Investigate numerical instability for MLOR without regularization

2016-08-23 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433754#comment-15433754 ] Seth Hendrickson edited comment on SPARK-17201 at 8/23/16 10:24 PM:

[jira] [Commented] (SPARK-17201) Investigate numerical instability for MLOR without regularization

2016-08-23 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433754#comment-15433754 ] Seth Hendrickson commented on SPARK-17201: -- Restating some of what was said on github: _Concern

[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433739#comment-15433739 ] Hyukjin Kwon commented on SPARK-17200: -- Thank you so much! > Automate building and testing on

[jira] [Updated] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

2016-08-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17099: --- Priority: Blocker (was: Critical) > Incorrect result when HAVING clause is added to group by query

[jira] [Updated] (SPARK-17120) Analyzer incorrectly optimizes plan to empty LocalRelation

2016-08-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17120: --- Target Version/s: 2.0.1, 2.1.0 (was: 2.1.0) > Analyzer incorrectly optimizes plan to empty

[jira] [Resolved] (SPARK-17194) When emitting SQL for string literals Spark should use single quotes, not double

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17194. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > When

[jira] [Commented] (SPARK-16581) Making JVM backend calling functions public

2016-08-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433492#comment-15433492 ] Shivaram Venkataraman commented on SPARK-16581: --- [~yinxusen] I created a PR for this as we

[jira] [Commented] (SPARK-16581) Making JVM backend calling functions public

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433479#comment-15433479 ] Apache Spark commented on SPARK-16581: -- User 'shivaram' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16581) Making JVM backend calling functions public

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16581: Assignee: (was: Apache Spark) > Making JVM backend calling functions public >

[jira] [Assigned] (SPARK-16581) Making JVM backend calling functions public

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16581: Assignee: Apache Spark > Making JVM backend calling functions public >

[jira] [Resolved] (SPARK-16508) Fix documentation warnings found by R CMD check

2016-08-23 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16508. --- Resolution: Fixed Assignee: Junyang Qian Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-17204) Spark 2.0 off heap RDD persistence with replication factor 2 leads to data corruption

2016-08-23 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433408#comment-15433408 ] Michael Allman commented on SPARK-17204: [~rxin] I'll give it a try. Thanks for the heads up. I

[jira] [Commented] (SPARK-17204) Spark 2.0 off heap RDD persistence with replication factor 2 leads to data corruption

2016-08-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433394#comment-15433394 ] Reynold Xin commented on SPARK-17204: - Does this problem still exist on today's master/branch-2.0?

[jira] [Commented] (SPARK-5928) Remote Shuffle Blocks cannot be more than 2 GB

2016-08-23 Thread yeshwanth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1541#comment-1541 ] yeshwanth commented on SPARK-5928: -- i ran into this issue in a production job,

[jira] [Comment Edited] (SPARK-14560) Cooperative Memory Management for Spillables

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433210#comment-15433210 ] Sean Owen edited comment on SPARK-14560 at 8/23/16 5:11 PM: I have a few

[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433209#comment-15433209 ] Dongjoon Hyun commented on SPARK-17200: --- Hi, [~hyukjin.kwon]. FYI, for Window CI, there is

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433210#comment-15433210 ] Sean Owen commented on SPARK-14560: --- I have a few somewhat-specific additional data points: More

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-08-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433200#comment-15433200 ] Davies Liu commented on SPARK-14560: Even with SPARK-4452, we still can not say that we fixed the OOM

[jira] [Resolved] (SPARK-13286) JDBC driver doesn't report full exception

2016-08-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13286. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Created] (SPARK-17204) Spark 2.0 off heap RDD persistence with replication factor 2 leads to data corruption

2016-08-23 Thread Michael Allman (JIRA)
Michael Allman created SPARK-17204: -- Summary: Spark 2.0 off heap RDD persistence with replication factor 2 leads to data corruption Key: SPARK-17204 URL: https://issues.apache.org/jira/browse/SPARK-17204

[jira] [Updated] (SPARK-17204) Spark 2.0 off heap RDD persistence with replication factor 2 leads to data corruption

2016-08-23 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-17204: --- Description: We use the OFF_HEAP storage level extensively. We've tried off-heap storage

[jira] [Assigned] (SPARK-17203) data source options should always be case insensitive

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17203: Assignee: Wenchen Fan (was: Apache Spark) > data source options should always be case

[jira] [Assigned] (SPARK-17203) data source options should always be case insensitive

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17203: Assignee: Apache Spark (was: Wenchen Fan) > data source options should always be case

[jira] [Commented] (SPARK-17203) data source options should always be case insensitive

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433005#comment-15433005 ] Apache Spark commented on SPARK-17203: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-17202) "Pipeline guide" link is broken in MLlib Guide main page

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17202. --- Resolution: Duplicate Yep, though this was already fixed in master. The next release docs would

[jira] [Created] (SPARK-17203) data source options should always be case insensitive

2016-08-23 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-17203: --- Summary: data source options should always be case insensitive Key: SPARK-17203 URL: https://issues.apache.org/jira/browse/SPARK-17203 Project: Spark Issue

[jira] [Created] (SPARK-17202) "Pipeline guide" link is broken in MLlib Guide main page

2016-08-23 Thread Vitalii Kotliarenko (JIRA)
Vitalii Kotliarenko created SPARK-17202: --- Summary: "Pipeline guide" link is broken in MLlib Guide main page Key: SPARK-17202 URL: https://issues.apache.org/jira/browse/SPARK-17202 Project: Spark

[jira] [Created] (SPARK-17201) Investigate numerical instability for MLOR without regularization

2016-08-23 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-17201: Summary: Investigate numerical instability for MLOR without regularization Key: SPARK-17201 URL: https://issues.apache.org/jira/browse/SPARK-17201 Project:

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-08-23 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432883#comment-15432883 ] Imran Rashid commented on SPARK-14560: -- One minor clarification -- SPARK-4452 is not included in

[jira] [Commented] (SPARK-17126) Errors setting driver classpath in spark-defaults.conf on Windows 7

2016-08-23 Thread Ozioma Ihekwoaba (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432767#comment-15432767 ] Ozioma Ihekwoaba commented on SPARK-17126: -- It works, all my jars get listed in the Spark Web

[jira] [Commented] (SPARK-17126) Errors setting driver classpath in spark-defaults.conf on Windows 7

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432715#comment-15432715 ] Sean Owen commented on SPARK-17126: --- Hm, I am not sure that "*" works on any JVM. Maybe I'm missing a

[jira] [Comment Edited] (SPARK-17126) Errors setting driver classpath in spark-defaults.conf on Windows 7

2016-08-23 Thread Ozioma Ihekwoaba (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432707#comment-15432707 ] Ozioma Ihekwoaba edited comment on SPARK-17126 at 8/23/16 12:32 PM:

[jira] [Commented] (SPARK-17126) Errors setting driver classpath in spark-defaults.conf on Windows 7

2016-08-23 Thread Ozioma Ihekwoaba (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432707#comment-15432707 ] Ozioma Ihekwoaba commented on SPARK-17126: -- Hi Sean, Thanks for the update. What I meant was the

[jira] [Resolved] (SPARK-17126) Errors setting driver classpath in spark-defaults.conf on Windows 7

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17126. --- Resolution: Not A Problem You said, "Yes the entries make it to the classpath, I checked up on the

[jira] [Updated] (SPARK-17095) Latex and Scala doc do not play nicely

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17095: -- Assignee: Jagadeesan A S Priority: Trivial (was: Minor) The net change here was slightly

[jira] [Resolved] (SPARK-17095) Latex and Scala doc do not play nicely

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17095. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14688

[jira] [Resolved] (SPARK-17199) Use CatalystConf.resolver for case-sensitivity comparison

2016-08-23 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17199. --- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 2.1.0 >

[jira] [Comment Edited] (SPARK-17055) add labelKFold to CrossValidator

2016-08-23 Thread Vincent (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432463#comment-15432463 ] Vincent edited comment on SPARK-17055 at 8/23/16 10:34 AM: --- sorry for late

[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432521#comment-15432521 ] Hyukjin Kwon commented on SPARK-17200: -- Maybe, I will try to do this and I guess this will be done

[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432511#comment-15432511 ] Sean Owen commented on SPARK-17200: --- Without a doubt that would be beneficial. The question is how much

[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432508#comment-15432508 ] Hyukjin Kwon commented on SPARK-17200: -- cc [~felixcheung] and [~shivaram] who might be interested in

[jira] [Commented] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432504#comment-15432504 ] Hyukjin Kwon commented on SPARK-17200: -- Could I please ask your opinion [~srowen]? I know you are an

[jira] [Commented] (SPARK-17174) Provide support for Timestamp type Column in add_months function to return HH:mm:ss

2016-08-23 Thread Amit Baghel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432503#comment-15432503 ] Amit Baghel commented on SPARK-17174: - Please go ahead and submit PR. Thanks > Provide support for

[jira] [Updated] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17200: - Description: It seems there is no automated tests on Windows (I am not sure this is being done

[jira] [Created] (SPARK-17200) Automate building and testing on Windows

2016-08-23 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-17200: Summary: Automate building and testing on Windows Key: SPARK-17200 URL: https://issues.apache.org/jira/browse/SPARK-17200 Project: Spark Issue Type: Test

[jira] [Comment Edited] (SPARK-17055) add labelKFold to CrossValidator

2016-08-23 Thread Vincent (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432463#comment-15432463 ] Vincent edited comment on SPARK-17055 at 8/23/16 9:18 AM: -- sorry for late reply.

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-08-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432470#comment-15432470 ] holdenk commented on SPARK-12072: - My guess is probably not a directly related issue - your OOM from

[jira] [Commented] (SPARK-9004) Add s3 bytes read/written metrics

2016-08-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432462#comment-15432462 ] Steve Loughran commented on SPARK-9004: --- If you know the filesystem, you can get summary stats from

[jira] [Commented] (SPARK-17055) add labelKFold to CrossValidator

2016-08-23 Thread Vincent (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432463#comment-15432463 ] Vincent commented on SPARK-17055: - sorry for late reply. Yes, I just knew they intend to rename it to

[jira] [Commented] (SPARK-12072) python dataframe ._jdf.schema().json() breaks on large metadata dataframes

2016-08-23 Thread Ben Teeuwen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432459#comment-15432459 ] Ben Teeuwen commented on SPARK-12072: - [~holdenk] we haven't been able to test the patch above (yet).

[jira] [Commented] (SPARK-10297) When save data to a data source table, we should bound the size of a saved file

2016-08-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432435#comment-15432435 ] Steve Loughran commented on SPARK-10297: FWIW, S3 and the S3a doesn't have a size limit any more

[jira] [Commented] (SPARK-15965) No FileSystem for scheme: s3n or s3a spark-2.0.0 and spark-1.6.1

2016-08-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432432#comment-15432432 ] Steve Loughran commented on SPARK-15965: This is being fixed with tests in my work in SPARK-7481;

[jira] [Commented] (SPARK-17055) add labelKFold to CrossValidator

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432427#comment-15432427 ] Sean Owen commented on SPARK-17055: --- >From a comment in the PR, I get it. This is not actually about

[jira] [Commented] (SPARK-16363) Spark-submit doesn't work with IAM Roles

2016-08-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432421#comment-15432421 ] Steve Loughran commented on SPARK-16363: S3A uses

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432406#comment-15432406 ] Sean Owen commented on SPARK-14560: --- Even with the fix for SPARK-4452, I observed a problem like what's

[jira] [Commented] (SPARK-17199) Use CatalystConf.resolver for case-sensitivity comparison

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432363#comment-15432363 ] Apache Spark commented on SPARK-17199: -- User 'jaceklaskowski' has created a pull request for this

[jira] [Assigned] (SPARK-17199) Use CatalystConf.resolver for case-sensitivity comparison

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17199: Assignee: (was: Apache Spark) > Use CatalystConf.resolver for case-sensitivity

[jira] [Assigned] (SPARK-17199) Use CatalystConf.resolver for case-sensitivity comparison

2016-08-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17199: Assignee: Apache Spark > Use CatalystConf.resolver for case-sensitivity comparison >

[jira] [Created] (SPARK-17199) Use CatalystConf.resolver for case-sensitivity comparison

2016-08-23 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-17199: --- Summary: Use CatalystConf.resolver for case-sensitivity comparison Key: SPARK-17199 URL: https://issues.apache.org/jira/browse/SPARK-17199 Project: Spark

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

2016-08-23 Thread Jason Moore (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432314#comment-15432314 ] Jason Moore commented on SPARK-17195: - That's right. The JDBC API has ResultSetMetaData.isNullable

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

2016-08-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432299#comment-15432299 ] Sean Owen commented on SPARK-17195: --- Got it. Is there really value in a third state? If something is

[jira] [Commented] (SPARK-17195) Dealing with JDBC column nullability when it is not reliable

2016-08-23 Thread Jason Moore (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432285#comment-15432285 ] Jason Moore commented on SPARK-17195: - Correct, currently Spark doesn't allow us to override what the

[jira] [Commented] (SPARK-17082) Replace ByteBuffer with ChunkedByteBuffer

2016-08-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432284#comment-15432284 ] Guoqiang Li commented on SPARK-17082: - OK > Replace ByteBuffer with ChunkedByteBuffer >

[jira] [Commented] (SPARK-17184) Replace ByteBuf with InputStream

2016-08-23 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432279#comment-15432279 ] Guoqiang Li commented on SPARK-17184: - ok > Replace ByteBuf with InputStream >

[jira] [Closed] (SPARK-16659) use Maven project to submit spark application via yarn-client

2016-08-23 Thread Jagadeesan A S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadeesan A S closed SPARK-16659. -- Resolution: Not A Problem > use Maven project to submit spark application via yarn-client >

  1   2   >