[jira] [Commented] (SPARK-13721) Add support for LATERAL VIEW OUTER explode()

2016-09-05 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464427#comment-15464427 ] Ewan Leith commented on SPARK-13721: Assuming Don's use case is the same as ours, we have to do odd

[jira] [Commented] (SPARK-17313) Support spark-shell on cluster mode

2016-08-30 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450194#comment-15450194 ] Ewan Leith commented on SPARK-17313: I think Apache Zeppelin and Spark Notebook both cover this

[jira] [Commented] (SPARK-17099) Incorrect result when HAVING clause is added to group by query

2016-08-17 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424277#comment-15424277 ] Ewan Leith commented on SPARK-17099: I've done a quick test in Spark 1.6.1 and this produces the

[jira] [Commented] (SPARK-16363) Spark-submit doesn't work with IAM Roles

2016-07-05 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363249#comment-15363249 ] Ewan Leith commented on SPARK-16363: I'm not sure this is a major issue, but try running with the

[jira] [Created] (SPARK-13623) Relaxed mode for querying Dataframes, so columns that don't exist or have an incompatible schema return null rather than error

2016-03-02 Thread Ewan Leith (JIRA)
Ewan Leith created SPARK-13623: -- Summary: Relaxed mode for querying Dataframes, so columns that don't exist or have an incompatible schema return null rather than error Key: SPARK-13623 URL:

[jira] [Comment Edited] (SPARK-12764) XML Column type is not supported

2016-01-12 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093836#comment-15093836 ] Ewan Leith edited comment on SPARK-12764 at 1/12/16 12:53 PM: -- What are you

[jira] [Commented] (SPARK-12764) XML Column type is not supported

2016-01-12 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093836#comment-15093836 ] Ewan Leith commented on SPARK-12764: What are you expecting it to do, output the XML as a string, or

[jira] [Comment Edited] (SPARK-12764) XML Column type is not supported

2016-01-12 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093836#comment-15093836 ] Ewan Leith edited comment on SPARK-12764 at 1/12/16 12:57 PM: -- What are you

[jira] [Commented] (SPARK-11948) Permanent UDF not work

2015-12-14 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056155#comment-15056155 ] Ewan Leith commented on SPARK-11948: I think this is a duplicate of SPARK-11609 ? > Permanent UDF

[jira] [Created] (SPARK-10947) With schema inference from JSON into a Dataframe, add option to infer all primitive object types as strings

2015-10-06 Thread Ewan Leith (JIRA)
Ewan Leith created SPARK-10947: -- Summary: With schema inference from JSON into a Dataframe, add option to infer all primitive object types as strings Key: SPARK-10947 URL:

[jira] [Created] (SPARK-10419) Add SQLServer JdbcDialect support for datetimeoffset types

2015-09-02 Thread Ewan Leith (JIRA)
Ewan Leith created SPARK-10419: -- Summary: Add SQLServer JdbcDialect support for datetimeoffset types Key: SPARK-10419 URL: https://issues.apache.org/jira/browse/SPARK-10419 Project: Spark Issue

[jira] [Created] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-18 Thread Ewan Leith (JIRA)
Ewan Leith created SPARK-8437: - Summary: Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles Key: SPARK-8437 URL:

[jira] [Commented] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-18 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591615#comment-14591615 ] Ewan Leith commented on SPARK-8437: --- Thanks, I wasn't sure if it was Hadoop or Spark

[jira] [Comment Edited] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-18 Thread Ewan Leith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591615#comment-14591615 ] Ewan Leith edited comment on SPARK-8437 at 6/18/15 10:51 AM: -