[jira] [Updated] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9735: -- Assignee: Cheng Hao (was: Cheng Lian) Auto infer partition schema of HadoopFsRelation should should

[jira] [Updated] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-08-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9735: -- Shepherd: Cheng Lian Auto infer partition schema of HadoopFsRelation should should respected the

[jira] [Updated] (SPARK-10155) Memory leak in SQL parsers

2015-08-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10155: Assignee: Shixiong Zhu Target Version/s: 1.5.0 Memory leak in SQL parsers

[jira] [Commented] (SPARK-10155) Memory leak in SQL parsers

2015-08-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707914#comment-14707914 ] Reynold Xin commented on SPARK-10155: - cc [~marmbrus] on this too Memory leak in

[jira] [Commented] (SPARK-10155) Memory leak in SQL parsers

2015-08-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14707913#comment-14707913 ] Reynold Xin commented on SPARK-10155: - not blocker since it was in 1.4. But I will

[jira] [Assigned] (SPARK-10168) Streaming assembly jars doesn't publish correctly

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10168: Assignee: Apache Spark (was: Shixiong Zhu) Streaming assembly jars doesn't publish

[jira] [Assigned] (SPARK-10168) Streaming assembly jars doesn't publish correctly

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10168: Assignee: Shixiong Zhu (was: Apache Spark) Streaming assembly jars doesn't publish

[jira] [Commented] (SPARK-10168) Streaming assembly jars doesn't publish correctly

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708050#comment-14708050 ] Apache Spark commented on SPARK-10168: -- User 'zsxwing' has created a pull request

[jira] [Comment Edited] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Jaka Jancar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708175#comment-14708175 ] Jaka Jancar edited comment on SPARK-10171 at 8/22/15 9:03 PM:

[jira] [Commented] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Jaka Jancar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708175#comment-14708175 ] Jaka Jancar commented on SPARK-10171: - You can start a task via a HTTP in a

[jira] [Commented] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Jaka Jancar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708188#comment-14708188 ] Jaka Jancar commented on SPARK-10171: - Oh sure, we have no problems running Spark

[jira] [Commented] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708174#comment-14708174 ] Sean Owen commented on SPARK-10171: --- I don't think that's a good fit, based on my

[jira] [Commented] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708189#comment-14708189 ] Sean Owen commented on SPARK-10171: --- You should definitely try to build it. EC2-related

[jira] [Updated] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Jaka Jancar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaka Jancar updated SPARK-10171: Description: It would be great if Spark supported using AWS Lambda for execution in addition to

[jira] [Commented] (SPARK-7710) User guide and example code for math/stat functions in DataFrames

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708290#comment-14708290 ] Apache Spark commented on SPARK-7710: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7998) Improve frequent items documentation

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7998: --- Assignee: Apache Spark (was: Burak Yavuz) Improve frequent items documentation

[jira] [Commented] (SPARK-7998) Improve frequent items documentation

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708291#comment-14708291 ] Apache Spark commented on SPARK-7998: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7998) Improve frequent items documentation

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7998: --- Assignee: Burak Yavuz (was: Apache Spark) Improve frequent items documentation

[jira] [Assigned] (SPARK-9910) User guide for train validation split

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9910: --- Assignee: Apache Spark User guide for train validation split

[jira] [Commented] (SPARK-9910) User guide for train validation split

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708288#comment-14708288 ] Apache Spark commented on SPARK-9910: - User 'zapletal-martin' has created a pull

[jira] [Assigned] (SPARK-9910) User guide for train validation split

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9910: --- Assignee: (was: Apache Spark) User guide for train validation split

[jira] [Commented] (SPARK-10169) Evaluating AggregateFunction1 (old code path) may return wrong answers when grouping expressions are used as arguments of aggregate functions

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708294#comment-14708294 ] Apache Spark commented on SPARK-10169: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-10169) Evaluating AggregateFunction1 (old code path) may return wrong answers when grouping expressions are used as arguments of aggregate functions

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10169: Assignee: Yin Huai (was: Apache Spark) Evaluating AggregateFunction1 (old code path)

[jira] [Assigned] (SPARK-10169) Evaluating AggregateFunction1 (old code path) may return wrong answers when grouping expressions are used as arguments of aggregate functions

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10169: Assignee: Apache Spark (was: Yin Huai) Evaluating AggregateFunction1 (old code path)

[jira] [Commented] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708182#comment-14708182 ] Sean Owen commented on SPARK-10171: --- I'm sure it can be made to work, but, if you are

[jira] [Commented] (SPARK-10169) Evaluating AggregateFunction1 (old code path) may return wrong answers when grouping expressions are used as arguments of aggregate functions

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708298#comment-14708298 ] Apache Spark commented on SPARK-10169: -- User 'yhuai' has created a pull request for

[jira] [Created] (SPARK-10171) AWS Lambda Executors

2015-08-22 Thread Jaka Jancar (JIRA)
Jaka Jancar created SPARK-10171: --- Summary: AWS Lambda Executors Key: SPARK-10171 URL: https://issues.apache.org/jira/browse/SPARK-10171 Project: Spark Issue Type: Wish Reporter:

[jira] [Commented] (SPARK-3533) Add saveAsTextFileByKey() method to RDDs

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708209#comment-14708209 ] Apache Spark commented on SPARK-3533: - User 'saurfang' has created a pull request for

[jira] [Commented] (SPARK-9910) User guide for train validation split

2015-08-22 Thread Martin Zapletal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708231#comment-14708231 ] Martin Zapletal commented on SPARK-9910: Thanks I will create a PR very soon.

[jira] [Created] (SPARK-10172) History Server web UI gets messed up when sorting on any column

2015-08-22 Thread Min Shen (JIRA)
Min Shen created SPARK-10172: Summary: History Server web UI gets messed up when sorting on any column Key: SPARK-10172 URL: https://issues.apache.org/jira/browse/SPARK-10172 Project: Spark

[jira] [Commented] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-08-22 Thread Ray Ortigas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708279#comment-14708279 ] Ray Ortigas commented on SPARK-7160: Hi again, [~marmbrus]. I just updated the PR,

[jira] [Commented] (SPARK-10169) Evaluating AggregateFunction1 (old code path) may return wrong answers when grouping expressions are used as arguments of aggregate functions

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708296#comment-14708296 ] Apache Spark commented on SPARK-10169: -- User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-10101) Spark JDBC writer mapping String to TEXT or VARCHAR

2015-08-22 Thread Rama Mullapudi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708095#comment-14708095 ] Rama Mullapudi commented on SPARK-10101: Adding dbStringDataType as configurable

[jira] [Resolved] (SPARK-9401) Fully implement code generation for ConcatWs

2015-08-22 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9401. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8353

[jira] [Created] (SPARK-10170) Writing from data frame into db2 database using jdbc data source api fails with error for string, and boolean column types.

2015-08-22 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-10170: Summary: Writing from data frame into db2 database using jdbc data source api fails with error for string, and boolean column types. Key: SPARK-10170 URL:

[jira] [Assigned] (SPARK-10101) Spark JDBC writer mapping String to TEXT or VARCHAR

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10101: Assignee: Apache Spark Spark JDBC writer mapping String to TEXT or VARCHAR

[jira] [Assigned] (SPARK-10101) Spark JDBC writer mapping String to TEXT or VARCHAR

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10101: Assignee: (was: Apache Spark) Spark JDBC writer mapping String to TEXT or VARCHAR

[jira] [Commented] (SPARK-10101) Spark JDBC writer mapping String to TEXT or VARCHAR

2015-08-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708122#comment-14708122 ] Apache Spark commented on SPARK-10101: -- User 'rama-mullapudi' has created a pull

[jira] [Commented] (SPARK-10170) Writing from data frame into db2 database using jdbc data source api fails with error for string, and boolean column types.

2015-08-22 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708124#comment-14708124 ] Suresh Thalamati commented on SPARK-10170: -- Scanning through the code I found