[jira] [Commented] (SPARK-7549) Support aggregating over nested fields

2015-07-13 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625704#comment-14625704 ] Chen Song commented on SPARK-7549: -- I prefer the former. I thought about using explode,

[jira] [Commented] (SPARK-7394) Add Pandas style cast (astype)

2015-05-06 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530065#comment-14530065 ] Chen Song commented on SPARK-7394: -- Ok, I'll work on this after finishing my daily job.

[jira] [Commented] (SPARK-7394) Add Pandas style cast (astype)

2015-05-06 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530066#comment-14530066 ] Chen Song commented on SPARK-7394: -- Ok, I'll work on this after finishing my daily job.

[jira] [Commented] (SPARK-7327) DataFrame show() method doesn't like empty dataframes

2015-05-03 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14526191#comment-14526191 ] Chen Song commented on SPARK-7327: -- I am working on upgrade the show function. I'll run

[jira] [Commented] (SPARK-7251) Perform sequential scan when iterating over entries in BytesToBytesMap

2015-05-01 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522977#comment-14522977 ] Chen Song commented on SPARK-7251: -- Can the key could be empty? If we allow the key could

[jira] [Created] (SPARK-7234) When codegen on DateType defaultPrimitive will throw type mismatch exception

2015-04-29 Thread Chen Song (JIRA)
Chen Song created SPARK-7234: Summary: When codegen on DateType defaultPrimitive will throw type mismatch exception Key: SPARK-7234 URL: https://issues.apache.org/jira/browse/SPARK-7234 Project: Spark

[jira] [Commented] (SPARK-7158) collect and take return different results

2015-04-27 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14513623#comment-14513623 ] Chen Song commented on SPARK-7158: -- Should we execute the query in cache method?

[jira] [Created] (SPARK-6927) Sorting Error when codegen on

2015-04-15 Thread Chen Song (JIRA)
Chen Song created SPARK-6927: Summary: Sorting Error when codegen on Key: SPARK-6927 URL: https://issues.apache.org/jira/browse/SPARK-6927 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-6899) Type mismatch when user codegen

2015-04-14 Thread Chen Song (JIRA)
Chen Song created SPARK-6899: Summary: Type mismatch when user codegen Key: SPARK-6899 URL: https://issues.apache.org/jira/browse/SPARK-6899 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Song updated SPARK-6899: - Summary: Type mismatch when using codegen (was: Type mismatch when user codegen) Type mismatch when

[jira] [Updated] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Song updated SPARK-6899: - Description: When I run tests in DataFrameSuite with codegen on, some type mismatched error occured.

[jira] [Closed] (SPARK-6395) Rebuild the schema from a GenericRow

2015-03-19 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Song closed SPARK-6395. Resolution: Not a Problem Rebuild the schema from a GenericRow

[jira] [Created] (SPARK-6412) Add Char support in dataTypes.

2015-03-19 Thread Chen Song (JIRA)
Chen Song created SPARK-6412: Summary: Add Char support in dataTypes. Key: SPARK-6412 URL: https://issues.apache.org/jira/browse/SPARK-6412 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-6395) Rebuild the schema from a GenericRow

2015-03-18 Thread Chen Song (JIRA)
Chen Song created SPARK-6395: Summary: Rebuild the schema from a GenericRow Key: SPARK-6395 URL: https://issues.apache.org/jira/browse/SPARK-6395 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-6382) withUDF(...) {...} for supporting temporary UDF definitions in the scope

2015-03-17 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365433#comment-14365433 ] Chen Song commented on SPARK-6382: -- If we don't change the global scope of UDF

[jira] [Commented] (SPARK-6292) Add RDD methods to DataFrame to preserve schema

2015-03-17 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365404#comment-14365404 ] Chen Song commented on SPARK-6292: -- I got it. I think we can expand the RDDApi and create

[jira] [Commented] (SPARK-6292) Add RDD methods to DataFrame to preserve schema

2015-03-17 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365370#comment-14365370 ] Chen Song commented on SPARK-6292: -- Can you explain this JIRA more exactly? Or you can

[jira] [Commented] (SPARK-6293) SQLContext.implicits should provide automatic conversion for RDD[Row]

2015-03-17 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365500#comment-14365500 ] Chen Song commented on SPARK-6293: -- Yeah, this is a problem. Maybe we can rebuild the

[jira] [Commented] (SPARK-6293) SQLContext.implicits should provide automatic conversion for RDD[Row]

2015-03-16 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14364340#comment-14364340 ] Chen Song commented on SPARK-6293: -- OK, I have created a pull request

[jira] [Commented] (SPARK-6293) SQLContext.implicits should provide automatic conversion for RDD[Row]

2015-03-16 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362824#comment-14362824 ] Chen Song commented on SPARK-6293: -- The schema is preserved in the row and rdd doesn't

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

2014-10-08 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163859#comment-14163859 ] Chen Song commented on SPARK-3633: -- Looks like we have addressed fetch failure caused by

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

2014-10-01 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155415#comment-14155415 ] Chen Song commented on SPARK-3633: -- I tried increasing timeout for this property

[jira] [Comment Edited] (SPARK-3633) Fetches failure observed after SPARK-2711

2014-10-01 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155415#comment-14155415 ] Chen Song edited comment on SPARK-3633 at 10/1/14 8:15 PM: --- I