[jira] [Created] (SPARK-9652) Make reading Avro to RDDs easier

2015-08-05 Thread Joseph Batchik (JIRA)
Joseph Batchik created SPARK-9652: - Summary: Make reading Avro to RDDs easier Key: SPARK-9652 URL: https://issues.apache.org/jira/browse/SPARK-9652 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-8360) Streaming DataFrames

2015-07-31 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649729#comment-14649729 ] Joseph Batchik commented on SPARK-8360: --- Would streaming DataFrames replace

[jira] [Created] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-07-30 Thread Joseph Batchik (JIRA)
Joseph Batchik created SPARK-9486: - Summary: Add aliasing to data sources to allow external packages to register themselves with Spark Key: SPARK-9486 URL: https://issues.apache.org/jira/browse/SPARK-9486

[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:08 PM:

[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:13 PM:

[jira] [Commented] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639187#comment-14639187 ] Joseph Batchik commented on SPARK-8007: --- You will be able to solve this issue by

[jira] [Commented] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-22 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637963#comment-14637963 ] Joseph Batchik commented on SPARK-746: -- I did some benchmarks for both the current

[jira] [Commented] (SPARK-8668) expr function to convert SQL expression into a Column

2015-07-21 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636180#comment-14636180 ] Joseph Batchik commented on SPARK-8668: --- Does this look like what you were thinking?

[jira] [Comment Edited] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-17 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630820#comment-14630820 ] Joseph Batchik edited comment on SPARK-8007 at 7/17/15 6:01 AM:

[jira] [Commented] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-17 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631673#comment-14631673 ] Joseph Batchik commented on SPARK-8007: --- Reynold, thanks for pointing that out. I

[jira] [Commented] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-16 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630820#comment-14630820 ] Joseph Batchik commented on SPARK-8007: --- [~rxin] Reynold, I start adding virtual

[jira] [Commented] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-06-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597973#comment-14597973 ] Joseph Batchik commented on SPARK-746: -- Spark can currently serialize the three type