[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:08 PM: --- I did some benchmarks for both the current implementation of serializing Avro records compared to this change, the results are located here: https://docs.google.com/a/cloudera.com/spreadsheets/d/16JXO80O1Fh9bTIhx_0PZcCd5gvGTobX6xoe17vBEGH0/pubhtml was (Author: jd): I did some benchmarks for both the current implementation of serializing Avro records compared to this change, the results are located here: https://docs.google.com/a/cloudera.com/spreadsheets/d/16JXO80O1Fh9bTIhx_0PZcCd5gvGTobX6xoe17vBEGH0/edit?usp=sharing Automatically Use Avro Serialization for Avro Objects - Key: SPARK-746 URL: https://issues.apache.org/jira/browse/SPARK-746 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Patrick Cogan All generated objects extend org.apache.avro.specific.SpecificRecordBase (or there may be a higher up class as well). Since Avro records aren't JavaSerializable by default people currently have to wrap their records. It would be good if we could use an implicit conversion to do this for them. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:13 PM: --- I did some benchmarks for both the current implementation of serializing Avro records compared to this change, the results are located here: http://www.csh.rit.edu/~jd/spark/Avro%20Datapoints.xlsx was (Author: jd): I did some benchmarks for both the current implementation of serializing Avro records compared to this change, the results are located here: https://docs.google.com/a/cloudera.com/spreadsheets/d/16JXO80O1Fh9bTIhx_0PZcCd5gvGTobX6xoe17vBEGH0/pubhtml Automatically Use Avro Serialization for Avro Objects - Key: SPARK-746 URL: https://issues.apache.org/jira/browse/SPARK-746 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Patrick Cogan All generated objects extend org.apache.avro.specific.SpecificRecordBase (or there may be a higher up class as well). Since Avro records aren't JavaSerializable by default people currently have to wrap their records. It would be good if we could use an implicit conversion to do this for them. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
