[
https://issues.apache.org/jira/browse/SPARK-24800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-24800:
----------------------------
Description: Currently in Avro data source module, the Avro Deserializer
converts input Avro format data to Row, and then convert the Row to
InternalRow. The Avro Serializer converts InternalRow to Row, and then output
Avro format data. To improve the performance, we need to make a direct
conversion between InternalRow and Avro format data.
> Refactor Avro Serializer and Deserializer
> -----------------------------------------
>
> Key: SPARK-24800
> URL: https://issues.apache.org/jira/browse/SPARK-24800
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Gengliang Wang
> Assignee: Gengliang Wang
> Priority: Major
> Fix For: 2.4.0
>
>
> Currently in Avro data source module, the Avro Deserializer converts input
> Avro format data to Row, and then convert the Row to InternalRow. The Avro
> Serializer converts InternalRow to Row, and then output Avro format data. To
> improve the performance, we need to make a direct conversion between
> InternalRow and Avro format data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
