[
https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570840#comment-16570840
]
Thomas Graves commented on SPARK-24924:
---------------------------------------
so officially the spark api compatibility is only at the compilation level:
[http://spark.apache.org/versioning-policy.html] . We try to keep binary
compatibility but its not guaranteed between releases. It might be worth
bringing up though to make sure they thought of that as it should be a
conscious decision.
I think if you rebuild databricks avro with spark 2.4 it works, right?
I unfortunately don't have a hive setup working with spark 2.4 right now. When
I wrote a table (saveAsTable) with 2.3 databricks avro I don't see a table
property spark.sql.sources.provider, what am I missing?
> Add mapping for built-in Avro data source
> -----------------------------------------
>
> Key: SPARK-24924
> URL: https://issues.apache.org/jira/browse/SPARK-24924
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Minor
> Fix For: 2.4.0
>
>
> This issue aims to the followings.
> # Like `com.databricks.spark.csv` mapping, we had better map
> `com.databricks.spark.avro` to built-in Avro data source.
> # Remove incorrect error message, `Please find an Avro package at ...`.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
