HyukjinKwon commented on a change in pull request #27045: [SPARK-27506][SQL][FOLLOWUP] Use option `avroSchema` to specify an evolved schema in `from_avro` URL: https://github.com/apache/spark/pull/27045#discussion_r361908355
########## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala ########## @@ -36,18 +36,14 @@ class AvroOptions( } /** - * Optional schema provided by an user in JSON format. + * Optional schema provided by an user in JSON format. This option can be set when + * 1. for reading Avro, the expected schema for deserialization is compatible with Review comment: This wording sounds a bit unclear to me. > When reading, the provided Avro schema should be compatible with the Avro schema from the actual data. > When writing, the provided Avro schema should be compatible with the Avro schema converted from Spark schema. Is it correct? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
