hudi-bot opened a new issue, #15052: URL: https://github.com/apache/hudi/issues/15052
In [InputBatch|https://github.com/apache/hudi/blob/548000b0d635067acf7574c4cf5122759e79b52b/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/InputBatch.java#L57] we use NullSchemaProvider when batch is empty. this will return null schema ( Schema.create(Schema.Type.NULL)). We need to understand why can't we return an empty schema here (Scehma.create(Collections.emptyList()). Thats the schema for an empty spark dataframe and we should stick to that. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-3596 - Type: Task -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
