Scott Carey wrote:
** Avro enhancements Both Specific and Generic APIs lead to extra object overhead here. For example in Pig one creates the Avro object then reads its fields and copies them into a pig Schema.
Can't you instead subclass GenericDatum{Reader/Writer} and override methods so that it operates directly on Pig data? That's the intent.
Neither will support recursive schemas. Is there a quick way to check if a schema is recursive? In general, some features in Avro to make it easier to 'categorize' a schema would be beneficial.
We could easily add Schema#isRecursive() and Schema#hasNonNullUnions() methods if those would be useful.
Doug