[
https://issues.apache.org/jira/browse/CRUNCH-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Wills updated CRUNCH-572:
------------------------------
Attachment: CRUNCH-572.patch
[~aeckstein] here's a patch to fix this for all tuple types, not just pairs
(e.g., Avros.trips(PTableType, PTableType, FooType) would break as well.)
> Avro schema error in Avros.tableOf() can't redefine
> org.apache.avro.mapred.Pair
> -------------------------------------------------------------------------------
>
> Key: CRUNCH-572
> URL: https://issues.apache.org/jira/browse/CRUNCH-572
> Project: Crunch
> Issue Type: Bug
> Affects Versions: 0.13.0
> Reporter: Adric Eckstein
> Attachments: CRUNCH-572.patch
>
>
> The Avros.tableOf() method produces a record schema named
> "org.apache.avro.mapred.Pair", which cannot be unique across types, whereas
> the Avros.pairs() method similarly creates a record schema, but calls
> Avros.createTupleSchema() which creates a unique name at every call.
> Example that fails on constructing schema:
> AvroType<Pair<String, String>> t1 = Avros.tableOf(Avros.strings(),
> Avros.strings());
> AvroType<Pair<String, Double>> t2 = Avros.tableOf(Avros.strings(),
> Avros.doubles());
> AvroType<Pair<Pair<String, String>, Pair<String, Double>>> t3 =
> Avros.pairs(t1, t2);
> System.out.println("schema: " + t3.getSchema().toString());
> Can the tableOf() method be updated to call the createTupleSchema() method
> instead of the avro pair constructor?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
