Ryan Blue created PARQUET-132:
---------------------------------
Summary: AvroParquetInputFormat should use a parameterized type
Key: PARQUET-132
URL: https://issues.apache.org/jira/browse/PARQUET-132
Project: Parquet
Issue Type: Bug
Reporter: Ryan Blue
The {{AvroParquetInputFormat}} currently extends
{{ParquetInputFormat<IndexedRecord>}}, which works for regular MR cases. But
Spark's {{hadoopRDD}} and {{newAPIHadoopRDD}} methods (correctly) create a RDD
with the types from the InputFormat. This means that the RDD always uses
{{IndexedRecord}} rather than the correct type.
The {{AvroParquetInputFormat}} should be {{AvroParquetInputFormat<T extends
IndexedRecord> extends ParquetInputFormat<T>}}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
