Paul Rogers created DRILL-7601: ---------------------------------- Summary: Shift column conversion to reader from scan framework Key: DRILL-7601 URL: https://issues.apache.org/jira/browse/DRILL-7601 Project: Apache Drill Issue Type: Improvement Affects Versions: 1.17.0 Reporter: Paul Rogers Assignee: Paul Rogers Fix For: 1.18.0
At the time we implemented provided schemas with the text reader, the best path forward appeared to be to perform column type conversions within the scan framework including deep in the column writer structure. Experience with other readers has shown that the text reader is a special case: it always writes strings, which Drill-provided converters can parse into other types. Other readers, however are not so simple: they often have their own source structures which must be mated to a column reader, and so conversion is generally best done in the reader where it can be specific to the nuances of each reader. This ticket asks to restructure the conversion code to fit the reader-does-conversion pattern. -- This message was sent by Atlassian Jira (v8.3.4#803005)