[
https://issues.apache.org/jira/browse/HCATALOG-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436483#comment-13436483
]
Travis Crawford commented on HCATALOG-425:
------------------------------------------
Hey Sushanth, good questions. The motivation for adding conversions at the
Hive-to-HCatRecord layer is so all framework adapters can take advantage of
these conversions. As more framework adapters are added over time we won't have
to reimplement the converters, or have feature drift between adapters.
That said, I'm totally open to refactoring how conversions are done if we think
that's the better approach. If we do go that route, and have a more robust
hcat-to-framework record conversions, would there be benefits to go straight
from Hive records to the framework-specific record (direct from Hive to Pig
tuple for example)? In this way of thinking, HCatRecord would be the "MR
framework adapter record format".
I'm totally open to either approach, since they're both totally valid
implementations. The core of what I care about here is letting users configure
the conversions they need for that specific job, in the processing framework
they choose to use.
Thoughts?
> Pig cannot read/write SMALLINT/TINYINT columns
> ----------------------------------------------
>
> Key: HCATALOG-425
> URL: https://issues.apache.org/jira/browse/HCATALOG-425
> Project: HCatalog
> Issue Type: Bug
> Components: pig
> Affects Versions: 0.4
> Reporter: Thejas M Nair
> Assignee: Travis Crawford
> Fix For: 0.5
>
> Attachments: HCATALOG-425_small_tiny_int.1.patch,
> HCATALOG-425_small_tiny_int.2.patch, HCATALOG-425_small_tiny_int.3.patch
>
>
> Currently throw exception. We can always allow read and on write side, we can
> do out of boundary check at runtime.
> This issue described in HCATALOG-168, has not been fixed. It still throws an
> exception.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
