Hello.
I have a set of complex structured objects that I would like to put into
hive and use it's sql to query data from those objects. Now, since they
are complex structures, defining a schema for every single field is a
hard job.
Instead I'm thinking of making a custom SerDe with custom
ObjectInspector that uses something like ONGL to get the values of
object fields and convert them to hive's data types. So when writing a
query it would be something like:
select <ongl_expression1>,<ongl_expression2>... from etc...
If expressions can be transfered verbatim to ObjectInspector without
hive checking for their validity as column names, ObjectInspector itself
would know what to do with them. This doesn't need any explicit schema
as far as SerDe and ObjectInspector are concerned. But can hive cope
with that? Is this possible to do?