[ 
https://issues.apache.org/jira/browse/HBASE-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13733695#comment-13733695
 ] 

Nick Dimiduk commented on HBASE-8089:
-------------------------------------

Hi Eli,

You're right, I've left this ticket untouched while working through the initial 
subtasks.

The order-preserving serialization is a critical component of the work. I think 
this is a feature that HBase absolutely must provide if there's to be any hope 
for interoperability. I also think the serialization format is necessary but 
not sufficient. An HBase that ships with an API for describing data types and 
implementations of a set of common definitions takes the next step in 
interoperability. By defining the type interface, type implementations provided 
by 3rd parties become pluggable -- it becomes feasible for a user to plug a 
type from Phoenix into their Kiji application. Systems like Phoenix, Kiji, and 
HCatalog are all choices for defining and managing schema. It may be the case 
that HBase should define the schema interfaces as well, but that's definitely 
beyond the scope here. But if those tools are going to interoperate, they need 
a common language of types with which to do so. Serialization, IMHO, is 
insufficient.

I don't know if there's a new project to be built out of this work. I see no 
need to create such a thing when the needs and use are not yet proven. The 
introduction of types in HBase will shake things up enough as it is, let's see 
how people and projects use them before promoting this stuff to its own project.

Yes, the serialization formats defined in HBASE-8201 are designed to be 
language agnostic. It's highly likely that I've missed some critical details 
here or there in the specification. Time will tell :)

-n
                
> Add type support
> ----------------
>
>                 Key: HBASE-8089
>                 URL: https://issues.apache.org/jira/browse/HBASE-8089
>             Project: HBase
>          Issue Type: New Feature
>          Components: Client
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>             Fix For: 0.98.0
>
>         Attachments: HBASE-8089-types.txt, HBASE-8089-types.txt, 
> HBASE-8089-types.txt, HBASE-8089-types.txt, hbase data types WIP.pdf
>
>
> This proposal outlines an improvement to HBase that provides for a set of 
> types, above and beyond the existing "byte-bucket" strategy. This is intended 
> to reduce user-level duplication of effort, provide better support for 
> 3rd-party integration, and provide an overall improved experience for 
> developers using HBase.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to