[ 
https://issues.apache.org/jira/browse/ATLAS-58?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-58:
-----------------------------
    Issue Type: Task  (was: New Feature)

> Make hive hook reliable
> -----------------------
>
>                 Key: ATLAS-58
>                 URL: https://issues.apache.org/jira/browse/ATLAS-58
>             Project: Atlas
>          Issue Type: Task
>            Reporter: Shwetha G S
>            Assignee: Shwetha G S
>
> Currently, hive hook executes in background thread pool and is an best effort 
> approach to register entities. But this needs to be reliable for data 
> governance to be effective
> One way is - in hive hook, add the entities to some messaging framework and 
> atlas server can read the entities from the message and register in atlas. 
> Since, posting message is faster, we can do it synchronously and hence 
> reliable entity registration.
> We can start with kafka for messaging, but any other messaging framework 
> should be pluggable



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to