[jira] [Commented] (HIVE-18799) Add SchemaRegistry APIs to Hive MetaStore
[ https://issues.apache.org/jira/browse/HIVE-18799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489864#comment-16489864 ] Sriharsha Chintalapani commented on HIVE-18799: --- [~alangates] SchemaVersion contains actual schema text(avro) and some meta info related to that. SchemaBranch, on the other hand, holds branch name, description etc. We have a mapping table which contains the relationship between a schema branch and schema version. This is to determine for a given schema version which branch it exists in. > Add SchemaRegistry APIs to Hive MetaStore > - > > Key: HIVE-18799 > URL: https://issues.apache.org/jira/browse/HIVE-18799 > Project: Hive > Issue Type: Sub-task > Components: Standalone Metastore >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19522) Add SchemaRegistry docs
[ https://issues.apache.org/jira/browse/HIVE-19522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned HIVE-19522: - > Add SchemaRegistry docs > --- > > Key: HIVE-19522 > URL: https://issues.apache.org/jira/browse/HIVE-19522 > Project: Hive > Issue Type: Sub-task >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19521) Add docker support for standalone-metastore
[ https://issues.apache.org/jira/browse/HIVE-19521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned HIVE-19521: - > Add docker support for standalone-metastore > --- > > Key: HIVE-19521 > URL: https://issues.apache.org/jira/browse/HIVE-19521 > Project: Hive > Issue Type: Sub-task >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > > Build docker module to run hive metastore & registry servers -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19520) Add SchemaRegistry Client to Hive Meta Store
[ https://issues.apache.org/jira/browse/HIVE-19520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned HIVE-19520: - > Add SchemaRegistry Client to Hive Meta Store > > > Key: HIVE-19520 > URL: https://issues.apache.org/jira/browse/HIVE-19520 > Project: Hive > Issue Type: Sub-task >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > > Schema registry client allows users to embed a HTTP client to access the > schemas during the runtime for streaming clients. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-19519) Add SchemaRegistry UI to Hive Metastore
[ https://issues.apache.org/jira/browse/HIVE-19519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned HIVE-19519: - Assignee: Sriharsha Chintalapani > Add SchemaRegistry UI to Hive Metastore > > > Key: HIVE-19519 > URL: https://issues.apache.org/jira/browse/HIVE-19519 > Project: Hive > Issue Type: Sub-task >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > > Schema registry has a web UI to browse and add schemas and manage them. This > Jira is to add that UI into Hive MetaStore -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-18799) Add SchemaRegistry APIs to Hive MetaStore
[ https://issues.apache.org/jira/browse/HIVE-18799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned HIVE-18799: - > Add SchemaRegistry APIs to Hive MetaStore > - > > Key: HIVE-18799 > URL: https://issues.apache.org/jira/browse/HIVE-18799 > Project: Hive > Issue Type: Sub-task > Components: Standalone Metastore >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (HIVE-18798) Add SchemaRegistry APIs to Hive MetaStore
[ https://issues.apache.org/jira/browse/HIVE-18798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani resolved HIVE-18798. --- Resolution: Duplicate > Add SchemaRegistry APIs to Hive MetaStore > - > > Key: HIVE-18798 > URL: https://issues.apache.org/jira/browse/HIVE-18798 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18798) Add SchemaRegistry APIs to Hive MetaStore
[ https://issues.apache.org/jira/browse/HIVE-18798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated HIVE-18798: -- Component/s: Standalone Metastore > Add SchemaRegistry APIs to Hive MetaStore > - > > Key: HIVE-18798 > URL: https://issues.apache.org/jira/browse/HIVE-18798 > Project: Hive > Issue Type: New Feature > Components: Standalone Metastore >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-18798) Add SchemaRegistry APIs to Hive MetaStore
[ https://issues.apache.org/jira/browse/HIVE-18798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned HIVE-18798: - > Add SchemaRegistry APIs to Hive MetaStore > - > > Key: HIVE-18798 > URL: https://issues.apache.org/jira/browse/HIVE-18798 > Project: Hive > Issue Type: New Feature >Reporter: Sriharsha Chintalapani >Assignee: Sriharsha Chintalapani >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-14114) Ensure RecordWriter in streaming API is using the same UserGroupInformation as StreamingConnection
[ https://issues.apache.org/jira/browse/HIVE-14114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365156#comment-15365156 ] Sriharsha Chintalapani commented on HIVE-14114: --- [~ekoifman] attached patch looks good to me . Thanks. > Ensure RecordWriter in streaming API is using the same UserGroupInformation > as StreamingConnection > -- > > Key: HIVE-14114 > URL: https://issues.apache.org/jira/browse/HIVE-14114 > Project: Hive > Issue Type: Bug > Components: Transactions >Affects Versions: 1.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman > Attachments: HIVE-14114.2.patch, HIVE-14114.patch > > > currently both DelimitedInputWriter and StrictJsonWriter perform some > Metastore access operations but without using UGI created by the caller for > Metastore operations made by matching StreamingConnection & TransactionBatch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-11317) ACID: Improve transaction Abort logic due to timeout
[ https://issues.apache.org/jira/browse/HIVE-11317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated HIVE-11317: -- Labels: triage (was: ) > ACID: Improve transaction Abort logic due to timeout > > > Key: HIVE-11317 > URL: https://issues.apache.org/jira/browse/HIVE-11317 > Project: Hive > Issue Type: Bug > Components: Metastore, Transactions >Affects Versions: 1.0.0 >Reporter: Eugene Koifman >Assignee: Eugene Koifman > Labels: triage > > the logic to Abort transactions that have stopped heartbeating is in > TxnHandler.timeOutTxns() > This is only called when DbTxnManger.getValidTxns() is called. > So if there is a lot of txns that need to be timed out and the there are not > SQL clients talking to the system, there is nothing to abort dead > transactions, and thus compaction can't clean them up so garbage accumulates > in the system. > Also, streaming api doesn't call DbTxnManager at all. > Need to move this logic into Initiator (or some other metastore side thread). > Also, make sure it is broken up into multiple small(er) transactions against > metastore DB. > Also more timeOutLocks() locks there as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)