[ https://issues.apache.org/jira/browse/GOBBLIN-861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zihan Li resolved GOBBLIN-861. ------------------------------ Resolution: Fixed > Skip getPartition() call to Hive Metastore when a partition already exists > -------------------------------------------------------------------------- > > Key: GOBBLIN-861 > URL: https://issues.apache.org/jira/browse/GOBBLIN-861 > Project: Apache Gobblin > Issue Type: Task > Components: hive-registration > Reporter: Zihan Li > Assignee: Abhishek Tiwari > Priority: Major > Time Spent: 2h 10m > Remaining Estimate: 0h > > Currently, we compute a diff between the current partition and an already > registered partition when a partition has already been registered in Hive. > This is done by calling getPartition() on the Hive metastore client, which > can be expensive. Since no time-varying attributes are stored in a Hive > partition, diff computation (and getPartition() call) can be skipped when a > partition already exists. -- This message was sent by Atlassian Jira (v8.3.4#803005)