[ 
https://issues.apache.org/jira/browse/HIVE-20428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586608#comment-16586608
 ] 

Prasanth Jayachandran commented on HIVE-20428:
----------------------------------------------

The overhead in terms of perf is not much (haven't measured it but it shouldn't 
be significant). Just that customer reported errors (already exists partition 
errors) in metastore logs which are safe to ignore for this specific case. To 
avoid the error logs, add_partitions with ifNotExists can be used. 

> HiveStreamingConnection should use addPartition if not exists API
> -----------------------------------------------------------------
>
>                 Key: HIVE-20428
>                 URL: https://issues.apache.org/jira/browse/HIVE-20428
>             Project: Hive
>          Issue Type: Bug
>          Components: Streaming, Transactions
>    Affects Versions: 4.0.0, 3.2.0
>            Reporter: Prasanth Jayachandran
>            Priority: Major
>
> [https://github.com/apache/hive/blob/f280361374c6219d8734d5972c740d6d6c3fb7ef/streaming/src/java/org/apache/hive/streaming/HiveStreamingConnection.java#L379-L381]
>  
> catches AlreadyExistsException when adding partition. Instead use 
> add_partitions API with ifNotExists set to true. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to