Eugene Koifman created HIVE-20581:
-------------------------------------

             Summary: Eliminate rename() from full CRUD transactional tables
                 Key: HIVE-20581
                 URL: https://issues.apache.org/jira/browse/HIVE-20581
             Project: Hive
          Issue Type: Improvement
          Components: Transactions
            Reporter: Eugene Koifman


The {{MoveTask}} in a query writing to full CRUD transactional table still 
performs a {{FileSystem.rename()}}.  Full CRUD should follow the insert-only 
transactional table implementation and write directly to delta_x_x in the 
partition dir.  If the txn fails, this delta will be marked aborted and will 
not be read.

There are several places that rely on this rename.  For example, support for 
{{Insert ... select ... Union All ... Select }} which creates multiple dirs, 1 
for each leg of the union.

Others?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to