Rui Li created HIVE-15202:
-----------------------------

             Summary: Concurrent compactions for the same partition may 
generate malformed folder structure
                 Key: HIVE-15202
                 URL: https://issues.apache.org/jira/browse/HIVE-15202
             Project: Hive
          Issue Type: Bug
            Reporter: Rui Li


If two compactions run concurrently on a single partition, it may generate 
folder structure like this: (nested base dir)
{noformat}
drwxr-xr-x   - root supergroup          0 2016-11-14 22:23 
/user/hive/warehouse/test/z=1/base_0000007/base_0000007
-rw-r--r--   3 root supergroup        201 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00000
-rw-r--r--   3 root supergroup        611 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00001
-rw-r--r--   3 root supergroup        614 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00002
-rw-r--r--   3 root supergroup        621 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00003
-rw-r--r--   3 root supergroup        621 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00004
-rw-r--r--   3 root supergroup        201 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00005
-rw-r--r--   3 root supergroup        201 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00006
-rw-r--r--   3 root supergroup        201 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00007
-rw-r--r--   3 root supergroup        201 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00008
-rw-r--r--   3 root supergroup        201 2016-11-14 21:46 
/user/hive/warehouse/test/z=1/base_0000007/bucket_00009
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to