allow the number of files to be a multiple of bucketed table
------------------------------------------------------------
Key: HIVE-2775
URL: https://issues.apache.org/jira/browse/HIVE-2775
Project: Hive
Issue Type: New Feature
Components: Metastore
Reporter: xiaoyu wang
Currently, hive bucketed table requires the number of files to match the bucket
number in order to for correct sampling. This is very restrictive. e.g. we can
only populate the table using a fix number of reducer, which can be a
bottleneck.
The idea is to introduce this "physical bucket" and "logical bucket" concept.
"physical bucket" is the number of files and "logical bucket" is the number of
bucket stored in meda-data for bucketed table. By allowing "physical bucket" to
be a multiple of "logical bucket", we can do correct sampling as well as
scaling up.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
