[
https://issues.apache.org/jira/browse/HAWQ-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214286#comment-15214286
]
ASF GitHub Bot commented on HAWQ-587:
-------------------------------------
Github user radarwave commented on the pull request:
https://github.com/apache/incubator-hawq/pull/521#issuecomment-202430166
@denalex, please help to review this, since it can solve conflict with
Ambari.
If Ambari already set 'default_hash_table_bucket_number' in hawq-site.xml,
then hawq init will just use that value.
Ambari also can give option '--default_hash_table_bucket_number' to 'hawq
init master/cluster' command to specify the value.
Thanks.
> Set GUC 'default_hash_table_bucket_number' dynamically
> ------------------------------------------------------
>
> Key: HAWQ-587
> URL: https://issues.apache.org/jira/browse/HAWQ-587
> Project: Apache HAWQ
> Issue Type: Improvement
> Components: Command Line Tools
> Reporter: Radar Lei
> Assignee: Radar Lei
>
> Currently we set default_hash_table_bucket_number = 6 * #nodes, this should
> be changed.
> The following is the correct pattern to set
> 'default_hash_table_bucket_number':
> 1) If #nodes <= 85, default_hash_table_bucket_number = 6 * #nodes
> 2) if #nodes > 85 and #nodes <= 102, default_hash_table_bucket_number = 5 *
> #nodes
> 3) if #nodes > 102 and #nodes <= 128, default_hash_table_bucket_number = 4 *
> #nodes
> 4) if #nodes > 128 and #nodes <= 170, default_hash_table_bucket_number = 3 *
> #nodes
> 5) if #nodes > 170 and #nodes <= 256, default_hash_table_bucket_number = 2 *
> #nodes
> 6) if #nodes > 256 and #nodes <= 512, default_hash_table_bucket_number = 1 *
> #nodes
> 7) if #nodes > 512, default_hash_table_bucket_number =
> 'hawq_rm_nvseg_perquery_limit'
> Some related changes need to be done:
> 1. Do not set GUC 'hawq_rm_nvseg_perquery_perseg_limit' any more since the
> default value is good enough.
> 2. Remove option ''--vsegment-number" since we do not need it any more.
> 3. Add new option "--default_hash_table_bucket_number" to let user define GUC
> 'default_hash_table_bucket_number'.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
