ambari git commit: AMBARI-15435: Update Hawq GUCS: Refactor resource related GUC (goutamtadi via jaoki)

2016-03-19 Thread jaoki 
Repository: ambari
Updated Branches:
  refs/heads/branch-2.2 d9c6025ea -> e3a673f74


AMBARI-15435: Update Hawq GUCS: Refactor resource related GUC (goutamtadi via 
jaoki)


Project: http://git-wip-us.apache.org/repos/asf/ambari/repo
Commit: http://git-wip-us.apache.org/repos/asf/ambari/commit/e3a673f7
Tree: http://git-wip-us.apache.org/repos/asf/ambari/tree/e3a673f7
Diff: http://git-wip-us.apache.org/repos/asf/ambari/diff/e3a673f7

Branch: refs/heads/branch-2.2
Commit: e3a673f747bd274ec16535b4aa11302634ce39d4
Parents: d9c6025
Author: Jun Aoki 
Authored: Thu Mar 17 16:44:09 2016 -0700
Committer: Jun Aoki 
Committed: Thu Mar 17 16:44:09 2016 -0700

--
 .../HAWQ/2.0.0/configuration/hawq-site.xml  |  66 ---
 .../HAWQ/2.0.0/themes/theme.json| 113 ---
 .../stacks/HDP/2.3/services/stack_advisor.py|   5 +-
 .../stacks/2.3/common/test_stack_advisor.py |  15 +--
 4 files changed, 157 insertions(+), 42 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/ambari/blob/e3a673f7/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
--
diff --git 
a/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
 
b/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
index d187017..93ad3fe 100644
--- 
a/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
+++ 
b/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
@@ -114,7 +114,7 @@
 
   
 hawq_master_temp_directory
-HAWQ Master Temp Directory
+HAWQ Master Temp Directories
 /tmp/hawq/master
 
   Used as temporary filespace to store workfile cache, sort/join temp 
files etc.
@@ -128,7 +128,7 @@
 
   
 hawq_segment_temp_directory
-HAWQ Segment Temp Directory
+HAWQ Segment Temp Directories
 /tmp/hawq/segment
 
   Used as temporary filespace to store workfile cache, sort/join temp 
files etc.
@@ -146,17 +146,17 @@
 Resource Manager
 none
 
-  HAWQ global resource manager type. Valid values are YARN ('yarn') and 
Native ('none').
-  Native('none') indicates that the HAWQ resource manager manages its own 
resources exclusively for the entire cluster.
+  HAWQ global resource manager type. Valid values are YARN ('yarn') and 
Standalone ('none').
+  Standalone('none') indicates that the HAWQ resource manager manages its 
own resources exclusively for the entire cluster.
   YARN ('yarn') means that HAWQ will negotiate with YARN's resource 
manager for resources.
-  The default is Native ('none').
+  The default is Standalone ('none').
 
 
   value-list
   
 
   none
-  Native
+  Standalone
 
 
   yarn
@@ -172,7 +172,7 @@
 Segment Memory Usage Limit
 64GB
 
-  The maximum memory that can be used by a HAWQ segment when Resource 
Manager ('hawq_global_rm_type') is set to Native ('none').
+  The maximum memory that can be used by a HAWQ segment when Resource 
Manager ('hawq_global_rm_type') is set to Standalone ('none').
   The default is 64GB.
 
 
@@ -185,7 +185,7 @@
 Segment Virtual Core Usage Limit
 16
 
-  The maximum number of virtual cores that can be used for query execution 
in a HAWQ segment when Resource Manager ('hawq_global_rm_type') is set to 
Native ('none').
+  The maximum number of virtual cores that can be used for query execution 
in a HAWQ segment when Resource Manager ('hawq_global_rm_type') is set to 
Standalone ('none').
   The default is 16.
 
 
@@ -299,18 +299,52 @@
   
 
   
-default_segment_num
-Default Number of Virtual Segments
-24
+default_hash_table_bucket_number
+Default buckets for Hash Distributed tables
+6
 
-  The default number of virtual segments to use when executing a query 
statement.
-  When the query is actually executed, the number of virtual segments may 
differ from this number depending on the query's needs.
-  When expanding the cluster, you should adjust this number to reflect the 
number of nodes in the new cluster times the number of virtual segments per 
node.
-  The default is 24.
+ The default number of virtual segments per query for hash distributed 
tables that can be used for query execution in a HAWQ segment when Resource 
Manager ('hawq_global_rm_type') is set to Standalone ('none').
+  The default is 6.
 
 
   int
-  0
+  1
+  1
+  100
+
+  
+
+
+hawq_rm_nvseg_perquery_perseg_limit
+Virtual Segments Limit per Query (per Segment 
Node)
+6
+
+

ambari git commit: AMBARI-15435: Update Hawq GUCS: Refactor resource related GUC (goutamtadi via jaoki)

2016-03-19 Thread jaoki 
Repository: ambari
Updated Branches:
  refs/heads/trunk 1bf667ead -> b663dbe1b


AMBARI-15435: Update Hawq GUCS: Refactor resource related GUC (goutamtadi via 
jaoki)


Project: http://git-wip-us.apache.org/repos/asf/ambari/repo
Commit: http://git-wip-us.apache.org/repos/asf/ambari/commit/b663dbe1
Tree: http://git-wip-us.apache.org/repos/asf/ambari/tree/b663dbe1
Diff: http://git-wip-us.apache.org/repos/asf/ambari/diff/b663dbe1

Branch: refs/heads/trunk
Commit: b663dbe1be5291d8d32de7ec2b4434612d0861c0
Parents: 1bf667e
Author: Jun Aoki 
Authored: Thu Mar 17 16:42:56 2016 -0700
Committer: Jun Aoki 
Committed: Thu Mar 17 16:42:56 2016 -0700

--
 .../HAWQ/2.0.0/configuration/hawq-site.xml  |  66 ---
 .../HAWQ/2.0.0/themes/theme.json| 113 ---
 .../stacks/HDP/2.3/services/stack_advisor.py|   5 +-
 .../stacks/2.3/common/test_stack_advisor.py |  15 +--
 4 files changed, 157 insertions(+), 42 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/ambari/blob/b663dbe1/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
--
diff --git 
a/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
 
b/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
index d187017..93ad3fe 100644
--- 
a/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
+++ 
b/ambari-server/src/main/resources/common-services/HAWQ/2.0.0/configuration/hawq-site.xml
@@ -114,7 +114,7 @@
 
   
 hawq_master_temp_directory
-HAWQ Master Temp Directory
+HAWQ Master Temp Directories
 /tmp/hawq/master
 
   Used as temporary filespace to store workfile cache, sort/join temp 
files etc.
@@ -128,7 +128,7 @@
 
   
 hawq_segment_temp_directory
-HAWQ Segment Temp Directory
+HAWQ Segment Temp Directories
 /tmp/hawq/segment
 
   Used as temporary filespace to store workfile cache, sort/join temp 
files etc.
@@ -146,17 +146,17 @@
 Resource Manager
 none
 
-  HAWQ global resource manager type. Valid values are YARN ('yarn') and 
Native ('none').
-  Native('none') indicates that the HAWQ resource manager manages its own 
resources exclusively for the entire cluster.
+  HAWQ global resource manager type. Valid values are YARN ('yarn') and 
Standalone ('none').
+  Standalone('none') indicates that the HAWQ resource manager manages its 
own resources exclusively for the entire cluster.
   YARN ('yarn') means that HAWQ will negotiate with YARN's resource 
manager for resources.
-  The default is Native ('none').
+  The default is Standalone ('none').
 
 
   value-list
   
 
   none
-  Native
+  Standalone
 
 
   yarn
@@ -172,7 +172,7 @@
 Segment Memory Usage Limit
 64GB
 
-  The maximum memory that can be used by a HAWQ segment when Resource 
Manager ('hawq_global_rm_type') is set to Native ('none').
+  The maximum memory that can be used by a HAWQ segment when Resource 
Manager ('hawq_global_rm_type') is set to Standalone ('none').
   The default is 64GB.
 
 
@@ -185,7 +185,7 @@
 Segment Virtual Core Usage Limit
 16
 
-  The maximum number of virtual cores that can be used for query execution 
in a HAWQ segment when Resource Manager ('hawq_global_rm_type') is set to 
Native ('none').
+  The maximum number of virtual cores that can be used for query execution 
in a HAWQ segment when Resource Manager ('hawq_global_rm_type') is set to 
Standalone ('none').
   The default is 16.
 
 
@@ -299,18 +299,52 @@
   
 
   
-default_segment_num
-Default Number of Virtual Segments
-24
+default_hash_table_bucket_number
+Default buckets for Hash Distributed tables
+6
 
-  The default number of virtual segments to use when executing a query 
statement.
-  When the query is actually executed, the number of virtual segments may 
differ from this number depending on the query's needs.
-  When expanding the cluster, you should adjust this number to reflect the 
number of nodes in the new cluster times the number of virtual segments per 
node.
-  The default is 24.
+ The default number of virtual segments per query for hash distributed 
tables that can be used for query execution in a HAWQ segment when Resource 
Manager ('hawq_global_rm_type') is set to Standalone ('none').
+  The default is 6.
 
 
   int
-  0
+  1
+  1
+  100
+
+  
+
+
+hawq_rm_nvseg_perquery_perseg_limit
+Virtual Segments Limit per Query (per Segment 
Node)
+6
+
+  Not