[44/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/MasterMirroring.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/MasterMirroring.html b/docs/userguide/2.3.0.0-incubating/admin/MasterMirroring.html new file mode 100644 index 000..d19e024 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/MasterMirroring.html @@ -0,0 +1,1202 @@ + + + + + + + + + + + + Using Master Mirroring | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of
[16/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-mitkdc.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-mitkdc.html b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-mitkdc.html new file mode 100644 index 000..24c91ca --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-mitkdc.html @@ -0,0 +1,1142 @@ + + + + + + + + + + + + Example - Setting up an MIT KDC Server | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + +
[20/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/g-hawq-database-client-applications.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/g-hawq-database-client-applications.html b/docs/userguide/2.3.0.0-incubating/clientaccess/g-hawq-database-client-applications.html new file mode 100644 index 000..6d62c4e --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/g-hawq-database-client-applications.html @@ -0,0 +1,1231 @@ + + + + + + + + + + + + HAWQ Client Applications | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger
[45/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/HighAvailability.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/HighAvailability.html b/docs/userguide/2.3.0.0-incubating/admin/HighAvailability.html new file mode 100644 index 000..564b219 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/HighAvailability.html @@ -0,0 +1,1107 @@ + + + + + + + + + + + + High Availability in HAWQ | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overvi
[27/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/querying_data_bestpractices.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/querying_data_bestpractices.html b/docs/userguide/2.3.0.0-incubating/bestpractices/querying_data_bestpractices.html new file mode 100644 index 000..6f871fb --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/querying_data_bestpractices.html @@ -0,0 +1,1118 @@ + + + + + + + + + + + + Best Practices for Querying Data | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization +
[15/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-securehdfs.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-securehdfs.html b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-securehdfs.html new file mode 100644 index 000..992953f --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-securehdfs.html @@ -0,0 +1,1248 @@ + + + + + + + + + + + + Configuring HAWQ/PXF for Secure HDFS | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + +
[42/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/RunningHAWQ.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/RunningHAWQ.html b/docs/userguide/2.3.0.0-incubating/admin/RunningHAWQ.html new file mode 100644 index 000..0141dfc --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/RunningHAWQ.html @@ -0,0 +1,1110 @@ + + + + + + + + + + + + Running a HAWQ Cluster | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Ma
[22/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/g-database-application-interfaces.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/g-database-application-interfaces.html b/docs/userguide/2.3.0.0-incubating/clientaccess/g-database-application-interfaces.html new file mode 100644 index 000..8af042d --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/g-database-application-interfaces.html @@ -0,0 +1,1204 @@ + + + + + + + + + + + + HAWQ Database Drivers and APIs | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger fo
[13/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos.html b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos.html new file mode 100644 index 000..e699fb2 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos.html @@ -0,0 +1,1112 @@ + + + + + + + + + + + + Using Kerberos Authentication | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overvi
[41/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/ambari-admin.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/ambari-admin.html b/docs/userguide/2.3.0.0-incubating/admin/ambari-admin.html new file mode 100644 index 000..6040678 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/ambari-admin.html @@ -0,0 +1,1661 @@ + + + + + + + + + + + + Managing HAWQ Using Ambari | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger P
[26/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/secure_bestpractices.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/secure_bestpractices.html b/docs/userguide/2.3.0.0-incubating/bestpractices/secure_bestpractices.html new file mode 100644 index 000..c9cf3cb --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/secure_bestpractices.html @@ -0,0 +1,1077 @@ + + + + + + + + + + + + Best Practices for Securing HAWQ | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + +
[51/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
Add build of 2.3.0.0-incubating generated html Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/commit/65b12831 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/tree/65b12831 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/diff/65b12831 Branch: refs/heads/asf-site Commit: 65b128318232c759689fa98b38bcf212a0372c7b Parents: 147646e Author: David Yozie Authored: Tue Mar 20 17:08:02 2018 -0700 Committer: David Yozie Committed: Tue Mar 20 17:08:02 2018 -0700 -- .../BackingUpandRestoringHAWQDatabases.html | 1414 .../admin/ClusterExpansion.html | 1262 .../2.3.0.0-incubating/admin/ClusterShrink.html | 1115 +++ .../admin/FaultTolerance.html | 1118 +++ ...ilespacesandHighAvailabilityEnabledHDFS.html | 1285 .../admin/HighAvailability.html | 1107 +++ .../admin/MasterMirroring.html | 1202 .../admin/RecommendedMonitoringTasks.html | 1331 .../2.3.0.0-incubating/admin/RunningHAWQ.html | 1110 +++ .../2.3.0.0-incubating/admin/ambari-admin.html | 1661 + .../admin/ambari-rest-api.html | 1350 .../2.3.0.0-incubating/admin/logfiles.html | 1488 .../2.3.0.0-incubating/admin/maintain.html | 1084 +++ .../2.3.0.0-incubating/admin/monitor.html | 2346 +++ .../2.3.0.0-incubating/admin/packcore.html | 1100 +++ .../admin/setuphawqopenv.html | 1185 .../2.3.0.0-incubating/admin/startstop.html | 1190 .../HAWQBestPracticesOverview.html | 1092 +++ .../config_hawq_bestpractices.html | 1077 +++ .../bestpractices/general_bestpractices.html| 1094 +++ .../managing_data_bestpractices.html| 1117 +++ .../managing_resources_bestpractices.html | 1199 .../operating_hawq_bestpractices.html | 1358 .../querying_data_bestpractices.html| 1118 +++ .../bestpractices/secure_bestpractices.html | 1077 +++ .../clientaccess/client_auth.html | 1267 .../clientaccess/disable-kerberos.html | 1168 .../clientaccess/g-connecting-with-psql.html| 1089 +++ .../g-database-application-interfaces.html | 1204 .../g-establishing-a-database-session.html | 1109 +++ .../g-hawq-database-client-applications.html| 1231 .../g-troubleshooting-connection-problems.html | 1099 +++ .../clientaccess/hawq-access-checks.html| 1133 .../2.3.0.0-incubating/clientaccess/index | 33 + .../clientaccess/kerberos-mitkdc.html | 1142 .../clientaccess/kerberos-securehdfs.html | 1248 .../clientaccess/kerberos-userauth.html | 1431 .../clientaccess/kerberos.html | 1112 +++ .../2.3.0.0-incubating/clientaccess/ldap.html | 1163 .../clientaccess/roles_privs.html | 1381 .../datamgmt/BasicDataOperations.html | 1127 .../datamgmt/ConcurrencyControl.html| 1120 +++ .../datamgmt/HAWQInputFormatforMapReduce.html | 1475 .../datamgmt/Transactions.html | 1130 .../datamgmt/about_statistics.html | 1291 .../2.3.0.0-incubating/datamgmt/dml.html| 1095 +++ .../datamgmt/load/client-loadtools.html | 1183 .../load/creating-external-tables-examples.html | 1174 .../g-about-gpfdist-setup-and-performance.html | 1092 +++ .../datamgmt/load/g-character-encoding.html | 1075 +++ .../g-command-based-web-external-tables.html| 1086 +++ .../load/g-configuration-file-format.html | 1130 .../load/g-controlling-segment-parallelism.html | 1075 +++ ...-error-table-and-declare-a-reject-limit.html | 1073 +++ ...-creating-and-using-web-external-tables.html | 1078 +++ ...l-table-with-single-row-error-isolation.html | 1084 +++ ...mmand-based-writable-external-web-table.html | 1157 ...ng-a-file-based-writable-external-table.html | 1084 +++ .../g-determine-the-transformation-schema.html | 1097 +++ ...ute-for-web-or-writable-external-tables.html | 1073 +++ .../load/g-escaping-in-csv-formatted-files.html | 1093 +++ .../g-escaping-in-text-formatted-files.html | 1093 +++ .../datamgmt/load/g-escaping.html | 1083 +++ ...database-publications-in-demo-directory.html | 1089 +++ .../g-example-hawq-file-server-gpfdist.html | 1075 +++ ...ple-irs-mef-xml-files-in-demo-directory.html | 1116 +++ ...-example-witsml-files-in-demo-directory.html | 1118 +++ .../load/g-examples-read-fixed-width-data.html | 1095 +++ .../datamgmt/load/g-external-tables.html| 1118 +++ .../datamgmt/load/g-formatting-columns.html | 1079 +++ .../datamgmt/load/g-formatting-data-files.html | 1079 +++ .../datamgmt/load/g-formatting-rows.html
[49/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/ClusterExpansion.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/ClusterExpansion.html b/docs/userguide/2.3.0.0-incubating/admin/ClusterExpansion.html new file mode 100644 index 000..907820a --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/ClusterExpansion.html @@ -0,0 +1,1262 @@ + + + + + + + + + + + + Expanding a Cluster | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of
[40/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/ambari-rest-api.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/ambari-rest-api.html b/docs/userguide/2.3.0.0-incubating/admin/ambari-rest-api.html new file mode 100644 index 000..cc0b627 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/ambari-rest-api.html @@ -0,0 +1,1350 @@ + + + + + + + + + + + + Using the Ambari REST API | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview
[32/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/config_hawq_bestpractices.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/config_hawq_bestpractices.html b/docs/userguide/2.3.0.0-incubating/bestpractices/config_hawq_bestpractices.html new file mode 100644 index 000..fdc09cf --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/config_hawq_bestpractices.html @@ -0,0 +1,1077 @@ + + + + + + + + + + + + Best Practices for Configuring HAWQ Parameters | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorizat
[04/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/load/client-loadtools.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/load/client-loadtools.html b/docs/userguide/2.3.0.0-incubating/datamgmt/load/client-loadtools.html new file mode 100644 index 000..17f9992 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/load/client-loadtools.html @@ -0,0 +1,1183 @@ + + + + + + + + + + + + Client-Based HAWQ Load Tools | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + +
[21/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/g-establishing-a-database-session.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/g-establishing-a-database-session.html b/docs/userguide/2.3.0.0-incubating/clientaccess/g-establishing-a-database-session.html new file mode 100644 index 000..6fe15a5 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/g-establishing-a-database-session.html @@ -0,0 +1,1109 @@ + + + + + + + + + + + + Establishing a Database Session | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger f
[30/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/managing_data_bestpractices.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/managing_data_bestpractices.html b/docs/userguide/2.3.0.0-incubating/bestpractices/managing_data_bestpractices.html new file mode 100644 index 000..642005a --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/managing_data_bestpractices.html @@ -0,0 +1,1117 @@ + + + + + + + + + + + + Best Practices for Managing Data | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization +
[05/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/dml.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/dml.html b/docs/userguide/2.3.0.0-incubating/datamgmt/dml.html new file mode 100644 index 000..42178bf --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/dml.html @@ -0,0 +1,1095 @@ + + + + + + + + + + + + Managing Data with HAWQ | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Management +
[34/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/startstop.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/startstop.html b/docs/userguide/2.3.0.0-incubating/admin/startstop.html new file mode 100644 index 000..d9bcf3f --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/startstop.html @@ -0,0 +1,1190 @@ + + + + + + + + + + + + Starting and Stopping HAWQ | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Manage
[39/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/logfiles.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/logfiles.html b/docs/userguide/2.3.0.0-incubating/admin/logfiles.html new file mode 100644 index 000..ecad65b --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/logfiles.html @@ -0,0 +1,1488 @@ + + + + + + + + + + + + HAWQ Administrative Log Files | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Managem
[11/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/roles_privs.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/roles_privs.html b/docs/userguide/2.3.0.0-incubating/clientaccess/roles_privs.html new file mode 100644 index 000..9dc4bc0 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/roles_privs.html @@ -0,0 +1,1381 @@ + + + + + + + + + + + + Using HAWQ Native Authorization | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + +
[50/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/BackingUpandRestoringHAWQDatabases.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/BackingUpandRestoringHAWQDatabases.html b/docs/userguide/2.3.0.0-incubating/admin/BackingUpandRestoringHAWQDatabases.html new file mode 100644 index 000..99a7e5c --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/BackingUpandRestoringHAWQDatabases.html @@ -0,0 +1,1414 @@ + + + + + + + + + + + + Backing Up and Restoring HAWQ | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization +
[10/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/BasicDataOperations.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/BasicDataOperations.html b/docs/userguide/2.3.0.0-incubating/datamgmt/BasicDataOperations.html new file mode 100644 index 000..0c77e1b --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/BasicDataOperations.html @@ -0,0 +1,1127 @@ + + + + + + + + + + + + Basic Data Operations | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + +
[28/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/operating_hawq_bestpractices.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/operating_hawq_bestpractices.html b/docs/userguide/2.3.0.0-incubating/bestpractices/operating_hawq_bestpractices.html new file mode 100644 index 000..2d71c83 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/operating_hawq_bestpractices.html @@ -0,0 +1,1358 @@ + + + + + + + + + + + + Best Practices for Operating HAWQ | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorizati
[03/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/load/creating-external-tables-examples.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/load/creating-external-tables-examples.html b/docs/userguide/2.3.0.0-incubating/datamgmt/load/creating-external-tables-examples.html new file mode 100644 index 000..02f0afb --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/load/creating-external-tables-examples.html @@ -0,0 +1,1174 @@ + + + + + + + + + + + + Creating External Tables - Examples | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using
[38/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/maintain.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/maintain.html b/docs/userguide/2.3.0.0-incubating/admin/maintain.html new file mode 100644 index 000..6152a9a --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/maintain.html @@ -0,0 +1,1084 @@ + + + + + + + + + + + + Routine System Maintenance Tasks | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Mana
[47/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/FaultTolerance.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/FaultTolerance.html b/docs/userguide/2.3.0.0-incubating/admin/FaultTolerance.html new file mode 100644 index 000..24e1f8e --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/FaultTolerance.html @@ -0,0 +1,1118 @@ + + + + + + + + + + + + Understanding the Fault Tolerance Service | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + +
[33/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/HAWQBestPracticesOverview.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/HAWQBestPracticesOverview.html b/docs/userguide/2.3.0.0-incubating/bestpractices/HAWQBestPracticesOverview.html new file mode 100644 index 000..15bc400 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/HAWQBestPracticesOverview.html @@ -0,0 +1,1092 @@ + + + + + + + + + + + + Best Practices | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + +
[43/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/RecommendedMonitoringTasks.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/RecommendedMonitoringTasks.html b/docs/userguide/2.3.0.0-incubating/admin/RecommendedMonitoringTasks.html new file mode 100644 index 000..e8d13d1 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/RecommendedMonitoringTasks.html @@ -0,0 +1,1331 @@ + + + + + + + + + + + + Recommended Monitoring and Maintenance Tasks | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + +
[48/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/ClusterShrink.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/ClusterShrink.html b/docs/userguide/2.3.0.0-incubating/admin/ClusterShrink.html new file mode 100644 index 000..5d7128b --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/ClusterShrink.html @@ -0,0 +1,1115 @@ + + + + + + + + + + + + Removing a Node | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy M
[08/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/HAWQInputFormatforMapReduce.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/HAWQInputFormatforMapReduce.html b/docs/userguide/2.3.0.0-incubating/datamgmt/HAWQInputFormatforMapReduce.html new file mode 100644 index 000..193b3f9 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/HAWQInputFormatforMapReduce.html @@ -0,0 +1,1475 @@ + + + + + + + + + + + + HAWQ InputFormat for MapReduce | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + +
[14/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-userauth.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-userauth.html b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-userauth.html new file mode 100644 index 000..3457787 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/kerberos-userauth.html @@ -0,0 +1,1431 @@ + + + + + + + + + + + + Configuring Kerberos User Authentication for HAWQ | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + +
[37/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/monitor.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/monitor.html b/docs/userguide/2.3.0.0-incubating/admin/monitor.html new file mode 100644 index 000..522e631 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/monitor.html @@ -0,0 +1,2346 @@ + + + + + + + + + + + + Monitoring a HAWQ System | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Management +
[12/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/ldap.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/ldap.html b/docs/userguide/2.3.0.0-incubating/clientaccess/ldap.html new file mode 100644 index 000..7910558 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/ldap.html @@ -0,0 +1,1163 @@ + + + + + + + + + + + + Using LDAP Authentication with TLS/SSL | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of
[25/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/client_auth.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/client_auth.html b/docs/userguide/2.3.0.0-incubating/clientaccess/client_auth.html new file mode 100644 index 000..68060b7 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/client_auth.html @@ -0,0 +1,1267 @@ + + + + + + + + + + + + Configuring Client Authentication | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + +
[18/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/hawq-access-checks.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/hawq-access-checks.html b/docs/userguide/2.3.0.0-incubating/clientaccess/hawq-access-checks.html new file mode 100644 index 000..af4fa80 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/hawq-access-checks.html @@ -0,0 +1,1133 @@ + + + + + + + + + + + + Overview of HAWQ Authorization | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + +
[36/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/packcore.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/packcore.html b/docs/userguide/2.3.0.0-incubating/admin/packcore.html new file mode 100644 index 000..9a593ba --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/packcore.html @@ -0,0 +1,1100 @@ + + + + + + + + + + + + HAWQ packcore utility | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Management +
[52/52] incubator-hawq-site git commit: Update /latest redirect to point to 2.3.0.0-incubating
Update /latest redirect to point to 2.3.0.0-incubating Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/commit/6c0ec165 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/tree/6c0ec165 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/diff/6c0ec165 Branch: refs/heads/asf-site Commit: 6c0ec1659768284f8d5cfc6a2653304ca49f657a Parents: 65b1283 Author: David Yozie Authored: Tue Mar 20 17:08:25 2018 -0700 Committer: David Yozie Committed: Tue Mar 20 17:08:25 2018 -0700 -- docs/userguide/latest/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/6c0ec165/docs/userguide/latest/index.html -- diff --git a/docs/userguide/latest/index.html b/docs/userguide/latest/index.html index 3c41811..2c78713 100644 --- a/docs/userguide/latest/index.html +++ b/docs/userguide/latest/index.html @@ -3,7 +3,7 @@ -window.location = "/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html"; +window.location = "/docs/userguide/2.3.0.0-incubating/overview/HAWQOverview.html";
[06/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/about_statistics.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/about_statistics.html b/docs/userguide/2.3.0.0-incubating/datamgmt/about_statistics.html new file mode 100644 index 000..2315ac5 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/about_statistics.html @@ -0,0 +1,1291 @@ + + + + + + + + + + + + About Database Statistics | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + +
[07/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/Transactions.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/Transactions.html b/docs/userguide/2.3.0.0-incubating/datamgmt/Transactions.html new file mode 100644 index 000..197978d --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/Transactions.html @@ -0,0 +1,1130 @@ + + + + + + + + + + + + Working with Transactions | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview
[31/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/general_bestpractices.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/general_bestpractices.html b/docs/userguide/2.3.0.0-incubating/bestpractices/general_bestpractices.html new file mode 100644 index 000..f865f1e --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/general_bestpractices.html @@ -0,0 +1,1094 @@ + + + + + + + + + + + + HAWQ Best Practices | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + +
[29/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/bestpractices/managing_resources_bestpractices.html -- diff --git a/docs/userguide/2.3.0.0-incubating/bestpractices/managing_resources_bestpractices.html b/docs/userguide/2.3.0.0-incubating/bestpractices/managing_resources_bestpractices.html new file mode 100644 index 000..5bcaae3 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/bestpractices/managing_resources_bestpractices.html @@ -0,0 +1,1199 @@ + + + + + + + + + + + + Best Practices for Managing Resources | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ra
[02/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-about-gpfdist-setup-and-performance.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-about-gpfdist-setup-and-performance.html b/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-about-gpfdist-setup-and-performance.html new file mode 100644 index 000..50f7624 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-about-gpfdist-setup-and-performance.html @@ -0,0 +1,1092 @@ + + + + + + + + + + + + About gpfdist Setup and Performance | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +
[23/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/g-connecting-with-psql.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/g-connecting-with-psql.html b/docs/userguide/2.3.0.0-incubating/clientaccess/g-connecting-with-psql.html new file mode 100644 index 000..ccba9d6 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/g-connecting-with-psql.html @@ -0,0 +1,1089 @@ + + + + + + + + + + + + Connecting with psql | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + +
[24/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/disable-kerberos.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/disable-kerberos.html b/docs/userguide/2.3.0.0-incubating/clientaccess/disable-kerberos.html new file mode 100644 index 000..fe14bc8 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/disable-kerberos.html @@ -0,0 +1,1168 @@ + + + + + + + + + + + + Disabling Kerberos Security | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + +
[46/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/HAWQFilespacesandHighAvailabilityEnabledHDFS.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/HAWQFilespacesandHighAvailabilityEnabledHDFS.html b/docs/userguide/2.3.0.0-incubating/admin/HAWQFilespacesandHighAvailabilityEnabledHDFS.html new file mode 100644 index 000..3f88bba --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/HAWQFilespacesandHighAvailabilityEnabledHDFS.html @@ -0,0 +1,1285 @@ + + + + + + + + + + + + HAWQ Filespaces and High Availability Enabled HDFS | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +
[09/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/ConcurrencyControl.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/ConcurrencyControl.html b/docs/userguide/2.3.0.0-incubating/datamgmt/ConcurrencyControl.html new file mode 100644 index 000..ca29519 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/ConcurrencyControl.html @@ -0,0 +1,1120 @@ + + + + + + + + + + + + Concurrency Control | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + +
[01/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
Repository: incubator-hawq-site Updated Branches: refs/heads/asf-site 147646e1a -> 6c0ec1659 http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-character-encoding.html -- diff --git a/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-character-encoding.html b/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-character-encoding.html new file mode 100644 index 000..b1e8e36 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/datamgmt/load/g-character-encoding.html @@ -0,0 +1,1075 @@ + + + + + + + + + + + + Character Encoding | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +
[19/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/g-troubleshooting-connection-problems.html -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/g-troubleshooting-connection-problems.html b/docs/userguide/2.3.0.0-incubating/clientaccess/g-troubleshooting-connection-problems.html new file mode 100644 index 000..741add7 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/g-troubleshooting-connection-problems.html @@ -0,0 +1,1099 @@ + + + + + + + + + + + + Troubleshooting Connection Problems | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +
[35/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/admin/setuphawqopenv.html -- diff --git a/docs/userguide/2.3.0.0-incubating/admin/setuphawqopenv.html b/docs/userguide/2.3.0.0-incubating/admin/setuphawqopenv.html new file mode 100644 index 000..52524a4 --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/admin/setuphawqopenv.html @@ -0,0 +1,1185 @@ + + + + + + + + + + + + Introducing the HAWQ Operating Environment | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + +HAWQ Packcore Utility + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + +
[17/52] [partial] incubator-hawq-site git commit: Add build of 2.3.0.0-incubating generated html
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/65b12831/docs/userguide/2.3.0.0-incubating/clientaccess/index -- diff --git a/docs/userguide/2.3.0.0-incubating/clientaccess/index b/docs/userguide/2.3.0.0-incubating/clientaccess/index new file mode 100644 index 000..4198d6e --- /dev/null +++ b/docs/userguide/2.3.0.0-incubating/clientaccess/index @@ -0,0 +1,33 @@ + + +This section explains how to configure client connections and authentication for HAWQ: + + + Configuring Client Authentication + Using LDAP Authentication with TLS/SSL + Using Kerberos Authentication + Disabling Kerberos Security + Managing Roles and Privileges + Establishing a Database Session + HAWQ Client Applications + Connecting with psql + Database Application Interfaces + Troubleshooting Connection Problems +
[3/3] incubator-hawq-docs git commit: updating book build for 2.3 release
updating book build for 2.3 release Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/3c188fdf Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/3c188fdf Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/3c188fdf Branch: refs/heads/master Commit: 3c188fdf1251cac9d5d3bbec6052561bf39e8ab9 Parents: ca730a4 Author: David Yozie Authored: Tue Mar 20 17:02:52 2018 -0700 Committer: David Yozie Committed: Tue Mar 20 17:02:52 2018 -0700 -- book/config.yml |2 +- .../source/subnavs/apache-hawq-nav.erb | 1304 +- book/redirects.rb |6 +- 3 files changed, 656 insertions(+), 656 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/3c188fdf/book/config.yml -- diff --git a/book/config.yml b/book/config.yml index ee8aa49..a687e88 100644 --- a/book/config.yml +++ b/book/config.yml @@ -5,7 +5,7 @@ public_host: http://localhost:9292/ sections: - repository: name: incubator-hawq-docs/markdown - directory: docs/userguide/2.2.0.0-incubating + directory: docs/userguide/2.3.0.0-incubating subnav_template: apache-hawq-nav template_variables:
[1/3] incubator-hawq-docs git commit: updating book build for 2.3 release
Repository: incubator-hawq-docs Updated Branches: refs/heads/master ca730a426 -> 3c188fdf1 http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/3c188fdf/book/redirects.rb -- diff --git a/book/redirects.rb b/book/redirects.rb index 6c580a0..08a8453 100644 --- a/book/redirects.rb +++ b/book/redirects.rb @@ -1,4 +1,4 @@ -r301 '/', '/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html' -r301 '/index.html', '/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html' -r301 '/docs', '/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html' +r301 '/', '/docs/userguide/2.3.0.0-incubating/overview/HAWQOverview.html' +r301 '/index.html', '/docs/userguide/2.3.0.0-incubating/overview/HAWQOverview.html' +r301 '/docs', '/docs/userguide/2.3.0.0-incubating/overview/HAWQOverview.html'
[2/3] incubator-hawq-docs git commit: updating book build for 2.3 release
http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/3c188fdf/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index 775c164..2ad8949 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -5,7 +5,7 @@ Apache HAWQ (incubating) - System Requirements + System Requirements @@ -13,51 +13,51 @@ -What is HAWQ? +What is HAWQ? -HAWQ Architecture +HAWQ Architecture -Table Distribution and Storage +Table Distribution and Storage -Elastic Query Execution Runtime +Elastic Query Execution Runtime -Resource Management +Resource Management -HDFS Catalog Cache +HDFS Catalog Cache -Management Tools +Management Tools -High Availability, Redundancy and Fault Tolerance +High Availability, Redundancy and Fault Tolerance -Getting Started with HAWQ Tutorial +Getting Started with HAWQ Tutorial - Lesson 1 - Runtime Environment + Lesson 1 - Runtime Environment - Lesson 2 - Cluster Administration + Lesson 2 - Cluster Administration - Lesson 3 - Database Administration + Lesson 3 - Database Administration - Lesson 4 - Sample Data Set and HAWQ Schemas + Lesson 4 - Sample Data Set and HAWQ Schemas - Lesson 5 - HAWQ Tables + Lesson 5 - HAWQ Tables - Lesson 6 - HAWQ Extension Framework (PXF) + Lesson 6 - HAWQ Extension Framework (PXF) @@ -68,57 +68,57 @@ -Overview +Overview -Introducing the HAWQ Operating Environment +Introducing the HAWQ Operating Environment -Managing HAWQ Using Ambari +Managing HAWQ Using Ambari - Using the Ambari REST API + Using the Ambari REST API -Starting and Stopping HAWQ +Starting and Stopping HAWQ -Expanding a Cluster +Expanding a Cluster -Removing a Node +Removing a Node -Backing Up and Restoring HAWQ +Backing Up and Restoring HAWQ -High Availability in HAWQ +High Availability in HAWQ -Master Mirroring +Master Mirroring -HAWQ Filespaces and High Availability Enabled HDFS +HAWQ Filespaces and High Availability Enabled HDFS -Understanding the Fault Tolerance Service +Understanding the Fault Tolerance Service -Recommended Monitoring and Maintenance Tasks +Recommended Monitoring and Maintenance Tasks -Routine System Maintenance Tasks +Routine System Maintenance Tasks -Monitoring a HAWQ System +Monitoring a HAWQ System -HAWQ Administrative Log Files +HAWQ Administrative Log Files -HAWQ Packcore Utility +HAWQ Packcore Utility @@ -128,22 +128,22 @@ -How HAWQ Manages Resources +How HAWQ Manages Resources -Best Practices for Configuring Resource Management +Best Practices for Configuring Resource Management -Configuring Resource Management +Configuring Resource Management -Integrating YARN with HAWQ +Integrating YARN with HAWQ -Working with Hierarchical Resource Queues +Working with Hierarc
incubator-hawq-docs git commit: updating bookbinder release to address nokogiri security warning
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 848d45a56 -> ca730a426 updating bookbinder release to address nokogiri security warning Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/ca730a42 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/ca730a42 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/ca730a42 Branch: refs/heads/master Commit: ca730a426642a0e5b4bf01c4300f87bcdaf7e807 Parents: 848d45a Author: David Yozie Authored: Wed Feb 7 08:39:09 2018 -0800 Committer: David Yozie Committed: Wed Feb 7 08:39:09 2018 -0800 -- book/Gemfile.lock | 196 + 1 file changed, 99 insertions(+), 97 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/ca730a42/book/Gemfile.lock -- diff --git a/book/Gemfile.lock b/book/Gemfile.lock index 3c483c0..7bcd1e6 100644 --- a/book/Gemfile.lock +++ b/book/Gemfile.lock @@ -1,43 +1,40 @@ GEM remote: https://rubygems.org/ specs: -activesupport (4.2.7.1) +activesupport (4.2.10) i18n (~> 0.7) - json (~> 1.7, >= 1.7.7) minitest (~> 5.1) thread_safe (~> 0.3, >= 0.3.4) tzinfo (~> 1.1) -addressable (2.4.0) +addressable (2.5.2) + public_suffix (>= 2.0.2, < 4.0) ansi (1.5.0) -bookbindery (9.12.0) +backports (3.11.1) +bookbindery (10.1.12) ansi (~> 1.4) css_parser elasticsearch fog-aws (~> 0.7.1) font-awesome-sass git (~> 1.2.8) - middleman (~> 3.4.0) - middleman-livereload (~> 3.4.3) - middleman-syntax (~> 2.0) - nokogiri (= 1.6.7.2) + middleman (= 4.1.10) + middleman-compass + middleman-livereload + middleman-sprockets + middleman-syntax (= 2.1.0) + nokogiri (= 1.8.1) puma rack-rewrite redcarpet (~> 3.2.3) rouge (!= 1.9.1) therubyracer - thor -builder (3.2.2) -capybara (2.4.4) - mime-types (>= 1.16) - nokogiri (>= 1.3.3) - rack (>= 1.0.0) - rack-test (>= 0.5.4) - xpath (~> 2.0) -chunky_png (1.3.6) + thor (= 0.19.1) +builder (3.2.3) +chunky_png (1.3.10) coffee-script (2.4.1) coffee-script-source execjs -coffee-script-source (1.10.0) +coffee-script-source (1.12.2) compass (1.0.3) chunky_png (~> 1.2) compass-core (~> 1.0.2) @@ -50,147 +47,152 @@ GEM sass (>= 3.3.0, < 3.5) compass-import-once (1.0.5) sass (>= 3.2, < 3.5) -css_parser (1.4.5) +concurrent-ruby (1.0.5) +contracts (0.13.0) +css_parser (1.6.0) addressable -elasticsearch (2.0.0) - elasticsearch-api (= 2.0.0) - elasticsearch-transport (= 2.0.0) -elasticsearch-api (2.0.0) +dotenv (2.2.1) +elasticsearch (6.0.1) + elasticsearch-api (= 6.0.1) + elasticsearch-transport (= 6.0.1) +elasticsearch-api (6.0.1) multi_json -elasticsearch-transport (2.0.0) +elasticsearch-transport (6.0.1) faraday multi_json em-websocket (0.5.1) eventmachine (>= 0.12.9) http_parser.rb (~> 0.6.0) erubis (2.7.0) -eventmachine (1.2.0.1) -excon (0.51.0) +eventmachine (1.2.5) +excon (0.60.0) execjs (2.7.0) -faraday (0.9.2) +faraday (0.14.0) multipart-post (>= 1.2, < 3) -ffi (1.9.14) +fast_blank (1.0.0) +fastimage (2.1.1) +ffi (1.9.21) fog-aws (0.7.6) fog-core (~> 1.27) fog-json (~> 1.0) fog-xml (~> 0.1) ipaddress (~> 0.8) -fog-core (1.42.0) +fog-core (1.45.0) builder - excon (~> 0.49) + excon (~> 0.58) formatador (~> 0.2) fog-json (1.0.2) fog-core (~> 1.0) multi_json (~> 1.10) -fog-xml (0.1.2) +fog-xml (0.1.3) fog-core - nokogiri (~> 1.5, >= 1.5.11) -font-awesome-sass (4.6.2) + nokogiri (>= 1.5.11, < 2.0.0) +font-awesome-sass (4.7.0) sass (>= 3.2) formatador (0.2.5) git (1.2.9.1) -haml (4.0.7) +haml (5.0.4) + temple (>= 0.8.0) tilt -hike (1.2.3) -hooks (0.4.1) - uber (~> 0.0.14) +hamster (3.0.0) + concurrent-ruby (~> 1.0) +hashie (3.5.7) http_parser.rb (0.6.0) i18n (0.7.0) ipaddress (0.8.3) -json (1.8.3) -kramdown (1.12.0) +kramdown (1.16.2) libv8 (3.16.14.7) listen (3.0.8) rb-fsevent (~> 0.9, >= 0.9.4) rb-inotify (~> 0.9, >= 0.9.7) -middleman (3.4.1) +
incubator-hawq-docs git commit: HAWQ-1562 Fixed incorrect path to default log directory (closes #136)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master a04f8cae1 -> 848d45a56 HAWQ-1562 Fixed incorrect path to default log directory (closes #136) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/848d45a5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/848d45a5 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/848d45a5 Branch: refs/heads/master Commit: 848d45a568e7a7a223a781e6988440d59f255f6e Parents: a04f8ca Author: Shubham Sharma Authored: Tue Feb 6 09:15:20 2018 -0800 Committer: David Yozie Committed: Tue Feb 6 09:15:20 2018 -0800 -- markdown/reference/cli/admin_utilities/hawqactivate.html.md.erb | 2 +- markdown/reference/cli/admin_utilities/hawqinit.html.md.erb | 2 +- markdown/reference/cli/admin_utilities/hawqload.html.md.erb | 2 +- markdown/reference/cli/admin_utilities/hawqrestart.html.md.erb | 2 +- markdown/reference/cli/admin_utilities/hawqstart.html.md.erb| 2 +- markdown/reference/cli/admin_utilities/hawqstop.html.md.erb | 2 +- 6 files changed, 6 insertions(+), 6 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/848d45a5/markdown/reference/cli/admin_utilities/hawqactivate.html.md.erb -- diff --git a/markdown/reference/cli/admin_utilities/hawqactivate.html.md.erb b/markdown/reference/cli/admin_utilities/hawqactivate.html.md.erb index 1dafe54..e3ba135 100644 --- a/markdown/reference/cli/admin_utilities/hawqactivate.html.md.erb +++ b/markdown/reference/cli/admin_utilities/hawqactivate.html.md.erb @@ -75,7 +75,7 @@ Fast shut down interrupts and rolls back any transactions currently in progress. Immediate shutdown aborts transactions in progress and kills all `postgres` processes without allowing the database server to complete transaction processing or clean up any temporary or in-process work files. Because of this, immediate shutdown is not recommended. In some instances, it can cause database corruption that requires manual recovery. -l, -\\\-logdir \ -Specifies the log directory for logs of the management tools. The default is `~/hawq/Adminlogs/`. +Specifies the log directory for logs of the management tools. The default is `~/hawqAdminLogs/`. -v, -\\\-verbose Displays detailed status, progress and error messages output by the utility. http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/848d45a5/markdown/reference/cli/admin_utilities/hawqinit.html.md.erb -- diff --git a/markdown/reference/cli/admin_utilities/hawqinit.html.md.erb b/markdown/reference/cli/admin_utilities/hawqinit.html.md.erb index 46069d8..364145d 100644 --- a/markdown/reference/cli/admin_utilities/hawqinit.html.md.erb +++ b/markdown/reference/cli/admin_utilities/hawqinit.html.md.erb @@ -116,7 +116,7 @@ If the primary master fails, the log replication process is shut down. Run the ` -l, -\\\-logdir \ -The directory to write the log file. Defaults to `~/hawq/AdminLogs`. +The directory to write the log file. Defaults to `~/hawqAdminLogs`. -q, -\\\-quiet (no screen output) Run in quiet mode. Command output is not displayed on the screen, but is still written to the log file. http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/848d45a5/markdown/reference/cli/admin_utilities/hawqload.html.md.erb -- diff --git a/markdown/reference/cli/admin_utilities/hawqload.html.md.erb b/markdown/reference/cli/admin_utilities/hawqload.html.md.erb index 45aa182..7a5bf2e 100644 --- a/markdown/reference/cli/admin_utilities/hawqload.html.md.erb +++ b/markdown/reference/cli/admin_utilities/hawqload.html.md.erb @@ -76,7 +76,7 @@ The operation, including any SQL commands specified in the `SQL` collection of t Sets the timeout for the `gpfdist` parallel file distribution program to send a response. Enter a value from `0` to `30` seconds (entering "`0`" to disables timeouts). Note that you might need to increase this value when operating on high-traffic networks. -l <log\_file> -Specifies where to write the log file. Defaults to `~/hawq/Adminlogs/hawq_load_MMDD`. For more information about the log file, see [Log File Format](#topic1__section9). +Specifies where to write the log file. Defaults to `~/hawqAdminLogs/hawq_load_MMDD`. For more information about the log file, see [Log File Format](#topic1__section9). -q (no screen output) Run in quiet mode. Command output is not displayed on the screen, but is still written to the log file. http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blo
incubator-hawq-docs git commit: server_ticket_renew_interval guc, YARN HA props (closes #133) (closes #131)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 501b7d588 -> a04f8cae1 server_ticket_renew_interval guc, YARN HA props (closes #133) (closes #131) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/a04f8cae Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/a04f8cae Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/a04f8cae Branch: refs/heads/master Commit: a04f8cae10c6c33fba0886d779dbd3b10aae2c4a Parents: 501b7d5 Author: Lisa Owen Authored: Fri Oct 27 09:48:43 2017 -0700 Committer: David Yozie Committed: Fri Oct 27 09:48:43 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 1 + .../kerberos-securehdfs.html.md.erb | 36 .../guc/parameter_definitions.html.md.erb | 14 +++- .../resourcemgmt/YARNIntegration.html.md.erb| 2 ++ 4 files changed, 52 insertions(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a04f8cae/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index 30bdba8..775c164 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -800,6 +800,7 @@ seg_max_connections seq_page_cost server_encoding + server_ticket_renew_interval server_version server_version_num shared_buffers http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a04f8cae/markdown/clientaccess/kerberos-securehdfs.html.md.erb -- diff --git a/markdown/clientaccess/kerberos-securehdfs.html.md.erb b/markdown/clientaccess/kerberos-securehdfs.html.md.erb index 27369e5..c124597 100644 --- a/markdown/clientaccess/kerberos-securehdfs.html.md.erb +++ b/markdown/clientaccess/kerberos-securehdfs.html.md.erb @@ -217,3 +217,39 @@ Perform the following steps to configure HAWQ and PXF for a secure HDFS. You wil ``` shell gpadmin@master$ hawq restart cluster -a -M fast ``` + +## Setting the HAWQ Kerberos Ticket Renewal Interval + +The HAWQ [`server_ticket_renew_interval`](../reference/guc/parameter_definitions.html#server_ticket_renew_interval) server configuration parameter governs the HAWQ HDFS client Kerberos ticket renewal interval. The default ticket renewal interval is 12 hours. + +You configure the lifetime of a Kerberos ticket when you set up your KDC. To avoid ticket expiration, set the `server_ticket_renew_interval` to a value that is less than the lifetime of the ticket. + + Procedure + +You will perform different procedures to set the ticket renewal interval if you manage your cluster from the command line or use Ambari to manage your cluster. + +1. If you manage your cluster using Ambari: + +1. Login in to the Ambari UI from a supported web browser. + +2. Navigate to the **HAWQ** service, **Configs > Advanced** tab and expand the **Custom hawq-site** drop down. + +3. Set the `server_ticket_renew_interval` value to the desired ticket renewal interval in milliseconds. + +4. **Save** this configuration change and then select the now orange **Restart > Restart All Affected** menu button to restart your HAWQ cluster. + +5. Exit the Ambari UI. + +2. If you manage your cluster from the command line: + +1. Use the `hawq config` command to update the `server_ticket_renew_interval` configuration parameter. For example: + +``` shell +gpadmin@master$ hawq config -c server_ticket_renew_interval -v 8640 +``` + +2. Restart your HAWQ cluster: + +``` shell +gpadmin@master$ hawq restart cluster +``` http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a04f8cae/markdown/reference/guc/parameter_definitions.html.md.erb -- diff --git a/markdown/reference/guc/parameter_definitions.html.md.erb b/markdown/reference/guc/parameter_definitions.html.md.erb index a652f72..9fda140 100644 --- a/markdown/reference/guc/parameter_definitions.html.md.erb +++ b/markdown/reference/guc/parameter_definitions.html.md.erb @@ -478,6 +478,8 @@ Descriptions of the HAWQ server configuration parameters listed alphabetically. - **[server\_encoding](../../reference/guc/parameter_definitions.html#server_encoding)** +- **[server\_ticket\_renew\_interval](../../
incubator-hawq-docs git commit: add support for active directory KDC server (closes #132)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master bce28faa4 -> 501b7d588 add support for active directory KDC server (closes #132) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/501b7d58 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/501b7d58 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/501b7d58 Branch: refs/heads/master Commit: 501b7d5885b3d2029d6687d50b6f91073cdf65fc Parents: bce28fa Author: Lisa Owen Authored: Thu Oct 26 14:29:23 2017 -0700 Committer: David Yozie Committed: Thu Oct 26 14:29:23 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 13 +- .../clientaccess/kerberos-mitkdc.html.md.erb| 113 .../kerberos-securehdfs.html.md.erb | 219 ++ .../clientaccess/kerberos-userauth.html.md.erb | 459 + markdown/clientaccess/kerberos.html.md.erb | 670 +-- 5 files changed, 815 insertions(+), 659 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/501b7d58/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index 03f0755..30bdba8 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -158,8 +158,19 @@ Using LDAP Authentication with TLS/SSL - + Using Kerberos Authentication + + +Configuring HAWQ/PXF for Secure HDFS + + +Configuring Kerberos User Authentication for HAWQ + + +Example - Setting up an MIT KDC Server + + Disabling Kerberos Security http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/501b7d58/markdown/clientaccess/kerberos-mitkdc.html.md.erb -- diff --git a/markdown/clientaccess/kerberos-mitkdc.html.md.erb b/markdown/clientaccess/kerberos-mitkdc.html.md.erb new file mode 100644 index 000..32b1040 --- /dev/null +++ b/markdown/clientaccess/kerberos-mitkdc.html.md.erb @@ -0,0 +1,113 @@ +--- +title: Example - Setting up an MIT KDC Server +--- + + + +Follow this procedure to install and configure a Kerberos KDC server on a Red Hat Enterprise Linux host. The KDC server resides on the host named \. + +1. Log in to the Kerberos KDC Server system as a superuser: + +``` shell +$ ssh root@ +root@kdc-server$ +``` + +2. Install the Kerberos server packages: + +``` shell +root@kdc-server$ yum install krb5-libs krb5-server krb5-workstation +``` + +3. Define the Kerberos realm for your cluster by editting the `/etc/krb5.conf` configuration file. The following example configures a Kerberos server with a realm named `REALM.DOMAIN` residing on a host named `hawq-kdc`. + +``` +[logging] +Â default = FILE:/var/log/krb5libs.log +Â kdc = FILE:/var/log/krb5kdc.log +Â admin_server = FILE:/var/log/kadmind.log + +[libdefaults] +Â default_realm = REALM.DOMAIN +Â dns_lookup_realm = false +Â dns_lookup_kdc = false +Â ticket_lifetime = 24h +Â renew_lifetime = 7d +Â forwardable = true +Â default_tgs_enctypes = aes128-cts des3-hmac-sha1 des-cbc-crc des-cbc-md5 +Â default_tkt_enctypes = aes128-cts des3-hmac-sha1 des-cbc-crc des-cbc-md5 +Â permitted_enctypes = aes128-cts des3-hmac-sha1 des-cbc-crc des-cbc-md5 + +[realms] +Â REALM.DOMAIN = { +Â Â kdc = hawq-kdc:88 +Â Â admin_server = hawq-kdc:749 +Â Â default_domain = hawq-kdc + } + +[domain_realm] +Â .hawq-kdc = REALM.DOMAIN +Â hawq-kdc = REALM.DOMAIN + +[appdefaults] +Â pam = { +Â Â Â Â debug = false +Â Â Â Â ticket_lifetime = 36000 +Â Â Â Â renew_lifetime = 36000 +Â Â Â Â forwardable = true +Â Â Â Â krb4_convert = false + } +``` + +The `kdc` and `admin_server` keys in the `[realms]` section specify the host \(`hawq-kdc`\) and port on which the Kerberos server is running. You can use an IP address in place of a host name. + +If your Kerberos server manages authentication for other realms, you would instead add the `REALM.DOMAINM` realm in the `[realms]` and `[domain_realm]` sections of the `krb5.conf` file. See the [Kerberos documentation](http://web.mit.edu/kerberos/krb5-latest/doc/) for detailed information about the `krb5.conf` configuration file. + +4. Note
incubator-hawq-docs git commit: HAWQ-1480 - Added documentation for packcore utility (closes #123)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 53ccf3db3 -> bce28faa4 HAWQ-1480 - Added documentation for packcore utility (closes #123) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/bce28faa Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/bce28faa Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/bce28faa Branch: refs/heads/master Commit: bce28faa46e08d84116bfb1dad02047cf9224174 Parents: 53ccf3d Author: outofmem0ry Authored: Thu Oct 12 10:10:44 2017 -0700 Committer: David Yozie Committed: Thu Oct 12 10:10:44 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 3 ++ markdown/admin/packcore.html.md.erb | 55 2 files changed, 58 insertions(+) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/bce28faa/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index f473dab..03f0755 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -117,6 +117,9 @@ HAWQ Administrative Log Files + +HAWQ Packcore Utility + http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/bce28faa/markdown/admin/packcore.html.md.erb -- diff --git a/markdown/admin/packcore.html.md.erb b/markdown/admin/packcore.html.md.erb new file mode 100644 index 000..a34a722 --- /dev/null +++ b/markdown/admin/packcore.html.md.erb @@ -0,0 +1,55 @@ +--- +title: HAWQ packcore utility +--- + + + +## Core file + +A core file is a disk file that records the memory image of a running process in the event the process crashes or terminates abruptly. The information in this image is useful for debugging the state of a process at the time when it was terminated. + +## Packcore + +The packcore utility helps pack a core file with its context, including the executable, application, and shared system libraries from the current environment. This information can be unpacked for later debugging on a different system. Packcore extracts the name of the binary that generated the core from the core file, then executes ldd (List Dynamic Dependencies) to create a single tar archive containing the core file information. + +### Using packcore + +The packcore utility is located under `${GPHOME}/sbin`. Run one of the following commands to pack a core file: + +```shell +$ $GPHOME/sbin/packcore +``` + +or + +```shell +$ $GPHOME/sbin/packcore -b|--binary $GPHOME/bin/postgres +``` + +Alternatively, you can navigate to `$GPHOME/sbin` and run the following: + +```shell +$ ./packcore +``` + +or + +```shell +$ ./packcore -b|--binary $GPHOME/bin/postgres +``` +When processing is completed, the utility creates a tar file in the format: packcore-.tgz. Unpack this file on another system to use it for debugging.
incubator-hawq-docs git commit: Unnecessary to put zlib in PATH (closes #130)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 2eb9c1534 -> 53ccf3db3 Unnecessary to put zlib in PATH (closes #130) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/53ccf3db Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/53ccf3db Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/53ccf3db Branch: refs/heads/master Commit: 53ccf3db354531d57b933b680d58d3380ed5bf83 Parents: 2eb9c15 Author: Chuck Litzell Authored: Tue Sep 19 13:22:52 2017 -0700 Committer: David Yozie Committed: Tue Sep 19 13:22:52 2017 -0700 -- markdown/reference/guc/parameter_definitions.html.md.erb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/53ccf3db/markdown/reference/guc/parameter_definitions.html.md.erb -- diff --git a/markdown/reference/guc/parameter_definitions.html.md.erb b/markdown/reference/guc/parameter_definitions.html.md.erb index d4968e0..a652f72 100644 --- a/markdown/reference/guc/parameter_definitions.html.md.erb +++ b/markdown/reference/guc/parameter_definitions.html.md.erb @@ -1805,7 +1805,7 @@ Adds a checksum value to each block of a work file (or spill file) used by `Hash ## gp\_workfile\_compress\_algorithm -When a hash aggregation or hash join operation spills to disk during query processing, specifies the compression algorithm to use on the spill files. If using zlib, it must be in your $PATH on all segments. +When a hash aggregation or hash join operation spills to disk during query processing, specifies the compression algorithm to use on the spill files. If your HAWQ database installation uses serial ATA (SATA) disk drives, setting the value of this parameter to `zlib` might help to avoid overloading the disk subsystem with IO operations.
incubator-hawq-docs git commit: Update for current implementation of max_connections (closes #129)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 39cd81475 -> 2eb9c1534 Update for current implementation of max_connections (closes #129) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/2eb9c153 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/2eb9c153 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/2eb9c153 Branch: refs/heads/master Commit: 2eb9c153451ab02ca77d3c4a84abc2765a6b0159 Parents: 39cd814 Author: Jane Beckman Authored: Thu Aug 31 12:47:04 2017 -0700 Committer: David Yozie Committed: Thu Aug 31 12:47:04 2017 -0700 -- markdown/clientaccess/client_auth.html.md.erb | 27 +++- ...ubleshooting-connection-problems.html.md.erb | 2 +- .../cli/admin_utilities/hawqinit.html.md.erb| 4 +-- .../reference/guc/guc_category-list.html.md.erb | 2 +- .../guc/parameter_definitions.html.md.erb | 33 ++-- 5 files changed, 18 insertions(+), 50 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/2eb9c153/markdown/clientaccess/client_auth.html.md.erb -- diff --git a/markdown/clientaccess/client_auth.html.md.erb b/markdown/clientaccess/client_auth.html.md.erb index 33dc717..7dd88ee 100644 --- a/markdown/clientaccess/client_auth.html.md.erb +++ b/markdown/clientaccess/client_auth.html.md.erb @@ -99,27 +99,25 @@ This example shows how to edit the `pg_hba.conf` file of the master to allow rem HAWQ allocates some resources on a per-connection basis, so setting the maximum number of connections allowed is recommended. -To limit the number of active concurrent sessions to your HAWQ system, you can configure the `max_connections` server configuration parameter on master or the `seg_max_connections` server configuration parameter on segments. These parameters are *local* parameters, meaning that you must set them in the `hawq-site.xml` file of all HAWQ instances. +To limit the number of active concurrent sessions to your HAWQ system, you can configure the `max_connections` server configuration parameter on the master instance or the `seg_max_connections` server configuration parameter on segments. -When you set `max_connections`, you must also set the dependent parameter `max_prepared_transactions`. This value must be at least as large as the value of `max_connections`, and all HAWQ instances should be set to the same value. +When you set `max_connections`, you can also set the value for the maximum concurrent connections for the segments by using `seg_max_connections`. Example `$GPHOME/etc/hawq-site.xml` configuration: ``` xml max_connections - 500 + 1280 - max_prepared_transactions - 1000 - - - seg_max_connections - 3200 + seg_max_connectionss + 3000 ``` +HAWQ is configured to allow a maximum of 1280 concurrent user connections on the master and 3000 connections on a segment. For best practices, the recommended value for `seg_max_connections` is its default value of 3000. + **Note:** Raising the values of these parameters may cause HAWQ to request more shared memory. To mitigate this effect, consider decreasing other memory-related server configuration parameters such as [gp\_cached\_segworkers\_threshold](../reference/guc/parameter_definitions.html#gp_cached_segworkers_threshold). @@ -129,7 +127,7 @@ You will perform different procedures to set connection-related server configura If you use Ambari to manage your cluster: -1. Set the `max_connections`, `seg_max_connections`, and `max_prepared_transactions` configuration properties via the HAWQ service **Configs > Advanced > Custom hawq-site** drop down. +1. Set the `max_connections` and `seg_max_connections` configuration properties via the HAWQ service **Configs > Advanced > Custom hawq-site** drop down. 2. Select **Service Actions > Restart All** to load the updated configuration. If you manage your cluster from the command line: @@ -140,15 +138,13 @@ If you manage your cluster from the command line: $ source /usr/local/hawq/greenplum_path.sh ``` -2. Use the `hawq config` utility to set the values of the `max_connections`, `seg_max_connections`, and `max_prepared_transactions` parameters to values appropriate for your deployment. For example: +2. Use the `hawq config` utility to set the values of the `max_connections` and `seg_max_connections` parameters to values appropriate for your deployment. For example: ``` bash -$ hawq config -c max_connections -v 100 -$ hawq config -c seg_max_connections -v 6400 -$ hawq config -c max_prepared_transactions
incubator-hawq-docs git commit: HAWQ-1497 - kerberos docs refactoring (closes #127)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master f7d9536ae -> 776ede0e5 HAWQ-1497 - kerberos docs refactoring (closes #127) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/776ede0e Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/776ede0e Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/776ede0e Branch: refs/heads/master Commit: 776ede0e5c4f26864efbb2bcbf50ef879e08da18 Parents: f7d9536 Author: Lisa Owen Authored: Mon Jul 17 11:35:43 2017 -0700 Committer: David Yozie Committed: Mon Jul 17 11:35:43 2017 -0700 -- .../clientaccess/disable-kerberos.html.md.erb | 76 +- ...awq-database-client-applications.html.md.erb | 6 +- markdown/clientaccess/kerberos.html.md.erb | 716 ++- 3 files changed, 602 insertions(+), 196 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/776ede0e/markdown/clientaccess/disable-kerberos.html.md.erb -- diff --git a/markdown/clientaccess/disable-kerberos.html.md.erb b/markdown/clientaccess/disable-kerberos.html.md.erb index 12efe09..2f88fc1 100644 --- a/markdown/clientaccess/disable-kerberos.html.md.erb +++ b/markdown/clientaccess/disable-kerberos.html.md.erb @@ -21,43 +21,49 @@ specific language governing permissions and limitations under the License. --> -Follow these steps to disable Kerberos security for HAWQ and PXF for manual installations. +HAWQ supports Kerberos at both the HDFS and/or user authentication levels. You will perform different disable procedures for each. -**Note:** If you install or manage your cluster using Ambari, then the HAWQ Ambari plug-in automatically disables security for HAWQ and PXF when you disable security for Hadoop. The following instructions are only necessary for manual installations, or when Hadoop security is disabled outside of Ambari. -1. Disable Kerberos on the Hadoop cluster on which you use HAWQ. -2. Disable security for HAWQ: -1. Login to the HAWQ database master server as the `gpadmin` user: +## Disable Kerberized HDFS for HAWQ/PXF -``` bash -$ ssh hawq_master_fqdn -``` +You will perform different procedures to disable HAWQ/PXF access to a previously-kerberized HDFS depending upon whether you manage your cluster from the command line or use Ambari to manage your cluster. + +### Procedure for Ambari-Managed Clusters + +If you manage your cluster using Ambari, you will disable Kerberos authentication for your cluster as described in the [How To Disable Kerberos](https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-user-guide/content/how_to_disable_kerberos.html) Hortonworks documentation. Ambari will guide you through the de-kerberization process, including removing/updating any authentication-related configuration in your cluster. -2. Run the following command to set up HAWQ environment variables: +### Procedure for Command-Line-Managed Clusters + +If you manage your cluster from the command line, follow these instructions to disable HDFS Kerberos security for HAWQ and PXF. + +1. Disable Kerberos on the Hadoop cluster on which you use HAWQ. +2. Disable security for HAWQ: +1. Login to the HAWQ database master server as the `gpadmin` user and set up your HAWQ environment: ``` bash -$ source /usr/local/hawq/greenplum_path.sh +$ ssh gpadmin@ +gpadmin@master$ . /usr/local/hawq/greenplum_path.sh ``` -3. Start HAWQ if necessary: +2. Start HAWQ if necessary: ``` bash -$ hawq start -a +gpadmin@master$ hawq start cluster ``` -4. Run the following command to disable security: +3. Update HAWQ configuration to disable security: ``` bash -$ hawq config --masteronly -c enable_secure_filesystem -v âoffâ +gpadmin@master$ hawq config -c enable_secure_filesystem -v âoffâ ``` -5. Change the permission of the HAWQ HDFS data directory: +4. Change the permission of the HAWQ HDFS data directory: ``` bash -$ sudo -u hdfs hdfs dfs -chown -R gpadmin:gpadmin /hawq_data +gpadmin@master$ sudo -u hdfs hdfs dfs -chown -R gpadmin:gpadmin / ``` -6. On the HAWQ master node and on all segment server nodes, edit the `/usr/local/hawq/etc/hdfs-client.xml` file to disable kerberos security. Comment or remove the following properties in each file: +5. On the HAWQ master node and on all segment server nodes, edit the `/usr/local/hawq/etc/hdfs-client.xml` file to disable kerberos security. Comment or remove the following properties in each file: `
incubator-hawq-docs git commit: HAWQ-1479 - doc ranger kerberos integration (closes #128)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master f6d40aaca -> f7d9536ae HAWQ-1479 - doc ranger kerberos integration (closes #128) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/f7d9536a Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/f7d9536a Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/f7d9536a Branch: refs/heads/master Commit: f7d9536ae242dd2b08a59fc7370ca6df09d3fd23 Parents: f6d40aa Author: Lisa Owen Authored: Mon Jul 17 11:34:07 2017 -0700 Committer: David Yozie Committed: Mon Jul 17 11:34:07 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 3 + .../ranger-integration-config.html.md.erb | 85 +--- markdown/ranger/ranger-kerberos.html.md.erb | 207 +++ markdown/ranger/ranger-overview.html.md.erb | 2 +- 4 files changed, 266 insertions(+), 31 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/f7d9536a/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index 85eb424..f473dab 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -198,6 +198,9 @@ High Availability and HAWQ Ranger + + HAWQ Ranger Kerberos Integration + http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/f7d9536a/markdown/ranger/ranger-integration-config.html.md.erb -- diff --git a/markdown/ranger/ranger-integration-config.html.md.erb b/markdown/ranger/ranger-integration-config.html.md.erb index 7c91d6e..b535042 100644 --- a/markdown/ranger/ranger-integration-config.html.md.erb +++ b/markdown/ranger/ranger-integration-config.html.md.erb @@ -62,44 +62,65 @@ To use HAWQ Ranger integration, install a compatible Hadoop distribution and Apa ``` bash root@ranger-admin-node$ chown -R ranger:ranger hawq ``` -5. The `enable-ranger-plugin.sh` script configures Ranger connectivity to your HAWQ cluster. The command has the syntax: +5. Configure Ranger connectivity to your HAWQ cluster with the `enable-ranger-plugin.sh` script. The command has the syntax: ``` pre -enable-ranger-plugin.sh -r : -u -p -h : -w -q -``` - -Log in to the HAWQ master node as the `gpadmin` user and execute the `enable-ranger-plugin.sh` script. Ensure that \ identifies the fully qualified domain name of the HAWQ master node. For example: - -``` bash -gpadmin@master$ cd /usr/local/hawq/ranger/bin -gpadmin@master$ ./enable-ranger-plugin.sh -r ranger_host:6080 -u admin -p admin -h hawq_master:5432 -w gpadmin -q gpadmin - -RANGER URL = ranger_host:6080 -RANGER User = admin -RANGER Password = [*] -HAWQ HOST = hawq_master -HAWQ PORT = 5432 -HAWQ User = gpadmin -HAWQ Password = [***] -HAWQ service definition was not found in Ranger Admin, creating it by uploading /usr/local/hawq_/ranger/etc/ranger-servicedef-hawq.json -HAWQ service instance was not found in Ranger Admin, creating it. -Updated POLICY_MGR_URL to http://ranger_host:6080 in /usr/local/hawq_/ranger/etc/rps.properties -Updated default value of JAVA_HOME to /usr/jdk64/jdk1.8.0_77 in /usr/local/hawq_/ranger/etc/rps.properties -``` - -**Note**: You can also enter the short form of the command: `./enable-ranger-plugin.sh -r` and the script will prompt you for entries. - +enable-ranger-plugin.sh -r : -u -p [-h : -t -s ] -w -q +``` + + **Note**: You can also enter the short form of the command: `./enable-ranger-plugin.sh -r` and the script will prompt you for entries. + +1. Log in to the HAWQ master node as the `gpadmin` user, set up your HAWQ environment, and navigate to the HAWQ Ranger Plug-in `bin` directory: + +``` bash +$ ssh gpadmin@master +gpadmin@master$ . /usr/local/greenplum_path.sh +gpadmin@master$ cd /usr/local/hawq/ranger/bin +``` + +2. Execute the `enable-ranger-plugin.sh` script. You will provide different options for the script depending upon whether or not you have enabled Kerberos in your HAWQ cluster. + +***If Kerberos is not enabled for Ranger***: + +``` bash +gpadmin@master$ ./enable-ranger-plugin.sh -r ranger_host:6080 -u admin -p admin -h hawq_master:5432
incubator-hawq-docs git commit: HAWQ-1491 - create usage docs for HiveVectorizedORC profile (closes #126)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 40d9a0b6d -> abea80853 HAWQ-1491 - create usage docs for HiveVectorizedORC profile (closes #126) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/abea8085 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/abea8085 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/abea8085 Branch: refs/heads/master Commit: abea808538dc29e6eb893efc37c27fc2f59f460f Parents: 40d9a0b Author: Lisa Owen Authored: Wed Jun 28 16:35:49 2017 -0700 Committer: David Yozie Committed: Wed Jun 28 16:35:49 2017 -0700 -- markdown/pxf/HivePXF.html.md.erb| 82 .../PXFExternalTableandAPIReference.html.md.erb | 20 +++-- markdown/pxf/ReadWritePXF.html.md.erb | 12 +++ 3 files changed, 90 insertions(+), 24 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/abea8085/markdown/pxf/HivePXF.html.md.erb -- diff --git a/markdown/pxf/HivePXF.html.md.erb b/markdown/pxf/HivePXF.html.md.erb index a226537..c6c310e 100644 --- a/markdown/pxf/HivePXF.html.md.erb +++ b/markdown/pxf/HivePXF.html.md.erb @@ -50,7 +50,7 @@ The PXF Hive plug-in supports several file formats and profiles for accessing th | TextFile | Flat file with data in comma-, tab-, or space-separated value format or JSON notation. | Hive, HiveText | | SequenceFile | Flat file consisting of binary key/value pairs. | Hive | | RCFile | Record columnar data consisting of binary key/value pairs; high row compression rate. | Hive, HiveRC | -| ORCFile | Optimized row columnar data with stripe, footer, and postscript sections; reduces data size. | Hive, HiveORC | +| ORCFile | Optimized row columnar data with stripe, footer, and postscript sections; reduces data size. | Hive, HiveORC, HiveVectorizedORC | | Parquet | Compressed columnar data representation. | Hive | | Avro | JSON-defined, schema-based data serialization format. | Hive | @@ -78,12 +78,15 @@ The following table summarizes external mapping rules for Hive primitive types. | timestamp | timestamp | +**Note**: The `HiveVectorizedORC` profile does not support the timestamp data type. + ### Complex Data Types Hive supports complex data types including array, struct, map, and union. PXF maps each of these complex types to `text`. While HAWQ does not natively support these types, you can create HAWQ functions or application code to extract subcomponents of these complex data types. Examples using complex data types with the `Hive` and `HiveORC` profiles are provided later in this topic. +**Note**: The `HiveVectorizedORC` profile does not support complex types. ## Sample Data Set @@ -316,7 +319,7 @@ HCatalog integration has the following limitations: In the previous section, you used HCatalog integration to query a Hive table. You can also create a PXF/HAWQ external table to access Hive table data. This Hive table access mechanism requires that you identify an appropriate Hive profile. -The PXF Hive plug-in supports several Hive-related profiles. These include `Hive`, `HiveText`, and `HiveRC`, and `HiveORC`. The `HiveText` and `HiveRC` profiles are specifically optimized for text and RC file formats, respectively. The `HiveORC` profile is optimized for ORC file formats. The `Hive` profile is optimized for all file storage types; use the `Hive` profile when the underlying Hive table is composed of multiple partitions with differing file formats. +The PXF Hive plug-in supports several Hive-related profiles. These include `Hive`, `HiveText`, and `HiveRC`, `HiveORC`, and `HiveVectorizedORC`. The `HiveText` and `HiveRC` profiles are specifically optimized for text and RC file formats, respectively. The `HiveORC` and `HiveVectorizedORC` profiles are optimized for ORC file formats. The `Hive` profile is optimized for all file storage types; use the `Hive` profile when the underlying Hive table is composed of multiple partitions with differing file formats. Use the following syntax to create a HAWQ external table representing Hive data: @@ -324,7 +327,7 @@ Use the following syntax to create a HAWQ external table representing Hive data: CREATE EXTERNAL TABLE ( [, ...] | LIKE ) LOCATION ('pxf://[:]/. -?PROFILE=Hive|HiveText|HiveRC|HiveORC[&DELIMITER=']) + ?PROFILE=Hive|HiveText|HiveRC|HiveORC|HiveVectorizedORC[&DELIMITER=']) FORMAT 'CUSTOM|TEXT' (formatter='pxfwritable_import' | delimiter='') ``` @@ -336,9 +339,9 @@ Hive-plug-in-specific keywords and values used in the [CREATE EXTERNAL TABLE](.. | \| The PXF
incubator-hawq-docs git commit: HAWQ-1435 document new pxf jdbc plug-in (closes #124)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 458ef8ea4 -> 40d9a0b6d HAWQ-1435 document new pxf jdbc plug-in (closes #124) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/40d9a0b6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/40d9a0b6 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/40d9a0b6 Branch: refs/heads/master Commit: 40d9a0b6d27ab37d831827e9e845f3d5d8b0040b Parents: 458ef8e Author: Lisa Owen Authored: Wed Jun 28 09:43:56 2017 -0700 Committer: David Yozie Committed: Wed Jun 28 09:43:56 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 1 + .../pxf/HawqExtensionFrameworkPXF.html.md.erb | 4 + markdown/pxf/InstallPXFPlugins.html.md.erb | 4 +- markdown/pxf/JdbcPXF.html.md.erb| 211 +++ 4 files changed, 218 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/40d9a0b6/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index f18edef..85eb424 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -398,6 +398,7 @@ Accessing Hive Data Accessing HBase Data Accessing JSON Data + Accessing External SQL Databases Writing Data to HDFS Using Profiles to Read and Write Data PXF External Tables and API http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/40d9a0b6/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb -- diff --git a/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb b/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb index 1a49576..8d82d8a 100644 --- a/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb +++ b/markdown/pxf/HawqExtensionFrameworkPXF.html.md.erb @@ -51,6 +51,10 @@ PXF allows users to create custom connectors to access other parallel data store This topic describes how to access JSON data using PXF. +- **[Accessing External SQL Databases](../pxf/JdbcPXF.html)** + +This topic describes how to access data in external SQL databases using PXF. + - **[Writing Data to HDFS](../pxf/HDFSWritablePXF.html)** This topic describes how to write to HDFS using PXF. http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/40d9a0b6/markdown/pxf/InstallPXFPlugins.html.md.erb -- diff --git a/markdown/pxf/InstallPXFPlugins.html.md.erb b/markdown/pxf/InstallPXFPlugins.html.md.erb index 4fbda74..8060e5e 100644 --- a/markdown/pxf/InstallPXFPlugins.html.md.erb +++ b/markdown/pxf/InstallPXFPlugins.html.md.erb @@ -21,7 +21,7 @@ specific language governing permissions and limitations under the License. --> -This topic describes how to install the built-in PXF service plug-ins that are required to connect PXF to HDFS, Hive, HBase, and JSON. +This topic describes how to install the built-in PXF service plug-ins that are required to connect PXF to HDFS, Hive, HBase, JDBC, and JSON. **Note:** PXF requires that you run Tomcat on the host machine. Tomcat reserves ports 8005, 8080, and 8009. If you have configured Oozie JXM reporting on a host that will run PXF, make sure that the reporting service uses a port other than 8005. This helps to prevent port conflict errors from occurring when you start the PXF service. @@ -48,7 +48,7 @@ Each PXF service plug-in resides in its own RPM. You may have built these RPMs Perform the following steps on **_each_** node in your cluster to install PXF: -1. Install the PXF software, including Apache, the PXF service, and all PXF plug-ins: HDFS, HBase, Hive, JSON: +1. Install the PXF software, including Apache, the PXF service, and all PXF plug-ins: HDFS, HBase, Hive, JDBC, JSON: ```shell $ sudo yum install -y pxf http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/40d9a0b6/markdown/pxf/JdbcPXF.html.md.erb -- diff --git a/markdown/pxf/JdbcPXF.html.md.erb b/markdown/pxf/JdbcPXF.html.md.erb new file mode 100644 index 000..337de66 --- /dev/null +++ b/markdown/pxf/JdbcPXF.html.md.erb @@ -0,0 +1,211 @@ +--- +title: Accessing External SQL Databases with JDBC (Beta) +--- + + + +Some of your data may already reside in an external SQL database. The PXF JDBC plug-in reads data stored
incubator-hawq-docs git commit: DOCS: clarify pxf writable external tables (closes #125)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 973791b22 -> 458ef8ea4 DOCS: clarify pxf writable external tables (closes #125) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/458ef8ea Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/458ef8ea Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/458ef8ea Branch: refs/heads/master Commit: 458ef8ea40d50271eee4a70f6995d3600a4790d4 Parents: 973791b Author: Lisa Owen Authored: Thu Jun 22 12:44:41 2017 -0700 Committer: David Yozie Committed: Thu Jun 22 12:44:41 2017 -0700 -- markdown/pxf/HBasePXF.html.md.erb| 2 +- markdown/pxf/PXFExternalTableandAPIReference.html.md.erb | 2 ++ 2 files changed, 3 insertions(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/458ef8ea/markdown/pxf/HBasePXF.html.md.erb -- diff --git a/markdown/pxf/HBasePXF.html.md.erb b/markdown/pxf/HBasePXF.html.md.erb index 4341de3..853960f 100644 --- a/markdown/pxf/HBasePXF.html.md.erb +++ b/markdown/pxf/HBasePXF.html.md.erb @@ -41,7 +41,7 @@ Before trying to access HBase data with PXF, verify the following: To create an external HBase table, use the following syntax: ``` sql -CREATE [READABLE|WRITABLE] EXTERNAL TABLE table_name +CREATE READABLE EXTERNAL TABLE table_name ( column_name data_type [, ...] | LIKE other_table ) LOCATION ('pxf://host[:port]/hbase-table-name?Profile=HBase') FORMAT 'CUSTOM' (Formatter='pxfwritable_import'); http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/458ef8ea/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb -- diff --git a/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb b/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb index 3681079..096d41d 100644 --- a/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb +++ b/markdown/pxf/PXFExternalTableandAPIReference.html.md.erb @@ -47,6 +47,8 @@ FORMAT 'custom' (formatter='pxfwritable_import|pxfwritable_export'); &RESOLVER=] | ?PROFILE=profile-name ``` +**Note**: Not every PXF profile supports writable external tables. Refer to [Writing Data to HDFS](HDFSWritablePXF.html) for a detailed discussion of the HDFS plug-in profiles that support this feature. + Table 1. Parameter values and description
incubator-hawq-docs git commit: Notes on memory limit (closes #119)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 214684a05 -> 973791b22 Notes on memory limit (closes #119) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/973791b2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/973791b2 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/973791b2 Branch: refs/heads/master Commit: 973791b2257656d96708c770d356ea5e172be2aa Parents: 214684a Author: Jane Beckman Authored: Mon Jun 5 16:24:47 2017 -0700 Committer: David Yozie Committed: Mon Jun 5 16:24:47 2017 -0700 -- markdown/reference/catalog/pg_resqueue.html.md.erb | 2 +- markdown/reference/sql/CREATE-RESOURCE-QUEUE.html.md.erb | 4 +++- 2 files changed, 4 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/973791b2/markdown/reference/catalog/pg_resqueue.html.md.erb -- diff --git a/markdown/reference/catalog/pg_resqueue.html.md.erb b/markdown/reference/catalog/pg_resqueue.html.md.erb index 651f1fd..8d68936 100644 --- a/markdown/reference/catalog/pg_resqueue.html.md.erb +++ b/markdown/reference/catalog/pg_resqueue.html.md.erb @@ -31,7 +31,7 @@ The `pg_resqueue` system catalog table contains information about HAWQ resource | `rsqname` | name | Â | The name of the resource queue. | | `parentoid` | oid | Â | OID of the parent queue of the resource queue. | | `activestats` | integer | Â | The maximum number of parallel active statements allowed for the resource queue. | -| `memorylimit` | text | Â | The maximum amount of memory that can be consumed by the resource queue (expressed as a percentage of the cluster's memory.) | +| `memorylimit` | text | Â | The maximum amount of memory that can be consumed by the resource queue (expressed as a percentage of the cluster's memory.) Because of how memory is determined, the memory limit is not an upper limit on the memory actually used by a resource queue. | | `corelimit` | text | Â | The maximum amount of cores that can be consumed by the resource queue (expressed as a percentage of the cluster's cores.) | | `resovercommit` | real | Â | The ratio of resource consumption overcommit for the resource queue. | | `allocpolicy` | text | Â | The resource allocation policy name for the resource queue. | http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/973791b2/markdown/reference/sql/CREATE-RESOURCE-QUEUE.html.md.erb -- diff --git a/markdown/reference/sql/CREATE-RESOURCE-QUEUE.html.md.erb b/markdown/reference/sql/CREATE-RESOURCE-QUEUE.html.md.erb index 4ebaf7a..b27ccf5 100644 --- a/markdown/reference/sql/CREATE-RESOURCE-QUEUE.html.md.erb +++ b/markdown/reference/sql/CREATE-RESOURCE-QUEUE.html.md.erb @@ -58,6 +58,8 @@ Resource queues with an `ACTIVE_STATEMENTS` threshold set a maximum limit on the When creating the resource queue, use the MEMORY\_LIMIT\_CLUSTER and CORE\_LIMIT\_CLUSTER queue attributes to tune the allowed resource usage of the resource queue. MEMORY\_LIMIT\_CLUSTER and CORE\_LIMIT\_CLUSTER must set to the same value for a resource queue. In addition the sum of the percentages of MEMORY\_LIMIT\_CLUSTER (and CORE\_LIMIT\_CLUSTER) for resource queues that share the same parent cannot exceed 100%. +Note: The MEMORY\_LIMIT of a resource queue assigns the quota to operators in a query plan during planning, before actual execution. Actual memory consumption during query might exceed the limit. +
incubator-hawq-docs git commit: HAWQ-1473 - document ranger plugin service high availability (closes #120)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master a9fcece43 -> 64ab46cdb HAWQ-1473 - document ranger plugin service high availability (closes #120) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/64ab46cd Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/64ab46cd Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/64ab46cd Branch: refs/heads/master Commit: 64ab46cdb74eaf2f78f3b2b965abeb87ad6dbfaf Parents: a9fcece Author: Lisa Owen Authored: Thu Jun 1 10:50:18 2017 -0700 Committer: David Yozie Committed: Thu Jun 1 10:50:34 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 4 ++ markdown/admin/MasterMirroring.html.md.erb | 2 + markdown/admin/ambari-admin.html.md.erb | 6 +- markdown/ranger/ranger-ha.html.md.erb | 45 + .../ranger-integration-config.html.md.erb | 67 +++- markdown/ranger/ranger-overview.html.md.erb | 4 -- .../ranger/ranger-policy-creation.html.md.erb | 2 - .../admin_utilities/hawqactivate.html.md.erb| 6 +- .../reference/guc/guc_category-list.html.md.erb | 1 + .../guc/parameter_definitions.html.md.erb | 10 +++ 10 files changed, 136 insertions(+), 11 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/64ab46cd/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index 656ba45..f18edef 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -195,6 +195,9 @@ Auditing Authorization Events + + High Availability and HAWQ Ranger + @@ -705,6 +708,7 @@ hawq_rm_yarn_queue_name hawq_rm_yarn_scheduler_address hawq_rps_address_port + hawq_rps_check_local_interval hawq_segment_address_port hawq_segment_directory hawq_segment_temp_directory http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/64ab46cd/markdown/admin/MasterMirroring.html.md.erb -- diff --git a/markdown/admin/MasterMirroring.html.md.erb b/markdown/admin/MasterMirroring.html.md.erb index fb8e0d2..078fefe 100644 --- a/markdown/admin/MasterMirroring.html.md.erb +++ b/markdown/admin/MasterMirroring.html.md.erb @@ -103,6 +103,8 @@ Upon activation of the standby master, HAWQ reconstructs the state of the master ``` The newly-activated master's status should be **Active**. If you configured a new standby master, its status is **Passive**. When a standby master is not configured, the command displays `-No entries found`, the message indicating that no standby master instance is configured. + +6. If you have enabled HAWQ Ranger Authentication in high availability mode in your cluster, you must manually update the Ranger HAWQ service definition to identify the new master node. Refer to [Failover to HAWQ Standby Master](../ranger/ranger-ha.html#rps_ha_cfg_masterfailover) in the HAWQ Ranger documentation for additional information. 6. Query the `gp_segment_configuration` table to verify that segments have registered themselves to the new master: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/64ab46cd/markdown/admin/ambari-admin.html.md.erb -- diff --git a/markdown/admin/ambari-admin.html.md.erb b/markdown/admin/ambari-admin.html.md.erb index 73c7c39..a778944 100644 --- a/markdown/admin/ambari-admin.html.md.erb +++ b/markdown/admin/ambari-admin.html.md.erb @@ -284,10 +284,12 @@ Activating the HAWQ Standby Master promotes the standby host as the new HAWQ Mas 5. Ambari displays the host name of the current HAWQ Master that will be removed from the cluster, as well as the HAWQ Standby Master host that will be activated. The information is provided only for review and cannot be edited on this page. Click **Next** to confirm the operation. 6. Click **OK** to confirm that you want to perform the procedure, as it is not possible to roll back the operation using Ambari. - Ambari displays a list of tasks that are performed to activate the standby server and remove the previous HAWQ Master host. Click on any of the tasks to view progress or
incubator-hawq-docs git commit: analyze not supported on json, hbase external tables (closes #122)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master ad9b06696 -> aaa7ebba5 analyze not supported on json, hbase external tables (closes #122) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/aaa7ebba Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/aaa7ebba Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/aaa7ebba Branch: refs/heads/master Commit: aaa7ebba5964dc0c53744a153da9cb164f08f765 Parents: ad9b066 Author: Lisa Owen Authored: Wed May 31 09:12:02 2017 -0700 Committer: David Yozie Committed: Wed May 31 09:12:02 2017 -0700 -- markdown/pxf/HBasePXF.html.md.erb | 2 ++ markdown/pxf/JsonPXF.html.md.erb | 1 + markdown/reference/sql/ANALYZE.html.md.erb | 6 -- 3 files changed, 7 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/aaa7ebba/markdown/pxf/HBasePXF.html.md.erb -- diff --git a/markdown/pxf/HBasePXF.html.md.erb b/markdown/pxf/HBasePXF.html.md.erb index ddb86d5..90dacf3 100644 --- a/markdown/pxf/HBasePXF.html.md.erb +++ b/markdown/pxf/HBasePXF.html.md.erb @@ -53,6 +53,8 @@ The HBase profile is equivalent to the following PXF parameters: - Accessor=org.apache.hawq.pxf.plugins.hbase.HBaseAccessor - Resolver=org.apache.hawq.pxf.plugins.hbase.HBaseResolver +**Note**: `ANALYZE` operations are not supported on external tables you create with the `HBase` profile. + ## Column Mapping Most HAWQ external tables (PXF or others) require that the HAWQ table attributes match the source data record layout, and include all the available attributes. With HAWQ, however, you use the PXF HBase plug-in to specify the subset of HBase qualifiers that define the HAWQ PXF table. To set up a clear mapping between each attribute in the PXF table and a specific qualifier in the HBase table, you can use either direct mapping or indirect mapping. In addition, the HBase row key is handled in a special way. http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/aaa7ebba/markdown/pxf/JsonPXF.html.md.erb -- diff --git a/markdown/pxf/JsonPXF.html.md.erb b/markdown/pxf/JsonPXF.html.md.erb index 6aeea7e..e22a75c 100644 --- a/markdown/pxf/JsonPXF.html.md.erb +++ b/markdown/pxf/JsonPXF.html.md.erb @@ -176,6 +176,7 @@ JSON-plug-in-specific keywords and values used in the `CREATE EXTERNAL TABLE` ca | FORMAT| The `FORMAT` clause must specify `CUSTOM`. | | FORMATTER| The JSON `CUSTOM` format supports only the built-in `pxfwritable_import` `FORMATTER`. | +**Note**: `ANALYZE` operations are not supported on external tables you create with the `Json` profile. ### Example 1 http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/aaa7ebba/markdown/reference/sql/ANALYZE.html.md.erb -- diff --git a/markdown/reference/sql/ANALYZE.html.md.erb b/markdown/reference/sql/ANALYZE.html.md.erb index eb0af77..98fadd8 100644 --- a/markdown/reference/sql/ANALYZE.html.md.erb +++ b/markdown/reference/sql/ANALYZE.html.md.erb @@ -67,14 +67,16 @@ For large tables, `ANALYZE` takes a random sample of the table contents, rather The largest statistics target among the columns being analyzed determines the number of table rows sampled to prepare the statistics. Increasing the target causes a proportional increase in the time and space needed to do `ANALYZE`. -The `pxf_enable_stat_collection` server configuration parameter determines if `ANALYZE` calculates statistics for PXF readable tables. When `pxf_enable_stat_collection` is true, the default setting, `ANALYZE` estimates the number of tuples in the table from the total size of the table, the size of the first fragment, and the number of tuples in the first fragment. Then it builds a sample table and calculates statistics for the PXF table by running statistics queries on the sample table, the same as it does with native tables. A sample table is always created to calculate PXF table statistics, even when the table has a small number of rows. +The `pxf_enable_stat_collection` server configuration parameter determines if `ANALYZE` calculates statistics for PXF readable external tables. When `pxf_enable_stat_collection` is true, the default setting, `ANALYZE` estimates the number of tuples in the table from the total size of the table, the size of the first fragment, and the number of tuples in the first fragment. Then it builds a sample table and calculates statistics for the PXF table by running statistics queries on the sample table, the same as it does w
incubator-hawq-docs git commit: HAWQ-1474 - document minimal psql client pkg create/install/run (closes #121)
Repository: incubator-hawq-docs Updated Branches: refs/heads/master 6b42b34f9 -> ad9b06696 HAWQ-1474 - document minimal psql client pkg create/install/run (closes #121) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/ad9b0669 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/ad9b0669 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/ad9b0669 Branch: refs/heads/master Commit: ad9b06696dec9368a37e41c873bb04d53d5f3163 Parents: 6b42b34 Author: Lisa Owen Authored: Tue May 30 15:39:39 2017 -0700 Committer: David Yozie Committed: Tue May 30 15:39:42 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 3 - ...awq-database-client-applications.html.md.erb | 133 ++- .../g-supported-client-applications.html.md.erb | 27 markdown/clientaccess/index.md.erb | 1 - 4 files changed, 132 insertions(+), 32 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/ad9b0669/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index a69da5c..656ba45 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -201,9 +201,6 @@ Establishing a Database Session -Supported Client Applications - - HAWQ Client Applications http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/ad9b0669/markdown/clientaccess/g-hawq-database-client-applications.html.md.erb -- diff --git a/markdown/clientaccess/g-hawq-database-client-applications.html.md.erb b/markdown/clientaccess/g-hawq-database-client-applications.html.md.erb index 70604da..2171b45 100644 --- a/markdown/clientaccess/g-hawq-database-client-applications.html.md.erb +++ b/markdown/clientaccess/g-hawq-database-client-applications.html.md.erb @@ -21,7 +21,13 @@ specific language governing permissions and limitations under the License. --> -HAWQ comes installed with a number of client utility applications located in the `$GPHOME/bin` directory of your HAWQ master host installation. The following are the most commonly used client utility applications: +HAWQ is pre-installed with a number of client utility applications. You can also run client applications in your HAWQ deployment that were created using standard ODBC/JDBC Application Interfaces. + +Alternatively, you may want to provide access to your HAWQ master node from a Linux client outside of your HAWQ cluster. One option to enable this access is to install the full HAWQ binary on the client node. A second option is to create a minimal `psql` client package from an existing HAWQ installation which you could then install on a non-HAWQ client. Refer to [HAWQ psql Client Package](#hawqclient_pkg) for instructions on creating, installing, and running such a package. + +## HAWQ-Installed Client Applications + +HAWQ is installed with a number of client utility applications. These applications are located in the `$GPHOME/bin` directory of your HAWQ master host installation. The following client utility applications are the most commonly used: |Name|Usage| ||-| @@ -40,3 +46,128 @@ When using these client applications, you must connect to a database through the All of these options have default values which will be used if the option is not specified. The default host is the local host. The default port number is 5432. The default user name is your OS system user name, as is the default database name. Note that OS user names and HAWQ user names are not necessarily the same. If the default values are not correct, you can set the environment variables `PGDATABASE`, `PGHOST`, `PGPORT`, and `PGUSER` to the appropriate values, or use a `psql``~/.pgpass` file to contain frequently-used passwords. + +## HAWQ psql Client Package + +You may choose to provide `psql` access to your HAWQ master node from a non-HAWQ Linux client. This section describes the procedures for creating, installing, and running a minimal HAWQ `psql` client package. + +### Creating the HAWQ psql Client Package + +Perform the following steps to create a HAWQ Linux `psql` client package: + +1. Log in to a HAWQ node and set up your HAWQ environment: + +``` shell +$ ssh gpadmin@ +gpadmin@hawq-node$ . /usr/local/hawq/greenplum_path.sh +``` + +**Note**: You can create the client package on any node on
[16/17] incubator-hawq-docs git commit: Merge branch 'develop'
Merge branch 'develop' Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/18ee9446 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/18ee9446 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/18ee9446 Branch: refs/heads/release/2.2.0.0-incubating Commit: 18ee9446db2dbe05522eb528c6d91a5de0fff070 Parents: 51cd83d be34a83 Author: David Yozie Authored: Mon Apr 24 17:03:30 2017 -0700 Committer: David Yozie Committed: Mon Apr 24 17:03:30 2017 -0700 -- book/config.yml |4 +- .../source/docs/userguide/latest/index.html | 11 + .../source/subnavs/apache-hawq-nav-210.erb | 894 -- .../source/subnavs/apache-hawq-nav.erb | 945 ++ book/redirects.rb |6 +- ...ckingUpandRestoringHAWQDatabases.html.md.erb | 23 +- markdown/admin/ClusterExpansion.html.md.erb | 19 + markdown/admin/ClusterShrink.html.md.erb| 19 + markdown/admin/FaultTolerance.html.md.erb | 19 + ...esandHighAvailabilityEnabledHDFS.html.md.erb | 23 + markdown/admin/HighAvailability.html.md.erb | 19 + markdown/admin/MasterMirroring.html.md.erb | 26 +- .../RecommendedMonitoringTasks.html.md.erb | 19 + markdown/admin/RunningHAWQ.html.md.erb | 19 + markdown/admin/ambari-admin.html.md.erb | 159 ++- markdown/admin/ambari-rest-api.html.md.erb | 69 +- markdown/admin/logfiles.html.md.erb | 294 + markdown/admin/maintain.html.md.erb | 41 +- markdown/admin/monitor.html.md.erb | 78 +- markdown/admin/setuphawqopenv.html.md.erb | 26 +- markdown/admin/startstop.html.md.erb| 19 + .../HAWQBestPracticesOverview.html.md.erb | 22 + .../config_hawq_bestpractices.html.md.erb | 32 + .../general_bestpractices.html.md.erb | 19 + .../managing_data_bestpractices.html.md.erb | 19 + ...managing_resources_bestpractices.html.md.erb | 31 +- .../operating_hawq_bestpractices.html.md.erb| 55 +- .../querying_data_bestpractices.html.md.erb | 19 + .../secure_bestpractices.html.md.erb| 19 + markdown/clientaccess/client_auth.html.md.erb | 19 + .../clientaccess/disable-kerberos.html.md.erb | 21 +- .../g-connecting-with-psql.html.md.erb | 19 + ...-database-application-interfaces.html.md.erb | 19 + ...-establishing-a-database-session.html.md.erb | 19 + ...awq-database-client-applications.html.md.erb | 19 + .../g-supported-client-applications.html.md.erb | 19 + ...ubleshooting-connection-problems.html.md.erb | 19 + .../clientaccess/hawq-access-checks.html.md.erb | 75 ++ markdown/clientaccess/index.md.erb | 19 + markdown/clientaccess/kerberos.html.md.erb | 19 + markdown/clientaccess/ldap.html.md.erb | 19 + markdown/clientaccess/roles_privs.html.md.erb | 25 +- .../datamgmt/BasicDataOperations.html.md.erb| 19 + .../datamgmt/ConcurrencyControl.html.md.erb | 19 + .../HAWQInputFormatforMapReduce.html.md.erb | 19 + markdown/datamgmt/Transactions.html.md.erb | 19 + markdown/datamgmt/about_statistics.html.md.erb | 19 + markdown/datamgmt/dml.html.md.erb | 19 + .../datamgmt/load/client-loadtools.html.md.erb | 19 + ...reating-external-tables-examples.html.md.erb | 21 +- ...ut-gpfdist-setup-and-performance.html.md.erb | 19 + .../load/g-character-encoding.html.md.erb | 19 + ...ommand-based-web-external-tables.html.md.erb | 19 + .../g-configuration-file-format.html.md.erb | 19 + ...-controlling-segment-parallelism.html.md.erb | 19 + ...table-and-declare-a-reject-limit.html.md.erb | 19 + ...ng-and-using-web-external-tables.html.md.erb | 19 + ...-with-single-row-error-isolation.html.md.erb | 19 + ...ased-writable-external-web-table.html.md.erb | 19 + ...le-based-writable-external-table.html.md.erb | 19 + ...ermine-the-transformation-schema.html.md.erb | 19 + ...-web-or-writable-external-tables.html.md.erb | 19 + ...-escaping-in-csv-formatted-files.html.md.erb | 19 + ...escaping-in-text-formatted-files.html.md.erb | 19 + markdown/datamgmt/load/g-escaping.html.md.erb | 19 + ...e-publications-in-demo-directory.html.md.erb | 19 + ...example-hawq-file-server-gpfdist.html.md.erb | 19 + ...-mef-xml-files-in-demo-directory.html.md.erb | 19 + ...e-witsml-files-in-demo-directory.html.md.erb | 19 + ...g-examples-read-fixed-width-data.html.md.erb | 19 + .../datamgmt/load/g-external-tables.html.md.erb | 19 + .../load/g-formatting-columns.html.md.erb | 19 + .../load/g-formatting-data-files.html.md.erb| 19 + .../datamgmt/load/g-formatting-rows.html.md.
[15/17] incubator-hawq-docs git commit: HAWQ-1296 - initial draft of hawq getting started guide (closes #98)
HAWQ-1296 - initial draft of hawq getting started guide (closes #98) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/be34a833 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/be34a833 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/be34a833 Branch: refs/heads/release/2.2.0.0-incubating Commit: be34a8339d0bb1b9dea5079af18e5ffe5a65fd46 Parents: 2e6e0f3 Author: Lisa Owen Authored: Mon Apr 24 14:28:03 2017 -0700 Committer: David Yozie Committed: Mon Apr 24 14:28:03 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 24 ++ .../gettingstarted/basicdbadmin.html.md.erb | 233 .../gettingstarted/basichawqadmin.html.md.erb | 225 .../gettingstarted/dataandscripts.html.md.erb | 266 +++ .../tutorial/gettingstarted/imgs/addprop.png| Bin 0 -> 28885 bytes .../gettingstarted/imgs/advhawqsite.png | Bin 0 -> 81027 bytes .../gettingstarted/imgs/ambariconsole.png | Bin 0 -> 217655 bytes .../tutorial/gettingstarted/imgs/ambbgops.png | Bin 0 -> 122558 bytes .../gettingstarted/imgs/hawqcfgsadv.png | Bin 0 -> 175848 bytes .../gettingstarted/imgs/hawqsvcacts.png | Bin 0 -> 36751 bytes .../gettingstarted/imgs/hawqsvccheckout.png | Bin 0 -> 276107 bytes .../gettingstarted/imgs/orangerestart.png | Bin 0 -> 46796 bytes .../gettingstarted/introhawqenv.html.md.erb | 188 + .../gettingstarted/introhawqtbls.html.md.erb| 222 .../gettingstarted/intropxfhdfs.html.md.erb | 224 markdown/tutorial/overview.html.md.erb | 46 16 files changed, 1428 insertions(+) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/be34a833/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index a32c9ef..a69da5c 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -39,6 +39,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/be34a833/markdown/tutorial/gettingstarted/basicdbadmin.html.md.erb -- diff --git a/markdown/tutorial/gettingstarted/basicdbadmin.html.md.erb b/markdown/tutorial/gettingstarted/basicdbadmin.html.md.erb new file mode 100644 index 000..04fdaab --- /dev/null +++ b/markdown/tutorial/gettingstarted/basicdbadmin.html.md.erb @@ -0,0 +1,233 @@ +--- +title: Lesson 3 - Database Administration +--- + + + +The HAWQ `gpadmin` user and other users who are granted the necessary privileges can execute SQL commands to create HAWQ databases and tables. These commands may be invoked via scripts, programs, and from the `psql` client utility. + +This lesson introduces basic HAWQ database administration commands and tasks using `psql`. You will create a database and a simple table, and add data to and query the table. + +## Prerequisites + +Ensure that you have [Set Up your HAWQ Runtime Environment](introhawqenv.html#tut_runtime_setup) and that your HAWQ cluster is up and running. + + +## Exercise: Create the HAWQ Tutorial Database + +In this exercise, you use the `psql` command line utility to create a HAWQ database. + +1. Start the `psql` subsystem: + +``` shell +gpadmin@master$ psql -d postgres +``` + +You enter the `psql` interpreter, connecting to the `postgres` database. `postgres` is a default template database created during HAWQ installation. + +``` sql +psql (8.2.15) +Type "help" for help. + +postgres=# +``` + +The `psql` prompt is the database name followed by `=#` or `=>`. `=#` identifies the session as that of a database superuser. The default `psql` prompt for a non-superuser is `=>`. + +2. Create a database named `hawqgsdb`: + +``` sql +postgres
[06/17] incubator-hawq-docs git commit: Merge branch 'release/2.1.0.0-incubating'
Merge branch 'release/2.1.0.0-incubating' Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/6667ed22 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/6667ed22 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/6667ed22 Branch: refs/heads/release/2.2.0.0-incubating Commit: 6667ed2253e1e0bc4f6103cef2804e491b2496b7 Parents: caf68c7 06d7cd2 Author: David Yozie Authored: Tue Jan 10 15:53:24 2017 -0800 Committer: David Yozie Committed: Tue Jan 10 15:53:24 2017 -0800 -- .gitignore |4 + README.md | 53 +- ...ckingUpandRestoringHAWQDatabases.html.md.erb | 373 -- admin/ClusterExpansion.html.md.erb | 226 -- admin/ClusterShrink.html.md.erb | 55 - admin/FaultTolerance.html.md.erb| 52 - ...esandHighAvailabilityEnabledHDFS.html.md.erb | 223 -- admin/HighAvailability.html.md.erb | 37 - admin/MasterMirroring.html.md.erb | 135 - admin/RecommendedMonitoringTasks.html.md.erb| 259 -- admin/RunningHAWQ.html.md.erb | 22 - admin/ambari-admin.html.md.erb | 439 --- admin/maintain.html.md.erb | 31 - admin/monitor.html.md.erb | 424 --- admin/startstop.html.md.erb | 157 - .../HAWQBestPracticesOverview.html.md.erb | 31 - bestpractices/general_bestpractices.html.md.erb | 24 - .../managing_data_bestpractices.html.md.erb | 47 - ...managing_resources_bestpractices.html.md.erb | 144 - .../operating_hawq_bestpractices.html.md.erb| 289 -- .../querying_data_bestpractices.html.md.erb | 25 - bestpractices/secure_bestpractices.html.md.erb | 11 - book/Gemfile|5 + book/Gemfile.lock | 203 ++ book/config.yml | 21 + book/master_middleman/source/images/favicon.ico | Bin 0 -> 1150 bytes .../master_middleman/source/javascripts/book.js | 16 + .../source/javascripts/waypoints/context.js | 300 ++ .../source/javascripts/waypoints/group.js | 105 + .../javascripts/waypoints/noframeworkAdapter.js | 213 ++ .../source/javascripts/waypoints/sticky.js | 63 + .../source/javascripts/waypoints/waypoint.js| 160 + book/master_middleman/source/layouts/_title.erb |6 + .../source/stylesheets/book-styles.css.scss |3 + .../stylesheets/partials/_book-base-values.scss |0 .../source/stylesheets/partials/_book-vars.scss | 19 + .../source/subnavs/apache-hawq-nav-210.erb | 894 + book/redirects.rb |4 + clientaccess/client_auth.html.md.erb| 193 -- clientaccess/disable-kerberos.html.md.erb | 85 - clientaccess/g-connecting-with-psql.html.md.erb | 35 - ...-database-application-interfaces.html.md.erb |8 - ...-establishing-a-database-session.html.md.erb | 17 - ...lum-database-client-applications.html.md.erb | 23 - .../g-supported-client-applications.html.md.erb |8 - ...ubleshooting-connection-problems.html.md.erb | 12 - clientaccess/index.md.erb | 17 - clientaccess/kerberos.html.md.erb | 308 -- clientaccess/ldap.html.md.erb | 116 - clientaccess/roles_privs.html.md.erb| 288 -- datamgmt/BasicDataOperations.html.md.erb| 64 - datamgmt/ConcurrencyControl.html.md.erb | 24 - .../HAWQInputFormatforMapReduce.html.md.erb | 304 -- datamgmt/Transactions.html.md.erb | 54 - datamgmt/about_statistics.html.md.erb | 185 - datamgmt/dml.html.md.erb| 35 - datamgmt/load/client-loadtools.html.md.erb | 96 - ...reating-external-tables-examples.html.md.erb | 117 - ...ut-gpfdist-setup-and-performance.html.md.erb | 22 - datamgmt/load/g-character-encoding.html.md.erb | 11 - ...ommand-based-web-external-tables.html.md.erb | 26 - .../g-configuration-file-format.html.md.erb | 66 - ...-controlling-segment-parallelism.html.md.erb | 11 - ...table-and-declare-a-reject-limit.html.md.erb | 11 - ...ng-and-using-web-external-tables.html.md.erb | 13 - ...-with-single-row-error-isolation.html.md.erb | 24 - ...ased-writable-external-web-table.html.md.erb | 43 - ...le-based-writable-external-table.html.md.erb | 16 - ...ermine-the-transformation-schema.html.md.erb | 33 - ...-web-or-writable-external-tables.html.md.erb | 11 - ...-escaping-in-csv-formatted-files.html.md.erb | 29 - ...escaping-in-text-formatted-files.html.md.erb | 31 - datamgmt/load/g-escaping.html.md.erb| 16 - ...e-publications-in-demo-director
[01/17] incubator-hawq-docs git commit: removing hawq-book directory from this branch [HAWQ-1027]
Repository: incubator-hawq-docs Updated Branches: refs/heads/release/2.2.0.0-incubating a65fa2896 -> b50bbf259 removing hawq-book directory from this branch [HAWQ-1027] Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/52ce16bf Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/52ce16bf Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/52ce16bf Branch: refs/heads/release/2.2.0.0-incubating Commit: 52ce16bfb368ef3fc43782fe22f4ad0c85749842 Parents: 410c629 Author: David Yozie Authored: Mon Aug 29 10:18:49 2016 -0700 Committer: David Yozie Committed: Mon Aug 29 10:23:51 2016 -0700 -- hawq-book/Gemfile | 5 - hawq-book/Gemfile.lock | 203 - hawq-book/config.yml| 22 -- .../master_middleman/source/images/favicon.ico | Bin 1150 -> 0 bytes .../master_middleman/source/javascripts/book.js | 16 - .../source/javascripts/waypoints/context.js | 300 --- .../source/javascripts/waypoints/group.js | 105 --- .../javascripts/waypoints/noframeworkAdapter.js | 213 - .../source/javascripts/waypoints/sticky.js | 63 .../source/javascripts/waypoints/waypoint.js| 160 -- .../master_middleman/source/layouts/_title.erb | 6 - .../patch/dynamic_variable_interpretation.py| 192 .../source/stylesheets/book-styles.css.scss | 3 - .../stylesheets/partials/_book-base-values.scss | 0 .../source/stylesheets/partials/_book-vars.scss | 19 -- hawq-book/redirects.rb | 6 - 16 files changed, 1313 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/52ce16bf/hawq-book/Gemfile -- diff --git a/hawq-book/Gemfile b/hawq-book/Gemfile deleted file mode 100644 index f66d333..000 --- a/hawq-book/Gemfile +++ /dev/null @@ -1,5 +0,0 @@ -source "https://rubygems.org"; - -gem 'bookbindery' - -gem 'libv8', '3.16.14.7' http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/52ce16bf/hawq-book/Gemfile.lock -- diff --git a/hawq-book/Gemfile.lock b/hawq-book/Gemfile.lock deleted file mode 100644 index 3c483c0..000 --- a/hawq-book/Gemfile.lock +++ /dev/null @@ -1,203 +0,0 @@ -GEM - remote: https://rubygems.org/ - specs: -activesupport (4.2.7.1) - i18n (~> 0.7) - json (~> 1.7, >= 1.7.7) - minitest (~> 5.1) - thread_safe (~> 0.3, >= 0.3.4) - tzinfo (~> 1.1) -addressable (2.4.0) -ansi (1.5.0) -bookbindery (9.12.0) - ansi (~> 1.4) - css_parser - elasticsearch - fog-aws (~> 0.7.1) - font-awesome-sass - git (~> 1.2.8) - middleman (~> 3.4.0) - middleman-livereload (~> 3.4.3) - middleman-syntax (~> 2.0) - nokogiri (= 1.6.7.2) - puma - rack-rewrite - redcarpet (~> 3.2.3) - rouge (!= 1.9.1) - therubyracer - thor -builder (3.2.2) -capybara (2.4.4) - mime-types (>= 1.16) - nokogiri (>= 1.3.3) - rack (>= 1.0.0) - rack-test (>= 0.5.4) - xpath (~> 2.0) -chunky_png (1.3.6) -coffee-script (2.4.1) - coffee-script-source - execjs -coffee-script-source (1.10.0) -compass (1.0.3) - chunky_png (~> 1.2) - compass-core (~> 1.0.2) - compass-import-once (~> 1.0.5) - rb-fsevent (>= 0.9.3) - rb-inotify (>= 0.9) - sass (>= 3.3.13, < 3.5) -compass-core (1.0.3) - multi_json (~> 1.0) - sass (>= 3.3.0, < 3.5) -compass-import-once (1.0.5) - sass (>= 3.2, < 3.5) -css_parser (1.4.5) - addressable -elasticsearch (2.0.0) - elasticsearch-api (= 2.0.0) - elasticsearch-transport (= 2.0.0) -elasticsearch-api (2.0.0) - multi_json -elasticsearch-transport (2.0.0) - faraday - multi_json -em-websocket (0.5.1) - eventmachine (>= 0.12.9) - http_parser.rb (~> 0.6.0) -erubis (2.7.0) -eventmachine (1.2.0.1) -excon (0.51.0) -execjs (2.7.0) -faraday (0.9.2) - multipart-post (>= 1.2, < 3) -ffi (1.9.14) -fog-aws (0.7.6) - fog-core (~> 1.27) - fog-json (~> 1.0) - fog-xml (~> 0.1) - ipaddress (~> 0.8) -fog-core (1.42.0) - builder - excon (~> 0.49) - formatador (~> 0.2) -fog-json (1.0.2) - fog-core (~> 1.0) - multi_json (~> 1.10) -fog-xml (0.1.2) - fog-core - nokogiri (~>
[14/17] incubator-hawq-docs git commit: HAWQ-1432 - new topic for locating a HAWQ table's HDFS files (closes #118)
HAWQ-1432 - new topic for locating a HAWQ table's HDFS files (closes #118) Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/2e6e0f38 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/2e6e0f38 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/2e6e0f38 Branch: refs/heads/release/2.2.0.0-incubating Commit: 2e6e0f386801a529f66fb0e0b20e50bebed020a9 Parents: d687d97 Author: Lisa Owen Authored: Fri Apr 21 13:43:12 2017 -0700 Committer: David Yozie Committed: Fri Apr 21 13:43:12 2017 -0700 -- .../source/subnavs/apache-hawq-nav.erb | 3 + markdown/ddl/locate-table-hdfs.html.md.erb | 160 +++ 2 files changed, 163 insertions(+) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/2e6e0f38/book/master_middleman/source/subnavs/apache-hawq-nav.erb -- diff --git a/book/master_middleman/source/subnavs/apache-hawq-nav.erb b/book/master_middleman/source/subnavs/apache-hawq-nav.erb index 489f0c4..a32c9ef 100644 --- a/book/master_middleman/source/subnavs/apache-hawq-nav.erb +++ b/book/master_middleman/source/subnavs/apache-hawq-nav.erb @@ -214,6 +214,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/2e6e0f38/markdown/ddl/locate-table-hdfs.html.md.erb -- diff --git a/markdown/ddl/locate-table-hdfs.html.md.erb b/markdown/ddl/locate-table-hdfs.html.md.erb new file mode 100644 index 000..a38aa1a --- /dev/null +++ b/markdown/ddl/locate-table-hdfs.html.md.erb @@ -0,0 +1,160 @@ +--- +title: Identifying HAWQ Table HDFS Files +--- + + + +You can determine the HDFS location of the data file(s) associated with a specific HAWQ table using the HAWQ filespace HDFS location, the table identifier, and the identifiers for the tablespace and database in which the table resides. + +The number of HDFS data files associated with a HAWQ table is determined by the distribution mechanism (hash or random) identified when the table was first created or altered. + +Only an HDFS or HAWQ superuser may access HAWQ table HDFS files. + +## HDFS Location + +The format of the HDFS file path for a HAWQ table is: + +``` pre +hdfs://:/ +``` + +The HDFS file path components are described in the table below. + +| Path Component | Description | +|-|| +| \ | The HDFS NameNode host. | +| \ | The HDFS NameNode port. | +| \ | The HDFS directory location of the HAWQ filespace. The default HAWQ filespace HDFS directory is `hawq_default`. | +| \ | The tablespace object identifier. The default HAWQ tablespace identifier is `16385`. | +| \ | The database object identifier. | +| \ | The table object identifier. | +| \ | The file number. | + +**Note**: The HAWQ filespace name and its HDFS directory location must be identified when you create a new HAWQ filespace. You must know both to locate the HDFS files for a specific HAWQ table. + +The \:\/\ together comprise the `hawq_dfs_url` server configuration parameter. To display the value of the HAWQ default filespace URL: + +``` shell +gpadmin@master$ hawq config -s hawq_dfs_url +GUC : hawq_dfs_url +Value: :8020/hawq_default +``` + +or view the **HAWQ** service **Configs > Advanced**, **General** pane, in your Ambari console. + +You can determine the tablespace, database, and table object identifiers through HAWQ catalog queries. See the [Example](#ex_hdfslochash) below. + + +## Number of Data Files + +The number of data files that are created for a HAWQ table differs for hash-distributed and randomly-distributed HAWQ tables. + +Hash-distributed HAWQ tables use a fixed number of virtual segments (vsegs). This number is determined by the `default_hash_table_bucket_number` server configuration parameter setting, or the `BUCKETNUM` value you provide in the `CREATE TABLE` call. The number of HDFS files that HAWQ creates for a hash-distributed table also depends on the maximum number of concurrent inserts that have been executed against the table. The number of HDFS files is always the `default_hash_table_bucket_number` or `BUCKETNUM` value multiplied by the maximum number of concurrent inserts. + +The number of HDFS files generated for a randomly-distributed HAWQ table varies depending on the total number of virtual segments that have written data to the table. + + +## Example: Locating HDFS Files for a HAWQ Table + +Per
[12/17] incubator-hawq-docs git commit: Fix markdown formatting in README
Fix markdown formatting in README Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/d687d975 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/d687d975 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/d687d975 Branch: refs/heads/release/2.2.0.0-incubating Commit: d687d9755657ffac08dbb2d8f9b3d28d97b51ce2 Parents: 5b3bda7 Author: David Yozie Authored: Mon Apr 17 14:01:12 2017 -0700 Committer: David Yozie Committed: Mon Apr 17 14:01:12 2017 -0700 -- README.md | 16 1 file changed, 8 insertions(+), 8 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/d687d975/README.md -- diff --git a/README.md b/README.md index 331d272..79cddb6 100644 --- a/README.md +++ b/README.md @@ -33,24 +33,24 @@ For Apache HAWQ (incubating), a preconfigured **book** is provided in the `/book 2. Install bookbinder and its dependent gems. Make sure you are in the `book` directory and enter: ``` bash -$ bundle install -``` +$ bundle install +``` 3. The installed `config.yml` file configures the book for building from your local HAWQ source files. Build the output HTML files by executing the command: ``` bash -$ bundle exec bookbinder bind local -``` +$ bundle exec bookbinder bind local +``` Bookbinder converts the XML source into HTML, and puts the final output in the `final_app` directory. 5. The `final_app` directory stages the HTML into a web application that you can view using the rack gem. To view the documentation build: ``` bash -$ cd final_app -$ bundle install -$ rackup -``` +$ cd final_app +$ bundle install +$ rackup +``` Your local documentation is now available for viewing at[http://localhost:9292](http://localhost:9292)
[09/17] incubator-hawq-docs git commit: policy doc - built-in func warning, revise hdfs/hive considers
policy doc - built-in func warning, revise hdfs/hive considers Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/e85f3a49 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/e85f3a49 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/e85f3a49 Branch: refs/heads/release/2.2.0.0-incubating Commit: e85f3a49ec1721c6f08567b782d537a691b5928e Parents: a3ebec2 Author: Lisa Owen Authored: Fri Apr 7 15:24:12 2017 -0700 Committer: Lisa Owen Committed: Fri Apr 7 17:41:31 2017 -0700 -- markdown/ranger/ranger-policy-creation.html.md.erb | 15 +-- 1 file changed, 9 insertions(+), 6 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/e85f3a49/markdown/ranger/ranger-policy-creation.html.md.erb -- diff --git a/markdown/ranger/ranger-policy-creation.html.md.erb b/markdown/ranger/ranger-policy-creation.html.md.erb index 5bd12b4..ec78c35 100644 --- a/markdown/ranger/ranger-policy-creation.html.md.erb +++ b/markdown/ranger/ranger-policy-creation.html.md.erb @@ -319,10 +319,13 @@ Make note of the following considerations when employing Ranger authorization fo - `CREATE LANGUAGE` commands (superuser-only) issued for non-built-in languages (pljava, plpython, ..) require the `usage` permission for the `c` language. -- If Ranger is enabled for Hive authorization in your HAWQ cluster: -- Create Hive policy(s) providing the user `pxf` access to any Hive tables you want to expose via PXF HCatalog integration or HAWQ PXF external tables. -- The HAWQ policies providing access to PXF HCatalog integration must identify database `hcatalog`, schema ``, and table `` resources. These privileges are required in addition to any Hive policies for user `pxf` when Ranger is enabled for Hive authorization. +- Using built-in functions may generate the message: âWARNING: usage privilege of namespace \ is required.â This message is displayed even though the usage permission on \ is not actually required to execute the built-in function. -- If you have enabled Ranger authorization for HDFS in your HAWQ cluster: -- Create an HDFS policy(s) providing user `gpadmin` access to the HDFS HAWQ filespace. -- If you plan to use PXF external tables to read and write HDFS data, create HDFS policies providing user `pxf` access to the HDFS files backing your PXF external tables. +- When Ranger authorization is enabled for HDFS in your HAWQ cluster: +- The HDFS `xasecure.add-hadoop-authorization` property determines whether or not HDFS access controls are used as a fallback when no policy exists for a given HDFS resource. HAWQ access to HDFS is not affected when the `xasecure.add-hadoop-authorization` property is set to `true`. When this property is set to `false`, you must define HDFS Ranger policies permitting the `gadmin` HAWQ user read/write/execute access to the HAWQ HDFS filespace. +- Access to HDFS-backed PXF external tables is not affected by the `xasecure.add-hadoop-authorization` property value, since the `pxf` user is a member of the `hdfs` superuser group. + +- Hive Ranger policies cannot control PXF access to Hive tables. +- When Ranger authorization is enabled for HAWQ, the `gpadmin` user has access permissions to all Hive tables exposed through PXF external tables and HCatalog integration. +- Other HAWQ users may gain access to Hive-backed PXF external tables when provided `usage-schema` and `create` permissions on the `public` or any private schema. To restrict this access, selectively assign permissions to the `pxf` protocol. +- HCatalog access to Hive tables is restricted by default when Ranger authorization is enabled for HAWQ; you must create policies to explicitly allow this access.
[17/17] incubator-hawq-docs git commit: Merge branch 'master' into release/2.2.0.0-incubating
Merge branch 'master' into release/2.2.0.0-incubating Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/b50bbf25 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/b50bbf25 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/b50bbf25 Branch: refs/heads/release/2.2.0.0-incubating Commit: b50bbf2590b5047a011462dd6f31750026ea1c8e Parents: a65fa28 18ee944 Author: David Yozie Authored: Tue May 23 16:18:10 2017 -0700 Committer: David Yozie Committed: Tue May 23 16:18:10 2017 -0700 -- README.md | 16 +- .../source/subnavs/apache-hawq-nav.erb | 27 ++ markdown/clientaccess/roles_privs.html.md.erb | 4 +- markdown/ddl/locate-table-hdfs.html.md.erb | 160 +++ markdown/ranger/madlib-ranger.html.md.erb | 18 +- .../ranger/ranger-policy-creation.html.md.erb | 15 +- .../guc/parameter_definitions.html.md.erb | 2 +- .../gettingstarted/basicdbadmin.html.md.erb | 233 .../gettingstarted/basichawqadmin.html.md.erb | 225 .../gettingstarted/dataandscripts.html.md.erb | 266 +++ .../tutorial/gettingstarted/imgs/addprop.png| Bin 0 -> 28885 bytes .../gettingstarted/imgs/advhawqsite.png | Bin 0 -> 81027 bytes .../gettingstarted/imgs/ambariconsole.png | Bin 0 -> 217655 bytes .../tutorial/gettingstarted/imgs/ambbgops.png | Bin 0 -> 122558 bytes .../gettingstarted/imgs/hawqcfgsadv.png | Bin 0 -> 175848 bytes .../gettingstarted/imgs/hawqsvcacts.png | Bin 0 -> 36751 bytes .../gettingstarted/imgs/hawqsvccheckout.png | Bin 0 -> 276107 bytes .../gettingstarted/imgs/orangerestart.png | Bin 0 -> 46796 bytes .../gettingstarted/introhawqenv.html.md.erb | 188 + .../gettingstarted/introhawqtbls.html.md.erb| 222 .../gettingstarted/intropxfhdfs.html.md.erb | 224 markdown/tutorial/overview.html.md.erb | 46 22 files changed, 1619 insertions(+), 27 deletions(-) --
[05/17] incubator-hawq-docs git commit: Merge branch 'develop'
Merge branch 'develop' Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/caf68c72 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/caf68c72 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/caf68c72 Branch: refs/heads/release/2.2.0.0-incubating Commit: caf68c72558f335ffa17eabeff698d636b876af6 Parents: 135ab9b a819abd Author: David Yozie Authored: Thu Oct 6 09:42:38 2016 -0700 Committer: David Yozie Committed: Thu Oct 6 09:42:38 2016 -0700 -- reference/cli/admin_utilities/hawqconfig.html.md.erb | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) --
[11/17] incubator-hawq-docs git commit: remove pgcrypto download reference
remove pgcrypto download reference Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/5b3bda70 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/5b3bda70 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/5b3bda70 Branch: refs/heads/release/2.2.0.0-incubating Commit: 5b3bda70a20222679698185a3bd4d2ae7c7da7ec Parents: 6be57c3 Author: Lisa Owen Authored: Mon Apr 17 10:42:36 2017 -0700 Committer: Lisa Owen Committed: Mon Apr 17 10:42:36 2017 -0700 -- markdown/clientaccess/roles_privs.html.md.erb | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/5b3bda70/markdown/clientaccess/roles_privs.html.md.erb -- diff --git a/markdown/clientaccess/roles_privs.html.md.erb b/markdown/clientaccess/roles_privs.html.md.erb index 2675c75..e9e9aa2 100644 --- a/markdown/clientaccess/roles_privs.html.md.erb +++ b/markdown/clientaccess/roles_privs.html.md.erb @@ -154,9 +154,9 @@ Row-level or column-level access is not supported, nor is labeled security. Row- ## Encrypting Data -PostgreSQL provides an optional package of encryption/decryption functions called `pgcrypto`, which can also be installed and used in HAWQ. The `pgcrypto` package is not installed by default with HAWQ. However, you can download a `pgcrypto` package from [Pivotal Network](https://network.pivotal.io). +PostgreSQL provides an optional package of encryption/decryption functions called `pgcrypto`, which you can enable in HAWQ. -If you are building HAWQ from source files, then you should enable `pgcrypto` support as an option when compiling HAWQ. +If you are building HAWQ from source, then you should enable `pgcrypto` support as an option when compiling HAWQ. The `pgcrypto` functions allow database administrators to store certain columns of data in encrypted form. This adds an extra layer of protection for sensitive data, as data stored in HAWQ in encrypted form cannot be read by users who do not have the encryption key, nor be read directly from the disks.
[10/17] incubator-hawq-docs git commit: incorporate frank s madlib comments
incorporate frank s madlib comments Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/6be57c3b Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/6be57c3b Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/6be57c3b Branch: refs/heads/release/2.2.0.0-incubating Commit: 6be57c3bfed9399c6ec2bab2149f7250cc8878d9 Parents: e85f3a4 Author: Lisa Owen Authored: Mon Apr 10 16:12:41 2017 -0700 Committer: Lisa Owen Committed: Mon Apr 10 16:12:41 2017 -0700 -- markdown/ranger/madlib-ranger.html.md.erb | 18 -- 1 file changed, 8 insertions(+), 10 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/6be57c3b/markdown/ranger/madlib-ranger.html.md.erb -- diff --git a/markdown/ranger/madlib-ranger.html.md.erb b/markdown/ranger/madlib-ranger.html.md.erb index 8f6d55a..f074c30 100644 --- a/markdown/ranger/madlib-ranger.html.md.erb +++ b/markdown/ranger/madlib-ranger.html.md.erb @@ -22,21 +22,19 @@ under the License. --> -You can use MADlib, an open source library for in-database analytics, with your HAWQ installation. MADlib functions typically operate on source, output, and model tables. When Ranger is enabled for HAWQ authorization, you will need to provide access to all MADLib-related databases, schemas, tables, and functions to the appropriate users. +You can use MADlib, an open source library for in-database analytics, with your HAWQ installation. MADlib functions typically operate on source, output, and model tables. When Ranger is enabled for HAWQ authorization, you will need to explicitly provide access to all MADlib-related databases, schemas, tables, and functions to the appropriate users. -Consider the following when setting up HAWQ policies for MADlib access: +Consider the following when setting up HAWQ Ranger policies for MADlib access: -- Assign `temp` permission to the database on which users will run MADlib functions. -- MADlib users often share their output tables. If this is the case in your deployment, create a shared schema dedicated to output tables, assigning `usage-schema` and `create` privileges for all MADlib users to this shared schema. -- Assign `create-schema` database permission to those MADlib users that do not choose to share their output tables. +- Assign `temp` permission to the database(s) on which users will run MADlib functions. This permission is required because MADlib creates temporary tables at runtime. +- MADlib users often share their output tables. If this is the case in your deployment, create a shared schema dedicated to output tables, assigning `usage-schema` and `create` privileges to this shared schema to all MADlib users. +- When calling a MADlib function, prepend the output table name with the shared schema name; for example, `shared_schema.output_table1`. This ensures that all tables created by the MADlib function (model summary tables, dictionary tables, etc.) are written to the same, accessible shared schema. +- MADlib sometimes creates output tables in addition to the one specified by the user. Prepending the shared schema name to the output table name ensures that these MADlib-generated output tables are accessible. +- Assign the `create-schema` database permission to those MADlib users who choose not to share their output tables. This permits those users to create private schemas for their MADlib output tables, rendering them inaccessible to other users. - `madlib` Schema-Level Permissions +- By default, MADlib is installed in a schema named `madlib`. You can choose to install MADlib in a different schema. References to `madlib` in the list below apply to the schema in which you installed MADlib. - Assign `usage-schema` and `create` privileges to the `madlib` schema. - Assign `execute` permissions on all functions within the `madlib` schema, including any functions called within. - Assign `insert` and `select` permissions to all tables within the `madlib` schema. - Assign the `usage-schema` and `create` permissions for the current schema, and any schema in which the source, output, and model tables may reside. - -- Function-Specific Permissions -- Assign `insert` and `select` permissions for the source, output, and model tables. -- Assign `insert` and `select` permissions for the output \_summary and \__group tables. -
[03/17] incubator-hawq-docs git commit: Merge branch 'develop'
Merge branch 'develop' Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/3377f513 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/3377f513 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/3377f513 Branch: refs/heads/release/2.2.0.0-incubating Commit: 3377f513fc1a70314955e3cb5ddd8e090a8cdafc Parents: c3d7896 81b1ef8 Author: David Yozie Authored: Fri Sep 30 17:26:03 2016 -0700 Committer: David Yozie Committed: Fri Sep 30 17:26:03 2016 -0700 -- .../g-loading-and-unloading-data.html.md.erb| 4 +- datamgmt/load/g-register_files.html.md.erb | 208 +++ reference/.DS_Store | Bin 6148 -> 0 bytes .../cli/admin_utilities/hawqextract.html.md.erb | 4 +- .../admin_utilities/hawqregister.html.md.erb| 177 ++-- 5 files changed, 331 insertions(+), 62 deletions(-) --
[08/17] incubator-hawq-docs git commit: hawq_rm_return_percent_on_overcommit clarification
hawq_rm_return_percent_on_overcommit clarification Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/a3ebec2d Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/a3ebec2d Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/a3ebec2d Branch: refs/heads/release/2.2.0.0-incubating Commit: a3ebec2d865b67eb4a292ab6bbacf11c3fe6e3b1 Parents: 975ef85 Author: Lisa Owen Authored: Fri Apr 7 09:46:58 2017 -0700 Committer: Lisa Owen Committed: Fri Apr 7 09:46:58 2017 -0700 -- markdown/reference/guc/parameter_definitions.html.md.erb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/a3ebec2d/markdown/reference/guc/parameter_definitions.html.md.erb -- diff --git a/markdown/reference/guc/parameter_definitions.html.md.erb b/markdown/reference/guc/parameter_definitions.html.md.erb index 1f94c5a..70416d6 100644 --- a/markdown/reference/guc/parameter_definitions.html.md.erb +++ b/markdown/reference/guc/parameter_definitions.html.md.erb @@ -2043,7 +2043,7 @@ Amount of time, in seconds, before idle resources are returned to YARN. ## hawq\_rm\_return\_percent\_on\_overcommit -Determines how many containers the global resource manager should return to the global resource manager (YARN for example.) This configuration only applies when HAWQ's YARN queue is busy, and HAWQ makes the YARN queue overuse its resources. The default value is 10, which means HAWQ will return 10% of acquired YARN containers by pausing the allocation of resources to HAWQ queries. +Determines how many containers HAWQ should return to the global resource manager (YARN for example.) This configuration only applies when HAWQ's YARN queue is busy, and HAWQ makes the YARN queue overuse its resources. The default value is 10, which means HAWQ will return 10% of acquired YARN containers by pausing the allocation of resources to HAWQ queries. In a typical deployment, you do not need to modify the default value of this parameter.
[13/17] incubator-hawq-docs git commit: Fix markdown formatting in README
Fix markdown formatting in README Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/51cd83d5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/51cd83d5 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/51cd83d5 Branch: refs/heads/release/2.2.0.0-incubating Commit: 51cd83d5657086a633b6fb0010974a1c1d3cd91d Parents: 6667ed2 Author: David Yozie Authored: Mon Apr 17 14:01:12 2017 -0700 Committer: David Yozie Committed: Mon Apr 17 14:05:08 2017 -0700 -- README.md | 16 1 file changed, 8 insertions(+), 8 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/51cd83d5/README.md -- diff --git a/README.md b/README.md index 331d272..79cddb6 100644 --- a/README.md +++ b/README.md @@ -33,24 +33,24 @@ For Apache HAWQ (incubating), a preconfigured **book** is provided in the `/book 2. Install bookbinder and its dependent gems. Make sure you are in the `book` directory and enter: ``` bash -$ bundle install -``` +$ bundle install +``` 3. The installed `config.yml` file configures the book for building from your local HAWQ source files. Build the output HTML files by executing the command: ``` bash -$ bundle exec bookbinder bind local -``` +$ bundle exec bookbinder bind local +``` Bookbinder converts the XML source into HTML, and puts the final output in the `final_app` directory. 5. The `final_app` directory stages the HTML into a web application that you can view using the rack gem. To view the documentation build: ``` bash -$ cd final_app -$ bundle install -$ rackup -``` +$ cd final_app +$ bundle install +$ rackup +``` Your local documentation is now available for viewing at[http://localhost:9292](http://localhost:9292)
[04/17] incubator-hawq-docs git commit: Merge branch 'develop'
Merge branch 'develop' Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/135ab9b8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/135ab9b8 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/135ab9b8 Branch: refs/heads/release/2.2.0.0-incubating Commit: 135ab9b85eadbc6b3f369965978afbb07f62de4d Parents: 3377f51 e169704 Author: David Yozie Authored: Fri Sep 30 17:47:20 2016 -0700 Committer: David Yozie Committed: Fri Sep 30 17:47:20 2016 -0700 -- pxf/InstallPXFPlugins.html.md.erb | 133 - 1 file changed, 30 insertions(+), 103 deletions(-) --
[07/17] incubator-hawq-docs git commit: updating redirects for 2.2.0.0-incubating
updating redirects for 2.2.0.0-incubating Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/975ef85d Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/975ef85d Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/975ef85d Branch: refs/heads/release/2.2.0.0-incubating Commit: 975ef85d8c4725a313fee8488c0c3d0372d16ce4 Parents: 4f333a3 Author: David Yozie Authored: Fri Apr 7 09:16:47 2017 -0700 Committer: David Yozie Committed: Fri Apr 7 09:19:28 2017 -0700 -- book/redirects.rb | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/blob/975ef85d/book/redirects.rb -- diff --git a/book/redirects.rb b/book/redirects.rb index a09023b..6c580a0 100644 --- a/book/redirects.rb +++ b/book/redirects.rb @@ -1,4 +1,4 @@ -r301 '/', '/docs/userguide/2.1.0.0-incubating/overview/HAWQOverview.html' -r301 '/index.html', '/docs/userguide/2.1.0.0-incubating/overview/HAWQOverview.html' -r301 '/docs', '/docs/userguide/2.1.0.0-incubating/overview/HAWQOverview.html' +r301 '/', '/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html' +r301 '/index.html', '/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html' +r301 '/docs', '/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html'
[02/17] incubator-hawq-docs git commit: Merge branch 'develop'
Merge branch 'develop' Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/commit/c3d7896c Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/tree/c3d7896c Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-docs/diff/c3d7896c Branch: refs/heads/release/2.2.0.0-incubating Commit: c3d7896c3c0c2152e30b27f19a413d82e14de699 Parents: 52ce16b 10cde80 Author: David Yozie Authored: Thu Sep 29 10:21:52 2016 -0700 Committer: David Yozie Committed: Thu Sep 29 10:21:52 2016 -0700 -- README.md | 8 +- admin/ClusterExpansion.html.md.erb | 14 +- ...esandHighAvailabilityEnabledHDFS.html.md.erb | 18 +- admin/RecommendedMonitoringTasks.html.md.erb| 10 +- admin/ambari-admin.html.md.erb | 20 +- admin/monitor.html.md.erb | 2 +- admin/startstop.html.md.erb | 4 +- bestpractices/general_bestpractices.html.md.erb | 1 + clientaccess/client_auth.html.md.erb| 14 +- clientaccess/disable-kerberos.html.md.erb | 11 +- ...-database-application-interfaces.html.md.erb | 15 +- .../g-supported-client-applications.html.md.erb | 2 +- clientaccess/kerberos.html.md.erb | 20 +- clientaccess/roles_privs.html.md.erb| 2 +- datamgmt/BasicDataOperations.html.md.erb| 12 +- datamgmt/ConcurrencyControl.html.md.erb | 7 - datamgmt/Transactions.html.md.erb | 10 +- datamgmt/about_statistics.html.md.erb | 8 +- datamgmt/load/client-loadtools.html.md.erb | 58 +- ...-data-load-and-query-performance.html.md.erb | 6 +- ddl/ddl-partition.html.md.erb | 6 +- ddl/ddl-storage.html.md.erb | 9 +- ddl/ddl-table.html.md.erb | 6 +- .../source/subnavs/apache-hawq-nav.erb | 955 --- install/aws-config.html.md.erb | 18 +- overview/HAWQArchitecture.html.md.erb | 4 +- overview/ManagementTools.html.md.erb| 2 +- overview/RedundancyFailover.html.md.erb | 2 +- overview/ResourceManagement.html.md.erb | 2 +- overview/TableDistributionStorage.html.md.erb | 6 +- plext/using_pljava.html.md.erb | 4 +- pxf/HawqExtensionFrameworkPXF.html.md.erb | 4 + pxf/HivePXF.html.md.erb | 18 +- pxf/InstallPXFPlugins.html.md.erb | 12 +- pxf/TroubleshootingPXF.html.md.erb | 71 +- query/functions-operators.html.md.erb | 2 +- reference/HAWQDataTypes.html.md.erb | 4 +- reference/HAWQEnvironmentVariables.html.md.erb | 12 +- reference/catalog/pg_class.html.md.erb | 2 +- reference/catalog/pg_index.html.md.erb | 2 +- .../cli/admin_utilities/gpfdist.html.md.erb | 2 +- .../cli/admin_utilities/gplogfilter.html.md.erb | 16 +- .../cli/admin_utilities/hawqcheck.html.md.erb | 25 +- .../cli/admin_utilities/hawqload.html.md.erb| 2 +- .../admin_utilities/hawqregister.html.md.erb| 27 +- .../admin_utilities/hawqssh-exkeys.html.md.erb | 7 +- .../cli/admin_utilities/hawqstate.html.md.erb | 8 - .../cli/client_utilities/vacuumdb.html.md.erb | 2 + reference/guc/guc_category-list.html.md.erb | 3 +- reference/guc/parameter_definitions.html.md.erb | 25 +- reference/sql/ALTER-RESOURCE-QUEUE.html.md.erb | 8 +- reference/sql/ALTER-TABLE.html.md.erb | 2 +- reference/sql/BEGIN.html.md.erb | 2 +- reference/sql/COPY.html.md.erb | 2 +- reference/sql/CREATE-EXTERNAL-TABLE.html.md.erb | 2 +- reference/sql/CREATE-RESOURCE-QUEUE.html.md.erb | 8 +- reference/sql/CREATE-TABLE.html.md.erb | 10 +- reference/sql/CREATE-VIEW.html.md.erb | 2 +- reference/sql/DROP-TABLE.html.md.erb| 2 +- reference/sql/GRANT.html.md.erb | 2 +- reference/sql/PREPARE.html.md.erb | 2 +- reference/sql/VACUUM.html.md.erb| 10 +- reference/toolkit/hawq_toolkit.html.md.erb | 2 +- requirements/system-requirements.html.md.erb| 44 +- .../ConfigureResourceManagement.html.md.erb | 6 +- resourcemgmt/HAWQResourceManagement.html.md.erb | 2 +- resourcemgmt/ResourceQueues.html.md.erb | 8 +- resourcemgmt/YARNIntegration.html.md.erb| 2 +- resourcemgmt/best-practices.html.md.erb | 4 +- troubleshooting/Troubleshooting.html.md.erb | 10 +- 70 files changed, 392 insertions(+), 1238 deletions(-) --
incubator-hawq-site git commit: link fix
Repository: incubator-hawq-site Updated Branches: refs/heads/asf-site 1da4a097a -> 4f92c2471 link fix Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/commit/4f92c247 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/tree/4f92c247 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/diff/4f92c247 Branch: refs/heads/asf-site Commit: 4f92c247172dca8cb83b701e745fb455a9e9c0bb Parents: 1da4a09 Author: dyozie Authored: Tue May 23 16:50:15 2017 -0700 Committer: dyozie Committed: Tue May 23 16:50:15 2017 -0700 -- index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/4f92c247/index.html -- diff --git a/index.html b/index.html index 4917379..667b7af 100644 --- a/index.html +++ b/index.html @@ -231,7 +231,7 @@ Documentation and how-to tips can always be made clearer, better organized, more complete, and translated to more languages. - — Getting Started with HAWQ + — Getting Started with HAWQ — https://cwiki.apache.org/confluence/display/HAWQ";>HAWQ Wiki — HAWQ Docs — http://hawq.incubator.apache.org/docs/pxf/javadoc/";>PXF Java API
incubator-hawq-site git commit: updating doc link behavior; adding Getting Started link
Repository: incubator-hawq-site Updated Branches: refs/heads/asf-site bca6af3d8 -> 1da4a097a updating doc link behavior; adding Getting Started link Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/commit/1da4a097 Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/tree/1da4a097 Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/diff/1da4a097 Branch: refs/heads/asf-site Commit: 1da4a097a376845f3ee350a52a47d26f5cd06089 Parents: bca6af3 Author: dyozie Authored: Tue May 23 16:48:50 2017 -0700 Committer: dyozie Committed: Tue May 23 16:48:50 2017 -0700 -- index.html | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/1da4a097/index.html -- diff --git a/index.html b/index.html index 746f1cb..4917379 100644 --- a/index.html +++ b/index.html @@ -49,7 +49,7 @@ Contribute Mailing Lists Download -Docs +Docs More… @@ -192,7 +192,7 @@ Are you a HAWQ expert? Want to share your knowledge with others? We are collaborative community that shares best practices. - — https://cwiki.apache.org/confluence/display/HAWQ";>HAWQ Meetups + — https://cwiki.apache.org/confluence/display/HAWQ";>HAWQ Meetups — http://mail-archives.apache.org/mod_mbox/incubator-hawq-user/";>HAWQ User mail list — https://twitter.com/ApacheHAWQ";>HAWQ social media @@ -231,6 +231,7 @@ Documentation and how-to tips can always be made clearer, better organized, more complete, and translated to more languages. + — Getting Started with HAWQ — https://cwiki.apache.org/confluence/display/HAWQ";>HAWQ Wiki — HAWQ Docs — http://hawq.incubator.apache.org/docs/pxf/javadoc/";>PXF Java API
incubator-hawq-site git commit: updating /latest redirect to point to 2.2.0.0-incubating docs
Repository: incubator-hawq-site Updated Branches: refs/heads/asf-site f7bde4beb -> bca6af3d8 updating /latest redirect to point to 2.2.0.0-incubating docs Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/commit/bca6af3d Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/tree/bca6af3d Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/diff/bca6af3d Branch: refs/heads/asf-site Commit: bca6af3d88521373af203205efbc087f0e4748e6 Parents: f7bde4b Author: dyozie Authored: Tue May 23 16:29:45 2017 -0700 Committer: dyozie Committed: Tue May 23 16:29:45 2017 -0700 -- docs/userguide/latest/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/bca6af3d/docs/userguide/latest/index.html -- diff --git a/docs/userguide/latest/index.html b/docs/userguide/latest/index.html index f9ff594..3c41811 100644 --- a/docs/userguide/latest/index.html +++ b/docs/userguide/latest/index.html @@ -3,7 +3,7 @@ -window.location = "/docs/userguide/2.1.0.0-incubating/overview/HAWQOverview.html"; +window.location = "/docs/userguide/2.2.0.0-incubating/overview/HAWQOverview.html";
[21/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
regenerating 2.2.0.0-incubating html with latest commits, including new tutorials Project: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/commit/f7bde4be Tree: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/tree/f7bde4be Diff: http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/diff/f7bde4be Branch: refs/heads/asf-site Commit: f7bde4beb22780b8c8e7b3137c6d6afdb3c63fb4 Parents: 3cfac27 Author: dyozie Authored: Tue May 23 16:25:24 2017 -0700 Committer: dyozie Committed: Tue May 23 16:25:24 2017 -0700 -- .../BackingUpandRestoringHAWQDatabases.html | 27 + .../admin/ClusterExpansion.html | 27 + .../2.2.0.0-incubating/admin/ClusterShrink.html | 27 + .../admin/FaultTolerance.html | 27 + ...ilespacesandHighAvailabilityEnabledHDFS.html | 27 + .../admin/HighAvailability.html | 27 + .../admin/MasterMirroring.html | 27 + .../admin/RecommendedMonitoringTasks.html | 27 + .../2.2.0.0-incubating/admin/RunningHAWQ.html | 27 + .../2.2.0.0-incubating/admin/ambari-admin.html | 27 + .../admin/ambari-rest-api.html | 27 + .../2.2.0.0-incubating/admin/logfiles.html | 27 + .../2.2.0.0-incubating/admin/maintain.html | 27 + .../2.2.0.0-incubating/admin/monitor.html | 27 + .../admin/setuphawqopenv.html | 27 + .../2.2.0.0-incubating/admin/startstop.html | 27 + .../HAWQBestPracticesOverview.html | 27 + .../config_hawq_bestpractices.html | 27 + .../bestpractices/general_bestpractices.html| 27 + .../managing_data_bestpractices.html| 27 + .../managing_resources_bestpractices.html | 27 + .../operating_hawq_bestpractices.html | 27 + .../querying_data_bestpractices.html| 27 + .../bestpractices/secure_bestpractices.html | 27 + .../clientaccess/client_auth.html | 27 + .../clientaccess/disable-kerberos.html | 27 + .../clientaccess/g-connecting-with-psql.html| 27 + .../g-database-application-interfaces.html | 27 + .../g-establishing-a-database-session.html | 27 + .../g-hawq-database-client-applications.html| 27 + .../g-supported-client-applications.html| 27 + .../g-troubleshooting-connection-problems.html | 27 + .../clientaccess/hawq-access-checks.html| 27 + .../2.2.0.0-incubating/clientaccess/index.html | 27 + .../clientaccess/kerberos.html | 27 + .../2.2.0.0-incubating/clientaccess/ldap.html | 27 + .../clientaccess/roles_privs.html | 31 +- .../datamgmt/BasicDataOperations.html | 27 + .../datamgmt/ConcurrencyControl.html| 27 + .../datamgmt/HAWQInputFormatforMapReduce.html | 27 + .../datamgmt/Transactions.html | 27 + .../datamgmt/about_statistics.html | 27 + .../2.2.0.0-incubating/datamgmt/dml.html| 27 + .../datamgmt/load/client-loadtools.html | 27 + .../load/creating-external-tables-examples.html | 27 + .../g-about-gpfdist-setup-and-performance.html | 27 + .../datamgmt/load/g-character-encoding.html | 27 + .../g-command-based-web-external-tables.html| 27 + .../load/g-configuration-file-format.html | 27 + .../load/g-controlling-segment-parallelism.html | 27 + ...-error-table-and-declare-a-reject-limit.html | 27 + ...-creating-and-using-web-external-tables.html | 27 + ...l-table-with-single-row-error-isolation.html | 27 + ...mmand-based-writable-external-web-table.html | 27 + ...ng-a-file-based-writable-external-table.html | 27 + .../g-determine-the-transformation-schema.html | 27 + ...ute-for-web-or-writable-external-tables.html | 27 + .../load/g-escaping-in-csv-formatted-files.html | 27 + .../g-escaping-in-text-formatted-files.html | 27 + .../datamgmt/load/g-escaping.html | 27 + ...database-publications-in-demo-directory.html | 27 + .../g-example-hawq-file-server-gpfdist.html | 27 + ...ple-irs-mef-xml-files-in-demo-directory.html | 27 + ...-example-witsml-files-in-demo-directory.html | 27 + .../load/g-examples-read-fixed-width-data.html | 27 + .../datamgmt/load/g-external-tables.html| 27 + .../datamgmt/load/g-formatting-columns.html | 27 + .../datamgmt/load/g-formatting-data-files.html | 27 + .../datamgmt/load/g-formatting-rows.html| 27 + .../datamgmt/load/g-gpfdist-protocol.html | 27 + .../datamgmt/load/g-gpfdists-protocol.html | 27 + .../load/g-handling-errors-ext-table-data.html | 27 + .../datamgmt/load/g-handling-load-errors.html | 27 + ...g-invalid-csv-files-in-error-table-data.html | 27 + ...mporting-and-expo
[12/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqload.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqload.html b/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqload.html index 17b3e84..6184656 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqload.html +++ b/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqload.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqregister.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqregister.html b/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqregister.html index 39aefbc..1f92c09 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqregister.html +++ b/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqregister.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqrestart.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqrestart.html b/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqrestart.html index 62e5634..7979a38 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqrestart.html +++ b/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqrestart.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqscp.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqscp.html b/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqscp.html index 6688201..4b1bee8 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/cli/admin_utilities/hawqs
[08/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/basicdbadmin.html -- diff --git a/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/basicdbadmin.html b/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/basicdbadmin.html new file mode 100644 index 000..de94d67 --- /dev/null +++ b/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/basicdbadmin.html @@ -0,0 +1,1235 @@ + + + + + + + + + + + Lesson 3 - Database Administration | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Management + + + Configuring HAWQ to use Ranger Policy Management + + + Creating HAWQ Authorization Policies in Ranger + +
[10/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-LANGUAGE.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-LANGUAGE.html b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-LANGUAGE.html index 71914a1..412499b 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-LANGUAGE.html +++ b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-LANGUAGE.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR-CLASS.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR-CLASS.html b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR-CLASS.html index b6c6c4b..33819ad 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR-CLASS.html +++ b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR-CLASS.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR.html b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR.html index b884abf..8d4ad91 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR.html +++ b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OPERATOR.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OWNED.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OWNED.html b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OWNED.html index 86f1fc0..57a170c 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OWNED.html +++ b/docs/userguide/2.2.0.0-incubating/reference/sql/DROP-OWNED.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Envir
[20/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/clientaccess/g-database-application-interfaces.html -- diff --git a/docs/userguide/2.2.0.0-incubating/clientaccess/g-database-application-interfaces.html b/docs/userguide/2.2.0.0-incubating/clientaccess/g-database-application-interfaces.html index 32b6d95..2b58e24 100644 --- a/docs/userguide/2.2.0.0-incubating/clientaccess/g-database-application-interfaces.html +++ b/docs/userguide/2.2.0.0-incubating/clientaccess/g-database-application-interfaces.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/clientaccess/g-establishing-a-database-session.html -- diff --git a/docs/userguide/2.2.0.0-incubating/clientaccess/g-establishing-a-database-session.html b/docs/userguide/2.2.0.0-incubating/clientaccess/g-establishing-a-database-session.html index a2df1bf..4357098 100644 --- a/docs/userguide/2.2.0.0-incubating/clientaccess/g-establishing-a-database-session.html +++ b/docs/userguide/2.2.0.0-incubating/clientaccess/g-establishing-a-database-session.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/clientaccess/g-hawq-database-client-applications.html -- diff --git a/docs/userguide/2.2.0.0-incubating/clientaccess/g-hawq-database-client-applications.html b/docs/userguide/2.2.0.0-incubating/clientaccess/g-hawq-database-client-applications.html index 325e541..d8906e4 100644 --- a/docs/userguide/2.2.0.0-incubating/clientaccess/g-hawq-database-client-applications.html +++ b/docs/userguide/2.2.0.0-incubating/clientaccess/g-hawq-database-client-applications.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/clientaccess/g-supported-client-applications.html -- diff --git a/docs/userguide/2.2.0.0-incubating/clientaccess/g-supported-client-applications.html b/docs/userguide/2.2.0.0-incubating/clientaccess/g-supported-client-applic
[03/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/introhawqtbls.html -- diff --git a/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/introhawqtbls.html b/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/introhawqtbls.html new file mode 100644 index 000..00ec391 --- /dev/null +++ b/docs/userguide/2.2.0.0-incubating/tutorial/gettingstarted/introhawqtbls.html @@ -0,0 +1,1220 @@ + + + + + + + + + + + Lesson 5 - HAWQ Tables | +Apache HAWQ (Incubating) Docs + + + + + + + + + + + + + + + + document.domain = ""; + + + + + + Apache HAWQ (incubating) Documentation + + + + + http://hawq.incubator.apache.org/";>Back to Apache HAWQ Page + +https://issues.apache.org/jira/browse/HAWQ"; target="_blank">Issues + + + + + + + + + + +Doc Index + + + +Apache HAWQ (incubating) + + System Requirements + + + + HAWQ System Overview + + + +What is HAWQ? + + +HAWQ Architecture + + +Table Distribution and Storage + + +Elastic Query Execution Runtime + + +Resource Management + + +HDFS Catalog Cache + + +Management Tools + + +High Availability, Redundancy and Fault Tolerance + + + + +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + + + Running a HAWQ Cluster + + + +Overview + + +Introducing the HAWQ Operating Environment + + +Managing HAWQ Using Ambari + + + Using the Ambari REST API + + + + +Starting and Stopping HAWQ + + +Expanding a Cluster + + +Removing a Node + + +Backing Up and Restoring HAWQ + + +High Availability in HAWQ + + +Master Mirroring + + +HAWQ Filespaces and High Availability Enabled HDFS + + +Understanding the Fault Tolerance Service + + +Recommended Monitoring and Maintenance Tasks + + +Routine System Maintenance Tasks + + +Monitoring a HAWQ System + + +HAWQ Administrative Log Files + + + + + + Managing Resources + + + +How HAWQ Manages Resources + + +Best Practices for Configuring Resource Management + + +Configuring Resource Management + + +Integrating YARN with HAWQ + + +Working with Hierarchical Resource Queues + + +Analyzing Resource Manager Status + + + + + + Managing Client Access + + + +Configuring Client Authentication + + +Using LDAP Authentication with TLS/SSL + + +Using Kerberos Authentication + + +Disabling Kerberos Security + + + Overview of HAWQ Authorization + + + Using HAWQ Native Authorization + + + +Using Ranger for Authorization + + + + Overview of Ranger Policy Management + + + Configuring HAWQ to use Ranger Policy Management + + + Creating HAWQ Authorization Policies in Ranger + +
[14/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relation_node.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relation_node.html b/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relation_node.html index df69029..7b84fcc 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relation_node.html +++ b/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relation_node.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relfile_node.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relfile_node.html b/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relfile_node.html index 67e5b12..89881eb 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relfile_node.html +++ b/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_relfile_node.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_tablespace_node.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_tablespace_node.html b/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_tablespace_node.html index 4b0ec46..066d1e7 100644 --- a/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_tablespace_node.html +++ b/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_persistent_tablespace_node.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_relfile_node.html -- diff --git a/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_relfile_node.html b/docs/userguide/2.2.0.0-incubating/reference/catalog/gp_relfile_node.html index 16c18ea..ccab968 100644 --- a/docs/u
[15/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-fallback.html -- diff --git a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-fallback.html b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-fallback.html index 85c7a15..bf079cf 100644 --- a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-fallback.html +++ b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-fallback.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-features.html -- diff --git a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-features.html b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-features.html index 9733bc6..537a586 100644 --- a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-features.html +++ b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-features.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-limitations.html -- diff --git a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-limitations.html b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-limitations.html index 5dbdc2c..c7ccbd6 100644 --- a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-limitations.html +++ b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-limitations.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-notes.html -- diff --git a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-notes.html b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-notes.html index 9a1f36d..d9ab669 100644 --- a/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-notes.html +++ b/docs/userguide/2.2.0.0-incubating/query/gporca/query-gporca-notes.html @@ -89,6 +89,30 @@
[16/21] incubator-hawq-site git commit: regenerating 2.2.0.0-incubating html with latest commits, including new tutorials
http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/index.html -- diff --git a/docs/userguide/2.2.0.0-incubating/index.html b/docs/userguide/2.2.0.0-incubating/index.html index 78f014a..f4cb0cd 100644 --- a/docs/userguide/2.2.0.0-incubating/index.html +++ b/docs/userguide/2.2.0.0-incubating/index.html @@ -93,6 +93,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -268,6 +292,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/install/aws-config.html -- diff --git a/docs/userguide/2.2.0.0-incubating/install/aws-config.html b/docs/userguide/2.2.0.0-incubating/install/aws-config.html index bb98656..99ba12c 100644 --- a/docs/userguide/2.2.0.0-incubating/install/aws-config.html +++ b/docs/userguide/2.2.0.0-incubating/install/aws-config.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/install/select-hosts.html -- diff --git a/docs/userguide/2.2.0.0-incubating/install/select-hosts.html b/docs/userguide/2.2.0.0-incubating/install/select-hosts.html index 475fc42..98c77b1 100644 --- a/docs/userguide/2.2.0.0-incubating/install/select-hosts.html +++ b/docs/userguide/2.2.0.0-incubating/install/select-hosts.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sample Data Set and HAWQ Schemas + + + Lesson 5 - HAWQ Tables + + + Lesson 6 - HAWQ Extension Framework (PXF) + + + + + Running a HAWQ Cluster @@ -264,6 +288,9 @@ Creating and Managing Tables + Identifying HAWQ Table HDFS Files + + Choosing the Table Storage Model http://git-wip-us.apache.org/repos/asf/incubator-hawq-site/blob/f7bde4be/docs/userguide/2.2.0.0-incubating/overview/ElasticSegments.html -- diff --git a/docs/userguide/2.2.0.0-incubating/overview/ElasticSegments.html b/docs/userguide/2.2.0.0-incubating/overview/ElasticSegments.html index 87ec074..08be421 100644 --- a/docs/userguide/2.2.0.0-incubating/overview/ElasticSegments.html +++ b/docs/userguide/2.2.0.0-incubating/overview/ElasticSegments.html @@ -89,6 +89,30 @@ +Getting Started with HAWQ Tutorial + + + Lesson 1 - Runtime Environment + + + Lesson 2 - Cluster Administration + + + Lesson 3 - Database Administration + + + Lesson 4 - Sa