[jira] [Assigned] (HAWQ-786) Framework to support pluggable formats and file systems

2017-06-27 Thread Lei Chang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Chang reassigned HAWQ-786:
--

Assignee: Lei Chang  (was: hongwu)

> Framework to support pluggable formats and file systems
> ---
>
> Key: HAWQ-786
> URL: https://issues.apache.org/jira/browse/HAWQ-786
> Project: Apache HAWQ
>  Issue Type: Wish
>  Components: Storage
>Reporter: Lei Chang
>Assignee: Lei Chang
> Fix For: backlog
>
> Attachments: ORCdesign-v0.1-2016-06-17.pdf
>
>
> In current HAWQ, two native formats are supported: AO and parquet. Now we 
> want to support ORC. A framework to support naive c/c++ pluggable format is 
> needed to support ORC more easily. And it can also be potentially used for 
> fast external data access.
> And there are a lot of requests for supporting S3, Ceph and other file 
> systems, and this is closely related to pluggable formats, so this JIRA is 
> proposing a framework to support both.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HAWQ-786) Framework to support pluggable formats and file systems

2017-06-27 Thread Lei Chang (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065952#comment-16065952
 ] 

Lei Chang commented on HAWQ-786:


This feature has been not active for some time. A lot of hawq users are asking 
this feature. currently, we are working on this feature. I am assigning this 
issue to me. Hope that we can release this feature in next release.





> Framework to support pluggable formats and file systems
> ---
>
> Key: HAWQ-786
> URL: https://issues.apache.org/jira/browse/HAWQ-786
> Project: Apache HAWQ
>  Issue Type: Wish
>  Components: Storage
>Reporter: Lei Chang
>Assignee: hongwu
> Fix For: backlog
>
> Attachments: ORCdesign-v0.1-2016-06-17.pdf
>
>
> In current HAWQ, two native formats are supported: AO and parquet. Now we 
> want to support ORC. A framework to support naive c/c++ pluggable format is 
> needed to support ORC more easily. And it can also be potentially used for 
> fast external data access.
> And there are a lot of requests for supporting S3, Ceph and other file 
> systems, and this is closely related to pluggable formats, so this JIRA is 
> proposing a framework to support both.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Resolved] (HAWQ-1475) Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache HAWQ binary release

2017-06-27 Thread Ruilong Huo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruilong Huo resolved HAWQ-1475.
---
Resolution: Fixed

> Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache 
> HAWQ binary release
> -
>
> Key: HAWQ-1475
> URL: https://issues.apache.org/jira/browse/HAWQ-1475
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build
>Affects Versions: 2.2.0.0-incubating
>Reporter: Ruilong Huo
>Assignee: Ruilong Huo
> Fix For: 2.2.0.0-incubating
>
>
> Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, 
> we need to add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for 
> the binary release.
> Refer to 
> https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
>  for detail.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HAWQ-1475) Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache HAWQ binary release

2017-06-27 Thread Ruilong Huo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruilong Huo updated HAWQ-1475:
--
Affects Version/s: 2.2.0.0-incubating

> Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache 
> HAWQ binary release
> -
>
> Key: HAWQ-1475
> URL: https://issues.apache.org/jira/browse/HAWQ-1475
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build
>Affects Versions: 2.2.0.0-incubating
>Reporter: Ruilong Huo
>Assignee: Ruilong Huo
> Fix For: 2.2.0.0-incubating
>
>
> Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, 
> we need to add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for 
> the binary release.
> Refer to 
> https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
>  for detail.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HAWQ-1475) Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache HAWQ binary release

2017-06-27 Thread Ruilong Huo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruilong Huo updated HAWQ-1475:
--
Summary: Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for 
Apache HAWQ binary release  (was: Add LICENSE, NOTICE, and DISCLAIMER files for 
Apache HAWQ binary release)

> Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache 
> HAWQ binary release
> -
>
> Key: HAWQ-1475
> URL: https://issues.apache.org/jira/browse/HAWQ-1475
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build
>Reporter: Ruilong Huo
>Assignee: Ruilong Huo
> Fix For: 2.2.0.0-incubating
>
>
> Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, 
> we need to add LICENSE, NOTICE, and DISCLAIMER files for the binary release.
> Refer to 
> https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
>  for detail.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HAWQ-1475) Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache HAWQ binary release

2017-06-27 Thread Ruilong Huo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruilong Huo updated HAWQ-1475:
--
Description: 
Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, we 
need to add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for the 
binary release.

Refer to 
https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
 for detail.

  was:
Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, we 
need to add LICENSE, NOTICE, and DISCLAIMER files for the binary release.

Refer to 
https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
 for detail.


> Add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for Apache 
> HAWQ binary release
> -
>
> Key: HAWQ-1475
> URL: https://issues.apache.org/jira/browse/HAWQ-1475
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build
>Reporter: Ruilong Huo
>Assignee: Ruilong Huo
> Fix For: 2.2.0.0-incubating
>
>
> Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, 
> we need to add LICENSE, NOTICE, and DISCLAIMER files for c/c++ components for 
> the binary release.
> Refer to 
> https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
>  for detail.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HAWQ-1489) For PXF jar files, add LICENSE, NOTICE, and DISCLAIMER files for Apache HAWQ binary release

2017-06-27 Thread Ruilong Huo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruilong Huo updated HAWQ-1489:
--
Affects Version/s: 2.2.0.0-incubating

> For PXF jar files, add LICENSE, NOTICE, and DISCLAIMER files for Apache HAWQ 
> binary release
> ---
>
> Key: HAWQ-1489
> URL: https://issues.apache.org/jira/browse/HAWQ-1489
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build, PXF
>Affects Versions: 2.2.0.0-incubating
>Reporter: Ed Espino
>Assignee: Ed Espino
> Fix For: 2.2.0.0-incubating
>
>
> For PXF jar files, add LICENSE, NOTICE, and DISCLAIMER.
> Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, 
> we need to add LICENSE, NOTICE, and DISCLAIMER files for the binary release.
> Refer to 
> https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
>  for detail.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HAWQ-1489) Fix PXF jar files, add LICENSE, NOTICE, and DISCLAIMER files for Apache HAWQ binary release

2017-06-27 Thread Ruilong Huo (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruilong Huo updated HAWQ-1489:
--
Summary: Fix PXF jar files, add LICENSE, NOTICE, and DISCLAIMER files for 
Apache HAWQ binary release  (was: For PXF jar files, add LICENSE, NOTICE, and 
DISCLAIMER files for Apache HAWQ binary release)

> Fix PXF jar files, add LICENSE, NOTICE, and DISCLAIMER files for Apache HAWQ 
> binary release
> ---
>
> Key: HAWQ-1489
> URL: https://issues.apache.org/jira/browse/HAWQ-1489
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build, PXF
>Affects Versions: 2.2.0.0-incubating
>Reporter: Ed Espino
>Assignee: Ed Espino
> Fix For: 2.2.0.0-incubating
>
>
> For PXF jar files, add LICENSE, NOTICE, and DISCLAIMER.
> Per review from IPMC vote for Apache HAWQ 2.2.0.0-incubating binary release, 
> we need to add LICENSE, NOTICE, and DISCLAIMER files for the binary release.
> Refer to 
> https://lists.apache.org/thread.html/13a66f0f5762166f37354ec2cdc7e82f531b74650be16239f5f738ce@%3Cdev.hawq.apache.org%3E
>  for detail.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HAWQ-1491) docs - add usage info for HiveVectorizedORC profile

2017-06-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065669#comment-16065669
 ] 

ASF GitHub Bot commented on HAWQ-1491:
--

Github user sansanichfb commented on a diff in the pull request:

https://github.com/apache/incubator-hawq-docs/pull/126#discussion_r124423336
  
--- Diff: markdown/pxf/ReadWritePXF.html.md.erb ---
@@ -105,6 +105,18 @@ Note: The DELIMITER 
parameter is mandatory.
 org.apache.hawq.pxf.service.io.GPDBWritable
 
 
+
+HiveVectorizedORC
+Optimized block read of a Hive table where each partition is stored as 
an ORC file.
--- End diff --

People might get confused with HDFS block, so we can maybe use bulk/batch 
read.


> docs - add usage info for HiveVectorizedORC profile
> ---
>
> Key: HAWQ-1491
> URL: https://issues.apache.org/jira/browse/HAWQ-1491
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: Lisa Owen
>Assignee: David Yozie
>
> add usage info and an example for the new HiveVectorizedORC profile to the 
> Hive plug-in page.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HAWQ-1491) docs - add usage info for HiveVectorizedORC profile

2017-06-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065667#comment-16065667
 ] 

ASF GitHub Bot commented on HAWQ-1491:
--

Github user sansanichfb commented on a diff in the pull request:

https://github.com/apache/incubator-hawq-docs/pull/126#discussion_r124423164
  
--- Diff: markdown/pxf/HivePXF.html.md.erb ---
@@ -565,6 +577,44 @@ In the following example, you will create a Hive table 
stored in ORC format and
 Time: 425.416 ms
 ```
 
+### Example: Using the HiveVectorizedORC 
Profile
+
+In the following example, you will use the `HiveVectorizedORC` profile to 
query the `sales_info_ORC` Hive table you created in the previous example.
+
+**Note**: The `HiveVectorizedORC` profile does not support the timestamp 
data type and complex types.
+
+1. Start the `psql` subsystem:
+
+``` shell
+$ psql -d postgres
+```
+
+2. Use the PXF `HiveVectorizedORC` profile to create a queryable HAWQ 
external table from the Hive table named `sales_info_ORC` that you created in 
Step 1 of the previous example. The `FORMAT` clause must specify `'CUSTOM'`. 
The `HiveVectorizedORC` `CUSTOM` format supports only the built-in 
`'pxfwritable_import'` `formatter`.
--- End diff --

queryable - maybe readable?


> docs - add usage info for HiveVectorizedORC profile
> ---
>
> Key: HAWQ-1491
> URL: https://issues.apache.org/jira/browse/HAWQ-1491
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: Lisa Owen
>Assignee: David Yozie
>
> add usage info and an example for the new HiveVectorizedORC profile to the 
> Hive plug-in page.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HAWQ-1491) docs - add usage info for HiveVectorizedORC profile

2017-06-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065665#comment-16065665
 ] 

ASF GitHub Bot commented on HAWQ-1491:
--

Github user sansanichfb commented on a diff in the pull request:

https://github.com/apache/incubator-hawq-docs/pull/126#discussion_r124423088
  
--- Diff: markdown/pxf/HivePXF.html.md.erb ---
@@ -495,9 +500,16 @@ Use the `HiveORC` profile to access ORC format data. 
The `HiveORC` profile provi
 - `=`, `>`, `<`, `>=`, `<=`, `IS NULL`, and `IS NOT NULL` operators 
and comparisons between the `float8` and `float4` types
 - `IN` operator on arrays of `int2`, `int4`, `int8`, `boolean`, and 
`text`
 
-- Complex type support - You can access Hive tables composed of array, 
map, struct, and union data types. PXF serializes each of these complex types 
to `text`.
+When choosing an ORC-supporting profile, consider the following:
+
+- The `HiveORC` profile supports complex types. You can access Hive tables 
composed of array, map, struct, and union data types. PXF serializes each of 
these complex types to `text`.  
+
+The `HiveVectorizedORC` profile does not support complex types.
+
+- The `HiveVectorizedORC` profile reads 1024 rows of data, while the 
`HiveORC` profile reads only a single row at a time.
--- End diff --

profile reads 1024 rows of data at once


> docs - add usage info for HiveVectorizedORC profile
> ---
>
> Key: HAWQ-1491
> URL: https://issues.apache.org/jira/browse/HAWQ-1491
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: Lisa Owen
>Assignee: David Yozie
>
> add usage info and an example for the new HiveVectorizedORC profile to the 
> Hive plug-in page.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HAWQ-1491) docs - add usage info for HiveVectorizedORC profile

2017-06-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065576#comment-16065576
 ] 

ASF GitHub Bot commented on HAWQ-1491:
--

GitHub user lisakowen opened a pull request:

https://github.com/apache/incubator-hawq-docs/pull/126

HAWQ-1491 - create usage docs for HiveVectorizedORC profile

update hawq docs for new HiveVectorizedORC profile.
- add example to hive plug-in page
- include the profile and accessor/fragmenter/resolver classes in the 
appropriate tables in the other docs


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/lisakowen/incubator-hawq-docs 
feature/pxf-hivevectorizedorc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq-docs/pull/126.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #126


commit dfd692cb355e9505e82669c311c413c06ae8518e
Author: Lisa Owen 
Date:   2017-06-27T19:56:45Z

HAWQ-1491 - create usage docs for HiveVectorizedORC profile




> docs - add usage info for HiveVectorizedORC profile
> ---
>
> Key: HAWQ-1491
> URL: https://issues.apache.org/jira/browse/HAWQ-1491
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: Lisa Owen
>Assignee: David Yozie
>
> add usage info and an example for the new HiveVectorizedORC profile to the 
> Hive plug-in page.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HAWQ-1492) Package jdbc-plugin RPM with PXF installation

2017-06-27 Thread Lav Jain (JIRA) 
Lav Jain created HAWQ-1492:
--

 Summary: Package jdbc-plugin RPM with PXF installation
 Key: HAWQ-1492
 URL: https://issues.apache.org/jira/browse/HAWQ-1492
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: PXF
Reporter: Lav Jain
Assignee: Vineet Goel
 Fix For: 2.3.0.0-incubating


JDBC PXF RPM is currently not being installed when PXF is installed in an 
ambari cluster. PXF JDBC profile needs to be enabled as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (HAWQ-1492) Package jdbc-plugin RPM with PXF installation

2017-06-27 Thread Lav Jain (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lav Jain reassigned HAWQ-1492:
--

Assignee: Lav Jain  (was: Vineet Goel)

> Package jdbc-plugin RPM with PXF installation
> -
>
> Key: HAWQ-1492
> URL: https://issues.apache.org/jira/browse/HAWQ-1492
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: PXF
>Reporter: Lav Jain
>Assignee: Lav Jain
> Fix For: 2.3.0.0-incubating
>
>
> JDBC PXF RPM is currently not being installed when PXF is installed in an 
> ambari cluster. PXF JDBC profile needs to be enabled as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HAWQ-1491) docs - add usage info for HiveVectorizedORC profile

2017-06-27 Thread Lisa Owen (JIRA) 
Lisa Owen created HAWQ-1491:
---

 Summary: docs - add usage info for HiveVectorizedORC profile
 Key: HAWQ-1491
 URL: https://issues.apache.org/jira/browse/HAWQ-1491
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: Documentation
Reporter: Lisa Owen
Assignee: David Yozie


add usage info and an example for the new HiveVectorizedORC profile to the Hive 
plug-in page.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HAWQ-1490) PXF dummy text profile for non-hadoop testing.

2017-06-27 Thread Shivram Mani (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shivram Mani updated HAWQ-1490:
---
Description: 
A user should be able to create a PXF ext table with Demo profile that allows 
her to check whether PXF service is functional in a given system without 
relying on any backend data source.
This would serve as a profile to test PXF service/framework. The demo profile 
could return some configured static data while invoking all the necessary 
APIs/functions for the smoke test.

  was:
A user should be able to create a PXF ext table with Demo profile that allows 
her to check whether PXF service is functional in a given system without 
relying on any backend data source. 
The demo profile could return some configured static data while invoking all 
the necessary APIs/functions for the smoke test.


> PXF dummy text profile for non-hadoop testing.
> --
>
> Key: HAWQ-1490
> URL: https://issues.apache.org/jira/browse/HAWQ-1490
> Project: Apache HAWQ
>  Issue Type: New Feature
>  Components: PXF, Tests
>Reporter: John Gaskin
>Assignee: Shivram Mani
> Fix For: 2.3.0.0-incubating
>
>
> A user should be able to create a PXF ext table with Demo profile that allows 
> her to check whether PXF service is functional in a given system without 
> relying on any backend data source.
> This would serve as a profile to test PXF service/framework. The demo profile 
> could return some configured static data while invoking all the necessary 
> APIs/functions for the smoke test.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (HAWQ-1490) PXF dummy text profile for non-hadoop testing.

2017-06-27 Thread Shivram Mani (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shivram Mani reassigned HAWQ-1490:
--

Assignee: Shivram Mani  (was: Vineet Goel)

> PXF dummy text profile for non-hadoop testing.
> --
>
> Key: HAWQ-1490
> URL: https://issues.apache.org/jira/browse/HAWQ-1490
> Project: Apache HAWQ
>  Issue Type: New Feature
>  Components: PXF, Tests
>Reporter: John Gaskin
>Assignee: Shivram Mani
> Fix For: 2.3.0.0-incubating
>
>
> A user should be able to create a PXF ext table with Demo profile that allows 
> her to check whether PXF service is functional in a given system without 
> relying on any backend data source. The demo profile could return some 
> configured static data while invoking all the necessary APIs/functions for 
> the smoke test. User may wish to modify this preconfigured data file such 
> that the query then returns the modified content of the file



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Closed] (HAWQ-1437) Hadoop enabled Kerberos，HAWQ occurs errors

2017-06-27 Thread lynn (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lynn closed HAWQ-1437.
--
Resolution: Not A Bug

pxf:///错误

> Hadoop enabled Kerberos，HAWQ occurs errors
> --
>
> Key: HAWQ-1437
> URL: https://issues.apache.org/jira/browse/HAWQ-1437
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: lynn
>Assignee: Ed Espino
> Fix For: 2.2.0.0-incubating
>
>
> When kerberos enabled with Hadoop , HAWQ create external table from hdfs need 
> principal information， what should I do can create it success?
> postgres=# 
> postgres=# 
> postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month 
> text, num_orders int, total_sales float8)
> postgres-# LOCATION 
> ('pxf://mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple')
> postgres-#   FORMAT 'TEXT' (delimiter=E',');
> ERROR:  Invalid URI 
> pxf://mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple 
> : missing authority section
> postgres=# 
> postgres=# 
> postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month 
> text, num_orders int, total_sales float8)
> postgres-# LOCATION 
> ('pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA')
> postgres-#   FORMAT 'TEXT' (delimiter=E',');
> ERROR:  Invalid URI 
> pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA
>  : missing authority section



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (HAWQ-1437) Hadoop enabled Kerberos，HAWQ occurs errors

2017-06-27 Thread lynn (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lynn updated HAWQ-1437:
---
Description: 
When kerberos enabled with Hadoop , HAWQ create external table from hdfs need 
principal information， what should I do can create it success?

postgres=# 
postgres=# 
postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month text, 
num_orders int, total_sales float8)
postgres-# LOCATION 
('pxf://mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple')
postgres-#   FORMAT 'TEXT' (delimiter=E',');
ERROR:  Invalid URI 
pxf://mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple : 
missing authority section


postgres=# 
postgres=# 
postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month text, 
num_orders int, total_sales float8)
postgres-# LOCATION 
('pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA')
postgres-#   FORMAT 'TEXT' (delimiter=E',');
ERROR:  Invalid URI 
pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA
 : missing authority section

  was:
When kerberos enabled with Hadoop , HAWQ create external table from hdfs need 
principal information， what should I do can create it success?

postgres=# 
postgres=# 
postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month text, 
num_orders int, total_sales float8)
postgres-# LOCATION 
('pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple')
postgres-#   FORMAT 'TEXT' (delimiter=E',');
ERROR:  Invalid URI 
pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple : 
missing authority section


postgres=# 
postgres=# 
postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month text, 
num_orders int, total_sales float8)
postgres-# LOCATION 
('pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA')
postgres-#   FORMAT 'TEXT' (delimiter=E',');
ERROR:  Invalid URI 
pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA
 : missing authority section


> Hadoop enabled Kerberos，HAWQ occurs errors
> --
>
> Key: HAWQ-1437
> URL: https://issues.apache.org/jira/browse/HAWQ-1437
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: lynn
>Assignee: Ed Espino
> Fix For: 2.2.0.0-incubating
>
>
> When kerberos enabled with Hadoop , HAWQ create external table from hdfs need 
> principal information， what should I do can create it success?
> postgres=# 
> postgres=# 
> postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month 
> text, num_orders int, total_sales float8)
> postgres-# LOCATION 
> ('pxf://mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple')
> postgres-#   FORMAT 'TEXT' (delimiter=E',');
> ERROR:  Invalid URI 
> pxf://mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple 
> : missing authority section
> postgres=# 
> postgres=# 
> postgres=# CREATE EXTERNAL TABLE pxf_hdfs_textsimple(location text, month 
> text, num_orders int, total_sales float8)
> postgres-# LOCATION 
> ('pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA')
> postgres-#   FORMAT 'TEXT' (delimiter=E',');
> ERROR:  Invalid URI 
> pxf:///mycluster/data/pxf_examples/pxf_hdfs_simple.txt?PROFILE=HdfsTextSimple=hdfs-bigdatacenter@BIGDATA
>  : missing authority section



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)