[jira] [Commented] (HAWQ-786) HAWQ supports ORC as a native storage format

[Kavinder Dhaliwal (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15336415#comment-15336415
 ] 

Kavinder Dhaliwal commented on HAWQ-786:


Thanks for design doc [~liming01]. From a high level having a framework similar 
to FDW looks like a good change to make to HAWQ. I have a couple points:

1. This document seems to join ORC support and the Foreign Data Wrapper 
framework into the same issue. Am I correct in thinking that the FDW 
abstraction will be used to support ORC as a native format? Why not work on it 
in two stages, first the FDW then ORC support?

2. Since this is such a large change can you update the document with 
information of the architectural changes that will be made to HAWQ to support 
FDW? 

3. Can you also add information about the impact this change will have on the 
existing PXF framework? How the two frameworks will differ and why in your 
opinion FDW is the preferred approach to PXF or whether the two will co-exist?

Overall I appreciate that the design doc explains the new User experience HAWQ 
will have through the FDW framework but I'd like more explanation of the 
internal changes to HAWQ that you are purposing.

> HAWQ supports ORC as a native storage format
> 
>
> Key: HAWQ-786
> URL: https://issues.apache.org/jira/browse/HAWQ-786
> Project: Apache HAWQ
>  Issue Type: New Feature
>  Components: Storage
>Reporter: Lei Chang
>Assignee: hongwu
> Attachments: ORCdesign-v0.1-2016-06-17.pdf
>
>
> In current HAWQ, two native formats are supported: AO and parquet. Now we 
> want to support ORC. A framework to support naive c/c++ pluggable format is 
> needed to support ORC more easily. And it can also be potentially used for 
> fast external data access.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HAWQ-786) HAWQ supports ORC as a native storage format

[Ming LI (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ming LI updated HAWQ-786:
-
Attachment: ORCdesign-v0.1-2016-06-17.pdf

attach the initial design spec

> HAWQ supports ORC as a native storage format
> 
>
> Key: HAWQ-786
> URL: https://issues.apache.org/jira/browse/HAWQ-786
> Project: Apache HAWQ
>  Issue Type: New Feature
>  Components: Storage
>Reporter: Lei Chang
>Assignee: hongwu
> Attachments: ORCdesign-v0.1-2016-06-17.pdf
>
>
> In current HAWQ, two native formats are supported: AO and parquet. Now we 
> want to support ORC. A framework to support naive c/c++ pluggable format is 
> needed to support ORC more easily. And it can also be potentially used for 
> fast external data access.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HAWQ-833) Lack of pgcrypto.sql for the pgcrypto support

[Paul Guo (JIRA)]

Paul Guo created HAWQ-833:
-

 Summary: Lack of pgcrypto.sql for the pgcrypto support
 Key: HAWQ-833
 URL: https://issues.apache.org/jira/browse/HAWQ-833
 Project: Apache HAWQ
  Issue Type: Bug
Reporter: Paul Guo
Assignee: Lei Chang


Currently we use upstream postgres/pgcrypto for the pgcrypto support. The 
version we are using just provides the sql file for the "create extension" 
command which has not been supported on our code. We need to provide a separate 
 pgcrypto.sql (and its corresponding uninstall sql file), just like what pl/plr 
code does, then users could use the pgcrypto functionality as before.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HAWQ-832) Integrate ICG to Gtest

[Jiali Yao (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jiali Yao updated HAWQ-832:
---
Description: 
In HAWQ test, google test is used for libyarn and libhdfs test. Install check 
test framework is used for smoke test and has a lot of limitations. To make it 
easy to learn and consolidate test, we want to unify the two frameworks. 
Considering below factors, we want to use google test: 
It supports more functions and then a developer can write more complex tests 
which are not only limited to SQL test.  
Google test support run test parallelly. 
Google mock is an extension for google test, it can also be used for unit test. 

Please see the attach file for detail. 


  was:
In HAWQ test, google test is used for libyarn and libhdfs test. Install check 
test framework is used for smoke test and has a lot of limitations. To make it 
easy to learn and consolidate test, we want to unify the two frameworks. 
Considering below factors, we want to use google test: 
It supports more functions and then a developer can write more complex tests 
which are not only limited to SQL test.  
Google test support run test parallelly. 
Google mock is an extension for google test, it can also be used for unit test. 





> Integrate ICG to Gtest
> --
>
> Key: HAWQ-832
> URL: https://issues.apache.org/jira/browse/HAWQ-832
> Project: Apache HAWQ
>  Issue Type: Test
>  Components: Tests
>Reporter: Jiali Yao
>Assignee: Jiali Yao
> Attachments: GoogleTest.pdf
>
>
> In HAWQ test, google test is used for libyarn and libhdfs test. Install check 
> test framework is used for smoke test and has a lot of limitations. To make 
> it easy to learn and consolidate test, we want to unify the two frameworks. 
> Considering below factors, we want to use google test: 
> It supports more functions and then a developer can write more complex tests 
> which are not only limited to SQL test.  
> Google test support run test parallelly. 
> Google mock is an extension for google test, it can also be used for unit 
> test. 
> Please see the attach file for detail. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HAWQ-832) Integrate ICG to Gtest

[Jiali Yao (JIRA)]

Jiali Yao created HAWQ-832:
--

 Summary: Integrate ICG to Gtest
 Key: HAWQ-832
 URL: https://issues.apache.org/jira/browse/HAWQ-832
 Project: Apache HAWQ
  Issue Type: Test
  Components: Tests
Reporter: Jiali Yao
Assignee: Jiali Yao
 Attachments: GoogleTest.pdf

In HAWQ test, google test is used for libyarn and libhdfs test. Install check 
test framework is used for smoke test and has a lot of limitations. To make it 
easy to learn and consolidate test, we want to unify the two frameworks. 
Considering below factors, we want to use google test: 
It supports more functions and then a developer can write more complex tests 
which are not only limited to SQL test.  
Google test support run test parallelly. 
Google mock is an extension for google test, it can also be used for unit test. 






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HAWQ-832) Integrate ICG to Gtest

[Jiali Yao (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jiali Yao updated HAWQ-832:
---
Attachment: GoogleTest.pdf

> Integrate ICG to Gtest
> --
>
> Key: HAWQ-832
> URL: https://issues.apache.org/jira/browse/HAWQ-832
> Project: Apache HAWQ
>  Issue Type: Test
>  Components: Tests
>Reporter: Jiali Yao
>Assignee: Jiali Yao
> Attachments: GoogleTest.pdf
>
>
> In HAWQ test, google test is used for libyarn and libhdfs test. Install check 
> test framework is used for smoke test and has a lot of limitations. To make 
> it easy to learn and consolidate test, we want to unify the two frameworks. 
> Considering below factors, we want to use google test: 
> It supports more functions and then a developer can write more complex tests 
> which are not only limited to SQL test.  
> Google test support run test parallelly. 
> Google mock is an extension for google test, it can also be used for unit 
> test. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Closed] (HAWQ-824) Move orca submodules to depends/

[Paul Guo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HAWQ-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Guo closed HAWQ-824.
-
   Resolution: Fixed
 Assignee: Paul Guo  (was: Lei Chang)
Fix Version/s: 2.0.0-beta-incubating

> Move orca submodules to depends/
> 
>
> Key: HAWQ-824
> URL: https://issues.apache.org/jira/browse/HAWQ-824
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build
>Reporter: Paul Guo
>Assignee: Paul Guo
> Fix For: 2.0.0-beta-incubating
>
>
> Discussed with some dev offline. It would be better to move orca submodules 
> to paths other than src/backend. depends/ seems to be a good choice.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-hawq pull request #723: HAWQ-824. Move orca submodules to depends/

[paul-guo-]

Github user paul-guo- closed the pull request at:

https://github.com/apache/incubator-hawq/pull/723


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (HAWQ-824) Move orca submodules to depends/

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335610#comment-15335610
 ] 

ASF GitHub Bot commented on HAWQ-824:
-

Github user paul-guo- closed the pull request at:

https://github.com/apache/incubator-hawq/pull/723


> Move orca submodules to depends/
> 
>
> Key: HAWQ-824
> URL: https://issues.apache.org/jira/browse/HAWQ-824
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Build
>Reporter: Paul Guo
>Assignee: Paul Guo
> Fix For: 2.0.0-beta-incubating
>
>
> Discussed with some dev offline. It would be better to move orca submodules 
> to paths other than src/backend. depends/ seems to be a good choice.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HAWQ-827) Refactor aggregate_with_groupingsets checkinstall cases using new test framework.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335605#comment-15335605
 ] 

ASF GitHub Bot commented on HAWQ-827:
-

Github user yaoj2 commented on the issue:

https://github.com/apache/incubator-hawq/pull/730
  
LGTM


> Refactor aggregate_with_groupingsets checkinstall cases using new test 
> framework.
> -
>
> Key: HAWQ-827
> URL: https://issues.apache.org/jira/browse/HAWQ-827
> Project: Apache HAWQ
>  Issue Type: Test
>  Components: Tests
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
>
> refactor installcheck-good test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HAWQ-827) Refactor aggregate_with_groupingsets checkinstall cases using new test framework.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335606#comment-15335606
 ] 

ASF GitHub Bot commented on HAWQ-827:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-hawq/pull/730


> Refactor aggregate_with_groupingsets checkinstall cases using new test 
> framework.
> -
>
> Key: HAWQ-827
> URL: https://issues.apache.org/jira/browse/HAWQ-827
> Project: Apache HAWQ
>  Issue Type: Test
>  Components: Tests
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
>
> refactor installcheck-good test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-hawq pull request #730: HAWQ-827. Refactor aggregate_with_grouping...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-hawq/pull/730


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (HAWQ-827) Refactor aggregate_with_groupingsets checkinstall cases using new test framework.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335603#comment-15335603
 ] 

ASF GitHub Bot commented on HAWQ-827:
-

Github user wengyanqing commented on the issue:

https://github.com/apache/incubator-hawq/pull/730
  
LGTM


> Refactor aggregate_with_groupingsets checkinstall cases using new test 
> framework.
> -
>
> Key: HAWQ-827
> URL: https://issues.apache.org/jira/browse/HAWQ-827
> Project: Apache HAWQ
>  Issue Type: Test
>  Components: Tests
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
>
> refactor installcheck-good test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-hawq issue #730: HAWQ-827. Refactor aggregate_with_groupingsets ch...

[yaoj2]

Github user yaoj2 commented on the issue:

https://github.com/apache/incubator-hawq/pull/730
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hawq issue #730: HAWQ-827. Refactor aggregate_with_groupingsets ch...

[wengyanqing]

Github user wengyanqing commented on the issue:

https://github.com/apache/incubator-hawq/pull/730
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (HAWQ-827) Refactor aggregate_with_groupingsets checkinstall cases using new test framework.

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/HAWQ-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335600#comment-15335600
 ] 

ASF GitHub Bot commented on HAWQ-827:
-

GitHub user zhangh43 opened a pull request:

https://github.com/apache/incubator-hawq/pull/730

HAWQ-827. Refactor aggregate_with_groupingsets checkinstall cases usi…

…ng new test framework.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zhangh43/incubator-hawq hawq827

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/730.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #730


commit 583ef22e0da0522fe13ad6b1fc1188fc2abca1c4
Author: hzhang2 
Date:   2016-06-17T07:38:55Z

HAWQ-827. Refactor aggregate_with_groupingsets checkinstall cases using new 
test framework.




> Refactor aggregate_with_groupingsets checkinstall cases using new test 
> framework.
> -
>
> Key: HAWQ-827
> URL: https://issues.apache.org/jira/browse/HAWQ-827
> Project: Apache HAWQ
>  Issue Type: Test
>  Components: Tests
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
>
> refactor installcheck-good test



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-hawq pull request #730: HAWQ-827. Refactor aggregate_with_grouping...

[zhangh43]

GitHub user zhangh43 opened a pull request:

https://github.com/apache/incubator-hawq/pull/730

HAWQ-827. Refactor aggregate_with_groupingsets checkinstall cases usi…

…ng new test framework.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zhangh43/incubator-hawq hawq827

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/730.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #730


commit 583ef22e0da0522fe13ad6b1fc1188fc2abca1c4
Author: hzhang2 
Date:   2016-06-17T07:38:55Z

HAWQ-827. Refactor aggregate_with_groupingsets checkinstall cases using new 
test framework.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---