[jira] [Closed] (HAWQ-1240) Fix bug of plan refinement for cursor operation

2016-12-28 Thread Paul Guo (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Guo closed HAWQ-1240.
--
   Resolution: Fixed
Fix Version/s: (was: backlog)
   2.2.0.0-incubating

> Fix bug of plan refinement for cursor operation
> ---
>
> Key: HAWQ-1240
> URL: https://issues.apache.org/jira/browse/HAWQ-1240
> Project: Apache HAWQ
>  Issue Type: Bug
>Reporter: Paul Guo
>Assignee: Paul Guo
> Fix For: 2.2.0.0-incubating
>
>
> Currently we call refineCachedPlan() in the cursor open code 
> SPI_cursor_open(), however the code is buggy since the new plan is not used 
> for later operation. Also there is a debate that whether we need to replan 
> when needed from query tree for this, but this is another issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #1068: HAWQ-1240. Fix bug of plan refinement for...

2016-12-28 Thread paul-guo-
Github user paul-guo- closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1068


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1068: HAWQ-1240. Fix bug of plan refinement for cursor...

2016-12-28 Thread paul-guo-
Github user paul-guo- commented on the issue:

https://github.com/apache/incubator-hawq/pull/1068
  
Merged.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1068: HAWQ-1240. Fix bug of plan refinement for cursor...

2016-12-28 Thread huor
Github user huor commented on the issue:

https://github.com/apache/incubator-hawq/pull/1068
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1071: HAWQ-1242. hawq-site.xml default content has wro...

2016-12-28 Thread huor
Github user huor commented on the issue:

https://github.com/apache/incubator-hawq/pull/1071
  
+1 for the fix


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (HAWQ-1244) unrecognized configuration parameter "ONETARY"

2016-12-28 Thread Yi Jin (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15784521#comment-15784521
 ] 

Yi Jin commented on HAWQ-1244:
--

I agree ONTARY issue should be caused by large value settings, I am 
investigating the system cache part to check if there is something going wrong.

> unrecognized configuration parameter "ONETARY"
> --
>
> Key: HAWQ-1244
> URL: https://issues.apache.org/jira/browse/HAWQ-1244
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Dispatcher
>Reporter: Jon Roberts
>Assignee: Yi Jin
>
> Fatal error occurs when reading /usr/local/hawq/etc/_mgmt_config when the 
> file is large due to many temp directories, a highly parallelized query, 
> random distributed tables, and hawq_rm_nvseg_perquery_perseg_limit set higher 
> (12 for example).
> Query 88 in TPC-DS fails with random distribution, 10 nodes in AWS, 7TB of 
> data,  hawq_rm_memory_limit_perseg = 200gb, hawq_rm_stmt_vseg_memory = 16gb, 
> hawq_rm_nvseg_perquery_perseg_limit = 12.
> Error raised:
> psql:188.tpcds.88.sql:95: ERROR:  Error dispatching to seg25 
> ip-172-21-13-189.ec2.internal:4: connection pointer is NULL
> DETAIL:  Master unable to connect to seg25 
> ip-172-21-13-189.ec2.internal:4: FATAL:  unrecognized configuration 
> parameter "ONETARY"
> Error from segment:
> 2016-12-14 13:47:34.760839 
> UTC,"gpadmin","gpadmin",p737499,th542214432,"172.21.13.196","40327",2016-12-14
>  13:47:34 UTC,0,con23798,,seg-1,"FATAL","42704","unrecognized 
> configuration parameter ""ONETARY""",,,0,,"guc.c",10006,
> Workaround is to use less vsegs or reduce the number of temp directories.  
> This is probably not related to the number of temp directories but the size 
> of the _mgmt_config file.  The parameter it apparently is failing to parse is:
> hawq_lc_monetary=en_US.utf8
> The problem is likely in guc.c based on the segment error.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #1029: HAWQ-1174. double type core counter of co...

2016-12-28 Thread jiny2
Github user jiny2 closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1029


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1071: HAWQ-1242. hawq-site.xml default content has wro...

2016-12-28 Thread jiny2
Github user jiny2 commented on the issue:

https://github.com/apache/incubator-hawq/pull/1071
  
@huor @radarwave Please have a review. Thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1071: HAWQ-1242. hawq-site.xml default content has wro...

2016-12-28 Thread paul-guo-
Github user paul-guo- commented on the issue:

https://github.com/apache/incubator-hawq/pull/1071
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1071: HAWQ-1242. hawq-site.xml default content ...

2016-12-28 Thread jiny2
GitHub user jiny2 opened a pull request:

https://github.com/apache/incubator-hawq/pull/1071

HAWQ-1242. hawq-site.xml default content has wrong guc variable names

Fixed the wrong names in hawq-site.xml and its template file.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jiny2/incubator-hawq HAWQ-1242

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1071.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1071


commit 4b2655bc17aceaa67e9db7b53147584f7860c61e
Author: Yi 
Date:   2016-12-29T04:03:11Z

HAWQ-1242. hawq-site.xml default content has wrong guc variable names




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (HAWQ-1245) can HAWQ support alternate python module deployment directory?

2016-12-28 Thread Lisa Owen (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lisa Owen updated HAWQ-1245:

Priority: Minor  (was: Major)

> can HAWQ support alternate python module deployment directory?
> --
>
> Key: HAWQ-1245
> URL: https://issues.apache.org/jira/browse/HAWQ-1245
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Core
>Reporter: Lisa Owen
>Assignee: Ed Espino
>Priority: Minor
>
> HAWQ no longer embeds python and is now using the system python installation. 
>  with this change, installing a new python module now requires root/sudo 
> access to the system python directories.  is there any reason why HAWQ would 
> not be able to support deploying python modules to an alternate directory 
> that is owned by gpadmin?  or using a python virtual environment?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HAWQ-1245) can HAWQ support alternate python module deployment directory?

2016-12-28 Thread Lisa Owen (JIRA)
Lisa Owen created HAWQ-1245:
---

 Summary: can HAWQ support alternate python module deployment 
directory?
 Key: HAWQ-1245
 URL: https://issues.apache.org/jira/browse/HAWQ-1245
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: Core
Reporter: Lisa Owen
Assignee: Ed Espino


HAWQ no longer embeds python and is now using the system python installation.  
with this change, installing a new python module now requires root/sudo access 
to the system python directories.  is there any reason why HAWQ would not be 
able to support deploying python modules to an alternate directory that is 
owned by gpadmin?  or using a python virtual environment?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HAWQ-1244) unrecognized configuration parameter "ONETARY"

2016-12-28 Thread Yi Jin (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yi Jin reassigned HAWQ-1244:


Assignee: Yi Jin  (was: Ed Espino)

> unrecognized configuration parameter "ONETARY"
> --
>
> Key: HAWQ-1244
> URL: https://issues.apache.org/jira/browse/HAWQ-1244
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Dispatcher
>Reporter: Jon Roberts
>Assignee: Yi Jin
>
> Fatal error occurs when reading /usr/local/hawq/etc/_mgmt_config when the 
> file is large due to many temp directories, a highly parallelized query, 
> random distributed tables, and hawq_rm_nvseg_perquery_perseg_limit set higher 
> (12 for example).
> Query 88 in TPC-DS fails with random distribution, 10 nodes in AWS, 7TB of 
> data,  hawq_rm_memory_limit_perseg = 200gb, hawq_rm_stmt_vseg_memory = 16gb, 
> hawq_rm_nvseg_perquery_perseg_limit = 12.
> Error raised:
> psql:188.tpcds.88.sql:95: ERROR:  Error dispatching to seg25 
> ip-172-21-13-189.ec2.internal:4: connection pointer is NULL
> DETAIL:  Master unable to connect to seg25 
> ip-172-21-13-189.ec2.internal:4: FATAL:  unrecognized configuration 
> parameter "ONETARY"
> Error from segment:
> 2016-12-14 13:47:34.760839 
> UTC,"gpadmin","gpadmin",p737499,th542214432,"172.21.13.196","40327",2016-12-14
>  13:47:34 UTC,0,con23798,,seg-1,"FATAL","42704","unrecognized 
> configuration parameter ""ONETARY""",,,0,,"guc.c",10006,
> Workaround is to use less vsegs or reduce the number of temp directories.  
> This is probably not related to the number of temp directories but the size 
> of the _mgmt_config file.  The parameter it apparently is failing to parse is:
> hawq_lc_monetary=en_US.utf8
> The problem is likely in guc.c based on the segment error.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HAWQ-1216) PL/Python doc page - validate and enhance info

2016-12-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15783688#comment-15783688
 ] 

ASF GitHub Bot commented on HAWQ-1216:
--

GitHub user lisakowen opened a pull request:

https://github.com/apache/incubator-hawq-docs/pull/77

HAWQ-1216 - clean up plpython docs

restructured content, updated examples, added new examples 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/lisakowen/incubator-hawq-docs 
feature/HAWQ-1216-plpython-review

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq-docs/pull/77.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #77


commit 881ad95ab12ab745894e54fe40fe9c935f6f6237
Author: Lisa Owen 
Date:   2016-12-13T22:19:31Z

clean up plpython docs - working examples, reorg




> PL/Python doc page - validate and enhance info
> --
>
> Key: HAWQ-1216
> URL: https://issues.apache.org/jira/browse/HAWQ-1216
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: Lisa Owen
>Assignee: David Yozie
>Priority: Minor
>
> PL/Python docs section:
> - review and validate current content
> - update module installation instructions - need to be root to install 
> modules to system python dirs
> - make sure examples run and are relevant
> - develop new examples as appropriate



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HAWQ-1244) unrecognized configuration parameter "ONETARY"

2016-12-28 Thread Jon Roberts (JIRA)
Jon Roberts created HAWQ-1244:
-

 Summary: unrecognized configuration parameter "ONETARY"
 Key: HAWQ-1244
 URL: https://issues.apache.org/jira/browse/HAWQ-1244
 Project: Apache HAWQ
  Issue Type: Bug
  Components: Dispatcher
Reporter: Jon Roberts
Assignee: Ed Espino


Fatal error occurs when reading /usr/local/hawq/etc/_mgmt_config when the file 
is large due to many temp directories, a highly parallelized query, random 
distributed tables, and hawq_rm_nvseg_perquery_perseg_limit set higher (12 for 
example).

Query 88 in TPC-DS fails with random distribution, 10 nodes in AWS, 7TB of 
data,  hawq_rm_memory_limit_perseg = 200gb, hawq_rm_stmt_vseg_memory = 16gb, 
hawq_rm_nvseg_perquery_perseg_limit = 12.

Error raised:
psql:188.tpcds.88.sql:95: ERROR:  Error dispatching to seg25 
ip-172-21-13-189.ec2.internal:4: connection pointer is NULL
DETAIL:  Master unable to connect to seg25 ip-172-21-13-189.ec2.internal:4: 
FATAL:  unrecognized configuration parameter "ONETARY"

Error from segment:
2016-12-14 13:47:34.760839 
UTC,"gpadmin","gpadmin",p737499,th542214432,"172.21.13.196","40327",2016-12-14 
13:47:34 UTC,0,con23798,,seg-1,"FATAL","42704","unrecognized 
configuration parameter ""ONETARY""",,,0,,"guc.c",10006,

Workaround is to use less vsegs or reduce the number of temp directories.  This 
is probably not related to the number of temp directories but the size of the 
_mgmt_config file.  The parameter it apparently is failing to parse is:
hawq_lc_monetary=en_US.utf8

The problem is likely in guc.c based on the segment error.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq issue #1068: HAWQ-1240. Fix bug of plan refinement for cursor...

2016-12-28 Thread zhangh43
Github user zhangh43 commented on the issue:

https://github.com/apache/incubator-hawq/pull/1068
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1067: HAWQ-1239. Fail to call pg_rangercheck_batch() w...

2016-12-28 Thread stanlyxiang
Github user stanlyxiang commented on the issue:

https://github.com/apache/incubator-hawq/pull/1067
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---