[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...

2016-12-20 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1059


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...

2016-12-20 Thread paul-guo-
Github user paul-guo- commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1059#discussion_r93384000
  
--- Diff: tools/bin/hawqpylib/HAWQ_HELP.py ---
@@ -159,10 +159,10 @@
 
 The "options" are:
-c --change Changes a configuration parameter setting.
--- End diff --

How. Then +1.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1060: HAWQ-1226. HAWQ core dump due to enable r...

2016-12-20 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1060


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1054: HAWQ-870. Allocate target's tuple table slot in ...

2016-12-20 Thread xunzhang
Github user xunzhang commented on the issue:

https://github.com/apache/incubator-hawq/pull/1054
  
Already merged?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...

2016-12-20 Thread linwen
Github user linwen commented on the issue:

https://github.com/apache/incubator-hawq/pull/1060
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...

2016-12-20 Thread zhangh43
Github user zhangh43 commented on the issue:

https://github.com/apache/incubator-hawq/pull/1060
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...

2016-12-20 Thread stanlyxiang
Github user stanlyxiang commented on the issue:

https://github.com/apache/incubator-hawq/pull/1060
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...

2016-12-20 Thread interma
Github user interma commented on the issue:

https://github.com/apache/incubator-hawq/pull/1060
  
@linwen @stanlyxiang @zhangh43 help to review again, thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1060: HAWQ-1226. HAWQ core dump due to enable r...

2016-12-20 Thread interma
GitHub user interma opened a pull request:

https://github.com/apache/incubator-hawq/pull/1060

HAWQ-1226. HAWQ core dump due to enable ranger while RPS is down

lnclude:
1. fix core dump while RPS not running
2. fix libcurl write_callback() problem
3. add libcurl timeout (hard-coded 30s temporarily)
4. fix some compile warnings
5. fix make install error: add json.h to checkinc.py

And old PR discuss: https://github.com/apache/incubator-hawq/pull/1058

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/interma/interma-hawq HAWQ-1226

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1060.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1060


commit b6a82951eeb5218cb4d22659281812fd7b2b98da
Author: interma 
Date:   2016-12-21T04:02:14Z

HAWQ-1226. HAWQ core dump due to enable ranger while RPS is down




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...

2016-12-20 Thread interma
Github user interma closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1058


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1058: HAWQ-1226. HAWQ core dump due to enable ranger w...

2016-12-20 Thread interma
Github user interma commented on the issue:

https://github.com/apache/incubator-hawq/pull/1058
  
I will open a new PR, closed this.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...

2016-12-20 Thread paul-guo-
Github user paul-guo- commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1059#discussion_r93370544
  
--- Diff: tools/bin/hawqpylib/HAWQ_HELP.py ---
@@ -159,10 +159,10 @@
 
 The "options" are:
-c --change Changes a configuration parameter setting.
--- End diff --

Actually I think "--change" could better be "--parameter"? ". How do you 
think?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config

2016-12-20 Thread radarwave
Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1059
  
@paul-guo- Please review. Thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config

2016-12-20 Thread radarwave
Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1059
  
Good point, I will update it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config

2016-12-20 Thread paul-guo-
Github user paul-guo- commented on the issue:

https://github.com/apache/incubator-hawq/pull/1059
  
I mean why not replace this time.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config

2016-12-20 Thread radarwave
Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1059
  
Yeah, '-v' is used to set the GUC value. '--verbose' is a legacy option, 
now it's already been removed. This time only remove the wrong help message.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config

2016-12-20 Thread paul-guo-
Github user paul-guo- commented on the issue:

https://github.com/apache/incubator-hawq/pull/1059
  
'-v' seem to have another usage in "hawq config"?

[-v hawq_property_value | --value=hawq_property_value


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (HAWQ-1229) Remove unused option help message in hawq config

2016-12-20 Thread Radar Lei (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radar Lei updated HAWQ-1229:

Summary: Remove unused option help message in hawq config  (was: Remove 
unused option in hawq config)

> Remove unused option help message in hawq config
> 
>
> Key: HAWQ-1229
> URL: https://issues.apache.org/jira/browse/HAWQ-1229
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Command Line Tools
>Reporter: Radar Lei
>Assignee: Radar Lei
>
> 'hawq config --help' offers '--verbose' option but it is not actually 
> possible. We should remove this option.
> See:
> [gpadmin@test1 ~]$ hawq config --help
> usage: hawq config [--options]
> The "options" are:
>-c --change Changes a configuration parameter setting.
>-s --show   Shows the value for a specified configuration 
> parameter.
>-l --list   Lists all configuration parameters.
>-q --quiet  Run in quiet mode.
>-v --verboseDisplays detailed status.
>-r --remove HAWQ GUC name to be removed.
>--skipvalidationSkip the system validation checks.
>--ignore-bad-hosts  Skips copying configuration files on host on which SSH 
> fails
> See 'hawq --help' for more information on other commands.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HAWQ-1229) Remove unused option help message in hawq config

2016-12-20 Thread Radar Lei (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radar Lei updated HAWQ-1229:

Description: 
'hawq config --help' offers '--verbose' option but it is not actually possible. 
We should remove this option's help mesage.

See:
[gpadmin@test1 ~]$ hawq config --help

usage: hawq config [--options]

The "options" are:
   -c --change Changes a configuration parameter setting.
   -s --show   Shows the value for a specified configuration parameter.
   -l --list   Lists all configuration parameters.
   -q --quiet  Run in quiet mode.
   -v --verboseDisplays detailed status.
   -r --remove HAWQ GUC name to be removed.
   --skipvalidationSkip the system validation checks.
   --ignore-bad-hosts  Skips copying configuration files on host on which SSH 
fails

See 'hawq --help' for more information on other commands.

  was:
'hawq config --help' offers '--verbose' option but it is not actually possible. 
We should remove this option.

See:
[gpadmin@test1 ~]$ hawq config --help

usage: hawq config [--options]

The "options" are:
   -c --change Changes a configuration parameter setting.
   -s --show   Shows the value for a specified configuration parameter.
   -l --list   Lists all configuration parameters.
   -q --quiet  Run in quiet mode.
   -v --verboseDisplays detailed status.
   -r --remove HAWQ GUC name to be removed.
   --skipvalidationSkip the system validation checks.
   --ignore-bad-hosts  Skips copying configuration files on host on which SSH 
fails

See 'hawq --help' for more information on other commands.


> Remove unused option help message in hawq config
> 
>
> Key: HAWQ-1229
> URL: https://issues.apache.org/jira/browse/HAWQ-1229
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Command Line Tools
>Reporter: Radar Lei
>Assignee: Radar Lei
>
> 'hawq config --help' offers '--verbose' option but it is not actually 
> possible. We should remove this option's help mesage.
> See:
> [gpadmin@test1 ~]$ hawq config --help
> usage: hawq config [--options]
> The "options" are:
>-c --change Changes a configuration parameter setting.
>-s --show   Shows the value for a specified configuration 
> parameter.
>-l --list   Lists all configuration parameters.
>-q --quiet  Run in quiet mode.
>-v --verboseDisplays detailed status.
>-r --remove HAWQ GUC name to be removed.
>--skipvalidationSkip the system validation checks.
>--ignore-bad-hosts  Skips copying configuration files on host on which SSH 
> fails
> See 'hawq --help' for more information on other commands.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...

2016-12-20 Thread radarwave
GitHub user radarwave opened a pull request:

https://github.com/apache/incubator-hawq/pull/1059

HAWQ-1229. Remove verbose option in hawq config



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/radarwave/incubator-hawq config_verbose

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1059.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1059


commit 5ac1a23db4eb2b2ebc026c94f35cb77a09dd8393
Author: rlei 
Date:   2016-12-21T02:59:13Z

HAWQ-1229. Remove verbose option in hawq config




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (HAWQ-1229) Remove unused option in hawq config

2016-12-20 Thread Radar Lei (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radar Lei updated HAWQ-1229:

Description: 
'hawq config --help' offers '--verbose' option but it is not actually possible. 
We should remove this option.

See:
[gpadmin@test1 ~]$ hawq config --help

usage: hawq config [--options]

The "options" are:
   -c --change Changes a configuration parameter setting.
   -s --show   Shows the value for a specified configuration parameter.
   -l --list   Lists all configuration parameters.
   -q --quiet  Run in quiet mode.
   -v --verboseDisplays detailed status.
   -r --remove HAWQ GUC name to be removed.
   --skipvalidationSkip the system validation checks.
   --ignore-bad-hosts  Skips copying configuration files on host on which SSH 
fails

See 'hawq --help' for more information on other commands.

  was:
hawq config --help offers --verbose option but it is not actually possible. We 
should remove this '--verbose' option.

See:
[gpadmin@test1 ~]$ hawq config --help

usage: hawq config [--options]

The "options" are:
   -c --change Changes a configuration parameter setting.
   -s --show   Shows the value for a specified configuration parameter.
   -l --list   Lists all configuration parameters.
   -q --quiet  Run in quiet mode.
   -v --verboseDisplays detailed status.
   -r --remove HAWQ GUC name to be removed.
   --skipvalidationSkip the system validation checks.
   --ignore-bad-hosts  Skips copying configuration files on host on which SSH 
fails

See 'hawq --help' for more information on other commands.


> Remove unused option in hawq config
> ---
>
> Key: HAWQ-1229
> URL: https://issues.apache.org/jira/browse/HAWQ-1229
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Command Line Tools
>Reporter: Radar Lei
>Assignee: Ed Espino
>
> 'hawq config --help' offers '--verbose' option but it is not actually 
> possible. We should remove this option.
> See:
> [gpadmin@test1 ~]$ hawq config --help
> usage: hawq config [--options]
> The "options" are:
>-c --change Changes a configuration parameter setting.
>-s --show   Shows the value for a specified configuration 
> parameter.
>-l --list   Lists all configuration parameters.
>-q --quiet  Run in quiet mode.
>-v --verboseDisplays detailed status.
>-r --remove HAWQ GUC name to be removed.
>--skipvalidationSkip the system validation checks.
>--ignore-bad-hosts  Skips copying configuration files on host on which SSH 
> fails
> See 'hawq --help' for more information on other commands.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HAWQ-1229) Remove unused option in hawq config

2016-12-20 Thread Radar Lei (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radar Lei reassigned HAWQ-1229:
---

Assignee: Radar Lei  (was: Ed Espino)

> Remove unused option in hawq config
> ---
>
> Key: HAWQ-1229
> URL: https://issues.apache.org/jira/browse/HAWQ-1229
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Command Line Tools
>Reporter: Radar Lei
>Assignee: Radar Lei
>
> 'hawq config --help' offers '--verbose' option but it is not actually 
> possible. We should remove this option.
> See:
> [gpadmin@test1 ~]$ hawq config --help
> usage: hawq config [--options]
> The "options" are:
>-c --change Changes a configuration parameter setting.
>-s --show   Shows the value for a specified configuration 
> parameter.
>-l --list   Lists all configuration parameters.
>-q --quiet  Run in quiet mode.
>-v --verboseDisplays detailed status.
>-r --remove HAWQ GUC name to be removed.
>--skipvalidationSkip the system validation checks.
>--ignore-bad-hosts  Skips copying configuration files on host on which SSH 
> fails
> See 'hawq --help' for more information on other commands.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HAWQ-1229) Remove unused option in hawq config

2016-12-20 Thread Radar Lei (JIRA)
Radar Lei created HAWQ-1229:
---

 Summary: Remove unused option in hawq config
 Key: HAWQ-1229
 URL: https://issues.apache.org/jira/browse/HAWQ-1229
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: Command Line Tools
Reporter: Radar Lei
Assignee: Ed Espino


hawq config --help offers --verbose option but it is not actually possible. We 
should remove this '--verbose' option.

See:
[gpadmin@test1 ~]$ hawq config --help

usage: hawq config [--options]

The "options" are:
   -c --change Changes a configuration parameter setting.
   -s --show   Shows the value for a specified configuration parameter.
   -l --list   Lists all configuration parameters.
   -q --quiet  Run in quiet mode.
   -v --verboseDisplays detailed status.
   -r --remove HAWQ GUC name to be removed.
   --skipvalidationSkip the system validation checks.
   --ignore-bad-hosts  Skips copying configuration files on host on which SSH 
fails

See 'hawq --help' for more information on other commands.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (HAWQ-999) Log_error when file count is not in proportion to bucket number of hash table.

2016-12-20 Thread Hubert Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hubert Zhang closed HAWQ-999.
-
Resolution: Fixed

> Log_error when file count is not in proportion to bucket number of hash table.
> --
>
> Key: HAWQ-999
> URL: https://issues.apache.org/jira/browse/HAWQ-999
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Core
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
> Fix For: 2.0.1.0-incubating
>
>
> By definition, file count of a hash table should be equal to or a multiple of 
> the bucket number of the table. So if mismatch happens, we should not treat 
> it as hash table in data locality algorithm.
> The default behaviour should LOG_ERROR and tell the user "file count is not 
> in proportion to bucket number for hash table with oid=X. Some data maybe 
> lost, if you still want to continue the query, set GUC 
> assign_randomly_for_mismatched_hash_table to true and try again."
> If GUC assign_randomly_for_mismatched_hash_table is on, the behaviour changed 
> to treat the hash table as random table in data locality algorithm.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HAWQ-1039) Add test case of bucket number may not be consistent with parent table.

2016-12-20 Thread Hubert Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hubert Zhang reassigned HAWQ-1039:
--

Assignee: Hubert Zhang  (was: Lei Chang)

> Add test case of bucket number may not be consistent with parent table.
> ---
>
> Key: HAWQ-1039
> URL: https://issues.apache.org/jira/browse/HAWQ-1039
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Core
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
> Fix For: 2.0.1.0-incubating
>
>
> add test case for HAWQ-1032



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (HAWQ-1039) Add test case of bucket number may not be consistent with parent table.

2016-12-20 Thread Hubert Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hubert Zhang closed HAWQ-1039.
--
Resolution: Fixed

> Add test case of bucket number may not be consistent with parent table.
> ---
>
> Key: HAWQ-1039
> URL: https://issues.apache.org/jira/browse/HAWQ-1039
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Core
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
> Fix For: 2.0.1.0-incubating
>
>
> add test case for HAWQ-1032



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (HAWQ-1032) Bucket number of newly added partition is not consistent with parent table.

2016-12-20 Thread Hubert Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hubert Zhang closed HAWQ-1032.
--
Resolution: Fixed

> Bucket number of newly added partition is not consistent with parent table.
> ---
>
> Key: HAWQ-1032
> URL: https://issues.apache.org/jira/browse/HAWQ-1032
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Core
>Reporter: Hubert Zhang
>Assignee: Hubert Zhang
> Fix For: 2.0.1.0-incubating
>
>
> Failure Case
> {code}
> set deafult_hash_table_bucket_number = 12;
> CREATE TABLE sales3 (id int, date date, amt decimal(10,2)) 
> DISTRIBUTED BY (id)   
> PARTITION BY RANGE (date) 
> ( START (date '2008-01-01') INCLUSIVE 
>END (date '2009-01-01') EXCLUSIVE  
>EVERY (INTERVAL '1 day') );
> set default_hash_table_bucket_number = 16;
> ALTER TABLE sales3 ADD PARTITION   START 
> (date '2009-03-01') INCLUSIVE   END 
> (date '2009-04-01') EXCLUSIVE;
> {code}
> The newly added partition with buckcet number 16 is not consistent with 
> parent partition.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HAWQ-1197) Add note about default_hash_table_bucket_number to PXF section

2016-12-20 Thread Vineet Goel (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765741#comment-15765741
 ] 

Vineet Goel commented on HAWQ-1197:
---

Currently, queries on PXF external tables use default_hash_table_bucket_number 
as the static number of virtual segments to process the query. We don't want to 
recommend changing this parameter for tuning purposes, as changing the 
parameter would affect HASH distribution on HAWQ internal tables, requiring a 
re-distribution of data. The future enhancement goal is to have PXF use 
something more dynamic instead.

> Add note about default_hash_table_bucket_number to PXF section
> --
>
> Key: HAWQ-1197
> URL: https://issues.apache.org/jira/browse/HAWQ-1197
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: Jane Beckman
>Assignee: David Yozie
>
> The discussion of default_hash_table_bucket_number controlling numbe rof 
> segments in PXF external table queries is in Best Practices, but not the PXF 
> sections.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HAWQ-1195) Synchrony:Union not working on external tables ERROR:"Two or more external tables use the same error table ""xxxxxxx"" in a statement (execMain.c:274)"

2016-12-20 Thread Vineet Goel (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765712#comment-15765712
 ] 

Vineet Goel commented on HAWQ-1195:
---

Could you please change the "Fix Version/s:" field to the correct version where 
this commit was made? Thanks

> Synchrony:Union not working on external tables ERROR:"Two or more external 
> tables use the same error table ""xxx"" in a statement (execMain.c:274)"
> ---
>
> Key: HAWQ-1195
> URL: https://issues.apache.org/jira/browse/HAWQ-1195
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: External Tables
>Reporter: Ming LI
>Assignee: Ming LI
> Fix For: backlog
>
>
> Hello,
> User create an external table and define the error table. Then he do the 
> union on the same external table with different where condition. Then return 
> the error:ERROR:  Two or more external tables use the same error table 
> "err_ext_pdr_cdci_pivotal_request_43448" in a statement (execMain.c:274)
> Below is the master log when I reproduce: (the whole log file attached in 
> attachement)
> {code}
> 2016-11-29 22:49:51.976864 
> PST,"gpadmin","postgres",p769199,th-2123704032,"[local]",,2016-11-29 22:46:14 
> PST,1260,con72,cmd10,seg-1,,,x1260,sx1,"ERROR","XX000","Two or more external 
> tables use the same error table ""err_ext_pdr_cdci_pivotal_request_43448"" in 
> a statement (execMain.c:274)",,"select current_account_nbr,yearmonthint, 
> bank_name, first_date_open, max_cr_limit, care_credit_flag, cc1_flag, 
> partition_value, 'US' as loc from pdr_cdci_pivotal_request_43448 where 
> care_credit_flag<1
> union
> select current_account_nbr,yearmonthint, bank_name, first_date_open, 
> max_cr_limit, care_credit_flag, cc1_flag, partition_value, 'Non-US' as loc 
> from pdr_cdci_pivotal_request_43448 where 
> care_credit_flag=1;",0,,"execMain.c",274,"Stack trace:
> 10x8c5858 postgres errstart (??:0)
> 20x8c75db postgres elog_finish (??:0)
> 30x65f669 postgres  (??:0)
> 40x77d06a postgres walk_plan_node_fields (??:0)
> 50x77e3ee postgres plan_tree_walker (??:0)
> 60x77c70a postgres expression_tree_walker (??:0)
> 70x77e35d postgres plan_tree_walker (??:0)
> 80x77d06a postgres walk_plan_node_fields (??:0)
> 90x77dfe6 postgres plan_tree_walker (??:0)
> 10   0x77d06a postgres walk_plan_node_fields (??:0)
> 11   0x77e1e5 postgres plan_tree_walker (??:0)
> 12   0x77d06a postgres walk_plan_node_fields (??:0)
> 13   0x77dfe6 postgres plan_tree_walker (??:0)
> 14   0x77d06a postgres walk_plan_node_fields (??:0)
> 15   0x77e1e5 postgres plan_tree_walker (??:0)
> 16   0x66079b postgres ExecutorStart (??:0)
> 17   0x7ebf1d postgres PortalStart (??:0)
> 18   0x7e4288 postgres  (??:0)
> 19   0x7e54c2 postgres PostgresMain (??:0)
> 20   0x797d50 postgres  (??:0)
> 21   0x79ab19 postgres PostmasterMain (??:0)
> 22   0x4a4069 postgres main (??:0)
> 23   0x7fd97d486d5d libc.so.6 __libc_start_main (??:0)
> 24   0x4a40e9 postgres  (??:0)
> "
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (HAWQ-1228) Use profile based on file format in HCatalog integration for HiveRC, HiveText

2016-12-20 Thread Oleksandr Diachenko (JIRA)
Oleksandr Diachenko created HAWQ-1228:
-

 Summary: Use profile based on file format in HCatalog integration 
for HiveRC, HiveText
 Key: HAWQ-1228
 URL: https://issues.apache.org/jira/browse/HAWQ-1228
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: PXF
Reporter: Oleksandr Diachenko
Assignee: Ed Espino


To leverage changes introduced in HAWQ-1177, expand optimization for other Hive 
profiles. Additional information need to be included in user metadata(e.g. 
DELIMITER etc).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HAWQ-1177) Use profile based on file format in HCatalog integration for HiveOrc profile

2016-12-20 Thread Oleksandr Diachenko (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Oleksandr Diachenko updated HAWQ-1177:
--
Summary: Use profile based on file format in HCatalog integration for 
HiveOrc profile  (was: Use profile based on file format in HCatalog integration)

> Use profile based on file format in HCatalog integration for HiveOrc profile
> 
>
> Key: HAWQ-1177
> URL: https://issues.apache.org/jira/browse/HAWQ-1177
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: PXF
>Reporter: Oleksandr Diachenko
>Assignee: Oleksandr Diachenko
> Fix For: backlog
>
>
> When user queries Hive table using HCatalog integration feature, HAWQ uses 
> "Hive" profile, which might be not optimal. Idea is to choose profile for 
> each fragment, based of underlying file format.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HAWQ-1177) Use profile based on file format in HCatalog integration for HiveOrc profile

2016-12-20 Thread Oleksandr Diachenko (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Oleksandr Diachenko updated HAWQ-1177:
--
Description: When user queries Hive table using HCatalog integration 
feature, HAWQ uses "Hive" profile, which might be not optimal. Idea is to 
choose profile for each fragment, based of underlying file format. In this JIRA 
we should implement changes to leverage HiveORC profile.  (was: When user 
queries Hive table using HCatalog integration feature, HAWQ uses "Hive" 
profile, which might be not optimal. Idea is to choose profile for each 
fragment, based of underlying file format.)

> Use profile based on file format in HCatalog integration for HiveOrc profile
> 
>
> Key: HAWQ-1177
> URL: https://issues.apache.org/jira/browse/HAWQ-1177
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: PXF
>Reporter: Oleksandr Diachenko
>Assignee: Oleksandr Diachenko
> Fix For: backlog
>
>
> When user queries Hive table using HCatalog integration feature, HAWQ uses 
> "Hive" profile, which might be not optimal. Idea is to choose profile for 
> each fragment, based of underlying file format. In this JIRA we should 
> implement changes to leverage HiveORC profile.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...

2016-12-20 Thread linwen
Github user linwen commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1058#discussion_r93190511
  
--- Diff: src/backend/libpq/rangerrest.c ---
@@ -452,8 +448,8 @@ static int call_ranger_rest(CURL_HANDLE curl_handle, 
const char* request)
goto _exit;
}
 
-   // hard core timeout
-   curl_easy_setopt(curl_handle->curl_handle, CURLOPT_TIMEOUT, 15L);
+   // hard-coded timeout
--- End diff --

please use /**/ as comment.
/* hard-coded timeout is 30 seconds */


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...

2016-12-20 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1058#discussion_r93190518
  
--- Diff: src/test/regress/checkinc.py ---
@@ -78,9 +78,10 @@
 'winsock.h': [],
 'winsock2.h':[],
 'ws2tcpip.h':[],
-'hdfs/hdfs.h':  [],
+'hdfs/hdfs.h':  [],
 'quicklz1.h':   [],
 'quicklz3.h':   [],
+'json-c/json.h': [],
--- End diff --

Make sense since Travis CI is green with this commit. Good fix.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...

2016-12-20 Thread linwen
Github user linwen commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1058#discussion_r93189866
  
--- Diff: src/backend/libpq/rangerrest.c ---
@@ -272,280 +286,300 @@ json_object *create_ranger_request_json_batch(List 
*args)
  *   ]
  *   }
  */
-json_object* create_ranger_request_json(char* user, AclObjectKind kind, 
char* object,
-List* actions, char* how)
+static json_object* create_ranger_request_json(char* user, AclObjectKind 
kind, char* object,
+   List* actions, char* how)
 {
-Assert(user != NULL && object != NULL && privilege != NULL
-&& how != NULL);
-ListCell *cell;
-
-elog(LOG, "build json for ranger request, user:%s, kind:%s, object:%s",
-  user, AclObjectKindStr[kind], object);
-json_object *jrequest = json_object_new_object();
-json_object *juser = json_object_new_string(user);
-
-json_object *jaccess = json_object_new_array();
-json_object *jelement = json_object_new_object();
-
-json_object *jresource = json_object_new_object();
-switch(kind)
-{
-case ACL_KIND_CLASS:
-case ACL_KIND_SEQUENCE:
-case ACL_KIND_PROC:
-case ACL_KIND_NAMESPACE:
-case ACL_KIND_LANGUAGE:
-{
-char *ptr = NULL; char *name = NULL;
-char *first = NULL; // could be a database or protocol or 
tablespace
-char *second = NULL; // could be a schema or language
-char *third = NULL; // could be a table or sequence or function
-int idx = 0;
-for (name = strtok_r(object, ".", );
- name;
- name = strtok_r(NULL, ".", ), idx++)
-{
-if (idx == 0)
-{
-first = pstrdup(name);
-}
-else if (idx == 1)
-{
-second = pstrdup(name);
-}
-else
-{
-third = pstrdup(name);
-}
-}
-
-if (first != NULL)
-{
-json_object *jfirst = json_object_new_string(first);
-json_object_object_add(jresource, "database", jfirst);
-}
-if (second != NULL)
-{
-json_object *jsecond = json_object_new_string(second);
-json_object_object_add(jresource,
-(kind == ACL_KIND_LANGUAGE) ? "language" : 
"schema", jsecond);
-}
-if (third != NULL)
-{
-json_object *jthird = json_object_new_string(third);
-json_object_object_add(jresource,
- (kind == ACL_KIND_CLASS) ? "table" :
- (kind == ACL_KIND_SEQUENCE) ? "sequence" : 
"function", jthird);
-}
-
-if (first != NULL)
-pfree(first);
-if (second != NULL)
-pfree(second);
-if (third != NULL)
-pfree(third);
-break;
-}
-case ACL_KIND_OPER:
-case ACL_KIND_CONVERSION:
-case ACL_KIND_DATABASE:
-case ACL_KIND_TABLESPACE:
-case ACL_KIND_TYPE:
-case ACL_KIND_FILESYSTEM:
-case ACL_KIND_FDW:
-case ACL_KIND_FOREIGN_SERVER:
-case ACL_KIND_EXTPROTOCOL:
-{
-json_object *jobject = json_object_new_string(object);
-json_object_object_add(jresource, AclObjectKindStr[kind], 
jobject);
-break;
-}
-default:
-elog(ERROR, "unrecognized objkind: %d", (int) kind);
-}
-
-json_object *jactions = json_object_new_array();
-foreach(cell, actions)
-{
-json_object* jaction = json_object_new_string((char 
*)cell->data.ptr_value);
-json_object_array_add(jactions, jaction);
-}
-json_object_object_add(jelement, "resource", jresource);
-json_object_object_add(jelement, "privileges", jactions);
-json_object_array_add(jaccess, jelement);
-
-json_object_object_add(jrequest, "user", juser);
-json_object_object_add(jrequest, "access", jaccess);
-json_object *jreqid = json_object_new_string("1");
-json_object_object_add(jrequest, "requestId", jreqid);
-json_object *jclientip = json_object_new_string("123.0.0.21");
-json_object_object_add(jrequest, "clientIp", jclientip);
-json_object *jcontext = json_object_new_string("SELECT * FROM 

[GitHub] incubator-hawq issue #1058: HAWQ-1226. HAWQ core dump due to enable ranger w...

2016-12-20 Thread stanlyxiang
Github user stanlyxiang commented on the issue:

https://github.com/apache/incubator-hawq/pull/1058
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1058: HAWQ-1226. HAWQ core dump due to enable ranger w...

2016-12-20 Thread interma
Github user interma commented on the issue:

https://github.com/apache/incubator-hawq/pull/1058
  
Fixed review problems already.
Tks, guys!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---