[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-hawq/pull/1059 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...
Github user paul-guo- commented on a diff in the pull request: https://github.com/apache/incubator-hawq/pull/1059#discussion_r93384000 --- Diff: tools/bin/hawqpylib/HAWQ_HELP.py --- @@ -159,10 +159,10 @@ The "options" are: -c --change Changes a configuration parameter setting. --- End diff -- How. Then +1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1060: HAWQ-1226. HAWQ core dump due to enable r...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-hawq/pull/1060 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1054: HAWQ-870. Allocate target's tuple table slot in ...
Github user xunzhang commented on the issue: https://github.com/apache/incubator-hawq/pull/1054 Already merged? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...
Github user linwen commented on the issue: https://github.com/apache/incubator-hawq/pull/1060 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...
Github user zhangh43 commented on the issue: https://github.com/apache/incubator-hawq/pull/1060 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...
Github user stanlyxiang commented on the issue: https://github.com/apache/incubator-hawq/pull/1060 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1060: HAWQ-1226. HAWQ core dump due to enable ranger w...
Github user interma commented on the issue: https://github.com/apache/incubator-hawq/pull/1060 @linwen @stanlyxiang @zhangh43 help to review again, thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1060: HAWQ-1226. HAWQ core dump due to enable r...
GitHub user interma opened a pull request: https://github.com/apache/incubator-hawq/pull/1060 HAWQ-1226. HAWQ core dump due to enable ranger while RPS is down lnclude: 1. fix core dump while RPS not running 2. fix libcurl write_callback() problem 3. add libcurl timeout (hard-coded 30s temporarily) 4. fix some compile warnings 5. fix make install error: add json.h to checkinc.py And old PR discuss: https://github.com/apache/incubator-hawq/pull/1058 You can merge this pull request into a Git repository by running: $ git pull https://github.com/interma/interma-hawq HAWQ-1226 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/1060.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1060 commit b6a82951eeb5218cb4d22659281812fd7b2b98da Author: intermaDate: 2016-12-21T04:02:14Z HAWQ-1226. HAWQ core dump due to enable ranger while RPS is down --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...
Github user interma closed the pull request at: https://github.com/apache/incubator-hawq/pull/1058 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1058: HAWQ-1226. HAWQ core dump due to enable ranger w...
Github user interma commented on the issue: https://github.com/apache/incubator-hawq/pull/1058 I will open a new PR, closed this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...
Github user paul-guo- commented on a diff in the pull request: https://github.com/apache/incubator-hawq/pull/1059#discussion_r93370544 --- Diff: tools/bin/hawqpylib/HAWQ_HELP.py --- @@ -159,10 +159,10 @@ The "options" are: -c --change Changes a configuration parameter setting. --- End diff -- Actually I think "--change" could better be "--parameter"? ". How do you think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config
Github user radarwave commented on the issue: https://github.com/apache/incubator-hawq/pull/1059 @paul-guo- Please review. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config
Github user radarwave commented on the issue: https://github.com/apache/incubator-hawq/pull/1059 Good point, I will update it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config
Github user paul-guo- commented on the issue: https://github.com/apache/incubator-hawq/pull/1059 I mean why not replace this time. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config
Github user radarwave commented on the issue: https://github.com/apache/incubator-hawq/pull/1059 Yeah, '-v' is used to set the GUC value. '--verbose' is a legacy option, now it's already been removed. This time only remove the wrong help message. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1059: HAWQ-1229. Remove verbose option in hawq config
Github user paul-guo- commented on the issue: https://github.com/apache/incubator-hawq/pull/1059 '-v' seem to have another usage in "hawq config"? [-v hawq_property_value | --value=hawq_property_value --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (HAWQ-1229) Remove unused option help message in hawq config
[ https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radar Lei updated HAWQ-1229: Summary: Remove unused option help message in hawq config (was: Remove unused option in hawq config) > Remove unused option help message in hawq config > > > Key: HAWQ-1229 > URL: https://issues.apache.org/jira/browse/HAWQ-1229 > Project: Apache HAWQ > Issue Type: Improvement > Components: Command Line Tools >Reporter: Radar Lei >Assignee: Radar Lei > > 'hawq config --help' offers '--verbose' option but it is not actually > possible. We should remove this option. > See: > [gpadmin@test1 ~]$ hawq config --help > usage: hawq config [--options] > The "options" are: >-c --change Changes a configuration parameter setting. >-s --show Shows the value for a specified configuration > parameter. >-l --list Lists all configuration parameters. >-q --quiet Run in quiet mode. >-v --verboseDisplays detailed status. >-r --remove HAWQ GUC name to be removed. >--skipvalidationSkip the system validation checks. >--ignore-bad-hosts Skips copying configuration files on host on which SSH > fails > See 'hawq --help' for more information on other commands. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HAWQ-1229) Remove unused option help message in hawq config
[ https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radar Lei updated HAWQ-1229: Description: 'hawq config --help' offers '--verbose' option but it is not actually possible. We should remove this option's help mesage. See: [gpadmin@test1 ~]$ hawq config --help usage: hawq config [--options] The "options" are: -c --change Changes a configuration parameter setting. -s --show Shows the value for a specified configuration parameter. -l --list Lists all configuration parameters. -q --quiet Run in quiet mode. -v --verboseDisplays detailed status. -r --remove HAWQ GUC name to be removed. --skipvalidationSkip the system validation checks. --ignore-bad-hosts Skips copying configuration files on host on which SSH fails See 'hawq --help' for more information on other commands. was: 'hawq config --help' offers '--verbose' option but it is not actually possible. We should remove this option. See: [gpadmin@test1 ~]$ hawq config --help usage: hawq config [--options] The "options" are: -c --change Changes a configuration parameter setting. -s --show Shows the value for a specified configuration parameter. -l --list Lists all configuration parameters. -q --quiet Run in quiet mode. -v --verboseDisplays detailed status. -r --remove HAWQ GUC name to be removed. --skipvalidationSkip the system validation checks. --ignore-bad-hosts Skips copying configuration files on host on which SSH fails See 'hawq --help' for more information on other commands. > Remove unused option help message in hawq config > > > Key: HAWQ-1229 > URL: https://issues.apache.org/jira/browse/HAWQ-1229 > Project: Apache HAWQ > Issue Type: Improvement > Components: Command Line Tools >Reporter: Radar Lei >Assignee: Radar Lei > > 'hawq config --help' offers '--verbose' option but it is not actually > possible. We should remove this option's help mesage. > See: > [gpadmin@test1 ~]$ hawq config --help > usage: hawq config [--options] > The "options" are: >-c --change Changes a configuration parameter setting. >-s --show Shows the value for a specified configuration > parameter. >-l --list Lists all configuration parameters. >-q --quiet Run in quiet mode. >-v --verboseDisplays detailed status. >-r --remove HAWQ GUC name to be removed. >--skipvalidationSkip the system validation checks. >--ignore-bad-hosts Skips copying configuration files on host on which SSH > fails > See 'hawq --help' for more information on other commands. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-hawq pull request #1059: HAWQ-1229. Remove verbose option in hawq ...
GitHub user radarwave opened a pull request: https://github.com/apache/incubator-hawq/pull/1059 HAWQ-1229. Remove verbose option in hawq config You can merge this pull request into a Git repository by running: $ git pull https://github.com/radarwave/incubator-hawq config_verbose Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/1059.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1059 commit 5ac1a23db4eb2b2ebc026c94f35cb77a09dd8393 Author: rleiDate: 2016-12-21T02:59:13Z HAWQ-1229. Remove verbose option in hawq config --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (HAWQ-1229) Remove unused option in hawq config
[ https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radar Lei updated HAWQ-1229: Description: 'hawq config --help' offers '--verbose' option but it is not actually possible. We should remove this option. See: [gpadmin@test1 ~]$ hawq config --help usage: hawq config [--options] The "options" are: -c --change Changes a configuration parameter setting. -s --show Shows the value for a specified configuration parameter. -l --list Lists all configuration parameters. -q --quiet Run in quiet mode. -v --verboseDisplays detailed status. -r --remove HAWQ GUC name to be removed. --skipvalidationSkip the system validation checks. --ignore-bad-hosts Skips copying configuration files on host on which SSH fails See 'hawq --help' for more information on other commands. was: hawq config --help offers --verbose option but it is not actually possible. We should remove this '--verbose' option. See: [gpadmin@test1 ~]$ hawq config --help usage: hawq config [--options] The "options" are: -c --change Changes a configuration parameter setting. -s --show Shows the value for a specified configuration parameter. -l --list Lists all configuration parameters. -q --quiet Run in quiet mode. -v --verboseDisplays detailed status. -r --remove HAWQ GUC name to be removed. --skipvalidationSkip the system validation checks. --ignore-bad-hosts Skips copying configuration files on host on which SSH fails See 'hawq --help' for more information on other commands. > Remove unused option in hawq config > --- > > Key: HAWQ-1229 > URL: https://issues.apache.org/jira/browse/HAWQ-1229 > Project: Apache HAWQ > Issue Type: Improvement > Components: Command Line Tools >Reporter: Radar Lei >Assignee: Ed Espino > > 'hawq config --help' offers '--verbose' option but it is not actually > possible. We should remove this option. > See: > [gpadmin@test1 ~]$ hawq config --help > usage: hawq config [--options] > The "options" are: >-c --change Changes a configuration parameter setting. >-s --show Shows the value for a specified configuration > parameter. >-l --list Lists all configuration parameters. >-q --quiet Run in quiet mode. >-v --verboseDisplays detailed status. >-r --remove HAWQ GUC name to be removed. >--skipvalidationSkip the system validation checks. >--ignore-bad-hosts Skips copying configuration files on host on which SSH > fails > See 'hawq --help' for more information on other commands. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HAWQ-1229) Remove unused option in hawq config
[ https://issues.apache.org/jira/browse/HAWQ-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radar Lei reassigned HAWQ-1229: --- Assignee: Radar Lei (was: Ed Espino) > Remove unused option in hawq config > --- > > Key: HAWQ-1229 > URL: https://issues.apache.org/jira/browse/HAWQ-1229 > Project: Apache HAWQ > Issue Type: Improvement > Components: Command Line Tools >Reporter: Radar Lei >Assignee: Radar Lei > > 'hawq config --help' offers '--verbose' option but it is not actually > possible. We should remove this option. > See: > [gpadmin@test1 ~]$ hawq config --help > usage: hawq config [--options] > The "options" are: >-c --change Changes a configuration parameter setting. >-s --show Shows the value for a specified configuration > parameter. >-l --list Lists all configuration parameters. >-q --quiet Run in quiet mode. >-v --verboseDisplays detailed status. >-r --remove HAWQ GUC name to be removed. >--skipvalidationSkip the system validation checks. >--ignore-bad-hosts Skips copying configuration files on host on which SSH > fails > See 'hawq --help' for more information on other commands. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HAWQ-1229) Remove unused option in hawq config
Radar Lei created HAWQ-1229: --- Summary: Remove unused option in hawq config Key: HAWQ-1229 URL: https://issues.apache.org/jira/browse/HAWQ-1229 Project: Apache HAWQ Issue Type: Improvement Components: Command Line Tools Reporter: Radar Lei Assignee: Ed Espino hawq config --help offers --verbose option but it is not actually possible. We should remove this '--verbose' option. See: [gpadmin@test1 ~]$ hawq config --help usage: hawq config [--options] The "options" are: -c --change Changes a configuration parameter setting. -s --show Shows the value for a specified configuration parameter. -l --list Lists all configuration parameters. -q --quiet Run in quiet mode. -v --verboseDisplays detailed status. -r --remove HAWQ GUC name to be removed. --skipvalidationSkip the system validation checks. --ignore-bad-hosts Skips copying configuration files on host on which SSH fails See 'hawq --help' for more information on other commands. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (HAWQ-999) Log_error when file count is not in proportion to bucket number of hash table.
[ https://issues.apache.org/jira/browse/HAWQ-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hubert Zhang closed HAWQ-999. - Resolution: Fixed > Log_error when file count is not in proportion to bucket number of hash table. > -- > > Key: HAWQ-999 > URL: https://issues.apache.org/jira/browse/HAWQ-999 > Project: Apache HAWQ > Issue Type: Improvement > Components: Core >Reporter: Hubert Zhang >Assignee: Hubert Zhang > Fix For: 2.0.1.0-incubating > > > By definition, file count of a hash table should be equal to or a multiple of > the bucket number of the table. So if mismatch happens, we should not treat > it as hash table in data locality algorithm. > The default behaviour should LOG_ERROR and tell the user "file count is not > in proportion to bucket number for hash table with oid=X. Some data maybe > lost, if you still want to continue the query, set GUC > assign_randomly_for_mismatched_hash_table to true and try again." > If GUC assign_randomly_for_mismatched_hash_table is on, the behaviour changed > to treat the hash table as random table in data locality algorithm. > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HAWQ-1039) Add test case of bucket number may not be consistent with parent table.
[ https://issues.apache.org/jira/browse/HAWQ-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hubert Zhang reassigned HAWQ-1039: -- Assignee: Hubert Zhang (was: Lei Chang) > Add test case of bucket number may not be consistent with parent table. > --- > > Key: HAWQ-1039 > URL: https://issues.apache.org/jira/browse/HAWQ-1039 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Core >Reporter: Hubert Zhang >Assignee: Hubert Zhang > Fix For: 2.0.1.0-incubating > > > add test case for HAWQ-1032 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (HAWQ-1039) Add test case of bucket number may not be consistent with parent table.
[ https://issues.apache.org/jira/browse/HAWQ-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hubert Zhang closed HAWQ-1039. -- Resolution: Fixed > Add test case of bucket number may not be consistent with parent table. > --- > > Key: HAWQ-1039 > URL: https://issues.apache.org/jira/browse/HAWQ-1039 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Core >Reporter: Hubert Zhang >Assignee: Hubert Zhang > Fix For: 2.0.1.0-incubating > > > add test case for HAWQ-1032 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (HAWQ-1032) Bucket number of newly added partition is not consistent with parent table.
[ https://issues.apache.org/jira/browse/HAWQ-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hubert Zhang closed HAWQ-1032. -- Resolution: Fixed > Bucket number of newly added partition is not consistent with parent table. > --- > > Key: HAWQ-1032 > URL: https://issues.apache.org/jira/browse/HAWQ-1032 > Project: Apache HAWQ > Issue Type: Bug > Components: Core >Reporter: Hubert Zhang >Assignee: Hubert Zhang > Fix For: 2.0.1.0-incubating > > > Failure Case > {code} > set deafult_hash_table_bucket_number = 12; > CREATE TABLE sales3 (id int, date date, amt decimal(10,2)) > DISTRIBUTED BY (id) > PARTITION BY RANGE (date) > ( START (date '2008-01-01') INCLUSIVE >END (date '2009-01-01') EXCLUSIVE >EVERY (INTERVAL '1 day') ); > set default_hash_table_bucket_number = 16; > ALTER TABLE sales3 ADD PARTITION START > (date '2009-03-01') INCLUSIVE END > (date '2009-04-01') EXCLUSIVE; > {code} > The newly added partition with buckcet number 16 is not consistent with > parent partition. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HAWQ-1197) Add note about default_hash_table_bucket_number to PXF section
[ https://issues.apache.org/jira/browse/HAWQ-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765741#comment-15765741 ] Vineet Goel commented on HAWQ-1197: --- Currently, queries on PXF external tables use default_hash_table_bucket_number as the static number of virtual segments to process the query. We don't want to recommend changing this parameter for tuning purposes, as changing the parameter would affect HASH distribution on HAWQ internal tables, requiring a re-distribution of data. The future enhancement goal is to have PXF use something more dynamic instead. > Add note about default_hash_table_bucket_number to PXF section > -- > > Key: HAWQ-1197 > URL: https://issues.apache.org/jira/browse/HAWQ-1197 > Project: Apache HAWQ > Issue Type: Improvement > Components: Documentation >Reporter: Jane Beckman >Assignee: David Yozie > > The discussion of default_hash_table_bucket_number controlling numbe rof > segments in PXF external table queries is in Best Practices, but not the PXF > sections. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HAWQ-1195) Synchrony:Union not working on external tables ERROR:"Two or more external tables use the same error table ""xxxxxxx"" in a statement (execMain.c:274)"
[ https://issues.apache.org/jira/browse/HAWQ-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765712#comment-15765712 ] Vineet Goel commented on HAWQ-1195: --- Could you please change the "Fix Version/s:" field to the correct version where this commit was made? Thanks > Synchrony:Union not working on external tables ERROR:"Two or more external > tables use the same error table ""xxx"" in a statement (execMain.c:274)" > --- > > Key: HAWQ-1195 > URL: https://issues.apache.org/jira/browse/HAWQ-1195 > Project: Apache HAWQ > Issue Type: Bug > Components: External Tables >Reporter: Ming LI >Assignee: Ming LI > Fix For: backlog > > > Hello, > User create an external table and define the error table. Then he do the > union on the same external table with different where condition. Then return > the error:ERROR: Two or more external tables use the same error table > "err_ext_pdr_cdci_pivotal_request_43448" in a statement (execMain.c:274) > Below is the master log when I reproduce: (the whole log file attached in > attachement) > {code} > 2016-11-29 22:49:51.976864 > PST,"gpadmin","postgres",p769199,th-2123704032,"[local]",,2016-11-29 22:46:14 > PST,1260,con72,cmd10,seg-1,,,x1260,sx1,"ERROR","XX000","Two or more external > tables use the same error table ""err_ext_pdr_cdci_pivotal_request_43448"" in > a statement (execMain.c:274)",,"select current_account_nbr,yearmonthint, > bank_name, first_date_open, max_cr_limit, care_credit_flag, cc1_flag, > partition_value, 'US' as loc from pdr_cdci_pivotal_request_43448 where > care_credit_flag<1 > union > select current_account_nbr,yearmonthint, bank_name, first_date_open, > max_cr_limit, care_credit_flag, cc1_flag, partition_value, 'Non-US' as loc > from pdr_cdci_pivotal_request_43448 where > care_credit_flag=1;",0,,"execMain.c",274,"Stack trace: > 10x8c5858 postgres errstart (??:0) > 20x8c75db postgres elog_finish (??:0) > 30x65f669 postgres (??:0) > 40x77d06a postgres walk_plan_node_fields (??:0) > 50x77e3ee postgres plan_tree_walker (??:0) > 60x77c70a postgres expression_tree_walker (??:0) > 70x77e35d postgres plan_tree_walker (??:0) > 80x77d06a postgres walk_plan_node_fields (??:0) > 90x77dfe6 postgres plan_tree_walker (??:0) > 10 0x77d06a postgres walk_plan_node_fields (??:0) > 11 0x77e1e5 postgres plan_tree_walker (??:0) > 12 0x77d06a postgres walk_plan_node_fields (??:0) > 13 0x77dfe6 postgres plan_tree_walker (??:0) > 14 0x77d06a postgres walk_plan_node_fields (??:0) > 15 0x77e1e5 postgres plan_tree_walker (??:0) > 16 0x66079b postgres ExecutorStart (??:0) > 17 0x7ebf1d postgres PortalStart (??:0) > 18 0x7e4288 postgres (??:0) > 19 0x7e54c2 postgres PostgresMain (??:0) > 20 0x797d50 postgres (??:0) > 21 0x79ab19 postgres PostmasterMain (??:0) > 22 0x4a4069 postgres main (??:0) > 23 0x7fd97d486d5d libc.so.6 __libc_start_main (??:0) > 24 0x4a40e9 postgres (??:0) > " > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HAWQ-1228) Use profile based on file format in HCatalog integration for HiveRC, HiveText
Oleksandr Diachenko created HAWQ-1228: - Summary: Use profile based on file format in HCatalog integration for HiveRC, HiveText Key: HAWQ-1228 URL: https://issues.apache.org/jira/browse/HAWQ-1228 Project: Apache HAWQ Issue Type: Improvement Components: PXF Reporter: Oleksandr Diachenko Assignee: Ed Espino To leverage changes introduced in HAWQ-1177, expand optimization for other Hive profiles. Additional information need to be included in user metadata(e.g. DELIMITER etc). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HAWQ-1177) Use profile based on file format in HCatalog integration for HiveOrc profile
[ https://issues.apache.org/jira/browse/HAWQ-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Diachenko updated HAWQ-1177: -- Summary: Use profile based on file format in HCatalog integration for HiveOrc profile (was: Use profile based on file format in HCatalog integration) > Use profile based on file format in HCatalog integration for HiveOrc profile > > > Key: HAWQ-1177 > URL: https://issues.apache.org/jira/browse/HAWQ-1177 > Project: Apache HAWQ > Issue Type: Improvement > Components: PXF >Reporter: Oleksandr Diachenko >Assignee: Oleksandr Diachenko > Fix For: backlog > > > When user queries Hive table using HCatalog integration feature, HAWQ uses > "Hive" profile, which might be not optimal. Idea is to choose profile for > each fragment, based of underlying file format. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HAWQ-1177) Use profile based on file format in HCatalog integration for HiveOrc profile
[ https://issues.apache.org/jira/browse/HAWQ-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Diachenko updated HAWQ-1177: -- Description: When user queries Hive table using HCatalog integration feature, HAWQ uses "Hive" profile, which might be not optimal. Idea is to choose profile for each fragment, based of underlying file format. In this JIRA we should implement changes to leverage HiveORC profile. (was: When user queries Hive table using HCatalog integration feature, HAWQ uses "Hive" profile, which might be not optimal. Idea is to choose profile for each fragment, based of underlying file format.) > Use profile based on file format in HCatalog integration for HiveOrc profile > > > Key: HAWQ-1177 > URL: https://issues.apache.org/jira/browse/HAWQ-1177 > Project: Apache HAWQ > Issue Type: Improvement > Components: PXF >Reporter: Oleksandr Diachenko >Assignee: Oleksandr Diachenko > Fix For: backlog > > > When user queries Hive table using HCatalog integration feature, HAWQ uses > "Hive" profile, which might be not optimal. Idea is to choose profile for > each fragment, based of underlying file format. In this JIRA we should > implement changes to leverage HiveORC profile. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...
Github user linwen commented on a diff in the pull request: https://github.com/apache/incubator-hawq/pull/1058#discussion_r93190511 --- Diff: src/backend/libpq/rangerrest.c --- @@ -452,8 +448,8 @@ static int call_ranger_rest(CURL_HANDLE curl_handle, const char* request) goto _exit; } - // hard core timeout - curl_easy_setopt(curl_handle->curl_handle, CURLOPT_TIMEOUT, 15L); + // hard-coded timeout --- End diff -- please use /**/ as comment. /* hard-coded timeout is 30 seconds */ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...
Github user xunzhang commented on a diff in the pull request: https://github.com/apache/incubator-hawq/pull/1058#discussion_r93190518 --- Diff: src/test/regress/checkinc.py --- @@ -78,9 +78,10 @@ 'winsock.h': [], 'winsock2.h':[], 'ws2tcpip.h':[], -'hdfs/hdfs.h': [], +'hdfs/hdfs.h': [], 'quicklz1.h': [], 'quicklz3.h': [], +'json-c/json.h': [], --- End diff -- Make sense since Travis CI is green with this commit. Good fix. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1058: HAWQ-1226. HAWQ core dump due to enable r...
Github user linwen commented on a diff in the pull request: https://github.com/apache/incubator-hawq/pull/1058#discussion_r93189866 --- Diff: src/backend/libpq/rangerrest.c --- @@ -272,280 +286,300 @@ json_object *create_ranger_request_json_batch(List *args) * ] * } */ -json_object* create_ranger_request_json(char* user, AclObjectKind kind, char* object, -List* actions, char* how) +static json_object* create_ranger_request_json(char* user, AclObjectKind kind, char* object, + List* actions, char* how) { -Assert(user != NULL && object != NULL && privilege != NULL -&& how != NULL); -ListCell *cell; - -elog(LOG, "build json for ranger request, user:%s, kind:%s, object:%s", - user, AclObjectKindStr[kind], object); -json_object *jrequest = json_object_new_object(); -json_object *juser = json_object_new_string(user); - -json_object *jaccess = json_object_new_array(); -json_object *jelement = json_object_new_object(); - -json_object *jresource = json_object_new_object(); -switch(kind) -{ -case ACL_KIND_CLASS: -case ACL_KIND_SEQUENCE: -case ACL_KIND_PROC: -case ACL_KIND_NAMESPACE: -case ACL_KIND_LANGUAGE: -{ -char *ptr = NULL; char *name = NULL; -char *first = NULL; // could be a database or protocol or tablespace -char *second = NULL; // could be a schema or language -char *third = NULL; // could be a table or sequence or function -int idx = 0; -for (name = strtok_r(object, ".", ); - name; - name = strtok_r(NULL, ".", ), idx++) -{ -if (idx == 0) -{ -first = pstrdup(name); -} -else if (idx == 1) -{ -second = pstrdup(name); -} -else -{ -third = pstrdup(name); -} -} - -if (first != NULL) -{ -json_object *jfirst = json_object_new_string(first); -json_object_object_add(jresource, "database", jfirst); -} -if (second != NULL) -{ -json_object *jsecond = json_object_new_string(second); -json_object_object_add(jresource, -(kind == ACL_KIND_LANGUAGE) ? "language" : "schema", jsecond); -} -if (third != NULL) -{ -json_object *jthird = json_object_new_string(third); -json_object_object_add(jresource, - (kind == ACL_KIND_CLASS) ? "table" : - (kind == ACL_KIND_SEQUENCE) ? "sequence" : "function", jthird); -} - -if (first != NULL) -pfree(first); -if (second != NULL) -pfree(second); -if (third != NULL) -pfree(third); -break; -} -case ACL_KIND_OPER: -case ACL_KIND_CONVERSION: -case ACL_KIND_DATABASE: -case ACL_KIND_TABLESPACE: -case ACL_KIND_TYPE: -case ACL_KIND_FILESYSTEM: -case ACL_KIND_FDW: -case ACL_KIND_FOREIGN_SERVER: -case ACL_KIND_EXTPROTOCOL: -{ -json_object *jobject = json_object_new_string(object); -json_object_object_add(jresource, AclObjectKindStr[kind], jobject); -break; -} -default: -elog(ERROR, "unrecognized objkind: %d", (int) kind); -} - -json_object *jactions = json_object_new_array(); -foreach(cell, actions) -{ -json_object* jaction = json_object_new_string((char *)cell->data.ptr_value); -json_object_array_add(jactions, jaction); -} -json_object_object_add(jelement, "resource", jresource); -json_object_object_add(jelement, "privileges", jactions); -json_object_array_add(jaccess, jelement); - -json_object_object_add(jrequest, "user", juser); -json_object_object_add(jrequest, "access", jaccess); -json_object *jreqid = json_object_new_string("1"); -json_object_object_add(jrequest, "requestId", jreqid); -json_object *jclientip = json_object_new_string("123.0.0.21"); -json_object_object_add(jrequest, "clientIp", jclientip); -json_object *jcontext = json_object_new_string("SELECT * FROM
[GitHub] incubator-hawq issue #1058: HAWQ-1226. HAWQ core dump due to enable ranger w...
Github user stanlyxiang commented on the issue: https://github.com/apache/incubator-hawq/pull/1058 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1058: HAWQ-1226. HAWQ core dump due to enable ranger w...
Github user interma commented on the issue: https://github.com/apache/incubator-hawq/pull/1058 Fixed review problems already. Tks, guys! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---