[GitHub] incubator-hawq issue #815: HAWQ-898. Add feature test for COPY with new test...
Github user yaoj2 commented on the issue: https://github.com/apache/incubator-hawq/pull/815 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #815: HAWQ-898. Add feature test for COPY with new test...
Github user linwen commented on the issue: https://github.com/apache/incubator-hawq/pull/815 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #815: HAWQ-898. Add feature test for COPY with n...
GitHub user jiny2 opened a pull request: https://github.com/apache/incubator-hawq/pull/815 HAWQ-898. Add feature test for COPY with new test framework You can merge this pull request into a Git repository by running: $ git pull https://github.com/jiny2/incubator-hawq HAWQ-898 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/815.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #815 commit 60097693b1eb18dd904f7d4e6518d3e526121492 Author: YI JIN Date: 2016-07-26T06:16:19Z HAWQ-898. Add feature test for COPY with new test framework --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #814: HAWQ-922. Add basic verification for various pl a...
Github user yaoj2 commented on the issue: https://github.com/apache/incubator-hawq/pull/814 LGTM Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #814: HAWQ-922. Add basic verification for various pl a...
Github user huor commented on the issue: https://github.com/apache/incubator-hawq/pull/814 @yaoj2, the commit message, title of the PR, and title of the JIRA has been modified to reflect that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (HAWQ-922) Add basic verification for various pl and udf in HAWQ
[ https://issues.apache.org/jira/browse/HAWQ-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-922: - Summary: Add basic verification for various pl and udf in HAWQ (was: Add basic data verification for various pl and udf in HAWQ) > Add basic verification for various pl and udf in HAWQ > - > > Key: HAWQ-922 > URL: https://issues.apache.org/jira/browse/HAWQ-922 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Upgrade >Affects Versions: 2.0.0.0-incubating >Reporter: Ruilong Huo >Assignee: Ruilong Huo > Fix For: 2.0.1.0-incubating > > > For HAWQ upgrade from 2.0.0.0 to 2.0.1.0 related tasks, we need to add basic > data verification for hawq upgrade, including procedural languages, > user-defined functions, etc. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HAWQ-922) Add basic data verification for various pl and udf in HAWQ
[ https://issues.apache.org/jira/browse/HAWQ-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruilong Huo updated HAWQ-922: - Summary: Add basic data verification for various pl and udf in HAWQ (was: Add basic data verification for HAWQ upgrade from 2.0.0.0 to 2.0.1.0) > Add basic data verification for various pl and udf in HAWQ > -- > > Key: HAWQ-922 > URL: https://issues.apache.org/jira/browse/HAWQ-922 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Upgrade >Affects Versions: 2.0.0.0-incubating >Reporter: Ruilong Huo >Assignee: Ruilong Huo > Fix For: 2.0.1.0-incubating > > > For HAWQ upgrade from 2.0.0.0 to 2.0.1.0 related tasks, we need to add basic > data verification for hawq upgrade, including procedural languages, > user-defined functions, etc. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HAWQ-908) Add feature test for goh_toast with new test framework
[ https://issues.apache.org/jira/browse/HAWQ-908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Weng resolved HAWQ-908. Resolution: Fixed > Add feature test for goh_toast with new test framework > -- > > Key: HAWQ-908 > URL: https://issues.apache.org/jira/browse/HAWQ-908 > Project: Apache HAWQ > Issue Type: Sub-task > Components: Tests >Reporter: Ivan Weng >Assignee: Ivan Weng > Fix For: 2.0.1.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[GitHub] incubator-hawq pull request #813: HAWQ-908. Add feature test for goh_toast w...
Github user asfgit closed the pull request at: https://github.com/apache/incubator-hawq/pull/813 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #814: HAWQ-922. Add basic verification for pl and udf f...
Github user yaoj2 commented on the issue: https://github.com/apache/incubator-hawq/pull/814 I think it is not related to upgrade. It is add UDF related test. We'd better to modify subject. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #811: GPSQL-3288: Set dummy workfile pointer to NULL af...
Github user liming01 commented on the issue: https://github.com/apache/incubator-hawq/pull/811 Thanks @zhangh43, @GodenYao, Yes, I will open a new Apache JIRA for it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #813: HAWQ-908. Add feature test for goh_toast with new...
Github user zhangh43 commented on the issue: https://github.com/apache/incubator-hawq/pull/813 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #814: HAWQ-922. Add basic verification for pl an...
GitHub user huor opened a pull request: https://github.com/apache/incubator-hawq/pull/814 HAWQ-922. Add basic verification for pl and udf for HAWQ upgrade from 2.0.0.0 to 2.0.1.0 @yaoj2, @xunzhang, @ztao1987, please review. You can merge this pull request into a Git repository by running: $ git pull https://github.com/huor/incubator-hawq huor_pl_upgrade Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/814.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #814 commit aeaee3b6f6c7351c301fe537355e02993c8c4ac3 Author: Ruilong Huo Date: 2016-07-25T07:20:00Z HAWQ-922. Add basic verification for pl and udf for HAWQ upgrade from 2.0.0.0 to 2.0.1.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #813: HAWQ-908. Add feature test for goh_toast w...
GitHub user wengyanqing opened a pull request: https://github.com/apache/incubator-hawq/pull/813 HAWQ-908. Add feature test for goh_toast with new test framework You can merge this pull request into a Git repository by running: $ git pull https://github.com/wengyanqing/incubator-hawq HAWQ-908 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/813.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #813 commit faf50470b73c3d646ff6edfd03a62fbf7931a5f7 Author: ivan Date: 2016-07-26T03:02:01Z HAWQ-908. Add feature test for goh_toast with new test framework --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #812: HAWQ-949. Revert serializing floats in pxf...
GitHub user kavinderd opened a pull request: https://github.com/apache/incubator-hawq/pull/812 HAWQ-949. Revert serializing floats in pxf string filter You can merge this pull request into a Git repository by running: $ git pull https://github.com/kavinderd/incubator-hawq HAWQ-949 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/812.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #812 commit 5387f1c93afc286bba628c66b9cc2015f4b7474e Author: Kavinder Dhaliwal Date: 2016-07-25T23:50:50Z HAWQ-949. Revert serializing floats in pxf string filter --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Assigned] (HAWQ-949) Hawq sending unsupported serialized float filter data to PXF
[ https://issues.apache.org/jira/browse/HAWQ-949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kavinder Dhaliwal reassigned HAWQ-949: -- Assignee: Kavinder Dhaliwal (was: Goden Yao) > Hawq sending unsupported serialized float filter data to PXF > > > Key: HAWQ-949 > URL: https://issues.apache.org/jira/browse/HAWQ-949 > Project: Apache HAWQ > Issue Type: Bug > Components: External Tables, PXF >Reporter: Kavinder Dhaliwal >Assignee: Kavinder Dhaliwal > > HAWQ-779 introduced support in the C side for Float to be serialized into the > filter header sent to PXF. However, changes were not made to the FilterParser > class in PXF to support parsing non-Int numeric types. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HAWQ-949) Hawq sending unsupported serialized float filter data to PXF
Kavinder Dhaliwal created HAWQ-949: -- Summary: Hawq sending unsupported serialized float filter data to PXF Key: HAWQ-949 URL: https://issues.apache.org/jira/browse/HAWQ-949 Project: Apache HAWQ Issue Type: Bug Components: External Tables, PXF Reporter: Kavinder Dhaliwal Assignee: Goden Yao HAWQ-779 introduced support in the C side for Float to be serialized into the filter header sent to PXF. However, changes were not made to the FilterParser class in PXF to support parsing non-Int numeric types. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HAWQ-947) set work_mem cannot work
[
https://issues.apache.org/jira/browse/HAWQ-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Goden Yao updated HAWQ-947:
---
Fix Version/s: 2.0.1.0-incubating
> set work_mem cannot work
>
>
> Key: HAWQ-947
> URL: https://issues.apache.org/jira/browse/HAWQ-947
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Core
>Affects Versions: 2.0.1.0-incubating
>Reporter: Biao Wu
>Assignee: Lei Chang
> Fix For: 2.0.1.0-incubating
>
>
> HAWQ version is 2.0.1.0 build dev.
> EXPLAIN ANALYZE:
> Work_mem: 9554K bytes max, 63834K bytes wanted。
> then set work_mem to '512MB',but not work
> {code:sql}
> test=# EXPLAIN ANALYZE SELECT count(DISTINCT item_sku_id)
> test-# FROM gdm_m03_item_sku_da
> test-# WHERE item_origin ='中国大陆';
>
>
>QUERY PLAN
>
>
> Aggregate (cost=54177150.69..54177150.70 rows=1 width=8)
>Rows out: Avg 1.0 rows x 1 workers.
> Max/Last(seg-1:BJHC-HEBE-9014.hadoop.jd.local/seg-1:BJHC-HEBE-9014.hadoop.jd.local)
> 1/1 rows with 532498/532498 ms to end, start offset by 201/201 ms.
>-> Gather Motion 306:1 (slice2; segments: 306)
> (cost=54177147.60..54177150.68 rows=1 width=8)
> Rows out: Avg 306.0 rows x 1 workers at destination.
> Max/Last(seg-1:BJHC-HEBE-9014.hadoop.jd.local/seg-1:BJHC-HEBE-9014.hadoop.jd.local)
> 306/306 rows with 529394/529394 ms to first row, 532498/532498 ms to end,
> start offset b
> y 201/201 ms.
> -> Aggregate (cost=54177147.60..54177147.61 rows=1 width=8)
>Rows out: Avg 1.0 rows x 306 workers.
> Max/Last(seg305:BJHC-HEBE-9031.hadoop.jd.local/seg258:BJHC-HEBE-9029.hadoop.jd.local)
> 1/1 rows with 530367/532274 ms to end, start offset by 396/246 ms.
>Executor memory: 9554K bytes avg, 9554K bytes max
> (seg305:BJHC-HEBE-9031.hadoop.jd.local).
>Work_mem used: 9554K bytes avg, 9554K bytes max
> (seg305:BJHC-HEBE-9031.hadoop.jd.local).
>Work_mem wanted: 63695K bytes avg, 63834K bytes max
> (seg296:BJHC-HEBE-9031.hadoop.jd.local) to lessen workfile I/O affecting 306
> workers.
>-> Redistribute Motion 306:306 (slice1; segments: 306)
> (cost=0.00..53550018.97 rows=819776 width=11)
> Hash Key: gdm_m03_item_sku_da.item_sku_id
> Rows out: Avg 820083.0 rows x 306 workers at
> destination.
> Max/Last(seg296:BJHC-HEBE-9031.hadoop.jd.local/seg20:BJHC-HEBE-9016.hadoop.jd.local)
> 821880/818660 rows with 769/771 ms to first row, 524681/525063 ms to e
> nd, start offset by 352/307 ms.
> -> Append-only Scan on gdm_m03_item_sku_da
> (cost=0.00..48532990.00 rows=819776 width=11)
>Filter: item_origin::text = '中国大陆'::text
>Rows out: Avg 820083.0 rows x 306 workers.
> Max/Last(seg46:BJHC-HEBE-9017.hadoop.jd.local/seg5:BJHC-HEBE-9015.hadoop.jd.local)
> 893390/810582 rows with 28/127 ms to first row, 73062/526318 ms to end,
> start off
> set by 354/458 ms.
> Slice statistics:
>(slice0)Executor memory: 1670K bytes.
>(slice1)Executor memory: 3578K bytes avg x 306 workers, 4711K bytes
> max (seg172:BJHC-HEBE-9024.hadoop.jd.local).
>(slice2) * Executor memory: 10056K bytes avg x 306 workers, 10056K bytes
> max (seg305:BJHC-HEBE-9031.hadoop.jd.local). Work_mem: 9554K bytes max,
> 63834K bytes wanted.
> Statement statistics:
>Memory used: 262144K bytes
>Memory wanted: 64233K bytes
> Settings: default_hash_table_bucket_number=6
> Dispatcher statistics:
>executors used(total/cached/new connection): (612/0/612); dispatcher
> time(total/connection/dispatch data): (489.036 ms/192.741 ms/293.357 ms).
>dispatch data time(max/min/avg): (37.798 ms/0.011 ms/3.504 ms); consume
> executor data time(max/min/avg): (0.016 ms/0.002 ms/0.005 ms); free executor
> time(max/min/avg): (0.000 ms/0.000 ms/0.000 ms).
> Data locality statistics:
>data locality ratio: 0.864; virtual segment number: 306; different host
> number: 17; virtual segment number per host(avg/min/max): (18/18/18); segment
> size(avg/min/max): (3435087582.693 B/3391891296 B/3489660928 B); segment size
[GitHub] incubator-hawq issue #811: GPSQL-3288: Set dummy workfile pointer to NULL af...
Github user GodenYao commented on the issue: https://github.com/apache/incubator-hawq/pull/811 even this is an internal customer JIRA, we should still file Apache JIRA so the repro steps and RCA are available to public. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
