[ https://issues.apache.org/jira/browse/HAWQ-166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ruilong Huo updated HAWQ-166: ----------------------------- Attachment: olap_setup.sql > Orphaned share input scan QE process after OLAP grouping query > -------------------------------------------------------------- > > Key: HAWQ-166 > URL: https://issues.apache.org/jira/browse/HAWQ-166 > Project: Apache HAWQ > Issue Type: Bug > Components: Query Execution > Reporter: Ruilong Huo > Assignee: George Caragea > Attachments: olap_setup.sql > > > Some OLAP grouping query may error out with "division by zero", and then > leaves orphaned share input scan QE process on segment hosts. It causes HAWQ > fails to shutdown, restart, etc. > {code} > [gpadmin@test2 ~]$ ps -ef | grep postgres > gpadmin 115703 1 0 Nov15 ? 00:02:32 > /data/pulse-agent-data/HAWQ-main-FeatureTest-dbg-mutilnode-huor/product/hawq-2.0.0.0/bin/postgres > -D > /data/pulse-agent-data/HAWQ-main-FeatureTest-dbg-mutilnode-huor/product/segmentdd > -i -M segment -p 21100 --silent-mode=true > gpadmin 115704 115703 0 Nov15 ? 00:06:10 postgres: port 21100, > logger process > gpadmin 115707 115703 0 Nov15 ? 00:00:01 postgres: port 21100, stats > collector process > gpadmin 115708 115703 0 Nov15 ? 00:00:17 postgres: port 21100, > writer process > gpadmin 115709 115703 0 Nov15 ? 00:00:03 postgres: port 21100, > checkpoint process > gpadmin 115710 115703 0 Nov15 ? 00:00:38 postgres: port 21100, > segment resource manager > gpadmin 118013 115703 0 Nov15 ? 00:00:28 postgres: port 21100, > gpadmin olap_group 10.32.35.205(46459) con58 seg1 cmd2 slice10 MPPEXEC SELECT > gpadmin 118611 115703 0 Nov15 ? 00:00:28 postgres: port 21100, > gpadmin olap_group 10.32.35.205(47395) con63 seg5 cmd2 slice36 MPPEXEC SELECT > gpadmin 173633 115703 0 Nov15 ? 00:00:28 postgres: port 21100, > gpadmin olap_group 10.32.35.205(3398) con616 seg3 cmd2 slice11 MPPEXEC SELECT > gpadmin 180033 115703 0 Nov15 ? 00:00:28 postgres: port 21100, > gpadmin olap_group 10.32.35.205(13067) con676 seg1 cmd2 slice16 MPPEXEC SELECT > gpadmin 223009 115703 0 Nov15 ? 00:00:27 postgres: port 21100, > gpadmin olap_group 10.32.35.205(13860) con1098 seg7 cmd2 slice21 MPPEXEC > SELECT > gpadmin 414471 414449 0 17:46 pts/1 00:00:00 grep postgres > [gpadmin@test2 ~]$ sudo gdb -p 173633 > (gdb) bt > #0 0x0000003c1e8e15e3 in select () from /lib64/libc.so.6 > #1 0x000000000076724d in shareinput_writer_waitdone (ctxt=0x2b6cc10, > share_id=0, nsharer_xslice=4) at nodeShareInputScan.c:1011 > #2 0x000000000075b241 in ExecEndMaterial (node=0x2a98700) at > nodeMaterial.c:496 > #3 0x00000000007250b0 in ExecEndNode (node=0x2a98700) at execProcnode.c:1690 > #4 0x000000000076539c in ExecEndShareInputScan (node=0x2a98250) at > nodeShareInputScan.c:367 > #5 0x000000000072506a in ExecEndNode (node=0x2a98250) at execProcnode.c:1681 > #6 0x00000000007684e0 in ExecEndSort (node=0x2a97c20) at nodeSort.c:588 > #7 0x00000000007250f6 in ExecEndNode (node=0x2a97c20) at execProcnode.c:1696 > #8 0x000000000074b0c1 in ExecEndAgg (node=0x2a61df8) at nodeAgg.c:2644 > #9 0x0000000000725107 in ExecEndNode (node=0x2a61df8) at execProcnode.c:1700 > #10 0x00000000007639c1 in ExecEndRepeat (node=0x2a608e0) at nodeRepeat.c:218 > #11 0x000000000072517e in ExecEndNode (node=0x2a608e0) at execProcnode.c:1728 > #12 0x0000000000745ad5 in ExecEndAppend (node=0x2a603b8) at nodeAppend.c:411 > #13 0x0000000000724ec9 in ExecEndNode (node=0x2a603b8) at execProcnode.c:1582 > #14 0x0000000000745ad5 in ExecEndAppend (node=0x2a5ff08) at nodeAppend.c:411 > #15 0x0000000000724ec9 in ExecEndNode (node=0x2a5ff08) at execProcnode.c:1582 > #16 0x0000000000760997 in ExecEndMotion (node=0x2a79950) at nodeMotion.c:1232 > #17 0x000000000072516d in ExecEndNode (node=0x2a79950) at execProcnode.c:1724 > #18 0x000000000071c9e9 in ExecEndPlan (planstate=0x2a79950, estate=0x29d4318) > at execMain.c:2891 > #19 0x0000000000719952 in ExecutorEnd (queryDesc=0x29cc208) at execMain.c:1365 > #20 0x00000000006b452b in PortalCleanupHelper (portal=0x29e2528) at > portalcmds.c:347 > #21 0x00000000006b4454 in PortalCleanup (portal=0x29e2528) at portalcmds.c:299 > #22 0x0000000000a1c8ca in AtAbort_Portals () at portalmem.c:677 > #23 0x0000000000521b9b in AbortTransaction () at xact.c:2819 > #24 0x0000000000522753 in AbortCurrentTransaction () at xact.c:3332 > #25 0x00000000008fc43d in PostgresMain (argc=276, argv=0x2912038, > username=0x28f57f8 "gpadmin") at postgres.c:4469 > #26 0x000000000089f48a in BackendRun (port=0x28bde30) at postmaster.c:5844 > #27 0x000000000089e914 in BackendStartup (port=0x28bde30) at postmaster.c:5437 > #28 0x0000000000899032 in ServerLoop () at postmaster.c:2139 > #29 0x0000000000898108 in PostmasterMain (argc=9, argv=0x28a6130) at > postmaster.c:1431 > #30 0x00000000007b199a in main (argc=9, argv=0x28a6130) at main.c:226 > {code} > The reproduction steps are: > {code} > Step 1: Prepare schema and data using attached olap_setup.sql > Step 2: Run below OLAP grouping query > -- OLAP query involving MAX() function > SELECT sale.vn,sale.cn,sale.dt,GROUPING(sale.vn), > TO_CHAR(COALESCE(MAX(DISTINCT > floor(sale.vn+sale.qty)),0),'99999999.9999999'),TO_CHAR(COALESCE(VAR_SAMP(floor(sale.pn/sale.prc)),0),'99999999.9999999'),TO_CHAR(COALESCE(COUNT(floor(sale.qty+sale.prc)),0),'99999999.9999999') > FROM sale,customer,vendor > WHERE sale.cn=customer.cn AND sale.vn=vendor.vn > GROUP BY > ROLLUP((sale.prc),(sale.vn,sale.vn),(sale.pn,sale.pn),(sale.dt),(sale.qty,sale.vn,sale.qty)),ROLLUP((sale.pn),(sale.vn,sale.pn),(sale.qty)),(),sale.cn > HAVING COALESCE(VAR_POP(sale.cn),0) >= 45.5839785564113; > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)