[jira] [Updated] (HAWQ-1547) Increase default table name length from 64 to 128 to match Hive

2017-11-10 Thread Grant Krieger (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Grant Krieger updated HAWQ-1547:

Description: 
Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h 
property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger 
than 64 by default without having to change this setting when compiling for 
downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
 ( 
rtlymth int, 
rtlyint)

STORED AS ORC

in Hawq

select * from 
hcatalog.default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

 ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
report   message   
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found)description   The server encountered an internal error 
that prevented it from fulfilling this request.exception   
javax.servlet.ServletException: 
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found) (libchurl.c:897)
  Position: 15
 Line: 1 

Thanks

Grant

  was:
Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h 
property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger 
than 64 by default without having to change this setting when compiling for 
downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
 ( 
rtlymth int, 
rtlyint)

STORED AS ORC

in Hawq

select * from 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
report   message   
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found)description   The server encountered an internal error 
that prevented it from fulfilling this request.exception   
javax.servlet.ServletException: 
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found) (libchurl.c:897)
  Position: 15

Thanks

Grant


> Increase default table name length from 64 to 128 to match Hive
> ---
>
> Key: HAWQ-1547
> URL: https://issues.apache.org/jira/browse/HAWQ-1547
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Unknown
>Reporter: Grant Krieger
>Assignee: Radar Lei
>
> Hi,
> Would it be possible to increase 
> incubator-hawq/src/include/pg_config_manual.h property default NAMEDATALEN 
> from 64 to 128. 
> This hopefully will allow one to be able to read Hive tables from Hawq larger 
> than 64 by default without having to change this setting when compiling for 
> downstream systems. It will also allow for equivalently name Hawq tables.
> Does anyone foresee performance challenges with the increase? 
> See problem below:
> In hive
> CREATE TABLE 
> default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
>  ( 
>   rtlymth int, 
>   rtlyint)
> STORED AS ORC
> in Hawq
> select * from 
> hcatalog.default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
>  ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
> report   message   
> NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
>  table not found)description   The server encountered an internal error 
> that prevented it from fulfilling this request.exception   
> javax.servlet.ServletException: 
> NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
>  table not found) (libchurl.c:897)
>   Position: 15
>  Line: 1 
> Thanks
> Grant



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (HAWQ-1547) Increase default table name length from 64 to 128 to match Hive

2017-11-10 Thread Grant Krieger (JIRA)
Grant Krieger created HAWQ-1547:
---

 Summary: Increase default table name length from 64 to 128 to 
match Hive
 Key: HAWQ-1547
 URL: https://issues.apache.org/jira/browse/HAWQ-1547
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: Unknown
Reporter: Grant Krieger
Assignee: Radar Lei


Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h 
property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger 
than 64 by default without having to change this setting when compiling for 
downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
 ( 
rtlymth int, 
rtlyint)

STORED AS ORC

in Hawq

select * from 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
report   message   
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found)description   The server encountered an internal error 
that prevented it from fulfilling this request.exception   
javax.servlet.ServletException: 
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found) (libchurl.c:897)
  Position: 15

Thanks

Grant



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HAWQ-1530) Illegally killing a JDBC select query causes locking problems

2017-11-08 Thread Grant Krieger (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245198#comment-16245198
 ] 

Grant Krieger commented on HAWQ-1530:
-

Hi Yi,

Thank you for the explanation. 

Regards

Grant

> Illegally killing a JDBC select query causes locking problems
> -
>
> Key: HAWQ-1530
> URL: https://issues.apache.org/jira/browse/HAWQ-1530
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Transaction
>Reporter: Grant Krieger
>Assignee: Yi Jin
> Fix For: 2.3.0.0-incubating
>
>
> Hi,
> When you perform a long running select statement on 2 hawq tables (join) from 
> JDBC and illegally kill the JDBC client (CTRL ALT DEL) before completion of 
> the query the 2 tables remained locked even when the query completes on the 
> server. 
> The lock is visible via PG_locks. One cannot kill the query via SELECT 
> pg_terminate_backend(393937). The only way to get rid of it is to kill -9 
> from linux or restart hawq but this can kill other things as well.
> The JDBC client I am using is Aqua Data Studio.
> I can provide exact steps to reproduce if required
> Thank you
> Grant 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (HAWQ-1530) Illegally killing a JDBC select query causes locking problems

2017-11-07 Thread Grant Krieger (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243416#comment-16243416
 ] 

Grant Krieger commented on HAWQ-1530:
-

Thanks for the help. If there is anything I can assist with from a testing 
perspective please advise

> Illegally killing a JDBC select query causes locking problems
> -
>
> Key: HAWQ-1530
> URL: https://issues.apache.org/jira/browse/HAWQ-1530
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Transaction
>Reporter: Grant Krieger
>Assignee: Yi Jin
> Fix For: 2.3.0.0-incubating
>
>
> Hi,
> When you perform a long running select statement on 2 hawq tables (join) from 
> JDBC and illegally kill the JDBC client (CTRL ALT DEL) before completion of 
> the query the 2 tables remained locked even when the query completes on the 
> server. 
> The lock is visible via PG_locks. One cannot kill the query via SELECT 
> pg_terminate_backend(393937). The only way to get rid of it is to kill -9 
> from linux or restart hawq but this can kill other things as well.
> The JDBC client I am using is Aqua Data Studio.
> I can provide exact steps to reproduce if required
> Thank you
> Grant 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Comment Edited] (HAWQ-1530) Illegally killing a JDBC select query causes locking problems

2017-11-03 Thread Grant Krieger (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237223#comment-16237223
 ] 

Grant Krieger edited comment on HAWQ-1530 at 11/3/17 7:51 AM:
--

Hi,

I think any JDBC client will do. Aqua should not be a must

Below is a test script which loads data then a test query. Please do this 
through JDBC only. Do not use psql. Problem is from JDBC only.

--- loading dummy data

DROP
  TABLE if EXISTS PUBLIC.test_prod_dim3;
CREATE
  TABLE PUBLIC.test_prod_dim3
  (
productid int4 NULL,
description text NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_prod_dim3
SELECT
  1   AS productid,
  '1 desc' AS description
FROM
  generate_series(1,1);
DROP
  TABLE if EXISTS PUBLIC.test_table_fact3;
CREATE
  TABLE PUBLIC.test_table_fact3
  (
productid int4 NULL,
value1 int4 NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_table_fact3
SELECT
  1 AS productid,
  1 AS value1
FROM
  generate_series(1,1);
  --End loading dummy data


  --Starting test query and kill it with CTRL ALT DEL (Do not just stop the 
query) before it finishes . (Test and kill from windows only) . You will notice 
query kills but lock on table is never released until reboot of server or kill 
-9
  
-- test query (This should be killed before completion)
SELECT
  *
FROM
  ( SELECT
  a.*,
  b.description
FROM
  PUBLIC.test_table_fact3 a
  JOIN PUBLIC.test_prod_dim3 b
  ON a.productid = b.productid ) AS q LIMIT 1;
-- end test query 

--Then in a new session try drop the table . Unable to do so as its locked and 
unable to free lock until restart of server

drop table public.test_prod_dim3;

select * from pg_stat_activity
where procpid = 335492

1075919 edw_performance3  335492  342   10gpadmin drop table 
public.test_prod_dim3
  true  2017/09/21 10:51:22 AM  2017/09/21 8:58:55 AM   10.1.3.201  61257   
2017/09/21
10:51:22 AM  false

select * from pg_locks
where pid = 335492

relation1075919 1710089 (null)  (null)  (null)  (null)  
(null)
 (null)  109830156   335492  AccessExclusiveLock false 342  
false -1
transactionid (null)  (null)  (null)  (null)  109830156   
(null) 
(null)  (null)  109830156   335492  ExclusiveLock true  342 
 false -1
relation1075919 1259  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 2608  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 1247  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1

Thank you



was (Author: ncsballie):
Hi,

I think any JDBC client will do. Aqua should not be a must

Below is a test script which loads data then a test query. Please do this 
through JDBC only. Do not use psql. Problem is from JDBC only.

--- loading dummy data

DROP
  TABLE if EXISTS PUBLIC.test_prod_dim3;
CREATE
  TABLE PUBLIC.test_prod_dim3
  (
productid int4 NULL,
description text NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_prod_dim3
SELECT
  1   AS productid,
  '1 desc' AS description
FROM
  generate_series(1,1);
DROP
  TABLE if EXISTS PUBLIC.test_table_fact3;
CREATE
  TABLE PUBLIC.test_table_fact3
  (
productid int4 NULL,
value1 int4 NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_table_fact3
SELECT
  1 AS productid,
  1 AS value1
FROM
  generate_series(1,1);
  --End loading dummy data


  --Starting test query and kill it with CTRL ALT DEL (Do not just stop the 
query) before it finishes . (Test and kill from windows only) . You will notice 
query kills but lock on table is never released until reboot of server or kill 
-9
  
-- test query (This should be killed before completion)
SELECT
  *
FROM
  ( SELECT
  a.*,
  

[jira] [Comment Edited] (HAWQ-1530) Illegally killing a JDBC select query causes locking problems

2017-11-03 Thread Grant Krieger (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237223#comment-16237223
 ] 

Grant Krieger edited comment on HAWQ-1530 at 11/3/17 7:47 AM:
--

Hi,

I think any JDBC client will do. Aqua should not be a must

Below is a test script which loads data then a test query. Please do this 
through JDBC only. Do not use psql. Problem is from JDBC only.

--- loading dummy data

DROP
  TABLE if EXISTS PUBLIC.test_prod_dim3;
CREATE
  TABLE PUBLIC.test_prod_dim3
  (
productid int4 NULL,
description text NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_prod_dim3
SELECT
  1   AS productid,
  '1 desc' AS description
FROM
  generate_series(1,1);
DROP
  TABLE if EXISTS PUBLIC.test_table_fact3;
CREATE
  TABLE PUBLIC.test_table_fact3
  (
productid int4 NULL,
value1 int4 NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_table_fact3
SELECT
  1 AS productid,
  1 AS value1
FROM
  generate_series(1,1);
  --End loading dummy data


  --Starting test query and kill it with CTRL ALT DEL (Do not just stop the 
query) before it finishes . (Test and kill from windows only) . You will notice 
query kills but lock on table is never released until reboot of server or kill 
-9
  
-- test query (This should be killed before completion)
SELECT
  *
FROM
  ( SELECT
  a.*,
  b.description
FROM
  PUBLIC.test_table_fact3 a
  JOIN PUBLIC.test_prod_dim3 b
  ON a.productid = b.productid ) AS q LIMIT 1;
-- end test query 

--Then in a new session

drop table public.test_prod_dim3;

select * from pg_stat_activity
where procpid = 335492

1075919 edw_performance3  335492  342   10gpadmin drop table 
public.test_prod_dim3
  true  2017/09/21 10:51:22 AM  2017/09/21 8:58:55 AM   10.1.3.201  61257   
2017/09/21
10:51:22 AM  false

select * from pg_locks
where pid = 335492

relation1075919 1710089 (null)  (null)  (null)  (null)  
(null)
 (null)  109830156   335492  AccessExclusiveLock false 342  
false -1
transactionid (null)  (null)  (null)  (null)  109830156   
(null) 
(null)  (null)  109830156   335492  ExclusiveLock true  342 
 false -1
relation1075919 1259  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 2608  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 1247  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1



was (Author: ncsballie):
Hi,

I think any JDBC client will do. Aqua should not be a must

Below is a test script which loads data then a test query. Please do this 
through JDBC only. Do not use psql. Problem is from JDBC only.

--- loading dummy data

DROP
  TABLE if EXISTS PUBLIC.test_prod_dim3;
CREATE
  TABLE PUBLIC.test_prod_dim3
  (
productid int4 NULL,
description text NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_prod_dim3
SELECT
  1   AS productid,
  '1 desc' AS description
FROM
  generate_series(1,1);
DROP
  TABLE if EXISTS PUBLIC.test_table_fact3;
CREATE
  TABLE PUBLIC.test_table_fact3
  (
productid int4 NULL,
value1 int4 NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_table_fact3
SELECT
  1 AS productid,
  1 AS value1
FROM
  generate_series(1,1);
  --End loading dummy data


  --Starting test query and kill it with CTRL ALT DEL before it finishes . 
(Test and kill from windows only) . You will notice query kills but lock on 
table is never released until reboot of server or kill -9
  
-- test query (This should be killed before completion)
SELECT
  *
FROM
  ( SELECT
  a.*,
  b.description
FROM
  PUBLIC.test_table_fact3 a
  JOIN PUBLIC.test_prod_dim3 b
   

[jira] [Comment Edited] (HAWQ-1530) Illegally killing a JDBC select query causes locking problems

2017-11-03 Thread Grant Krieger (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237223#comment-16237223
 ] 

Grant Krieger edited comment on HAWQ-1530 at 11/3/17 7:46 AM:
--

Hi,

I think any JDBC client will do. Aqua should not be a must

Below is a test script which loads data then a test query. Please do this 
through JDBC only. Do not use psql. Problem is from JDBC only.

--- loading dummy data

DROP
  TABLE if EXISTS PUBLIC.test_prod_dim3;
CREATE
  TABLE PUBLIC.test_prod_dim3
  (
productid int4 NULL,
description text NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_prod_dim3
SELECT
  1   AS productid,
  '1 desc' AS description
FROM
  generate_series(1,1);
DROP
  TABLE if EXISTS PUBLIC.test_table_fact3;
CREATE
  TABLE PUBLIC.test_table_fact3
  (
productid int4 NULL,
value1 int4 NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_table_fact3
SELECT
  1 AS productid,
  1 AS value1
FROM
  generate_series(1,1);
  --End loading dummy data


  --Starting test query and kill it with CTRL ALT DEL before it finishes . 
(Test and kill from windows only) . You will notice query kills but lock on 
table is never released until reboot of server or kill -9
  
-- test query (This should be killed before completion)
SELECT
  *
FROM
  ( SELECT
  a.*,
  b.description
FROM
  PUBLIC.test_table_fact3 a
  JOIN PUBLIC.test_prod_dim3 b
  ON a.productid = b.productid ) AS q LIMIT 1;
-- end test query 

--Then in a new session

drop table public.test_prod_dim3;

select * from pg_stat_activity
where procpid = 335492

1075919 edw_performance3  335492  342   10gpadmin drop table 
public.test_prod_dim3
  true  2017/09/21 10:51:22 AM  2017/09/21 8:58:55 AM   10.1.3.201  61257   
2017/09/21
10:51:22 AM  false

select * from pg_locks
where pid = 335492

relation1075919 1710089 (null)  (null)  (null)  (null)  
(null)
 (null)  109830156   335492  AccessExclusiveLock false 342  
false -1
transactionid (null)  (null)  (null)  (null)  109830156   
(null) 
(null)  (null)  109830156   335492  ExclusiveLock true  342 
 false -1
relation1075919 1259  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 2608  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 1247  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1



was (Author: ncsballie):
Hi,

Below is a test script which loads data then a test query. Please do this 
through JDBC only. Do not use psql. Problem is from JDBC only.

--- loading dummy data

DROP
  TABLE if EXISTS PUBLIC.test_prod_dim3;
CREATE
  TABLE PUBLIC.test_prod_dim3
  (
productid int4 NULL,
description text NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_prod_dim3
SELECT
  1   AS productid,
  '1 desc' AS description
FROM
  generate_series(1,1);
DROP
  TABLE if EXISTS PUBLIC.test_table_fact3;
CREATE
  TABLE PUBLIC.test_table_fact3
  (
productid int4 NULL,
value1 int4 NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_table_fact3
SELECT
  1 AS productid,
  1 AS value1
FROM
  generate_series(1,1);
  --End loading dummy data


  --Starting test query and kill it with CTRL ALT DEL before it finishes . 
(Test and kill from windows only) . You will notice query kills but lock on 
table is never released until reboot of server or kill -9
  
-- test query (This should be killed before completion)
SELECT
  *
FROM
  ( SELECT
  a.*,
  b.description
FROM
  PUBLIC.test_table_fact3 a
  JOIN PUBLIC.test_prod_dim3 b
  ON a.productid = b.productid ) AS q LIMIT 1;
-- end test query 


[jira] [Commented] (HAWQ-1530) Illegally killing a JDBC select query causes locking problems

2017-11-03 Thread Grant Krieger (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237223#comment-16237223
 ] 

Grant Krieger commented on HAWQ-1530:
-

Hi,

Below is a test script which loads data then a test query. Please do this 
through JDBC only. Do not use psql. Problem is from JDBC only.

--- loading dummy data

DROP
  TABLE if EXISTS PUBLIC.test_prod_dim3;
CREATE
  TABLE PUBLIC.test_prod_dim3
  (
productid int4 NULL,
description text NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_prod_dim3
SELECT
  1   AS productid,
  '1 desc' AS description
FROM
  generate_series(1,1);
DROP
  TABLE if EXISTS PUBLIC.test_table_fact3;
CREATE
  TABLE PUBLIC.test_table_fact3
  (
productid int4 NULL,
value1 int4 NULL
  )
  WITH
  (
APPENDONLY = TRUE,
COMPRESSTYPE = SNAPPY,
OIDS = FALSE
  )
  DISTRIBUTED RANDOMLY;
INSERT
INTO
  PUBLIC.test_table_fact3
SELECT
  1 AS productid,
  1 AS value1
FROM
  generate_series(1,1);
  --End loading dummy data


  --Starting test query and kill it with CTRL ALT DEL before it finishes . 
(Test and kill from windows only) . You will notice query kills but lock on 
table is never released until reboot of server or kill -9
  
-- test query (This should be killed before completion)
SELECT
  *
FROM
  ( SELECT
  a.*,
  b.description
FROM
  PUBLIC.test_table_fact3 a
  JOIN PUBLIC.test_prod_dim3 b
  ON a.productid = b.productid ) AS q LIMIT 1;
-- end test query 

--Then in a new session

drop table public.test_prod_dim3;

select * from pg_stat_activity
where procpid = 335492

1075919 edw_performance3  335492  342   10gpadmin drop table 
public.test_prod_dim3
  true  2017/09/21 10:51:22 AM  2017/09/21 8:58:55 AM   10.1.3.201  61257   
2017/09/21
10:51:22 AM  false

select * from pg_locks
where pid = 335492

relation1075919 1710089 (null)  (null)  (null)  (null)  
(null)
 (null)  109830156   335492  AccessExclusiveLock false 342  
false -1
transactionid (null)  (null)  (null)  (null)  109830156   
(null) 
(null)  (null)  109830156   335492  ExclusiveLock true  342 
 false -1
relation1075919 1259  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 2608  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1
relation1075919 1247  (null)  (null)  (null)  (null)  
(null) 
(null)  109830156   335492  RowExclusiveLock  true  342   false -1


> Illegally killing a JDBC select query causes locking problems
> -
>
> Key: HAWQ-1530
> URL: https://issues.apache.org/jira/browse/HAWQ-1530
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Transaction
>Reporter: Grant Krieger
>Assignee: Radar Lei
>Priority: Major
>
> Hi,
> When you perform a long running select statement on 2 hawq tables (join) from 
> JDBC and illegally kill the JDBC client (CTRL ALT DEL) before completion of 
> the query the 2 tables remained locked even when the query completes on the 
> server. 
> The lock is visible via PG_locks. One cannot kill the query via SELECT 
> pg_terminate_backend(393937). The only way to get rid of it is to kill -9 
> from linux or restart hawq but this can kill other things as well.
> The JDBC client I am using is Aqua Data Studio.
> I can provide exact steps to reproduce if required
> Thank you
> Grant 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (HAWQ-1530) Illegally killing a JDBC select query causes locking problems

2017-09-25 Thread Grant Krieger (JIRA)
Grant Krieger created HAWQ-1530:
---

 Summary: Illegally killing a JDBC select query causes locking 
problems
 Key: HAWQ-1530
 URL: https://issues.apache.org/jira/browse/HAWQ-1530
 Project: Apache HAWQ
  Issue Type: Bug
  Components: Transaction
Reporter: Grant Krieger
Assignee: Radar Lei


Hi,

When you perform a long running select statement on 2 hawq tables (join) from 
JDBC and illegally kill the JDBC client (CTRL ALT DEL) before completion of the 
query the 2 tables remained locked even when the query completes on the server. 

The lock is visible via PG_locks. One cannot kill the query via SELECT 
pg_terminate_backend(393937). The only way to get rid of it is to kill -9 from 
linux or restart hawq but this can kill other things as well.

The JDBC client I am using is Aqua Data Studio.

I can provide exact steps to reproduce if required

Thank you

Grant 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)