[jira] [Updated] (HAWQ-1547) Increase default table name length from 64 to 128 to match Hive

2017-11-10 Thread Grant Krieger (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Grant Krieger updated HAWQ-1547:

Description: 
Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h 
property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger 
than 64 by default without having to change this setting when compiling for 
downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
 ( 
rtlymth int, 
rtlyint)

STORED AS ORC

in Hawq

select * from 
hcatalog.default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

 ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
report   message   
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found)description   The server encountered an internal error 
that prevented it from fulfilling this request.exception   
javax.servlet.ServletException: 
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found) (libchurl.c:897)
  Position: 15
 Line: 1 

Thanks

Grant

  was:
Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h 
property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger 
than 64 by default without having to change this setting when compiling for 
downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
 ( 
rtlymth int, 
rtlyint)

STORED AS ORC

in Hawq

select * from 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
report   message   
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found)description   The server encountered an internal error 
that prevented it from fulfilling this request.exception   
javax.servlet.ServletException: 
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found) (libchurl.c:897)
  Position: 15

Thanks

Grant


> Increase default table name length from 64 to 128 to match Hive
> ---
>
> Key: HAWQ-1547
> URL: https://issues.apache.org/jira/browse/HAWQ-1547
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: Unknown
>Reporter: Grant Krieger
>Assignee: Radar Lei
>
> Hi,
> Would it be possible to increase 
> incubator-hawq/src/include/pg_config_manual.h property default NAMEDATALEN 
> from 64 to 128. 
> This hopefully will allow one to be able to read Hive tables from Hawq larger 
> than 64 by default without having to change this setting when compiling for 
> downstream systems. It will also allow for equivalently name Hawq tables.
> Does anyone foresee performance challenges with the increase? 
> See problem below:
> In hive
> CREATE TABLE 
> default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
>  ( 
>   rtlymth int, 
>   rtlyint)
> STORED AS ORC
> in Hawq
> select * from 
> hcatalog.default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
>  ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
> report   message   
> NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
>  table not found)description   The server encountered an internal error 
> that prevented it from fulfilling this request.exception   
> javax.servlet.ServletException: 
> NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
>  table not found) (libchurl.c:897)
>   Position: 15
>  Line: 1 
> Thanks
> Grant



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (HAWQ-1547) Increase default table name length from 64 to 128 to match Hive

2017-11-10 Thread Grant Krieger (JIRA)
Grant Krieger created HAWQ-1547:
---

 Summary: Increase default table name length from 64 to 128 to 
match Hive
 Key: HAWQ-1547
 URL: https://issues.apache.org/jira/browse/HAWQ-1547
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: Unknown
Reporter: Grant Krieger
Assignee: Radar Lei


Hi,

Would it be possible to increase incubator-hawq/src/include/pg_config_manual.h 
property default NAMEDATALEN from 64 to 128. 

This hopefully will allow one to be able to read Hive tables from Hawq larger 
than 64 by default without having to change this setting when compiling for 
downstream systems. It will also allow for equivalently name Hawq tables.

Does anyone foresee performance challenges with the increase? 

See problem below:

In hive

CREATE TABLE 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test
 ( 
rtlymth int, 
rtlyint)

STORED AS ORC

in Hawq

select * from 
default.test123456789123456789123456789123456789123456789123456789123456789123456789123456789test

ERROR: remote component error (500) from '127.0.0.1:51200':  type  Exception 
report   message   
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found)description   The server encountered an internal error 
that prevented it from fulfilling this request.exception   
javax.servlet.ServletException: 
NoSuchObjectException(message:default.test12345678912345678912345678912345678912345678912345678912345
 table not found) (libchurl.c:897)
  Position: 15

Thanks

Grant



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)