[ 
https://issues.apache.org/jira/browse/TRAFODION-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guo Heng updated TRAFODION-3236:
--------------------------------
    Description: 
In the code file: 
[core/sqf/src/tm/tm.cpp|https://github.com/apache/trafodion/pull/1748/commits/be7c999b5cc27c74c5b8004158a2aa18236dd6d9#diff-fc1bfd76bb5a88b2fbcd581c90968da9]

In the function definition of line 2788, there are two buffer definitions, 
la_recv_buffer and la_recv_buffer_ddl. Maybe we can avoid dynamically assigning 
la_recv_buffer_ddl. It is enough to use only la_recv_buffer, which simplifies 
the logic and reduces the heap pressure.

 

  was:
    DDL statement:
        CREATE TABLE DW_UNIFORM_USER_INFO_MM_YYYYMM_TEST005
        ( 
            USER_ID VARCHAR(128 CHARS) CHARACTER SET UTF8 COLLATE DEFAULT NO 
DEFAULT NOT NULL NOT DROPPABLE NOT SERIALIZED,
            CUST_ID VARCHAR(128 CHARS) CHARACTER SET UTF8 COLLATE DEFAULT 
DEFAULT NULL NOT SERIALIZED,
            PRODUCT_NO VARCHAR(128 CHARS) CHARACTER SET UTF8 COLLATE DEFAULT NO 
DEFAULT NOT NULL NOT DROPPABLE NOT SERIALIZED
          , COUNTY_ID VARCHAR(128 CHARS) CHARACTER SET UTF8 COLLATE DEFAULT NO 
DEFAULT NOT NULL NOT DROPPABLE NOT SERIALIZED
          , COUNTY_NAME VARCHAR(128 CHARS) CHARACTER SET UTF8 COLLATE DEFAULT 
NO DEFAULT NOT NULL NOT DROPPABLE NOT SERIALIZED
          , MONTH_ID VARCHAR(128 CHARS) CHARACTER SET UTF8 COLLATE DEFAULT NO 
DEFAULT NOT NULL NOT DROPPABLE NOT SERIALIZED
          , YYS VARCHAR(128 CHARS) CHARACTER SET UTF8 COLLATE DEFAULT NO 
DEFAULT NOT NULL NOT DROPPABLE NOT SERIALIZED
          , PRIMARY KEY (COUNTY_ID ASC, COUNTY_NAME ASC, PRODUCT_NO ASC, 
USER_ID ASC, YYS ASC, MONTH_ID ASC)
        )
       SALT USING 88 PARTITIONS on(COUNTY_ID, MONTH_ID, PRODUCT_NO,USER_ID);
       Execute this SQL in Trafci, and you can encounter the error:
                *** ERROR[29157] Server aborted abnormally or Connection timed 
out
                *** ERROR[29160] The message header was not long enough
                *** ERROR[29157] Server aborted abnormally or Connection timed 
out
                *** ERROR[29160] The message header was not long enough    
        and error message in mxosrvr log:
                2018-11-09 14:11:27,151, ERROR, SQL.HBase, Node Number: 0, CPU: 
0, PIN: 31813, Process Name: $Z000QYY,,,Java exception in file 
../executor/HBaseClient_JNI.cpp, line 600.
                2018-11-09 14:11:27,151, ERROR, SQL.HBase, Node Number: 0, CPU: 
0, PIN: 31813, Process Name: $Z000QYY,,,HBaseClient_JNI::create() error: 
java.io.IOException: createTable exception. 
                                                          Unable to create 
table TRAF_RSRVD_3:TRAFODION.SEABASE.DW_UNIFORM_USER_INFO_MM_YYYYMM_TEST005 
Reason: Create Table failed. Error is Unknown
 
        and error message in HBase log:
                2018-10-29 23:05:32,030 INFO  
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxnFactory: 
Accepted socket connection from /0:0:0:0:0:0:0:1:60268
                2018-10-29 23:05:32,036 INFO  
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.ZooKeeperServer: Client 
attempting to establish new session at /0:0:0:0:0:0:0:1:60268
                2018-10-29 23:05:32,038 INFO  [SyncThread:0] 
server.ZooKeeperServer: Established session 0x166c05abbc50009 with negotiated 
timeout 40000 for client /0:0:0:0:0:0:0:1:60268
                2018-10-29 23:05:33,253 WARN  
[NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] server.NIOServerCnxn: caught end of 
stream exception
                EndOfStreamException: Unable to read additional data from 
client sessionid 0x166c05abbc50009, likely client has closed socket
                        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
                        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
                        at java.lang.Thread.run(Thread.java:745)

 


> Create table failed due to an exception of java IO from HBase
> -------------------------------------------------------------
>
>                 Key: TRAFODION-3236
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-3236
>             Project: Apache Trafodion
>          Issue Type: Improvement
>          Components: dtm
>    Affects Versions: 2.2.0
>            Reporter: Guo Heng
>            Assignee: Guo Heng
>            Priority: Minor
>
> In the code file: 
> [core/sqf/src/tm/tm.cpp|https://github.com/apache/trafodion/pull/1748/commits/be7c999b5cc27c74c5b8004158a2aa18236dd6d9#diff-fc1bfd76bb5a88b2fbcd581c90968da9]
> In the function definition of line 2788, there are two buffer definitions, 
> la_recv_buffer and la_recv_buffer_ddl. Maybe we can avoid dynamically 
> assigning la_recv_buffer_ddl. It is enough to use only la_recv_buffer, which 
> simplifies the logic and reduces the heap pressure.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to