[ https://issues.apache.org/jira/browse/HAWQ-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15242093#comment-15242093 ]
ASF GitHub Bot commented on HAWQ-644: ------------------------------------- Github user kavinderd commented on the pull request: https://github.com/apache/incubator-hawq/pull/604#issuecomment-210194710 @ictmalili @ztao1987 Please review use of MessageContext for `dfs_address` in `RebuildNamespace` > Failure in security ha environment with certain writable external tables > ------------------------------------------------------------------------ > > Key: HAWQ-644 > URL: https://issues.apache.org/jira/browse/HAWQ-644 > Project: Apache HAWQ > Issue Type: Bug > Components: PXF, Security > Reporter: Goden Yao > Assignee: Goden Yao > > In a Secure HA environment: > Few tests which tests writable table fail due to empty dfs_address prior to > getting the delegation token in the segment. > On an initial investigation, the shared_path seems to not be set by the hawq > master. > Log from the specific segment. The hdfs path available in the segment is > empty and hence the failure. > {code} > 2016-04-08 22:53:11.034661 > UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 > 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG2","00000","PXF > received from configuration HA Namenode-1 having rpc-address > <ip-10-32-37-27.ore1.vpc.pivotal.io:8020> and rest-address > <ip-10-32-37-27.ore1.vpc.pivotal.io:50070>",,,,,"External table > readable_table, line 1 of > pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: > """"","INSERT INTO writable_table SELECT * FROM > readable_table;",0,,"ha_config.c",157, > 2016-04-08 22:53:11.034699 > UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 > 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG2","00000","PXF > received from configuration HA Namenode-2 having rpc-address > <ip-10-32-39-243.ore1.vpc.pivotal.io:8020> and rest-address > <ip-10-32-39-243.ore1.vpc.pivotal.io:50070>",,,,,"External table > readable_table, line 1 of > pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: > """"","INSERT INTO writable_table SELECT * FROM > readable_table;",0,,"ha_config.c",157, > 2016-04-08 22:53:11.034785 > UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 > 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG2","00000","locating > token for 0^N\",,,,,"External table readable_table, line 1 of > pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: > """"","INSERT INTO writable_table SELECT * FROM > readable_table;",0,,"gpbridgeapi.c",521, > 2016-04-08 22:53:11.034871 > UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 > 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"WARNING","01000","internal > error HdfsParsePath: no filesystem protocol found in path > ""0^N\^A""",,,,,"External table readable_table, line 1 of > pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: > """"","INSERT INTO writable_table SELECT * FROM > readable_table;",0,,"fd.c",2501, > 2016-04-08 22:53:11.035004 > UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 > 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"DEBUG1","00000","Deleted > entry for query (sessionid=73, commandcnt=43)",,,,,,"INSERT INTO > writable_table SELECT * FROM readable_table;",0,,"workfile_queryspace.c",329, > 2016-04-08 22:53:11.066243 > UTC,"gpadmin","pxfautomation",p337499,th1668020416,"10.32.37.27","34072",2016-04-08 > 22:52:25 UTC,37729,con73,cmd43,seg9,,,x37729,sx1,"ERROR","XX000","fail to > parse uri: 0^N\ (cdbfilesystemcredential.c:529)",,,,,"External table > readable_table, line 1 of > pxf://mycluster/tmp/pxf_automation_data/data?PROFILE=HdfsTextSimple: > """"","INSERT INTO writable_table SELECT * FROM > readable_table;",0,,"cdbfilesystemcredential.c",529,"Stack trace: > 1 0x871f8f postgres <symbol not found> + 0x871f8f > 2 0x872679 postgres elog_finish + 0xa9 > 3 0x99d7b8 postgres find_filesystem_credential_with_uri + 0x78 > 4 0x7fc935c8f5a2 pxf.so add_delegation_token + 0xa2 > 5 0x7fc935c8f9b2 pxf.so get_pxf_server + 0xe2 > 6 0x7fc935c8ff02 pxf.so gpbridge_export_start + 0x42 > 7 0x7fc935c90170 pxf.so gpbridge_export + 0x50 > 8 0x507eb8 postgres <symbol not found> + 0x507eb8 > 9 0x5083af postgres url_fwrite + 0x9f > 10 0x5042b4 postgres external_insert + 0x184 > 11 0x69dcca postgres ExecInsert + 0x1fa > 12 0x69d41c postgres ExecDML + 0x1ec > 13 0x65e185 postgres ExecProcNode + 0x3c5 > 14 0x659f4a postgres <symbol not found> + 0x659f4a > 15 0x65a8d3 postgres ExecutorRun + 0x4a3 > 16 0x7b550a postgres <symbol not found> + 0x7b550a > 17 0x7b5baf postgres <symbol not found> + 0x7b5baf > 18 0x7b6142 postgres PortalRun + 0x342 > 19 0x7b2c21 postgres PostgresMain + 0x3861 > 20 0x763ce3 postgres <symbol not found> + 0x763ce3 > 21 0x76443d postgres <symbol not found> + 0x76443d > 22 0x76626e postgres PostmasterMain + 0xc7e > 23 0x6c04ea postgres main + 0x48a > 24 0x7fc95f276d5d libc.so.6 __libc_start_main + 0xfd > 25 0x4a1489 postgres <symbol not found> + 0x4a1489 > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)