Philip Zeyliger has posted comments on this change. ( http://gerrit.cloudera.org:8080/11113 )
Change subject: IMPALA-7390: Pin rpc-mgr-kerberized-test to localhost. ...................................................................... Patch Set 1: (1 comment) http://gerrit.cloudera.org:8080/#/c/11113/1//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/11113/1//COMMIT_MSG@11 PS1, Line 11: failing due to DNS resolution reasons > Does it mean in general, to run Impala with docker, one has to specify the test-with-docker creates an /etc/hosts file that looks like: 127.0.0.1 localhost <dockercontainerhostname> That's happening because of a workaround: # Update /etc/hosts to remove the entry for the unique docker hostname, # and instead point it to 127.0.0.1. Otherwise, HttpFS returns Location: # redirects to said hostname, but the relevant datanode isn't listening # on the wildcard address. sed -e /$(hostname)/d /etc/hosts -e /127.0.0.1/s,localhost,"localhost $(hostname)," \ > /tmp/hosts Kerberos decides the hostname is dockercontainerhostname, but the IP is 127.0.0.1, and then when it looks up the reverse, it finds localhost. Interestingly, if I swap the order in /etc/hosts, this test passes, but a different test fails. (thrift-server-test, if I recall correctly.) All that to say, this is quite specific to the way test-with-docker is working (and the way we configure our minicluster). A user genuinely using docker probably would be doing different hostname anyway. The workaround above exists because tests that use webhdfs (e.g., metadata.test_ddl.TestDdlStatements.test_drop_table_with_purge) end up getting the wrong addresses. I'm going to take a little bit more of a look about why WebHDFS is different in this docker environment than not, but I don't want to go down too deep a rabbit hole there. I'll report back if I figure it out, and otherwise I'll just update the comments here a bit. -- To view, visit http://gerrit.cloudera.org:8080/11113 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I91003cbc86177feb7f99563f61297f7da7fabab4 Gerrit-Change-Number: 11113 Gerrit-PatchSet: 1 Gerrit-Owner: Philip Zeyliger <phi...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Michael Ho <k...@cloudera.com> Gerrit-Reviewer: Philip Zeyliger <phi...@cloudera.com> Gerrit-Reviewer: Sailesh Mukil <sail...@cloudera.com> Gerrit-Comment-Date: Fri, 03 Aug 2018 21:14:50 +0000 Gerrit-HasComments: Yes
