Hi all,
I am fixing a Druid bug and is adding some integration test, but is blocked
by some integration test problems which I did not find any solution from
existing doc.
Since I do not have enough time to investigate these problems deeply, I am
writing this email for the purpose of hoping any of you could offer me some
help or suggestions.
The command to launch IT test I used is: mvn verify -P integration-tests
-Dit.test=ITIndexerTest -Ddocker.build.skip=true
l Problem 1. Druid nodes started in docker by integration test start very
slow. It took about 2-3 minutes until the nodes were ready to accept http
request from test. Following coordinator log shows that it took very long
during first 3 log lines. Other nodes were also the same.
Listening for transport dt_socket at address: 5006
2021-02-23T10:28:22,874 INFO [main]
org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator
5.2.5.Final
2021-02-23T10:29:19,442 WARN [main] org.apache.hadoop.util.NativeCodeLoader -
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
2021-02-23T10:29:42,797 INFO [main] org.apache.curator.utils.Compatibility -
Running in ZooKeeper 3.4.x compatibility mode
2021-02-23T10:29:42,839 INFO [main] org.apache.curator.utils.Compatibility -
Using emulated InjectSessionExpiration
2021-02-23T10:29:47,396 INFO [main]
org.apache.druid.server.emitter.EmitterModule - Using emitter [NoopEmitter{}]
for metrics and alerts, with dimensions [{version=0.21.0-SNAPSHOT}].
This problem greatly causes long time to wait for execution of a test. The
problem also exists when the nodes are started by manually executing
docker-compose -f docker-compose.yml command.
l Problem 2. There are lots of stack trace messages on the console showing
that “Unable to canonicalize address 127.0.0.1/<unresolved>:2181 because it's
not resolvable”
2021-02-23T10:31:43,722 WARN [main-SendThread(127.0.0.1:2181)]
org.apache.zookeeper.ClientCnxn - Session 0x0 for server
127.0.0.1/<unresolved>:2181, unexpected error, closing socket connection and
attempting reconnect
java.lang.IllegalArgumentException: Unable to canonicalize address
127.0.0.1/<unresolved>:2181 because it's not resolvable
at
org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:65)
~[zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
at
org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:41)
~[zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
at
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1001)
~[zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[zookeeper-3.4.14.jar:3.4.14-4c25d480e66aadd371de8bd2fd8da255ac140bcf]
What happened and how to solve it so that the console is clean enough for me to
find the real exception thrown by IT test ?
l Problem 3. Since my test failed, I wanted to check task logs to dig out what
happed. But I did not find task logs in docker so I tried to visit router at
http://localhost:8888 to see if task log could be found in 'Ingestion Tab' ,
but router requires username and password to authenticate. So, what is the
username and password to access router web page ?
l Problem 4. How to starts and debug an integration test in IntelliJ ? I
tried, but it showed in console saying
com.google.inject.ProvisionException: Unable to provision, see the following
errors:
1) Error in custom provider, java.lang.NullPointerException: must specify a
trustStorePath
It seems that some configurations are missing to start the test in
IntelliJ.
Any help or response from you is greatly appreciated.
