Thanks Uwe!
Hi guys, Ishan,
When I tryied to build the RC1 for branch_8_1. I did see this failure on
test HttpPartitionWithTlogReplicasTest
215685 ERROR
(updateExecutor-537-thread-1-processing-x:collDoRecoveryOnRestart_shard1_replica_t1
r:core_node3 null n:127.0.0.1:55000_t_ayt%2Fs c:collDoRecoveryOnRestart
s:shard1) [n:127.0.0.1:55000_t_ayt%2Fs c:collDoRecoveryOnRestart s:shard1
r:core_node3 x:collDoRecoveryOnRestart_shard1_replica_t1]
o.a.s.u.ErrorReportingConcurrentUpdateSolrClient Error when calling
SolrCmdDistributor$Req: cmd=add{,id=(null)}; node=StdNode:
http://127.0.0.1:54997/t_ayt/s/collDoRecoveryOnRestart_shard1_replica_t2/
to http://127.0.0.1:54997/t_ayt/s/collDoRecoveryOnRestart_shard1_replica_t2/
=> java.io.IOException: java.net.ConnectException: Connection
refused
at
org.eclipse.jetty.client.util.DeferredContentProvider.flush(DeferredContentProvider.java:193)
java.io.IOException: java.net.ConnectException: Connection refused
at
org.eclipse.jetty.client.util.DeferredContentProvider.flush(DeferredContentProvider.java:193)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.flush(OutputStreamContentProvider.java:152)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.write(OutputStreamContentProvider.java:146)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:216)
~[java/:?]
at
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:209)
~[java/:?]
at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:169)
~[java/:?]
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.marshal(JavaBinUpdateRequestCodec.java:102)
~[java/:?]
at
org.apache.solr.client.solrj.impl.BinaryRequestWriter.write(BinaryRequestWriter.java:83)
~[java/:?]
at
org.apache.solr.client.solrj.impl.Http2SolrClient.send(Http2SolrClient.java:337)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:231)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176)
~[java/:?]
at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:181)
~[metrics-core-4.0.5.jar:4.0.5]
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
~[java/:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_191]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_191]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
Suppressed: java.io.IOException: java.net.ConnectException: Connection
refused
at
org.eclipse.jetty.client.util.DeferredContentProvider.flush(DeferredContentProvider.java:193)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.flush(OutputStreamContentProvider.java:152)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.write(OutputStreamContentProvider.java:146)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:216)
~[java/:?]
at
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:209)
~[java/:?]
at org.apache.solr.common.util.JavaBinCodec.close(JavaBinCodec.java:1261)
~[java/:?]
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.marshal(JavaBinUpdateRequestCodec.java:103)
~[java/:?]
at
org.apache.solr.client.solrj.impl.BinaryRequestWriter.write(BinaryRequestWriter.java:83)
~[java/:?]
at
org.apache.solr.client.solrj.impl.Http2SolrClient.send(Http2SolrClient.java:337)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:231)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176)
~[java/:?]
at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:181)
~[metrics-core-4.0.5.jar:4.0.5]
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
~[java/:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_191]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_191]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0_191]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
~[?:1.8.0_191]
at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) ~[?:1.8.0_191]
at org.eclipse.jetty.http2.client.HTTP2Client.connect(HTTP2Client.java:397)
~[http2-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:146)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:141)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at org.eclipse.jetty.client.HttpClient$1.connect(HttpClient.java:619)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:596)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:589)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.util.SocketAddressResolver$Async.lambda$resolve$1(SocketAddressResolver.java:181)
~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
... 4 more
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0_191]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
~[?:1.8.0_191]
at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) ~[?:1.8.0_191]
at org.eclipse.jetty.http2.client.HTTP2Client.connect(HTTP2Client.java:397)
~[http2-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:146)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:141)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at org.eclipse.jetty.client.HttpClient$1.connect(HttpClient.java:619)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:596)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:589)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.util.SocketAddressResolver$Async.lambda$resolve$1(SocketAddressResolver.java:181)
~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
... 4 more
215686 INFO (qtp175924403-2361) [n:127.0.0.1:55000_t_ayt%2Fs
c:collDoRecoveryOnRestart s:shard1 r:core_node3
x:collDoRecoveryOnRestart_shard1_replica_t1] o.a.s.u.SolrCmdDistributor
SolrCmdDistributor found 1 errors
215686 WARN (qtp175924403-2361) [n:127.0.0.1:55000_t_ayt%2Fs
c:collDoRecoveryOnRestart s:shard1 r:core_node3
x:collDoRecoveryOnRestart_shard1_replica_t1]
o.a.s.u.p.DistributedZkUpdateProcessor Error sending update to
http://127.0.0.1:54997/t_ayt/s
=> java.io.IOException: java.net.ConnectException: Connection
refused
at
org.eclipse.jetty.client.util.DeferredContentProvider.flush(DeferredContentProvider.java:193)
java.io.IOException: java.net.ConnectException: Connection refused
at
org.eclipse.jetty.client.util.DeferredContentProvider.flush(DeferredContentProvider.java:193)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.flush(OutputStreamContentProvider.java:152)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.write(OutputStreamContentProvider.java:146)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:216)
~[java/:?]
at
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:209)
~[java/:?]
at org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:169)
~[java/:?]
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.marshal(JavaBinUpdateRequestCodec.java:102)
~[java/:?]
at
org.apache.solr.client.solrj.impl.BinaryRequestWriter.write(BinaryRequestWriter.java:83)
~[java/:?]
at
org.apache.solr.client.solrj.impl.Http2SolrClient.send(Http2SolrClient.java:337)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:231)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176)
~[java/:?]
at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:181)
~[metrics-core-4.0.5.jar:4.0.5]
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
~[java/:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_191]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_191]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
Suppressed: java.io.IOException: java.net.ConnectException: Connection
refused
at
org.eclipse.jetty.client.util.DeferredContentProvider.flush(DeferredContentProvider.java:193)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.flush(OutputStreamContentProvider.java:152)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.client.util.OutputStreamContentProvider$DeferredOutputStream.write(OutputStreamContentProvider.java:146)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:216)
~[java/:?]
at
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:209)
~[java/:?]
at org.apache.solr.common.util.JavaBinCodec.close(JavaBinCodec.java:1261)
~[java/:?]
at
org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec.marshal(JavaBinUpdateRequestCodec.java:103)
~[java/:?]
at
org.apache.solr.client.solrj.impl.BinaryRequestWriter.write(BinaryRequestWriter.java:83)
~[java/:?]
at
org.apache.solr.client.solrj.impl.Http2SolrClient.send(Http2SolrClient.java:337)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.sendUpdateStream(ConcurrentUpdateHttp2SolrClient.java:231)
~[java/:?]
at
org.apache.solr.client.solrj.impl.ConcurrentUpdateHttp2SolrClient$Runner.run(ConcurrentUpdateHttp2SolrClient.java:176)
~[java/:?]
at
com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:181)
~[metrics-core-4.0.5.jar:4.0.5]
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
~[java/:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_191]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_191]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0_191]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
~[?:1.8.0_191]
at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) ~[?:1.8.0_191]
at org.eclipse.jetty.http2.client.HTTP2Client.connect(HTTP2Client.java:397)
~[http2-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:146)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:141)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at org.eclipse.jetty.client.HttpClient$1.connect(HttpClient.java:619)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:596)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:589)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.util.SocketAddressResolver$Async.lambda$resolve$1(SocketAddressResolver.java:181)
~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
... 4 more
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0_191]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
~[?:1.8.0_191]
at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) ~[?:1.8.0_191]
at org.eclipse.jetty.http2.client.HTTP2Client.connect(HTTP2Client.java:397)
~[http2-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:146)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:141)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at org.eclipse.jetty.client.HttpClient$1.connect(HttpClient.java:619)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:596)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:589)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.util.SocketAddressResolver$Async.lambda$resolve$1(SocketAddressResolver.java:181)
~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
... 4 more
215690 ERROR (qtp175924403-2361) [n:127.0.0.1:55000_t_ayt%2Fs
c:collDoRecoveryOnRestart s:shard1 r:core_node3
x:collDoRecoveryOnRestart_shard1_replica_t1]
o.a.s.u.p.DistributedZkUpdateProcessor Setting up to try to start recovery
on replica core_node4 with url
http://127.0.0.1:54997/t_ayt/s/collDoRecoveryOnRestart_shard1_replica_t2/
by increasing leader term
=> java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[?:1.8.0_191]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
~[?:1.8.0_191]
at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:111) ~[?:1.8.0_191]
at org.eclipse.jetty.http2.client.HTTP2Client.connect(HTTP2Client.java:397)
~[http2-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:146)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at
org.eclipse.jetty.http2.client.http.HttpClientTransportOverHTTP2.connect(HttpClientTransportOverHTTP2.java:141)
~[http2-http-client-transport-9.4.19.v20190610.jar:9.4.19.v20190610]
at org.eclipse.jetty.client.HttpClient$1.connect(HttpClient.java:619)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:596)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at org.eclipse.jetty.client.HttpClient$1.succeeded(HttpClient.java:589)
~[jetty-client-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.eclipse.jetty.util.SocketAddressResolver$Async.lambda$resolve$1(SocketAddressResolver.java:181)
~[jetty-util-9.4.14.v20181114.jar:9.4.14.v20181114]
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
~[java/:?]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_191]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_191]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191]
215690 INFO (qtp175924403-2361) [n:127.0.0.1:55000_t_ayt%2Fs
c:collDoRecoveryOnRestart s:shard1 r:core_node3
x:collDoRecoveryOnRestart_shard1_replica_t1] o.a.s.c.ZkShardTerms
Successful update of terms at
/collections/collDoRecoveryOnRestart/terms/shard1 to
Terms{values={core_node3=2, core_node4=1}, version=3}
This seems relates to the fix for SOLR-13413 when only
http2-http-client-transport
get upgraded to 9.4.19. The similar failure does not happen in branch_8x or
master. I tried to switch back http2-http-client-transport 9.4.14 and the
problem seems go away. So there are 2 solutions now for 8.1.2
1. 8.1.2 will be released without SOLR-13413.
2. upgrade Jetty to 9.4.19 for 8.1.2 release.
I personally prefer the second option since there are no (or I think so)
suspicious failures on master and branch_8x. What do you guys think?
Thanks!
On Thu, Jul 4, 2019 at 12:48 PM Uwe Schindler <u...@thetaphi.de> wrote:
> No,
>
> Running with Java 9 is optional. You have to tell smoker to do this,
> otherwise it enforces Java 8 only.
>
> Uwe
>
> Am July 4, 2019 2:22:40 AM UTC schrieb "Đạt Cao Mạnh" <
> caomanhdat...@gmail.com>:
>>
>> Thanks Uwe, Steve
>>
>> I'm not familiar with the pipeline of smoker-release but I assumpt that
>> the same pipeline will be run during release process in my machine and
>> anyone who do the vote. So It won't be a blocker for this release and I can
>> continue with the release process, is that correct?
>>
>
> --
> Uwe Schindler
> Achterdiek 19, 28357 Bremen
> https://www.thetaphi.de
>
--
*Best regards,*
*Cao Mạnh Đạt*
*E-mail: caomanhdat...@gmail.com <caomanhdat...@gmail.com>*
