Hi!!
We are facing some errors trying to insert multiple records into the
database through the Java API.
We have a simple cluster composed of 1 master node and 1 slave node. 1
table with 1 bigint primary key and 1 string. The String length is more or
less 30 characters. The table has a replication of 2.
We are using 0.8 on both the cluster and java API and performing Manual
Flush mode with a maximum of 10.000 rows per flush (it is only a maximum,
not all flush operations insert the same amount of data).
After 2 or 3 successful flushes (more or less 6000 records) we are
receiving the error attached to this email.
We started receiving this error a few weeks ago, when we were using the
0.7.1 version.
Did this happen to other people? any ideas on what can be wrong? Any help
would be appreciated.
If you need more info let me know.
Thanks, Juan Pablo.
--
*Juan Pablo Briganti* | Data Architect
*GLOBANT* | AR: +54 11 4109 1700 ext. 19508 | US: +1 877 215 5230 ext. 19508
|
[image: Facebook] <https://www.facebook.com/Globant> [image: Twitter]
<http://www.twitter.com/globant> [image: Youtube]
<http://www.youtube.com/Globant> [image: Linkedin]
<http://www.linkedin.com/company/globant> [image: Pinterest]
<http://pinterest.com/globant/> [image: Globant] <http://www.globant.com>
--
The information contained in this e-mail may be confidential. It has been
sent for the sole use of the intended recipient(s). If the reader of this
message is not an intended recipient, you are hereby notified that any
unauthorized review, use, disclosure, dissemination, distribution or
copying of this communication, or any of its contents,
is strictly prohibited. If you have received it by mistake please let us
know by e-mail immediately and delete it from your system. Many thanks.
La información contenida en este mensaje puede ser confidencial. Ha sido
enviada para el uso exclusivo del destinatario(s) previsto. Si el lector de
este mensaje no fuera el destinatario previsto, por el presente queda Ud.
notificado que cualquier lectura, uso, publicación, diseminación,
distribución o copiado de esta comunicación o su contenido está
estrictamente prohibido. En caso de que Ud. hubiera recibido este mensaje
por error le agradeceremos notificarnos por e-mail inmediatamente y
eliminarlo de su sistema. Muchas gracias.
16/04/26 10:50:52 ERROR client.TabletClient: [Peer
f7e2936b040d4c58b52d90ae50ad6d5a] Unexpected exception from downstream on [id:
0x323019c2, /10.0.6.6:58930 => /10.0.6.157:7050]
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:64)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at
org.kududb.client.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at
org.kududb.client.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
16/04/26 10:50:52 INFO client.AsyncKuduClient: Removing server
f7e2936b040d4c58b52d90ae50ad6d5a from this tablet's cache
9d66b0bb6019492daca0a607fb0bd64b
16/04/26 10:50:52 ERROR storage.JsonEventDAO: An error ocurred trying to flush
current session
com.stumbleupon.async.DeferredGroupException: At least one of the Deferreds
failed, first exception:
at com.stumbleupon.async.DeferredGroup.done(DeferredGroup.java:169)
at
com.stumbleupon.async.DeferredGroup.recordCompletion(DeferredGroup.java:142)
at com.stumbleupon.async.DeferredGroup.access$000(DeferredGroup.java:36)
at
com.stumbleupon.async.DeferredGroup$1Notify.call(DeferredGroup.java:82)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1278)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1257)
at com.stumbleupon.async.Deferred.access$300(Deferred.java:430)
at com.stumbleupon.async.Deferred$Continue.call(Deferred.java:1366)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1278)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1257)
at com.stumbleupon.async.Deferred.callback(Deferred.java:1005)
at org.kududb.client.KuduRpc.handleCallback(KuduRpc.java:179)
at org.kududb.client.KuduRpc.errback(KuduRpc.java:199)
at
org.kududb.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:939)
at
org.kududb.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:1131)
at
org.kududb.client.AsyncKuduClient.handleRetryableError(AsyncKuduClient.java:1116)
at
org.kududb.client.AsyncKuduClient.handleTabletNotFound(AsyncKuduClient.java:1102)
at org.kududb.client.TabletClient.failOrRetryRpc(TabletClient.java:673)
at org.kududb.client.TabletClient.cleanup(TabletClient.java:635)
at
org.kududb.client.TabletClient.channelDisconnected(TabletClient.java:609)
at
org.kududb.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102)
at org.kududb.client.TabletClient.handleUpstream(TabletClient.java:601)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at
org.kududb.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.channelDisconnected(SimpleChannelUpstreamHandler.java:208)
at
org.kududb.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at
org.kududb.client.AsyncKuduClient$TabletClientPipeline.sendUpstream(AsyncKuduClient.java:1649)
at
org.kududb.client.shaded.org.jboss.netty.channel.Channels.fireChannelDisconnected(Channels.java:396)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.close(AbstractNioWorker.java:360)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipelineSink.java:58)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendDownstream(DefaultChannelPipeline.java:574)
at
org.kududb.client.AsyncKuduClient$TabletClientPipeline.sendDownstream(AsyncKuduClient.java:1641)
at
org.kududb.client.shaded.org.jboss.netty.channel.Channels.close(Channels.java:812)
at org.kududb.client.TabletClient.exceptionCaught(TabletClient.java:696)
at
org.kududb.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112)
at org.kududb.client.TabletClient.handleUpstream(TabletClient.java:601)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at
org.kududb.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.exceptionCaught(SimpleChannelUpstreamHandler.java:153)
at
org.kududb.client.shaded.org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:112)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at
org.kududb.client.shaded.org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at
org.kududb.client.AsyncKuduClient$TabletClientPipeline.sendUpstream(AsyncKuduClient.java:1649)
at
org.kududb.client.shaded.org.jboss.netty.channel.Channels.fireExceptionCaught(Channels.java:525)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:74)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at
org.kududb.client.shaded.org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at
org.kududb.client.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at
org.kududb.client.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.kududb.client.NonRecoverableException: Too many attempts:
KuduRpc(method=Write, tablet=9d66b0bb6019492daca0a607fb0bd64b, attempt=8,
DeadlineTracker(timeout=10000, elapsed=6289), Deferred@608776154(state=PENDING,
result=null, callback=apply batch response -> callback: mark tablet
9d66b0bb6019492daca0a607fb0bd64b inflight done -> (continuation of
Deferred@544649099 after retry RPC@1702110689) -> (continuation of
Deferred@956406952 after retry RPC@1415267245) -> (continuation of
Deferred@690509936 after retry RPC@756533645) -> (continuation of
Deferred@1348564629 after retry RPC@1415510081), errback=apply batch error
response -> errback: mark tablet 9d66b0bb6019492daca0a607fb0bd64b inflight done
-> (continuation of Deferred@544649099 after retry RPC@1702110689) ->
(continuation of Deferred@956406952 after retry RPC@1415267245) ->
(continuation of Deferred@690509936 after retry RPC@756533645) -> (continuation
of Deferred@1348564629 after retry RPC@1415510081)))
at
org.kududb.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:938)
... 42 more
Caused by: org.kududb.client.ConnectionResetException: [Peer
f7e2936b040d4c58b52d90ae50ad6d5a] Connection reset on [id: 0x323019c2,
/10.0.6.6:58930 :> /10.0.6.157:7050]
at org.kududb.client.TabletClient.cleanup(T
