[ 
https://issues.apache.org/jira/browse/STREAMPIPES-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368225#comment-17368225
 ] 

Simon Bosse commented on STREAMPIPES-388:
-----------------------------------------

There are errors regarding mysql in the pipeline-elements-all pod. 

The last packet successfully received from the server was 362,839 milliseconds 
ago.  The last packet sent successfully to the server was 362,844 milliseconds 
ago.
        at sun.reflect.GeneratedConstructorAccessor49.newInstance(Unknown 
Source)
        at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at 
com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
        at 
com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105)
        at 
com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151)
        at 
com.mysql.cj.exceptions.ExceptionFactory.createCommunicationsException(ExceptionFactory.java:167)
        at 
com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:562)
        at 
com.mysql.cj.protocol.a.NativeProtocol.checkErrorMessage(NativeProtocol.java:732)
        at 
com.mysql.cj.protocol.a.NativeProtocol.sendCommand(NativeProtocol.java:671)
        at 
com.mysql.cj.protocol.a.NativeProtocol.sendQueryPacket(NativeProtocol.java:986)
        at 
com.mysql.cj.protocol.a.NativeProtocol.sendQueryString(NativeProtocol.java:921)
        at com.mysql.cj.NativeSession.execSQL(NativeSession.java:1154)
        at 
com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:742)
        at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:666)
        at 
org.apache.streampipes.sinks.databases.jvm.mysql.Mysql.save(Mysql.java:155)
        ... 10 more
Caused by: java.io.EOFException: Can not read response from server. Expected to 
read 4 bytes, read 0 bytes before connection was unexpectedly lost.
        at 
com.mysql.cj.protocol.FullReadInputStream.readFully(FullReadInputStream.java:67)
        at 
com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:63)
        at 
com.mysql.cj.protocol.a.SimplePacketReader.readHeader(SimplePacketReader.java:45)
        at 
com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:52)
        at 
com.mysql.cj.protocol.a.TimeTrackingPacketReader.readHeader(TimeTrackingPacketReader.java:41)
        at 
com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:54)
        at 
com.mysql.cj.protocol.a.MultiPacketReader.readHeader(MultiPacketReader.java:44)
        at 
com.mysql.cj.protocol.a.NativeProtocol.readMessage(NativeProtocol.java:556)
        ... 18 more
java.sql.SQLNonTransientConnectionException: No operations allowed after 
connection closed.
        at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
        at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
        at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
        at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
        at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73)
        at 
com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:73)
        at 
com.mysql.cj.jdbc.ConnectionImpl.createStatement(ConnectionImpl.java:1094)
        at 
com.mysql.cj.jdbc.ConnectionImpl.createStatement(ConnectionImpl.java:1084)
        at 
org.apache.streampipes.sinks.databases.jvm.mysql.Mysql.save(Mysql.java:131)
        at 
org.apache.streampipes.sinks.databases.jvm.mysql.Mysql.onEvent(Mysql.java:70)
        at 
org.apache.streampipes.wrapper.standalone.runtime.StandaloneEventSinkRuntime.process(StandaloneEventSinkRuntime.java:50)
        at 
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.send(StandaloneSpInputCollector.java:54)
        at 
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.lambda$onEvent$0(StandaloneSpInputCollector.java:48)
        at 
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector$$Lambda$796/0x00000000e0348160.accept(Unknown
 Source)
        at 
java.util.concurrent.ConcurrentHashMap.forEach(ConcurrentHashMap.java:1597)
        at 
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.onEvent(StandaloneSpInputCollector.java:48)
        at 
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.onEvent(StandaloneSpInputCollector.java:29)
        at 
org.apache.streampipes.messaging.kafka.SpKafkaConsumer.run(SpKafkaConsumer.java:101)
        at java.lang.Thread.run(Thread.java:823)
Caused by: com.mysql.cj.exceptions.ConnectionIsClosedException: No operations 
allowed after connection closed.
        at sun.reflect.GeneratedConstructorAccessor46.newInstance(Unknown 
Source)
        at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at 
com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
        at 
com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105)
        at 
com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151)
        at com.mysql.cj.NativeSession.checkClosed(NativeSession.java:1263)
        at com.mysql.cj.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:575)
        at com.mysql.cj.jdbc.ConnectionImpl.createStatement(ConnectionImpl.java)
        ... 12 more
Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications 
link failure


> Pipeline stops writing data to mysql inside kubernetes 
> -------------------------------------------------------
>
>                 Key: STREAMPIPES-388
>                 URL: https://issues.apache.org/jira/browse/STREAMPIPES-388
>             Project: StreamPipes
>          Issue Type: Bug
>            Reporter: Simon Bosse
>            Priority: Major
>
> Hi,
> we are using streampipes in kubernetes where we have a mqtt broker in the 
> same namespace which is used in a pipeline together with a mysql sink.
> The pipeline works and data is written into the database but in the morning 
> around the same time there is no data written anymore into the database. If 
> the pipeline is manually restarted it works again. I looked in the logs of 
> the connect worker pod and I can see these kind of entries around the time 
> when the pipeline stops.
> 04:08:32.561 SP [kafka-admin-client-thread | adminclient-12] WARN 
> o.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-12] 
> Error connecting to node kafka:9092 (id: 1001 rack: null) 
>  java.net.UnknownHostException: kafka
>  at java.net.InetAddress.getAllByName0(InetAddress.java:1281)
>  at java.net.InetAddress.getAllByName(InetAddress.java:1193)
>  at java.net.InetAddress.getAllByName(InetAddress.java:1127)
>  at org.apache.kafka.clients.ClientUtils.resolve(ClientUtils.java:117)
>  at 
> org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.moveToNextAddress(ClusterConnectionStates.java:387)
>  at 
> org.apache.kafka.clients.ClusterConnectionStates.connecting(ClusterConnectionStates.java:121)
>  at 
> org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:917)
>  at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:287)
>  at 
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.sendEligibleCalls(KafkaAdminClient.java:904)
>  at 
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1119)
>  at java.lang.Thread.run(Thread.java:823)
>  
> I also looked in the logs of the kafka container but there are no entries at 
> this time.
> Do you know what could be the reason for this or how I can further debug it?
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to