[
https://issues.apache.org/jira/browse/STREAMPIPES-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17443808#comment-17443808
]
Simon Bosse commented on STREAMPIPES-461:
-----------------------------------------
Hi, thanks for your answer.
I have tried it, I can make a curl request from the worker to the backend.
I have looked further in the logs and from what I can read out there I think
backend and worker do not have problems to communicate.
There are entries in the logs which happens before the one I posted in the
stacktrace.
>From the backend:
10:12:29.428 SP [http-nio-8030-exec-2] INFO o.a.s.c.c.m.m.WorkerRestClient -
Trying to start adapter on endpoint:
http://connect-worker-main:8098/api/v1/[email protected]/worker/stream/invoke
10:12:29.576 SP [http-nio-8030-exec-2] INFO o.a.s.c.c.m.m.WorkerRestClient -
Adapter started on endpoint:
http://connect-worker-main:8098/api/v1/[email protected]/worker/stream/invoke
with Response: {
"success" : true,
"elementName" : null,
"notifications" : [ {
"title" : "Stream adapter with id
http://backend:8030/streampipes-backend/api/v2/connect/[email protected]/master/sources/69f9ff51-f7f0-40b1-8948-20c76a269fa4
successfully started",
"description" : "",
"additionalInformation" : null
} ]
}
>From the worker:
10:12:29.573 SP [XNIO-1 task-4] INFO o.a.s.c.c.worker.rest.WorkerResource -
Stream adapter with id
http://backend:8030/streampipes-backend/api/v2/connect/[email protected]/master/sources/69f9ff51-f7f0-40b1-8948-20c76a269fa4
successfully started
So for me from the timestamps it looks like the backend makes a request to the
worker and then worker can successful start the adapter.
There is one thing I have found inside the zookeeper pods which happens also in
the same time:
2021-11-12 10:12:29,491 [myid:] - INFO [ProcessThread(sid:0
cport:2181)::PrepRequestProcessor@653] - Got user-level KeeperException when
processing sessionid:0x100434c21ce0000 type:setData cxid:0x12c zxid:0x9e
txntype:-1 reqpath:n/a Error Path:/config/topics/org.apache.
streampipes.connect.e16095f0-ec16-4a06-8862-6562b6cae284 Error:KeeperErrorCode
= NoNode for
/config/topics/org.apache.streampipes.connect.e16095f0-ec16-4a06-8862-6562b6cae284
I am not sure if there could be a correlation to this error
> 500 error if mqtt adapter is created
> ------------------------------------
>
> Key: STREAMPIPES-461
> URL: https://issues.apache.org/jira/browse/STREAMPIPES-461
> Project: StreamPipes
> Issue Type: Bug
> Reporter: Simon Bosse
> Priority: Major
>
> Hi,
> we are running streampipes Version 0.68 inside kubernetes. At the moment we
> have the problem that if a mqtt adapter is created after clicking on "Start
> adapter" the message "Please wait while your adapter is generated" keeps
> spinning. If I look at the requests in the browser I can see that there is a
> 500 error.
> If I open then streampipes in a new window under connect/adapters I can see
> the adapter but it is not shown in the pipeline editor.
> In the logs of the backend pod I see this 500 error. What can be the cause of
> this?
> 10:12:29.643 SP [http-nio-8030-exec-2] INFO
> o.a.s.c.c.m.m.AdapterMasterManagement - Start adapter
> 10:12:29.647 SP [http-nio-8030-exec-2] INFO
> o.a.s.c.c.m.m.AdapterMasterManagement - Install source (source URL:
> http://backend:8030/streampipes-backend/api/v2/connect/[email protected]/master/sources/69f9ff51-f7f0-40b1-8948-20c76a269fa4
> in backend over URL:
> http://backend:8030/streampipes-backend/api/v2/noauth/users/[email protected]/element
> 10:12:29.676 SP [http-nio-8030-exec-2] ERROR
> o.a.c.c.C.[.[.[.[.a.s.b.StreamPipesResourceConfig] - Servlet.service() for
> servlet [org.apache.streampipes.backend.StreamPipesResourceConfig] in context
> with path [/streampipes-backend] threw exception
> [javax.persistence.PersistenceException:
> javax.persistence.PersistenceException:
> javax.persistence.PersistenceException: java.lang.NullPointerException] with
> root cause
> java.lang.NullPointerException: null
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl$MergeCascade.cascade(EntityManagerImpl.java:530)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl$CascadeAction.test(EntityManagerImpl.java:580)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl.cascadeOperation(EntityManagerImpl.java:516)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl.persist(EntityManagerImpl.java:360)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl$MergeCascade.cascade(EntityManagerImpl.java:535)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl$CascadeAction.test(EntityManagerImpl.java:580)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl.cascadeOperation(EntityManagerImpl.java:516)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl.persist(EntityManagerImpl.java:360)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl$MergeCascade.cascade(EntityManagerImpl.java:535)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl$CascadeAction.test(EntityManagerImpl.java:584)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl.cascadeOperation(EntityManagerImpl.java:516)
> at
> io.fogsy.empire.core.empire.impl.EntityManagerImpl.persist(EntityManagerImpl.java:360)
> at
> org.apache.streampipes.storage.rdf4j.impl.PipelineElementStorageRequests.storeDataStream(PipelineElementStorageRequests.java:57)
> at
> org.apache.streampipes.storage.rdf4j.impl.PipelineElementInMemoryStorage.storeDataStream(PipelineElementInMemoryStorage.java:104)
> at
> org.apache.streampipes.manager.verification.DataStreamVerifier.store(DataStreamVerifier.java:51)
> at
> org.apache.streampipes.manager.verification.ElementVerifier.verifyAndAdd(ElementVerifier.java:100)
> at
> org.apache.streampipes.connect.container.master.management.AdapterMasterManagement.installDataSource(AdapterMasterManagement.java:125)
> at
> org.apache.streampipes.connect.container.master.management.AdapterMasterManagement.addAdapter(AdapterMasterManagement.java:118)
> at
> org.apache.streampipes.connect.container.master.rest.AdapterResource.addAdapter(AdapterResource.java:56)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)
> at
> org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$$Lambda$700/0x000000002406e8f0.invoke(Unknown
> Source)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167)
> at
> org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:176)
> at
> org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:475)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:397)
> at
> org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
> at
> org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:255)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
> at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
> at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
> at
> org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
> at
> org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:234)
> at
> org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:680)
> at
> org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
> at
> org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
> at
> org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:366)
> at
> org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:319)
> at
> org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
> at
> org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:61)
> at
> org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
> at
> org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
> at
> org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
> at
> org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
> at
> org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
> at
> org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
> at
> org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
> at
> org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
> at
> org.apache.shiro.web.servlet.AdviceFilter.executeChain(AdviceFilter.java:108)
> at
> org.apache.shiro.web.servlet.AdviceFilter.doFilterInternal(AdviceFilter.java:137)
> at
> org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
> at
> org.apache.shiro.web.servlet.ProxiedFilterChain.doFilter(ProxiedFilterChain.java:66)
> at
> org.apache.shiro.web.servlet.AbstractShiroFilter.executeChain(AbstractShiroFilter.java:450)
> at
> org.apache.shiro.web.servlet.AbstractShiroFilter$1.call(AbstractShiroFilter.java:365)
> at
> org.apache.shiro.subject.support.SubjectCallable.doCall(SubjectCallable.java:90)
> at
> org.apache.shiro.subject.support.SubjectCallable.call(SubjectCallable.java:83)
> at
> org.apache.shiro.subject.support.DelegatingSubject.execute(DelegatingSubject.java:387)
> at
> org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:362)
> at
> org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
> at
> org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
> at
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
> at
> org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
> at
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
> at
> org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
> at
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:542)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:143)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
> at
> org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:764)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
> at
> org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:374)
> at
> org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
> at
> org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:888)
> at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1597)
> at
> org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
> at java.lang.Thread.run(Thread.java:823)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
