Re: Session state in cluster HandleHttpRequest and HandleHttpReponse

2020-06-30 Thread Jeremy Pemberton-Pigott
Thanks Peter that makes sense. I'll try a wait/notify using an identifier for the node in the Spark messages being monitored so that the same node will receive the reply from Spark and respond to the client that initiated the connection. Regards, Jeremy On 30 Jun 2020, at 22:41, Peter Turcs

Re: Session state in cluster HandleHttpRequest and HandleHttpReponse

2020-06-30 Thread Peter Turcsanyi
Hi Jeremy, I don't think you can accept the request in one node and send back the response from another node. There is an open HTTP connection between the client and the NiFi node while the HandleHttpRequest -> ... -> HandleHttpResponse flow is running. Even if we passed the request/response conte

Session state in cluster HandleHttpRequest and HandleHttpReponse

2020-06-29 Thread Jeremy Pemberton-Pigott
Hi, I have a cluster of 3 nodes and the incoming request on one node's HandleHttpRequest may be replied to by a different node's HandleHttpResponse, in between there is a Spark streaming job process. Is there any example how to do that, maybe with DistributeMapCacheService? So that I can still r