Hi Mithun Bhattacharya wrote:
Do you really need a webserver which is providing a blocking service ?
yes, this is a prediction server, which would be deployed in PROD environment, the client application would request the prediction server for results as scores. You can think it as online recommendation systems.
regards.