[GitHub] spattewar commented on issue #2569: 1 million per second event processing using openwhisk ??
spattewar commented on issue #2569: 1 million per second event processing using openwhisk ?? URL: https://github.com/apache/incubator-openwhisk/issues/2569#issuecomment-320976933 @perryibm Perry very useful information. In our scenario it is not a burst of events but rather a continuous thing. Note that we are trying to handle the max scenario. So there could be 1M/second events happening through lot of devices which will then come to a openwhisk cluster, which will handle all of them. It is not clear at this point what different types of events would we have and how much processing for each type is required. there could be event that needs to be just transferred to kafka and further to internal database. Others might have some processing to do. So do you thing depending upon the system power and memory it is possible to setup an openwhisk cluster that can handle 1M/sec events? I am not sure how we can setup this cluster up but we are trying to gauge if openwhisk can support our scenario. thanks again for your time and help. regards This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] spattewar commented on issue #2569: 1 million per second event processing using openwhisk ??
spattewar commented on issue #2569: 1 million per second event processing using openwhisk ?? URL: https://github.com/apache/incubator-openwhisk/issues/2569#issuecomment-320083712 @perryibm thanks for your reponse. At this point in time we are still installing openwhisk locally and trying to run it and understand it. But scaling to that level is the goal. 1. Does this matter if I am able to spawn and run 1 million event handlers? so what time each one take to complete is not an issue as long as I can handle the events. On another note the job of the event handler is to just push the event to another kafka stream to be inserted in database. 2. This is important and I will make sure to check on this parameter 3. This could be true to some extent and again an important point to consider. All valuable points. Thank you. But is there a system limit on the number of event handlers that can be started? thanks This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] spattewar commented on issue #2569: 1 million per second event processing using openwhisk ??
spattewar commented on issue #2569: 1 million per second event processing using openwhisk ?? URL: https://github.com/apache/incubator-openwhisk/issues/2569#issuecomment-31019 @markusthoemmes thanks for the response. sure I will. But before that I would require some help with the limits and the number of openwhisks mentioned in my original question. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services