Both siege and wrk are fine to test at least 300-500 concurrent users. I prefer siege as it is more similar to real traffic - wrk reuses connections, siege opens new one for each request. Wrk usually shows higher rate than siege.
Consumer switches and routers are often getting saturated very fast, especially WiFi ones, so you need to either start both siege and server on two vps'/servers or start them on a two local boxes connected p2p by cross ethernet cable. When you use two Vps expect 'Longest transaction' field in siege output to be very big, like 10-15 seconds. This is usually not fault of your app, it's due to routing and other network things. Just make sure both Shortest transaction and Transaction rate are low enough. As a first approximation you can start both siege and server on the same box, even development one. This would show the most basic errors related to concurrency and give insights on the early problems with memory consumption, cpu and overall performance. If you need to do real testing, you need to run long (at least a few hours for each run, depending on the app) series of tests with increasing concurrent users number using two or more servers and find the rate when you either begin getting Failed transactions or Transaction rate stops growing up. Make sure you actually test your app but not a switch or connection limits. Open top and iostat to monitor cpu and storage load on the server. The app should be started in production mode, as in debug mode it recompiles changed modules on each request. Some things, like different IP addresses and HTTP headers are hard to test, so if you expect these things can affect performance of your app, you need to either modify the app to use random data instead of actual client data or use specially crafted test suites like Tsung. Or both. Of course most these things are obvious, but this is what I think of when I do tests. воскресенье, 19 октября 2014 г., 10:27:33 UTC+4 пользователь James L написал: > > Which tools would you use for the benchmark on CB and how do you tests > with more than 100 concurrent users with either Siege or Wrk? > -- You received this message because you are subscribed to the Google Groups "ChicagoBoss" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. Visit this group at http://groups.google.com/group/chicagoboss. To view this discussion on the web visit https://groups.google.com/d/msgid/chicagoboss/0ffb70a7-394f-4386-8a90-402618727e49%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
