Github user Parth-Brahmbhatt commented on the pull request:
https://github.com/apache/storm/pull/392#issuecomment-71706395
I did not know we only stored 10 errors, makes sense to not go with
pagination if its hardcoded to 10. I will take a look at the complete PR today.
Not to derail the discussion but personally, I would much rather not store
errors in zk at all if its just for rendering the errors in UI. If the
spouts/bolts could just store this in memory with some expiration that should
suffice and we could expose an API at worker layer to get this information
directly from it. If the host dies you lose some errors but that does not seem
like a big deal. The only downside will be ui would now have to make requests
against worker hosts to get erros but that seems ok to me, you would also get
parallelism as all these worker calls can be made in parallel. I haven't
thought this through completely and its probably much more work but I would
love to hear your opinion.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
