I've read about Lamina and Narrator, watched the linked videos and I think I understand how it all fits together:
1) Instrument the applications using Lamina's `instrument` or `trace` 2) Probe the instrumented code somehow by channeling the traces to some endpoint (how do you do this? do you automatically probe everything and channel to some remote service? Do you have some method of dynamically enabling/disabling probes on your services (e.g. embedded repl or some management endpoint)? 3) Analyze the traces remotely using Narrator + networking code + a UI (that's the gist of the Omphalos as I've understood). If so, what would you say is the largest difference between Riemann's[1] stream analysis functionality and what is provided by Narrator? Would you say that Omphalos and Riemann serve completely different puproses? Am I on the right track? [1] http://riemann.io/ On Sunday, 3 November 2013 00:28:27 UTC+2, Zach Tellman wrote: > > https://github.com/ztellman/narrator > > This is a reimplementation of an approach I've discussed in several talks > [1] [2], with an eye towards performance, memory efficiency, and > flexibility w.r.t. how the event stream is represented. The readme does a > good job of explaining how it works, but there have been a number of new > event processing libraries recently (core.async, EEP, etc.), so I'll spend > some time here describing how this differs. > > First, this library is focused on aggregations over event streams, not > arbitrary transformations. It is designed such that these aggregations can > be automatically parallelized, and use non-thread-safe data structures > (such as those in the excellent stream-lib [3]) without having to worry > about coordination. As such, within this narrower application it has a > richer set of operators, and should be a fair bit faster (millions of > messages/sec/core). > > Second, this has support for time-series analysis of ordered streams, > either historical or in real time. The input for either type of analysis > can be normal sequences, core.async channels, or Lamina channels. At > Factual we use this for aggregations across many of our real-time systems, > and I also use it for both ad hoc queries and daily rollups of logs and > other historical data. > > On a personal note, I think this is one of the most interesting and useful > libraries I've written. I'm really looking forward to seeing how people > use it, and encourage feedback on how to make it better. > > Zach > > [1] http://www.infoq.com/presentations/analyze-running-system > [2] http://vimeo.com/45132054#! > [3] https://github.com/addthis/stream-lib > -- -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
