On 19.08.14 11:28, Ashley Aitken wrote:
On Tuesday, 19 August 2014 16:53:46 UTC+8, Martin Krasser wrote:
journal -> akka actor(s) -> read model datastore
when I can do this much more efficiently via
journal -> spark -> read model datastore
directly, for example
I am confused, are you suggesting that spark is talking to the journal
data store directly, without any involvement of Akka / Akka Persistence?
Yes. Why looping it through journal actors if something like the
spark-cassandra-connector, for example, is able to do this in a highly
scalable way? If one would like to have the same read scalability with
an akka-persistence plugin, one would partly need to re-implement what
is already done by the spark-cassandra-connector.
If so, it sounds like a great solution but why would that require an
extension to the Akka Persistence design/API?
Because transformed/joined/... event streams in backend store on the
read side must be consumable by PersistentViews (for creating read
models). I still see this backend store to maintain changes (=
transformed/joined/... events) instead of current state.
--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ:
http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google
Groups "Akka User List" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to akka-user+unsubscr...@googlegroups.com
<mailto:akka-user+unsubscr...@googlegroups.com>.
To post to this group, send email to akka-user@googlegroups.com
<mailto:akka-user@googlegroups.com>.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
--
Martin Krasser
blog: http://krasserm.blogspot.com
code: http://github.com/krasserm
twitter: http://twitter.com/mrt1nz
--
Read the docs: http://akka.io/docs/
Check the FAQ: http://doc.akka.io/docs/akka/current/additional/faq.html
Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
