Hi Chelios,
I didn't mean to use any external engine or Riak, I meant that you should
learn what they do so that you can get ideas from these frameworks/engines.
The thing with map reduce is the ability to split data sets among nodes
where a query is the sum of the filtered dataset per node, so
Hi Cherios,
I didn't mean to use any external engine or Riak, I meant that you should
learn what they do so that you can get ideas from these frameworks/engines.
The thing with map reduce is the ability to split data sets among nodes
where a query is the sum of the filtered dataset per node, so
You may also want to take a look at Akka Distributed Data
http://doc.akka.io/docs/akka/2.4.2/scala/distributed-data.html for
replicating the search index (small enough amount of data I guess).
/Patrik
tors 31 mars 2016 kl. 04:35 skrev Chelios :
> Hey Guido,
>
> Thanks heaps for this info. I only
Hey Guido,
Thanks heaps for this info. I only have small theoretical experience with
map reduce. I will have to study on the info you gave me.
The reason I thought of not using any external database is because I'm
trying to get every small Actor (Customer, Product etc) manage it's on
small pi
Even if you want to do it yourself you still have to reduce data from a
map, there are papers if you want to create your own implementation of a
"map reduce engine"
You won't escape that fact if you want your implementation to be
competitive, take a look at Riak, they do the same in Erlang, they
Hi Chelios,
The problem you are solving is divided in two and I think it has been
resolved before though it is quite complex but if you divide and conquer it
might turn out to be easy.
IMHO here are the main aspects of your problem:
- Your data is distributed, each node with data will return
Hi Konrad,
Your reply gave me the confidence to continue with implementing the Actor
based search. Thank You :D ... I'm doing this just for research purposes,
I'm just trying to see if I can get a high performant, distributed,
in-memory system by just using Eventsourcing with Akka Actors withou
Technically it's doable , but I'm not sure if that'll reduce complexity :-)
Search really has to be "good" in order to be useful, just "fast but bad
results" often won't satisfy anyone,
thus I'm not sure implementing your own custom search engine is a good idea
(unless that is exactly the goal of
Hey guys
I've got an Eventsource based application (Not CQRS - Read and write are
both on the write side). The state of all the entities/aggregates/actor are
stored in memory because the data is not going to go above 120GB and I've
have a machine with 265GB RAM.
*Problem:*
Suppose I have a mil