I’m no expert, but I think Kafka, Kafka Connect and Kafka Streams could be a
great fit for your use case.
Use Kafka Connect to pull data from the various data sources, into a topic or
topics and then use Kafka Streams to do the joins, enrichment, and / or
analysis needed to determine a record
Everything's down to requirements. I'm unclear on yours. I tried to
look at your website to see if I could pick up any clues but upsail.co
(and just in case, upsail.com) don't exist, so I dunno.
Some questions, rhetorical really:
Is there any reason a standard SQL database would not do - what doe
Hi Cedric,
I'm not sure if this is directly applicable, but you might get a feel for
how Kafka relates to more traditional databases from this post (afaik this
is one of the seminal talks relating the two ideas):
https://www.confluent.io/blog/turning-the-database-inside-out-with-apache-samza/
You
Hello Cedric,
My 2 cents :
We use Kafka alot but mostly for messaging and event streaming purpose.
Using Kafka as Database is not a usecase i would look Kafka for. Ofcourse
you can use it to store some intermediate states but having it as "system
of records" would be stretched use case for Kafka.
Let me introduce myself, my name is Cedric and I am a network engineer
passionate about new technologies and as part of my new activity, I am
interested in Big Data. Currently, I live in Africa (Congo) and as everyone
knows, Africa is very late in terms of IT infrastructure (the Cloud is
diffic
