Thanks Khurrum. I will try to take a look. (Although I am not an expert of
Beam.)
It would also be awesome if you can share your experience on building this
via soms blog posts, once you finished this.
Sijie
On Nov 30, 2016 4:02 AM, "Khurrum Nasim" wrote:
> FYI
>
> I just sent a pull request f
FYI
I just sent a pull request for adding a bounded source to Beam for reading
distributedlog streams. I am going to send out the pull request for adding
an unbounded source and a sink after that.
If you are interested in this and willing to help review it, this is the
pull request - https://gith
Wow. This sounds interesting. Look forward to this. Let us know if you need
any helps.
- Sijie
On Wed, Aug 31, 2016 at 2:02 AM, Khurrum Nasim
wrote:
> Hello beam folks,
>
> We are evaluating a new solution to unify our streaming and batching data
> pipeline, from storage, computing engine to pr
Hello beam folks,
We are evaluating a new solution to unify our streaming and batching data
pipeline, from storage, computing engine to programming model. The idea is
basically to implement the Kappa architecture, using DistributedLog as a
unified stream store for both streaming and batching, usin
