Re: Working with SDF

2022-03-28 Thread Julien Chaty-Capelle
Thank you for your feeback ! I tried to make a simpler version of my problem here : https://pastebin.com/sa1P2EEc (I added some print statements as I don't really know how debugger friendly beam is) I'm running on Ubuntu 20.04, Python 3.8.10 with beam 2.37.0 like this (direct runner) : python -m m

Working with SDF

2022-03-25 Thread Julien Chaty-Capelle
Hello there, I'm actually working on moving parts of my company's architectures toward something more cloud native. I ended up using beam as its quite straightforward to use with our current stack. I have some pipelines working at this time but I need to move some of them to SDF to increase paral