Beam Dataframe - sort and grouping

2021-04-01 Thread Wenbing Bai
Hi Beam users, I have a user case to partition my PCollection by some key, and then sort my rows within the same partition by some other key. I feel Beam Dataframe could be a candidate solution, but I cannot figure out how to make it work. Specifically, I tried df.groupby where I expect my data w

Re: Scio 0.10.1 released

2021-04-01 Thread Ahmet Altay
Congratulations! On Thu, Apr 1, 2021 at 1:44 PM Kirill Panarin wrote: > Hi all, > > We just released Scio 0.10.1 *"Belli Horizontis"*. Here's a short summary > of the notable changes since 0.10.0: > > 🚀 Enhancements > >- Support verifyDeterministic and consistentWithEquals in recursive >

Scio 0.10.1 released

2021-04-01 Thread Kirill Panarin
Hi all, We just released Scio 0.10.1 *"Belli Horizontis"*. Here's a short summary of the notable changes since 0.10.0: 🚀 Enhancements - Support verifyDeterministic and consistentWithEquals in recursive coders (#3716 ) @jto