Hello everyone, I am trying to split a dataframe on partitions and i want to apply a custom function on every partition. More precisely i have a dataframe like the one below
Group_Id | Id | Points 1 | id1| Point1 2 | id2| Point2 I want to have a partition for every Group_Id and apply on every partition a function defined by me. I have tried with partitionBy('Group_Id').mapPartitions() but i receive error. Could you please advice me how to do it?