Hi, I am facing an issue when exploding multiple array columns where few columns have a huge element list. Repartition dataset before explode doesn't work Getting memory and space issue though file size before explode is ~16mb and Ram is 32gb with ~150gb. What is the efficient way of handling
Regards, Shrikanth R.