tan shai Thu, 07 Jul 2016 02:26:16 -0700
Hi, I have a sorted dataframe, I need to optimize the filter operations. How does Spark performs filter operations on sorted dataframe?
It is scanning all the data? Many thanks.