dfWithUDF.cache() dfWithUDF.write.saveAsTable("t") dfWithUDF.write.saveAsTable("t1")
Cached data is not being used. It causes a big performance regression. 2018-07-19 11:32 GMT-07:00 Sean Owen <sro...@gmail.com>: > What regression are you referring to here? A -1 vote really needs a > rationale. > > On Thu, Jul 19, 2018 at 1:27 PM Xiao Li <gatorsm...@gmail.com> wrote: > >> I would first vote -1. >> >> I might find another regression caused by the analysis barrier. Will keep >> you posted. >> >>