Yes. https://issues.apache.org/jira/browse/SPARK-24867 is the one I created. The PR has been created. Since this is not rare, let us merge it to 2.3.2?
Reynold' PR is to get rid of AnalysisBarrier. That is better than multiple patches we added for AnalysisBarrier after 2.3.0 release. We can target it to 2.4. Thanks, Xiao 2018-07-19 17:48 GMT-07:00 Saisai Shao <[email protected]>: > I see, thanks Reynold. > > Reynold Xin <[email protected]> 于2018年7月20日周五 上午8:46写道： > >> Looking at the list of pull requests it looks like this is the ticket: >> https://issues.apache.org/jira/browse/SPARK-24867 >> >> >> >> On Thu, Jul 19, 2018 at 5:25 PM Reynold Xin <[email protected]> wrote: >> >>> I don't think my ticket should block this release. It's a big general >>> refactoring. >>> >>> Xiao do you have a ticket for the bug you found? >>> >>> >>> On Thu, Jul 19, 2018 at 5:24 PM Saisai Shao <[email protected]> >>> wrote: >>> >>>> Hi Xiao, >>>> >>>> Are you referring to this JIRA (https://issues.apache.org/ >>>> jira/browse/SPARK-24865)? >>>> >>>> Xiao Li <[email protected]> 于2018年7月20日周五 上午2:41写道： >>>> >>>>> dfWithUDF.cache() >>>>> dfWithUDF.write.saveAsTable("t") >>>>> dfWithUDF.write.saveAsTable("t1") >>>>> >>>>> >>>>> Cached data is not being used. It causes a big performance regression. >>>>> >>>>> >>>>> >>>>> >>>>> 2018-07-19 11:32 GMT-07:00 Sean Owen <[email protected]>: >>>>> >>>>>> What regression are you referring to here? A -1 vote really needs a >>>>>> rationale. >>>>>> >>>>>> On Thu, Jul 19, 2018 at 1:27 PM Xiao Li <[email protected]> wrote: >>>>>> >>>>>>> I would first vote -1. >>>>>>> >>>>>>> I might find another regression caused by the analysis barrier. Will >>>>>>> keep you posted. >>>>>>> >>>>>>> >>>>>
