-1 Agreed with Anton that this bug will potentially corrupt the data silently. As he is ready to submit a PR, I'll suggest to wait to include the fix. Thanks!
Sincerely, DB Tsai ---------------------------------------------------------- Web: https://www.dbtsai.com PGP Key ID: 0x5CED8B896A6BDFA0 On Wed, Jan 23, 2019 at 7:10 AM Anton Okolnychyi <anton.okolnyc...@gmail.com> wrote: > > It is a correctness bug. I have updated the description with an example. It > has been there for a while, so I am not sure about the priority. > > ср, 23 янв. 2019 г. в 14:48, Sean Owen <sro...@gmail.com>: >> >> I'm not clear if it's a correctness bug from that description, and if >> it's not a regression, no it does not need to go into 2.3.3. If it's a >> real bug, sure it can be merged to 2.3.x. >> >> On Wed, Jan 23, 2019 at 7:54 AM Anton Okolnychyi >> <anton.okolnyc...@gmail.com> wrote: >> > >> > Recently, I came across this bug: >> > https://issues.apache.org/jira/browse/SPARK-26706. >> > >> > It seems appropriate to include it in 2.3.3, doesn't it? >> > >> > Thanks, >> > Anton >> > --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org