Re: [VOTE] Release Apache Druid 29.0.0 [RC1]

2024-02-16 Thread Gian Merlino
Here's a patch with the validation idea: https://github.com/apache/druid/pull/15920 It adds validation for the most problematic case (mixing strings and arrays), provides a way to override the validation, and makes the warning log on the controller task when arrayIngestMode is 'mvd' more

Re: [VOTE] Release Apache Druid 29.0.0 [RC1]

2024-02-16 Thread Gian Merlino
I just learned that arrayIngestMode is not actually new, just https://github.com/apache/druid/pull/15588 is. However this will still make it more likely that people accidentally break their tables, so I am still -0. Just, slightly less so. I still think it would be a good idea, for Druid 29, to

Re: [VOTE] Release Apache Druid 29.0.0 [RC1]

2024-02-16 Thread Gian Merlino
Thanks for managing this release! My vote is -0, let me explain why. I am concerned about usability issues with the new arrayIngestMode feature. There are various issues when mixing MVD strings and string arrays in the same column: as soon as arrays show up in a column, various "classic