RE: Re: [Spark Sql] Global Setting for Case-Insensitive String Compare
Thanks. How would I go about formally submitting a feature request for this? On 2022/11/21 23:47:16 Andrew Melo wrote: > I think this is the right place, just a hard question :) As far as I > know, there's no "case insensitive flag", so YMMV > > On Mon, Nov 21, 2022 at 5:40 PM Patrick Tucci wrote: > > > > Is this the wrong list for this type of question? > > > > On 2022/11/12 16:34:48 Patrick Tucci wrote: > > > Hello, > > > > > > Is there a way to set string comparisons to be case-insensitive > > globally? I > > > understand LOWER() can be used, but my codebase contains 27k lines of SQL > > > and many string comparisons. I would need to apply LOWER() to each string > > > literal in the code base. I'd also need to change all the ETL/import code > > > to apply LOWER() to each string value on import. > > > > > > Current behavior: > > > > > > SELECT 'ABC' = 'abc'; > > > false > > > Time taken: 5.466 seconds, Fetched 1 row(s) > > > > > > SELECT 'ABC' IN ('AbC', 'abc'); > > > false > > > Time taken: 5.498 seconds, Fetched 1 row(s) > > > > > > SELECT 'ABC' like 'Ab%' > > > false > > > Time taken: 5.439 seconds, Fetched 1 row(s) > > > > > > Desired behavior would be true for all of the above with the proposed > > > case-insensitive flag set. > > > > > > Thanks, > > > > > > Patrick > > > > > > > - > > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Re: [Spark Sql] Global Setting for Case-Insensitive String Compare
I think this is the right place, just a hard question :) As far as I know, there's no "case insensitive flag", so YMMV On Mon, Nov 21, 2022 at 5:40 PM Patrick Tucci wrote: > > Is this the wrong list for this type of question? > > On 2022/11/12 16:34:48 Patrick Tucci wrote: > > Hello, > > > > Is there a way to set string comparisons to be case-insensitive > globally? I > > understand LOWER() can be used, but my codebase contains 27k lines of SQL > > and many string comparisons. I would need to apply LOWER() to each string > > literal in the code base. I'd also need to change all the ETL/import code > > to apply LOWER() to each string value on import. > > > > Current behavior: > > > > SELECT 'ABC' = 'abc'; > > false > > Time taken: 5.466 seconds, Fetched 1 row(s) > > > > SELECT 'ABC' IN ('AbC', 'abc'); > > false > > Time taken: 5.498 seconds, Fetched 1 row(s) > > > > SELECT 'ABC' like 'Ab%' > > false > > Time taken: 5.439 seconds, Fetched 1 row(s) > > > > Desired behavior would be true for all of the above with the proposed > > case-insensitive flag set. > > > > Thanks, > > > > Patrick > > > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
RE: [Spark Sql] Global Setting for Case-Insensitive String Compare
Is this the wrong list for this type of question? On 2022/11/12 16:34:48 Patrick Tucci wrote: > Hello, > > Is there a way to set string comparisons to be case-insensitive globally? I > understand LOWER() can be used, but my codebase contains 27k lines of SQL > and many string comparisons. I would need to apply LOWER() to each string > literal in the code base. I'd also need to change all the ETL/import code > to apply LOWER() to each string value on import. > > Current behavior: > > SELECT 'ABC' = 'abc'; > false > Time taken: 5.466 seconds, Fetched 1 row(s) > > SELECT 'ABC' IN ('AbC', 'abc'); > false > Time taken: 5.498 seconds, Fetched 1 row(s) > > SELECT 'ABC' like 'Ab%' > false > Time taken: 5.439 seconds, Fetched 1 row(s) > > Desired behavior would be true for all of the above with the proposed > case-insensitive flag set. > > Thanks, > > Patrick > - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
[Spark Sql] Global Setting for Case-Insensitive String Compare
Hello, Is there a way to set string comparisons to be case-insensitive globally? I understand LOWER() can be used, but my codebase contains 27k lines of SQL and many string comparisons. I would need to apply LOWER() to each string literal in the code base. I'd also need to change all the ETL/import code to apply LOWER() to each string value on import. Current behavior: SELECT 'ABC' = 'abc'; false Time taken: 5.466 seconds, Fetched 1 row(s) SELECT 'ABC' IN ('AbC', 'abc'); false Time taken: 5.498 seconds, Fetched 1 row(s) SELECT 'ABC' like 'Ab%' false Time taken: 5.439 seconds, Fetched 1 row(s) Desired behavior would be true for all of the above with the proposed case-insensitive flag set. Thanks, Patrick