[
https://issues.apache.org/jira/browse/SPARK-48128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-48128:
-------------------------------
Description:
If the `BitwiseCount` / `bit_count` expresison is applied to a boolean type
column then then it will trigger codegen fallback to interpreted because the
generated code contains invalid Java syntax, triggering errors like
{code}
java.util.concurrent.ExecutionException:
org.codehaus.commons.compiler.CompileException: File 'generated.java', Line 41,
Column 11: Failed to compile: org.codehaus.commons.compiler.CompileException:
File 'generated.java', Line 41, Column 11: Unexpected token "if" in primary
{code}
This problem was masked because the QueryTest framework may not be fully
exercising codegen paths (e.g. if constant folding occurs).
was:
If the `BitwiseCount` / `bit_count` expresison is applied to a boolean type
column then then it will trigger codegen fallback to interpreted because the
generated code contains invalid Java syntax.
This problem was masked because the QueryTest framework may not be fully
exercising codegen paths (e.g. if constant folding occurs).
> BitwiseCount / bit_count generated code for boolean inputs fails to compile
> ---------------------------------------------------------------------------
>
> Key: SPARK-48128
> URL: https://issues.apache.org/jira/browse/SPARK-48128
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Josh Rosen
> Assignee: Josh Rosen
> Priority: Major
>
> If the `BitwiseCount` / `bit_count` expresison is applied to a boolean type
> column then then it will trigger codegen fallback to interpreted because the
> generated code contains invalid Java syntax, triggering errors like
> {code}
> java.util.concurrent.ExecutionException:
> org.codehaus.commons.compiler.CompileException: File 'generated.java', Line
> 41, Column 11: Failed to compile:
> org.codehaus.commons.compiler.CompileException: File 'generated.java', Line
> 41, Column 11: Unexpected token "if" in primary
> {code}
> This problem was masked because the QueryTest framework may not be fully
> exercising codegen paths (e.g. if constant folding occurs).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
