L. C. Hsieh created SPARK-32163:
-----------------------------------

             Summary: Nested pruning should still work for nested column 
extractors of attributes with cosmetic variations
                 Key: SPARK-32163
                 URL: https://issues.apache.org/jira/browse/SPARK-32163
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: L. C. Hsieh
            Assignee: L. C. Hsieh


If the expressions extracting nested fields have cosmetic variations like 
qualifier difference, currently nested column pruning cannot work well.

For example, two attributes which are semantically the same, are referred in a 
query, but the nested column extractors of them are treated differently when we 
deal with nested column pruning.








--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to