Github user viirya commented on the issue:

    https://github.com/apache/spark/pull/22357
  
    FYI, per further checking code and discussion with @dbtsai regarding with 
predicate pushdown, we know that predicate push down only works for primitive 
types on Parquet datasource. So both `IsNotNull(employer)` and 
`IsNotNull(employer.id)` are not actually pushed down to work at Parquet reader.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to