[SPARK-SQL] Does Spark 3.0 support parquet predicate pushdown for array of structs?

Hi, I know Spark 3.0 has added Parquet predicate pushdown for nested structures (SPARK-17636) Does it also support predicate pushdown for an array of structs?   For example, say I have a spark table 'individuals' (in parquet format) with the following schema  root |-- individual_id: string

Does Spark 3.0 support parquet predicate pushdown for array of structures

Hi, I know Spark 3.0 has added Parquet predicate pushdown for nested structures (SPARK-17636) Does it also support predicate pushdown for an array of structures?  For example, say I have a spark table 'individuals' (in parquet format) with the following schema  root |-- individual_id: string

Does Spark support column scan pruning for array of structs?

I have a data frame in following schema: household root |-- country_code: string (nullable = true) |-- region_code: string (nullable = true) |-- individuals: array (nullable = true) ||-- element: struct (containsNull = true) |||-- individual_id: string (nullable = true) ||

Compiling ERROR for Spark MetricsSystem

Hi, 0 down vote favorite I'm trying to register a custom Spark metrics source to Spark metrics system with following code: val source = new CustomMetricSource()