Hello,

Previously when using pyarrow 3.0.0 when trying to filter null columns on 
read_table I was doing it this way: 
pq.read_table(myparquetFile.parquet', filters=~ds.field(« my_field").is_valid())
It was working fine, but when upgrading top yarrow 4.0.0 I am now receiving an 
error 
"ValueError: An Expression cannot be evaluated to python True or False. If you 
are using the 'and', 'or' or 'not' operators, use '&', '|' or '~' instead. »
I tried to use is_null() instead of is_valid() but with no luck either.

Is there some other way to apply this filter?

Thank you.

Reply via email to