Re: Problem using User Defined Predicate pushdown with core RDD and parquet - UDP class not found

+spark user mailing list Hi there, I have exactly the same problem as mentioned below. My current work around is to add the jar containing my UDP in one of the system classpath (for example, put it under the same path as

Problem using User Defined Predicate pushdown with core RDD and parquet - UDP class not found

Hi all I feel like this questions is more Spark dev related that Spark user related. Please correct me if I'm wrong. My project's data flow involves sampling records from the data stored as Parquet dataset. I've checked DataFrames API and it doesn't support user defined predicates projection