https://github.com/apache/spark/blob/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/InputPartition.java
See InputPartition which had a preferred location parameter you should
override
On Sat, Jan 18, 2020, 1:44 PM kineret M wrote:
> Hi,
> I would like to support data
Hi,
I would like to support data locality in Spark data source v2. How can I
provide Spark the ability to read and process data on the same node?
I didn't find any interface that supports 'getPreferredLocations' (or
equivalent).
Thanks!
