[ https://issues.apache.org/jira/browse/SPARK-35803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan reassigned SPARK-35803: ----------------------------------- Assignee: Pablo Langa Blanco > Spark SQL does not support creating views using DataSource v2 based data > sources > -------------------------------------------------------------------------------- > > Key: SPARK-35803 > URL: https://issues.apache.org/jira/browse/SPARK-35803 > Project: Spark > Issue Type: New Feature > Components: SQL > Affects Versions: 2.4.8, 3.1.2 > Reporter: David Rabinowitz > Assignee: Pablo Langa Blanco > Priority: Major > Fix For: 3.3.0 > > > When a temporary view is created in Spark SQL using an external data source, > Spark then tries to create the relevant relation using > DataSource.resolveRelation() method. Unlike DataFrameReader.load(), > resolveRelation() does not check if the provided DataSource implements the > DataSourceV2 interface and instead tries to use the RelationProvider trait in > order to generate the Relation. > Furthermore, DataSourceV2Relation is not a subclass of BaseRelation, so it > cannot be used in resolveRelation(). > Last, I tried to implement the RelationProvider trait in my Java > implementation of DataSourceV2, but the match inside resolveRelation() did > not detect it as RelationProvider. > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org