Github user hvanhovell commented on the pull request:
https://github.com/apache/spark/pull/13414
I think the name of the `SessionCatalog.createTempView` is a misnomer -
this is strengthened by the fact that the documentation and usage all refer to
create temp tables...
I am pretty sure that no query is executed in this case. It will just scan
the data. For example the following REPL code:
```scala
import java.nio.file.Files
val location = Files.createTempDirectory("data").resolve("src")
spark.range(0, 100000).
select($"id".as("key"), rand().as("value")).
write.parquet(location.toString)
spark.sql(s"create temporary table my_src using parquet options(path
'$location')")
spark.table("my_src").explain(true)
```
Yields the following plan:
```
== Parsed Logical Plan ==
SubqueryAlias my_src
+- Relation[key#14L,value#15] parquet
== Analyzed Logical Plan ==
key: bigint, value: double
SubqueryAlias my_src
+- Relation[key#14L,value#15] parquet
== Optimized Logical Plan ==
Relation[key#14L,value#15] parquet
== Physical Plan ==
*BatchedScan parquet [key#14L,value#15] Format: ParquetFormat, InputPaths:
file:/tmp/data8602759574255545993/src, PushedFilters: [], ReadSchema:
struct<key:bigint,value:double>
```
Am I missing something?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
