[ https://issues.apache.org/jira/browse/SPARK-36971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17427976#comment-17427976 ]
Hyukjin Kwon commented on SPARK-36971: -------------------------------------- I suggest you do contact AWS or Databricks to follow up the issue. Databricks or AWS aren't Apache Spark. > Query files directly with SQL is broken (with Glue) > --------------------------------------------------- > > Key: SPARK-36971 > URL: https://issues.apache.org/jira/browse/SPARK-36971 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.1.2 > Environment: Databricks Runtime 9.1 and 10.0 Beta > Reporter: Lauri Koobas > Priority: Major > > This is broken in DBR 9.1 (and 10.0 Beta): > {{ select * from json.`filename`}} > [https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select-file.html] > I have tried with JSON and Parquet files. > The error: > {color:#FF0000}{{Error in SQL statement: SparkException: Unable to fetch > tables of db json}}{color} > Down in the stack trace this also exists: > {{{color:#FF0000}Caused by: NoSuchObjectException(message:Database json not > found. (Service: AWSGlue; Status Code: 400; Error Code: > EntityNotFoundException; ... )){color}}} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org