[
https://issues.apache.org/jira/browse/SPARK-30400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-30400:
---------------------------------
Description:
I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the
test cases are failing in SQL module with following error :
{code}
- CREATE TABLE USING AS SELECT based on the file without write permission ***
FAILED ***
Expected exception org.apache.spark.SparkException to be thrown, but no
exception was thrown (CreateTableAsSelectSuite.scala:92)
- create a table, drop it and create another one with the same name *** FAILED
***
org.apache.spark.sql.AnalysisException: Table default.jsonTable already
exists. You need to drop it first.;
at
org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:159)
at
org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
at
org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
at
org.apache.spark.sql.execution.command.DataWritingCommandExec.executeCollect(commands.scala:115)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$53.apply(Dataset.scala:3365)
at
org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:78)
at
org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
at
org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
{code}
Would like some help on understanding the cause for the same . I am running it
on a High end VM with good connectivity.
was:
I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however, the
test cases are failing in SQL module with following error :
- CREATE TABLE USING AS SELECT based on the file without write permission ***
FAILED ***
Expected exception org.apache.spark.SparkException to be thrown, but no
exception was thrown (CreateTableAsSelectSuite.scala:92)
- create a table, drop it and create another one with the same name *** FAILED
***
org.apache.spark.sql.AnalysisException: Table default.jsonTable already
exists. You need to drop it first.;
at
org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:159)
at
org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
at
org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
at
org.apache.spark.sql.execution.command.DataWritingCommandExec.executeCollect(commands.scala:115)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
at org.apache.spark.sql.Dataset$$anonfun$53.apply(Dataset.scala:3365)
at
org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:78)
at
org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
at
org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
Would like some help on understanding the cause for the same . I am running it
on a High end VM with good connectivity.
> Test failure in SQL module on ppc64le
> -------------------------------------
>
> Key: SPARK-30400
> URL: https://issues.apache.org/jira/browse/SPARK-30400
> Project: Spark
> Issue Type: Test
> Components: Build
> Affects Versions: 2.4.0
> Environment: os: rhel 7.6
> arch: ppc64le
> Reporter: AK97
> Priority: Major
>
> I have been trying to build the Apache Spark on rhel_7.6/ppc64le; however,
> the test cases are failing in SQL module with following error :
> {code}
> - CREATE TABLE USING AS SELECT based on the file without write permission ***
> FAILED ***
> Expected exception org.apache.spark.SparkException to be thrown, but no
> exception was thrown (CreateTableAsSelectSuite.scala:92)
> - create a table, drop it and create another one with the same name ***
> FAILED ***
> org.apache.spark.sql.AnalysisException: Table default.jsonTable already
> exists. You need to drop it first.;
> at
> org.apache.spark.sql.execution.command.CreateDataSourceTableAsSelectCommand.run(createDataSourceTables.scala:159)
> at
> org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult$lzycompute(commands.scala:104)
> at
> org.apache.spark.sql.execution.command.DataWritingCommandExec.sideEffectResult(commands.scala:102)
> at
> org.apache.spark.sql.execution.command.DataWritingCommandExec.executeCollect(commands.scala:115)
> at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
> at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:195)
> at org.apache.spark.sql.Dataset$$anonfun$53.apply(Dataset.scala:3365)
> at
> org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:78)
> at
> org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:125)
> at
> org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:73)
> {code}
> Would like some help on understanding the cause for the same . I am running
> it on a High end VM with good connectivity.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
