eugen yushin created SPARK-54056:
------------------------------------

             Summary: Enable substitution for SQLConf settings
                 Key: SPARK-54056
                 URL: https://issues.apache.org/jira/browse/SPARK-54056
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 4.0.1
            Reporter: eugen yushin


Values set for custom catalogs are not being substituted:
```
spark.sql.catalog.mssql=org.apache.spark.sql.execution.datasources.v2.jdbc.JDBCTableCatalog
spark.sql.catalog.mssql.user=${env:MSSQL__USER}
```

Fails with:
```
spark.sql("show tables in mssql").show()

com.microsoft.sqlserver.jdbc.SQLServerException: Login failed for user 
'${env:MSSQL__USER}'
```





--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to