[ 
https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kousuke Saruta updated SPARK-36398:
-----------------------------------
    Target Version/s:   (was: 3.2.0, 3.1.3)

> Redact sensitive information in Spark Thrift Server log
> -------------------------------------------------------
>
>                 Key: SPARK-36398
>                 URL: https://issues.apache.org/jira/browse/SPARK-36398
>             Project: Spark
>          Issue Type: Bug
>          Components: Security, SQL
>    Affects Versions: 3.1.2
>            Reporter: Denis Krivenko
>            Assignee: Kousuke Saruta
>            Priority: Major
>
> Spark Thrift Server logs query without sensitive information redaction in 
> [org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.scala|https://github.com/apache/spark/blob/master/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala#L188]
> {code:scala}
>   override def runInternal(): Unit = {
>     setState(OperationState.PENDING)
>     logInfo(s"Submitting query '$statement' with $statementId")
> {code}
> Logs
> {code:sh}
> 21/08/03 20:49:46 INFO SparkExecuteStatementOperation: Submitting query 
> 'CREATE OR REPLACE TEMPORARY VIEW test_view
>     USING org.apache.spark.sql.jdbc
>     OPTIONS (
>         url="jdbc:mysql://example.com:3306",
>         driver="com.mysql.jdbc.Driver",
>         dbtable="example.test",
>         user="my_username",
>         password="my_password"
>     )' with 37e5d2cb-aa96-407e-b589-7cb212324100
> 21/08/03 20:49:46 INFO SparkExecuteStatementOperation: Running query with 
> 37e5d2cb-aa96-407e-b589-7cb212324100
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to