[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kousuke Saruta resolved SPARK-36398. ------------------------------------ Fix Version/s: 3.1.3 3.2.0 Assignee: Kousuke Saruta Resolution: Fixed > Redact sensitive information in Spark Thrift Server log > ------------------------------------------------------- > > Key: SPARK-36398 > URL: https://issues.apache.org/jira/browse/SPARK-36398 > Project: Spark > Issue Type: Bug > Components: Security, SQL > Affects Versions: 3.1.2 > Reporter: Denis Krivenko > Assignee: Kousuke Saruta > Priority: Major > Fix For: 3.2.0, 3.1.3 > > > Spark Thrift Server logs query without sensitive information redaction in > [org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.scala|https://github.com/apache/spark/blob/master/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkExecuteStatementOperation.scala#L188] > {code:scala} > override def runInternal(): Unit = { > setState(OperationState.PENDING) > logInfo(s"Submitting query '$statement' with $statementId") > {code} > Logs > {code:sh} > 21/08/03 20:49:46 INFO SparkExecuteStatementOperation: Submitting query > 'CREATE OR REPLACE TEMPORARY VIEW test_view > USING org.apache.spark.sql.jdbc > OPTIONS ( > url="jdbc:mysql://example.com:3306", > driver="com.mysql.jdbc.Driver", > dbtable="example.test", > user="my_username", > password="my_password" > )' with 37e5d2cb-aa96-407e-b589-7cb212324100 > 21/08/03 20:49:46 INFO SparkExecuteStatementOperation: Running query with > 37e5d2cb-aa96-407e-b589-7cb212324100 > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org