jadami10 opened a new pull request, #18430: URL: https://github.com/apache/pinot/pull/18430
This is both a bugfix and a new feature to support query redaction. By default, query logs are not redacted. With `literal_values`, we use the the query fingerprint to only log the redacted query with no literal values. This is useful if folks still want the structure of the query without potentially leaking PII. This also fixes a bug where query fingerprinting was modifying the AST in place and breaking queries. Using fingerprinting now requires parsing the query twice. The final option is full redaction. This is good if you want no SQL ending up in your logging system. I tested all options internally on a QA cluster. We plan to stick with `full` redaction going forward. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
