Re: Logging KNN vector queries

2023-03-20 Thread Joel Bernstein
It does appear that the logs are being truncated by the logger: https://logging.apache.org/log4j/log4j-2.8/log4j-core/apidocs/org/apache/logging/log4j/core/pattern/MaxLengthConverter.html . But, I've created a ticket to selectively suppress certain parameters in the logs: https://issues.apache.or

Logging KNN vector queries

2023-03-20 Thread Joel Bernstein
I've run into an issue with KNN vector queries and the Solr logs. The issue is for large vectors you can end up with 20K+ of just vector data in the logs. This is because each floating point value in the vector can take 20+ characters to express as a string. In our testing the log line is getting t