Excessive Arrays.fill(0) in DocumentsWriter drastically slows down small docs
(3.9X slowdown!)
----------------------------------------------------------------------------------------------
Key: LUCENE-1125
URL: https://issues.apache.org/jira/browse/LUCENE-1125
Project: Lucene - Java
Issue Type: Bug
Components: Index
Affects Versions: 2.3
Reporter: Michael McCandless
Assignee: Michael McCandless
Fix For: 2.3
I've been doing some "final" performance testing of 2.3RC1 and
uncovered a fairly serious bug that adds a large fixed CPU cost when
documents have any term vector enabled fields.
The bug does not affect correctness, just performance.
Basically, for every document, we were calling Arrays.fill(0) on a
large (32 KB) byte array when in fact we only needed to zero a small
part of it. This only happens if term vectors are turned on, and is
especially devastating for small documents.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]