Looks pretty good, but why not go the distance and stick the JSON-open and JSON-end logic in EscapedServletOutputStream as well? You'd need only to pass through the index (or first-ness) of the entry being placed -- @Override close() for the ender. Thoughts?
http://codereview.appspot.com/183045
