[Apologise if this appears twice. I subscribed under one email, and
posted under another... oops]
Hi,
I'd like to request a new Apache Lab titled 'Pinpoint'.
Human-readable description (copied from DOAP descriptor see further
below):
Pinpoint is designed to allow log correlation using various
mechanisms built into log4j (Mapped Diagnostic Contexts, Nested
Diagostic Contexts, event properties). For example, using MDC a
thread can set a 'userId' key so that each LoggingEvent generated by
that Thread is tagged with the same set of MDC values. This allows
LoggingEvents to be correlated together later.
When millions of logging events are involved, finding specific sets
of events is difficult, and often involves command-line tools (grep)
to filter. Unfortunately these tools are not LoggingEvent-aware and
can strip out important information. Pinpoint uses Apache Lucene to
index the Logging content and provide an easily searchable context,
backed up with a simple binary event data-store so that the full,
rich, event detail of the LoggingEvent is retained (this reduces the
need to store the entire binary content in a Lucene index, which is
not very efficient during high volume indexing).
The project is designed to provide both command-line and web-based
tools allowing easy navigation to find relevant events in the vast
ocean of production events.
If this sounds a lot like the commercial Splunk application, that's
because it's inspired in part by it and by the authors need to drill
through events to find user-specific application usage behaviour.
DOAP descriptor:
<?xml version="1.0"?>
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#";
xmlns="http://usefulinc.com/ns/doap#"; xmlns:foaf="http://xmlns.com/
foaf/0.1/" xmlns:labs="http://labs.apache.org/doap-ext/1.0#";
xmlns:projects="http://projects.apache.org/ns/asfext#";>
<Project rdf:about="http://labs.apache.org/labs#pinpoint";>
<name>Pinpoint</name>
<shortname>pinpoint</shortname>
<shortdesc xml:lang="en">Provide Logging context analysis tools
to find important information in vast amounts of logging</shortdesc>
<description xml:lang="en">Pinpoint is designed to allow log
correlation using various mechanisms built into log4j (Mapped
Diagnostic Contexts, Nested Diagostic Contexts, event properties).
For example, using MDC a thread can set a 'userId' key so that each
LoggingEvent generated by that Thread is tagged with the same set of
MDC values. This allows LoggingEvents to be correlated together
later. When millions of logging events are involved, finding specific
sets of events is difficult, and often involves command-line tools
(grep) to filter. Unfortunately these tools are not LoggingEvent-
aware and can strip out important information. Pinpoint uses Apache
Lucene to index the Logging content and provide an easily searchable
context, backed up with a simple binary event data-store so that the
full, rich, event detail of the LoggingEvent is retained (this
reduces the need to store the entire binary content in a Lucene
index, which is not very efficient during high volume indexing). The
project is designed to provide both command-line and web-based tools
allowing easy navigation to find relevant events in the vast ocean of
production events. If this sounds a lot like the commercial Splunk
application, that's because it's inspired in part by it and by the
authors need to drill through events to find user-specific
application usage behaviour.</description>
<homepage rdf:resource="http://labs.apache.org/pinpoint/"/>
<license rdf:resource="http://usefulinc.com/doap/licenses/asl20"/>
<created>2007-8-5</created>
<labs:status>active</labs:status>
<maintainer>
<foaf:Person rdf:about="http://people.apache.org/~psmith/#me";>
<foaf:name>Paul Smith</foaf:name>
<foaf:homepage rdf:resource="http://people.apache.org/
~psmith/"/>
<foaf:mbox_sha1sum>f33fdcb4bbe365a3295535d7112499923feaa4e3</
foaf:mbox_sha1sum>
</foaf:Person>
</maintainer>
<repository>
<SVNRepository>
<location rdf:resource="http://svn.apache.org/repos/asf/labs/
pinpoint/"/>
<browse rdf:resource="http://svn.apache.org/viewvc/labs/
pinpoint/"/>
</SVNRepository>
</repository>
<programming-language>Java</programming-language>
</Project>
</rdf:RDF>
