Re: Use Solr / Lucene to search in a Logfile

2011-05-09 Thread Matthieu Huin
Hello Robert, At my company, we are working on a generic log collector that uses Solr to provide search capabilities. What the collector does basically is this (this is greatly dumbed down !) : * collect a log line (read it from a file, receive it from the network, ... ) * parse it through a

Use Solr / Lucene to search in a Logfile

2011-05-06 Thread Robert Naczinski
Hello, we want to search large log4j logfiles withSolr / Lucene and find any lines with a special argument. ( for examle: with a defined userid ) It should be a solr indput document for each row in the file. The log file is growing continuously and the search index must be refreshed. Has already

Re: Use Solr / Lucene to search in a Logfile

2011-05-06 Thread Otis Gospodnetic
Sent: Fri, May 6, 2011 3:01:45 AM Subject: Use Solr / Lucene to search in a Logfile Hello, we want to search large log4j logfiles withSolr / Lucene and find any lines with a special argument. ( for examle: with a defined userid ) It should be a solr indput document for each row

Re: Use Solr / Lucene to search in a Logfile

2011-05-06 Thread Robert Naczinski
Hi, thanks for the reply. I did not know that. Is there still a way to use Solr or Lucene? Or Apache Nutch would be not be bad. Could I maybe write a customized DIH? Greetings, Robert 2011/5/6 Otis Gospodnetic otis_gospodne...@yahoo.com: Loggly.com