Input raw log file

2011-01-08 Thread Dinesh
ho to give the raw log file as input to solr instead of xml file.. i'm working with log files from DHCP server and i want to index the datas.. pls help -- View this message in context: http://lucene.472066.n3.nabble.com/Input-raw-log-file-tp2210043p2210043.html Sent from the Solr - User

Re: Input raw log file

2011-01-08 Thread Dinesh
i don't have much idea about converting log into CSV and then giving it as input.. can u please specify how to do it excatly.. -- View this message in context: http://lucene.472066.n3.nabble.com/Input-raw-log-file-tp2210043p2216083.html Sent from the Solr - User mailing list archive at

Re: Input raw log file

2011-01-08 Thread Gora Mohanty
On Sat, Jan 8, 2011 at 3:50 PM, Dinesh mdineshkuma...@karunya.edu.in wrote: i don't have much idea about converting log into CSV and then giving it as input.. can u please specify how to do it excatly.. [...] As the format of the raw log file is known only to you, it is difficult for someone

Re: DIH - Closing ResultSet in JdbcDataSource

2011-01-08 Thread Gora Mohanty
On Sat, Jan 8, 2011 at 1:10 AM, Shane Perry thry...@gmail.com wrote: Hi, I am in the process of migrating our system from Postgres 8.4 to Solr 1.4.1.  Our system is fairly complex and as a result, I have had to define 19 base entities in the data-config.xml definition file.  Each of these

Re: DIH load only selected documents with XPathEntityProcessor

2011-01-08 Thread Gora Mohanty
On Fri, Jan 7, 2011 at 12:30 PM, Bernd Fehling bernd.fehl...@uni-bielefeld.de wrote: Hello list, is it possible to load only selected documents with XPathEntityProcessor? While loading docs I want to drop/skip/ignore documents with missing URL. Example: documents    document        

Re: DIH Transformer

2011-01-08 Thread Gora Mohanty
On Fri, Jan 7, 2011 at 6:15 PM, Bernd Fehling bernd.fehl...@uni-bielefeld.de wrote: Hi list, currently the Transformers return row but can I skip or drop a row from the Transformer? [...] I presume that you are referring to a ScriptTransformer. Just do not return anything, e.g.,you can make

Show SQL-DIH datasource name in result list

2011-01-08 Thread Patrick Kirsch
Hey, does somebody know, if there is a command option in Solr to show which datasource provided the result. Or with other words: is it possible to output in the result the tag name given in datasource / or entity /? Let me explain: - I'm using the SQL-DIH with a lot of datasources and

Re: Show SQL-DIH datasource name in result list

2011-01-08 Thread Gora Mohanty
On Sat, Jan 8, 2011 at 7:47 PM, Patrick Kirsch p-kir...@gmx.de wrote: Hey,  does somebody know, if there is a command option in Solr to show which datasource provided the result. Or with other words: is it possible to output in the result the tag name given in datasource / or entity /? [...]

multicore controlled by properties

2011-01-08 Thread Zach Friedland
We manage a large number of solr cores for a number of groups. To make this manageable in production, we have a single 'multicore' configuration with all cores deployed to a centralized NFS server, and each solr server loads this shared configuration and writes its indexes to local disks.

multicore controlled by properties

2011-01-08 Thread Zach Friedland
We have a large number of solr cores that are used by different groups for different purposes. To make the source control simple, we keep a single 'multicore' directory and solr.xml references all cores. We deploy the same configuration to all servers (shared NFS mount), and then only

Re: Including Small Amounts of New Data in Searches (MultiSearcher ?)

2011-01-08 Thread Lance Norskog
There are always slowdowns when merging new segments during indexing. A MergePolicy decides when to merge segments. The older MergePolicies followed a strategy which is quite disruptive in an NRT environment. There is a new feature in 3.x the trunk called 'BalancedSegmentMergePolicy'. This new

Re: Improving Solr performance

2011-01-08 Thread Lance Norskog
Are you using the Solr caches? These are configured in solrconfig.xml in each core. Make sure you have at least 50-100 configured for each kind. Also, use filter queries: a filter query describes a subset of documents. When you do a bunch of queries against the same filter query, the second and

Re: multicore controlled by properties

2011-01-08 Thread Lance Norskog
The config files support XInclude. Some sites use this to include a local configuration that affects your single global file. On Sat, Jan 8, 2011 at 10:53 AM, Zach Friedland wacko...@yahoo.com wrote: We have a large number of solr cores that are used by different groups for different purposes.