Re: Hash range to shard assignment

2013-09-24 Thread Noble Paul നോബിള്‍ नोब्ळ्
That is in the pipeline. within next 3-4 months for sure On Mon, Sep 23, 2013 at 11:07 PM, lochri wrote: > Yes, actually that would be a very comfortable solution. > Is that planned ? And if so, when will it be released ? > > > > -- > View this message in context: > http://lucene.472066.n3.nabbl

Re: Hash range to shard assignment

2013-09-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
Custom routers is an idea that is floated around ad easy to implement. Just that it is something we resist to add another extension point. The point is we are planning other features which would obviate the need for a custom router. Something like splitting a shard by a query. Will it be a good en

Re: Hash range to shard assignment

2013-09-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
This would need you to plug your own router . It is not yet possible But , you can split that shard repeatedly and keep the no:of users in that shard limited On Fri, Sep 20, 2013 at 3:52 PM, lochri wrote: > Hello folks, > > we would like to have control of where certain hash values or ranges a

Re: dataconfig to index ZIP Files

2013-07-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
IIRC Zip files are not supported On Mon, Jul 1, 2013 at 10:30 PM, ericrs22 wrote: > To answer the previous Post: > > I was not sure what datasource="binaryFile" I took it from a PDF sample > thinking that would help. > > after setting datasource="null" I'm still gett the same errors... > > >

Re: DataImportHandler: Problems with delta-import and CachedSqlEntityProcessor

2013-06-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
ty. > > It would be great if you could just sketch the setup with the entities I > provided. Because currently I have no idea on how to do it. > > Regards > > Constantin > > > -Ursprüngliche Nachricht- > Von: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com

Re: DataImportHandler: Problems with delta-import and CachedSqlEntityProcessor

2013-06-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is possible to create two separate root entities . one for full-import and another for delta. for the delta-import you can skip Cache that way On Thu, Jun 20, 2013 at 1:50 PM, Constantin Wolber < constantin.wol...@medicalcolumbus.de> wrote: > Hi, > > i searched for a solution for quite some

Re: Replication not working

2013-06-11 Thread Noble Paul നോബിള്‍ नोब्ळ्
06-1:) > Closing out SolrRequest: {command=indexversion} > > -----Ursprüngliche Nachricht- > Von: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] > Gesendet: Dienstag, 11. Juni 2013 13:41 > An: solr-user@lucene.apache.org > Betreff: Re: Replication not working > > Y

Re: Replication not working

2013-06-11 Thread Noble Paul നോബിള്‍ नोब्ळ्
> On Slave: > >0 >0 >0 >1 > > > > pollInterval is set to 2 minutes. It is usually long > > I know ;-) > > > -Ursprüngliche Nachricht- > Von: Noble Paul നോബിള്‍ नोब्ळ् [mailto:noble.p...@gmail.com] > Gesen

Re: Replication not working

2013-06-11 Thread Noble Paul നോബിള്‍ नोब्ळ्
can you check with the indexversion command on both mater and slave? pollInterval is set to 2 minutes. It is usually long . So you may need to wait for 2 mins for the replication to kick in On Tue, Jun 11, 2013 at 3:21 PM, wrote: > Hi all, > > > > we have a setup with multiple cores, loaded vi

Re: LotsOfCores feature

2013-06-10 Thread Noble Paul നോബിള്‍ नोब्ळ्
I did a couple of quick searches and found mostly older wikis that say > solr replication will change in the future. Would you be able to point > me to the right one? > > > - > > On Fri, Jun 7, 2013 at 8:34 PM, Noble Paul നോബിള്‍ नोब्ळ् > wrote: > > We set it up like

Re: LotsOfCores feature

2013-06-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
We set it up like this + individual solr instances are setup + external mapping/routing to allocate users to instances. This information can be stored in an external data store + all cores are created as transient and loadonstart as false + cores come online on demand + as and when users data get b

Re: SOLR CSV output in custom order

2013-06-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
Have you tried explicitly giving the field names (fl) as parameter http://wiki.apache.org/solr/CommonQueryParameters#fl On Thu, Jun 6, 2013 at 12:41 PM, anurag.jain wrote: > I want output of csv file in proper order. when I use wt=csv it gives > output in random order. Is there any way to ge

Re: LotsOfCores feature

2013-06-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
The Wiki page was built not for Cloud Solr. We have done such a deployment where less than a tenth of cores were active at any given point in time. though there were tens of million indices they were split among a large no:of hosts. If you don't insist of Cloud deployment it is possible. I'm not

Re: Upgrading from SOLR 3.5 to 4.2.1 Results.

2013-05-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
Actually , It's pretty high end for most of the users. Rishi, u can post the real h/w details and our typical deployment . No :of cpus per node No :of disks per host Vms per host Gc params No :of cores per instance Noble Paul Sent from phone On 21 May 2013 01:47, "Rishi Easwaran" wrote: > No, w

Re: javabin binary format specification

2012-08-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no spec documented anywhere . It is all in this single file https://svn.apache.org/repos/asf/lucene/dev/trunk/solr/solrj/src/java/org/apache/solr/common/util/JavaBinCodec.java On Wed, Jul 25, 2012 at 6:47 PM, Ahmet Arslan wrote: > > Sorry, but I could not find any spec on the binary for

Re: @field for child object

2011-07-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
no On Mon, Jul 4, 2011 at 3:34 PM, Kiwi de coder wrote: > hi, > > i wondering solrj @Field annotation support embedded child object ? e.g. > > class A { > >  @field >  string somefield; > >  @emebedded >  B b; > > } > > regards, > kiwi > --

Re: Re; DIH Scheduling

2011-06-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Thu, Jun 23, 2011 at 9:13 PM, simon wrote: > The Wiki page describes a design for a scheduler, which has not been > committed to Solr yet (I checked). I did see a patch the other day > (see https://issues.apache.org/jira/browse/SOLR-2305) but it didn't > look well tested. > > I think that you'r

Re: Where is LogTransformer log file path??

2011-06-21 Thread Noble Paul നോബിള്‍ नोब्ळ्
it will be in the solr logs On Tue, Jun 21, 2011 at 2:18 PM, Alucard wrote: > Hi all. > > I follow the steps of creating a LogTransformer in DataImportHandler wiki: > > pk="office_add_Key" transformer="LogTransformer" logLevel="debug" >                    logTemplate="office_add_Key: > ${office_

Re: Need help with DIH dataconfig.xml

2011-06-15 Thread Noble Paul നോബിള്‍ नोब्ळ्
Use TemplateTransformer On Wed, Jun 15, 2011 at 4:41 PM, MartinS wrote: > Hello, > > I want to perform a data import from a relational database. > Th

Re: DIH entity threads

2011-06-15 Thread Noble Paul നോബിള്‍ नोब्ळ्
Sub entities can slow down indexing remarkably.What is that datasource? DB? then try using CachedSqlEntityProcessor On Tue, Jun 14, 2011 at 8:31 PM, Mark wrote: > Hello all, > > We are using DIH to index our data (~6M documents) and its taking an > extremely long time (~24 hours). I am trying to

Re: ContentStreamDataSource

2010-11-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
for contentstreamdatasource to work you must post the stream in the request On Thu, Nov 4, 2010 at 8:13 AM, Theodor Tolstoy wrote: > Hi! > I am trying to get the ContentStreamDataSource to work properly , but there > are not many examples out there. > > What I have done is that I have made a cop

Re: Throttling replication

2010-09-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no way to currently throttle replication. It consumes the whole bandwidth available. It is a nice to have feature On Thu, Sep 2, 2010 at 8:11 PM, Mark wrote: >  Is there any way or forthcoming patch that would allow configuration of how > much network bandwith (and ultimately disk I/O) a

Re: Solr DataConfig / DIH Question

2010-06-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
this looks like a common problem. I guess DIH should handle this more gracefully. Instead of firing a query and failing it should not fire a query if any of the values are missing . This can b made configurable if needed On Sun, Jun 13, 2010 at 9:14 AM, Lance Norskog wrote: > This is a slow way

Re: Dynamic dataConfig files in DIH

2010-06-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Jun 11, 2010 at 11:13 PM, Chris Hostetter wrote: > > : Is there a way to dynamically point which dataConfig file to use to > import > : using DIH without using the defaults hardcoded in solrconfig.xml? > > what do you mean by "dynamically" ? ... it's a query param, so you can > specify th

Re: TikaEntityProcessor not working?

2010-05-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
BinFileDataSource will only work with file, Try FieldStreamDataSource On Mon, May 31, 2010 at 3:30 AM, Brad Greenlee wrote: > Hi. I'm trying to get Solr to index a database in which one column is a > filename of a PDF document I'd like to index. My configuration looks like > this: > > > url=

Re: TikaEntityProcessor on Solr 1.4?

2010-05-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
just copy the dih-extras jar file from the nightly should be fine On Sat, May 22, 2010 at 3:12 AM, Sixten Otto wrote: > On Fri, May 21, 2010 at 5:30 PM, Chris Harris wrote: >> Actually, rather than cherry-pick just the changes from SOLR-1358 and >> SOLR-1583 what I did was to merge in all DataIm

Re: TikaEntityProcessor on Solr 1.4?

2010-05-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess it should work because Tika Entityprocessor does not use any new 1.4 APIs On Wed, May 19, 2010 at 1:17 AM, Sixten Otto wrote: > Sorry to repeat this question, but I realized that it probably > belonged in its own thread: > > The TikaEntityProcessor class that enables DataImportHandler to

Re: Issue with delta import (not finding data in a column)

2010-05-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
Are u reusing the context object? It may help if u can paste the relevant part of ur code On 10 May 2010 19:03, "ahammad" wrote: I have a Solr core that retrieves data from an Oracle DB. The DB table has a few columns, one of which is a Blob that represents a PDF document. In order to retrieve

Re: Custom DIH variables

2010-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
you can use the core from this API and use EmbeddedSolrServer (part of solrj) . So the calls will be in-vm On Thu, May 6, 2010 at 6:08 AM, Blargy wrote: > > Thanks Noble this is exactly what I was looking for. > > What is the preferred way to query solr within these sorts of classes? > Should I

Re: Custom DIH EventListeners

2010-05-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
nope. register any event listener and check for the context.currentProcess() to figure out what is the event On Thu, May 6, 2010 at 8:21 AM, Blargy wrote: > > I know one can create custom event listeners for update or query events, but > is it possible to create one for any DIH event (Full-Import

Re: Custom DIH variables

2010-05-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
ok , u can't write a variable. But you may write a function (Evaluator). it will look something like ${dataimporter.functions.foo()} http://wiki.apache.org/solr/DataImportHandler#Custom_formatting_in_query_and_url_using_Functions On Wed, May 5, 2010 at 9:12 PM, Blargy wrote: > > Thanks Paul, tha

Re: Custom DIH variables

2010-05-04 Thread Noble Paul നോബിള്‍ नोब्ळ्
you can use custom parameters from request like , ${dataimporter.request.foo}. pass the value of foo as a request param say foo=bar On Wed, May 5, 2010 at 6:05 AM, Blargy wrote: > > Can someone please point me in the right direction (classes) on how to create > my own custom dih variable that ca

Re: DIH: inner select fails when outter entity is null/empty

2010-04-25 Thread Noble Paul നോബിള്‍ नोब्ळ्
do an onError="skip" on the inner entity On Fri, Apr 23, 2010 at 3:56 AM, Otis Gospodnetic wrote: > Hello, > > Here is a newbie DataImportHandler question: > > Currently, I have entities with entities.  There are some > situations where a column value from the outer entity is null, and when I try

Re: ReplicationHandler reports incorrect replication failures

2010-03-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
please create a bug On Fri, Mar 26, 2010 at 7:29 PM, Shawn Smith wrote: > We're using Solr 1.4 Java replication, which seems to be working > nicely.  While writing production monitors to check that replication > is healthy, I think we've run into a bug in the status reporting of > the "../solr/re

Re: expungeDeletes on commit in Dataimport

2010-03-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Thu, Mar 25, 2010 at 10:14 PM, Ruben Chadien wrote: > Hi > > I know this has been discussed before, but is there any way do > expungeDeletes=true when the DataImportHandler does the commit. expungeDeletes= true is not used does not mean that the doc does not get deleted.deleteDocByQuery does

Re: DIH best pratices question

2010-03-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Mar 27, 2010 at 3:25 AM, Blargy wrote: > > I have a items table on db1 and and item_descriptions table on db2. > > The items table is very small in the sense that it has small columns while > the item_descriptions table has a very large text field column. Both tables > are around 7 million

Re: XPath Processing Applied to Clob

2010-03-17 Thread Noble Paul നോബിള്‍ नोब्ळ्
keep in mind that the xpath is case-sensitive. paste a sample xml what is dataField="d.text" it does not seem to refer to anything. where is the enclosing entity? did you mean dataField="doc.text". xpath="//BODY" is a supported syntax as long as you are using Solr1.4 or higher On Thu, Mar 18

Re: Is it possible to use ODBC with DIH?

2010-03-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
if you have a jdbc-odbc bridge driver , it should be fine On Sun, Mar 7, 2010 at 4:52 AM, JavaGuy84 wrote: > > Hi, > > I have a ODBC driver with me for MetaMatrix DB(Redhat). I am trying to > figure out a way to use DIH using the DSN which has been created in my > machine with that ODBC driver?

Re: If you could have one feature in Solr...

2010-03-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Fri, Mar 5, 2010 at 4:34 AM, Mark Miller wrote: > On 03/04/2010 05:56 PM, Chris Hostetter wrote: >> >> : The ability to read solr configuration files from the classpath instead >> of >> : solr.solr.home directory. >> >> Solr has always supported this. >> >> When SolrResourceLoader.openResourceL

Re: DIH onError question

2010-03-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
onError only handles Exception (not Error or Throwable). I your case it is a NoClassDefFoundError . If it is an Error or Throwable it is a symptom of a larger problem. If you fix the NoClassDefFoundError it should be ok On Wed, Mar 3, 2010 at 10:06 AM, Shah, Nirmal wrote: > Hi all, > > I am using

Re: replication issue

2010-03-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
The data/index.20100226063400 dir is a temporary dir and isc reated in the same dir where the index dir is located. I'm wondering if the symlink is causing the problem. Why don't you set the data dir as /raid/data instead of /solr/data On Sat, Feb 27, 2010 at 12:13 AM, Matthieu Labour wrote: > H

Re: If you could have one feature in Solr...

2010-02-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Feb 24, 2010 at 7:18 PM, Patrick Sauts wrote: > Synchronisation between the slaves to switch the new index at the same time > after replication. I shall open as issue for this. And let us figure out how best it should be done https://issues.apache.org/jira/browse/SOLR-1800

Re: Using XSLT with DIH for a URLDataSource

2010-02-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
this is the only one place this should be a problem.'xsl' is not a very commonly used attribute On Fri, Feb 26, 2010 at 10:46 AM, Lance Norskog wrote: > There could be a common 'open an url' utility method. This would help > make the DIH components consistent. > &

Re: Using XSLT with DIH for a URLDataSource

2010-02-24 Thread Noble Paul നോബിള്‍ नोब्ळ्
you are right. The StreamSource class is not throwing the proper exception Do we really have to handle this.? On Thu, Feb 25, 2010 at 9:06 AM, Lance Norskog wrote: > [Taken off the list] > > The problem is that the XSLT code swallows the real exception, and > does not return it as the "deeper" e

Re: error while using the DIH handler

2010-02-23 Thread Noble Paul നോബിള്‍ नोब्ळ्
can you paste the DIH part in your solrconfig.xml ? On Tue, Feb 23, 2010 at 7:01 PM, Na_D wrote: > > yes i did check the location of the data-config.xml > > its in the folder example-DIH/solr/db/conf > -- > View this message in context: > http://old.nabble.com/error-while-using-the-DIH-handler-t

Re: Using XSLT with DIH for a URLDataSource

2010-02-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
The xslt file looks fine . is the location of the file correct ? On Mon, Feb 22, 2010 at 2:57 PM, Roland Villemoes wrote: > > Hi > > (thanks a lot) > > Yes, The full stacktrace is this: > > 22-02-2010 08:37:00 org.apache.solr.handler.dataimport.DataImporter > doFullImport > SEVERE: Full Import

Re: @Field annotation support

2010-02-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
.4.0.jar/org\apache\solr\client\solrj\beans\Field.class > > 2010/2/18 Noble Paul നോബിള്‍  नोब्ळ् : >> solrj jar >> >> On Thu, Feb 18, 2010 at 10:52 PM, Pulkit Singhal >> wrote: >>> Hello All, >>> >>> When I use Maven or Eclipse to try and com

Re: replications issue

2010-02-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
wha is the problem. Is the replication not happening after you do a commit on the master? frequent polling is not a problem. frequent commits can slow down the system On Fri, Feb 19, 2010 at 2:41 PM, giskard wrote: > Ciao, > > Uhm after some time a new index in data/index on the slave has been wr

Re: @Field annotation support

2010-02-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
solrj jar On Thu, Feb 18, 2010 at 10:52 PM, Pulkit Singhal wrote: > Hello All, > > When I use Maven or Eclipse to try and compile my bean which has the > @Field annotation as specified in http://wiki.apache.org/solr/Solrj > page ... the compiler doesn't find any class to support the > annotation.

Re: Preventing mass index delete via DataImportHandler full-import

2010-02-16 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Feb 17, 2010 at 8:03 AM, Chris Hostetter wrote: > > : I have a small worry though. When I call the full-import functions, can > : I configure Solr (via the XML files) to make sure there are rows to > : index before wiping everything? What worries me is if, for some unknown > : reason, we h

Re: Solr 1.4: Full import FileNotFoundException

2010-02-13 Thread Noble Paul നോബിള്‍ नोब्ळ्
can we confirm that the user does not have multiple DIH configured? any request for an import, while an import is going on, is rejected On Sat, Feb 13, 2010 at 11:40 AM, Chris Hostetter wrote: > > : concurrent imports are not allowed in DIH, unless u setup multiple DIH > instances > > Right, bu

Re: Solr 1.4: Full import FileNotFoundException

2010-02-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
concurrent imports are not allowed in DIH, unless u setup multiple DIH instances On Sat, Feb 13, 2010 at 7:05 AM, Chris Hostetter wrote: > > : I have noticed that when I run concurrent full-imports using DIH in Solr > : 1.4, the index ends up getting corrupted. I see the following in the log > >

Re: Call URL, simply parse the results using SolrJ

2010-02-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
you can also try URL urlo = new URL(url);// ensure that the url has wt=javabin in that NamedList namedList = new JavaBinCodec().unmarshal(urlo.openConnection().getInputStream()); QueryResponse response = new QueryResponse(namedList, null); On Mon, Feb 8, 2010 at 11:49 PM, Jason Rutherglen wrote

Re: DIH: delta-import not working

2010-02-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
try this deltaImportQuery="select id, bytes from attachment where application = 'MYAPP' and id = '${dataimporter.delta.id}'" be aware that the names are case sensitive . if the id comes as 'ID' this will not work On Tue, Feb 9, 2010 at 3:15 PM, Jorg Heymans wrote: > Hi, > > I am having probl

Re: How to configure multiple data import types

2010-02-08 Thread Noble Paul നോബിള്‍ नोब्ळ्
are you referring to nested entities? http://wiki.apache.org/solr/DIHQuickStart#Index_data_from_multiple_tables_into_Solr On Mon, Feb 8, 2010 at 5:42 PM, wrote: > I have got a dataimport request handler configured to index data by selecting > data from a DB view > > I now need to index addition

Re: DataImportHandlerException for custom DIH Transformer

2010-02-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Mon, Feb 8, 2010 at 9:13 AM, Tommy Chheng wrote: >  I'm having trouble making a custom DIH transformer in solr 1.4. > > I compiled the "General TrimTransformer" into a jar. (just copy/paste sample > code from http://wiki.apache.org/solr/DIHCustomTransformer) > I placed the jar along with the da

Re: DataImportHandler TikaEntityProcessor FieldReaderDataSource

2010-02-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
unfortunately, no On Fri, Feb 5, 2010 at 2:23 PM, Jorg Heymans wrote: > dow, thanks for that Paul :-| > > I suppose schema validation for data-config.xml is already in Jira somewhere > ? > > Jorg > > 2010/2/5 Noble Paul നോബിള്‍ नोब्ळ् > >> wrong   >> ri

Re: java.lang.NullPointerException with MySQL DataImportHandler

2010-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Thu, Feb 4, 2010 at 10:50 AM, Lance Norskog wrote: > I just tested this with a DIH that does not use database input. > > If the DataImportHandler JDBC code does not support a schema that has > optional fields, that is a major weakness. Noble/Shalin, is this true? The problem is obviously not wi

Re: DataImportHandler - convertType attribute

2010-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Feb 3, 2010 at 4:16 PM, Erik Hatcher wrote: > > On Feb 3, 2010, at 5:36 AM, Noble Paul നോബിള്‍ नोब्ळ् wrote: >> >> On Wed, Feb 3, 2010 at 3:31 PM, Erik Hatcher >> wrote: >>> >>> One thing I find awkward about convertType is that it is Jdbc

Re: DataImportHandler - convertType attribute

2010-02-03 Thread Noble Paul നോബിള്‍ नोब्ळ्
t. we offer it because JDBC drivers have mechanism to do type conversion What do you mean by it is too broad? > >        Erik > > On Feb 3, 2010, at 1:16 AM, Noble Paul നോബിള്‍ नोब्ळ् wrote: > >> implicit conversion can cause problem when Transformers are applied. >> It

Re: DataImportHandler - convertType attribute

2010-02-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
implicit conversion can cause problem when Transformers are applied. It is hard for user to guess the type of the field by looking at the schema.xml. In Solr, String is the most commonly used type. if you wish to do numeric operations on a field convertType will cause problems. If it is explicitly

Re: DataImportHandler delta-import confusion

2010-02-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
noble.p...@gmail.com [noble.p...@gmail.com] On Behalf Of Noble Paul > നോബിള്‍  नोब्ळ् [noble.p...@corp.aol.com] > Sent: Tuesday, February 02, 2010 2:12 AM > To: solr-user@lucene.apache.org > Subject: Re: DataImportHandler delta-import confusion > > try > deltaImportQ

Re: DataImportHandler delta-import confusion

2010-02-02 Thread Noble Paul നോബിള്‍ नोब्ळ्
try deltaImportQuery="select [bunch of stuff] WHERE m.moment_id = '${dataimporter.delta.moment_id}'" The key has to be same and in the same case On Tue, Feb 2, 2010 at 1:45 AM, Jon Drukman wrote: > First, let me just say that DataImportHandler is fantastic. It got my old > mysql-php-xml index

Re: DataImportHandler multivalued field Collection not working

2010-01-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is multiValued not multiValue 2010/1/30 Wangsheng Mei : > Did you correctly set multiValue(not multivalue)="true" in schema.xml? > > 2010/1/30 Jason Rutherglen > >> DataImportHandler multivalued field Collection isn't >> working the way I'd expect, meaning not at all. I logged the >> collectio

Re: replication setup

2010-01-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is always recommended to paste your actual configuration and startup commands, instead of saying "as described in wiki" . On Tue, Jan 26, 2010 at 9:52 PM, Matthieu Labour wrote: > Hi > > > > I have set up replication following the wiki > > I downloaded the latest apache-solr-1.4 release and ex

Re: DataImportHandler problem - reading XML from a file

2010-01-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
It clear that the xpaths provided won't fetch anything. because there is no data in those paths. what do you really wish to be indexed ? On Sun, Jan 31, 2010 at 10:30 AM, Lance Norskog wrote: > This DataImportHandler script does not find any documents in this HTML > file. The DIH definitely ope

Re: loading an updateProcessorChain with multicore in trunk

2010-01-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess . default=true should not be necessary if there is only one updateRequestProcessorChain specified . Open an issue On Fri, Jan 29, 2010 at 6:06 PM, Marc Sturlese wrote: > > I am testing trunk and have seen a different behaviour when loading > updateProcessors wich I don't know if it's norm

Re: Solr 1.4 Replication index directories

2010-01-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
the index.20100127044500/ is a temp directory should have got cleaned up if there was no problem in replication (see the logs if there was a problem) . if there is a problem the temp directory will be used as the new index directory and the old one will no more be used.at any given point only one d

Re: Help using CachedSqlEntityProcessor

2010-01-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
Thanks for pointing this out. The wiki had a problem fro a while and we could not update the documentation. It is updated here http://wiki.apache.org/solr/DataImportHandler#cached On Thu, Jan 28, 2010 at 6:31 PM, KirstyS wrote: > > Thanks, > I saw that mistake and I have it working now!!! thank y

Re: Help using CachedSqlEntityProcessor

2010-01-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
cacheKey and cacheLookup are required attributes . On Thu, Jan 28, 2010 at 12:51 AM, KirstyS wrote: > > Thanks. I am on 1.4..so maybe that is the problem. > Will try when I get back to work tomorrow. > Thanks > > > Rolf Johansson-2 wrote: >> >> I recently had issues with CachedSqlEntityProcessor

Re: Fastest way to use solrj

2010-01-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
ins almost all > of the 5000 chars. > > /Tim > > 2010/1/27 Noble Paul നോബിള്‍  नोब्ळ् : >> how many fields are there in each doc? the binary format just reduces >> overhead. it does not touch/compress the payload >> >> 2010/1/27 Tim Terlegård : >>> I h

Re: Fastest way to use solrj

2010-01-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
prised about this. It doesn't bother me much though. At > least it performs better. > > /Tim > > 2010/1/27 Noble Paul നോബിള്‍  नोब्ळ् : >> if you write only a few docs you may not observe much difference in >> size. if you write large no:of docs you may observe a b

Re: Fastest way to use solrj

2010-01-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
x27;t look like a binary file is smaller in size than > an xml file? > > /Tim > > 2010/1/27 Noble Paul നോബിള്‍  नोब्ळ् : >> 2010/1/21 Tim Terlegård : >>> Yes, it worked! Thank you very much. But do I need to use curl or can >>> I use CommonsHttpSolrServer or St

Re: DataImportHandler TikaEntityProcessor FieldReaderDataSource

2010-01-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
There is no corresponding DataSurce which can be used with TikaEntityProcessor which reads from BLOB I have opened an issue.https://issues.apache.org/jira/browse/SOLR-1737 On Mon, Jan 25, 2010 at 10:57 PM, Shah, Nirmal wrote: > Hi, > > > > I am fairly new to Solr and would like to use the DIH to

Re: NullPointerException in ReplicationHandler.postCommit + question about compression

2010-01-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
never keep a 0. It is better to leave not mention the deletionPolicy at all. The defaults are usually fine. On Fri, Jan 22, 2010 at 11:12 AM, Stephen Weiss wrote: > Hi Shalin, > > Thanks for your reply.  Please see below. > > > On Jan 18, 2010, at 4:19 AM, Shalin Shekhar Mangar wrote: > >> On We

Re: Replication Handler Severe Error: Unable to move index file

2010-01-24 Thread Noble Paul നോബിള്‍ नोब्ळ्
./index wouldn't work).  Does Solr ever hold files open > in a manner that would prevent a file in the index directory from being > overridden? There is a TODO which says manual it try to copy if move (renameTo) fails. We never did it because we never observed renameTo failing. > > > 2

Re: Replication Handler Severe Error: Unable to move index file

2010-01-21 Thread Noble Paul നോബിള്‍ नोब्ळ्
is it a one off case? do you observerve this frequently? On Thu, Jan 21, 2010 at 11:26 AM, Otis Gospodnetic wrote: > It's hard to tell without poking around, but one of the first things I'd do > would be to look for /home/solr/cores/core8/index.20100119103919/_6qv.fnm - > does this file/dir rea

Re: Fastest way to use solrj

2010-01-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
2010/1/20 Tim Terlegård : BinaryRequestWriter does not read from a file and post it >>> >>> Is there any other way or is this use case not supported? I tried this: >>> >>> $ curl /solr/update/javabin -F stream.file=/tmp/data.bin >>> $ curl /solr/update -F stream.body=' ' >>> >>> Solr did read

Re: DIH delta import - last modified date

2010-01-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
While invoking the delta-import you may, pass the value as a request parameter. That value can be used in the query as ${dih.request.xyz} where as xyz is the request parameter name On Wed, Jan 20, 2010 at 1:15 AM, Yao Ge wrote: > > I am struggling with the concept of delta import in DIH. Accordi

Re: Fastest way to use solrj

2010-01-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
2010/1/19 Tim Terlegård : > There are a few ways to use solrj. I just learned that I can use the > javabin format to get some performance gain. But when I try the binary > format nothing is added to the index. This is how I try to use this: > >    server = new CommonsHttpSolrServer("http://localhos

Re: NullPointerException in ReplicationHandler.postCommit + question about compression

2010-01-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
When you copy paste config from wiki, just copy what you need. excluding documentation and comments On Wed, Jan 13, 2010 at 12:51 AM, Stephen Weiss wrote: > Hi Solr List, > > We're trying to set up java-based replication with Solr 1.4 (dist tarball). >  We are running this to start with on a pair

Re: DataImportHandler - synchronous execution

2010-01-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
it can be added On Tue, Jan 12, 2010 at 10:18 PM, Alexey Serba wrote: > Hi, > > I found that there's no explicit option to run DataImportHandler in a > synchronous mode. I need that option to run DIH from SolrJ ( > EmbeddedSolrServer ) in the same thread. Currently I pass dummy stream > to DIH as

Re: Data Full Import Error

2010-01-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
> Hope you can advise ! > > On 12 Jan 2010, at 12:26, Noble Paul നോബിള്‍ नोब्ळ् wrote: > >> You need more memory to run dataimport. >> >> >> On Tue, Jan 12, 2010 at 4:46 PM, Lee Smith wrote: >>> Hi All >>> >>> I am trying to do a

Re: Data Full Import Error

2010-01-12 Thread Noble Paul നോബിള്‍ नोब्ळ्
You need more memory to run dataimport. On Tue, Jan 12, 2010 at 4:46 PM, Lee Smith wrote: > Hi All > > I am trying to do a data import but I am getting the following error. > > INFO: [] webapp=/solr path=/dataimport params={command=status} status=0 > QTime=405 > 2010-01-12 03:08:08.576::WARN:  

Re: Synonyms from Database

2010-01-10 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sun, Jan 10, 2010 at 1:04 PM, Otis Gospodnetic wrote: > Ravi, > > I think if your synonyms were in a DB, it would be trivial to periodically > dump them into a text file Solr expects.  You wouldn't want to hit the DB to > look up synonyms at query time... Why query time. Can it not be done at

Re: replication --> missing field data file

2010-01-07 Thread Noble Paul നോബിള്‍ नोब्ळ्
actually it does not. BTW, FYI, backup is just to take periodics backups not necessary for the Replicationhandler to work On Thu, Jan 7, 2010 at 2:37 AM, Giovanni Fernandez-Kincade wrote: > How can you tell when the backup is done? > > -Original Message- > From: noble.p...@gmail.com [mail

Re: replication --> missing field data file

2010-01-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
the index dir is in the name "index" others will be stored as index On Wed, Jan 6, 2010 at 10:31 PM, Giovanni Fernandez-Kincade wrote: > How can you differentiate between the backup and the normal index files? > > -Original Message- > From: noble.p...@gmail.com [mailto:noble.p...@gmail.co

Re: replication --> missing field data file

2010-01-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Jan 6, 2010 at 9:49 PM, Giovanni Fernandez-Kincade wrote: > I set up replication between 2 cores on one master and 2 cores on one slave. > Before doing this the master was working without issues, and I stopped all > indexing on the master. > > Now that replication has synced the index fi

Re: readOnly=true IndexReader

2010-01-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Jan 6, 2010 at 4:26 PM, Patrick Sauts wrote: > In the Wiki page : http://wiki.apache.org/lucene-java/ImproveSearchingSpeed, > I've found > -Open the IndexReader with readOnly=true. This makes a big difference when > multiple threads are sharing the same reader, as it removes certain source

Re: Solr Replication Questions

2010-01-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Jan 6, 2010 at 2:51 AM, Giovanni Fernandez-Kincade wrote: > http://wiki.apache.org/solr/SolrReplication > > I've been looking over this replication wiki and I'm still unclear on a two > points about Solr Replication: > > 1.     If there have been small changes to the index on the master,

Re: replicating extension JARs

2010-01-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
jars are not replicated. It is by design. But that is not to say that we can't do it. open an issue . On Wed, Jan 6, 2010 at 6:20 AM, Ryan Kennedy wrote: > Will the built-in Solr replication replicate extension JAR files in > the "lib" directory? The documentation appears to indicate that only >

Re: serialize SolrInputDocument to java.io.File and back again?

2009-12-31 Thread Noble Paul നോബിള്‍ नोब्ळ्
what serialization would you wish to use? you can use java serialization or solrj helps you serialize it as xml or javabin format (org.apache.solr.client.solrj.request.JavaBinUpdateRequestCodec) On Thu, Dec 31, 2009 at 6:55 AM, Phillip Rhodes wrote: > I want to store a SolrInputDocument to the f

Re: fl parameter and dynamic fields

2009-12-29 Thread Noble Paul നോബിള്‍ नोब्ळ्
if you wish to search on fields using wild-card you have to use a copyField to copy all the values of "Bool_*" to another field and search on that field. On Tue, Dec 29, 2009 at 4:14 AM, Harsch, Timothy J. (ARC-TI)[PEROT SYSTEMS] wrote: > I use dynamic fields heavily in my SOLR config.  I would

Re: Problem with simple use of DIH

2009-12-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
d it worked. > > I think the column names may be case-sensitive, although I haven't proven > that to be the case. I did discover that references to column names in the > velocity template are case sensitive; ${dproduc.DPRPRD} works > and ${dproduc.dprprd} does not. > >

Re: Problem with simple use of DIH

2009-12-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
did you run it w/o the debug? On Sun, Dec 27, 2009 at 6:31 PM, AHMET ARSLAN wrote: >> I'm trying to use DataImportHandler >> to load my index and having some strange >> results. I have two tables in my database. DPRODUC contains >> products and >> FSKUMAS contains the skus related to each product

Re: suggestions for DIH batchSize

2009-12-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
A bigger batchSize results in increased memory usage. I guess performance should be slightly better with bigger values but not verified. On Wed, Dec 23, 2009 at 2:51 AM, Joel Nylund wrote: > Hi, > > it looks like from looking at the code the default is 500, is the > recommended setting for this?

Re: Documents are indexed but not searchable

2009-12-20 Thread Noble Paul നോബിള്‍ नोब्ळ्
just search for *:* and see if the docs are indeed there in the index. --Noble On Mon, Dec 21, 2009 at 9:26 AM, krosan wrote: > > Hi, > > I'm trying to test solr for a proof of concept project, but I'm having some > problems. > > I indexed my document, but when I search for a word which is 100% ce

Re: Is DataImportHandler ThreadSafe???

2009-12-19 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Sat, Dec 19, 2009 at 2:16 PM, gurudev wrote: > > Hi, > Just wanted to know, Is the DataImportHandler available in solr1.3 > thread-safe?. I would like to use multiple instances of data import handler > running concurrently and posting my various set of data from DB to Index. > > Can I do this b

Re: CCU of Solr?

2009-12-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
it is very difficult to say. It depends on the cache hit ratio. If everything is served out of cache you may go upto arounbf 1000 req/sec On Fri, Dec 18, 2009 at 1:39 PM, Olala wrote: > > Hi all! > > I am developing an online dictionary application by using Solr, but I wonder > that how many conc

Re: Question about updateRequestProcessorChain

2009-12-17 Thread Noble Paul നോബിള്‍ नोब्ळ्
At least one processor chain is invoked. if you do not want the custom chain to be invoked create a chain without the name and without your custom processor On Thu, Dec 17, 2009 at 1:16 PM, Shalin Shekhar Mangar wrote: > On Thu, Dec 17, 2009 at 3:35 AM, Manepalli, Kalyan < > kalyan.manepa...@orb

  1   2   3   4   5   6   7   8   9   10   >