RE: DataImportHandler delta-import confusion

[Leann Pereira]

Hi Paul,

Can you take me off this distribution list?

Thanks,

Leann


From: noble.p...@gmail.com [noble.p...@gmail.com] On Behalf Of Noble Paul 
നോബിള്‍  नोब्ळ् [noble.p...@corp.aol.com]
Sent: Tuesday, February 02, 2010 2:12 AM
To: solr-user@lucene.apache.org
Subject: Re: DataImportHandler delta-import confusion

try
deltaImportQuery=select [bunch of stuff]
   WHERE m.moment_id = '${dataimporter.delta.moment_id}'

The key has to be same and in the same case

On Tue, Feb 2, 2010 at 1:45 AM, Jon Drukman jdruk...@gmail.com wrote:
 First, let me just say that DataImportHandler is fantastic. It got my old
 mysql-php-xml index rebuild process down from 30 hours to 6 minutes.

 I'm trying to use the delta-import functionality now but failing miserably.

 Here's my entity tag:  (some SELECT statements reduced to increase
 readability)

 entity name=moment
  query=select ...

  deltaQuery=select moment_id from moments where date_modified 
 '${dataimporter.last_index_time}'

  deltaImportQuery=select [bunch of stuff]
WHERE m.moment_id = '${dataimporter.delta.MOMENTID}'

  pk=MOMENTID

  transformer=TemplateTransformer

 When I look at the MySQL query log I see the date modified query running
 fine and returning 3 rows.  The deltaImportQuery, however, does not have the
 proper primary key in the where clause.  It's just blank.  I also tried
 changing it to ${moment.MOMENTID}.

 I don't really get the relation between the pk field and the
 ${dataimport.delta.whatever} stuff.

 Help please!
 -jsd-






--
-
Noble Paul | Systems Architect| AOL | http://aol.com

Seeking Solr/Nutch consultant in San Jose, CA

[Leann Pereira]

Hi,

I am working with a SaaS vendor who is integrated with Nutch 0.9 and SOLR.  We 
are looking for some help to migrate this to Nutch 1.0.  The work involves:


1)  We made changes to Nutch 0.9;  these need to be ported to Nutch 1.0.

2)  Configure SOLR integration with Nutch 1.0

3)  Configure SOLR to do Japanese indexing;  expose this configuration as 
part of Baynote configuration.

4)  Check if indexes are portable between Nutch 0.9 and Nutch 1.0 - should 
we re-index?

Please email me if there is interest.  The work is in San Jose, CA.  Duration 
and rate are not yet known.

Best regards,

Leann


Leann Pereira | o: +1 650.425.7950 | le...@1sourcestaffing.com | Senior 
Technical Recruiter