Re: Problem cleaning solr index (nutch clean command).

Wed, 06 Jul 2016 02:33:07 -0700 


Hi Sebastian,

Thanks for your answer...

On 07/06/2016 09:51 AM, Sebastian Nagel wrote:

Hi José-Marcio,


There is a bug report (by someone other than me) but no answer there.


https://issues.apache.org/jira/browse/NUTCH-2269


If someone can help me and point me what I'm doing wrong.


Maybe the first step would be to try Nutch 1.12 together with Solr 5.4.1:
this would make it clear whether it's a bug or a version incompatibility.


Just tried and I have the same result. Tried also with Sol5 5.5.1. I haven't 
tried with any SolR 4.x version. Is it useful ?

Well. The core contains 4733 results. "Clean" operation should remove 4180 
documents - so it should remain 553 documents.
1932 documents are indeed removed as core remains with 2801 documents. If I try to repeat the operation, nothing changes. So it may be some particular document which causes the problem. 

If I look the dump of crawldb I have :

[nutch@crawler crawldb]$ grep Status part-00000  | sort | uniq -c
   2827 Status: 2 (db_fetched)
   2241 Status: 3 (db_gone)
      1 Status: 5 (db_redir_perm)
   1939 Status: 7 (db_duplicate)

So, 4180 = 1939 + 2241...

I'll take a look on these URLs to, with some big luck, find something which 
could trigger this behaviour...

1939 is just a little more than 1932... coincidence ? Or "clean" operation 
begins removing duplicate pages ?

Also, this problem was found by other people... :-(

Regards

José-Marcio



Thanks,
Sebastian

On 07/05/2016 03:11 PM, Jose-Marcio Martins da Cruz wrote:


Hello,

Using nutch 1.12 and solr 6.1.0.

I'm trying to launch the "nutch clean" command. Tried many options but nothing 
works.

There is a bug report (by someone other than me) but no answer there.

If someone can help me and point me what I'm doing wrong.

Regards,

José-Marcio

The command line says :
************************

nutch@crawler nutch-sets]$ nutch clean externes/crawldb -D
solr.server.url=http://127.0.0.1:8983/solr/externes
SolrIndexer: deleting 250/250 documents
SolrIndexer: deleting 250/500 documents
SolrIndexer: deleting 250/750 documents
SolrIndexer: deleting 250/1000 documents
SolrIndexer: deleting 250/1250 documents
SolrIndexer: deleting 250/1500 documents
SolrIndexer: deleting 250/1750 documents
SolrIndexer: deleting 250/2000 documents
SolrIndexer: deleting 250/2250 documents
SolrIndexer: deleting 250/2500 documents
SolrIndexer: deleting 250/2750 documents
SolrIndexer: deleting 250/3000 documents
SolrIndexer: deleting 250/3250 documents
SolrIndexer: deleting 250/3500 documents
SolrIndexer: deleting 250/3750 documents
SolrIndexer: deleting 250/4000 documents
SolrIndexer: deleting 180/4180 documents
ERROR CleaningJob: java.io.IOException: Job failed!
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
    at org.apache.nutch.indexer.CleaningJob.delete(CleaningJob.java:172)
    at org.apache.nutch.indexer.CleaningJob.run(CleaningJob.java:195)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.nutch.indexer.CleaningJob.main(CleaningJob.java:206)

[nutch@crawler nutch-sets]$

Nutch log file says :
**********************

2016-07-05 15:00:59,682 INFO  indexer.CleaningJob - CleaningJob: starting at 
2016-07-05 15:00:59
2016-07-05 15:00:59,982 WARN  util.NativeCodeLoader - Unable to load 
native-hadoop library for your
platform... using builtin-java classes where applicable
2016-07-05 15:01:00,562 WARN  conf.Configuration -
file:/tmp/hadoop-nutch/mapred/staging/nutch241558728/.staging/job_local241558728_0001/job.xml:an
attempt to override final parameter: 
mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-07-05 15:01:00,569 WARN  conf.Configuration -
file:/tmp/hadoop-nutch/mapred/staging/nutch241558728/.staging/job_local241558728_0001/job.xml:an
attempt to override final parameter: 
mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-07-05 15:01:00,698 WARN  conf.Configuration -
file:/tmp/hadoop-nutch/mapred/local/localRunner/nutch/job_local241558728_0001/job_local241558728_0001.xml:an
attempt to override final parameter: 
mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2016-07-05 15:01:00,703 WARN  conf.Configuration -
file:/tmp/hadoop-nutch/mapred/local/localRunner/nutch/job_local241558728_0001/job_local241558728_0001.xml:an
attempt to override final parameter: 
mapreduce.job.end-notification.max.attempts;  Ignoring.
2016-07-05 15:01:00,720 WARN  output.FileOutputCommitter - Output Path is null 
in setupJob()
2016-07-05 15:01:01,978 INFO  indexer.IndexWriters - Adding
org.apache.nutch.indexwriter.solr.SolrIndexWriter
2016-07-05 15:01:02,234 INFO  solr.SolrMappingReader - source: content dest: 
content
2016-07-05 15:01:02,234 INFO  solr.SolrMappingReader - source: title dest: title
2016-07-05 15:01:02,235 INFO  solr.SolrMappingReader - source: host dest: host
2016-07-05 15:01:02,235 INFO  solr.SolrMappingReader - source: segment dest: 
segment
2016-07-05 15:01:02,235 INFO  solr.SolrMappingReader - source: boost dest: boost
2016-07-05 15:01:02,235 INFO  solr.SolrMappingReader - source: digest dest: 
digest
2016-07-05 15:01:02,235 INFO  solr.SolrMappingReader - source: tstamp dest: 
tstamp
2016-07-05 15:01:02,261 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/250 documents
2016-07-05 15:01:02,676 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/500 documents
2016-07-05 15:01:02,723 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/750 documents
2016-07-05 15:01:02,763 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/1000 documents
2016-07-05 15:01:02,801 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/1250 documents
2016-07-05 15:01:02,839 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/1500 documents
2016-07-05 15:01:02,880 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/1750 documents
2016-07-05 15:01:02,902 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/2000 documents
2016-07-05 15:01:02,924 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/2250 documents
2016-07-05 15:01:02,943 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/2500 documents
2016-07-05 15:01:02,970 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/2750 documents
2016-07-05 15:01:02,998 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/3000 documents
2016-07-05 15:01:03,028 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/3250 documents
2016-07-05 15:01:03,048 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/3500 documents
2016-07-05 15:01:03,076 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/3750 documents
2016-07-05 15:01:03,096 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
250/4000 documents
2016-07-05 15:01:03,125 INFO  solr.SolrIndexWriter - SolrIndexer: deleting 
180/4180 documents
2016-07-05 15:01:03,454 WARN  output.FileOutputCommitter - Output Path is null 
in cleanupJob()
2016-07-05 15:01:03,455 WARN  mapred.LocalJobRunner - job_local241558728_0001
java.lang.Exception: java.lang.IllegalStateException: Connection pool shut down
        at 
org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
        at 
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:529)
Caused by: java.lang.IllegalStateException: Connection pool shut down
        at org.apache.http.util.Asserts.check(Asserts.java:34)
        at 
org.apache.http.pool.AbstractConnPool.lease(AbstractConnPool.java:169)
        at 
org.apache.http.pool.AbstractConnPool.lease(AbstractConnPool.java:202)
        at
org.apache.http.impl.conn.PoolingClientConnectionManager.requestConnection(PoolingClientConnectionManager.java:184)

        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:415)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:480)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:483)
        at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:464)
        at 
org.apache.nutch.indexwriter.solr.SolrIndexWriter.commit(SolrIndexWriter.java:190)
        at 
org.apache.nutch.indexwriter.solr.SolrIndexWriter.close(SolrIndexWriter.java:178)
        at org.apache.nutch.indexer.IndexWriters.close(IndexWriters.java:115)
        at 
org.apache.nutch.indexer.CleaningJob$DeleterReducer.close(CleaningJob.java:120)
        at org.apache.hadoop.io.IOUtils.cleanup(IOUtils.java:237)
        at 
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:459)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
        at 
org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
2016-07-05 15:01:03,746 ERROR indexer.CleaningJob - CleaningJob: 
java.io.IOException: Job failed!
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
        at org.apache.nutch.indexer.CleaningJob.delete(CleaningJob.java:172)
        at org.apache.nutch.indexer.CleaningJob.run(CleaningJob.java:195)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.nutch.indexer.CleaningJob.main(CleaningJob.java:206)


SolR log file says :
********************


2016-07-05 13:01:02.622 INFO  (qtp1634198-13) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.epnoe.eu/EPNOE-CSA/Overview 
(-1539019807219777536),
http://www.carnot-mines.eu/transferts/transferts-réussis/traitement-syngaz 
(-1539019807223971840),
http://www.carnot-mines.eu/transferts/transferts-réussis/qualité-et 
(-1539019807225020416),
http://www.carnot-mines.eu/transferts/centres-thematiques/mathématiques-9 
(-1539019807225020417),
http://www.carnot-mines.eu/transferts/0.85 (-1539019807225020418),
http://www.carnot-mines.eu/sites/default/files/xjvkjz (-1539019807225020419),
http://www.carnot-mines.eu/node/centres-thematiques/mathématiques-9 
(-1539019807226068992),
http://www.carnot-mines.eu/node/agenda/feed (-1539019807226068993),
http://www.carnot-mines.eu/node/1.8 (-1539019807226068994), 
http://www.carnot-mines.eu/node/0.85
(-1539019807227117568), ... (250 deletes)]} 0 170

2016-07-05 13:01:02.708 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.armines.net/fr/domaines-dapplication/ressources-et-environnement/0.85
(-1539019807322537984),
http://www.armines.net/fr/domaines-dapplication/informatique/maitrise-calculs
(-1539019807323586560),
http://www.armines.net/fr/domaines-dapplication/informatique/ingénierie-modèles
(-1539019807323586561), http://www.armines.net/fr/domaines-dapplication/0.85 
(-1539019807323586562),
http://www.armines.net/fr/des-sécurité (-1539019807323586563), 
http://www.armines.net/fr/chargée-0
(-1539019807323586564), 
http://www.armines.net/fr/centres-thematiques/sciences-matériaux
(-1539019807324635136), 
http://www.armines.net/fr/centres-thematiques/mathématiques-9
(-1539019807324635137), 
http://www.armines.net/fr/centres-thematiques/mathématiques-7
(-1539019807324635138), 
http://www.armines.net/fr/centres-thematiques/mathématiques-5
(-1539019807324635139), ... (250 deletes)]} 0 25

2016-07-05 13:01:02.753 INFO  (qtp1634198-15) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/ri/2012/resumes/fevrier/08-2012.html
(-1539019807369723904), 
http://www.annales.org/site/ri/2012/resumes/fevrier/06-2012.html
(-1539019807370772480), 
http://www.annales.org/site/ri/2012/resumes/fevrier/04-2012.html
(-1539019807370772481), 
http://www.annales.org/site/ri/2012/resumes/fevrier/02-2012.html
(-1539019807370772482), 
http://www.annales.org/site/ri/2012/resumes/aout/20-2012.html
(-1539019807370772483), 
http://www.annales.org/site/ri/2012/resumes/aout/19-2012.html
(-1539019807370772484), 
http://www.annales.org/site/ri/2012/resumes/aout/17-2012.html
(-1539019807370772485), 
http://www.annales.org/site/ri/2012/resumes/aout/15-2012.html
(-1539019807370772486), 
http://www.annales.org/site/ri/2012/resumes/aout/13-2012.html
(-1539019807370772487), 
http://www.annales.org/site/ri/2012/resumes/aout/11-2012.html
(-1539019807371821056), ... (250 deletes)]} 0 24

2016-07-05 13:01:02.794 INFO  (qtp1634198-19) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/gc/tab-gc.html
(-1539019807412715520), 
http://www.annales.org/site/gc/resum-espagnol/2016/annales.org
(-1539019807412715521),
http://www.annales.org/site/gc/resum-espagnol/2015/espagnol_gc_juin-2015.html
(-1539019807413764096),
http://www.annales.org/site/gc/resum-espagnol/2014/espagnol_gc_juin-2014.html
(-1539019807413764097), 
http://www.annales.org/site/gc/resum-espagnol/2014/annales.org
(-1539019807413764098), 
http://www.annales.org/site/gc/resum-espagnol/2013/espagnol_
gc_mars-2013.html (-1539019807413764099),
http://www.annales.org/site/gc/resum-espagnol/2013/espagnol_ 
gc_decembre-2013.html
(-1539019807413764100), 
http://www.annales.org/site/gc/resum-espagnol/2012/espagnol_
gc_decembre-2012.html (-1539019807413764101),
http://www.annales.org/site/gc/resum-anglais/2016/annales.org 
(-1539019807413764102),
http://www.annales.org/site/gc/resum-anglais/2015/anglais_gc_juin-2015.html 
(-1539019807413764103),
... (250 deletes)]} 0 24

2016-07-05 13:01:02.832 INFO  (qtp1634198-21) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/archives/x/promo-1858.html
(-1539019807457804288), http://www.annales.org/site/archives/x/presentation.html
(-1539019807458852864), http://www.annales.org/site/archives/x/pralon.html 
(-1539019807458852865),
http://www.annales.org/site/archives/x/pourcel2.html (-1539019807458852866),
http://www.annales.org/site/archives/x/pourcel.html (-1539019807458852867),
http://www.annales.org/site/archives/x/ponteves.html (-1539019807459901440),
http://www.annales.org/site/archives/x/polonceau.html (-1539019807459901441),
http://www.annales.org/site/archives/x/poincare7.html (-1539019807459901442),
http://www.annales.org/site/archives/x/poincare5.html (-1539019807459901443),
http://www.annales.org/site/archives/x/poinc.doc (-1539019807459901444), ... 
(250 deletes)]} 0 19

2016-07-05 13:01:02.873 INFO  (qtp1634198-18) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/archives/x/fmayer.html
(-1539019807494504448), http://www.annales.org/site/archives/x/flandrin.html 
(-1539019807495553024),
http://www.annales.org/site/archives/x/fisch1.html (-1539019807495553025),
http://www.annales.org/site/archives/x/fevre.html (-1539019807495553026),
http://www.annales.org/site/archives/x/ferry2.html (-1539019807495553027),
http://www.annales.org/site/archives/x/ferry.html (-1539019807495553028),
http://www.annales.org/site/archives/x/ferron.html (-1539019807495553029),
http://www.annales.org/site/archives/x/fbernard.html (-1539019807495553030),
http://www.annales.org/site/archives/x/fayol3.html (-1539019807495553031),
http://www.annales.org/site/archives/x/faujas.html (-1539019807495553032), ... 
(250 deletes)]} 0 25

2016-07-05 13:01:02.895 INFO  (qtp1634198-16) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/archives/x/Actes_du_26_mai.pdf
(-1539019807534350336), 
http://www.annales.org/site/archives/x/Actes_du_26_mai.doc
(-1539019807534350337), http://www.annales.org/site/archives/x/AN64_histoire.pdf
(-1539019807534350338), http://www.annales.org/site/archives/x/ABC.html 
(-1539019807534350339),
http://www.annales.org/site/archives/vpcgm.html (-1539019807534350340),
http://www.annales.org/site/archives/textes.html (-1539019807534350341),
http://www.annales.org/site/archives/panneaux/Schlumberger.pdf 
(-1539019807534350342),
http://www.annales.org/site/archives/panneaux/Schaeffer.pdf 
(-1539019807534350343),
http://www.annales.org/site/archives/panneaux/Pellenc.pdf 
(-1539019807534350344),
http://www.annales.org/site/archives/panneaux/Painvin.pdf 
(-1539019807534350345), ... (250
deletes)]} 0 9

2016-07-05 13:01:02.915 INFO  (qtp1634198-12) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/ri/2013/resumes/novembre/07-2013.html
(-1539019807557419008), 
http://www.annales.org/ri/2013/resumes/novembre/05-2013.html
(-1539019807557419009), 
http://www.annales.org/ri/2013/resumes/novembre/03-2013.html
(-1539019807557419010), 
http://www.annales.org/ri/2013/resumes/novembre/01-2013.html
(-1539019807557419011), http://www.annales.org/ri/2013/resumes/mai/17-2013.html
(-1539019807557419012), http://www.annales.org/ri/2013/resumes/mai/15-2013.html
(-1539019807557419013), http://www.annales.org/ri/2013/resumes/mai/13-2013.html
(-1539019807557419014), http://www.annales.org/ri/2013/resumes/mai/11-2013.html
(-1539019807557419015), http://www.annales.org/ri/2013/resumes/mai/08-2013.html
(-1539019807557419016), http://www.annales.org/ri/2013/resumes/mai/06-2013.html
(-1539019807557419017), ... (250 deletes)]} 0 7

2016-07-05 13:01:02.936 INFO  (qtp1634198-13) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/gc/2014/resumes/juin/02-2014.html
(-1539019807580487680), 
http://www.annales.org/gc/2014/resumes/decembre/07-2014.html
(-1539019807580487681), 
http://www.annales.org/gc/2014/resumes/decembre/05-2014.html
(-1539019807580487682), 
http://www.annales.org/gc/2014/resumes/decembre/03-2014.html
(-1539019807580487683), 
http://www.annales.org/gc/2014/resumes/decembre/01-2014.html
(-1539019807580487684), http://www.annales.org/gc/2014/edito-2014.pdf 
(-1539019807580487685),
http://www.annales.org/gc/2013/resumes/septembre/07-2013.html 
(-1539019807580487686),
http://www.annales.org/gc/2013/resumes/septembre/05-2013.html 
(-1539019807580487687),
http://www.annales.org/gc/2013/resumes/septembre/03-2013.html 
(-1539019807580487688),
http://www.annales.org/gc/2013/resumes/septembre/01-2013.html 
(-1539019807580487689), ... (250
deletes)]} 0 7

2016-07-05 13:01:02.964 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.carnot-mines.eu/en/carnot-mines-tv/mathématiques-systèmes/innovation-flexible
(-1539019807608799232),
http://www.carnot-mines.eu/en/carnot-mines-tv/mathématiques-systèmes/imagerie-xénon
(-1539019807608799233),
http://www.carnot-mines.eu/en/carnot-mines-tv/mathématiques-systèmes/cbio-vessie
(-1539019807608799234), 
http://www.carnot-mines.eu/en/carnot-mines-tv/mathématiques-systèmes/0.85
(-1539019807608799235),
http://www.carnot-mines.eu/en/carnot-mines-tv/centres-thematiques/mathématiques-9
(-1539019807608799236), http://www.carnot-mines.eu/en/carnot-mines-tv/1.8 
(-1539019807608799237),
http://www.carnot-mines.eu/en/carnot-mines-tv/0.85 (-1539019807608799238),
http://www.carnot-mines.eu/en/carnot-mines-tv/énergétique-procédés/smart-electric-lyon
(-1539019807608799239),
http://www.carnot-mines.eu/en/carnot-mines-tv/énergétique-procédés/industrialisation-la
(-1539019807608799240),
http://www.carnot-mines.eu/en/carnot-mines-tv/énergétique-procédés/des-infimes
(-1539019807608799241), ... (250 deletes)]} 0 7

2016-07-05 13:01:02.991 INFO  (qtp1634198-15) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/ri/2015/fevrier/13-2015.html
(-1539019807637110784), http://www.annales.org/site/ri/2015/fevrier/11-2015.html
(-1539019807637110785), http://www.annales.org/site/ri/2015/fevrier/08-2015.html
(-1539019807637110786), http://www.annales.org/site/ri/2015/fevrier/06-2015.html
(-1539019807637110787), http://www.annales.org/site/ri/2015/fevrier/04-2015.html
(-1539019807637110788), http://www.annales.org/site/ri/2015/fevrier/02-2015.html
(-1539019807637110789), 
http://www.annales.org/site/ri/2014/ri_novembre_2014.html
(-1539019807637110790), http://www.annales.org/site/ri/2014/ri-editorial.pdf 
(-1539019807637110791),
http://www.annales.org/site/ri/2014/resumes/novembre/17-2014.html 
(-1539019807637110792),
http://www.annales.org/site/ri/2014/resumes/novembre/15-2014.html 
(-1539019807637110793), ... (250
deletes)]} 0 7

2016-07-05 13:01:03.017 INFO  (qtp1634198-19) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/re/2013/resumes/juillet/01-2013.html
(-1539019807665422336), 
http://www.annales.org/site/re/2013/resumes/janvier/16-2013.html
(-1539019807665422337), 
http://www.annales.org/site/re/2013/resumes/janvier/14-2013.html
(-1539019807665422338), 
http://www.annales.org/site/re/2013/resumes/janvier/12-2013.html
(-1539019807665422339), 
http://www.annales.org/site/re/2013/resumes/janvier/10-2013.html
(-1539019807665422340), 
http://www.annales.org/site/re/2013/resumes/janvier/09-2013.html
(-1539019807665422341), 
http://www.annales.org/site/re/2013/resumes/janvier/07-2013.html
(-1539019807665422342), 
http://www.annales.org/site/re/2013/resumes/janvier/05-2013.html
(-1539019807665422343), 
http://www.annales.org/site/re/2013/resumes/janvier/03-2013.html
(-1539019807665422344), 
http://www.annales.org/site/re/2013/resumes/janvier/01-2013.html
(-1539019807665422345), ... (250 deletes)]} 0 8

2016-07-05 13:01:03.041 INFO  (qtp1634198-21) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/bicentenaire/blank.html
(-1539019807688491008), http://www.annales.org/site/bicentenaire/banniere.html
(-1539019807689539584),
http://www.annales.org/site/bicentenaire/audios/audios_7_octobre_2010/audio_7_octobre_2010.html
(-1539019807689539585), http://www.annales.org/site/bicentenaire/accueil.html
(-1539019807689539586), 
http://www.annales.org/site/archives/yvesmartin/transport.html
(-1539019807689539587),
http://www.annales.org/site/archives/yvesmartin/table_des_matieres_effet_de_serre.html
(-1539019807689539588), 
http://www.annales.org/site/archives/yvesmartin/politique_energetique.html
(-1539019807689539589), 
http://www.annales.org/site/archives/yvesmartin/gestion_de_leau.html
(-1539019807689539590), 
http://www.annales.org/site/archives/yvesmartin/divers.html
(-1539019807689539591), 
http://www.annales.org/site/archives/yvesmartin/1992-12-00.pdf
(-1539019807689539592), ... (250 deletes)]} 0 8

2016-07-05 13:01:03.059 INFO  (qtp1634198-18) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/archives/x/lame2.html
(-1539019807709462528), http://www.annales.org/site/archives/x/lame.html 
(-1539019807709462529),
http://www.annales.org/site/archives/x/lambert.html (-1539019807709462530),
http://www.annales.org/site/archives/x/lahoussay.html (-1539019807709462531),
http://www.annales.org/site/archives/x/laffitte.html (-1539019807709462532),
http://www.annales.org/site/archives/x/lacombe2.html (-1539019807710511104),
http://www.annales.org/site/archives/x/lacombe.html (-1539019807710511105),
http://www.annales.org/site/archives/x/lacepede.html (-1539019807710511106),
http://www.annales.org/site/archives/x/labophy.html (-1539019807710511107),
http://www.annales.org/site/archives/x/koninck.html (-1539019807710511108), ... 
(250 deletes)]} 0 6

2016-07-05 13:01:03.090 INFO  (qtp1634198-16) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/archives/x/c4.html
(-1539019807741968384), http://www.annales.org/site/archives/x/c2.html 
(-1539019807741968385),
http://www.annales.org/site/archives/x/buvignier.html (-1539019807741968386),
http://www.annales.org/site/archives/x/burelle.html (-1539019807741968387),
http://www.annales.org/site/archives/x/brun.html (-1539019807741968388),
http://www.annales.org/site/archives/x/brongniart1.html (-1539019807741968389),
http://www.annales.org/site/archives/x/brochin.html (-1539019807741968390),
http://www.annales.org/site/archives/x/brochant.html (-1539019807741968391),
http://www.annales.org/site/archives/x/braure.html (-1539019807741968392),
http://www.annales.org/site/archives/x/brard.html (-1539019807741968393), ... 
(250 deletes)]} 0 6

2016-07-05 13:01:03.114 INFO  (qtp1634198-12) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/site/archives/cofrhigeo/bertrand-dd.html
 (-1539019807767134208),
http://www.annales.org/site/archives/cofrhigeo/beguyer.html 
(-1539019807768182784),
http://www.annales.org/site/archives/cofrhigeo/barrande.html 
(-1539019807768182785),
http://www.annales.org/site/archives/cofrhigeo/barrabe.html 
(-1539019807768182786),
http://www.annales.org/site/archives/cofrhigeo/barbier.html 
(-1539019807768182787),
http://www.annales.org/site/archives/cofrhigeo/amedee-burat.pdf 
(-1539019807768182788),
http://www.annales.org/site/archives/cofrhigeo/alpine.html 
(-1539019807768182789),
http://www.annales.org/site/archives/cofrhigeo/albert-le-grand.html 
(-1539019807768182790),
http://www.annales.org/site/archives/cofrhigeo/Petrographie.pdf 
(-1539019807768182791),
http://www.annales.org/site/archives/cofrhigeo/Coulomb.html 
(-1539019807768182792), ... (250
deletes)]} 0 6

2016-07-05 13:01:03.135 INFO  (qtp1634198-13) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={wt=javabin&version=2}{delete=[http://www.annales.org/re/2014/resumes/juillet/01-2014.html
(-1539019807790202880), 
http://www.annales.org/re/2014/resumes/janvier/10-2014.html
(-1539019807791251456), 
http://www.annales.org/re/2014/resumes/janvier/09-2014.html
(-1539019807791251457), 
http://www.annales.org/re/2014/resumes/janvier/07-2014.html
(-1539019807791251458), 
http://www.annales.org/re/2014/resumes/janvier/05-2014.html
(-1539019807791251459), 
http://www.annales.org/re/2014/resumes/janvier/03-2014.html
(-1539019807791251460), 
http://www.annales.org/re/2014/resumes/janvier/01-2014.html
(-1539019807791251461), 
http://www.annales.org/re/2014/resumes/avril/13-2014.html
(-1539019807791251462), 
http://www.annales.org/re/2014/resumes/avril/11-2014.html
(-1539019807791251463), 
http://www.annales.org/re/2014/resumes/avril/08-2014.html
(-1539019807791251464), ... (180 deletes)]} 0 4

2016-07-05 13:01:03.144 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.u.DirectUpdateHandler2 start
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}


2016-07-05 13:01:03.394 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.c.SolrDeletionPolicy
SolrDeletionPolicy.onCommit: commits: num=2
    
commit{dir=NRTCachingDirectory(MMapDirectory@/export/var/solr/data/externes/data/index
lockFactory=org.apache.lucene.store.NativeFSLockFactory@45e31c76; 
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_3x,generation=141}
    
commit{dir=NRTCachingDirectory(MMapDirectory@/export/var/solr/data/externes/data/index
lockFactory=org.apache.lucene.store.NativeFSLockFactory@45e31c76; 
maxCacheMB=48.0
maxMergeSizeMB=4.0),segFN=segments_3y,generation=142}

2016-07-05 13:01:03.394 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.c.SolrDeletionPolicy newest
commit generation = 142

2016-07-05 13:01:03.401 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.s.SolrIndexSearcher Opening
[Searcher@52c19010[externes] main]

2016-07-05 13:01:03.413 INFO  
(searcherExecutor-32-thread-1-processing-x:externes) [   x:externes]
o.a.s.c.QuerySenderListener QuerySenderListener sending requests to 
Searcher@52c19010[externes]
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_30(6.1.0):C4)
Uninverting(_31(6.1.0):C95/1:delGen=1) 
Uninverting(_3h(6.1.0):C4517/1830:delGen=1)
Uninverting(_3c(6.1.0):C76/75:delGen=1) Uninverting(_3d(6.1.0):C7/6:delGen=1)
Uninverting(_3e(6.1.0):C3/2:delGen=1) Uninverting(_3q(6.1.0):c20/10:delGen=1)
Uninverting(_3r(6.1.0):C2/1:delGen=1) Uninverting(_3s(6.1.0):C2/1:delGen=1)
Uninverting(_3t(6.1.0):C2/1:delGen=1)))}

2016-07-05 13:01:03.414 INFO  
(searcherExecutor-32-thread-1-processing-x:externes) [   x:externes]
o.a.s.c.QuerySenderListener QuerySenderListener done.

2016-07-05 13:01:03.414 INFO  
(searcherExecutor-32-thread-1-processing-x:externes) [   x:externes]
o.a.s.c.SolrCore [externes] Registered new searcher Searcher@52c19010[externes]
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_30(6.1.0):C4)
Uninverting(_31(6.1.0):C95/1:delGen=1) 
Uninverting(_3h(6.1.0):C4517/1830:delGen=1)
Uninverting(_3c(6.1.0):C76/75:delGen=1) Uninverting(_3d(6.1.0):C7/6:delGen=1)
Uninverting(_3e(6.1.0):C3/2:delGen=1) Uninverting(_3q(6.1.0):c20/10:delGen=1)
Uninverting(_3r(6.1.0):C2/1:delGen=1) Uninverting(_3s(6.1.0):C2/1:delGen=1)
Uninverting(_3t(6.1.0):C2/1:delGen=1)))}

2016-07-05 13:01:03.446 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.u.DirectUpdateHandler2
end_commit_flush

2016-07-05 13:01:03.447 INFO  (qtp1634198-17) [   x:externes] 
o.a.s.u.p.LogUpdateProcessorFactory
[externes] webapp=/solr path=/update
params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=}
 0 303








--

 Envoyé de ma machine à écrire.
 ---------------------------------------------------------------
  Spam : Classement statistique de messages électroniques -
         Une approche pragmatique
  Chez Amazon.fr : http://amzn.to/LEscRu ou http://bit.ly/SpamJM
 ---------------------------------------------------------------
 Jose Marcio MARTINS DA CRUZ            http://www.j-chkmail.org
 Ecole des Mines de Paris                   http://bit.ly/SpamJM
 60, bd Saint Michel                      75272 - PARIS CEDEX 06

Reply via email to