Another thing I could not able to figure out how the time zone is getting
changed after the failure.
20161211 125058 [] [(_start_indexing_file) File to index:
/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/001_check_log_size.log
Save Index location:
/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1
FileSeek pointer start : 17794 Final Flag: 1
20161211 175059 [] ****************************************
20161211 175059 [] * FAIL: [FAILED]: Retrying to add doc at path:
/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1
: rename from
'/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema.temp'
to
'/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema_e4.json'
failed: No such file or directory
20161211 175059 [] * LUCY_Schema_Write_IMP at core/Lucy/Plan/Schema.c line
429
20161211 175059 [] * at
/x/eng/bbrtp/users/rajivg/dotdev_052309_4015413_1612060522/test/nate/bin/../lib/NATE/LucyIndexerUtils.pm
line 3278, <$fhlogfile> line 46.
20161211 175059 [] * eval {...} called at
/x/eng/bbrtp/users/rajivg/dotdev_052309_4015413_1612060522/test/nate/bin/../lib/NATE/LucyIndexerUtils.pm
line 3265
20161211 175059 [] *
NATE::LucyIndexerUtils::_lucy_add_doc('NATE::LucyIndexerUtils=HASH(0x2917050)',
'HASH(0x3116398)') called at
/x/eng/bbrtp/users/rajivg/dotdev_052309_4015413_1612060522/test/nate/bin/../lib/NATE/LucyIndexerUtils.pm
line 3169
It is exactly shifting by 5 hrs. from EST. These logs are nothing but the
STDOUT moving to one file and I'm using localtime(time()) and format it to
generate the time string.
Thanks,
Rajiv Gutpta
-----Original Message-----
From: Gupta, Rajiv
Sent: Monday, December 12, 2016 10:08 AM
To: [email protected]
Subject: RE: [lucy-user] LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c
line 119
Can't open
'/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1/seg_fd/lexicon-7.ixix':
Invalid argument
20161211 182109 [] * LUCY_FSFolder_Local_Open_FileHandle_IMP at
core/Lucy/Store/FSFolder.c line 118
20161211 182109 [] * LUCY_Folder_Local_Open_In_IMP at
core/Lucy/Store/Folder.c line 101
20161211 182109 [] * LUCY_Folder_Open_In_IMP at core/Lucy/Store/Folder.c
line 75
There are two more failures they also failed due so similar reasons
rename from
'/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema.temp'
to
'/u/smoke/presub/logs/cit-fg-adr-ndo-rtp.rajivg.1481473039.49384_cmode_1of1/.lucyindex/1/schema_e4.json'
failed: No such file or directory
Can't delete 'lexicon-3.ix'
I believe all three are related to race condition while doing parallel indexing
and should go away with retries. However my retries started failing with
different error which is strange to me as if directory already exists shouldn't
it skip from create attempt.
20161211 182109 [] * FAIL: [FAILED]: Retrying to add doc at path:
/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1
: Couldn't create directory
'/u/smoke/presub/logs/cit-fg-adr-neg-rtp.rajivg.1481473130.41339_cmode_1of1/.lucyindex/1':
No such file or directory
20161211 182109 [] * LUCY_FSFolder_Initialize_IMP at
core/Lucy/Store/FSFolder.c line 102
So my all retry attempts were also failed.
Now I have put one more condition on before Index creation if directory exists
or not before retry :(
My failure rate is now 7/10. Target to achieve at least 9/10.
-Rajiv
-----Original Message-----
From: Nick Wellnhofer [mailto:[email protected]]
Sent: Sunday, December 11, 2016 3:58 PM
To: [email protected]
Subject: Re: [lucy-user] LUCY_Folder_Open_Out_IMP at core/Lucy/Store/Folder.c
line 119
On 10/12/2016 17:25, Gupta, Rajiv wrote:
> Any timeline when 0.6.1 will be released?
0.6.1 is on schedule to be released in a few days.
Nick
