Re: [Virtuoso-users] full-text indexing after mass import (was: rdf_loader_run logs "missed delete of name id cache" messages)

[Jörn Hees]

Hi,

any ideas on this?

> On 23 Nov 2015, at 04:01, Jörn Hees  wrote:
> 
>>> 
>>> Reading the doc page, i have two remaining questions:
>>> 
>>> After a normal `rdf_loader_run()`, would a 
>>> `DB.DBA.VT_INC_INDEX_DB_DBA_RDF_OBJ();` be sufficient to get a complete 
>>> full-text index? Or do i have to run `DB.DBA.RDF_OBJ_FT_RECOVER();` in 
>>> those cases and will otherwise never arrive at a complete free-text index 
>>> (not even after the background tasks finished?)?
>> 
>> [Hugh] The scheduler will run `DB.DBA.VT_INC_INDEX_DB_DBA_RDF_OBJ();` so you 
>> can wait for it to run or run it manually itself.
> 
> 
> Yes, that's what i understood, but in the 
> http://docs.openlinksw.com/virtuoso/sparqlextensions.html#rdfsparqlrulefulltext
>  there's this remark:
> 
>> One problem related to free-text indexing of DB.DBA.RDF_QUAD is that some 
>> applications (e.g. those that import billions of triples) may set off 
>> triggers. This will make free-text index data incomplete. Calling procedure 
>> DB.DBA.RDF_OBJ_FT_RECOVER () will insert all missing free-text index items 
>> by dropping and re-inserting every existing free-text index rule.
> 
> So i'm asking: is `rdf_loader_run();` one of those "applications" which 
> deactivate some triggers leading to an incomplete full-text index and need 
> `DB.DBA.RDF_OBJ_FT_RECOVER();` to be called?

Or is it enough to wait or call `DB.DBA.VT_INC_INDEX_DB_DBA_RDF_OBJ();`?


Cheers,

Jörn


--
Go from Idea to Many App Stores Faster with Intel(R) XDK
Give your users amazing mobile app experiences with Intel(R) XDK.
Use one codebase in this all-in-one HTML5 development environment.
Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs.
http://pubads.g.doubleclick.net/gampad/clk?id=254741911=/4140
___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users

[Virtuoso-users] traps: virtuoso-t[54165] general protection ip:931aa7 sp:7f9b34d2eda0 error:0 in virtuoso-t[400000+c00000]

[Jörn Hees]

Hi,

i'm running a machine learning algorithm against a local Virtuoso 7.2.1 SPARQL 
endpoint containing ~ 6 G triples...

After several weeks of using it (including reboots etc.) tonight it crashed 
after > 6h of heavy load with no further information in any of the logs than 
this in dmesg:

> traps: virtuoso-t[54165] general protection ip:931aa7 sp:7f9b34d2eda0 error:0 
> in virtuoso-t[40+c0]


It seems like it tried to access some memory it wasn't meant to access and the 
kernel simply killed it for that:
https://en.wikipedia.org/wiki/General_protection_fault

Did anyone ever experienced something similar?
Any reasonable way i could maybe get some more meaningful log if that happens 
again?

Best,
Jörn


--
Go from Idea to Many App Stores Faster with Intel(R) XDK
Give your users amazing mobile app experiences with Intel(R) XDK.
Use one codebase in this all-in-one HTML5 development environment.
Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs.
http://pubads.g.doubleclick.net/gampad/clk?id=254741911=/4140
___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users