Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
well, the index problem already is resolved. A real showstopper is the dbus problem though :( http://bugreports.qt.nokia.com/browse/QTBUG-7475 Cheers, Sebastian Will Stephenson wrote: On Saturday 06 February 2010 15:11:24 Sebastian Trueg wrote: the big problem is that I cannot reproduce this error. Even without the patch queries work... I need to look into that when I am back from the FOSDEM. I can reproduce it with 4.3.98, soprano 2.3.70, virtuoso 6.1. I asked Sebas, and since he got it working he is using soprano 2.3.73 out of kdesupport trunk, not the blessed for 4.4 2.3.70 version. Is the soprano version relevant? Log extract searching for a file by file name: /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 : SQLExecDirect failed on quer y 'sparql select distinct ?r where { { { ?r ?v1 ?v2 . ?v2 bif:contains 'Bread Sauce.pdf*' . } U NION { ?r ?v1 ?v3 . ?v3 ?v4 ?v2 . ?v4 http://www.w3.org/2000/01/rdf-schema#subPropertyOf http:// www.w3.org/2000/01/rdf-schema#label . ?v2 bif:contains 'Bread Sauce.pdf*' . } . { ?r a ?v5 . ?v5 http://www.w3.org/2000/01/rdf-schema#subClassOf http://www.semanticdesktop.org/ontologies/2007/ 03/22/nfo#FileDataObject . } UNION { ?r a ?v6 . ?v6 http://www.w3.org/2000/01/rdf-schema#subClass Of http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#Folder . } . } . }' (iODBC Error: [OpenLink][Virtuoso iODBC Driver][Virtuoso Server]SQ200: Table referenced in contains does not hav e a text index) /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 : Invalid iterator. nepomukqueryservice(3215)/nepomuk (query service) Nepomuk::Query::SearchThread::run: 5 nepomukqueryservice(3215)/nepomuk (query service) Nepomuk::Query::SearchCore::slotFinished: I am for delaying the release until this is resolved. Will Cheers, Sebastian Hey Sebastian, On Friday 05 February 2010 09:10:36 Sebastian Trueg wrote: Please try the attached patch in kdebase/runtime/nepomuk/services/storage. And if it helps, please apply as I am in the train all day. Starting nepomuk will take a long time probably since the whole index needs to be rebuilt. That doesn't seem to help. (I've only rebuilt/installed that particular directory.) The error is apparently the same still. I've attached an updated log from my nepomukserver (gave it some time to start up, the initial CPU load had definitely settled). I'll be on IRC all day and tonight, you can catch me there (or by email, of course). Sebastian Trueg wrote: yeah... damn, apparently the text index is not enabled by default anymore. Still was in 6.0.x snapshots I had. This is fixed with a simple patch to the storage service though. Maybe we need to port that back to the 4.4.0 tag, too. Thanks, -- sebas http://www.kde.org | http://vizZzion.org | GPG Key ID: 9119 0EF9 ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
On Monday 08 February 2010 21:39:43 you wrote: well, the index problem already is resolved. Sorry, I should have said that I started with a clean apps/nepomuk - no conversion. If you said the index problem resolved on the basis of Sebas' experience, I'm afraid mine contradicts that. Will A real showstopper is the dbus problem though :( http://bugreports.qt.nokia.com/browse/QTBUG-7475 Yuck. Cheers, Sebastian Will Stephenson wrote: On Saturday 06 February 2010 15:11:24 Sebastian Trueg wrote: the big problem is that I cannot reproduce this error. Even without the patch queries work... I need to look into that when I am back from the FOSDEM. I can reproduce it with 4.3.98, soprano 2.3.70, virtuoso 6.1. I asked Sebas, and since he got it working he is using soprano 2.3.73 out of kdesupport trunk, not the blessed for 4.4 2.3.70 version. Is the soprano version relevant? Log extract searching for a file by file name: /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 : SQLExecDirect failed on quer y 'sparql select distinct ?r where { { { ?r ?v1 ?v2 . ?v2 bif:contains 'Bread Sauce.pdf*' . } U NION { ?r ?v1 ?v3 . ?v3 ?v4 ?v2 . ?v4 http://www.w3.org/2000/01/rdf-schema#subPropertyOf http:// www.w3.org/2000/01/rdf-schema#label . ?v2 bif:contains 'Bread Sauce.pdf*' . } . { ?r a ?v5 . ?v5 http://www.w3.org/2000/01/rdf-schema#subClassOf http://www.semanticdesktop.org/ontologies/2007/ 03/22/nfo#FileDataObject . } UNION { ?r a ?v6 . ?v6 http://www.w3.org/2000/01/rdf-schema#subClass Of http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#Folder . } . } . }' (iODBC Error: [OpenLink][Virtuoso iODBC Driver][Virtuoso Server]SQ200: Table referenced in contains does not hav e a text index) /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 : Invalid iterator. nepomukqueryservice(3215)/nepomuk (query service) Nepomuk::Query::SearchThread::run: 5 nepomukqueryservice(3215)/nepomuk (query service) Nepomuk::Query::SearchCore::slotFinished: I am for delaying the release until this is resolved. Will Cheers, Sebastian Hey Sebastian, On Friday 05 February 2010 09:10:36 Sebastian Trueg wrote: Please try the attached patch in kdebase/runtime/nepomuk/services/storage. And if it helps, please apply as I am in the train all day. Starting nepomuk will take a long time probably since the whole index needs to be rebuilt. That doesn't seem to help. (I've only rebuilt/installed that particular directory.) The error is apparently the same still. I've attached an updated log from my nepomukserver (gave it some time to start up, the initial CPU load had definitely settled). I'll be on IRC all day and tonight, you can catch me there (or by email, of course). Sebastian Trueg wrote: yeah... damn, apparently the text index is not enabled by default anymore. Still was in 6.0.x snapshots I had. This is fixed with a simple patch to the storage service though. Maybe we need to port that back to the 4.4.0 tag, too. Thanks, -- sebas http://www.kde.org | http://vizZzion.org | GPG Key ID: 9119 0EF9 ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
the big problem is that I cannot reproduce this error. Even without the patch queries work... I need to look into that when I am back from the FOSDEM. Cheers, Sebastian Hey Sebastian, On Friday 05 February 2010 09:10:36 Sebastian Trueg wrote: Please try the attached patch in kdebase/runtime/nepomuk/services/storage. And if it helps, please apply as I am in the train all day. Starting nepomuk will take a long time probably since the whole index needs to be rebuilt. That doesn't seem to help. (I've only rebuilt/installed that particular directory.) The error is apparently the same still. I've attached an updated log from my nepomukserver (gave it some time to start up, the initial CPU load had definitely settled). I'll be on IRC all day and tonight, you can catch me there (or by email, of course). Sebastian Trueg wrote: yeah... damn, apparently the text index is not enabled by default anymore. Still was in 6.0.x snapshots I had. This is fixed with a simple patch to the storage service though. Maybe we need to port that back to the 4.4.0 tag, too. Thanks, -- sebas http://www.kde.org | http://vizZzion.org | GPG Key ID: 9119 0EF9 ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
Hey, On Saturday 06 February 2010 15:11:24 Sebastian Trueg wrote: the big problem is that I cannot reproduce this error. Even without the patch queries work... I need to look into that when I am back from the FOSDEM. I've re-run the converter (backups FTW!), and while the first query doesn't return anything, it now works as expected -- and is much faster as well. :) -- sebas http://www.kde.org | http://vizZzion.org | GPG Key ID: 9119 0EF9 signature.asc Description: This is a digitally signed message part. ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
yeah... damn, apparently the text index is not enabled by default anymore. Still was in 6.0.x snapshots I had. This is fixed with a simple patch to the storage service though. Maybe we need to port that back to the 4.4.0 tag, too. Cheers, Sebastian Sebastian Kügler wrote: On Thursday 04 February 2010 23:18:18 Sebastian Trueg wrote: Anyway, the converter is hacky tool allowing early adopters of KDE 4.4 who already tries Nepomuk with Virtuoso 5 (and thus, compile themselves!) to easily convert their data. Distro's who have provided RC's to their users are now more or less obliged to run that script. Virtuoso was made a hard dependency (at least for anyone compiling kdepim) so all svn users also need to update. Bottom line is that distros will probably shop Virtuoso 6 to their end-users anyway, so we need to make sure it works well with it. I don't think it's as easy as saying it's too late to require V6, because it's not. Note that I don't like the situation, but to me it's more complex ... There's also the question what we require. As far as I know, KDE 4.4.0 works with virtuoso 5 and 6, so what would be natural is requiring at least V5, recommending V6 (for the upgrade path, BUT we haven't tested it yet). And that is exactly what is happening. It works with both v5 and v6 but nobody will package v5. Thus the converter. After using the converter, I don't get search results anymore. Listing tags works, but queries fail with /home/sebas/kdesvn/install/bin/nepomukservicestub(30328) Error in thread 2958723952 : SQLExecDirect failed on query 'sparql select distinct ?p where { { ?p a http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . ?p http://www.w3.org/2000/01/rdf-schema#label ?l . ?l bif:contains 'hastag*' . } UNION { ?p a http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . FILTER(REGEX(STR(?p),'hastag*','i')) . } }' (iODBC Error: [OpenLink][Virtuoso iODBC Driver][Virtuoso Server]SQ200: Table referenced in contains does not have a text index) Any hint? ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
Please try the attached patch in kdebase/runtime/nepomuk/services/storage. And if it helps, please apply as I am in the train all day. Starting nepomuk will take a long time probably since the whole index needs to be rebuilt. Cheers, Sebastian Sebastian Trueg wrote: yeah... damn, apparently the text index is not enabled by default anymore. Still was in 6.0.x snapshots I had. This is fixed with a simple patch to the storage service though. Maybe we need to port that back to the 4.4.0 tag, too. Cheers, Sebastian Sebastian Kügler wrote: On Thursday 04 February 2010 23:18:18 Sebastian Trueg wrote: Anyway, the converter is hacky tool allowing early adopters of KDE 4.4 who already tries Nepomuk with Virtuoso 5 (and thus, compile themselves!) to easily convert their data. Distro's who have provided RC's to their users are now more or less obliged to run that script. Virtuoso was made a hard dependency (at least for anyone compiling kdepim) so all svn users also need to update. Bottom line is that distros will probably shop Virtuoso 6 to their end-users anyway, so we need to make sure it works well with it. I don't think it's as easy as saying it's too late to require V6, because it's not. Note that I don't like the situation, but to me it's more complex ... There's also the question what we require. As far as I know, KDE 4.4.0 works with virtuoso 5 and 6, so what would be natural is requiring at least V5, recommending V6 (for the upgrade path, BUT we haven't tested it yet). And that is exactly what is happening. It works with both v5 and v6 but nobody will package v5. Thus the converter. After using the converter, I don't get search results anymore. Listing tags works, but queries fail with /home/sebas/kdesvn/install/bin/nepomukservicestub(30328) Error in thread 2958723952 : SQLExecDirect failed on query 'sparql select distinct ?p where { { ?p a http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . ?p http://www.w3.org/2000/01/rdf-schema#label ?l . ?l bif:contains 'hastag*' . } UNION { ?p a http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . FILTER(REGEX(STR(?p),'hastag*','i')) . } }' (iODBC Error: [OpenLink][Virtuoso iODBC Driver][Virtuoso Server]SQ200: Table referenced in contains does not have a text index) Any hint? ___ Nepomuk mailing list nepo...@kde.org https://mail.kde.org/mailman/listinfo/nepomuk Index: repository.cpp === --- repository.cpp (revision 1084701) +++ repository.cpp (working copy) @@ -325,6 +325,9 @@ // lower the minimum transaction log size to make sure the checkpoints are actually executed settings Soprano::BackendSetting( MinAutoCheckpointSize, 20 ); +// alwyays index literals +settings Soprano::BackendSetting( fulltextindex, sync ); + return settings; } ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
kde-4.4, virtuoso-6.1.0, and virtuosoconverter
FYI, http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter 1. The requirements for kde-4.4/nepomuk have changed pretty late in the game (after all 4.4rc's). 2. I personally have had trouble downloading 6.1.0 for the past 24hrs from sourceforge, if this is a continuing problem for others, perhaps we could put it on kde mirrors somewhere? 3. the aforementioned data conversion tool (from 5.0.x) as-is seems... less than optimal. Comments? -- Rex ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
On 02/04/2010 07:43 AM, Sebastian Trueg wrote: Rex Dieter wrote: FYI, http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter 1. The requirements for kde-4.4/nepomuk have changed pretty late in the game (after all 4.4rc's). No, they did not. I always said that Virtuoso 6 would be the dependency for KDE 4.4. That's all well and good. I had held off trying to use 6.0 myself, based on comments from you that it was buggy and didn't work, ie, waiting for 6.0.1 or 6.1, which has now landed. Fact is that we're in a bad situation of now requiring something that's been untested and it's data is incompatible with what was tested. 3. the aforementioned data conversion tool (from 5.0.x) as-is seems... less than optimal. less than optimal is way too detailed for me to give any feedback on. ;) Anyway, the converter is hacky tool allowing early adopters of KDE 4.4 who already tries Nepomuk with Virtuoso 5 (and thus, compile themselves!) to easily convert their data. I get that. I was hoping we could do better. This is just a consequence of (1), and not having ample time to adapt to the new stuff. -- Rex ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
Well, if you want you can still ship Virtuoso 5.0.13. I can't make you change to V6 now. But I recommend it. Cheers, Sebastian Rex Dieter wrote: On 02/04/2010 07:43 AM, Sebastian Trueg wrote: Rex Dieter wrote: FYI, http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter 1. The requirements for kde-4.4/nepomuk have changed pretty late in the game (after all 4.4rc's). No, they did not. I always said that Virtuoso 6 would be the dependency for KDE 4.4. That's all well and good. I had held off trying to use 6.0 myself, based on comments from you that it was buggy and didn't work, ie, waiting for 6.0.1 or 6.1, which has now landed. Fact is that we're in a bad situation of now requiring something that's been untested and it's data is incompatible with what was tested. 3. the aforementioned data conversion tool (from 5.0.x) as-is seems... less than optimal. less than optimal is way too detailed for me to give any feedback on. ;) Anyway, the converter is hacky tool allowing early adopters of KDE 4.4 who already tries Nepomuk with Virtuoso 5 (and thus, compile themselves!) to easily convert their data. I get that. I was hoping we could do better. This is just a consequence of (1), and not having ample time to adapt to the new stuff. -- Rex ___ Nepomuk mailing list nepo...@kde.org https://mail.kde.org/mailman/listinfo/nepomuk ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
Rex Dieter wrote: FYI, http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter 1. The requirements for kde-4.4/nepomuk have changed pretty late in the game (after all 4.4rc's). No, they did not. I always said that Virtuoso 6 would be the dependency for KDE 4.4. This is just a new version. Nepomuk also works with Virtuoso 5 but it is not recommended. Packaging efforts have been going on between Mandriva, Debian, SuSE, and OpenLink for a while now. 2. I personally have had trouble downloading 6.1.0 for the past 24hrs from sourceforge, if this is a continuing problem for others, perhaps we could put it on kde mirrors somewhere? Probably high load after the release yesterday night. 3. the aforementioned data conversion tool (from 5.0.x) as-is seems... less than optimal. less than optimal is way too detailed for me to give any feedback on. ;) Anyway, the converter is hacky tool allowing early adopters of KDE 4.4 who already tries Nepomuk with Virtuoso 5 (and thus, compile themselves!) to easily convert their data. Cheers, Sebastian ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team
Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter
Sebastian Kügler wrote: On Thursday 04 February 2010 16:16:34 Tom Albers wrote: Op Thursday 4 February 2010 16:02 schreef u: On 02/04/2010 07:43 AM, Sebastian Trueg wrote: Rex Dieter wrote: FYI, http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter 1. The requirements for kde-4.4/nepomuk have changed pretty late in the game (after all 4.4rc's). No, they did not. I always said that Virtuoso 6 would be the dependency for KDE 4.4. You can not add a new dependency for KDE 4.4 the day before the release without testing. I consider it a new feature which is not allowed since ages. for KDE 4.5 I've planned to add it to the release schedule explicitly to make it even more clear. It is too late in the cycle for 4.4 to change this dependency. Really. Some packagers can not add a new dependency to their repository in one day and have prepared the KDE 4.4 packaging based on the 4.4 release candidates we have given them. Please don't do this. Fact is that we're in a bad situation of now requiring something that's been untested and it's data is incompatible with what was tested. +1 Unacceptable imho. What will happen is that distros will ship Virtuoso 6 anyway, because they don't want That has been the plan for a long time now and the major distros already knew that. Like I said: Debian, SuSE and Mandriva have been in contact with OpenLink for a long time to clean up the code tree (licence-wise) and figure out the best packaging scheme. to introduce V5, and then have to convert users' data again (first time from the sesame2) backend. I don't know in how far V6 is different from V5, other than the dataformat, but we might consider recommending V6 anyway, because it has a clearer road forward. It's a bit unfortunate that there was a bug in V6.0 that prevented us from testing with it, that seems fixed in 6.1? I'd also be interested in more (dis)advantages of V6 over V5, and how different V5 and 6 actually are from a what can break KDE?-point of view. Sebastian, can you give more details? From my point of view there are no disadvantages, only advantages. Better performance, lower mem footprint, more features, better support, ... Anyway, the converter is hacky tool allowing early adopters of KDE 4.4 who already tries Nepomuk with Virtuoso 5 (and thus, compile themselves!) to easily convert their data. Distro's who have provided RC's to their users are now more or less obliged to run that script. Virtuoso was made a hard dependency (at least for anyone compiling kdepim) so all svn users also need to update. Bottom line is that distros will probably shop Virtuoso 6 to their end-users anyway, so we need to make sure it works well with it. I don't think it's as easy as saying it's too late to require V6, because it's not. Note that I don't like the situation, but to me it's more complex ... There's also the question what we require. As far as I know, KDE 4.4.0 works with virtuoso 5 and 6, so what would be natural is requiring at least V5, recommending V6 (for the upgrade path, BUT we haven't tested it yet). And that is exactly what is happening. It works with both v5 and v6 but nobody will package v5. Thus the converter. Cheers, Sebastian ___ release-team mailing list release-team@kde.org https://mail.kde.org/mailman/listinfo/release-team