Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-08 Thread Sebastian Trueg
well, the index problem already is resolved.
A real showstopper is the dbus problem though :(

http://bugreports.qt.nokia.com/browse/QTBUG-7475

Cheers,
Sebastian

Will Stephenson wrote:
 On Saturday 06 February 2010 15:11:24 Sebastian Trueg wrote:
 the big problem is that I cannot reproduce this error.
 Even without the patch queries work...
 I need to look into that when I am back from the FOSDEM.

 
 I can reproduce it with 4.3.98, soprano 2.3.70, virtuoso 6.1.  I asked Sebas, 
 and since he got it working he is using soprano 2.3.73 out of kdesupport 
 trunk, not the blessed for 4.4 2.3.70 version.  Is the soprano version 
 relevant?
 
 Log extract searching for a file by file name:
 
 /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 : 
 SQLExecDirect failed on quer  y 'sparql  select distinct ?r  where { { { ?r 
 ?v1 ?v2 . ?v2 bif:contains 'Bread Sauce.pdf*' . } U  NION { ?r ?v1 ?v3 . 
 ?v3 
 ?v4 ?v2 . ?v4 http://www.w3.org/2000/01/rdf-schema#subPropertyOf http://  
 www.w3.org/2000/01/rdf-schema#label . ?v2 bif:contains 'Bread Sauce.pdf*' 
 . 
 } . { ?r a ?v5 . ?v5   http://www.w3.org/2000/01/rdf-schema#subClassOf 
 http://www.semanticdesktop.org/ontologies/2007/  03/22/nfo#FileDataObject . 
 } UNION { ?r a ?v6 . ?v6 http://www.w3.org/2000/01/rdf-schema#subClass  Of 
 http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#Folder . } . } .   
  
 }' (iODBC Error:   [OpenLink][Virtuoso iODBC Driver][Virtuoso Server]SQ200: 
 Table referenced in contains does not hav  e a text index)   
   
 /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 : 
 Invalid 
 iterator.
 nepomukqueryservice(3215)/nepomuk (query service) 
 Nepomuk::Query::SearchThread::run: 5   
 nepomukqueryservice(3215)/nepomuk (query service) 
 Nepomuk::Query::SearchCore::slotFinished:  
 
 I am for delaying the release until this is resolved.
 
 
 Will
   
 Cheers,
 Sebastian

 Hey Sebastian,

 On Friday 05 February 2010 09:10:36 Sebastian Trueg wrote:
 Please try the attached patch in
 kdebase/runtime/nepomuk/services/storage.
 And if it helps, please apply as I am in the train all day.
 Starting nepomuk will take a long time probably since the whole index
 needs to be rebuilt.
 That doesn't seem to help. (I've only rebuilt/installed that particular
 directory.)
 The error is apparently the same still. I've attached an updated log from
 my
 nepomukserver (gave it some time to start up, the initial CPU load had
 definitely
 settled).

 I'll be on IRC all day and tonight, you can catch me there (or by email,
 of course).

 Sebastian Trueg wrote:
 yeah... damn, apparently the text index is not enabled by default
 anymore. Still was in 6.0.x snapshots I had.
 This is fixed with a simple patch to the storage service though.
 Maybe we need to port that back to the 4.4.0 tag, too.
 Thanks,
 --
 sebas

 http://www.kde.org | http://vizZzion.org | GPG Key ID: 9119 0EF9
 ___
 release-team mailing list
 release-team@kde.org
 https://mail.kde.org/mailman/listinfo/release-team
 
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-08 Thread Will Stephenson
On Monday 08 February 2010 21:39:43 you wrote:
 well, the index problem already is resolved.
Sorry, I should have said that I started with a clean apps/nepomuk - no 
conversion.  If you said the index problem resolved on the basis of Sebas' 
experience, I'm afraid mine contradicts that.

Will

 A real showstopper is the dbus problem though :(
 
 http://bugreports.qt.nokia.com/browse/QTBUG-7475

Yuck.

 
 Cheers,
 Sebastian
 
 Will Stephenson wrote:
  On Saturday 06 February 2010 15:11:24 Sebastian Trueg wrote:
  the big problem is that I cannot reproduce this error.
  Even without the patch queries work...
  I need to look into that when I am back from the FOSDEM.
  
  I can reproduce it with 4.3.98, soprano 2.3.70, virtuoso 6.1.  I asked
  Sebas, and since he got it working he is using soprano 2.3.73 out of
  kdesupport trunk, not the blessed for 4.4 2.3.70 version.  Is the
  soprano version relevant?
  
  Log extract searching for a file by file name:
  
  /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 :
  SQLExecDirect failed on quer  y 'sparql  select distinct ?r  where { { {
  ?r ?v1 ?v2 . ?v2 bif:contains 'Bread Sauce.pdf*' . } U  NION { ?r ?v1
  ?v3 . ?v3 ?v4 ?v2 . ?v4
  http://www.w3.org/2000/01/rdf-schema#subPropertyOf http://
  www.w3.org/2000/01/rdf-schema#label . ?v2 bif:contains 'Bread
  Sauce.pdf*' . } . { ?r a ?v5 . ?v5  
  http://www.w3.org/2000/01/rdf-schema#subClassOf
  http://www.semanticdesktop.org/ontologies/2007/ 
  03/22/nfo#FileDataObject . } UNION { ?r a ?v6 . ?v6
  http://www.w3.org/2000/01/rdf-schema#subClass  Of
  http://www.semanticdesktop.org/ontologies/2007/03/22/nfo#Folder . } .
  } . }' (iODBC Error:   [OpenLink][Virtuoso iODBC Driver][Virtuoso
  Server]SQ200: Table referenced in contains does not hav  e a text
  index)
  /usr/bin/nepomukservicestub(3215) Error in thread 139951182154000 :
  Invalid iterator.
  nepomukqueryservice(3215)/nepomuk (query service)
  Nepomuk::Query::SearchThread::run: 5
  nepomukqueryservice(3215)/nepomuk (query service)
  Nepomuk::Query::SearchCore::slotFinished:
  
  I am for delaying the release until this is resolved.
  
  
  Will
  
  Cheers,
  Sebastian
  
  Hey Sebastian,
  
  On Friday 05 February 2010 09:10:36 Sebastian Trueg wrote:
  Please try the attached patch in
  kdebase/runtime/nepomuk/services/storage.
  And if it helps, please apply as I am in the train all day.
  Starting nepomuk will take a long time probably since the whole index
  needs to be rebuilt.
  
  That doesn't seem to help. (I've only rebuilt/installed that particular
  directory.)
  The error is apparently the same still. I've attached an updated log
  from my
  nepomukserver (gave it some time to start up, the initial CPU load had
  definitely
  settled).
  
  I'll be on IRC all day and tonight, you can catch me there (or by
  email, of course).
  
  Sebastian Trueg wrote:
  yeah... damn, apparently the text index is not enabled by default
  anymore. Still was in 6.0.x snapshots I had.
  This is fixed with a simple patch to the storage service though.
  Maybe we need to port that back to the 4.4.0 tag, too.
  
  Thanks,
  --
  sebas
  
  http://www.kde.org | http://vizZzion.org | GPG Key ID: 9119 0EF9
  
  ___
  release-team mailing list
  release-team@kde.org
  https://mail.kde.org/mailman/listinfo/release-team
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-06 Thread Sebastian Trueg
the big problem is that I cannot reproduce this error.
Even without the patch queries work...
I need to look into that when I am back from the FOSDEM.

Cheers,
Sebastian

 Hey Sebastian,

 On Friday 05 February 2010 09:10:36 Sebastian Trueg wrote:
 Please try the attached patch in
 kdebase/runtime/nepomuk/services/storage.
 And if it helps, please apply as I am in the train all day.
 Starting nepomuk will take a long time probably since the whole index
 needs to be rebuilt.

 That doesn't seem to help. (I've only rebuilt/installed that particular
 directory.)
 The error is apparently the same still. I've attached an updated log from
 my
 nepomukserver (gave it some time to start up, the initial CPU load had
 definitely
 settled).

 I'll be on IRC all day and tonight, you can catch me there (or by email,
 of course).

 Sebastian Trueg wrote:
  yeah... damn, apparently the text index is not enabled by default
  anymore. Still was in 6.0.x snapshots I had.
  This is fixed with a simple patch to the storage service though.
  Maybe we need to port that back to the 4.4.0 tag, too.

 Thanks,
 --
 sebas

 http://www.kde.org | http://vizZzion.org | GPG Key ID: 9119 0EF9



___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-06 Thread Sebastian Kügler
Hey,

On Saturday 06 February 2010 15:11:24 Sebastian Trueg wrote:
 the big problem is that I cannot reproduce this error.
 Even without the patch queries work...
 I need to look into that when I am back from the FOSDEM.

I've re-run the converter (backups FTW!), and while the first query doesn't 
return 
anything, it now works as expected -- and is much faster as well. :)
-- 
sebas

 http://www.kde.org | http://vizZzion.org |  GPG Key ID: 9119 0EF9 


signature.asc
Description: This is a digitally signed message part.
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-05 Thread Sebastian Trueg
yeah... damn, apparently the text index is not enabled by default
anymore. Still was in 6.0.x snapshots I had.
This is fixed with a simple patch to the storage service though.
Maybe we need to port that back to the 4.4.0 tag, too.

Cheers,
Sebastian

Sebastian Kügler wrote:
 On Thursday 04 February 2010 23:18:18 Sebastian Trueg wrote:
 Anyway, the converter is hacky tool allowing early adopters of KDE 4.4
 who already tries Nepomuk with Virtuoso 5 (and thus, compile
 themselves!) to easily convert their data.
 Distro's who have provided RC's to their users are now more or less
 obliged to run that script. Virtuoso was made a hard dependency (at
 least for anyone compiling kdepim) so all svn users also need to
 update.


 Bottom line is that distros will probably shop Virtuoso 6 to their
 end-users anyway,  so we need to make sure it works well with it. I
 don't think it's as easy as saying it's too late to require V6,
 because it's not. Note that I don't like the situation, but to me it's
 more complex ...

 There's also the question what we require. As far as I know, KDE 4.4.0
 works with  virtuoso 5 and 6, so what would be natural is requiring at
 least V5, recommending V6 (for the upgrade path, BUT we haven't tested
 it yet).
 And that is exactly what is happening. It works with both v5 and v6 but
 nobody will package v5. Thus the converter.
 
 After using the converter, I don't get search results anymore. Listing tags 
 works, 
 but queries fail with
 
 /home/sebas/kdesvn/install/bin/nepomukservicestub(30328) Error in thread 
 2958723952 
 : SQLExecDirect failed on query 'sparql  select distinct ?p where { { ?p a 
 http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . ?p 
 http://www.w3.org/2000/01/rdf-schema#label ?l . ?l bif:contains 'hastag*' 
 . } 
 UNION { ?p a http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . 
 FILTER(REGEX(STR(?p),'hastag*','i')) . } }' (iODBC Error: [OpenLink][Virtuoso 
 iODBC 
 Driver][Virtuoso Server]SQ200: Table referenced in contains does not have a 
 text 
 index)
 
 Any hint?
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-05 Thread Sebastian Trueg
Please try the attached patch in kdebase/runtime/nepomuk/services/storage.
And if it helps, please apply as I am in the train all day.
Starting nepomuk will take a long time probably since the whole index
needs to be rebuilt.

Cheers,
Sebastian

Sebastian Trueg wrote:
 yeah... damn, apparently the text index is not enabled by default
 anymore. Still was in 6.0.x snapshots I had.
 This is fixed with a simple patch to the storage service though.
 Maybe we need to port that back to the 4.4.0 tag, too.
 
 Cheers,
 Sebastian
 
 Sebastian Kügler wrote:
 On Thursday 04 February 2010 23:18:18 Sebastian Trueg wrote:
 Anyway, the converter is hacky tool allowing early adopters of KDE 4.4
 who already tries Nepomuk with Virtuoso 5 (and thus, compile
 themselves!) to easily convert their data.
 Distro's who have provided RC's to their users are now more or less
 obliged to run that script. Virtuoso was made a hard dependency (at
 least for anyone compiling kdepim) so all svn users also need to
 update.

 Bottom line is that distros will probably shop Virtuoso 6 to their
 end-users anyway,  so we need to make sure it works well with it. I
 don't think it's as easy as saying it's too late to require V6,
 because it's not. Note that I don't like the situation, but to me it's
 more complex ...

 There's also the question what we require. As far as I know, KDE 4.4.0
 works with  virtuoso 5 and 6, so what would be natural is requiring at
 least V5, recommending V6 (for the upgrade path, BUT we haven't tested
 it yet).
 And that is exactly what is happening. It works with both v5 and v6 but
 nobody will package v5. Thus the converter.
 After using the converter, I don't get search results anymore. Listing tags 
 works, 
 but queries fail with

 /home/sebas/kdesvn/install/bin/nepomukservicestub(30328) Error in thread 
 2958723952 
 : SQLExecDirect failed on query 'sparql  select distinct ?p where { { ?p a 
 http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . ?p 
 http://www.w3.org/2000/01/rdf-schema#label ?l . ?l bif:contains 
 'hastag*' . } 
 UNION { ?p a http://www.w3.org/1999/02/22-rdf-syntax-ns#Property . 
 FILTER(REGEX(STR(?p),'hastag*','i')) . } }' (iODBC Error: 
 [OpenLink][Virtuoso iODBC 
 Driver][Virtuoso Server]SQ200: Table referenced in contains does not have a 
 text 
 index)

 Any hint?
 ___
 Nepomuk mailing list
 nepo...@kde.org
 https://mail.kde.org/mailman/listinfo/nepomuk
 
Index: repository.cpp
===
--- repository.cpp  (revision 1084701)
+++ repository.cpp  (working copy)
@@ -325,6 +325,9 @@
 // lower the minimum transaction log size to make sure the checkpoints are 
actually executed
 settings  Soprano::BackendSetting( MinAutoCheckpointSize, 20 );
 
+// alwyays index literals
+settings  Soprano::BackendSetting( fulltextindex, sync );
+
 return settings;
 }
 
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-04 Thread Rex Dieter
FYI,
http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter

1.  The requirements for kde-4.4/nepomuk have changed pretty late in the 
game (after all 4.4rc's).

2.  I personally have had trouble downloading 6.1.0 for the past 24hrs 
from sourceforge, if this is a continuing problem for others, perhaps we 
could put it on kde mirrors somewhere?

3.  the aforementioned data conversion tool (from 5.0.x) as-is seems... 
less than optimal.

Comments?

-- Rex
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-04 Thread Rex Dieter
On 02/04/2010 07:43 AM, Sebastian Trueg wrote:
 Rex Dieter wrote:
 FYI,
 http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter

 1.  The requirements for kde-4.4/nepomuk have changed pretty late in the
 game (after all 4.4rc's).

 No, they did not. I always said that Virtuoso 6 would be the dependency
 for KDE 4.4.

That's all well and good.

I had held off trying to use 6.0 myself, based on comments from you that 
it was buggy and didn't work, ie, waiting for 6.0.1 or 6.1, which has 
now landed.

Fact is that we're in a bad situation of now requiring something that's 
been untested and it's data is incompatible with what was tested.

 3.  the aforementioned data conversion tool (from 5.0.x) as-is seems...
 less than optimal.

 less than optimal is way too detailed for me to give any feedback on.  ;)

 Anyway, the converter is hacky tool allowing early adopters of KDE 4.4
 who already tries Nepomuk with Virtuoso 5 (and thus, compile
 themselves!) to easily convert their data.

I get that.  I was hoping we could do better.  This is just a 
consequence of (1), and not having ample time to adapt to the new stuff.

-- Rex
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-04 Thread Sebastian Trueg
Well, if you want you can still ship Virtuoso 5.0.13. I can't make you
change to V6 now. But I recommend it.

Cheers,
Sebastian

Rex Dieter wrote:
 On 02/04/2010 07:43 AM, Sebastian Trueg wrote:
 Rex Dieter wrote:
 FYI,
 http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter

 1.  The requirements for kde-4.4/nepomuk have changed pretty late in the
 game (after all 4.4rc's).
 No, they did not. I always said that Virtuoso 6 would be the dependency
 for KDE 4.4.
 
 That's all well and good.
 
 I had held off trying to use 6.0 myself, based on comments from you that 
 it was buggy and didn't work, ie, waiting for 6.0.1 or 6.1, which has 
 now landed.
 
 Fact is that we're in a bad situation of now requiring something that's 
 been untested and it's data is incompatible with what was tested.
 
 3.  the aforementioned data conversion tool (from 5.0.x) as-is seems...
 less than optimal.
 less than optimal is way too detailed for me to give any feedback on.  ;)

 Anyway, the converter is hacky tool allowing early adopters of KDE 4.4
 who already tries Nepomuk with Virtuoso 5 (and thus, compile
 themselves!) to easily convert their data.
 
 I get that.  I was hoping we could do better.  This is just a 
 consequence of (1), and not having ample time to adapt to the new stuff.
 
 -- Rex
 ___
 Nepomuk mailing list
 nepo...@kde.org
 https://mail.kde.org/mailman/listinfo/nepomuk
 
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-04 Thread Sebastian Trueg
Rex Dieter wrote:
 FYI,
 http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter
 
 1.  The requirements for kde-4.4/nepomuk have changed pretty late in the 
 game (after all 4.4rc's).

No, they did not. I always said that Virtuoso 6 would be the dependency
for KDE 4.4. This is just a new version. Nepomuk also works with
Virtuoso 5 but it is not recommended.
Packaging efforts have been going on between Mandriva, Debian, SuSE, and
OpenLink for a while now.

 2.  I personally have had trouble downloading 6.1.0 for the past 24hrs 
 from sourceforge, if this is a continuing problem for others, perhaps we 
 could put it on kde mirrors somewhere?

Probably high load after the release yesterday night.

 3.  the aforementioned data conversion tool (from 5.0.x) as-is seems... 
 less than optimal.

less than optimal is way too detailed for me to give any feedback on.  ;)

Anyway, the converter is hacky tool allowing early adopters of KDE 4.4
who already tries Nepomuk with Virtuoso 5 (and thus, compile
themselves!) to easily convert their data.

Cheers,
Sebastian
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team


Re: [Nepomuk] kde-4.4, virtuoso-6.1.0, and virtuosoconverter

2010-02-04 Thread Sebastian Trueg
Sebastian Kügler wrote:
 On Thursday 04 February 2010 16:16:34 Tom Albers wrote:
 Op Thursday 4 February 2010 16:02 schreef u:
 On 02/04/2010 07:43 AM, Sebastian Trueg wrote:
 Rex Dieter wrote:
 FYI,
 http://kde-apps.org/content/show.php/Nepomuk+Virtuoso+Converter

 1.  The requirements for kde-4.4/nepomuk have changed pretty late in
 the game (after all 4.4rc's).
 No, they did not. I always said that Virtuoso 6 would be the dependency
 for KDE 4.4.
 You can not add a new dependency for KDE 4.4 the day before the release
 without testing. I consider it a new feature which is not allowed since
 ages. for KDE 4.5 I've planned to add it to the release schedule
 explicitly to make it even more clear. It is too late in the cycle for 4.4
 to change this dependency. Really. Some packagers can not add a new
 dependency to their repository in one day and have prepared the KDE 4.4
 packaging based on the 4.4 release candidates we have given them. Please
 don't do this.

 Fact is that we're in a bad situation of now requiring something that's
 been untested and it's data is incompatible with what was tested.
 +1
 Unacceptable imho.
 
 What will happen is that distros will ship Virtuoso 6 anyway, because they 
 don't want 

That has been the plan for a long time now and the major distros already
knew that. Like I said: Debian, SuSE and Mandriva have been in contact
with OpenLink for a long time to clean up the code tree (licence-wise)
and figure out the best packaging scheme.

 to introduce V5, and then have to convert users' data again (first time from 
 the 
 sesame2) backend. I don't know in how far V6 is different from V5, other than 
 the 
 dataformat, but we might consider recommending V6 anyway, because it has a 
 clearer 
 road forward.
 
 It's a bit unfortunate that there was a bug in V6.0 that prevented us from 
 testing 
 with it, that seems fixed in 6.1?
 
 I'd also be interested in more (dis)advantages of V6 over V5, and how 
 different V5 
 and 6 actually are from a what can break KDE?-point of view. Sebastian, can 
 you 
 give more details?

From my point of view there are no disadvantages, only advantages.
Better performance, lower mem footprint, more features, better support, ...

 Anyway, the converter is hacky tool allowing early adopters of KDE 4.4
 who already tries Nepomuk with Virtuoso 5 (and thus, compile
 themselves!) to easily convert their data.
 Distro's who have provided RC's to their users are now more or less obliged
 to run that script. Virtuoso was made a hard dependency (at least for
 anyone compiling kdepim) so all svn users also need to update.
 
 Bottom line is that distros will probably shop Virtuoso 6 to their end-users 
 anyway, 
 so we need to make sure it works well with it. I don't think it's as easy as 
 saying 
 it's too late to require V6, because it's not. Note that I don't like the 
 situation, but to me it's more complex ...

 There's also the question what we require. As far as I know, KDE 4.4.0 works 
 with 
 virtuoso 5 and 6, so what would be natural is requiring at least V5, 
 recommending V6 
 (for the upgrade path, BUT we haven't tested it yet).

And that is exactly what is happening. It works with both v5 and v6 but
nobody will package v5. Thus the converter.

Cheers,
Sebastian
___
release-team mailing list
release-team@kde.org
https://mail.kde.org/mailman/listinfo/release-team