On Wednesday 08 July 2009 01:35:59 Mike Bush wrote: > A progress report on my project. > > My SoC project originally had to do with improvements to XMLLibrarian > and XMLSpider to provide a better search experience to freenet users, > particularly helping with the issue of newcomers to freenet starting > up a search and seeing nothing happening for ages. Some of my original > targets have changed though as infinity0's work on new index formats > has meant I have not been having to change the index format to include > more metadata. > > Some of my original targets and status: > > Asynchronous searching - the current official version of XMLLibrarian > from the work I did in easter runs searches separately from showing > progress so that the page is not blank. In my forked version searches > for different terms and on different indexes are run at the same time > to speed this progress further. > > Search progress - the current version shows the raw description of the > fetch progress from the ClientGetter's fetching the indexes. My newer > version uses ajax to update the progress and get the results, avoiding > screen refreshes if you have javascript enabled in your browser. > Progress bars are also shown for each fetch. I did have partial > results being shown as some of the fetches complete but it had > implications on performance and I had doubts on whether it would be of > use to anyone. > > Result listing - commits last week were working on better displaying > of search results, including grouping SSK sites and hiding older > versions of them, showing uri's and USK links (I think people were > asking for that). > > Search querys - the most recent work I have been doing, not & or > operations are working well (as far as my tests have gone), I have > been implementing phrase searching but it is not working for a reason > I am yet to determine. > > This work is availiable in my fork > git://github.com/platy/plugin-XMLLibrarian-staging.git it is ready to > be merged back into the freenet staging repository, hopefully into the > official as well after review. > > Other items in my proposal that need to be done are: > Recording meta data in the spider, this will allow more information on > the search page and (some)search relevance ranking. > Use of filters other than the html one to allow other filetypes to be indexed. > Embedded search in freesites - allowing someone who has uploaded an > index to present a box on their site to start searches on it. > > And importantly, I will be working with infinity0, to integrate the > Interdex distributed index system into the search interface and > crawling. > > MikeB
New index posted on FMS: [11:52:00] <Anarhist> http://pastebin.com/m1d0a7a7e [11:52:06] <Anarhist> you people do know about this, don't you? == ----- Anonymous ----- 2009.07.05 - 19:24:25GMT ----- USK at US6gHsNApDvyShI~sBHGEOplJ3pwZUDhLqTAas6rO4c,3jeU5OwV0-K4B6HRBznDYGvpu2PRUuwL0V110rn-~8g,AQACAAE/freenet-index/2/ To use: on the XMLLibrarian plugin page (aka the page you get to from the search freenet box), type the above key into the "Index" box. Version 2 is the same as version 1, but corrects an insert problem. Post if there are problems, or just to let me know it works. ----- Anonymous ----- 2009.07.07 - 21:52:40GMT ----- Say, has anyone told toad that this exists? == Whether we should include wAnnA edition 20 depends on whether it is practical to show partial results - most of wAnnA edition 20 is in huge 40MB chunks... If it's not practical to show partial results, then don't use it. -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 835 bytes Desc: This is a digitally signed message part. URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20090708/d9b8b181/attachment.pgp>
