[
https://jira.duraspace.org/browse/DS-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=27677#comment-27677
]
Graham Triggs commented on DS-1482:
-----------------------------------
I thought this is why we have the sitemaps? If you look at a sitemap, for every
item we give the lastmod date as part of the sitemap entry (but not collection
/ community, as we don't have that information).
Retrieving those sitemaps are fast (pre-generated), and it's pretty trivial to
either work out from the lastmod date is newer than the last indexed date - or
even if it is more recent that the previous time the sitemap was accessed (new
item).
> Add a way for harvesters to find recently added items (request from Google)
> ---------------------------------------------------------------------------
>
> Key: DS-1482
> URL: https://jira.duraspace.org/browse/DS-1482
> Project: DSpace
> Issue Type: New Feature
> Reporter: Tim Donohue
>
> This request came out of a discussion I had with Anurag Acharya and Darcy
> Darpa at Google / Google Scholar.
> Anurag mentioned that often the Google harvesters seem to need to do a lot of
> "paging / clicking" in order to find new items in a DSpace instance. This
> can cause both a performance hit in DSpace (as the crawler keeps requesting
> pages), and also can result in delays where items may not appear in Google
> for some time (if the crawler gives up or moves on before it ever finds the
> item).
> Anurag mentioned that it'd be much easier (both on DSpace performance and on
> the Google crawlers), if DSpace provided some way to easily locate recently
> added items.
> This could be something like a "Browse Recently Added Items" (i.e. browse by
> dc.date.accessioned), or similar. It was noted that EPrints has such a
> feature (called "Latest Additions"). For example, see their demo site:
> http://demoprints.eprints.org/cgi/latest
> It's also worth noting this could just be as simple as adding a "More...."
> Option to our existing "Recently Added" list (of 5 items), so that you can
> see other recently added items.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
------------------------------------------------------------------------------
Free Next-Gen Firewall Hardware Offer
Buy your Sophos next-gen firewall before the end March 2013
and get the hardware for free! Learn more.
http://p.sf.net/sfu/sophos-d2d-feb
_______________________________________________
Dspace-devel mailing list
Dspace-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-devel
