Re: [Dspace-tech] What are the possible data format export options in Dspace?
Hi Helix84, Thanks. I have set up the Bulk Editor {attached} But when call it from the WebUI, the fields are replicated multiple times. Am I missing something Kev -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 22 May 2013 14:51 To: Evans, Kev Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] What are the possible data format export options in Dspace? On Wed, May 22, 2013 at 3:03 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: I notice there is a GUI option. When enabled what should I expect to see? Is it in the context menu? Or a specific uri? That means you can also do it from web UI. if you log in as admin in XMLUI, you can find it un der Administrative - Import Metadata. But when called from web UI, it is subject to the limit set here: https://github.com/DSpace/DSpace/blob/dspace-3.1/dspace/config/modules/bulkedit.cfg#L19 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette ---# #---BATCH METADATA EDITOR CONFIGURATIONS# #---# # Configuration properties used solely by the Batch Metadata# # Editing System# #---# ### Bulk metadata editor settings ### # The delimiter used to separate values within a single field (defaults to a double pipe ||) valueseparator = || # The delimiter used to separate fields (defaults to a comma for CSV) fieldseparator = id, collection, dc.contributor.author, \ dc.title, dc.date.issued, dc.rights, dc.funder # A hard limit of the number of items allowed to be edited in one go in the UI # (does not apply to the command line version) gui-item-limit = 50 # Metadata elements to exclude when exporting via the user interfaces, or when using the # command line version and not using the -a (all) option. ignore-on-export = dc.date.accessioned, dc.date.available, \ dc.date.updated, dc.description.provenance # Should the 'action' column allow the 'expunge' method. By default this is set to false #allowexpunge = false -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] What are the possible data format export options in Dspace?
On Fri, May 24, 2013 at 11:53 AM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: But when call it from the WebUI, the fields are replicated multiple times. You didn't write which fields, so I'm guessing you hit a common issue. DSpace treats field names as distinct based on what is specified as language. Say you're using two languages in your repository, en and de, then you can have fields with the following language variations and here's an example how the would be displayed in the CSV header: field language - column header for dc.title en - dc.title[en] de - dc.title[de] empty string - dc.title[] NULL - dc.title Is this the kind of duplication you're seeing? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] What are the possible data format export options in Dspace?
Yes this is the kind of duplication, although only using one language [en] Kev -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 24 May 2013 11:16 To: Evans, Kev Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] What are the possible data format export options in Dspace? On Fri, May 24, 2013 at 11:53 AM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: But when call it from the WebUI, the fields are replicated multiple times. You didn't write which fields, so I'm guessing you hit a common issue. DSpace treats field names as distinct based on what is specified as language. Say you're using two languages in your repository, en and de, then you can have fields with the following language variations and here's an example how the would be displayed in the CSV header: field language - column header for dc.title en - dc.title[en] de - dc.title[de] empty string - dc.title[] NULL - dc.title Is this the kind of duplication you're seeing? Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] What are the possible data format export options in Dspace?
On Fri, May 24, 2013 at 12:21 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: Yes this is the kind of duplication, although only using one language [en] These are inconsistencies in your user data - you should have your own policy whether you always use a language code for a certain field or not. The inconsistency between NULL and empty string is DSpace's fault because different processes (submission/edit/import methods) are not consistent in what they put in by default. Sorry about that, we should fix it, it's just low priority. Anyway, the Batch Metadata Editor makes it extremely easy to move data between these columns, and re-import them. Moving a data value from the dc.title[] column to dc.title and leaving the value under dc.title[] empty will do what you'd expect - create a new metadata value with NULL language and get rid of the metadata value with empty string as language. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] What are the possible data format export options in Dspace?
Hi Helix84 This looks just what me need. I notice there is a GUI option. When enabled what should I expect to see? Is it in the context menu? Or a specific uri? Cheers Kevin -Original Message- From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84 Sent: 21 May 2013 16:36 To: Evans, Kev Cc: dspace-tech@lists.sourceforge.net Subject: Re: [Dspace-tech] What are the possible data format export options in Dspace? On Tue, May 21, 2013 at 4:47 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: What are the possible data format export options in DSpace? Are Repository Administrators/Curators able to easily extract information that can be used to check compliance levels with funder open access policies. For example, I'd like to be able to get the following list: Author, Title, Date of publication, Funder, Rights etc. exported into Excel? Hi Kevin, there are in fact many options how to export data from DSpace. Most prominently OAI which lets you define many metadata formats, but also some package-like formats as described in the System Administration section [1]. Since you're interested in export of particlar metadata fields into Excel, I'd recommend you to use the Batch Metadata Editing Tool, which can export a CSV [2] with all the metadata of a specified site/community/collection/item. [1] https://wiki.duraspace.org/display/DSDOC3x/DSpace+3.x+Documentation [2] https://wiki.duraspace.org/display/DSDOC3x/Batch+Metadata+Editing Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] What are the possible data format export options in Dspace?
On Wed, May 22, 2013 at 3:03 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: I notice there is a GUI option. When enabled what should I expect to see? Is it in the context menu? Or a specific uri? That means you can also do it from web UI. if you log in as admin in XMLUI, you can find it un der Administrative - Import Metadata. But when called from web UI, it is subject to the limit set here: https://github.com/DSpace/DSpace/blob/dspace-3.1/dspace/config/modules/bulkedit.cfg#L19 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] What are the possible data format export options in Dspace?
Hi, What are the possible data format export options in DSpace? Are Repository Administrators/Curators able to easily extract information that can be used to check compliance levels with funder open access policies. For example, I'd like to be able to get the following list: Author, Title, Date of publication, Funder, Rights etc. exported into Excel? Cheers Kevin Kevin Evans Systems Developer, Research Collaborative Systems, Enterprise Applications, Room 911, 9th Floor, Laver Building, University of Exeter, Exeter, Devon, EX4 4QE 01392 725573 07775027574 https://my.exeter.ac.uk -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] What are the possible data format export options in Dspace?
On Tue, May 21, 2013 at 4:47 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote: What are the possible data format export options in DSpace? Are Repository Administrators/Curators able to easily extract information that can be used to check compliance levels with funder open access policies. For example, I'd like to be able to get the following list: Author, Title, Date of publication, Funder, Rights etc. exported into Excel? Hi Kevin, there are in fact many options how to export data from DSpace. Most prominently OAI which lets you define many metadata formats, but also some package-like formats as described in the System Administration section [1]. Since you're interested in export of particlar metadata fields into Excel, I'd recommend you to use the Batch Metadata Editing Tool, which can export a CSV [2] with all the metadata of a specified site/community/collection/item. [1] https://wiki.duraspace.org/display/DSDOC3x/DSpace+3.x+Documentation [2] https://wiki.duraspace.org/display/DSDOC3x/Batch+Metadata+Editing Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Try New Relic Now We'll Send You this Cool Shirt New Relic is the only SaaS-based application performance monitoring service that delivers powerful full stack analytics. Optimize and monitor your browser, app, servers with just a few lines of code. Try New Relic and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette