Re: [Dspace-tech] What are the possible data format export options in Dspace?

2013-05-24 Thread Evans, Kev
Hi Helix84,

Thanks. I have set up the Bulk Editor {attached}

But when call it from the WebUI, the fields are replicated multiple times.

Am I missing something

Kev

-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 22 May 2013 14:51
To: Evans, Kev
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] What are the possible data format export options in 
Dspace?

On Wed, May 22, 2013 at 3:03 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote:
 I notice there is a GUI option. When enabled what should I expect to see? Is 
 it in the context menu? Or a specific uri?

That means you can also do it from web UI. if you log in as admin in XMLUI, you 
can find it un der Administrative - Import Metadata. But when called from web 
UI, it is subject to the limit set here:

https://github.com/DSpace/DSpace/blob/dspace-3.1/dspace/config/modules/bulkedit.cfg#L19


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette 
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
---#
#---BATCH METADATA EDITOR CONFIGURATIONS#
#---#
# Configuration properties used solely by the Batch Metadata#
# Editing System#
#---#
### Bulk metadata editor settings ###
# The delimiter used to separate values within a single field (defaults to a 
double pipe ||)
 valueseparator = ||

# The delimiter used to separate fields (defaults to a comma for CSV)
 fieldseparator = id, collection, dc.contributor.author, \
   dc.title, dc.date.issued, dc.rights, dc.funder

# A hard limit of the number of items allowed to be edited in one go in the UI
# (does not apply to the command line version)
 gui-item-limit = 50

# Metadata elements to exclude when exporting via the user interfaces, or when 
using the
# command line version and not using the -a (all) option.
ignore-on-export = dc.date.accessioned, dc.date.available, \
dc.date.updated, dc.description.provenance

# Should the 'action' column allow the 'expunge' method.  By default this is 
set to false
#allowexpunge = false
--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] What are the possible data format export options in Dspace?

2013-05-24 Thread helix84
On Fri, May 24, 2013 at 11:53 AM, Evans, Kev kevin.ev...@exeter.ac.uk wrote:
 But when call it from the WebUI, the fields are replicated multiple times.

You didn't write which fields, so I'm guessing you hit a common issue.
DSpace treats field names as distinct based on what is specified as
language. Say you're using two languages in your repository, en and
de, then you can have fields with the following language variations
and here's an example how the would be displayed in the CSV header:
field language - column header for dc.title
en - dc.title[en]
de - dc.title[de]
empty string - dc.title[]
NULL - dc.title

Is this the kind of duplication you're seeing?


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] What are the possible data format export options in Dspace?

2013-05-24 Thread Evans, Kev
Yes this is the kind of duplication, although only using one language [en]

Kev

-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 24 May 2013 11:16
To: Evans, Kev
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] What are the possible data format export options in 
Dspace?

On Fri, May 24, 2013 at 11:53 AM, Evans, Kev kevin.ev...@exeter.ac.uk wrote:
 But when call it from the WebUI, the fields are replicated multiple times.

You didn't write which fields, so I'm guessing you hit a common issue.
DSpace treats field names as distinct based on what is specified as language. 
Say you're using two languages in your repository, en and de, then you can have 
fields with the following language variations and here's an example how the 
would be displayed in the CSV header:
field language - column header for dc.title en - dc.title[en] de - dc.title[de] 
empty string - dc.title[] NULL - dc.title

Is this the kind of duplication you're seeing?


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette 
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] What are the possible data format export options in Dspace?

2013-05-24 Thread helix84
On Fri, May 24, 2013 at 12:21 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote:
 Yes this is the kind of duplication, although only using one language [en]

These are inconsistencies in your user data - you should have your own
policy whether you always use a language code for a certain field or
not.

The inconsistency between NULL and empty string is DSpace's fault
because different processes (submission/edit/import methods) are not
consistent in what they put in by default. Sorry about that, we should
fix it, it's just low priority.

Anyway, the Batch Metadata Editor makes it extremely easy to move data
between these columns, and re-import them. Moving a data value from
the dc.title[] column to dc.title and leaving the value under
dc.title[] empty will do what you'd expect - create a new metadata
value with NULL language and get rid of the metadata value with empty
string as language.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] What are the possible data format export options in Dspace?

2013-05-22 Thread Evans, Kev
Hi Helix84

This looks just what me need.

I notice there is a GUI option. When enabled what should I expect to see? Is it 
in the context menu? Or a specific uri?

Cheers

Kevin

-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 21 May 2013 16:36
To: Evans, Kev
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] What are the possible data format export options in 
Dspace?

On Tue, May 21, 2013 at 4:47 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote:
 What are the possible data format export options in DSpace?

 Are Repository Administrators/Curators  able to easily extract 
 information that can be used  to check compliance levels with funder 
 open access policies.

 For example, I'd like to be able to get the following list:

 Author, Title, Date of publication, Funder, Rights etc. exported into Excel?

Hi Kevin,

there are in fact many options how to export data from DSpace. Most prominently 
OAI which lets you define many metadata formats, but also some package-like 
formats as described in the System Administration section [1].

Since you're interested in export of particlar metadata fields into Excel, I'd 
recommend you to use the Batch Metadata Editing Tool, which can export a CSV 
[2] with all the metadata of a specified site/community/collection/item.

[1] https://wiki.duraspace.org/display/DSDOC3x/DSpace+3.x+Documentation
[2] https://wiki.duraspace.org/display/DSDOC3x/Batch+Metadata+Editing


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette 
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] What are the possible data format export options in Dspace?

2013-05-22 Thread helix84
On Wed, May 22, 2013 at 3:03 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote:
 I notice there is a GUI option. When enabled what should I expect to see? Is 
 it in the context menu? Or a specific uri?

That means you can also do it from web UI. if you log in as admin in
XMLUI, you can find it un der Administrative - Import Metadata. But
when called from web UI, it is subject to the limit set here:

https://github.com/DSpace/DSpace/blob/dspace-3.1/dspace/config/modules/bulkedit.cfg#L19


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] What are the possible data format export options in Dspace?

2013-05-21 Thread Evans, Kev
Hi,

What are the possible data format export options in DSpace?

Are Repository Administrators/Curators  able to easily extract information that 
can be used  to check compliance levels with funder open access policies.
For example, I'd like to be able to get the following list:
Author, Title, Date of publication, Funder, Rights etc. exported into Excel?

Cheers

Kevin

Kevin Evans
Systems Developer,
Research  Collaborative Systems,
Enterprise Applications,
Room 911, 9th Floor, Laver Building,
University of Exeter,
Exeter,
Devon,
EX4 4QE
01392 725573
07775027574
https://my.exeter.ac.uk

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] What are the possible data format export options in Dspace?

2013-05-21 Thread helix84
On Tue, May 21, 2013 at 4:47 PM, Evans, Kev kevin.ev...@exeter.ac.uk wrote:
 What are the possible data format export options in DSpace?

 Are Repository Administrators/Curators  able to easily extract information
 that can be used  to check compliance levels with funder open access
 policies.

 For example, I'd like to be able to get the following list:

 Author, Title, Date of publication, Funder, Rights etc. exported into Excel?

Hi Kevin,

there are in fact many options how to export data from DSpace. Most
prominently OAI which lets you define many metadata formats, but also
some package-like formats as described in the System Administration
section [1].

Since you're interested in export of particlar metadata fields into
Excel, I'd recommend you to use the Batch Metadata Editing Tool, which
can export a CSV [2] with all the metadata of a specified
site/community/collection/item.

[1] https://wiki.duraspace.org/display/DSDOC3x/DSpace+3.x+Documentation
[2] https://wiki.duraspace.org/display/DSDOC3x/Batch+Metadata+Editing


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_may
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette