Re: [Dspace-tech] XOAI wrong request info

2015-03-05 Thread helix84
OK, I'm a bit lost but let's consider . Its value doesn't
originate in configuration, it's taken from current request. So if you
can access your repository in three ways (example below), it will
display three values of  accordingly. With caching enabled,
the value used in the first request is cached.

https://eldorado.tu-dortmund.de/dspace-oai/request?verb=Identify
http://eldorado.tu-dortmund.de/dspace-oai/request?verb=Identify
http://eldorado.tu-dortmund.de:8080/dspace-oai/request?verb=Identify

https://github.com/DSpace/DSpace/blob/dspace-4.2/dspace-oai/src/main/java/org/dspace/xoai/data/DSpaceIdentify.java#L76-85

Please note that I tested the behaviour described above only on
current master, not on 4.2.

https://github.com/DSpace/DSpace/blob/dspace-5_x/dspace-oai/src/main/java/org/dspace/xoai/services/impl/xoai/DSpaceRepositoryConfiguration.java#L72-81


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] Input Forms Value Pairs

2015-03-05 Thread helix84
File attached. This took literally three minutes to look up and create
in vim. I used alpha-2 as the stored value.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


  Afghanistan
  AF


  Åland Islands
  AX


  Albania
  AL


  Algeria
  DZ


  American Samoa
  AS


  Andorra
  AD


  Angola
  AO


  Anguilla
  AI


  Antarctica
  AQ


  Antigua and Barbuda
  AG


  Argentina
  AR


  Armenia
  AM


  Aruba
  AW


  Australia
  AU


  Austria
  AT


  Azerbaijan
  AZ


  Bahamas
  BS


  Bahrain
  BH


  Bangladesh
  BD


  Barbados
  BB


  Belarus
  BY


  Belgium
  BE


  Belize
  BZ


  Benin
  BJ


  Bermuda
  BM


  Bhutan
  BT


  Bolivia (Plurinational State of)
  BO


  Bonaire, Sint Eustatius and Saba
  BQ


  Bosnia and Herzegovina
  BA


  Botswana
  BW


  Bouvet Island
  BV


  Brazil
  BR


  British Indian Ocean Territory
  IO


  Brunei Darussalam
  BN


  Bulgaria
  BG


  Burkina Faso
  BF


  Burundi
  BI


  Cambodia
  KH


  Cameroon
  CM


  Canada
  CA


  Cabo Verde
  CV


  Cayman Islands
  KY


  Central African Republic
  CF


  Chad
  TD


  Chile
  CL


  China
  CN


  Christmas Island
  CX


  Cocos (Keeling) Islands
  CC


  Colombia
  CO


  Comoros
  KM


  Congo
  CG


  Congo (Democratic Republic of the)
  CD


  Cook Islands
  CK


  Costa Rica
  CR


  Côte d'Ivoire
  CI


  Croatia
  HR


  Cuba
  CU


  Curaçao
  CW


  Cyprus
  CY


  Czech Republic
  CZ


  Denmark
  DK


  Djibouti
  DJ


  Dominica
  DM


  Dominican Republic
  DO


  Ecuador
  EC


  Egypt
  EG


  El Salvador
  SV


  Equatorial Guinea
  GQ


  Eritrea
  ER


  Estonia
  EE


  Ethiopia
  ET


  Falkland Islands (Malvinas)
  FK


  Faroe Islands
  FO


  Fiji
  FJ


  Finland
  FI


  France
  FR


  French Guiana
  GF


  French Polynesia
  PF


  French Southern Territories
  TF


  Gabon
  GA


  Gambia
  GM


  Georgia
  GE


  Germany
  DE


  Ghana
  GH


  Gibraltar
  GI


  Greece
  GR


  Greenland
  GL


  Grenada
  GD


  Guadeloupe
  GP


  Guam
  GU


  Guatemala
  GT


  Guernsey
  GG


  Guinea
  GN


  Guinea-Bissau
  GW


  Guyana
  GY


  Haiti
  HT


  Heard Island and McDonald Islands
  HM


  Holy See
  VA


  Honduras
  HN


  Hong Kong
  HK


  Hungary
  HU


  Iceland
  IS


  India
  IN


  Indonesia
  ID


  Iran (Islamic Republic of)
  IR


  Iraq
  IQ


  Ireland
  IE


  Isle of Man
  IM


  Israel
  IL


  Italy
  IT


  Jamaica
  JM


  Japan
  JP


  Jersey
  JE


  Jordan
  JO


  Kazakhstan
  KZ


  Kenya
  KE


  Kiribati
  KI


  Korea (Democratic People's Republic of)
  KP


  Korea (Republic of)
  KR


  Kuwait
  KW


  Kyrgyzstan
  KG


  Lao People's Democratic Republic
  LA


  Latvia
  LV


  Lebanon
  LB


  Lesotho
  LS


  Liberia
  LR


  Libya
  LY


  Liechtenstein
  LI


  Lithuania
  LT


  Luxembourg
  LU


  Macao
  MO


  Macedonia (the former Yugoslav Republic of)
  MK


  Madagascar
  MG


  Malawi
  MW


  Malaysia
  MY


  Maldives
  MV


  Mali
  ML


  Malta
  MT


  Marshall Islands
  MH


  Martinique
  MQ


  Mauritania
  MR


  Mauritius
  MU


  Mayotte
  YT


  Mexico
  MX


  Micronesia (Federated States of)
  FM


  Moldova (Republic of)
  MD


  Monaco
  MC


  Mongolia
  MN


  Montenegro
  ME


  Montserrat
  MS


  Morocco
  MA


  Mozambique
  MZ


  Myanmar
  MM


  Namibia
  NA


  Nauru
  NR


  Nepal
  NP


  Netherlands
  NL


  New Caledonia
  NC


  New Zealand
  NZ


  Nicaragua
  NI


  Niger
  NE


  Nigeria
  NG


  Niue
  NU


  Norfolk Island
  NF


  Northern Mariana Islands
  MP


  Norway
  NO


  Oman
  OM


  Pakistan
  PK


  Palau
  PW


  Palestine, State of
  PS


  Panama
  PA


  Papua New Guinea
  PG


  Paraguay
  PY


  Peru
  PE


  Philippines
  PH


  Pitcairn
  PN


  Poland
  PL


  Portugal
  PT


  Puerto Rico
  PR


  Qatar
  QA


  Réunion
  RE


  Romania
  RO


  Russian Federation
  RU


  Rwanda
  RW


  Saint Barthélemy
  BL


  Saint Helena, Ascension and Tristan da Cunha
  SH


  Saint Kitts and Nevis
  KN


  Saint Lucia
  LC


  Saint Martin (French part)
  MF


  Saint Pierre and Miquelon
  PM


  Saint Vincent and the Grenadines
  VC


  Samoa
  WS


  San Marino
  SM


  Sao Tome and Principe
  ST


  Saudi Arabia
  SA


  Senegal
  SN


  Serbia
  RS


  Seychelles
  SC


  Sierra Leone
  SL


  Singapore
  SG


  Sint Maarten (Dutch part)
  SX


  Slovakia
  SK


  Slovenia
  SI


  Solomon Islands
  SB


  Somalia
  SO


  South Africa
  ZA


  South Georgia and the South Sandwich Islands
  GS


  South Sudan
  SS


  Spain
  ES


  Sri Lanka
  LK


  Sudan
  SD


  Suriname
  SR


  Svalbard and Jan Mayen
  SJ


  Swaziland
  SZ


  Sweden
  SE


  Switzerland
  CH


  Syrian Arab Republic
  SY


  Taiwan, Province of China
  TW


  Tajikistan
  TJ


  Tanzania, United Republic of
  TZ


  Thailand
  TH


  Timor-Leste
  TL


  Togo
  TG


  Tokelau
  TK


  Tonga
  TO


  Trinidad an

Re: [Dspace-tech] Input Forms Value Pairs

2015-03-05 Thread Hilton Gibson
Thanks!
The power of open source.
Can I make it public?

Each to his own, I am sys admin not a programmer.
See: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Capacity_Building
And:
http://wiki.lib.sun.ac.za/index.php/SUNScholar/Capacity_Building/Digital_Repository_Systems_Management#Why_I_am_not_a_programmer

Cheers

hg


*Hilton Gibson*
Ubuntu Linux Systems Administrator
JS Gericke Library
Room 1025C
Stellenbosch University
Private Bag X5036
Stellenbosch
7599
South Africa

Tel: +27 21 808 4100 | Cell: +27 84 646 4758

On 5 March 2015 at 12:10, helix84  wrote:

> File attached. This took literally three minutes to look up and create
> in vim. I used alpha-2 as the stored value.
>
>
> Regards,
> ~~helix84
>
> Compulsory reading: DSpace Mailing List Etiquette
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Input Forms Value Pairs

2015-03-05 Thread helix84
On Thu, Mar 5, 2015 at 11:33 AM, Hilton Gibson  wrote:
> Can I make it public?

Sure. I took the data from Wikipedia, so consider it CC-BY-SA 3.0 Unported.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] install error for upstream/master

2015-03-05 Thread Mark H. Wood
On Wed, Mar 04, 2015 at 07:34:44PM +, Monika C. Mevenkamp wrote:
> Ah - Yikes - Thanks
> 
> It compiles now   after I changed the dependencies to rely on  
> javax.servlet-api
> Unfortunately this had to be done in all sorts of pom.xml files
> 
> BUT
> 
> after the compile I still find WEB-INF/lib/servlet-api-2.5-20081211.jar in 
> webapps/*/WEB-INF/lib directories
> 
> when I do
> > ant update
> > rm $DSPACE_HOME/webapps/jspui/WEB-INF/lib/*servlet*
> then restart tomcat and localhost:8080/jspui comes up fine

My reading of the output of 'mvn dependency:tree' suggests that this
is org.mortbay.jetty:servlet-api, pulled in transitively due to the
dependency on org.mortbay.jetty.jetty by
com.google.oauth-client-jetty, which for some reason is a dependency
of dspace-api.  I wonder what happens when we exclude
o.m.j:servlet-api?

It looks to me as though at least oauth-client-jetty, and perhaps
others, should be in test.  That's probably a better fix.

-- 
Mark H. Wood
Lead Technology Analyst

University Library
Indiana University - Purdue University Indianapolis
755 W. Michigan Street
Indianapolis, IN 46202
317-274-0749
www.ulib.iupui.edu


signature.asc
Description: Digital signature
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] browse list with contains option not starts_with

2015-03-05 Thread Pablo Buenaposada
up!



--
View this message in context: 
http://dspace.2283337.n4.nabble.com/browse-list-with-contains-option-not-starts-with-tp4676815p4676889.html
Sent from the DSpace - Tech mailing list archive at Nabble.com.

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] (no subject)

2015-03-05 Thread Mark H. Wood
On Thu, Mar 05, 2015 at 12:36:23AM +0200, Skevas Spiridon wrote:
> I've installed the dspace and when i go to browse "Authors" or "By Issue
> Date" or "Titles" as Administrator i get an error. This happens also when i
> try to browse "Private Items" or "Withdraw items" again as
> administrator.What happens?

It appears to me that your Solr instance for DSpace either is not
running, is not listening at the URL that DSpace has been configured
to use for it, or is configured to reject connections from the address
and/or port that DSpace uses to contact it.

-- 
Mark H. Wood
Lead Technology Analyst

University Library
Indiana University - Purdue University Indianapolis
755 W. Michigan Street
Indianapolis, IN 46202
317-274-0749
www.ulib.iupui.edu


signature.asc
Description: Digital signature
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Registering DOIs with crossref from DSpace

2015-03-05 Thread Chris Gray
Thanks, helix,

I'm blushing because I failed to notice the last short section of the 
document page for DOI integration.

Chris

On 15-03-04 04:34 PM, helix84 wrote:
> Hi Chris,
>
> you are correct, DSpace currrently supports only the DataCite and EZID
> APIs. It doesn't support the CrossRef API yet, but the infrastructure
> for minting DOIs is already in place, so it should be relatively easy
> to write a CrossRef class for someone with access to CrossRef API.
> Here's how:
>
> https://wiki.duraspace.org/display/DSDOC5x/DOI+Digital+Object+Identifier#DOIDigitalObjectIdentifier-AddingsupportforotherRegistrationAgencies
>
>
> Regards,
> ~~helix84
>
> Compulsory reading: DSpace Mailing List Etiquette
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] CrossRef API implementation of the DOIConnector interface

2015-03-05 Thread Chris Gray
Before I reinvent the wheel, I was wondering if there are any DSpace 
sites out there that have implemented the DOIConnector interface 
([dspace-source]/dspace-api/src/main/java/org/dspace/identifier/doi/DOIConnector.java)
 
to work with the CrossRef API.

Thanks,
Chris

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] Submission process and input-forms.xml - enable language fields

2015-03-05 Thread Vladimir Tomić

Hi all,

In Dublin Core metadata, each value (metadatavalue.text_value) has an 
accompanying language qualifier (metadatavalue.text_lang which can be null).


When editing metadata for an item, one can also edit this language 
qualifier.


When submitting a new item into DSpace there are no accompanying 
language fields for each input field - each metadata value that the 
submitter enters gets assigned the default language that's in 
dspace.cfg. We couldn't find instructions how to enable these fields in 
DSpace documentation, so that the submitter can say this title is in 
English, and this is in German...


Is it possible to configure the submission process in 
DSpace/XMLUI/Manakin to include the language qualifier for fields that 
need it?


Kind regards,
Vladimir



smime.p7s
Description: S/MIME Cryptographic Signature
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread helix84
Hi Kristian,

I think you're right that the declared
persistent doesn't match how DSpace
behaves. I filed a Jira issue and created a pull request to change the
declared status to transient.

https://jira.duraspace.org/browse/DS-2491


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


On Thu, Mar 5, 2015 at 2:52 PM, Kristian Roberto Salcedo
 wrote:
> Hi all,
>
> In Dspace 4.2 we are currently seeing that our OAI feeds are not being 
> persistent as per these definitions when it comes to deleted (withdrawn) 
> items:
>
> http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
> https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-PMHDataProvider2.0(Internals)-Deletions
>
> Withdrawn items do not get the  as they should, like 
> in this example:
>
> http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Record_Example_1
>
> Withdrawing an item is not reflected in the OAI entry in any way.
>
> --
>
> This is our Identify page at the moment:
>
> https://www.duo.uio.no/oai/request?verb=Identify
>
> --
>
> I believe we're doing everything right regarding config parameters and 
> maintenance of the solr oai index.
>
> The only place I can find a "persistent"-parameter is in this config file:
> /www/var/data/dspace/config/oaicat.properties
> which I thought was deprecated, but we still set it just to be sure:
> Identify.deletedRecord=persistent
>
> All other relevant config parameters are set in these two files as far as I 
> can tell:
>
> /www/var/data/dspace/config/modules/oai.cfg
> /www/var/data/dspace/config/crosswalks/oai/description.xml
>
> We are running the oai import -o command nightly.
>
> --
>
> The only way we've found to remove withdrawn items from the OAI feed is by 
> running a complete re-indexing of the oai solr index:
>
> /www/var/data/dspace/bin/dspace oai import -c
>
> with a subsequent
>
> /www/var/data/dspace/bin/dspace oai clean-cache
>
> This removes a withdrawn item:
>
> https://www.duo.uio.no/handle/10852/42670
>
> completely from the feed:
>
> https://www.duo.uio.no/oai/request?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai:localhost:10852/42670
>
> which is not what we want...
>
> --
>
>
> Is anyone else experiencing the same problem?
>
> Maybe I've missed something - If this actually works differently than we 
> expect or has been addressed in OAI 2.1, please let me know.
>
>
> regards,
> Kristian Salcedo
> Universitetet of Oslo Library
> Department of digital services
>
>
> --
> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for all
> things parallel software development, from weekly thought leadership blogs to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette: 
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] Submission process and input-forms.xml - enable language fields

2015-03-05 Thread helix84
Hi Vladimir,

as far as I know, submission forms don't give you a choice of language
for individual fields and just pre-fill the value of default.language
(as you noted). Currently you can either edit the in_archive item or
you can use other form of ingestion if you require this functionality.
If I may say so, patches to add this to input forms would be welcome,
but on the other hand people tend to simplify input forms (e.g. reduce
the number of steps) rather than complicate it. Preferably, this would
be done in a way that's very unobtrusive.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] Dspace migration from 1.7 to 4 in new setup

2015-03-05 Thread helix84
Please, don't cross-post. Your question belongs to dspace-tech only.

The bi_* tables are the old browse index. Since DSpace 4, it's not
used by default anymore unless you explicitly configure to use the
Postgres DAO rather then the Solr DAO [1].

In your dspace.log I don't see any problem which would pertain to
these bi_* tables. What did you do when those postgres errors were
logged?

Anyway, there's another problem in dspace.cfg, unrelated to bi_*
tables. Your DSpace cannot connect to Solr, which now provides the
browse and search functionality. Make sure that you deployed the solr
webapp, that it's running and that you configured DSpace to point to
their correct URL (which may be different from the example below):

server=http://localhost:8080/solr/statistics in
[dspace]/config/modules/solr-statistics.cfg.
solr.url=http://localhost:8080/solr/oai in [dspace]/config/modules/oai.cfg and
search.server=http://localhost:8080/solr/search in
[dspace]/config/modules/discovery.cfg
All of these can be changed at once at build time by changing
solr.server=http://localhost:8080/solr in [dspace-source]/build.properties


[1] 
https://github.com/DSpace/DSpace/blob/dspace-4_x/dspace/config/dspace.cfg#L1016-1017


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread Kristian Roberto Salcedo
Hi Ivan,

Thank you for answering so swiftly.
But are you saying that this part of the documentation
https://wiki.duraspace.org/pages/viewpage.action?pageId=45548245#OAI-PMHDataProvider2.0(Internals)-Deletions
is incorrect and that Dspace only supports deletions "transiently"? 
If so, wouldn’t it mean that all who harvest us would have to perform complete 
harvests every time in order to keep track of changes in our repository unless 
we create custom solutions in order to reveal deleted status?

regards,
Kristian

>-Original Message-
>From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of
>helix84
>Sent: Thursday, March 05, 2015 3:46 PM
>To: Kristian Roberto Salcedo
>Cc: dspace-tech@lists.sourceforge.net; João Melo
>Subject: Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?
>
>Hi Kristian,
>
>I think you're right that the declared
>persistent doesn't match how DSpace
>behaves. I filed a Jira issue and created a pull request to change the declared
>status to transient.
>
>https://jira.duraspace.org/browse/DS-2491
>
>
>Regards,
>~~helix84
>
>Compulsory reading: DSpace Mailing List Etiquette
>https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
>
>On Thu, Mar 5, 2015 at 2:52 PM, Kristian Roberto Salcedo
> wrote:
>> Hi all,
>>
>> In Dspace 4.2 we are currently seeing that our OAI feeds are not being
>persistent as per these definitions when it comes to deleted (withdrawn)
>items:
>>
>> http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
>> https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-
>P
>> MHDataProvider2.0(Internals)-Deletions
>>
>> Withdrawn items do not get the  as they should,
>like in this example:
>>
>>
>http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Re
>> cord_Example_1
>>
>> Withdrawing an item is not reflected in the OAI entry in any way.
>>
>> --
>>
>> This is our Identify page at the moment:
>>
>> https://www.duo.uio.no/oai/request?verb=Identify
>>
>> --
>>
>> I believe we're doing everything right regarding config parameters and
>maintenance of the solr oai index.
>>
>> The only place I can find a "persistent"-parameter is in this config file:
>> /www/var/data/dspace/config/oaicat.properties
>> which I thought was deprecated, but we still set it just to be sure:
>> Identify.deletedRecord=persistent
>>
>> All other relevant config parameters are set in these two files as far as I 
>> can
>tell:
>>
>> /www/var/data/dspace/config/modules/oai.cfg
>> /www/var/data/dspace/config/crosswalks/oai/description.xml
>>
>> We are running the oai import -o command nightly.
>>
>> --
>>
>> The only way we've found to remove withdrawn items from the OAI feed is
>by running a complete re-indexing of the oai solr index:
>>
>> /www/var/data/dspace/bin/dspace oai import -c
>>
>> with a subsequent
>>
>> /www/var/data/dspace/bin/dspace oai clean-cache
>>
>> This removes a withdrawn item:
>>
>> https://www.duo.uio.no/handle/10852/42670
>>
>> completely from the feed:
>>
>>
>https://www.duo.uio.no/oai/request?verb=GetRecord&metadataPrefix=oai
>_d
>> c&identifier=oai:localhost:10852/42670
>>
>> which is not what we want...
>>
>> --
>>
>>
>> Is anyone else experiencing the same problem?
>>
>> Maybe I've missed something - If this actually works differently than we
>expect or has been addressed in OAI 2.1, please let me know.
>>
>>
>> regards,
>> Kristian Salcedo
>> Universitetet of Oslo Library
>> Department of digital services
>>
>>
>> --
>>  Dive into the World of Parallel Programming The Go Parallel
>> Website, sponsored by Intel and developed in partnership with Slashdot
>> Media, is your hub for all things parallel software development, from
>> weekly thought leadership blogs to news, videos, case studies,
>> tutorials and more. Take a look and join the conversation now.
>> http://goparallel.sourceforge.net/
>> ___
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List E

Re: [Dspace-tech] Submission process and input-forms.xml - enable language fields

2015-03-05 Thread Vladimir Tomić

Hi Helix,

And thank you!

In case our users insist on this and we develop this alternative 
submission form, we will definitely make it public.


It would be basically the same as it is now, with language field next to 
its "owner", pre-filled with the dspace.cfg default value, so without 
any extra clicks or typing the submitter would get the same result as 
with the current submission form.


Kind regards,
Vladimir

On 2015-03-05 16:03, helix84 wrote:

Hi Vladimir,

as far as I know, submission forms don't give you a choice of language
for individual fields and just pre-fill the value of default.language
(as you noted). Currently you can either edit the in_archive item or
you can use other form of ingestion if you require this functionality.
If I may say so, patches to add this to input forms would be welcome,
but on the other hand people tend to simplify input forms (e.g. reduce
the number of steps) rather than complicate it. Preferably, this would
be done in a way that's very unobtrusive.


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette






smime.p7s
Description: S/MIME Cryptographic Signature
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread Kristian Roberto Salcedo
Hi all,

In Dspace 4.2 we are currently seeing that our OAI feeds are not being 
persistent as per these definitions when it comes to deleted (withdrawn) items:

http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-PMHDataProvider2.0(Internals)-Deletions

Withdrawn items do not get the  as they should, like in 
this example:

http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Record_Example_1

Withdrawing an item is not reflected in the OAI entry in any way.

--

This is our Identify page at the moment:

https://www.duo.uio.no/oai/request?verb=Identify

--

I believe we're doing everything right regarding config parameters and 
maintenance of the solr oai index.

The only place I can find a "persistent"-parameter is in this config file:
/www/var/data/dspace/config/oaicat.properties
which I thought was deprecated, but we still set it just to be sure:
Identify.deletedRecord=persistent

All other relevant config parameters are set in these two files as far as I can 
tell:

/www/var/data/dspace/config/modules/oai.cfg
/www/var/data/dspace/config/crosswalks/oai/description.xml

We are running the oai import -o command nightly.

--

The only way we've found to remove withdrawn items from the OAI feed is by 
running a complete re-indexing of the oai solr index:

/www/var/data/dspace/bin/dspace oai import -c

with a subsequent

/www/var/data/dspace/bin/dspace oai clean-cache

This removes a withdrawn item:

https://www.duo.uio.no/handle/10852/42670

completely from the feed:

https://www.duo.uio.no/oai/request?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai:localhost:10852/42670

which is not what we want...

--


Is anyone else experiencing the same problem?

Maybe I've missed something - If this actually works differently than we expect 
or has been addressed in OAI 2.1, please let me know.


regards,
Kristian Salcedo
Universitetet of Oslo Library
Department of digital services


--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread João Melo
Hi Kristian,

I cannot see how your description matches the implementation.
>From the implementation withdrawn items are indexed.

https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L248

The only way withdrawn items can disappear from the list is due to usage of
virtual contexts (driver/openaire).
Is that your scenario?

On 5 March 2015 at 15:13, Kristian Roberto Salcedo 
wrote:

> Hi Ivan,
>
> Thank you for answering so swiftly.
> But are you saying that this part of the documentation
>
> https://wiki.duraspace.org/pages/viewpage.action?pageId=45548245#OAI-PMHDataProvider2.0(Internals)-Deletions
> is incorrect and that Dspace only supports deletions "transiently"?
> If so, wouldn’t it mean that all who harvest us would have to perform
> complete harvests every time in order to keep track of changes in our
> repository unless we create custom solutions in order to reveal deleted
> status?
>
> regards,
> Kristian
>
> >-Original Message-
> >From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of
> >helix84
> >Sent: Thursday, March 05, 2015 3:46 PM
> >To: Kristian Roberto Salcedo
> >Cc: dspace-tech@lists.sourceforge.net; João Melo
> >Subject: Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?
> >
> >Hi Kristian,
> >
> >I think you're right that the declared
> >persistent doesn't match how DSpace
> >behaves. I filed a Jira issue and created a pull request to change the
> declared
> >status to transient.
> >
> >https://jira.duraspace.org/browse/DS-2491
> >
> >
> >Regards,
> >~~helix84
> >
> >Compulsory reading: DSpace Mailing List Etiquette
> >https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
> >
> >
> >On Thu, Mar 5, 2015 at 2:52 PM, Kristian Roberto Salcedo
> > wrote:
> >> Hi all,
> >>
> >> In Dspace 4.2 we are currently seeing that our OAI feeds are not being
> >persistent as per these definitions when it comes to deleted (withdrawn)
> >items:
> >>
> >> http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
> >> https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-
> >P
> >> MHDataProvider2.0(Internals)-Deletions
> >>
> >> Withdrawn items do not get the  as they should,
> >like in this example:
> >>
> >>
> >http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Re
> >> cord_Example_1
> >>
> >> Withdrawing an item is not reflected in the OAI entry in any way.
> >>
> >> --
> >>
> >> This is our Identify page at the moment:
> >>
> >> https://www.duo.uio.no/oai/request?verb=Identify
> >>
> >> --
> >>
> >> I believe we're doing everything right regarding config parameters and
> >maintenance of the solr oai index.
> >>
> >> The only place I can find a "persistent"-parameter is in this config
> file:
> >> /www/var/data/dspace/config/oaicat.properties
> >> which I thought was deprecated, but we still set it just to be sure:
> >> Identify.deletedRecord=persistent
> >>
> >> All other relevant config parameters are set in these two files as far
> as I can
> >tell:
> >>
> >> /www/var/data/dspace/config/modules/oai.cfg
> >> /www/var/data/dspace/config/crosswalks/oai/description.xml
> >>
> >> We are running the oai import -o command nightly.
> >>
> >> --
> >>
> >> The only way we've found to remove withdrawn items from the OAI feed is
> >by running a complete re-indexing of the oai solr index:
> >>
> >> /www/var/data/dspace/bin/dspace oai import -c
> >>
> >> with a subsequent
> >>
> >> /www/var/data/dspace/bin/dspace oai clean-cache
> >>
> >> This removes a withdrawn item:
> >>
> >> https://www.duo.uio.no/handle/10852/42670
> >>
> >> completely from the feed:
> >>
> >>
> >https://www.duo.uio.no/oai/request?verb=GetRecord&metadataPrefix=oai
> >_d
> >> c&identifier=oai:localhost:10852/42670
> >>
> >> which is not what we want...
> >>
> >> --
> >>
> >>
> >> Is anyone else experiencing the same problem?
> >>
> >> Maybe I've missed something - If this actually works differently than we
> >expect or has been addressed in OAI 2.1, please let me know.
> >>
> >>
> >> regards,
> >> Kristian Salcedo
> >> Universitetet of Oslo Library
> >> Department of digital services
> >>
> >>
> >> --
> >>  Dive into the World of Parallel Programming The Go Parallel
> >> Website, sponsored by Intel and developed in partnership with Slashdot
> >> Media, is your hub for all things parallel software development, from
> >> weekly thought leadership blogs to news, videos, case studies,
> >> tutorials and more. Take a look and join the conversation now.
> >> http://goparallel.sourceforge.net/
> >> ___
> >> DSpace-tech mailing list
> >> DSpace-tech@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/dspace-tec

Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread helix84
On Thu, Mar 5, 2015 at 4:13 PM, Kristian Roberto Salcedo
 wrote:
> Thank you for answering so swiftly.
> But are you saying that this part of the documentation
> https://wiki.duraspace.org/pages/viewpage.action?pageId=45548245#OAI-PMHDataProvider2.0(Internals)-Deletions
> is incorrect and that Dspace only supports deletions "transiently"?

I think the docs are open to interpretation a little bit. If you have
a policy to withdraw items instead of deleting them, then you have
persistent repository in the OAI-PMH sense. However, actually deleting
an item removes it from DSpace and DSpace can no more provide any
information about it. So there's an impedance mismatch of the concept
between DSpace and OAI-PMH. Secondly, if you run a full import, I
think the state information may be lost. But it's been a long time
since I last verified, so correct me if I'm wrong.

> If so, wouldn’t it mean that all who harvest us would have to perform 
> complete harvests every time in order to keep track of changes in our 
> repository unless we create custom solutions in order to reveal deleted 
> status?

If you implement a policy to only ever withdraw items, I think you're
fine. But you should test what happens to them during "oai import -c".


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread Ondřej Košarko
Hey,
but the indexAll() does not select the withdrawn items
https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L191

2015-03-05 16:31 GMT+01:00 João Melo :

> Hi Kristian,
>
> I cannot see how your description matches the implementation.
> From the implementation withdrawn items are indexed.
>
>
> https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L248
>
> The only way withdrawn items can disappear from the list is due to usage
> of virtual contexts (driver/openaire).
> Is that your scenario?
>
> On 5 March 2015 at 15:13, Kristian Roberto Salcedo 
> wrote:
>
>> Hi Ivan,
>>
>> Thank you for answering so swiftly.
>> But are you saying that this part of the documentation
>>
>> https://wiki.duraspace.org/pages/viewpage.action?pageId=45548245#OAI-PMHDataProvider2.0(Internals)-Deletions
>> is incorrect and that Dspace only supports deletions "transiently"?
>> If so, wouldn’t it mean that all who harvest us would have to perform
>> complete harvests every time in order to keep track of changes in our
>> repository unless we create custom solutions in order to reveal deleted
>> status?
>>
>> regards,
>> Kristian
>>
>> >-Original Message-
>> >From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of
>> >helix84
>> >Sent: Thursday, March 05, 2015 3:46 PM
>> >To: Kristian Roberto Salcedo
>> >Cc: dspace-tech@lists.sourceforge.net; João Melo
>> >Subject: Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?
>> >
>> >Hi Kristian,
>> >
>> >I think you're right that the declared
>> >persistent doesn't match how DSpace
>> >behaves. I filed a Jira issue and created a pull request to change the
>> declared
>> >status to transient.
>> >
>> >https://jira.duraspace.org/browse/DS-2491
>> >
>> >
>> >Regards,
>> >~~helix84
>> >
>> >Compulsory reading: DSpace Mailing List Etiquette
>> >https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>> >
>> >
>> >On Thu, Mar 5, 2015 at 2:52 PM, Kristian Roberto Salcedo
>> > wrote:
>> >> Hi all,
>> >>
>> >> In Dspace 4.2 we are currently seeing that our OAI feeds are not being
>> >persistent as per these definitions when it comes to deleted (withdrawn)
>> >items:
>> >>
>> >> http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
>> >> https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-
>> >P
>> >> MHDataProvider2.0(Internals)-Deletions
>> >>
>> >> Withdrawn items do not get the  as they should,
>> >like in this example:
>> >>
>> >>
>> >http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Re
>> >> cord_Example_1
>> >>
>> >> Withdrawing an item is not reflected in the OAI entry in any way.
>> >>
>> >> --
>> >>
>> >> This is our Identify page at the moment:
>> >>
>> >> https://www.duo.uio.no/oai/request?verb=Identify
>> >>
>> >> --
>> >>
>> >> I believe we're doing everything right regarding config parameters and
>> >maintenance of the solr oai index.
>> >>
>> >> The only place I can find a "persistent"-parameter is in this config
>> file:
>> >> /www/var/data/dspace/config/oaicat.properties
>> >> which I thought was deprecated, but we still set it just to be sure:
>> >> Identify.deletedRecord=persistent
>> >>
>> >> All other relevant config parameters are set in these two files as far
>> as I can
>> >tell:
>> >>
>> >> /www/var/data/dspace/config/modules/oai.cfg
>> >> /www/var/data/dspace/config/crosswalks/oai/description.xml
>> >>
>> >> We are running the oai import -o command nightly.
>> >>
>> >> --
>> >>
>> >> The only way we've found to remove withdrawn items from the OAI feed is
>> >by running a complete re-indexing of the oai solr index:
>> >>
>> >> /www/var/data/dspace/bin/dspace oai import -c
>> >>
>> >> with a subsequent
>> >>
>> >> /www/var/data/dspace/bin/dspace oai clean-cache
>> >>
>> >> This removes a withdrawn item:
>> >>
>> >> https://www.duo.uio.no/handle/10852/42670
>> >>
>> >> completely from the feed:
>> >>
>> >>
>> >https://www.duo.uio.no/oai/request?verb=GetRecord&metadataPrefix=oai
>> >_d
>> >> c&identifier=oai:localhost:10852/42670
>> >>
>> >> which is not what we want...
>> >>
>> >> --
>> >>
>> >>
>> >> Is anyone else experiencing the same problem?
>> >>
>> >> Maybe I've missed something - If this actually works differently than
>> we
>> >expect or has been addressed in OAI 2.1, please let me know.
>> >>
>> >>
>> >> regards,
>> >> Kristian Salcedo
>> >> Universitetet of Oslo Library
>> >> Department of digital services
>> >>
>> >>
>> >> --
>> >>  Dive into the World of Parallel Programming The Go Parallel
>> >> Website, sponsored by Intel and developed in partnership with Slashdot
>> >> Media, is your hub for all things parallel software development

Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread João Melo
Hi Ondřej

item table contains two fields withdrawn and in_archive.

in_archive - Find out if the item is part of the main archive
withdrawn - Find out if the item was withdrawn

On 5 March 2015 at 15:50, Ondřej Košarko  wrote:

> Hey,
> but the indexAll() does not select the withdrawn items
> https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L191
>
> 2015-03-05 16:31 GMT+01:00 João Melo :
>
>> Hi Kristian,
>>
>> I cannot see how your description matches the implementation.
>> From the implementation withdrawn items are indexed.
>>
>>
>> https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L248
>>
>> The only way withdrawn items can disappear from the list is due to usage
>> of virtual contexts (driver/openaire).
>> Is that your scenario?
>>
>> On 5 March 2015 at 15:13, Kristian Roberto Salcedo > > wrote:
>>
>>> Hi Ivan,
>>>
>>> Thank you for answering so swiftly.
>>> But are you saying that this part of the documentation
>>>
>>> https://wiki.duraspace.org/pages/viewpage.action?pageId=45548245#OAI-PMHDataProvider2.0(Internals)-Deletions
>>> is incorrect and that Dspace only supports deletions "transiently"?
>>> If so, wouldn’t it mean that all who harvest us would have to perform
>>> complete harvests every time in order to keep track of changes in our
>>> repository unless we create custom solutions in order to reveal deleted
>>> status?
>>>
>>> regards,
>>> Kristian
>>>
>>> >-Original Message-
>>> >From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of
>>> >helix84
>>> >Sent: Thursday, March 05, 2015 3:46 PM
>>> >To: Kristian Roberto Salcedo
>>> >Cc: dspace-tech@lists.sourceforge.net; João Melo
>>> >Subject: Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?
>>> >
>>> >Hi Kristian,
>>> >
>>> >I think you're right that the declared
>>> >persistent doesn't match how DSpace
>>> >behaves. I filed a Jira issue and created a pull request to change the
>>> declared
>>> >status to transient.
>>> >
>>> >https://jira.duraspace.org/browse/DS-2491
>>> >
>>> >
>>> >Regards,
>>> >~~helix84
>>> >
>>> >Compulsory reading: DSpace Mailing List Etiquette
>>> >https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>> >
>>> >
>>> >On Thu, Mar 5, 2015 at 2:52 PM, Kristian Roberto Salcedo
>>> > wrote:
>>> >> Hi all,
>>> >>
>>> >> In Dspace 4.2 we are currently seeing that our OAI feeds are not being
>>> >persistent as per these definitions when it comes to deleted (withdrawn)
>>> >items:
>>> >>
>>> >> http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
>>> >> https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-
>>> >P
>>> >> MHDataProvider2.0(Internals)-Deletions
>>> >>
>>> >> Withdrawn items do not get the  as they should,
>>> >like in this example:
>>> >>
>>> >>
>>> >http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Re
>>> >> cord_Example_1
>>> >>
>>> >> Withdrawing an item is not reflected in the OAI entry in any way.
>>> >>
>>> >> --
>>> >>
>>> >> This is our Identify page at the moment:
>>> >>
>>> >> https://www.duo.uio.no/oai/request?verb=Identify
>>> >>
>>> >> --
>>> >>
>>> >> I believe we're doing everything right regarding config parameters and
>>> >maintenance of the solr oai index.
>>> >>
>>> >> The only place I can find a "persistent"-parameter is in this config
>>> file:
>>> >> /www/var/data/dspace/config/oaicat.properties
>>> >> which I thought was deprecated, but we still set it just to be sure:
>>> >> Identify.deletedRecord=persistent
>>> >>
>>> >> All other relevant config parameters are set in these two files as
>>> far as I can
>>> >tell:
>>> >>
>>> >> /www/var/data/dspace/config/modules/oai.cfg
>>> >> /www/var/data/dspace/config/crosswalks/oai/description.xml
>>> >>
>>> >> We are running the oai import -o command nightly.
>>> >>
>>> >> --
>>> >>
>>> >> The only way we've found to remove withdrawn items from the OAI feed
>>> is
>>> >by running a complete re-indexing of the oai solr index:
>>> >>
>>> >> /www/var/data/dspace/bin/dspace oai import -c
>>> >>
>>> >> with a subsequent
>>> >>
>>> >> /www/var/data/dspace/bin/dspace oai clean-cache
>>> >>
>>> >> This removes a withdrawn item:
>>> >>
>>> >> https://www.duo.uio.no/handle/10852/42670
>>> >>
>>> >> completely from the feed:
>>> >>
>>> >>
>>> >https://www.duo.uio.no/oai/request?verb=GetRecord&metadataPrefix=oai
>>> >_d
>>> >> c&identifier=oai:localhost:10852/42670
>>> >>
>>> >> which is not what we want...
>>> >>
>>> >> --
>>> >>
>>> >>
>>> >> Is anyone else experiencing the same problem?
>>> >>
>>> >> Maybe I've missed something - If this actually works differently than
>>> we
>>> >expect or has been addressed in OAI 2.1, please let me know.
>>> >>
>>> >>
>>> >> regards,
>>> >> Kristian Salcedo

Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread Ondřej Košarko
But can an item be both withdrawn & in_archive? I believe it isn't so
https://github.com/DSpace/DSpace/blob/master/dspace-api/src/main/java/org/dspace/content/Item.java#L1149

2015-03-05 16:58 GMT+01:00 João Melo :

> Hi Ondřej
>
> item table contains two fields withdrawn and in_archive.
>
> in_archive - Find out if the item is part of the main archive
> withdrawn - Find out if the item was withdrawn
>
> On 5 March 2015 at 15:50, Ondřej Košarko  wrote:
>
>> Hey,
>> but the indexAll() does not select the withdrawn items
>> https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L191
>>
>> 2015-03-05 16:31 GMT+01:00 João Melo :
>>
>>> Hi Kristian,
>>>
>>> I cannot see how your description matches the implementation.
>>> From the implementation withdrawn items are indexed.
>>>
>>>
>>> https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L248
>>>
>>> The only way withdrawn items can disappear from the list is due to usage
>>> of virtual contexts (driver/openaire).
>>> Is that your scenario?
>>>
>>> On 5 March 2015 at 15:13, Kristian Roberto Salcedo <
>>> k.r.salc...@ub.uio.no> wrote:
>>>
 Hi Ivan,

 Thank you for answering so swiftly.
 But are you saying that this part of the documentation

 https://wiki.duraspace.org/pages/viewpage.action?pageId=45548245#OAI-PMHDataProvider2.0(Internals)-Deletions
 is incorrect and that Dspace only supports deletions "transiently"?
 If so, wouldn’t it mean that all who harvest us would have to perform
 complete harvests every time in order to keep track of changes in our
 repository unless we create custom solutions in order to reveal deleted
 status?

 regards,
 Kristian

 >-Original Message-
 >From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of
 >helix84
 >Sent: Thursday, March 05, 2015 3:46 PM
 >To: Kristian Roberto Salcedo
 >Cc: dspace-tech@lists.sourceforge.net; João Melo
 >Subject: Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?
 >
 >Hi Kristian,
 >
 >I think you're right that the declared
 >persistent doesn't match how DSpace
 >behaves. I filed a Jira issue and created a pull request to change the
 declared
 >status to transient.
 >
 >https://jira.duraspace.org/browse/DS-2491
 >
 >
 >Regards,
 >~~helix84
 >
 >Compulsory reading: DSpace Mailing List Etiquette
 >https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
 >
 >
 >On Thu, Mar 5, 2015 at 2:52 PM, Kristian Roberto Salcedo
 > wrote:
 >> Hi all,
 >>
 >> In Dspace 4.2 we are currently seeing that our OAI feeds are not
 being
 >persistent as per these definitions when it comes to deleted
 (withdrawn)
 >items:
 >>
 >> http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
 >>
 https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-
 >P
 >> MHDataProvider2.0(Internals)-Deletions
 >>
 >> Withdrawn items do not get the  as they
 should,
 >like in this example:
 >>
 >>
 >http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Re
 >> cord_Example_1
 >>
 >> Withdrawing an item is not reflected in the OAI entry in any way.
 >>
 >> --
 >>
 >> This is our Identify page at the moment:
 >>
 >> https://www.duo.uio.no/oai/request?verb=Identify
 >>
 >> --
 >>
 >> I believe we're doing everything right regarding config parameters
 and
 >maintenance of the solr oai index.
 >>
 >> The only place I can find a "persistent"-parameter is in this config
 file:
 >> /www/var/data/dspace/config/oaicat.properties
 >> which I thought was deprecated, but we still set it just to be sure:
 >> Identify.deletedRecord=persistent
 >>
 >> All other relevant config parameters are set in these two files as
 far as I can
 >tell:
 >>
 >> /www/var/data/dspace/config/modules/oai.cfg
 >> /www/var/data/dspace/config/crosswalks/oai/description.xml
 >>
 >> We are running the oai import -o command nightly.
 >>
 >> --
 >>
 >> The only way we've found to remove withdrawn items from the OAI feed
 is
 >by running a complete re-indexing of the oai solr index:
 >>
 >> /www/var/data/dspace/bin/dspace oai import -c
 >>
 >> with a subsequent
 >>
 >> /www/var/data/dspace/bin/dspace oai clean-cache
 >>
 >> This removes a withdrawn item:
 >>
 >> https://www.duo.uio.no/handle/10852/42670
 >>
 >> completely from the feed:
 >>
 >>
 >https://www.duo.uio.no/oai/request?verb=GetRecord&metadataPrefix=oai
 >_d
 >> c&identifi

Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?

2015-03-05 Thread João Melo
Hi Ondřej,

you are absolutely right.
Logically speaking withdrawn = !in_archive (which makes me wonder how
useful this two flags are).
Which is something I wrongly assumed which makes it an unexpected
feature/bug.

Thanks for pointing it out.
Regards,
Joao


On 5 March 2015 at 16:26, Ondřej Košarko  wrote:

> But can an item be both withdrawn & in_archive? I believe it isn't so
> https://github.com/DSpace/DSpace/blob/master/dspace-api/src/main/java/org/dspace/content/Item.java#L1149
>
> 2015-03-05 16:58 GMT+01:00 João Melo :
>
>> Hi Ondřej
>>
>> item table contains two fields withdrawn and in_archive.
>>
>> in_archive - Find out if the item is part of the main archive
>> withdrawn - Find out if the item was withdrawn
>>
>> On 5 March 2015 at 15:50, Ondřej Košarko 
>> wrote:
>>
>>> Hey,
>>> but the indexAll() does not select the withdrawn items
>>> https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L191
>>>
>>> 2015-03-05 16:31 GMT+01:00 João Melo :
>>>
 Hi Kristian,

 I cannot see how your description matches the implementation.
 From the implementation withdrawn items are indexed.


 https://github.com/DSpace/DSpace/blob/master/dspace-oai/src/main/java/org/dspace/xoai/app/XOAI.java#L248

 The only way withdrawn items can disappear from the list is due to
 usage of virtual contexts (driver/openaire).
 Is that your scenario?

 On 5 March 2015 at 15:13, Kristian Roberto Salcedo <
 k.r.salc...@ub.uio.no> wrote:

> Hi Ivan,
>
> Thank you for answering so swiftly.
> But are you saying that this part of the documentation
>
> https://wiki.duraspace.org/pages/viewpage.action?pageId=45548245#OAI-PMHDataProvider2.0(Internals)-Deletions
> is incorrect and that Dspace only supports deletions "transiently"?
> If so, wouldn’t it mean that all who harvest us would have to perform
> complete harvests every time in order to keep track of changes in our
> repository unless we create custom solutions in order to reveal deleted
> status?
>
> regards,
> Kristian
>
> >-Original Message-
> >From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of
> >helix84
> >Sent: Thursday, March 05, 2015 3:46 PM
> >To: Kristian Roberto Salcedo
> >Cc: dspace-tech@lists.sourceforge.net; João Melo
> >Subject: Re: [Dspace-tech] OAI-PMH data provider 2.0 not persistent?
> >
> >Hi Kristian,
> >
> >I think you're right that the declared
> >persistent doesn't match how DSpace
> >behaves. I filed a Jira issue and created a pull request to change
> the declared
> >status to transient.
> >
> >https://jira.duraspace.org/browse/DS-2491
> >
> >
> >Regards,
> >~~helix84
> >
> >Compulsory reading: DSpace Mailing List Etiquette
> >https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
> >
> >
> >On Thu, Mar 5, 2015 at 2:52 PM, Kristian Roberto Salcedo
> > wrote:
> >> Hi all,
> >>
> >> In Dspace 4.2 we are currently seeing that our OAI feeds are not
> being
> >persistent as per these definitions when it comes to deleted
> (withdrawn)
> >items:
> >>
> >> http://www.openarchives.org/OAI/openarchivesprotocol.html#deletion
> >>
> https://wiki.duraspace.org/pages/viewpage.action?pageId=34640887#OAI-
> >P
> >> MHDataProvider2.0(Internals)-Deletions
> >>
> >> Withdrawn items do not get the  as they
> should,
> >like in this example:
> >>
> >>
> >
> http://webservices.itcs.umich.edu/mediawiki/oaibp/index.php/Deleted_Re
> >> cord_Example_1
> >>
> >> Withdrawing an item is not reflected in the OAI entry in any way.
> >>
> >> --
> >>
> >> This is our Identify page at the moment:
> >>
> >> https://www.duo.uio.no/oai/request?verb=Identify
> >>
> >> --
> >>
> >> I believe we're doing everything right regarding config parameters
> and
> >maintenance of the solr oai index.
> >>
> >> The only place I can find a "persistent"-parameter is in this
> config file:
> >> /www/var/data/dspace/config/oaicat.properties
> >> which I thought was deprecated, but we still set it just to be sure:
> >> Identify.deletedRecord=persistent
> >>
> >> All other relevant config parameters are set in these two files as
> far as I can
> >tell:
> >>
> >> /www/var/data/dspace/config/modules/oai.cfg
> >> /www/var/data/dspace/config/crosswalks/oai/description.xml
> >>
> >> We are running the oai import -o command nightly.
> >>
> >> --
> >>
> >> The only way we've found to remove withdrawn items from the OAI
> feed is
> >by running a complete re-

[Dspace-tech] External Searching of DSpace contents

2015-03-05 Thread Peter Dietz
I was wondering if anyone has built any integrations where an external web
site (such as your institution website or CMS) can search and show results
from your DSpace? One approach that ought to be pretty straight forward
that I'm thinking of is the OpenSearch web service.

https://trydspace.longsight.com/open-search/discover?query=test

Getting that to work on a site would require some AJAX to update as the
user types in a search query, and then display the updated search results.

Another route could be the DSpace 5 REST API. There is a
find-by-metadata-field (key, value), but isn't suited for full text
searching. Other possible routes that I'm thinking are SRW/U or Z39.50.

So, I was just wondering if anyone has already accomplished something in
this area, and has client integration examples. I suppose a cheap route
would be to have some DSpace-iframe solution, where you
homepage/searchpage, just embeds DSpace search page inside.

Thanks

Peter Dietz
Longsight
www.longsight.com
pe...@longsight.com
p: 740-599-5005 x809
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] External Searching of DSpace contents

2015-03-05 Thread Terry Brady
We have a bento-box style search built into our Drupal website.

http://www.library.georgetown.edu/search/gusuper/yearbook

We have de-emphasized this interface since we adopted a discovery layer
since the discovery layer also searches our DSpace instance.

If you are curious, here is the code:
https://github.com/Georgetown-University-Libraries/gusuper

The code constructs a PHP SolrClient to perform the search.

https://github.com/Georgetown-University-Libraries/gusuper/blob/master/gudspacesolr/gudspacesolr.module#L83

Terry


On Thu, Mar 5, 2015 at 9:15 AM, Peter Dietz  wrote:

> I was wondering if anyone has built any integrations where an external web
> site (such as your institution website or CMS) can search and show results
> from your DSpace? One approach that ought to be pretty straight forward
> that I'm thinking of is the OpenSearch web service.
>
> https://trydspace.longsight.com/open-search/discover?query=test
>
> Getting that to work on a site would require some AJAX to update as the
> user types in a search query, and then display the updated search results.
>
> Another route could be the DSpace 5 REST API. There is a
> find-by-metadata-field (key, value), but isn't suited for full text
> searching. Other possible routes that I'm thinking are SRW/U or Z39.50.
>
> So, I was just wondering if anyone has already accomplished something in
> this area, and has client integration examples. I suppose a cheap route
> would be to have some DSpace-iframe solution, where you
> homepage/searchpage, just embeds DSpace search page inside.
>
> Thanks
> 
> Peter Dietz
> Longsight
> www.longsight.com
> pe...@longsight.com
> p: 740-599-5005 x809
>
>
> --
> Dive into the World of Parallel Programming The Go Parallel Website,
> sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for
> all
> things parallel software development, from weekly thought leadership blogs
> to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette:
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>



-- 
Terry Brady
Applications Programmer Analyst
Georgetown University Library Information Technology
https://www.library.georgetown.edu/lit/code
425-298-5498 (Seattle, WA)
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] External Searching of DSpace contents

2015-03-05 Thread Bruno Zanette
Peter,

It was good you have touched on this subject!! I'm also thinking about
it for some time since it's a requirement for the project i'm working
on.

I thought about creating a RubyGem to integrate with SOLR directly,
and use it side-by-side with rest-api gem, but i'm pretty sure this
idea has several security issues. The other ideia is to use REST API,
as you said, but i don't know how far it can go. But i think that's
the best solution for our problem, once we're already using rest-api.

I'll do some research about OpenSearch, and the other ideas you gave.
I haven't heard anything about them yet.

Right now we're fixing some bugs on our site and in next weeks we will
start working on the search feature.

I'll follow this thread closely!!!

2015-03-05 14:27 GMT-03:00 Terry Brady :
> We have a bento-box style search built into our Drupal website.
>
> http://www.library.georgetown.edu/search/gusuper/yearbook
>
> We have de-emphasized this interface since we adopted a discovery layer
> since the discovery layer also searches our DSpace instance.
>
> If you are curious, here is the code:
> https://github.com/Georgetown-University-Libraries/gusuper
>
> The code constructs a PHP SolrClient to perform the search.
>
> https://github.com/Georgetown-University-Libraries/gusuper/blob/master/gudspacesolr/gudspacesolr.module#L83
>
> Terry
>
>
> On Thu, Mar 5, 2015 at 9:15 AM, Peter Dietz  wrote:
>>
>> I was wondering if anyone has built any integrations where an external web
>> site (such as your institution website or CMS) can search and show results
>> from your DSpace? One approach that ought to be pretty straight forward that
>> I'm thinking of is the OpenSearch web service.
>>
>> https://trydspace.longsight.com/open-search/discover?query=test
>>
>> Getting that to work on a site would require some AJAX to update as the
>> user types in a search query, and then display the updated search results.
>>
>> Another route could be the DSpace 5 REST API. There is a
>> find-by-metadata-field (key, value), but isn't suited for full text
>> searching. Other possible routes that I'm thinking are SRW/U or Z39.50.
>>
>> So, I was just wondering if anyone has already accomplished something in
>> this area, and has client integration examples. I suppose a cheap route
>> would be to have some DSpace-iframe solution, where you homepage/searchpage,
>> just embeds DSpace search page inside.
>>
>> Thanks
>> 
>> Peter Dietz
>> Longsight
>> www.longsight.com
>> pe...@longsight.com
>> p: 740-599-5005 x809
>>
>>
>> --
>> Dive into the World of Parallel Programming The Go Parallel Website,
>> sponsored
>> by Intel and developed in partnership with Slashdot Media, is your hub for
>> all
>> things parallel software development, from weekly thought leadership blogs
>> to
>> news, videos, case studies, tutorials and more. Take a look and join the
>> conversation now. http://goparallel.sourceforge.net/
>> ___
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
>
>
>
> --
> Terry Brady
> Applications Programmer Analyst
> Georgetown University Library Information Technology
> https://www.library.georgetown.edu/lit/code
> 425-298-5498 (Seattle, WA)
>
> --
> Dive into the World of Parallel Programming The Go Parallel Website,
> sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for
> all
> things parallel software development, from weekly thought leadership blogs
> to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette:
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette



-- 
Bruno Nocera Zanette
+55 41 9992-2508

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


[Dspace-tech] OAI field for harvested data

2015-03-05 Thread Admire Mutsikiwa
Hi

For some reasons, I  have implemented an OAI harvesting using the
Net::OAI::Harvester. I am interested in establishing which field stores the
status of a record, that is whether a record is deleted or otherwise.

 

Kind Regards,

 

Admire Mutsikiwa (Mr)

ICT Manager

Libraries

University of Zimbabwe

Tel:+263-4-303276

Mob:+263782476883

 

"It is easy to dodge our responsibilities, but we cannot dodge the
consequences of dodging our responsibilities."  Josiah Charles Stamp
 

 

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] External Searching of DSpace contents

2015-03-05 Thread helix84
I used to use this SRU module[1] in DSpace 1.6-1.8. It should still
work, but it uses Lucene as the search backend. It was an annoyance to
upgrade though, so I changed my client to talk to DSpace Solr
directly, the client is a component on another server, so I didn't
have to secure Solr, only add its IP to RemoteAddrValve. Back then I
had this idea for creating a SRU interface as a thin layer on top of
Solr, it should be quite easily doable [2], see the link there.

Anyway, I asked you what your use case was. Is it just search query
autosuggestion using JQuery? We used to have that before 3.0, but it
was removed in the huge patch which brought Access Rights Awareness to
Discovery, supposedly due to being memory-inefficient. It's worth
looking there how it was implemented.

For completeness, I'll also mention solr-security-proxy [3] here, but
generally you might want to avoid that approach [4]. Going off on a
tangent, Elasticsearch has the same problem, but the company behind ES
very recently released a commercial product that addresses this highly
requested feature [5].


[1] https://code.google.com/p/oclcsrwdspacelucene/
[2] https://jira.duraspace.org/browse/DS-1264
[3] https://github.com/dergachev/solr-security-proxy
[4] http://stackoverflow.com/questions/3637014/running-solr-in-read-only-mode
[5] http://www.elasticsearch.org/overview/shield/

Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] maven error

2015-03-05 Thread Tim Donohue
Hi Lewatle,

We likely need more information here on your environment. What OS are 
you using?  What version of Java?

The ${toolsjar} setting is supposed to be auto-determined by our Maven 
POM based on your JAVA_HOME..and it's different based on your operating 
system.

Here's the relevant part of the Maven POM which seems to be having issues:
https://github.com/DSpace/DSpace/blob/master/pom.xml#L447

- Tim

On 3/4/2015 4:06 AM, Lewatle Phaladi wrote:
> Hi,
>
> I am getting the following error, any idea what am I doing wrongly
>
> dspace@lcstest:~/dspace-5.0-src-release$ mvn package
>
> [INFO] Scanning for projects...
>
> [ERROR] The build could not read 1 project -> [Help 1]
>
> [ERROR]
>
> [ERROR]   The project org.dspace:dspace-parent:5.0
> (/home/dspace/dspace-5.0-src-release/pom.xml) has 1 error
>
> [ERROR]
> 'build.plugins.plugin[org.apache.maven.plugins:maven-antrun-plugin].dependencies.dependency.systemPath'
> for com.sun:tools:jar must specify an absolute path but is ${toolsjar} @
> line 176, column 28
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>
> Regards,
>
> Lewatle
>
> This communication is intended for the addressee only. It is
> confidential. If you have received this communication in error, please
> notify us immediately and destroy the original message. You may not copy
> or disseminate this communication without the permission of the
> University. Only authorised signatories are competent to enter into
> agreements on behalf of the University and recipients are thus advised
> that the content of this message may not be legally binding on the
> University and may contain the personal views and opinions of the
> author, which are not necessarily the views and opinions of The
> University of the Witwatersrand, Johannesburg. All agreements between
> the University and outsiders are subject to South African Law unless the
> University agrees in writing to the contrary.
>
>
>
>
>
> --
> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for all
> things parallel software development, from weekly thought leadership blogs to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
>
>
>
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette: 
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
>
>

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] browse list with contains option not starts_with

2015-03-05 Thread Tim Donohue
Hi Pablo,

Why not just use the Search box in DSpace? That'll let you search on any 
string anywhere in the item.

In the most recent versions of DSpace, the Browse and Search 
functionality both use the same backend (Apache Solr). So you are 
searching the same Apache Solr data whether you are accessing content 
from the Browse interface or the Search interface.

- Tim

On 2/27/2015 5:59 AM, Pablo Buenaposada wrote:
> Hi,
> In browse itemlist (/browse?type=title) you have an input for search items
> starting with the string you want.
> What about if you want to search an item containing that string not starting
> with? is it possible?
>
> Thanks.
>
>
>
> --
> View this message in context: 
> http://dspace.2283337.n4.nabble.com/browse-list-with-contains-option-not-starts-with-tp4676815.html
> Sent from the DSpace - Tech mailing list archive at Nabble.com.
>
> --
> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for all
> things parallel software development, from weekly thought leadership blogs to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette: 
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] External Searching of DSpace contents

2015-03-05 Thread LiYu Lilly
It might not be very relevant-- but has anyone started or considering 
integrating VIVO and DSpace? 
Thanks,Lilly

> From: heli...@centrum.sk
> Date: Thu, 5 Mar 2015 21:20:45 +0100
> To: pe...@longsight.com
> CC: dspace-tech@lists.sourceforge.net
> Subject: Re: [Dspace-tech] External Searching of DSpace contents
> 
> I used to use this SRU module[1] in DSpace 1.6-1.8. It should still
> work, but it uses Lucene as the search backend. It was an annoyance to
> upgrade though, so I changed my client to talk to DSpace Solr
> directly, the client is a component on another server, so I didn't
> have to secure Solr, only add its IP to RemoteAddrValve. Back then I
> had this idea for creating a SRU interface as a thin layer on top of
> Solr, it should be quite easily doable [2], see the link there.
> 
> Anyway, I asked you what your use case was. Is it just search query
> autosuggestion using JQuery? We used to have that before 3.0, but it
> was removed in the huge patch which brought Access Rights Awareness to
> Discovery, supposedly due to being memory-inefficient. It's worth
> looking there how it was implemented.
> 
> For completeness, I'll also mention solr-security-proxy [3] here, but
> generally you might want to avoid that approach [4]. Going off on a
> tangent, Elasticsearch has the same problem, but the company behind ES
> very recently released a commercial product that addresses this highly
> requested feature [5].
> 
> 
> [1] https://code.google.com/p/oclcsrwdspacelucene/
> [2] https://jira.duraspace.org/browse/DS-1264
> [3] https://github.com/dergachev/solr-security-proxy
> [4] http://stackoverflow.com/questions/3637014/running-solr-in-read-only-mode
> [5] http://www.elasticsearch.org/overview/shield/
> 
> Regards,
> ~~helix84
> 
> Compulsory reading: DSpace Mailing List Etiquette
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
> 
> --
> Dive into the World of Parallel Programming The Go Parallel Website, sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for all
> things parallel software development, from weekly thought leadership blogs to
> news, videos, case studies, tutorials and more. Take a look and join the 
> conversation now. http://goparallel.sourceforge.net/
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette: 
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
  --
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] maven error

2015-03-05 Thread Tim Donohue
A minor update, another user reported this same sort of issue.

There's a ticket at https://jira.duraspace.org/browse/DS-2481

As noted in my comment to that ticket, I suspect the JAVA_HOME is not 
set (or improperly set). I'm able to build DSpace 5.0 and 5.1 fine on 
multiple OSes (Windows 8, Ubuntu 14.04), so it seems like a possible 
configuration issue.

- Tim

On 3/5/2015 3:40 PM, Tim Donohue wrote:
> Hi Lewatle,
>
> We likely need more information here on your environment. What OS are
> you using?  What version of Java?
>
> The ${toolsjar} setting is supposed to be auto-determined by our Maven
> POM based on your JAVA_HOME..and it's different based on your operating
> system.
>
> Here's the relevant part of the Maven POM which seems to be having issues:
> https://github.com/DSpace/DSpace/blob/master/pom.xml#L447
>
> - Tim
>
> On 3/4/2015 4:06 AM, Lewatle Phaladi wrote:
>> Hi,
>>
>> I am getting the following error, any idea what am I doing wrongly
>>
>> dspace@lcstest:~/dspace-5.0-src-release$ mvn package
>>
>> [INFO] Scanning for projects...
>>
>> [ERROR] The build could not read 1 project -> [Help 1]
>>
>> [ERROR]
>>
>> [ERROR]   The project org.dspace:dspace-parent:5.0
>> (/home/dspace/dspace-5.0-src-release/pom.xml) has 1 error
>>
>> [ERROR]
>> 'build.plugins.plugin[org.apache.maven.plugins:maven-antrun-plugin].dependencies.dependency.systemPath'
>>
>> for com.sun:tools:jar must specify an absolute path but is ${toolsjar} @
>> line 176, column 28
>>
>> [ERROR]
>>
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>>
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>
>> [ERROR]
>>
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>>
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
>>
>> Regards,
>>
>> Lewatle
>>
>> This communication is intended for the addressee only. It is
>> confidential. If you have received this communication in error, please
>> notify us immediately and destroy the original message. You may not copy
>> or disseminate this communication without the permission of the
>> University. Only authorised signatories are competent to enter into
>> agreements on behalf of the University and recipients are thus advised
>> that the content of this message may not be legally binding on the
>> University and may contain the personal views and opinions of the
>> author, which are not necessarily the views and opinions of The
>> University of the Witwatersrand, Johannesburg. All agreements between
>> the University and outsiders are subject to South African Law unless the
>> University agrees in writing to the contrary.
>>
>>
>>
>>
>>
>> --
>>
>> Dive into the World of Parallel Programming The Go Parallel Website,
>> sponsored
>> by Intel and developed in partnership with Slashdot Media, is your hub
>> for all
>> things parallel software development, from weekly thought leadership
>> blogs to
>> news, videos, case studies, tutorials and more. Take a look and join the
>> conversation now. http://goparallel.sourceforge.net/
>>
>>
>>
>> ___
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>
>>
>>

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] browse list with contains option not starts_with

2015-03-05 Thread Pablo Buenaposada
because I still want to show the full list of items, the only that I can't
understand is why you have to search something knowing how it starts, that's
not the general case, normally you know that contains some word but you
don't know the first ones.



--
View this message in context: 
http://dspace.2283337.n4.nabble.com/browse-list-with-contains-option-not-starts-with-tp4676815p4676915.html
Sent from the DSpace - Tech mailing list archive at Nabble.com.

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette