Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[Josefina Perez Alvarez]

Sorry all... I read just until the second message...
Josi Perez



2012/7/11 helix84 

> Josefina just to clear things up, the two repositories he tries to
> harvest items _from_ and which both declare support for qdc are
> http://oai.recercat.net/request and http://www.tdx.cat/oai/request,
> not http://oai-vinson2.upf.edu/request which is his repository he
> tries to harvest items _to_ (in other words, he's running the DSpace
> harvester on this machine targetting the former two).
>
> Regards,
> ~~helix84
>
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[helix84]

Josefina just to clear things up, the two repositories he tries to
harvest items _from_ and which both declare support for qdc are
http://oai.recercat.net/request and http://www.tdx.cat/oai/request,
not http://oai-vinson2.upf.edu/request which is his repository he
tries to harvest items _to_ (in other words, he's running the DSpace
harvester on this machine targetting the former two).

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[Josefina Perez Alvarez]

Just a comment:
using the harvester command to see what formats this site can send:
http://oai-vinson2.upf.edu/request*?verb=ListMetadataFormats*

the answer is:
oai_dc
rdf
mets

Then, you can harvest from this site using a harvester command like:
http://oai-vinson2.upf.edu/request?verb=ListRecords&metadataPrefix=oai_dc
or
http://oai-vinson2.upf.edu/request?verb=ListRecords&metadataPrefix=rdf
or
http://oai-vinson2.upf.edu/request?verb=ListRecords&metadataPrefix=mets


Choosing oai_dc:
the first page are from deleted items;
to collect the second, it is necessary to copy the resumption token
indicated at the botton of the list, and repeat the command like that:

http://oai-vinson2.upf.edu/request?verb=ListRecords&resumptionToken=0001-01-01T00:00:00Z/-12-31T23:59:59Z//oai_dc/100

On the third page there is an current item, in plain dublin core, not
qualified.

of course, these examples are justo for test purposes: the conversation is
made between machines. No offer for QDC format

I hope this help.
Josi Perez



2012/7/11 RUIZ MORENO, ROBERT 

> Hi,
>
> ok, centering on my initial problem.
>
> I choose QDC because I want to obtain the metadada in dc format, with
> qualifiers. Anyway, I just did a test with unqualified dc, with the same
> error.
>
> The OAI servers I harvesting from are http://oai.recercat.net/request and
> http://www.tdx.cat/oai/request
>
> Both requests are thrown the same error (when I debug my code, it
> complains in the same line I indicated in my first message).
>
> I don't know why the code enter in this line: *  if
> (!(root.getName().equals("qualifieddc")))** {*
>
> and if I can do anything to solve this from my side, or if it's a problem
> of servers I'm requesting.
>
> many thanks,
> Robert
>
> 2012/7/11 helix84 
>
>> On Wed, Jul 11, 2012 at 11:17 AM, RUIZ MORENO, ROBERT
>>  wrote:
>> > yes, in my previous message I mean the URL http://re.cs.uct.ac.za/  is
>> down,
>> > so I can't test my OAI URL.
>>
>> This is just a tool that can help diagnose the problem, but since we
>> cannot use it right now, let's focus on the problem itself.
>> (I already reported that it's down to the contact listed there)
>>
>> > The URL of my OAI is: http://oai-vinson2.upf.edu/request (is a test
>> server,
>> > not production server)
>>
>> I meant the OAI which you're harvesting, not the repository you're
>> harvesting _into_.
>>
>> I never used the DSpace harvester, but you're saying you chose QDC as
>> format. Can you select unqualified DC (oai_dc) instead?
>>
>> Regards,
>> ~~helix84
>>
>
>
>
> --
> Live Security Virtual Conference
> Exclusive live event will cover all the ways today's security and
> threat landscape has changed and how IT managers can respond. Discussions
> will include endpoint security, mobile security and the latest in malware
> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>
>
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[Kelly Brown]

The epersongroup table contains 2 entries :

EPERSON_GROUP_ID NAME
0   Anonymous
1   Administrator



Thanks,

Kelly Brown
Database Analyst 
Massey Library | Bibliothèque Massey
Royal Military College of Canada | Collège militaire royal du Canada
Telephone / Téléphone: (613) 541-6000 x 6979
E-Mail / Couriel: kelly.br...@rmc.ca


-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: July 11, 2012 11:59 AM
To: Kelly Brown
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

OK. Can you somehow you check (maybe via SQL export) whether the primary key on 
the epersongroup table is correct? This is the immediate problem (if I read the 
code correctly).

Regards,
~~helix84
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[helix84]

OK. Can you somehow you check (maybe via SQL export) whether the
primary key on the epersongroup table is correct? This is the
immediate problem (if I read the code correctly).

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[Kelly Brown]

Both my Postgres (working version) and Oracle setup have the same 42 tables, 
there are no tables missing I compared both databases table for  table .

And just on a side the dspace test-email doesn't work  with the Postgres 
either, but I have no problems with sending emails on the Postgres install

Thanks,

Kelly Brown
Database Analyst 
Massey Library | Bibliothèque Massey
Royal Military College of Canada | Collège militaire royal du Canada
Telephone / Téléphone: (613) 541-6000 x 6979
E-Mail / Couriel: kelly.br...@rmc.ca


-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: July 11, 2012 9:45 AM
To: Kelly Brown
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

On Wed, Jul 11, 2012 at 3:27 PM, Kelly Brown  wrote:
> The create-administrator output is attached the error is the following:
> Exception: null java.lang.NullPointerException

So it seems like a database issue after all.

column is an empty string here:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/storage/rdbms/DatabaseManager.java#L508

Which is returned by getPrimaryKeyColumn(ctable) here:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/storage/rdbms/DatabaseManager.java#L476

And the table in question is epersongroup:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/eperson/Group.java#L684


> The database test works fine.

Well, it's a test of connecting to database. The problem is that
(some?) tables were not created.

Can you send us a list of tables in your dspace tablespace? (You can also 
compare it to your other DSpace installation and see which tables are missing).

> The email seems to be the issue as well as,  I am using the same credentials 
> as the install I have with Postgres db and everything works there.

There should be
"Email sent successfully!"
at the end, so maybe you didn't set mail.server (and possibly other related 
options) in dspace.cfg correctly.

Regards,
~~helix84
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[helix84]

On Wed, Jul 11, 2012 at 3:27 PM, Kelly Brown  wrote:
> The create-administrator output is attached the error is the following:
> Exception: null java.lang.NullPointerException

So it seems like a database issue after all.

column is an empty string here:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/storage/rdbms/DatabaseManager.java#L508

Which is returned by getPrimaryKeyColumn(ctable) here:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/storage/rdbms/DatabaseManager.java#L476

And the table in question is epersongroup:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/eperson/Group.java#L684


> The database test works fine.

Well, it's a test of connecting to database. The problem is that
(some?) tables were not created.

Can you send us a list of tables in your dspace tablespace? (You can
also compare it to your other DSpace installation and see which tables
are missing).

> The email seems to be the issue as well as,  I am using the same credentials 
> as the install I have with Postgres db and everything works there.

There should be
"Email sent successfully!"
at the end, so maybe you didn't set mail.server (and possibly other
related options) in dspace.cfg correctly.

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[Kelly Brown]

The create-administrator output is attached the error is the following:
Exception: null java.lang.NullPointerException

The database test works fine.

The email seems to be the issue as well as,  I am using the same credentials as 
the install I have with Postgres db and everything works there. 

Thanks,

Kelly Brown
Database Analyst 
Massey Library | Bibliothèque Massey
Royal Military College of Canada | Collège militaire royal du Canada
Telephone / Téléphone: (613) 541-6000 x 6979
E-Mail / Couriel: kelly.br...@rmc.ca


-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: July 11, 2012 7:20 AM
To: Kelly Brown
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

On Wed, Jul 11, 2012 at 1:12 PM, Kelly Brown  wrote:
> Technically no the install doesn't work as I cannot add any accounts include 
> the initial account that is created after install.  With that being said, the 
> DSpace web is present but not functional.

OK, that might or might not be related to a non-functional database.
First, from c:\dspace\bin try running:
dspace test-database
and
dspace test-email
and report back if it failed.

Then, how does create-administrator fail? Is there an error message?
If not, look at dspace log and tomcat log and try to find the reason there.

Regards,
~~helix84


create-administrator
Description: create-administrator


test-email
Description: test-email


test-db
Description: test-db
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Handle collision during harvest

[helix84]

On Wed, Mar 28, 2012 at 7:41 PM, Bill Anderson
 wrote:
> We're trying to havest the metadata from our IR, SMARTech (running DSpace
> 1.7.2) to a metadata-only repository running DSpace 1.8.2, using the OAI
> harvester.  For the most part, it's going well -- but we have a lot of items
> in SMARTech mapped to more than one collection.  When the harvester hits one
> of these mapped items, having already ingested its doppelganger, it throws
> an error:
>
> 2012-03-28 12:37:37,526 ERROR org.dspace.harvest.OAIHarvester @ Harvesting
> error occured while processing an OAI record: Handle collision: attempted to
> re-assign handle '1853/10302' to an incoming harvested item
> 'oai:smartech.gatech.edu:1853/10302'
>
> This makes sense, since the handle is indeed already in use -- but the
> harvester exits on the error, and nothing else in the collection is
> harvested.  I'm assuming that anybody else who attempts to harvest metadata
> from SMARTech is getting the same behavior.Has anybody else run into
> this?  Unless I'm missing something, it seems like this would make it
> impossible to do a full harvest on a site using mapped items.

Hi Bill,

I solved this issue (although I was testing with a different
repository and handle prefix) by adding this configuration option to
[dspace]/config/modules/oai.cfg:
harvester.rejectedHandlePrefix = 1853

Also note that
harvester.rejectedHandlePrefix = 123456789, myTestHandle, 1853
didn't work for me, there must be some problem with splitting individual values.

Setting this option doesn't try to assign the same handle, but creates
a new handle instead.

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[helix84]

On Wed, Jul 11, 2012 at 2:26 PM, helix84  wrote:
> 2012-07-11 14:03:53,140 ERROR org.dspace.harvest.OAIHarvester @
> Harvesting error occured while processing an OAI record: Handle
> collision: attempted to re-assign handle '10803/3001' to an incoming
> harvested item 'oai:www.tdx.cat:10803/3001'.
>
> This has been reported before, without any suggested solution:
> http://article.gmane.org/gmane.comp.db.dspace.user/16877

I solved this issue by adding this configuration option to
[dspace]/config/modules/oai.cfg:
harvester.rejectedHandlePrefix = 10803

Also note that
harvester.rejectedHandlePrefix = 123456789, myTestHandle, 10803
didn't work for me, there must be some problem with splitting individual values.

So I was able to successfuly harvest a collection from that repository
in DSpace 1.8.2.

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[helix84]

On Wed, Jul 11, 2012 at 12:10 PM, RUIZ MORENO, ROBERT
 wrote:
> The OAI servers I harvesting from are http://oai.recercat.net/request and
> http://www.tdx.cat/oai/request

Both repositories declare support for qdc, so it should work.
(Also, both repositories are DSpace with XMLUI, which is required to
harvest bitstreams in addition to metadata.)

I tried to use the DSpace harvester (it's the first time I tried) on
these repositories, but I'm running into a different problem:
2012-07-11 14:03:53,140 ERROR org.dspace.harvest.OAIHarvester @
Harvesting error occured while processing an OAI record: Handle
collision: attempted to re-assign handle '10803/3001' to an incoming
harvested item 'oai:www.tdx.cat:10803/3001'.

This has been reported before, without any suggested solution:
http://article.gmane.org/gmane.comp.db.dspace.user/16877

But I think apart from that that it would work for me from DSpace
1.8.2. Would you try harvesting from this version?

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[helix84]

On Wed, Jul 11, 2012 at 1:12 PM, Kelly Brown  wrote:
> Technically no the install doesn't work as I cannot add any accounts include 
> the initial account that is created after install.  With that being said, the 
> DSpace web is present but not functional.

OK, that might or might not be related to a non-functional database.
First, from c:\dspace\bin try running:
dspace test-database
and
dspace test-email
and report back if it failed.

Then, how does create-administrator fail? Is there an error message?
If not, look at dspace log and tomcat log and try to find the reason
there.

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[Kelly Brown]

Technically no the install doesn't work as I cannot add any accounts include 
the initial account that is created after install.  With that being said, the 
DSpace web is present but not functional. 

Thanks,

Kelly Brown
Database Analyst 
Massey Library | Bibliothèque Massey
Royal Military College of Canada | Collège militaire royal du Canada
Telephone / Téléphone: (613) 541-6000 x 6979
E-Mail / Couriel: kelly.br...@rmc.ca


-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: July 11, 2012 4:54 AM
To: Kelly Brown
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

On Tue, Jul 10, 2012 at 8:36 PM, Kelly Brown  wrote:
> Please find attached the output of ant fresh_install

I looked at your stack trace and I think in this case, the ORA-00942 error is 
harmless. It's just trying to drop tables during fresh install so that it can 
create them again empty. Obviously, this exception should be caught and ignored 
in the code. Does your installation seem to work otherwise? If so, you can 
ignore the problem and we can file a Jira issue about the unnecessary output.

This is the code your stacktrace relates to:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/BrowseCreateDAOOracle.java#L469

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/IndexBrowse.java#L876

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/IndexBrowse.java#L757

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/IndexBrowse.java#L711

Regards,
~~helix84
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[RUIZ MORENO, ROBERT]

Hi,

ok, centering on my initial problem.

I choose QDC because I want to obtain the metadada in dc format, with
qualifiers. Anyway, I just did a test with unqualified dc, with the same
error.

The OAI servers I harvesting from are http://oai.recercat.net/request and
http://www.tdx.cat/oai/request

Both requests are thrown the same error (when I debug my code, it complains
in the same line I indicated in my first message).

I don't know why the code enter in this line: *  if
(!(root.getName().equals("qualifieddc")))** {*

and if I can do anything to solve this from my side, or if it's a problem
of servers I'm requesting.

many thanks,
Robert

2012/7/11 helix84 

> On Wed, Jul 11, 2012 at 11:17 AM, RUIZ MORENO, ROBERT
>  wrote:
> > yes, in my previous message I mean the URL http://re.cs.uct.ac.za/  is
> down,
> > so I can't test my OAI URL.
>
> This is just a tool that can help diagnose the problem, but since we
> cannot use it right now, let's focus on the problem itself.
> (I already reported that it's down to the contact listed there)
>
> > The URL of my OAI is: http://oai-vinson2.upf.edu/request (is a test
> server,
> > not production server)
>
> I meant the OAI which you're harvesting, not the repository you're
> harvesting _into_.
>
> I never used the DSpace harvester, but you're saying you chose QDC as
> format. Can you select unqualified DC (oai_dc) instead?
>
> Regards,
> ~~helix84
>
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[helix84]

On Wed, Jul 11, 2012 at 11:17 AM, RUIZ MORENO, ROBERT
 wrote:
> yes, in my previous message I mean the URL http://re.cs.uct.ac.za/  is down,
> so I can't test my OAI URL.

This is just a tool that can help diagnose the problem, but since we
cannot use it right now, let's focus on the problem itself.
(I already reported that it's down to the contact listed there)

> The URL of my OAI is: http://oai-vinson2.upf.edu/request (is a test server,
> not production server)

I meant the OAI which you're harvesting, not the repository you're
harvesting _into_.

I never used the DSpace harvester, but you're saying you chose QDC as
format. Can you select unqualified DC (oai_dc) instead?

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[RUIZ MORENO, ROBERT]

Hi,

yes, in my previous message I mean the URL http://re.cs.uct.ac.za/  is
down, so I can't test my OAI URL.

The URL of my OAI is: http://oai-vinson2.upf.edu/request (is a test server,
not production server)

many thanks
Robert

2012/7/11 helix84 

> In response to your original problem, you should send the OAI URL of
> the site you're trying to harvest here, we might look if there's a
> problem.
> From what you posted it's possible it might not provide the QDC
> metadata format (it's not required by the specification). You may also
> want to try to harvest the oai_dc metadata format (which is required).
>
> Regards,
> ~~helix84
>
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Dspace Installation

[helix84]

On Wed, Jul 11, 2012 at 10:59 AM, seun olotu  wrote:
> error message: mvn is recognise as an internal or external command.
> Please what do I do?

You either don't have Maven installed or it's not in your path (the
PATH environment variable).

Maven is required to build DSpace:
https://wiki.duraspace.org/display/DSDOC18/Installation#Installation-ApacheMaven2.2.xorhigher%28Javabuildtool%29

While the official documentation is what you should follow, it
sometimes doesn't go into too much detail, like installing
dependencies. You may want to look at some other unofficial
installation manuals for these particular steps, e.g. this one (just
do a google search on "dspace installation windows"):

http://www.vpmthane.org/im/dspace.pdf

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Dspace Installation

[seun olotu]

Thanks fo the document you sent.
It is very useful. I am presently at the tage of 
installing Dspace, the command in the manual
"mvn package " is not starting the Dspace installation
at the dos prompt.

error message: mvn is recognise as an internal or external command.

Please what do I do?
Thanks



Obasola Oluwaseun 
Systems/Serials Librarian
E.Latunde Odeku Medical Library
College of Medicine,University of Ibadan
Ibadan,Oyo state, Nigeria.
email:olas...@yahoo.com
olas...@com.ui.edu.ng
Phone: +2348033517020
http://www.comui.edu.ng/Odeku--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Oracle 11g and DSpace 1.8.1 problems

[helix84]

On Tue, Jul 10, 2012 at 8:36 PM, Kelly Brown  wrote:
> Please find attached the output of ant fresh_install

I looked at your stack trace and I think in this case, the ORA-00942
error is harmless. It's just trying to drop tables during fresh
install so that it can create them again empty. Obviously, this
exception should be caught and ignored in the code. Does your
installation seem to work otherwise? If so, you can ignore the problem
and we can file a Jira issue about the unnecessary output.

This is the code your stacktrace relates to:

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/BrowseCreateDAOOracle.java#L469

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/IndexBrowse.java#L876

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/IndexBrowse.java#L757

https://github.com/DSpace/DSpace/blob/20943b7192cfaa5caa13d0bebf72a472c8c29bd9/dspace-api/src/main/java/org/dspace/browse/IndexBrowse.java#L711

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[helix84]

In response to your original problem, you should send the OAI URL of
the site you're trying to harvest here, we might look if there's a
problem.
>From what you posted it's possible it might not provide the QDC
metadata format (it's not required by the specification). You may also
want to try to harvest the oai_dc metadata format (which is required).

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[helix84]

I just checked and this is the required form:

http://example.com/oai/request

(However the site is still down)

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[helix84]

On Wed, Jul 11, 2012 at 10:12 AM, RUIZ MORENO, ROBERT
 wrote:
> I tried entering the URL, but doesn't work. Do you know why?

Did you enter the whole URL to your OAI interface or just URL to your
web interface? I can't look right now which format it requires because
it's currently down, but there you should be the required format.

Here are some one of the possible forms it may require:
http://example.com/oai/request?verb=Identify
http://example.com/oai/request
http://example.com/oai/

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[Bram Luyten]

Did it produce any error messages? Or did the site just fail to return
anything?
Could you copy the URL that you used in here?

cheers,

Bram

-- 
[image: logo]
*Bram Luyten* *@mire*
*2888 Loker Avenue East, Suite 305, Carlsbad, CA. 92010*
*Esperantolaan 4, Heverlee 3001, Belgium*
  
www.atmire.com


On Wed, Jul 11, 2012 at 9:12 AM, RUIZ MORENO, ROBERT wrote:

> Dear Bram,
>
> I tried entering the URL, but doesn't work. Do you know why?
>
> Thanks,
> Robert
>
>
> 2012/7/4 Bram Luyten 
>
>> Hi Robert,
>>
>> not sure if this is useful, but if you run your OAI provider URL through
>> the OAI Repository Explorer, do you get any meaningful error messages ?
>>
>> This tool can be found at:
>> http://re.cs.uct.ac.za/
>>
>> best regards,
>>
>> Bram Luyten
>>
>> --
>> [image: logo]
>> *Bram Luyten* *@mire*
>> *2888 Loker Avenue East, Suite 305, Carlsbad, CA. 92010*
>> *Esperantolaan 4, Heverlee 3001, Belgium*
>>   
>> www.atmire.com
>>
>>
>> On Fri, Jun 29, 2012 at 1:35 PM, RUIZ MORENO, ROBERT > > wrote:
>>
>>> Hi everyone,
>>>
>>> we have DSpace 1.7.1 XMLUI and I'm trying to harvest content from an
>>> external source, via XMLUI interface, in the tab "content source" in page
>>> Edit Collection.
>>>
>>>  I already configured the page, setting the OAI Provider, set id, and
>>> the QDC metadata format and the "Harvest metadata and bitstreams (requires
>>> ORE support)" option is selected.
>>>
>>> When I Save this settings, and I pto the next page, and click "Import
>>> Now" button, it shows me this error message:
>>>
>>> "Unknown error occured while generating an OAI response on xxx-xxx-xx ".
>>>
>>> If I debug the execution with Eclipse IDE, I see that throws this
>>> exception in class QDCCrosswalk.java
>>>
>>> *if (!(root.getName().equals("qualifieddc")))*
>>> *{*
>>> *here--> throw new MetadataValidationException("Wrong root
>>> element for Qualified DC: " + root.toString());*
>>> *}*
>>> *ingest(context, dso, root.getChildren());*
>>>
>>> Ok. That's all that I could find out for myself.
>>>
>>> Any help or hint or suggestion of how can I solve this?
>>>
>>> Many thanks!
>>>
>>> Robert
>>>
>>>
>>> --
>>> Live Security Virtual Conference
>>> Exclusive live event will cover all the ways today's security and
>>> threat landscape has changed and how IT managers can respond. Discussions
>>> will include endpoint security, mobile security and the latest in malware
>>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>>> ___
>>> DSpace-tech mailing list
>>> DSpace-tech@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>>
>>>
>>
>
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Harvesting OAI-ORE via XMLUI interface

[RUIZ MORENO, ROBERT]

Dear Bram,

I tried entering the URL, but doesn't work. Do you know why?

Thanks,
Robert

2012/7/4 Bram Luyten 

> Hi Robert,
>
> not sure if this is useful, but if you run your OAI provider URL through
> the OAI Repository Explorer, do you get any meaningful error messages ?
>
> This tool can be found at:
> http://re.cs.uct.ac.za/
>
> best regards,
>
> Bram Luyten
>
> --
> [image: logo]
> *Bram Luyten* *@mire*
> *2888 Loker Avenue East, Suite 305, Carlsbad, CA. 92010*
> *Esperantolaan 4, Heverlee 3001, Belgium*
>   
> www.atmire.com
>
>
> On Fri, Jun 29, 2012 at 1:35 PM, RUIZ MORENO, ROBERT 
> wrote:
>
>> Hi everyone,
>>
>> we have DSpace 1.7.1 XMLUI and I'm trying to harvest content from an
>> external source, via XMLUI interface, in the tab "content source" in page
>> Edit Collection.
>>
>>  I already configured the page, setting the OAI Provider, set id, and
>> the QDC metadata format and the "Harvest metadata and bitstreams (requires
>> ORE support)" option is selected.
>>
>> When I Save this settings, and I pto the next page, and click "Import
>> Now" button, it shows me this error message:
>>
>> "Unknown error occured while generating an OAI response on xxx-xxx-xx ".
>>
>> If I debug the execution with Eclipse IDE, I see that throws this
>> exception in class QDCCrosswalk.java
>>
>> *if (!(root.getName().equals("qualifieddc")))*
>> *{*
>> *here--> throw new MetadataValidationException("Wrong root
>> element for Qualified DC: " + root.toString());*
>> *}*
>> *ingest(context, dso, root.getChildren());*
>>
>> Ok. That's all that I could find out for myself.
>>
>> Any help or hint or suggestion of how can I solve this?
>>
>> Many thanks!
>>
>> Robert
>>
>>
>> --
>> Live Security Virtual Conference
>> Exclusive live event will cover all the ways today's security and
>> threat landscape has changed and how IT managers can respond. Discussions
>> will include endpoint security, mobile security and the latest in malware
>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>> ___
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>
>>
>
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Authority Control getMatches

[helix84]

On Wed, Jul 11, 2012 at 1:09 AM, Helves Domingues  wrote:
> I´ve opened a jira issue (https://jira.duraspace.org/browse/DS-1079)
> but I didn't receive any response. Someone could help me with this
> problem?

Hi Helves,

you did the right thing to report the issue to Jira. It will surely be
looked at, but the current review lag is over 6 months, as you surely
noticed. Review is currently at about issue DS-1065 and there are
about 2-5 issues reviewed every week which may give you an estimate
when this will be looked at (which unfortunately doesn't mean it will
be delt with immediately). It would help a lot if you can suggest a
fix and even more if you provide a patch or GitHub pull request.

If you want to speed things up, it's best to run a "git blame" (or
"svn annotate") on the affected file and look who wrote the buggy
piece of code. You can then contact him directly in addition to
reporting the bug to Jira.

Regards,
~~helix84

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech