date:20170228

Re: [dspace-tech] Re: Batch uploading bitstreams before adding metadata

2017-02-28 Thread Terry Brady

In case you are interested, we have a few tools that automate the creation
of packager/ingest folders that Mark has described.

https://github.com/Georgetown-University-Libraries/File-Analyzer/wiki/DSpace-Institutional-Repository-Ingest

Once you have created these folders, the DSpace command line tools let you
perform many batch operations.

Terry

On Tue, Feb 28, 2017 at 6:06 AM, Mark Wood  wrote:

> The spreadsheet is not necessary; lots of people use that method because
> they are familiar with spreadsheet tools.  The important thing is that you
> somehow create the archive format that DSpace will try to read.
>
> It shouldn't be too difficult to write a script that would, for example:
> walk a directory of PDFs, use pdftk to extract some minimal metadata, and
> lay out a tree of directories in Simple Archive Format that can be read
> with 'bin/dspace import'.  The content can be organized in any way you
> wish.  If you want each PDF to be a separate item, have your script create
> one subdirectory per PDF with one content file in it.
>
> DSpace does demand a few metadata fields.  I think you'll need to provide
> at least a title.  If necessary, you should be able to edit those later.
> but you'll need to provide *some* value.  You could just generate serial
> numbers for temporary titles:  "Title 1", "Title 2"...; or use the filename
> as the title.
>
> If you'd rather use one of the Packager formats, again it really doesn't
> matter how you proceed so long as you end up with a format that the
> Packager can read.  Again, if you describe each content file within a
> separate item, that's what you'll get.
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Terry Brady
Applications Programmer Analyst
Georgetown University Library Information Technology
http://georgetown-university-libraries.github.io/

425-298-5498 (Seattle, WA)

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

RE: [dspace-tech] Re: dspace5 rest login fails

2017-02-28 Thread Devaux Cédric

I have checked  on my DSpace 6 : with or without header -H "Accept: 
application/json", the response is the same (200 if the credentials are ok).

curl -v -X POST --data "email=g*&password=g*" -H "Accept: application/json" 
http://localhost:8080/rest/login

Regards,
Cedric

De : dspace-tech@googlegroups.com [mailto:dspace-tech@googlegroups.com] De la 
part de Mehrdad Pedram
Envoyé : mardi 28 février 2017 08:01
À : DSpace Technical Support
Cc : pedram.mehr...@gmail.com; heli...@centrum.sk
Objet : Re: [dspace-tech] Re: dspace5 rest login fails

The problem has been solved, I removed json header and changed the request as 
follow:

$.ajax({
url: '/rest/login ',
type : "POST",
data : 'email=m...@email.com&password=mypass',
success: function (response) { alert(response); },
error: function(xhr, status, errorThrown) { alert("Error in /rest/login "+ 
status+ " " + errorThrown); },
complete: function(xhr, status) { alert('complete'); }
});

Its weird, but login request in dspace 6 should not include any additional 
header and data should sent as a plain text.
Hope this help some one...

On Tuesday, February 28, 2017 at 9:39:18 AM UTC+3:30, Mehrdad Pedram wrote:
Thank you, I didn't notice the response cookie  but the problem is persist. i'm 
getting 401 error and there is no response cookies,
As the documentation says below command should return JSESSIONID but it's 
return 401 for me,
curl -v -X POST --data 
"email=m...@email.com&password=mypass" 
http://localhost:8080/rest/login
Any advice please?
Yours faithfully.





--
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to 
dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to 
dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

[dspace-tech] Re: Batch uploading bitstreams before adding metadata

2017-02-28 Thread Mark Wood

The spreadsheet is not necessary; lots of people use that method because 
they are familiar with spreadsheet tools.  The important thing is that you 
somehow create the archive format that DSpace will try to read.

It shouldn't be too difficult to write a script that would, for example:  
walk a directory of PDFs, use pdftk to extract some minimal metadata, and 
lay out a tree of directories in Simple Archive Format that can be read 
with 'bin/dspace import'.  The content can be organized in any way you 
wish.  If you want each PDF to be a separate item, have your script create 
one subdirectory per PDF with one content file in it.

DSpace does demand a few metadata fields.  I think you'll need to provide 
at least a title.  If necessary, you should be able to edit those later. 
but you'll need to provide *some* value.  You could just generate serial 
numbers for temporary titles:  "Title 1", "Title 2"...; or use the filename 
as the title.

If you'd rather use one of the Packager formats, again it really doesn't 
matter how you proceed so long as you end up with a format that the 
Packager can read.  Again, if you describe each content file within a 
separate item, that's what you'll get.

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Re: Dspace Handle Server error

2017-02-28 Thread Ahmet Melih Başbuğ

root@dspaceetu-vm:/home/dspaceuser# netstat -nltup | grep 2641
tcp6   0  0 10.1.11.254:2641:::*LISTEN 
 25778/java  
udp6   0  0 10.1.11.254:2641:::*   
 25778/java  
root@dspaceetu-vm:/home/dspaceuser# netstat -nltup | grep 8000
tcp6   0  0 10.1.11.254:8000:::*LISTEN 
 25778/java 

I tested your examples and i understood. I tried outside of network. it 
didn't corrupted.
ahmet@localhost:~$ nc -t earsiv.etu.edu.tr 2641


This is the website of dspace.

http://earsiv.etu.edu.tr/xmlui/handle/20.500.11851/317
http://hdl.handle.net/20.500.11851/317

Thanks
Melih


28 Şubat 2017 Salı 15:58:46 UTC+3 tarihinde Shaun Donovan yazdı:
>
> Sorry, pressed send by mistake :-)
>
> You can do the same test for TCP using:
>
> nc -t uir.unisa.ac.za 2641
>
> and you can also test for port 8000 (TCP only)
>
> nc -t uir.unisa.ac.za 8000.
>
> You must run these commands from outside of your network. If you give me 
> your URL, I will run them for you.
>
> Now that your handle server seems to be starting, what do you get from a 
> netstat -nltup?
>
> On 28/02/2017 09:51, Ahmet Melih Başbuğ wrote:
>
> Hello. After i changed ip adress (I changed public ip to private ip..) I 
> got new error.  
>
> Error - Resolution Error 
>
> The handle you requested --
>
> *20.500.11851/317*
>
> -- cannot be found.
>
>
> What should i do ? I had items which included in past.
>
> Thanks
>
> Melih
>
>
>
> 25 Şubat 2017 Cumartesi 17:38:23 UTC+3 tarihinde Ahmet Melih Başbuğ yazdı: 
>>
>> Hello. I have problem about handle server. It was working in past. but I 
>> restarted handle and it doesn't work. I can't understand why? We got 
>> handle.net account and it works. we configured settings before.
>>
>> when I gave start-handle-server, it start to work and i can see command 
>> in ps -ef| grep handle.
>> root@dspaceetu-vm:/dspace/handle-server# ps -ef | grep handle
>> tomcat7   8481 1  0 16:13 pts/800:00:05 java -Xmx256m -classpath 
>> :/dspace/lib/JUnitParams-...
>>
>>
>> i looked ports 8000 and 2641 with sudo netstat -tulpn | grep :2641 
>> command but it doesn't show anything. In Iptables, I gave to 8000(tcp) and 
>> 2641(udp,tcp) permissions.
>>
>> tail -100f handle-server.log
>> "2017/02/25 03:13:48 EET" 25 Rotating log files
>>
>> moreover when i go http://hdl.handle.net/20.500.11851/317  
>>   I see  Error - Cannot Connect 
>> to Server  error. What could the error be? I can't find any mistake.
>>
>> thanks
>> Melih
>>
> -- 
> You received this message because you are subscribed to the Google Groups 
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to dspace-tech...@googlegroups.com .
> To post to this group, send email to dspac...@googlegroups.com 
> .
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Re: Dspace Handle Server error

2017-02-28 Thread Shaun donovan


Sorry, pressed send by mistake :-)

You can do the same test for TCP using:

nc -t uir.unisa.ac.za 2641

and you can also test for port 8000 (TCP only)

nc -t uir.unisa.ac.za 8000.

You must run these commands from outside of your network. If you give me 
your URL, I will run them for you.


Now that your handle server seems to be starting, what do you get from a 
netstat -nltup?



On 28/02/2017 09:51, Ahmet Melih Başbuğ wrote:
Hello. After i changed ip adress (I changed public ip to private ip..) 
I got new error.



  Error - Resolution Error

The handle you requested --

*/20.500.11851/317/*

-- cannot be found.


What should i do ? I had items which included in past.

Thanks

Melih



25 Şubat 2017 Cumartesi 17:38:23 UTC+3 tarihinde Ahmet Melih Başbuğ 
yazdı:


Hello. I have problem about handle server. It was working in past.
but I restarted handle and it doesn't work. I can't understand
why? We got handle.net  account and it works.
we configured settings before.

when I gave start-handle-server, it start to work and i can see
command in ps -ef| grep handle.
root@dspaceetu-vm:/dspace/handle-server# ps -ef | grep handle
tomcat7   8481 1  0 16:13 pts/800:00:05 java -Xmx256m
-classpath :/dspace/lib/JUnitParams-...


i looked ports 8000 and 2641 with sudo netstat -tulpn | grep :2641
command but it doesn't show anything. In Iptables, I gave to
8000(tcp) and 2641(udp,tcp) permissions.

tail -100f handle-server.log
"2017/02/25 03:13:48 EET" 25 Rotating log files

moreover when i go http://hdl.handle.net/20.500.11851/317
 I see Error - Cannot
Connect to Server error. What could the error be? I can't find any
mistake.

thanks
Melih

--
You received this message because you are subscribed to the Google 
Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send 
an email to dspace-tech+unsubscr...@googlegroups.com 
.
To post to this group, send email to dspace-tech@googlegroups.com 
.

Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


--
You received this message because you are subscribed to the Google Groups "DSpace 
Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Re: Dspace Handle Server error

2017-02-28 Thread Shaun donovan


Hi Ahmet.

There are a few things to consider. Firstly, when you create the 
sitebundle.zip file, you must do it using the public IP address, as this 
is what CNRI use in their configuration. Then, because you are using a 
private IP address behind a firewall, you must go and change the IP 
addresses in the config.dct file in the handle-server directory, as you 
need to tell the handle server that it must bind to the private address.


The third step is to make sure that the puclic address port 2641 is 
forwarded to the private address port 2641 for both udp and tcp. You can 
test this using the netcat command as follows (but do it slowly):


nc -u uir.unisa.ac.za 2641

 (wait three seconds)

(wait three seconds)

ctl-c

The fact that you could type enter and it did not kick you out shows 
that it is connected.


If you test against a machine that does not work:

 nc -u www.teqcle.co.za 2641

(wait three seconds)

Ncat: No route to host.



On 28/02/2017 09:51, Ahmet Melih Başbuğ wrote:
Hello. After i changed ip adress (I changed public ip to private ip..) 
I got new error.



  Error - Resolution Error

The handle you requested --

*/20.500.11851/317/*

-- cannot be found.


What should i do ? I had items which included in past.

Thanks

Melih



25 Şubat 2017 Cumartesi 17:38:23 UTC+3 tarihinde Ahmet Melih Başbuğ 
yazdı:


Hello. I have problem about handle server. It was working in past.
but I restarted handle and it doesn't work. I can't understand
why? We got handle.net  account and it works.
we configured settings before.

when I gave start-handle-server, it start to work and i can see
command in ps -ef| grep handle.
root@dspaceetu-vm:/dspace/handle-server# ps -ef | grep handle
tomcat7   8481 1  0 16:13 pts/800:00:05 java -Xmx256m
-classpath :/dspace/lib/JUnitParams-...


i looked ports 8000 and 2641 with sudo netstat -tulpn | grep :2641
command but it doesn't show anything. In Iptables, I gave to
8000(tcp) and 2641(udp,tcp) permissions.

tail -100f handle-server.log
"2017/02/25 03:13:48 EET" 25 Rotating log files

moreover when i go http://hdl.handle.net/20.500.11851/317
 I see Error - Cannot
Connect to Server error. What could the error be? I can't find any
mistake.

thanks
Melih

--
You received this message because you are subscribed to the Google 
Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send 
an email to dspace-tech+unsubscr...@googlegroups.com 
.
To post to this group, send email to dspace-tech@googlegroups.com 
.

Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.


--
You received this message because you are subscribed to the Google Groups "DSpace 
Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Re: dspace not picking up Shibboleth attributes to authenticate

2017-02-28 Thread Tom Desair

Hi Julie,

I'm glad I could help and that you have Shibboleth up and running now.

There is also an (undocumented) property called "default-roles" in which
you can define a set of fallback roles in case no applicable roles were
found for a user. So if you want to assign each user that authenticates
through Shibboleth to the ETDR_AUTO group, you can put this in
the authentication-shibboleth.cfg file:

default-roles = internal
> role.internal = ETDR_AUTO


Best regards,
Tom

[image: logo] Tom Desair
250-B Suite 3A, Lucius Gordon Drive, West Henrietta, NY 14586
Esperantolaan 4, Heverlee 3001, Belgium
www.atmire.com


2017-02-27 20:33 GMT+01:00 J Bell :

>
> For future:
>
> I did also figure out being able to add a default group to shibboleth by
> using our domain name rather than affiliations - works great!
>
>
> # The shibboleth header to do role-based mappings
> role-header = email
>
> # Whether to ignore the attribute's scope or value.
> role-header.ignore-scope = false
> role-header.ignore-value = true
>
> # Default mappings of roles values to a comma separated list of DSpace
> group
> # names (Case Sensitive).
> role..edu = ETDR_AUTO
> role..edu = ETDR_AUTO
>
>
>
>
>
> On Tuesday, February 21, 2017 at 4:51:31 PM UTC-6, J Bell wrote:
>>
>>
>> We are moving to Shibboleth and I am having a problem figuring out where
>> my configuration is not set correctly to allow the actual authentication to
>> occur.  This is working in other instances we have running - only dSpace
>>  is not yet configured properly.   Would anyone have some input as to where
>> I have wandered into the weeds?
>>
>> Notes about our configuration:
>>
>> I have the IDP and my local *SP  (shibboleth 2.5.2)  * configured and
>> talking as I would expect.
>>
>> We are using *mod_ajp*  for the proxy  (this did not work under regular
>> proxy either - I have tried both ways).  My *shibboleth2.xml* configuration
>> looks like this:
>>
>> https://xxx.xxx.net/shibboleth";
>>  id="default" policyId="default"
>>  REMOTE_USER="eppn persistent-id targeted-id"
>>  signing="false" encryption="false"
>>  attributePrefix="AJP_">
>>
>> >   checkAddress="false" handlerSSL="false"
>> cookieProps="https">
>>
>> https://alpha.signin.xxx.edu/idp/shibboleth";
>> Location="/Login"
>>  discoveryProtocol="SAMLDS" discoveryURL="
>> https://ds.example.org/DS/WAYF";>
>>   SAML2 SAML1
>> 
>>
>>
>>
>> My *attribute-map.xml*  has the following attributes mapped - which come
>> back as expected:
>>
>>  
>> 
>> 
>> 
>> 
>> > id="displayName"/>
>>
>>
>>
>> */Shibboleth.sso/Session *returns this:
>>
>>
>> Miscellaneous
>> Session Expiration (barring inactivity): 476 minute(s)
>> Client Address: xxx.xxx.xxx.xxx
>> SSO Protocol: urn:oasis:names:tc:SAML:2.0:protocol
>> Identity Provider: https://alpha.signin.xxx.edu/idp/shibboleth
>> Authentication Time: 2017-02-20T17:31:43.925Z
>> Authentication Context Class: urn:oasis:names:tc:SAML:2.0:ac
>> :classes:PasswordProtectedTransport
>> Authentication Context Decl: (none)
>>
>> Attributes
>> cn: jbell
>> displayName: Julie Bell
>> email: jb...@xxx.edu
>> givenName: Julie
>> ksuPersonWildcatId: 
>> sn: Bell
>> telephoneNumber: x
>> uid: jbell
>>
>>
>> After proper authentication the service is returned to:
>>
>> https://test-dspace.xxx.net//dspace/shibboleth-login
>>
>> and:
>> Authentication Failed
>>
>> The* dspace log *responds with this:
>>
>> 2017-02-21 19:42:04,972 INFO  org.dspace.app.xmlui.aspect.a
>> rtifactbrowser.CommunityBrowser @ anonymous:session_id=DDFBE06E3
>> 003021B702DF0A1310B4816:ip_addr=xxx.xxx.xxx.xxx:view_community_list:
>> 2017-02-21 19:42:04,973 INFO  org.dspace.app.xmlui.aspect.d
>> iscovery.SidebarFacetsTransformer @ facets for scope, null: 3
>> 2017-02-21 19:42:05,677 INFO  org.dspace.app.xmlui.aspect.a
>> rtifactbrowser.CommunityBrowser @ anonymous:session_id=DDFBE06E3
>> 003021B702DF0A1310B4816:ip_addr=xxx.xxx.xxx.xxx:view_community_list:
>> 2017-02-21 19:42:05,678 INFO  org.dspace.app.xmlui.aspect.d
>> iscovery.SidebarFacetsTransformer @ facets for scope, null: 3
>> 2017-02-21 19:42:27,872 ERROR org.dspace.authenticate.ShibAuthentication
>> @ Shibboleth authentication was not able to find a NetId, Email, or Tomcat
>> Remote user for which to indentify a user from.
>> 2017-02-21 19:42:27,872 ERROR org.dspace.authenticate.ShibAuthentication
>> @ Unable to register new eperson because we are unable to find an email
>> address along with first and last name for the user.
>>   NetId Header: 'null'='null' (Optional)
>>   Email Header: 'email'='null'
>>   First Name Header: 'givenName'='null'
>>   Last Name Header: 'sn'='null'
>> 2017-02-21 19:42:27,872 INFO  org.dspace.app.xmlui.utils.Authenticat

Re: [dspace-tech] Re: Batch uploading bitstreams before adding metadata

RE: [dspace-tech] Re: dspace5 rest login fails

[dspace-tech] Re: Batch uploading bitstreams before adding metadata

Re: [dspace-tech] Re: Dspace Handle Server error

Re: [dspace-tech] Re: Dspace Handle Server error

Re: [dspace-tech] Re: Dspace Handle Server error

Re: [dspace-tech] Re: dspace not picking up Shibboleth attributes to authenticate

7 matches

Site Navigation

Mail list logo

Footer information