Hi Nicola, One more thing, in addition to the duplicated slashes, is that you may want to consider using a JSESSIONID rather than using your username/password credentials for your curl calls.
I usually use something like: read -s -p "ENTER PASSWORD: " PW;JSESSIONID=`curl -s -k -u MYUSERNAME:$PW https://db.humanconnectome.org/REST/JSESSIONID`;export JSESSIONID to get my JSESSIONID. Then you can do: curl –cookie JSESSIONID=$JSESSIONID https://db.humanconnectome.org/data/projects/ When you issue calls with -u USER:PW, you create a separate session for each curl call, while using the JSESSIONID reuses the same session. If your script is issuing a lot of curl calls and passing your credentials each time, you could end up exceeding the maximum number of allowed sessions. Then your output might just contain an error message rather than the actual file contents. Performance should also be a bit better if each call isn’t generating a new session. Regards, Mike From: Hodge, Michael Sent: Thursday, November 2, 2017 12:11 PM To: 'Nicola Toschi' <tos...@med.uniroma2.it>; hcp-users@humanconnectome.org >> hcp-users <hcp-users@humanconnectome.org> Subject: RE: [HCP-Users] Discrepancy in files downloaded from the web interface w.r.t CREST Hi Nicola, The archive specification is optional. So it should work with or without it. I think the problem is likely the duplicate slashes – “files//MNINonLinear”. I copied your curl command, and worked as-is once I removed the duplicate slash. Regards, Mike From: hcp-users-boun...@humanconnectome.org<mailto:hcp-users-boun...@humanconnectome.org> [mailto:hcp-users-boun...@humanconnectome.org] On Behalf Of Nicola Toschi Sent: Thursday, November 2, 2017 12:02 PM To: Hodge, Michael <hod...@wustl.edu<mailto:hod...@wustl.edu>>; hcp-users@humanconnectome.org<mailto:hcp-users@humanconnectome.org> >> hcp-users <hcp-users@humanconnectome.org<mailto:hcp-users@humanconnectome.org>> Subject: Re: [HCP-Users] Discrepancy in files downloaded from the web interface w.r.t CREST oh wait - I have and extra 'archive' in the path... is this what the problem is? On 11/02/2017 06:00 PM, Nicola Toschi wrote: Hi Michael, I am using: sub=100206 h=R curl -u USER:PASS -O https://db.humanconnectome.org/data/archive/projects/HCP_1200/subjects/${sub}/experiments/${sub}_CREST/resources/${sub}_CREST/files//MNINonLinear/Native/${sub}.${h}.sphere.MSMAll.native.surf.gii so the URL is the same (i think) but the curl options are slightly different... could this be it? I will try! Thanks for your reply, Nicola On 11/02/2017 05:50 PM, Hodge, Michael wrote: Hi Nicola, What URL are you using to retrieve the file via CREST/curl? When I do: curl -s -k --cookie JSESSIONID=$JSESSIONID https://db.humanconnectome.org/data/projects/HCP_1200/subjects/100206/experiments/100206_CREST/resources/100206_CREST/files/MNINonLinear/Native/100206.R.sphere.MSMAll.native.surf.gii -o 100206.R.sphere.MSMAll.native.surf.gii<https://db.humanconnectome.org/data/projects/HCP_1200/subjects/100206/experiments/100206_CREST/resources/100206_CREST/files/MNINonLinear/Native/100206.R.sphere.MSMAll.native.surf.gii%20-o%20100206.R.sphere.MSMAll.native.surf.gii> I get: 4175821 Nov 2 11:45 100206.R.sphere.MSMAll.native.surf.gii with the following md5sum: 5478269f6345c91c0566d7bccf010860 100206.R.sphere.MSMAll.native.surf.gii The md5sum from the file I’m retrieving via CREST/curl matches what I get from the package. Thanks, Mike From: hcp-users-boun...@humanconnectome.org<mailto:hcp-users-boun...@humanconnectome.org> [mailto:hcp-users-boun...@humanconnectome.org] On Behalf Of Nicola Toschi Sent: Tuesday, October 31, 2017 10:42 PM To: hcp-users <hcp-users@humanconnectome.org><mailto:hcp-users@humanconnectome.org> Subject: [HCP-Users] Discrepancy in files downloaded from the web interface w.r.t CREST Hi list, though a processing error I noticed the following strange behaviour: 1) When i download the complete structural package using the Aspera plugin and extract the file I am interested in, I get (for example): rwxrwxrwx 1 nicola users 4175821 Nov 27 2015 100206.R.sphere.MSMAll.native.surf.gii and this file works fine 2) When I fetch the same file through CREST/curl, I get a totally different file size (no error messages): -rw-r--r-- 1 nicola users 213364 Oct 30 19:56 100206.R.sphere.MSMAll.native.surf.gii and a parse error when I try to use it. Any Idea what I may be doing wrong? Thanks in advance!!! nicola _______________________________________________ HCP-Users mailing list HCP-Users@humanconnectome.org<mailto:HCP-Users@humanconnectome.org> http://lists.humanconnectome.org/mailman/listinfo/hcp-users ________________________________ The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail. _______________________________________________ HCP-Users mailing list HCP-Users@humanconnectome.org<mailto:HCP-Users@humanconnectome.org> http://lists.humanconnectome.org/mailman/listinfo/hcp-users _______________________________________________ HCP-Users mailing list HCP-Users@humanconnectome.org<mailto:HCP-Users@humanconnectome.org> http://lists.humanconnectome.org/mailman/listinfo/hcp-users ________________________________ The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail. _______________________________________________ HCP-Users mailing list HCP-Users@humanconnectome.org http://lists.humanconnectome.org/mailman/listinfo/hcp-users
