Re: [CODE4LIB] elsevier api program

2014-09-25 Thread Eric Lease Morgan
On Jul 14, 2014, at 5:00 PM, Eric Lease Morgan emor...@nd.edu wrote:

 Does anybody here have any experience with the Elsevier API Program? [1]
 
 [1] Elsevier API - http://www.developers.elsevier.com/cms/


I have had tiny success with the Elsevier API Program.

I first created an API key that is/was intended to be used from a particular IP 
address. This allowed me to sometimes download citation and abstract 
information from a few Elsevier-releated products using a REST-ful interface, 
but it did not allow me to download full text. Apparently because I was not 
“entitled”. 

Then some sort of contract was signed between the University and Elsevier. This 
contract was apparently returned to Elsevier, and consequently I have been able 
to create an access token for a text mining project as opposed to just an IP 
address. Using this second access token, I am able to programmatically download 
more articles. For example, using curl:

  curl -H X-ELS-APIKey: secretKey -H Accept: text/xml 
http://api.elsevier.com/content/article/PII:S0166361514000207  

The resulting XML includes links to images, and I can get those like this:

  curl -H X-ELS-APIKey: secretKey 
http://api.elsevier.com/content/object/eid:1-s2.0-S0166361514000207-si2.gif?httpAccept=%2A%2F%2A

Using this functionality I ought to be able to:

  1. Create a rudimentary one-box, one-buton interface to search select 
Elsevier indexes.
  2. Return the results allowing the reader to select items of interest.
  3. Get the selected items and on-the-fly do text mining against the results. 

Yea, sure, in my copious spare time.

I sincerely believe that indexers will catch on to text mining interfaces to 
their content. Search. Get back hundreds and hundreds of hits. Do some sort of 
analysis and visualization against the result. Allow people to USE the content 
as oppose to just get it. 

Has anybody else had any experience with the Elsevier API?

—
Eric Lease Morgan


[CODE4LIB] elsevier api program

2014-07-14 Thread Eric Lease Morgan
Does anybody here have any experience with the Elsevier API Program? [1]

Apparently, through Elsevier’s TDM (text and data mining) API a person can get 
the full text of Elsevier content, after being granted an access key. As per 
their instructions, I used the following curl command to try to download some 
full-text data as XML, but I only get the abstract:

  curl -H X-ELS-APIKey: suprsecrit -H Accept: text/xml 
http://api.elsevier.com/content/article/PII:S0039368109000934

Maybe I need some sort of additional access, but I’m wondering whether or not 
anybody else has been here previously and can shed some light on the subject? 
Do I need to be “entited”?

[1] Elsevier API - http://www.developers.elsevier.com/cms/

—
Eric Morgan


Re: [CODE4LIB] elsevier api program

2014-07-14 Thread Ben Companjen
This will not answer your question, but LIBER has a response to the TDM
API policies: 
http://libereurope.eu/news/over-40-signatories-ask-elsevier-to-withdraw-tdm
-policy/ Peter Murray-Rust posted quite a few times about it on his blog
too, e.g. http://blogs.ch.cam.ac.uk/pmr/2014/06/10/6054/

The main objection is that the licence for usage is too narrow - and that
most libraries already pay for access. I recall that you cannot do
[anything useful] with whatever you find while TDMing this data.

If you want to be entitled, you have to sign Elsevier's contract. You seem
to know more about the practical side of things here than I do.

Groeten van Ben

(Not speaking on behalf of anyone else here.)

On 14-07-14 23:00, Eric Lease Morgan emor...@nd.edu wrote:

Does anybody here have any experience with the Elsevier API Program? [1]

Apparently, through Elsevier’s TDM (text and data mining) API a person
can get the full text of Elsevier content, after being granted an access
key. As per their instructions, I used the following curl command to try
to download some full-text data as XML, but I only get the abstract:

  curl -H X-ELS-APIKey: suprsecrit -H Accept: text/xml
http://api.elsevier.com/content/article/PII:S0039368109000934

Maybe I need some sort of additional access, but I’m wondering whether or
not anybody else has been here previously and can shed some light on the
subject? Do I need to be “entited”?

[1] Elsevier API - http://www.developers.elsevier.com/cms/

—
Eric Morgan


Re: [CODE4LIB] elsevier api program

2014-07-14 Thread Eric Lease Morgan
On Jul 14, 2014, at 5:29 PM, Ben Companjen ben.compan...@dans.knaw.nl wrote:

 This will not answer your question, but LIBER has a response to the TDM API 
 policies:
 
 http://libereurope.eu/news/over-40-signatories-ask-elsevier-to-withdraw-tdm-policy/
 
 Peter Murray-Rust posted quite a few times about it on his blog
 too, e.g. http://blogs.ch.cam.ac.uk/pmr/2014/06/10/6054/
 
 The main objection is that the licence for usage is too narrow - and that
 most libraries already pay for access. I recall that you cannot do
 [anything useful] with whatever you find while TDMing this data.


Yes, apparently I (my application) needs to become “entitled” in order to get 
the full-text, and even then I’ve discovered the resulting XML is pretty ugly. 
I will wait. Thank you for the reply. —Eric Morgan