Thanks for your reply Noam. I'll watch the JIRA for the update.
Regards,
Ken
________________________________
From: Noam Y. Tenne [mailto:[email protected]]
Sent: Sunday, March 07, 2010 1:10 AM
To: [email protected]
Subject: Re: [Artifactory-users] Retrieving a complete listing of
artifacts via REST
Hi Ken,
The limit you hit is a hard limit on the amount of search results that
will be returned by a Artifactory's queries via Jackrabbit, since large
result sets can consume a large amount of system resources.
Currently, the REST API searcher which allows limitless search results
is the "Created or modified in range" searcher. It's details can be
viewed in the REST API wiki
<http://wiki.jfrog.org/confluence/display/RTF/Artifactory%27s+REST+API>
page, under "Searches" -> "Get All Artifacts Created in Date Range".
I have also created a JIRA issue for allowing limitless search results
from all searchers: RTFACT-2920
<http://issues.jfrog.org/jira/browse/RTFACT-2920> .
Noam
Pacileo, Ken wrote:
Hi Noam,
I tried your suggestions without any luck. Looking back at the
results from yesterday I found I was only getting artifacts listed from
three of the five local repos, not all the local repos. This is what I
saw:
Permissions: All browser requests show a non_authenticated_user
in the request log. This makes sense according to your statement that
REST commands executed from a browser are made anonymously:
20100304165310|1953|REQUEST|xx.xxx.xx.xx|non_authenticated_user|GET|/api
/search/artifact|HTTP/1.1|200|0
I tried the browser requests with both anonymous access disabled
and enabled (initially anonymous access was disabled with encrypted
passwords required, LDAP auth enabled and various permission targets
restricting access). With anonymous access enabled, encrypted passwords
supported and all permission targets giving the anonymous user read
access to the local repos and the sole remote repo, the request returns
a list of 501 artifacts from three of the five local repos. No artifacts
were listed from the other local repos or the remote repo. Disabling
read access to the local repos and rerunning the request returns a list
of 44 artifacts from the remote repo. Searching the UI for Group Id of
'*' from the remote repo displays 400 matches. The remote repo is to
central (http://repo1.maven.org/maven2).
There are three permission targets that tune access to five
local repos depending on the type of user. If only TargetA is set to
give the anonymous user read access to three local repos, the request
returns a list of 501 artifacts from those three repos. There are 842
artifacts in those three repos.
Removing the anonymous user's read access from TargetA and
applying it to TargetB that assigns perms for four local repos returns a
different list of artifacts but the number of entries in the list from
TargetB is the same as the list from TargetA - 501. Is there is a limit
to the number of entries returned by a REST request? If so, is there
another method that can be used to obtain a complete catalog of
everything stored in Artifactory, local repos and remote caches?
Regards,
--Ken
________________________________
From: Noam Y. Tenne [mailto:[email protected]]
Sent: Thursday, March 04, 2010 3:16 AM
To: [email protected]
Subject: Re: [Artifactory-users] Retrieving a complete listing
of artifacts via REST
Hi Ken
There is no reason for artifacts to be filtered by repository
(when no repository is specified in the query) and I can't seem to
reproduce the issue you describe.
There are a couple of things you can check in order to
troubleshoot the problem:
* Permissions: When normally executing REST commands (from
a browser, for example), the request is made anonymously. It is possible
that the "missing" artifacts are filtered for permission reasons.
You can view the the history of HTTP requests made to
Artifactory via the request.log file
($ARTIFACTORY_HOME/logs/request.log) to see the name of the user that
performed the request.
* Do the "missing" artifacts appear when searching for
them via the UI Artifact search?
If the sections described above behave as expected, could you
please provide us with specific details like the name of the repository
cache, the name of the artifact, the query, etc'?
HTH,
Noam
Pacileo, Ken wrote:
Hi,
I'm testing some of the Search REST commands from
(http://wiki.jfrog.org/confluence/display/RTF/Artifactory%27s+REST+API
<http://wiki.jfrog.org/confluence/display/RTF/Artifactory%27s+REST+API>
) to get a complete list of all artifacts stored in Artifactory. The
basic artifact search works (api/search/artifact?name=*) but only lists
artifacts stored in the local repos. Is there an option I can use to
include the remote repo caches as well?
Regards,
--Ken
Ken Pacileo
Continuous Integration Service
Solutions Development & Delvry
UnitedHealth Group - IT
W 303-410-7386
M 860-908-4307
This e-mail, including attachments, may include
confidential and/or
proprietary information, and may be used only by the
person or entity
to which it is addressed. If the reader of this e-mail
is not the intended
recipient or his or her authorized agent, the reader is
hereby notified
that any dissemination, distribution or copying of this
e-mail is
prohibited. If you have received this e-mail in error,
please notify the
sender by replying to this message and delete this
e-mail immediately.
________________________________
------------------------------------------------------------------------
------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed
compiling, find bugs
proactively, and fine-tune applications for parallel
performance.
See why Intel Parallel Studio got high marks during
beta.
http://p.sf.net/sfu/intel-sw-dev
________________________________
_______________________________________________
Artifactory-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
This e-mail, including attachments, may include confidential
and/or
proprietary information, and may be used only by the person or
entity
to which it is addressed. If the reader of this e-mail is not
the intended
recipient or his or her authorized agent, the reader is hereby
notified
that any dissemination, distribution or copying of this e-mail
is
prohibited. If you have received this e-mail in error, please
notify the
sender by replying to this message and delete this e-mail
immediately.
________________________________
------------------------------------------------------------------------
------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find
bugs
proactively, and fine-tune applications for parallel
performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
________________________________
_______________________________________________
Artifactory-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
This e-mail, including attachments, may include confidential and/or
proprietary information, and may be used only by the person or entity
to which it is addressed. If the reader of this e-mail is not the intended
recipient or his or her authorized agent, the reader is hereby notified
that any dissemination, distribution or copying of this e-mail is
prohibited. If you have received this e-mail in error, please notify the
sender by replying to this message and delete this e-mail immediately.
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Artifactory-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/artifactory-users
