Re: browsing maven repo
Oh yes I understand. I didn't think deep enough. My tutor needs this set of triplets. If I do not need the dependency information of the whole repo, just the triplets with timestamp, is there a way to get this? If not can I do this someway with the central repo only? Or maybe create a local repo and mirror? I tried the central repo's api but I cannot search for example a com.* groupid. The only idea I had is to search using http://search.maven.org/solrsearch/select?q=com&rows=20&wt=json then parse it get the numFound, and then next is: http://search.maven.org/solrsearch/select?q=com&rows=numFound&wt=json. Thank you very much! Br, Ogi 2011/11/15 Tamás Cservenák > Hi, > > it's not feasible at all. You'd need to _resolve_ all the existing > POMs into effective POMs, to be able to build the "edges" you mention > in way you want. Moreover, it's not that simple, think platform > specific profiles (hence, edges changes as you change the platform you > evaluate aganst), etc. I don't believe you want to do that. > > What "further analysis" you expect to have against _triplets_ and _edges_? > > > Thanks, > ~t~ > > On Tue, Nov 15, 2011 at 11:32 AM, Ognjen Bubalo > wrote: > > Yes I already read about Aether. I know that if I use this I can get the > > tree, and that should be enough to visualize, but the part of the thesis > is > > to get artifacts information (triples) into a DB from a repo for further > > analysis. Is this possible somehow? > > > > Thank you! > > > > Br, Ogi > > - > To unsubscribe, e-mail: users-unsubscr...@maven.apache.org > For additional commands, e-mail: users-h...@maven.apache.org > >
Re: browsing maven repo
Yes I already read about Aether. I know that if I use this I can get the tree, and that should be enough to visualize, but the part of the thesis is to get artifacts information (triples) into a DB from a repo for further analysis. Is this possible somehow? Thank you! Br, Ogi 2011/11/15 Tamás Cservenák > Hm, > > well then, your need seems "bloated". You don't need _whole_ Central > Repository GAVs at all (what for? to use 1%, 5% or 10% of it in best > case?)... > > Let's reverse your problem: Just create those "local POMs" first, and > use Aether [1] to resolve it's dependencies and persist somehow the > resulting tree. The tweak your local POM (apply changes you mention, > bump some versions or add some) and persist that tree too. And then > compare the two tree, visualize or whatever. > > So, you could figure out how to persist the dependency trees got from > Aether (it calculates for you all), how to compare the trees and > finally how to visualize those diffs. That would be a nice thesis :D > > Ultimately, the "tool" resulting from your thesis could be applied to > _any_ project, just pass in the POM of it in multiple iterations (ie. > V1, V2, ...), build the graphs, and resulting output would be nice > visualization of "changes" happened in dependencies. > > > Note: "getting dependencies from POM" is not trivial. It's not just > parsing the POM XML etc... you need to interpolate values, apply > parents, etc... All that is done by Aether for you. > > [1] https://github.com/sonatype/sonatype-aether > > > Thanks, > ~t~ > > On Tue, Nov 15, 2011 at 10:34 AM, Ognjen Bubalo > wrote: > > Hi! > > > > Hmm, the only way to get the dependencies is to look into the POM files I > > think. I know this is too much maybe. > > Yes I would like to have all the triplets in my DB and it would be really > > good if I could show the whole graph. If I add my local POM which depends > > on some other projects in this specific repository then I have to see for > > example in a different color the dependency tree inside the big graph. > > > > So if we give some other local POMs we can see the differences in the > > dependency trees. For example if we give 2 POMs which diffs only in > > versions or only in used dependencies (or their versions) we can see > > visually that there can be an affect on our project a difference between > 2 > > versions of a third party library. > > > > You mean that dependency trees do not always "stay" in one repository? > Yes > > then there would be a cut in the tree. I think the Central repo would be > > "enough" :) first. > > > > Thank you very much! > > > > Ogi > > > > 2011/11/15 Tamás Cservenák > > > >> Ogi, > >> > >> this is a bit incomplete :) I understand you want the triplets > >> (triplets? What about classifiers?), but Indexer does not have any > >> information about dependencies (edges in your case). > >> > >> Also, what for is the tree-like big graph needed? > >> Are you sure you need the graph of one whole repository? > >> > >> I still don't get your ultimate problem you try to solve, nor see the > >> value of having this tree-like graph of whole repository, since on > >> repository level, there is no constraint of whatsoever... repositories > >> _tend_ to contain interdependent artifacts, but it's not a requirement > >> at all. Or you are targeting Central Repository specifically (that one > >> has a weak requirement to not contain artifacts pointing "outside" of > >> it)? Or... > >> > >> > >> Thanks, > >> ~t~ > >> > >> On Mon, Nov 14, 2011 at 6:58 PM, Ognjen Bubalo > >> wrote: > >> > Hi! > >> > > >> > Yes I understand. > >> > So, I would like to get from a repository all the groupId, artifactId, > >> > version "3s" and put it into an SQL DB. Then I want to draw a graph > using > >> > my DB (POM = node, dependency = edge), and finally I want to put in my > >> > local POM and see how the dependency tree looklike in the big graph. I > >> need > >> > this for my thesis. So I need the information somehow what 3s are on a > >> > repository. > >> > > >> > Thank you! > >> > > >> > Ogi > >> > > >> > Ps: Puno ti hvala :). Harom nyelven is mehet a beszelgetes :) > >> > > >> > 2011/11/14 Tamás Cs
Re: browsing maven repo
Hi! Hmm, the only way to get the dependencies is to look into the POM files I think. I know this is too much maybe. Yes I would like to have all the triplets in my DB and it would be really good if I could show the whole graph. If I add my local POM which depends on some other projects in this specific repository then I have to see for example in a different color the dependency tree inside the big graph. So if we give some other local POMs we can see the differences in the dependency trees. For example if we give 2 POMs which diffs only in versions or only in used dependencies (or their versions) we can see visually that there can be an affect on our project a difference between 2 versions of a third party library. You mean that dependency trees do not always "stay" in one repository? Yes then there would be a cut in the tree. I think the Central repo would be "enough" :) first. Thank you very much! Ogi 2011/11/15 Tamás Cservenák > Ogi, > > this is a bit incomplete :) I understand you want the triplets > (triplets? What about classifiers?), but Indexer does not have any > information about dependencies (edges in your case). > > Also, what for is the tree-like big graph needed? > Are you sure you need the graph of one whole repository? > > I still don't get your ultimate problem you try to solve, nor see the > value of having this tree-like graph of whole repository, since on > repository level, there is no constraint of whatsoever... repositories > _tend_ to contain interdependent artifacts, but it's not a requirement > at all. Or you are targeting Central Repository specifically (that one > has a weak requirement to not contain artifacts pointing "outside" of > it)? Or... > > > Thanks, > ~t~ > > On Mon, Nov 14, 2011 at 6:58 PM, Ognjen Bubalo > wrote: > > Hi! > > > > Yes I understand. > > So, I would like to get from a repository all the groupId, artifactId, > > version "3s" and put it into an SQL DB. Then I want to draw a graph using > > my DB (POM = node, dependency = edge), and finally I want to put in my > > local POM and see how the dependency tree looklike in the big graph. I > need > > this for my thesis. So I need the information somehow what 3s are on a > > repository. > > > > Thank you! > > > > Ogi > > > > Ps: Puno ti hvala :). Harom nyelven is mehet a beszelgetes :) > > > > 2011/11/14 Tamás Cservenák > > > >> Hi, > >> > >> well, as I said, on remote reposes Indexer can't do much IF index is > >> not published. And crawling a repo is considered a bad behavior, so be > >> polite! :) > >> > >> Could you describe a bit more about your use case? > >> > >> > >> Thanks, > >> ~t~ > >> > >> PS: Ma nema problema Ogi, i drugi put! Moze i direktno :D > >> > >> > >> On Mon, Nov 14, 2011 at 6:39 PM, Ognjen Bubalo > >> wrote: > >> > Thank you (Koszonom) for your response! > >> > > >> > By given repository I mean a remote repository address > (http,https..). I > >> > thought that Nexus Indexer can only manage local repo. Anyway, if I > >> > understand, indexing a repo is done on the repo side, and I cannot > use it > >> > for sure. > >> > I need something like: http://search.maven.org/#api, but I have 2 > >> problem > >> > with this API: > >> > 1. I cannot get in an xml or json the whole artifacts information set > >> > (select *), only if I search for a specific artifact or group. > >> > 2. This works maybe only on this repo, I need something for my > >> application > >> > (an API or another application), to explore any remote repository > >> > programmatically (using java code). One repository is good for a start > >> also > >> > if there is a solution. > >> > > >> > I am new in this world, please excuse me. > >> > > >> > Thank you very much! > >> > > >> > Br, Ogi > >> > > >> > 2011/11/14 Tamás Cservenák > >> > > >> >> Hm, > >> >> > >> >> a typo: > >> >> > >> >> Maven3 (nor Maven2) does not... > >> >> > >> >> > >> >> Thanks, > >> >> ~t~ > >> >> > >> >> 2011/11/14 Tamás Cservenák : > >> >> > Hi Ogi, > >> >> > > >> >> > Maven3 (not was Maven2) does not use or consume or need index at > >&g
Re: browsing maven repo
Hi! Yes I understand. So, I would like to get from a repository all the groupId, artifactId, version "3s" and put it into an SQL DB. Then I want to draw a graph using my DB (POM = node, dependency = edge), and finally I want to put in my local POM and see how the dependency tree looklike in the big graph. I need this for my thesis. So I need the information somehow what 3s are on a repository. Thank you! Ogi Ps: Puno ti hvala :). Harom nyelven is mehet a beszelgetes :) 2011/11/14 Tamás Cservenák > Hi, > > well, as I said, on remote reposes Indexer can't do much IF index is > not published. And crawling a repo is considered a bad behavior, so be > polite! :) > > Could you describe a bit more about your use case? > > > Thanks, > ~t~ > > PS: Ma nema problema Ogi, i drugi put! Moze i direktno :D > > > On Mon, Nov 14, 2011 at 6:39 PM, Ognjen Bubalo > wrote: > > Thank you (Koszonom) for your response! > > > > By given repository I mean a remote repository address (http,https..). I > > thought that Nexus Indexer can only manage local repo. Anyway, if I > > understand, indexing a repo is done on the repo side, and I cannot use it > > for sure. > > I need something like: http://search.maven.org/#api, but I have 2 > problem > > with this API: > > 1. I cannot get in an xml or json the whole artifacts information set > > (select *), only if I search for a specific artifact or group. > > 2. This works maybe only on this repo, I need something for my > application > > (an API or another application), to explore any remote repository > > programmatically (using java code). One repository is good for a start > also > > if there is a solution. > > > > I am new in this world, please excuse me. > > > > Thank you very much! > > > > Br, Ogi > > > > 2011/11/14 Tamás Cservenák > > > >> Hm, > >> > >> a typo: > >> > >> Maven3 (nor Maven2) does not... > >> > >> > >> Thanks, > >> ~t~ > >> > >> 2011/11/14 Tamás Cservenák : > >> > Hi Ogi, > >> > > >> > Maven3 (not was Maven2) does not use or consume or need index at > all... > >> > > >> > For indexer API uses you can see some examples here: > >> > https://github.com/cstamas/maven-indexer-examples > >> > > >> > For CLI uses (to create indexes for repositories), unsure is there any > >> > up to date doco, but just gleaning over the CLI source should work: > >> > > >> > https://github.com/apache/maven-indexer/blob/trunk/indexer-core/src/main/java/org/apache/maven/index/cli/NexusIndexerCli.java > >> > > >> > Now the question is: is "given repository" you mention under your > >> > governance or not... since if it's NOT and it does NOT publish indexes > >> > either, Maven Indexer will not help you. > >> > > >> > > >> > Thanks, > >> > ~t~ > >> > > >> > > >> > On Mon, Nov 14, 2011 at 5:57 PM, Ognjen Bubalo > >> wrote: > >> >> Hi! > >> >> > >> >> I would like to get a list of all artifacts placed in a given > >> repository. I > >> >> think I could use Maven Indexer but I am not sure it works with > Maven 3. > >> >> Also I couldn't find any example using Maven Indexer, to know where > to > >> >> start. I would appreciate if somebody put me on right direction, > >> recommend > >> >> something. > >> >> > >> >> Thank you! > >> >> > >> >> Br, Ogi > >> >> > >> > > >> > >> - > >> To unsubscribe, e-mail: users-unsubscr...@maven.apache.org > >> For additional commands, e-mail: users-h...@maven.apache.org > >> > >> > > > > - > To unsubscribe, e-mail: users-unsubscr...@maven.apache.org > For additional commands, e-mail: users-h...@maven.apache.org > >
Re: browsing maven repo
Thank you (Koszonom) for your response! By given repository I mean a remote repository address (http,https..). I thought that Nexus Indexer can only manage local repo. Anyway, if I understand, indexing a repo is done on the repo side, and I cannot use it for sure. I need something like: http://search.maven.org/#api, but I have 2 problem with this API: 1. I cannot get in an xml or json the whole artifacts information set (select *), only if I search for a specific artifact or group. 2. This works maybe only on this repo, I need something for my application (an API or another application), to explore any remote repository programmatically (using java code). One repository is good for a start also if there is a solution. I am new in this world, please excuse me. Thank you very much! Br, Ogi 2011/11/14 Tamás Cservenák > Hm, > > a typo: > > Maven3 (nor Maven2) does not... > > > Thanks, > ~t~ > > 2011/11/14 Tamás Cservenák : > > Hi Ogi, > > > > Maven3 (not was Maven2) does not use or consume or need index at all... > > > > For indexer API uses you can see some examples here: > > https://github.com/cstamas/maven-indexer-examples > > > > For CLI uses (to create indexes for repositories), unsure is there any > > up to date doco, but just gleaning over the CLI source should work: > > > https://github.com/apache/maven-indexer/blob/trunk/indexer-core/src/main/java/org/apache/maven/index/cli/NexusIndexerCli.java > > > > Now the question is: is "given repository" you mention under your > > governance or not... since if it's NOT and it does NOT publish indexes > > either, Maven Indexer will not help you. > > > > > > Thanks, > > ~t~ > > > > > > On Mon, Nov 14, 2011 at 5:57 PM, Ognjen Bubalo > wrote: > >> Hi! > >> > >> I would like to get a list of all artifacts placed in a given > repository. I > >> think I could use Maven Indexer but I am not sure it works with Maven 3. > >> Also I couldn't find any example using Maven Indexer, to know where to > >> start. I would appreciate if somebody put me on right direction, > recommend > >> something. > >> > >> Thank you! > >> > >> Br, Ogi > >> > > > > - > To unsubscribe, e-mail: users-unsubscr...@maven.apache.org > For additional commands, e-mail: users-h...@maven.apache.org > >
browsing maven repo
Hi! I would like to get a list of all artifacts placed in a given repository. I think I could use Maven Indexer but I am not sure it works with Maven 3. Also I couldn't find any example using Maven Indexer, to know where to start. I would appreciate if somebody put me on right direction, recommend something. Thank you! Br, Ogi
exploring maven repository
Hello! I would like to create an application which is able to explore a user specified maven repository ( to see what is on that repo, get artifacts, poms). I think I should use the Maven API but maybe there is a maven plugin for this already. Do you have any idea how could I do this? The online Maven Browsers work similar maybe. Thank you! Br, Ogi
