Re: How big is repo1?

2009-07-08 Thread Deron Eriksson

Hi Steve,

The central repository is massive. As of July 4th:

Maven Repository Totals:
   773,960 Files
   93,618 Directories
   114,996 Archives
   66 GB (71,762,387,589 bytes)

Content within Archives:
   6,405,263 Java Class Files
   2,145,630 Java Source Code Files
   3,205,789 HTML Files
   498,006 XML Files
   48,030 JSPs
   161,429 Archives
   451,989 Images
   17,147,162 Total Files

I've got a repository statistics page at
http://www.jarvana.com/jarvana/info/repository_statistics , although it's
about a month and a half out of date. I'll be updating the server with a new
search index tomorrow, and then it'll reflect the above repo statistics.

Deron




steve_taylor wrote:
> 
> Just curious, how big is the central repository (including plugins)? I 
> couldn't find this information anywhere. You'd think it would be an FAQ.
> 
> 

-- 
View this message in context: 
http://www.nabble.com/How-big-is-repo1--tp24372493p24389527.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



RE: New Maven Respository Search Application

2009-02-23 Thread Deron Eriksson

Hello Eugene,

Thank you for the question about Jarvana's purpose.

Jarvana's raison d’être (Jarvana was conceived one August evening in Nice,
France) is that I wanted a web-based application that would let me search
for classes in the maven repo and get their dependency information. I also
wanted to have links to source code and javadocs (if available) and to be
able to view these online. Several web-based maven repo search tools exist,
but Nexus is the only other online tool that I've seen that offers class
searching. Nexus currently doesn't offer viewable souce code and javadoc
links (that I'm aware of), and these are things that I find useful when I am
trying to figure out what a class does. This capability seemed useful, so I
became motivated to share this functionality with the world. Since you
mentioned it, I would love to see source code and javadocs via m2eclipse,
although I don't know how other people feel. I would especially like it if I
could preview source code/javadocs for a class with m2eclipse before
deciding to download a jar and use it in my project.

Every once in a while I have a need to see what's in an archive file. If
there are javadocs, source code, or images in a jar file, I'd prefer to
scroll through such content online if I happen to be in a web browser.
Although Jarvana does this, class and artifact searching is far more useful
to most people than this feature. Jarvana is first and foremost a search
engine.

Jarvana takes a very hyperlinked/web 1.0 approach to searching. It allows
people to search for classes, artifacts, and content. When search results
are returned, it tries to link to relevant information (project dependency,
source code, javadoc, plugin goals, etc). Web browsers have a lot of
limitations, but they are great for hyperlinking.

Jarvana was a chance to learn how to write a Java-based search engine (in
the process we gained a great respect and appreciation for the work that
Doug Cutting and other developers have done on the Lucene project). It
seemed that no one had done a really in-depth indexing of the maven repo, so
we wrote Jarvana. It's kind of like mapping the human genome. Once you map
it, you can do interesting things with it. The Jarvana indexes are huge, but
no one besides the Jarvana web app interacts with these indexes, so
criticism of the large indexes really doesn't make much sense to me. They
are large so we can provide new, intrinsically different search
capabilities. We will probably add new interesting types of searches in the
future if we find the time and motivation to do so.

Many times, I've tried to explain to other developers the benefits of
adopting Maven for project management. But some people seem opposed to
Maven, and maybe sometimes they have situations that justify that
opposition. They are free to adopt other technologies that might be a better
fit for them. Likewise, some people might find Jarvana to be a silly little
search engine, so they never need to use it, but a few others might find it
to be useful. Jarvana isn't the first maven repo search tool and I'm sure it
won't be the last. However, I believe that variety is good when it comes to
software (operating systems, build tools, search engines, etc), and I think
our little search engine is a sign of a growing, healthy maven community. If
nothing else, it's been a great learning experience.

Keep up the great work with m2eclipse. I really think it is opening up maven
to thousands of new developers and making their (and our) lives easier.

Take care,
Deron Eriksson



Eugene Kuleshov wrote:
> 
> Deron,
> 
>   I wonder what is the purpose of such application? Being a Maven user for
> several ears I never had a need to browse content of some jar classes in
> the Maven repository... not outside my ide anyways.
> 
>   Also, from what I see, most of the information is already available from
> the repository index. Of course index does not include content of the jars
> and all the poms, but it still can be used to search trough them and it is
> far smaller then 10gb
> 
>   Tools like m2eclipse allow to search and open Maven poms directly from
> remote repositories. More over it allows to open pom editor from Navigate
> / Open Maven pom menu, from Maven Indexes view, from SVN//CVS Repositories
> view and even from History view. Then you can see the effective pom or
> resolved dependency hierarchy and navigate to other poms. If there is some
> interest, we could also show content of attached artifacts right in the
> pom editor (e.g. the sources or javadocs)
> 
>   regards,
>   Eugene
> 
> 

-- 
View this message in context: 
http://www.nabble.com/New-Maven-Respository-Search-Application-tp21973961p22163721.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



Re: mvn jetty home?

2009-02-16 Thread Deron Eriksson

There is a configuration guide here that can probably answer your questions:
http://docs.codehaus.org/display/JETTY/Maven+Jetty+Plugin


You should be able to use the plugin by adding it to the
build->plugins->plugin section of your project's pom.xml, like:

   org.mortbay.jetty
   jetty-maven-plugin
   7.0.0.pre5


Versions of the plugin before 7 apparently use maven-jetty-plugin as the
artifact rather than jetty-maven-plugin:

   org.mortbay.jetty
   maven-jetty-plugin
   6.1.14


The configuration guide describes configuration/execution of the various
goals.

Good luck,
Deron Eriksson
Code Strategies

-- 
View this message in context: 
http://www.nabble.com/Maven-using-old-snapshot-poms--tp21977241p22048668.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



RE: New Maven Respository Search Application

2009-02-12 Thread Deron Eriksson


Justin Edelson wrote:
> 
> Does this only index Central? 
> 

Hi Justin,
Yes, currently only central gets indexed, but in the future I'd like to add
support for multiple repositories.


Brian E Fox wrote:
> 
> Hopefully they are using the indexes and not scraping the entire
> contents of the repos.
> 

Hi Brian,
To offer the search capabilities that Jarvana offers, we need to create
massive new search indexes (over 10GB in size currently) that include
information such as file content, locations of related source code/javadocs,
etc.  We are trying to index all the files in the repository, all the files
in the archive files in the repository, and all the content of all the files
in the archive files in the repository. (We actually don't index everything,
but do try to index most things.)

Currently, we update our repository files a couple times a month (nights or
weekends) via rsync. We alternate between different mirrors to try to
minimize any bandwidth costs to any particular host, since bandwidth can get
expensive when dealing with large quantities of data. (Also, I would never
want to spider central, since that would not be nice to do to the web
servers.) In the future, if Jarvana proves to be popular and we move to a
better server, I wouldn't be opposed to the idea of also becoming a mirror.

We are hopeful that Jarvana might make the lives of current Java/Maven
developers a little easier to justify its existence. We are also hopeful
that it might, in some small ways, encourage more people to adopt Java and
Maven.

Let me know if you have any other questions or suggestions.
Deron Eriksson

-- 
View this message in context: 
http://www.nabble.com/New-Maven-Respository-Search-Application-tp21973961p21982369.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



New Maven Respository Search Application

2009-02-12 Thread Deron Eriksson

I'd like to announce our new Maven repository search application called
Jarvana that features searching for classes, artifacts, and content. In
addition to project dependency information, class search results include
links to relevant source code and javadocs when available. Class and
artifact search results include links to a 'POM inspector' and the relevant
archive file, which can be drilled into online. Plugin information is
displayed when available. Content searches can be broken down into different
areas (html, java, xml, etc) and include a 'Highlighter' feature similar to
Google's 'Cached' results highlighting.

The main page is available at:
http://www.jarvana.com

The application features a repository browser that has shortcut links and
allows for sorting based on a variety of characteristics such as the number
of folders, directories, and archives within folders.
http://www.jarvana.com/jarvana/browse

The browser 'Archive Details' view sums up statistics about all of the files
in all of the archives. These results are also sortable.
http://www.jarvana.com/jarvana/browse?d=y&path=&by=&order=

We also just added a 'Digest Generator and Checker' tool that generates MD5
and SHA1 digests for an uploaded file and checks to see if those digests
exist in the repository. This tool can be found here:
http://www.jarvana.com/jarvana/more


Jarvana is still a work in progress so UI and functionality changes are
quite likely to occur in the near future. Questions, comments, and
constructive criticism are always welcome!


Deron Eriksson
Code Strategies

-- 
View this message in context: 
http://www.nabble.com/New-Maven-Respository-Search-Application-tp21973961p21973961.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



Re: public html index for the site repo of org.apache.maven.plugins?

2009-01-24 Thread Deron Eriksson

I've been working on a new repository search tool. If you do a project search
for "org.apache.maven.plugins", it returns all the plugins in
org.apache.maven.plugins. The results include links to all of the javadocs
for the different versions of the plugins, if the javadocs are available in
the repository. In addition, it has links to the general plugin sites at
http://maven.apache.org/plugins/... . In the future, if maven.apache.org
sites are generated for all the different plugin versions, I could include
links to these sites, if there is a demand for it.

Here are the results of a "org.apache.maven.plugins" project query:
http://www.jarvana.com/jarvana/search?search_type=project&project=org.apache.maven.plugins

Deron Eriksson


-- 
View this message in context: 
http://www.nabble.com/public-html-index-for-the-site-repo-of-org.apache.maven.plugins--tp21632964p21639059.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



Re: How to do sftp without getting passwd or connection prompt?

2009-01-23 Thread Deron Eriksson

If you're running on windows, you can use Pageant to automatically take care
of your SSH login so that you're not prompted for username/password each
time. I've used Pageant in conjunction with scpexe to deploy.

A nice tutorial describing SSH setup can be found at:
http://www.howtoforge.com/ssh_key_based_logins_putty


Deron Eriksson

-- 
View this message in context: 
http://www.nabble.com/How-to-do-sftp-without-getting-passwd-or-connection-prompt--tp21632915p21637964.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



Re: how to exclude classes from package in target/classes to be copied to WAR in packaging

2009-01-19 Thread Deron Eriksson
If Eclipse is automatically generating classes in target/classes from your
classes in src/test/java, I think there is a problem, since src/test/java
classes should end up in target/test-classes. I would recommend

(1) running eclipse:eclipse on your project (to update your Eclipse
.classpath) and then
(2) perform a clean (to clean out the old files in target/classes).

As an example, if I execute 'mvn eclipse:eclipse' on a web project of mine,
my Eclipse project .classpath file ends up with the following:
...
  
  
  
...

Notice that src/test/java classes go to target/test-classes.

After performing eclipse:eclipse and refreshing your project, your
.classpath should be similar to the above.

After this, you should perform a 'mvn clean' and refresh your project. You
should end up with
 target/classes (empty folder)
 target/test-classes (empty folder)

Now, if you perform a 'mvn clean package', you should see that your regular
classes end up in target/classes and your test classes end up in
target/test-classes. If you inspect your war file that is created, you
should see that it does not contain your test classes.

By the way, it's a good idea to run clean before running lifecycle commands
like 'package' since this ensures that old stuff is cleaned out when you
build your new artifact.

Deron Eriksson


Re: how to exclude classes from package in target/classes to be copied to WAR in packaging

2009-01-19 Thread Deron Eriksson

If Eclipse is automatically generating classes in target/classes from your
classes in src/test/java, I think there is a problem, since src/test/java
classes should end up in target/test-classes. I would recommend
 
(1) running eclipse:eclipse on your project (to update your Eclipse
.classpath) and then
(2) perform a clean (to clean out the old files in target/classes).
 
As an example, if I execute 'mvn eclipse:eclipse' on a web project of mine,
my Eclipse project .classpath file ends up with the following:
...
  
  
  
...
 
Notice that src/test/java classes go to target/test-classes.
 
After performing eclipse:eclipse and refreshing your project, your
.classpath should be similar to the above.
 
After this, you should perform a 'mvn clean' and refresh your project. You
should end up with 
 target/classes (empty folder)
 target/test-classes (empty folder)
 
Now, if you perform a 'mvn clean package', you should see that your regular
classes end up in target/classes and your test classes end up in
target/test-classes. If you inspect your war file that is created, you
should see that it does not contain your test classes.
  
Deron Eriksson

-- 
View this message in context: 
http://www.nabble.com/how-to-exclude-classes-from-package-in-target-classes-to-be-copied-to-WAR-in-packaging-tp21540465p21542863.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



Re: Using maven with eclipse

2009-01-16 Thread Deron Eriksson

Hi Farrukh,

If you're interested in development that involves the maven-eclipse-plugin,
I created a series of tutorials (80+) a few months ago that cover Java
development using Eclipse and Maven. The main approach using this technique
is to execute maven commands on projects via Eclipse external tool
configurations (so that you can click on a project and run a maven goal on
that project). In this approach, Eclipse/Maven integration is very minimal
(you basically let maven be maven most of the time). Topics include Eclipse
user libraries, web applications, and a multi-module project. The tutorials
are located at:

http://www.avajava.com/tutorials/categories/maven
http://www.avajava.com/tutorials/categories/maven 

If you're interested in tightly integrated features rather than the bare
bones approach, the m2eclipse plugin is great. The ability to search for
classes and automatically add a dependency to your project in Eclipse is a
really fantastic feature.


Deron Eriksson


-- 
View this message in context: 
http://www.nabble.com/Using-maven-with-eclipse-tp21478705p21498725.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org



Re: Help for strange things about central repositiory

2009-01-03 Thread Deron Eriksson

Hi Jack,

I think you may be on the right track. I experienced a similar issue after
installing Norton Internet Security a year or two ago, since Norton's
firewall was preventing mvn and mvn.bat from contacting the central repo.
Usually Norton prompts you when it blocks a program, but it didn't in this
case for me, which made it surprisingly difficult to figure out. I needed to
go into the Norton settings and unblock maven.

In addition, if you're running Windows Vista, you might want to go into the
Vista firewall settings and see if the solution is in there. Like Norton,
Windows Vista's firewall normally asks you if you want to block or allow a
program's communication when it first occurs, but it doesn't always do this.

Deron Eriksson


Jinyuan Zhou-3 wrote:
> 
> Got hint from this thread
> http://www.mail-archive.com/users@maven.apache.org/msg69753.html and I am
> going to look at my fire wall setting.
> Thanks  and Happy New Year,
> Jack
> 
> On Fri, Jan 2, 2009 at 9:49 AM, Jinyuan Zhou 
> wrote:
> 
>> Hi there,
>> I suddenly cannot run mvn command at one of my home computer. The "root"
>> cause is that the very 'org.apache.maven.plugins'  cannot be downloaded. 
>> I
>> know it is not the central repository that has the problem. I was able to
>> run this on other computer at home.  It doesn't seem that  my isp is
>> blocking me. I m copying the output when I run* mvn -v* and the  comand
>> from tutorial *mvn archetype:create -DgroupId=com.mycompany.app
>> -DartifactId=my-a*pp
>>
> 
> 

-- 
View this message in context: 
http://www.nabble.com/Help-for-strange-things-about-central-repositiory-tp21254722p21270709.html
Sent from the Maven - Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org