Re: dist download size

2009-09-21 Thread Chris Hostetter

: Agreed, it was just when I had time set aside based on my schedule. If you
: have the bandwidth now, go for it!

My bad ... i had this weird impression that you ment they shouldn't be 
addressed until the release process.

I used the bandwidth i had to work on SOLR-1449 -- i figure that can kill 
two birds: reduce the dist size by not needing to copy jars for the 
example, and make plugins easier to use.


-Hoss



Re: dist download size

2009-09-20 Thread Chris Hostetter

: The example contains the solr cell libs in both the DIH example and
: the normal example.
: At a minimum, the DIH example shouldn't include them.
: I think it's still up in the air if the normal example should include them.

i've just taken it as a given that having two copies of every third party 
jar for using in the example was a neccessary evil, but 3 copies (in two 
different examples) just pushed me over the edge and prevented me from 
sleeping, so i banged this out...
   https://issues.apache.org/jira/browse/SOLR-1449
...if we get enough eyeballs on it, it might be feasibleto commit prior to 
1.4

: --- javadoc 
: 55MB of Javadoc!  That's a bit heavy... esp when I imagine almost no
: one uses it.

that's 55MB uncompressed ... but docs compress realy well so i doubt it
contributes significantly to the download size (the maven jars of all the
docs add up to less then 3MB, and zip/tar compression should be
comparable)

It's tempting to say most solr users aren't java hackers and leave it 
out ... but it's still the only comprehensive documentation on the various 
types of plugins (QParsers, analysis factories, etc...) so i vote we leave 
it in (one way or another)


-Hoss



Re: dist download size

2009-09-20 Thread Chris Hostetter

:  Hoss listed a bunch of the issues (jars in dist that didn't need to be
:  there)
:  https://issues.apache.org/jira/browse/SOLR-1433
: 
: I figured I'd work through these when preparing the release.

I don't really understand what that means ... why wait until the last 
minute to clean stuff up?  the sooner we make improvements the more likely 
we are to notice inadvertant glitches (in the nightlies and eventual 
release candidates)

-Hoss



dist download size

2009-09-19 Thread Yonik Seeley
Our download is currently a 150MB zip file, and 233MB on disk!

$ du -s *
96  CHANGES.txt
80  LICENSE.txt
12  NOTICE.txt
8   README.txt
36  build.xml
1857client
20  common-build.xml
40554   contrib
48036   dist
55620   docs
76214   example
3200lib
7554src

Hoss listed a bunch of the issues (jars in dist that didn't need to be there)
https://issues.apache.org/jira/browse/SOLR-1433

- solr cell ---
The example contains the solr cell libs in both the DIH example and
the normal example.
At a minimum, the DIH example shouldn't include them.
I think it's still up in the air if the normal example should include them.

--- javadoc 
55MB of Javadoc!  That's a bit heavy... esp when I imagine almost no
one uses it.
Should we create a compressed doc jar for this instead?
Point to an online version instead?
Note that dist also contains broken-out javadoc jars.
$ du -s dist/*docs*
60  dist/apache-solr-cell-docs-1.4-dev.jar
68  dist/apache-solr-clustering-docs-1.4-dev.jar
2212dist/apache-solr-core-docs-1.4-dev.jar
300 dist/apache-solr-dataimporthandler-docs-1.4-dev.jar
680 dist/apache-solr-solrj-docs-1.4-dev.jar

-Yonik
http://www.lucidimagination.com


Re: dist download size

2009-09-19 Thread Israel Ekpo
As you suggested, I think the javadoc should be removed and provided as a
separate download.

Developers and end users can also be pointed to the online documentation for
references and also where the downloadable javadoc can be found.

That could help

On Sat, Sep 19, 2009 at 10:12 AM, Yonik Seeley
yo...@lucidimagination.comwrote:

 Our download is currently a 150MB zip file, and 233MB on disk!

 $ du -s *
 96  CHANGES.txt
 80  LICENSE.txt
 12  NOTICE.txt
 8   README.txt
 36  build.xml
 1857client
 20  common-build.xml
 40554   contrib
 48036   dist
 55620   docs
 76214   example
 3200lib
 7554src

 Hoss listed a bunch of the issues (jars in dist that didn't need to be
 there)
 https://issues.apache.org/jira/browse/SOLR-1433

 - solr cell ---
 The example contains the solr cell libs in both the DIH example and
 the normal example.
 At a minimum, the DIH example shouldn't include them.
 I think it's still up in the air if the normal example should include them.

 --- javadoc 
 55MB of Javadoc!  That's a bit heavy... esp when I imagine almost no
 one uses it.
 Should we create a compressed doc jar for this instead?
 Point to an online version instead?
 Note that dist also contains broken-out javadoc jars.
 $ du -s dist/*docs*
 60  dist/apache-solr-cell-docs-1.4-dev.jar
 68  dist/apache-solr-clustering-docs-1.4-dev.jar
 2212dist/apache-solr-core-docs-1.4-dev.jar
 300 dist/apache-solr-dataimporthandler-docs-1.4-dev.jar
 680 dist/apache-solr-solrj-docs-1.4-dev.jar

 -Yonik
 http://www.lucidimagination.com




-- 
Good Enough is not good enough.
To give anything less than your best is to sacrifice the gift.
Quality First. Measure Twice. Cut Once.


Re: dist download size

2009-09-19 Thread Grant Ingersoll


On Sep 19, 2009, at 7:12 AM, Yonik Seeley wrote:


Our download is currently a 150MB zip file, and 233MB on disk!

$ du -s *
96  CHANGES.txt
80  LICENSE.txt
12  NOTICE.txt
8   README.txt
36  build.xml
1857client
20  common-build.xml
40554   contrib
48036   dist
55620   docs
76214   example
3200lib
7554src

Hoss listed a bunch of the issues (jars in dist that didn't need to  
be there)

https://issues.apache.org/jira/browse/SOLR-1433


I figured I'd work through these when preparing the release.



- solr cell ---
The example contains the solr cell libs in both the DIH example and
the normal example.
At a minimum, the DIH example shouldn't include them.
I think it's still up in the air if the normal example should  
include them.


--- javadoc 
55MB of Javadoc!  That's a bit heavy... esp when I imagine almost no
one uses it.
Should we create a compressed doc jar for this instead?
Point to an online version instead?


+1 to online version.  We can do like Lucene, etc. does and put up the  
versioned javadocs on the website.



Note that dist also contains broken-out javadoc jars.
$ du -s dist/*docs*
60  dist/apache-solr-cell-docs-1.4-dev.jar
68  dist/apache-solr-clustering-docs-1.4-dev.jar
2212dist/apache-solr-core-docs-1.4-dev.jar
300 dist/apache-solr-dataimporthandler-docs-1.4-dev.jar
680 dist/apache-solr-solrj-docs-1.4-dev.jar

-Yonik
http://www.lucidimagination.com