Re: [all] releasing IO 2.1 - sync with Maven Central
On Sun, Oct 9, 2011 at 8:07 PM, sebb seb...@gmail.com wrote: On 9 October 2011 18:41, Gary Gregory garydgreg...@gmail.com wrote: I am inching toward success... Friday, I released 2.1 to repository.apache.org and I can see it: https://repository.apache.org/index.html#nexus-search;quick~commons-io I am confused by what is on Maven Central: http://search.maven.org/#search%7Cga%7C1%7Ccommons-io The first line also says all (12) - click that link, and you see all the versions. No 2.0, no 2.0.1, no 2.1 But it is here: http://repo1.maven.org/maven2/commons-io/commons-io/ That's correct, apart from the directory http://repo1.maven.org/maven2/commons-io/commons-io/20030203.000550/ which is rather odd; I don't see why that should be there. Looks like a snapshot version got lost and ended up in the wrong repo. Uh? I'll raise a bug report with Central. Recent commons-codec releases do not even show up when you do a MC search. Yes, they do - see all (6) - same problem as with commons-io. I'll raise another issue. This post [1] talks about a rsync script. Does it need to do something else for MC searches? Where is the [1] reference? Got it: https://mail-archives.apache.org/mod_mbox/www-repository/201104.mbox/%3C559124503093306359@unknownmsgid%3E Gary Thank you, Gary On Fri, Oct 7, 2011 at 2:00 PM, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 1:46 PM, sebb seb...@gmail.com wrote: On 7 October 2011 16:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 8:51 AM, sebb seb...@gmail.com wrote: On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). Yes please. :( It's this kind of ridiculous hoop jumping that makes me put this task on the back burner, the one that's in the shed, deep in the woods. Problem seems to be that the Nexus server has a robots.txt which does not allow downloads from that directory. The following works for me: wget -r -l 1 -np -nH -nd -nv -e robots=off --wait 10 --no-check-certificate URL Thank you! It's now downloading. I'll update the Wiki... Gary -r recursive -l 1 1 level -np no parent -nH don't create host directories -nd don't create directories -nv quiet -e robots=off ignore robots.txt --wait 10 wait between retrievals Gary wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28
[all] releasing IO 2.1 - sync with Maven Central
I am inching toward success... Friday, I released 2.1 to repository.apache.org and I can see it: https://repository.apache.org/index.html#nexus-search;quick~commons-io I am confused by what is on Maven Central: http://search.maven.org/#search%7Cga%7C1%7Ccommons-io No 2.0, no 2.0.1, no 2.1 But it is here: http://repo1.maven.org/maven2/commons-io/commons-io/ Uh? Recent commons-codec releases do not even show up when you do a MC search. This post [1] talks about a rsync script. Does it need to do something else for MC searches? Thank you, Gary On Fri, Oct 7, 2011 at 2:00 PM, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 1:46 PM, sebb seb...@gmail.com wrote: On 7 October 2011 16:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 8:51 AM, sebb seb...@gmail.com wrote: On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). Yes please. :( It's this kind of ridiculous hoop jumping that makes me put this task on the back burner, the one that's in the shed, deep in the woods. Problem seems to be that the Nexus server has a robots.txt which does not allow downloads from that directory. The following works for me: wget -r -l 1 -np -nH -nd -nv -e robots=off --wait 10 --no-check-certificate URL Thank you! It's now downloading. I'll update the Wiki... Gary -r recursive -l 1 1 level -np no parent -nH don't create host directories -nd don't create directories -nv quiet -e robots=off ignore robots.txt --wait 10 wait between retrievals Gary wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28 MB/s) - `repository.apache.org/robots.txt' saved [86] FINISHED --2011-10-07 12:41:31-- Downloaded: 2 files, 27K in 0.001s (22.3 MB/s) Gary I used to use the grab_releases.sh script in committers/tools/releases/, but it's based on the Apache web server autoindex and needs changing to work with Nexus' format. Hen On Thu, Oct 6, 2011 at 5:58 PM, Gary Gregory garydgreg...@gmail.com wrote: Hi All, The instruction on https://wiki.apache.org/commons/UsingNexussay: wget -np -r https://repository.apache.org/content/repositories/orgapachecommons-098/org/apache/commons/commons-foo/1.1/ Which for IO 2.1 means: wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ When I do that from my home dir on p.a.o I get the index.html
Re: [all] releasing IO 2.1 - sync with Maven Central
On 9 October 2011 18:41, Gary Gregory garydgreg...@gmail.com wrote: I am inching toward success... Friday, I released 2.1 to repository.apache.org and I can see it: https://repository.apache.org/index.html#nexus-search;quick~commons-io I am confused by what is on Maven Central: http://search.maven.org/#search%7Cga%7C1%7Ccommons-io The first line also says all (12) - click that link, and you see all the versions. No 2.0, no 2.0.1, no 2.1 But it is here: http://repo1.maven.org/maven2/commons-io/commons-io/ That's correct, apart from the directory http://repo1.maven.org/maven2/commons-io/commons-io/20030203.000550/ which is rather odd; I don't see why that should be there. Looks like a snapshot version got lost and ended up in the wrong repo. Uh? I'll raise a bug report with Central. Recent commons-codec releases do not even show up when you do a MC search. Yes, they do - see all (6) - same problem as with commons-io. I'll raise another issue. This post [1] talks about a rsync script. Does it need to do something else for MC searches? Where is the [1] reference? Thank you, Gary On Fri, Oct 7, 2011 at 2:00 PM, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 1:46 PM, sebb seb...@gmail.com wrote: On 7 October 2011 16:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 8:51 AM, sebb seb...@gmail.com wrote: On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). Yes please. :( It's this kind of ridiculous hoop jumping that makes me put this task on the back burner, the one that's in the shed, deep in the woods. Problem seems to be that the Nexus server has a robots.txt which does not allow downloads from that directory. The following works for me: wget -r -l 1 -np -nH -nd -nv -e robots=off --wait 10 --no-check-certificate URL Thank you! It's now downloading. I'll update the Wiki... Gary -r recursive -l 1 1 level -np no parent -nH don't create host directories -nd don't create directories -nv quiet -e robots=off ignore robots.txt --wait 10 wait between retrievals Gary wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28 MB/s) - `repository.apache.org/robots.txt' saved [86] FINISHED --2011-10-07 12:41:31-- Downloaded: 2 files, 27K in 0.001s (22.3 MB/s) Gary I used to use the grab_releases.sh script in committers/tools/releases/, but it's based on the Apache web server autoindex and needs changing to work with Nexus' format.
Re: [all] releasing IO 2.1 - sync with Maven Central
On Sun, Oct 9, 2011 at 8:07 PM, sebb seb...@gmail.com wrote: On 9 October 2011 18:41, Gary Gregory garydgreg...@gmail.com wrote: I am inching toward success... Friday, I released 2.1 to repository.apache.org and I can see it: https://repository.apache.org/index.html#nexus-search;quick~commons-io I am confused by what is on Maven Central: http://search.maven.org/#search%7Cga%7C1%7Ccommons-io The first line also says all (12) - click that link, and you see all the versions. No 2.0, no 2.0.1, no 2.1 But it is here: http://repo1.maven.org/maven2/commons-io/commons-io/ That's correct, apart from the directory http://repo1.maven.org/maven2/commons-io/commons-io/20030203.000550/ which is rather odd; I don't see why that should be there. Looks like a snapshot version got lost and ended up in the wrong repo. Uh? I'll raise a bug report with Central. Recent commons-codec releases do not even show up when you do a MC search. Yes, they do - see all (6) - same problem as with commons-io. I'll raise another issue. This post [1] talks about a rsync script. Does it need to do something else for MC searches? Where is the [1] reference? Thank you for the digging. Crud, now I cannot reproduce the Google search that found the ML post. It said something like there was a problem with our rsync script because it did not take into account the fact that the project (Codec probably) has been set up for Nexus Gary Thank you, Gary On Fri, Oct 7, 2011 at 2:00 PM, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 1:46 PM, sebb seb...@gmail.com wrote: On 7 October 2011 16:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 8:51 AM, sebb seb...@gmail.com wrote: On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). Yes please. :( It's this kind of ridiculous hoop jumping that makes me put this task on the back burner, the one that's in the shed, deep in the woods. Problem seems to be that the Nexus server has a robots.txt which does not allow downloads from that directory. The following works for me: wget -r -l 1 -np -nH -nd -nv -e robots=off --wait 10 --no-check-certificate URL Thank you! It's now downloading. I'll update the Wiki... Gary -r recursive -l 1 1 level -np no parent -nH don't create host directories -nd don't create directories -nv quiet -e robots=off ignore robots.txt --wait 10 wait between retrievals Gary wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length:
Re: [all] releasing IO 2.1 - sync with Maven Central
On Oct 9, 2011, at 20:50, sebb seb...@gmail.com wrote: On 10 October 2011 01:31, Gary Gregory garydgreg...@gmail.com wrote: On Sun, Oct 9, 2011 at 8:07 PM, sebb seb...@gmail.com wrote: On 9 October 2011 18:41, Gary Gregory garydgreg...@gmail.com wrote: I am inching toward success... Friday, I released 2.1 to repository.apache.org and I can see it: https://repository.apache.org/index.html#nexus-search;quick~commons-io I am confused by what is on Maven Central: http://search.maven.org/#search%7Cga%7C1%7Ccommons-io The first line also says all (12) - click that link, and you see all the versions. No 2.0, no 2.0.1, no 2.1 But it is here: http://repo1.maven.org/maven2/commons-io/commons-io/ That's correct, apart from the directory http://repo1.maven.org/maven2/commons-io/commons-io/20030203.000550/ which is rather odd; I don't see why that should be there. Looks like a snapshot version got lost and ended up in the wrong repo. Uh? I'll raise a bug report with Central. Recent commons-codec releases do not even show up when you do a MC search. Yes, they do - see all (6) - same problem as with commons-io. I'll raise another issue. Raised: (MVNCENTRAL-126) Spurious entry in commons-io (MVNCENTRAL-127) Spurious entry in commons-codec Then I noticed that loads of commons directories have been affected, so I raised (MVNCENTRAL-128) Huge mess in commons directories Looks like something went horribly wrong at 04-Jan-2007 19:17 because all the spurious entries I have seen are dated then. MVNCENTRAL-126 has already been closed as Won't FIx (usual mantra about not being able to change anything that has been published), but in this case it looks as though the publishing was not intentional, so I hope they will actually clear up the mess. Thank you for slogging through this mess. Gary - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org
Re: [all] releasing IO 2.1
On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28 MB/s) - `repository.apache.org/robots.txt' saved [86] FINISHED --2011-10-07 12:41:31-- Downloaded: 2 files, 27K in 0.001s (22.3 MB/s) Gary I used to use the grab_releases.sh script in committers/tools/releases/, but it's based on the Apache web server autoindex and needs changing to work with Nexus' format. Hen On Thu, Oct 6, 2011 at 5:58 PM, Gary Gregory garydgreg...@gmail.com wrote: Hi All, The instruction on https://wiki.apache.org/commons/UsingNexus say: wget -np -r https://repository.apache.org/content/repositories/orgapachecommons-098/org/apache/commons/commons-foo/1.1/ Which for IO 2.1 means: wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ When I do that from my home dir on p.a.o I get the index.html and that's it. uh? Are these instructions up to date? -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory
Re: [all] releasing IO 2.1
On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28 MB/s) - `repository.apache.org/robots.txt' saved [86] FINISHED --2011-10-07 12:41:31-- Downloaded: 2 files, 27K in 0.001s (22.3 MB/s) Gary I used to use the grab_releases.sh script in committers/tools/releases/, but it's based on the Apache web server autoindex and needs changing to work with Nexus' format. Hen On Thu, Oct 6, 2011 at 5:58 PM, Gary Gregory garydgreg...@gmail.com wrote: Hi All, The instruction on https://wiki.apache.org/commons/UsingNexus say: wget -np -r https://repository.apache.org/content/repositories/orgapachecommons-098/org/apache/commons/commons-foo/1.1/ Which for IO 2.1 means: wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ When I do that from my home dir on p.a.o I get the index.html and that's it. uh? Are these instructions up to date? -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org
Re: [all] releasing IO 2.1
On Fri, Oct 7, 2011 at 8:51 AM, sebb seb...@gmail.com wrote: On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). Yes please. :( It's this kind of ridiculous hoop jumping that makes me put this task on the back burner, the one that's in the shed, deep in the woods. Gary wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28 MB/s) - `repository.apache.org/robots.txt' saved [86] FINISHED --2011-10-07 12:41:31-- Downloaded: 2 files, 27K in 0.001s (22.3 MB/s) Gary I used to use the grab_releases.sh script in committers/tools/releases/, but it's based on the Apache web server autoindex and needs changing to work with Nexus' format. Hen On Thu, Oct 6, 2011 at 5:58 PM, Gary Gregory garydgreg...@gmail.com wrote: Hi All, The instruction on https://wiki.apache.org/commons/UsingNexus say: wget -np -r https://repository.apache.org/content/repositories/orgapachecommons-098/org/apache/commons/commons-foo/1.1/ Which for IO 2.1 means: wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ When I do that from my home dir on p.a.o I get the index.html and that's it. uh? Are these instructions up to date? -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet!
Re: [all] releasing IO 2.1
On 7 October 2011 16:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 8:51 AM, sebb seb...@gmail.com wrote: On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). Yes please. :( It's this kind of ridiculous hoop jumping that makes me put this task on the back burner, the one that's in the shed, deep in the woods. Problem seems to be that the Nexus server has a robots.txt which does not allow downloads from that directory. The following works for me: wget -r -l 1 -np -nH -nd -nv -e robots=off --wait 10 --no-check-certificate URL -r recursive -l 1 1 level -np no parent -nH don't create host directories -nd don't create directories -nv quiet -e robots=off ignore robots.txt --wait 10 wait between retrievals Gary wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28 MB/s) - `repository.apache.org/robots.txt' saved [86] FINISHED --2011-10-07 12:41:31-- Downloaded: 2 files, 27K in 0.001s (22.3 MB/s) Gary I used to use the grab_releases.sh script in committers/tools/releases/, but it's based on the Apache web server autoindex and needs changing to work with Nexus' format. Hen On Thu, Oct 6, 2011 at 5:58 PM, Gary Gregory garydgreg...@gmail.com wrote: Hi All, The instruction on https://wiki.apache.org/commons/UsingNexus say: wget -np -r https://repository.apache.org/content/repositories/orgapachecommons-098/org/apache/commons/commons-foo/1.1/ Which for IO 2.1 means: wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ When I do that from my home dir on p.a.o I get the index.html and that's it. uh? Are these instructions up to date? -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOqhttp://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet!
Re: [all] releasing IO 2.1
On Fri, Oct 7, 2011 at 1:46 PM, sebb seb...@gmail.com wrote: On 7 October 2011 16:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 8:51 AM, sebb seb...@gmail.com wrote: On 7 October 2011 13:44, Gary Gregory garydgreg...@gmail.com wrote: On Fri, Oct 7, 2011 at 2:01 AM, Henri Yandell flame...@gmail.com wrote: wget doesn't seem to like the url. curl is happy to do it, but it doesn't do -r afaik. Here is what I get with wget. How do I make it get the embedded URLs? I don't care if it's curl, wget, or foobar, I just want instructions that work. After figuring out all the Maven nonsense, now this. Sigh. It's easy enough to loop around the non-Maven files in the directory if you cannot get the index parsing to work. Or even use Lynx on p.a.o and browse to the directory, and download from there. If you cannot get it to work, let me know and I can help later (about to be busy). Yes please. :( It's this kind of ridiculous hoop jumping that makes me put this task on the back burner, the one that's in the shed, deep in the woods. Problem seems to be that the Nexus server has a robots.txt which does not allow downloads from that directory. The following works for me: wget -r -l 1 -np -nH -nd -nv -e robots=off --wait 10 --no-check-certificate URL Thank you! It's now downloading. I'll update the Wiki... Gary -r recursive -l 1 1 level -np no parent -nH don't create host directories -nd don't create directories -nv quiet -e robots=off ignore robots.txt --wait 10 wait between retrievals Gary wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ --2011-10-07 12:41:31-- https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ Resolving repository.apache.org... 140.211.11.57 Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' [ = ] 27,475 --.-K/s in 0.001s 2011-10-07 12:41:31 (22.9 MB/s) - ` repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/index.html ' saved [27475] Loading robots.txt; please ignore errors. --2011-10-07 12:41:31-- https://repository.apache.org/robots.txt Connecting to repository.apache.org|140.211.11.57|:443... connected. WARNING: cannot verify repository.apache.org's certificate, issued by `/C=US/ST=Arizona/L=Scottsdale/O=GoDaddy.com, Inc./OU= http://certificates.godaddy.com/repo sitory/CN=Go Daddy Secure Certification Authority/serialNumber=07969287': Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/plain] Saving to: `repository.apache.org/robots.txt' [ = ] 86 --.-K/s in 0s 2011-10-07 12:41:31 (2.28 MB/s) - `repository.apache.org/robots.txt' saved [86] FINISHED --2011-10-07 12:41:31-- Downloaded: 2 files, 27K in 0.001s (22.3 MB/s) Gary I used to use the grab_releases.sh script in committers/tools/releases/, but it's based on the Apache web server autoindex and needs changing to work with Nexus' format. Hen On Thu, Oct 6, 2011 at 5:58 PM, Gary Gregory garydgreg...@gmail.com wrote: Hi All, The instruction on https://wiki.apache.org/commons/UsingNexus say: wget -np -r https://repository.apache.org/content/repositories/orgapachecommons-098/org/apache/commons/commons-foo/1.1/ Which for IO 2.1 means: wget -np -r --no-check-certificate https://repository.apache.org/content/repositories/orgapachecommons-027/commons-io/commons-io/2.1/ When I do that from my home dir on p.a.o I get the index.html and that's it. uh? Are these instructions up to date? -- E-Mail: garydgreg...@gmail.com | ggreg...@apache.org JUnit in Action, 2nd Ed: http://goog_1249600977 http://bit.ly/ECvg0 Spring Batch in Action: http://s.apache.org/HOq http://bit.ly/bqpbCK Blog: http://garygregory.wordpress.com Home: http://garygregory.com/ Tweet! http://twitter.com/GaryGregory - To unsubscribe, e-mail: dev-unsubscr...@commons.apache.org For additional commands, e-mail: dev-h...@commons.apache.org -- E-Mail: