[htdig] ssl patch for ht://dig
Hi I'm trying to get this ssl patch to work. I finally installed all the patch, but now I'm getting an error when compiling. Server.cc: In method `Server::Server(char *, int, int, StringList * = 0)': Server.cc:44: passing `const char *' as argument 1 of `String::operator =(char *)' discards qua lifiers make[1]: *** [Server.o] Error 1 make[1]: Leaving directory `/tmp/work/htdig-3.1.5/htdig' make: *** [all] Error 1 This is a line that was modified by the patch. Here is the excert from Server.cc // // Attempt to get a robots.txt file from the specified server // String url; url = ssl ? "https://" : "http://"; this is where it's getting an error url host ':' port "/robots.txt"; Documentdoc(url, 0); static int local_urls_only = config.Boolean("local_urls_only"); time_t timeZero = 0; Document::DocStatus status; Here's the diff @@ -40,7 +40,8 @@ // // Attempt to get a robots.txt file from the specified server // -String url = "http://"; +String url; +url = ssl ? "https://" : "http://"; url host ':' port "/robots.txt"; Document doc(url, 0); Any ideas?? Thanks in advance Jeremy begin:vcard n:Lyon;Jeremy tel;pager:303-899-9178 tel;work:303-624-4226 x-mozilla-html:FALSE org:Qwest;Information Technologies version:2.1 email;internet:[EMAIL PROTECTED] title:Associate IT Specialist adr;quoted-printable:;;1515 Arapahoe=0D=0ATower 1=0D=0AFlr 9;Denver;Colorado;80202; fn:Jeremy Lyon end:vcard To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: http://www.htdig.org/mail/menu.html FAQ:http://www.htdig.org/FAQ.html
Re: [htdig] ssl patch for ht://dig
Gilles, Thank you so much. That worked. Now I have a new problem. I am indexing from the local file system. Now when I do a search everything works fine except the urls that are returned for the ssl sites appear like this. http://ecom.uswest:443/path It's storing as a regular http:// instead of https:// and it's cutting off the .com. Any ideas. Thanks Jeremy Gilles Detillieux wrote: According to Jeremy Lyon: I'm trying to get this ssl patch to work. I finally installed all the patch, but now I'm getting an error when compiling. Server.cc: In method `Server::Server(char *, int, int, StringList * = 0)': Server.cc:44: passing `const char *' as argument 1 of `String::operator =(char *)' discards qualifiers make[1]: *** [Server.o] Error 1 make[1]: Leaving directory `/tmp/work/htdig-3.1.5/htdig' make: *** [all] Error 1 This is a line that was modified by the patch. Here is the excert from Server.cc // // Attempt to get a robots.txt file from the specified server // String url; url = ssl ? "https://" : "http://"; this is where it's getting an error url host ':' port "/robots.txt"; Documentdoc(url, 0); static int local_urls_only = config.Boolean("local_urls_only"); time_t timeZero = 0; Document::DocStatus status; Here's the diff @@ -40,7 +40,8 @@ // // Attempt to get a robots.txt file from the specified server // -String url = "http://"; +String url; +url = ssl ? "https://" : "http://"; url host ':' port "/robots.txt"; Document doc(url, 0); Any ideas?? I'd try the following construct to see if it would keep your compiler happy: String url = "http://"; if (ssl) url = "https://"; This seems to be a compiler bug to me, as there shouldn't be a difference in the type of a single string literal or a ternary operator with two string literals as result. We have had reports before of some C++ compilers choking on ternary operators, though, so we have tried to use them sparingly. -- Gilles R. Detillieux E-mail: [EMAIL PROTECTED] Spinal Cord Research Centre WWW:http://www.scrc.umanitoba.ca/~grdetil Dept. Physiology, U. of Manitoba Phone: (204)789-3766 Winnipeg, MB R3E 3J7 (Canada) Fax:(204)789-3930 begin:vcard n:Lyon;Jeremy tel;pager:303-899-9178 tel;work:303-624-4226 x-mozilla-html:FALSE org:Qwest;Information Technologies version:2.1 email;internet:[EMAIL PROTECTED] title:Associate IT Specialist adr;quoted-printable:;;1515 Arapahoe=0D=0ATower 1=0D=0AFlr 9;Denver;Colorado;80202; fn:Jeremy Lyon end:vcard To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: http://www.htdig.org/mail/menu.html FAQ:http://www.htdig.org/FAQ.html
Re: [htdig] Problem using local_urls
I got it working. I had to remove the old database and make a new one. Thanks Gilles Detillieux wrote: According to Jeremy Lyon: I am running htdig 3.1.5 and I'm trying to use local_urls. It seems to be working fine, except it is not crawling through the pages. I only get the index.html. Any ideas??? Here is my conf file. local_urls: https://ecom.uswest.com/redaction/test/=/apps/redaction/current /docs/test/ local_urls_only:true start_url: `/export/web/esearch/current/sites/ecom/redaction/site.lst` #limit_urls_to: `/export/web/esearch/current/sites/ecom/redaction/site.lst` limit_normalized: .uswest.com .uswest.net .qwest.com .qwest.net I assume this was because you were trying to use https URLs before applying the SSL patch. I don't know how well the SSL patch fits in with the local_urls handling, but theoretically the two should be pretty independent of each other. -- Gilles R. Detillieux E-mail: [EMAIL PROTECTED] Spinal Cord Research Centre WWW:http://www.scrc.umanitoba.ca/~grdetil Dept. Physiology, U. of Manitoba Phone: (204)789-3766 Winnipeg, MB R3E 3J7 (Canada) Fax:(204)789-3930 begin:vcard n:Lyon;Jeremy tel;pager:303-899-9178 tel;work:303-624-4226 x-mozilla-html:FALSE org:Qwest;Information Technologies version:2.1 email;internet:[EMAIL PROTECTED] title:Associate IT Specialist adr;quoted-printable:;;1515 Arapahoe=0D=0ATower 1=0D=0AFlr 9;Denver;Colorado;80202; fn:Jeremy Lyon end:vcard To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: http://www.htdig.org/mail/menu.html FAQ:http://www.htdig.org/FAQ.html
[htdig] Problem using local_urls
Hi I am running htdig 3.1.5 and I'm trying to use local_urls. It seems to be working fine, except it is not crawling through the pages. I only get the index.html. Any ideas??? Here is my conf file. local_urls: https://ecom.uswest.com/redaction/test/=/apps/redaction/current /docs/test/ local_urls_only:true start_url: `/export/web/esearch/current/sites/ecom/redaction/site.lst` #limit_urls_to: `/export/web/esearch/current/sites/ecom/redaction/site.lst` limit_normalized: .uswest.com .uswest.net .qwest.com .qwest.net Thanks Jeremy begin:vcard n:Lyon;Jeremy tel;pager:303-899-9178 tel;work:303-624-4226 x-mozilla-html:FALSE org:Qwest;Information Technologies version:2.1 email;internet:[EMAIL PROTECTED] title:Associate IT Specialist adr;quoted-printable:;;1515 Arapahoe=0D=0ATower 1=0D=0AFlr 9;Denver;Colorado;80202; fn:Jeremy Lyon end:vcard To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: http://www.htdig.org/mail/menu.html FAQ:http://www.htdig.org/FAQ.html
[htdig] ssl patch
Hi I just tried to patch htdig 3.1.5 with the ssl patch ftp://ftp.ccsf.org/htdig-patches/3.1.5/ssl.2 to a clean htdig. I got these errors root:/tmp/work/htdig-3.1.5# patch -p1 ../ssl.2 patching file `CONFIG' Hunk #1 FAILED at 8. 1 out of 1 hunk FAILED -- saving rejects to CONFIG.rej patching file `Makefile.config.in' Hunk #1 FAILED at 24. 1 out of 1 hunk FAILED -- saving rejects to Makefile.config.in.rej patching file `htcommon/DocumentDB.cc' Hunk #1 FAILED at 217. Hunk #2 FAILED at 284. 2 out of 2 hunks FAILED -- saving rejects to htcommon/DocumentDB.cc.rej patching file `htcommon/defaults.cc' Hunk #1 FAILED at 38. 1 out of 1 hunk FAILED -- saving rejects to htcommon/defaults.cc.rej patching file `htdig/Document.cc' Hunk #1 FAILED at 220. Hunk #2 FAILED at 332. 2 out of 2 hunks FAILED -- saving rejects to htdig/Document.cc.rej patching file `htdig/Images.cc' Hunk #1 FAILED at 61. Hunk #2 FAILED at 81. 2 out of 2 hunks FAILED -- saving rejects to htdig/Images.cc.rej patching file `htdig/Retriever.cc' Hunk #1 FAILED at 117. Hunk #2 FAILED at 132. Hunk #3 FAILED at 668. Hunk #4 FAILED at 1232. Hunk #5 FAILED at 1365. 5 out of 5 hunks FAILED -- saving rejects to htdig/Retriever.cc.rej patching file `htdig/Server.cc' Hunk #1 FAILED at 20. Hunk #2 FAILED at 40. 2 out of 2 hunks FAILED -- saving rejects to htdig/Server.cc.rej patching file `htdig/Server.h' Hunk #1 FAILED at 26. 1 out of 1 hunk FAILED -- saving rejects to htdig/Server.h.rej patching file `htlib/Connection.cc' Hunk #1 FAILED at 39. Hunk #2 FAILED at 53. Hunk #3 FAILED at 94. Hunk #4 FAILED at 119. Hunk #5 FAILED at 174. Hunk #6 FAILED at 251. Hunk #7 FAILED at 281. Hunk #8 FAILED at 426. Hunk #9 FAILED at 469. 9 out of 9 hunks FAILED -- saving rejects to htlib/Connection.cc.rej patching file `htlib/Connection.h' Hunk #1 FAILED at 36. Hunk #2 FAILED at 53. Hunk #3 FAILED at 73. Hunk #4 FAILED at 102. 4 out of 4 hunks FAILED -- saving rejects to htlib/Connection.h.rej patching file `htlib/URL.cc' Hunk #1 FAILED at 130. Hunk #2 FAILED at 223. Hunk #3 FAILED at 492. Hunk #4 FAILED at 549. 4 out of 4 hunks FAILED -- saving rejects to htlib/URL.cc.rej patching file `htlib/URL.h' Hunk #1 FAILED at 48. 1 out of 1 hunk FAILED -- saving rejects to htlib/URL.h.rej Am I doing something wrong??? Thanks begin:vcard n:Lyon;Jeremy tel;pager:303-899-9178 tel;work:303-624-4226 x-mozilla-html:FALSE org:Qwest;Information Technologies version:2.1 email;internet:[EMAIL PROTECTED] title:Associate IT Specialist adr;quoted-printable:;;1515 Arapahoe=0D=0ATower 1=0D=0AFlr 9;Denver;Colorado;80202; fn:Jeremy Lyon end:vcard To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: http://www.htdig.org/mail/menu.html FAQ:http://www.htdig.org/FAQ.html
Re: [htdig] ssl patch
tried that and got the same errors Joshua Gerth wrote: Add the -l flag to patch. I guess there is a white space issue. Joshua I just tried to patch htdig 3.1.5 with the ssl patch ftp://ftp.ccsf.org/htdig-patches/3.1.5/ssl.2 to a clean htdig. I got these errors root:/tmp/work/htdig-3.1.5# patch -p1 ../ssl.2 patching file `CONFIG' Hunk #1 FAILED at 8. 1 out of 1 hunk FAILED -- saving rejects to CONFIG.rej patching file `Makefile.config.in' Hunk #1 FAILED at 24. 1 out of 1 hunk FAILED -- saving rejects to Makefile.config.in.rej patching file `htcommon/DocumentDB.cc' Hunk #1 FAILED at 217. Hunk #2 FAILED at 284. 2 out of 2 hunks FAILED -- saving rejects to htcommon/DocumentDB.cc.rej patching file `htcommon/defaults.cc' Hunk #1 FAILED at 38. 1 out of 1 hunk FAILED -- saving rejects to htcommon/defaults.cc.rej patching file `htdig/Document.cc' Hunk #1 FAILED at 220. Hunk #2 FAILED at 332. 2 out of 2 hunks FAILED -- saving rejects to htdig/Document.cc.rej patching file `htdig/Images.cc' Hunk #1 FAILED at 61. Hunk #2 FAILED at 81. 2 out of 2 hunks FAILED -- saving rejects to htdig/Images.cc.rej patching file `htdig/Retriever.cc' Hunk #1 FAILED at 117. Hunk #2 FAILED at 132. Hunk #3 FAILED at 668. Hunk #4 FAILED at 1232. Hunk #5 FAILED at 1365. 5 out of 5 hunks FAILED -- saving rejects to htdig/Retriever.cc.rej patching file `htdig/Server.cc' Hunk #1 FAILED at 20. Hunk #2 FAILED at 40. 2 out of 2 hunks FAILED -- saving rejects to htdig/Server.cc.rej patching file `htdig/Server.h' Hunk #1 FAILED at 26. 1 out of 1 hunk FAILED -- saving rejects to htdig/Server.h.rej patching file `htlib/Connection.cc' Hunk #1 FAILED at 39. Hunk #2 FAILED at 53. Hunk #3 FAILED at 94. Hunk #4 FAILED at 119. Hunk #5 FAILED at 174. Hunk #6 FAILED at 251. Hunk #7 FAILED at 281. Hunk #8 FAILED at 426. Hunk #9 FAILED at 469. 9 out of 9 hunks FAILED -- saving rejects to htlib/Connection.cc.rej patching file `htlib/Connection.h' Hunk #1 FAILED at 36. Hunk #2 FAILED at 53. Hunk #3 FAILED at 73. Hunk #4 FAILED at 102. 4 out of 4 hunks FAILED -- saving rejects to htlib/Connection.h.rej patching file `htlib/URL.cc' Hunk #1 FAILED at 130. Hunk #2 FAILED at 223. Hunk #3 FAILED at 492. Hunk #4 FAILED at 549. 4 out of 4 hunks FAILED -- saving rejects to htlib/URL.cc.rej patching file `htlib/URL.h' Hunk #1 FAILED at 48. 1 out of 1 hunk FAILED -- saving rejects to htlib/URL.h.rej Am I doing something wrong??? Thanks begin:vcard n:Lyon;Jeremy tel;pager:303-899-9178 tel;work:303-624-4226 x-mozilla-html:FALSE org:Qwest;Information Technologies version:2.1 email;internet:[EMAIL PROTECTED] title:Associate IT Specialist adr;quoted-printable:;;1515 Arapahoe=0D=0ATower 1=0D=0AFlr 9;Denver;Colorado;80202; fn:Jeremy Lyon end:vcard To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: http://www.htdig.org/mail/menu.html FAQ:http://www.htdig.org/FAQ.html
[htdig] Digital Certificates
Hello all, I was wondering, can htdig use a browser (client) digital certificate to dig a site?? Thanks in advance Jeremy begin:vcard n:Lyon;Jeremy tel;pager:303-899-9178 tel;work:303-624-4226 x-mozilla-html:FALSE org:Qwest;Information Technologies version:2.1 email;internet:[EMAIL PROTECTED] title:Associate IT Specialist adr;quoted-printable:;;1515 Arapahoe=0D=0ATower 1=0D=0AFlr 9;Denver;Colorado;80202; fn:Jeremy Lyon end:vcard To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: http://www.htdig.org/mail/menu.html FAQ:http://www.htdig.org/FAQ.html