Andrew M. Bishop <[EMAIL PROTECTED]> wrote: AMB> Morten Bo Johansen <[EMAIL PROTECTED]> writes:
>> Andrew M. Bishop <[EMAIL PROTECTED]> wrote: > AMB>> No it does not, and rightly so since doing it this way will not add a > AMB>> User-Agent field which imdb expects. The wwwoffle program does not > AMB>> add in a User-Agent of its own. The CensorHeader section of the > AMB>> configuration file only censors existing headers, it does not add > AMB>> headers of its own. >> >> When speaking of your TODO-list, I suppose there would no chance >> of adding a little tweak to wwwoffle that would let one send >> customized headers on a url-configurable basis? AMB> You mean the option to add a header that is not already in the request AMB> (rather than modifying an existing header like CensorHeader does)? Yes, that's what I had in mind. AMB> This is complicated by the fact that the CensorHeader options already AMB> exist. How should this new option interact with the existing AMB> CensorHeader option? AMB> 1) The headers are censored and then new ones added? AMB> 2) The headers are added and then censored? AMB> 3) The headers are censored and then new ones added only if they don't AMB> duplicate existing ones (e.g. disallow two User-Agent headers even AMB> if they are different)? AMB> 4) The headers are added only if they don't duplicate existing ones AMB> and then censored? AMB> We don't want to end up with a situation where WWWOFFLE adds a header AMB> when there is already one from the browser if it is not legal to have AMB> more than one header of that type. You may find that imdb.com will AMB> reject a request with duplicate User-Agent headers. All right, I can see that perhaps it's not possible. In case you were to consider it at all, then you might (if possible) add a feature that made wwwoffle detect if the outgoing request was made from within a browser or not and only in the latter case add the header(s) that the user requested in wwwoffle.conf. I have defined a lot of small functions in my bashrc where I make wwwoffle register outgoing requests for information that I want from various sources and which I initiate from the command line: in casu, just writing e.g. 'actor bodil kjer' on the command line to have wwwoffle place an outgoing request for that actor with IMDb.com, fetch the page and enter browser to read it is obviously more convenient than having to open a browser, access the bookmark of a cached copy of IMDb's search page, find the text entry field on that page, enter text and press "submit", exit the browser, fetch the page, enter the browser again to read it. Regards, Morten -- "In film you will find four basic story lines. Man versus man, man versus nature, nature versus nature, and dog versus vampire."
