[Haskell-cafe] Haskell and SSL

[Thomas David Baker]

I'm writing an application that scrapes some data from some websites.  I was
using Network.Browser from http://haskell.org/http/.  So far, so good.
However, now I need to scrape some websites that use SSL.
Network.Browserdoesn't seem to support this (although for some reason
it does work on one
of the sites so maybe I'm getting this wrong).  Someone on #haskell pointed
me at hsgnutls which is an wrapper for parts of GNU TLS.  But I actually had
more success writing a wrapper around wget.  I know that darcs uses curl in
a similar way for some stuff but it still feels like I'm doing the Wrong
Thing.  Does anyone know of a Haskell library that does support scraping SSL
enabled web pages?  Or would adding it to Network.Browser be terribly
difficult?  Looking at GNU TLS it looks more complicated than I imagined.

Thanks in advance for your help,

Tom
___
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://www.haskell.org/mailman/listinfo/haskell-cafe

Re: [Haskell-cafe] Haskell and SSL

[Bryan O'Sullivan]

Thomas David Baker wrote:

I know that darcs uses curl in a similar way for some stuff but 
it still feels like I'm doing the Wrong Thing.


No, you're not.  SSL is very complicated, which is why there are no 
Haskell libraries that implement or usefully wrap it.


There's a proposal to write a decent curl wrapper for SOC, which would 
provide some level of SSL support.  We'll see where it goes.


b
___
Haskell-Cafe mailing list
Haskell-Cafe@haskell.org
http://www.haskell.org/mailman/listinfo/haskell-cafe