On Sunday, 19 February 2017 at 09:21:40 UTC, aberba wrote:
On Sunday, 19 February 2017 at 08:01:56 UTC, dummy wrote:
[...]
You can use any D lib with http GET support (Vibe.d[1]:
download, requests[2]) at code.dlang.org. arsd.dom[3] has dom
parsing support. or use any XML lib.
[1] http://code.dlang.org/packages/vibe-d
[2] http://code.dlang.org/packages/requests
[3] http://code.dlang.org/packages/arsd
The expiremental XML lib too has nice API
(https://lodo1995.github.io/experimental.xml/std/experimental/xml/dom/Document.html)
I recommend requests and experimental DOM lib
(http://code.dlang.org/packages/std-experimental-xml) to
implement crawling.
'requests' looks like very useful! Thank you so much!