Hallo all,
A friend of mine ask if there is a smart way to get the html code of
couple thousand links but with a script, it takes for ever since it
always has takes a couple of seconds to get the connection.
I needs to be multi threaded so we can use all of the download rate.
So I sad I could try it with clojure but I am pretty new in clojure
and java (almost through the Programming Clojure book but nothing
practical) and thought i just ask here instead of trying to copy some
java code in clojure and hack something bad.
My idea would be to span a agent for every dump and control that there
won't be more then a 10-20 threads. And dump it into a file.
How would you implement this?
A function that does all of it in a agent and control it with a
counter from a other function?
Is there a clojure way to write a file or should I use the java way?
Same for reading a file.
Here is some javacode that does part of what I want. Is there a better
way then proxy all of it?
url = new URL("random page");
URLConnection conn = url.openConnection();
DataInputStream in = new DataInputStream ( conn.getInputStream
( ) ) ;
BufferedReader d = new BufferedReader(new InputStreamReader(in));
while(d.ready())
{
System.out.println( d.readLine());
}
Just that this prints to console instead of a file.
So tanks for reading. I'm working on it any tip or suggestion would
help.
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clojure@googlegroups.com
Note that posts from new members are moderated - please be patient with your
first post.
To unsubscribe from this group, send email to
clojure+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
