On Feb 19, 2011, at 12:23 , Remigiusz Modrzejewski wrote: > On Feb 19, 2011, at 11:15 , Stephan Beal wrote: > >> i no longer believe that all bots are unaware of JS, though. In particular, >> now that google has their own js engine, i suspect that their crawlers can >> (or will soon be able to) understand js. > > They actually are fully js capable now. As fully AJAX sites became popular, > it was necessary for them to accommodate. So now most serious crawlers can > not only follow JS-obscured links, but also read fully JSON->Javascript > rendered pages. I believe that all newer rouge bots can also handle js to > some extent.
Actually, that is even simpler than I imagined. Take for example Perl WWW::Scripter module[1], which is made just for that. I believe that many other popular languages will have something for that too. Kind regards, Remigiusz Modrzejewski [1] - http://search.cpan.org/~sprout/WWW-Scripter-0.020/lib/WWW/Scripter.pod _______________________________________________ fossil-users mailing list fossil-users@lists.fossil-scm.org http://lists.fossil-scm.org:8080/cgi-bin/mailman/listinfo/fossil-users
