[orkut-developer] Re: robots.txt issue on orkut.com.br - blocking adsense crawler
But why would your call to requestNavigateTo() affect the crawler? Sorry if I'm asking something obvious... I don't really know how the Adsense crawler works, as that's not my area :-) - Bruno Oliveira (Google) -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/XOEomPs4nMQJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
[orkut-developer] Re: robots.txt issue on orkut.com.br - blocking adsense crawler
I'm not sure it is related solely to requestNavigateTo there are several app urls 1) orkut links (for example from profile page) http://www.orkut.com/Main#Application?uid=1234appId=1234 2) PublicAppInfo http://www.orkut.com/Main#PublicAppInfo?appId=1234 which redirects to http://www.orkut.com/Main#Application?appId=1234 (which is similar to #1) 3) orkut implementation of OpenSocial method requestNavigateTo goes to *http://www.orkut.com/Application.aspx?appId=1234appParams=bla*http://www.orkut.com/Application.aspx?appId=1234appParams=bla which briefly redirects to http://www.orkut.com/Main#Application.aspx?appId=1234appParams=bla adsense crawler reports errors on http://www.orkut.com/Application.aspx and *http://www.orkut.com/Application* since /Application.aspx and /Application are blocked by robots.txt These are real urls before url rewrite so somehow it might be related to url rewrite on orkut. In any case you can just solve it by adding User-agent: Mediapartners-Google Disallow: to robots txt (or just allow /Application.aspx and /Application for Mediapartners-Google) which will not effect other crawlers It will be in any case for Google's benefit (and for developers benefit). -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/3jd1C-u04yIJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
[orkut-developer] Re: robots.txt issue on orkut.com.br - blocking adsense crawler
In any case unrelated to crawlers error you can unify */Main#Application.aspx?appId=1234appParams=bla* ** with */Main#Application?appId=1234appParams=bla* ** as */Main#Application* ** is a standard scheme on orkut and only requestNavigateTo uses Application.aspx -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/8Co_T4warAcJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
[orkut-developer] Re: robots.txt issue on orkut.com.br - blocking adsense crawler
We do not plan to modify robots.txt at the moment... but as far as I understand, the crawler would not need to crawl over /Application, because /PublicAppInfo does *not* automatically redirect to /Application unless the user is logged in and has the app installed. Since the crawler is not an Orkut user, this redirection would not happen and it would never see /Application or any other page. At least that's how it *should* happen :-) I've tested /PublicAppInfo myself while not logged in (which mimics the way the adsense crawler would see it) and indeed it does not perform any redirections that I could tell... Thanks! - Bruno Oliveira (Google) -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/-k5lJwdhQnwJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
[orkut-developer] Re: List of many apps affected by the automatic reviewer bug
Hello, Is the issue still happening? I just checked a few of your apps and they were correctly listed as online on our directory... Thanks! - Bruno Oliveira (Google) -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/C6vNHf2OUsIJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
[orkut-developer] Re: 3 apps developed since 2009, and it were no longer found in orkut is 1 month
That app does not exist in our database. An app may get deleted if the server can't find it's XML for several days. -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/ug-p4dPJGEwJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
[orkut-developer] Re: robots.txt issue on orkut.com.br - blocking adsense crawler
Hello Bruno Google Adsense crawler crawls the page where the ad tag is placed - it is on the application page which is an iframe on orkut, when the crawler sees that the page is the iframe it attempts to crawl it's parent page (in our case it is /Application, /Application.aspx) which is blocked by robots.txt. Somehow it detects that the page is /Application and not /Main#Application. I suspect the issue might be with url rewriting from /Application to /Main#Application I suggest to at least change requestNavigateTo implementation to redirect to /Main#Application instead of /Main#Application.aspx to make it standard. Otherwise .aspx looks like a redundant orkut url format for pages. -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/Ex2sBNN16W4J. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
[orkut-developer] Re: List of many apps affected by the automatic reviewer bug
no i have resubmitted all apps but not getting exact reasong either its beacuse of photobucket images or tinypic images. but now they are ok. but still few apps are getting rejected because of some unkon maliciuos error. -- You received this message because you are subscribed to the Google Groups orkut Developer Forum group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/NMYLABlJ-9gJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
