Hi Bruno thanks for the update Please update this thread if you make any decisions or changes about this. I think it crawls the page where the ad markup appears plus sometimes the parent page if it the former is iframe. Adsense cralwer errors are reported to the publisher, so I can see where it fails. If you need any info let mwe know. thanks
On Thursday, March 8, 2012 7:04:08 PM UTC+2, Bruno Oliveira (Google) wrote: > Hello, > > Thanks for the explanation, it clarified the finer points of how the > adsense crawler works which I wasn't aware of. I assumed it crawled the > landing page only, not the page on which the ad appears. We'll look into > it. Thanks! > > - > Bruno Oliveira (Google) > > > On Wednesday, March 7, 2012 6:32:44 PM UTC-3, anatoly wrote: >> >> Any update on the issue? >> The minimum orkut team should do is fix the bug of requestNavigateTo >> implementation >> >> Currently requestNavigateTo redirects to /Application.aspx instead of >> /Application and it blocks adsense crawler. >> I'd suggest to work closely with adsense team, you're the same company, I >> can't coordinate your internal cooperation. >> Just ask Adsense team how much crawler errors do they get on >> google.com.br, I bet there are billions. >> >> >> Please fix and update, otherwise it makes counterproductive to use >> adsense on apps. >> >> >> thanks >> >> >> >> >> >> On Tuesday, January 3, 2012 10:08:35 PM UTC+2, Bruno Oliveira (Google) >> wrote: >> >>> We do not plan to modify robots.txt at the moment... but as far as I >>> understand, the crawler would not need to crawl over /Application, because >>> /PublicAppInfo does *not* automatically redirect to /Application unless >>> the user is logged in and has the app installed. >>> >>> Since the crawler is not an Orkut user, this redirection would not >>> happen and it would never see /Application or any other page. At least >>> that's how it *should* happen :-) I've tested /PublicAppInfo myself >>> while not logged in (which mimics the way the adsense crawler would see it) >>> and indeed it does not perform any redirections that I could tell... >>> >>> Thanks! >>> >>> - >>> Bruno Oliveira (Google) >>> >> -- You received this message because you are subscribed to the Google Groups "orkut Developer Forum" group. To view this discussion on the web visit https://groups.google.com/d/msg/opensocial-orkut/-/x3LkHTcMKgUJ. To post to this group, send email to opensocial-orkut@googlegroups.com. To unsubscribe from this group, send email to opensocial-orkut+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/opensocial-orkut?hl=en.
