Re: GWT - Crawlable (SEO)

2013-01-08 Thread darkflame
 I can only comment how I did it;

Googles bot will read any url in the form:

#!key1=value1key2=value2

As:

?_escaped_fragment_=key1=value1%26key2=value2

Thus I built a php version of my site that delivered the same 
content without the need for JavaScript.
By using escape fragments the same request data is avaliable to the server 
as the client, so you should be able to pull up the same contents as the 
client. (for example, from a mysql database).

So effectively the javascript and php versions of my site mirror eachother 
in terms of content, and the bot has access to the php one via the 
?_escaped_fragment_ url standard.


On Wednesday, December 26, 2012 1:55:11 AM UTC+1, Jan wrote:

 Hi,

 i like to make my gwt-app searchable by google. I found this article, that 
 describes how to do it: 
 https://developers.google.com/webmasters/ajax-crawling/

 But it does not really make sense to me: If i use a servlet filter to 
 present a special view to the google bot: This can not really work on the 
 client side. If i change the view with the activties and places pattern, 
 this only affects the client side an there is no servlet involved - 
 servlet filter does nothing.

 Does some one has an explanation, example or even better a tutorial for me?

 Thanks and best regards
 Jan


-- 
You received this message because you are subscribed to the Google Groups 
Google Web Toolkit group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-web-toolkit/-/JbqfwYRuz4YJ.
To post to this group, send email to google-web-toolkit@googlegroups.com.
To unsubscribe from this group, send email to 
google-web-toolkit+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-web-toolkit?hl=en.



Re: GWT Crawlable (SEO)

2012-12-31 Thread Benjamin Possolo
Jan

you seem to be kind of trolling; duplicate thread created 5 days ago by 
yourself and you clearly didnt bother to use the search feature but I will 
answer anyways

Just copy the filter I wrote:
https://groups.google.com/forum/#!topic/google-web-toolkit/aBt-QCCQkKY

On Thursday, December 27, 2012 3:36:17 AM UTC-8, Jan wrote:

 Hi

 I like to make my GWT-App by the google bot. I found this article (
 https://developers.google.com/webmasters/ajax-crawling/). It states there 
 should be a servlet filter, that serves a different view to the google bot. 
 But how can this work? If i use for example the activities and places 
 pattern, than the page changes are on the client-side only and there is no 
 servlet involved - servlet filter does not work here.

 Can someone give me an explanation? Or is there another good tutorial 
 tailored to gwt how to do this?

 Thanks and best regards
 Jan



-- 
You received this message because you are subscribed to the Google Groups 
Google Web Toolkit group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-web-toolkit/-/VqqvW4u0QmUJ.
To post to this group, send email to google-web-toolkit@googlegroups.com.
To unsubscribe from this group, send email to 
google-web-toolkit+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-web-toolkit?hl=en.



Re: GWT Crawlable (SEO)

2012-12-30 Thread RyanZA
Check out this link, specifically point 3 on how to set up a servlet filter 
that works with _escaped_fragment.
https://developers.google.com/webmasters/ajax-crawling/docs/html-snapshot

You now have two choices: in the link above, they use a java WebClient ( 
http://htmlunit.sourceforge.net/ ) to grab the html from your real page. 
The WebClient can parse javascript, and if your GWT page is fairly straight 
forward it should just work and give the right html back to google bot with 
zero extra work beyond the web.xml config / filter on your end.

However, if WebClient can't get good data from your pages (you'll need to 
test using WebClient directly), then you can inline some html for any pages 
that don't work, and you can make calls to your database/servlets to pull 
any dynamic data you might need. This output should be valid html, but it 
doesnt have to be pretty - just a bodyLots of text here.../body is 
enough for googlebot to understand the content on your page.

On Thursday, December 27, 2012 1:36:17 PM UTC+2, Jan wrote:

 Hi

 I like to make my GWT-App by the google bot. I found this article (
 https://developers.google.com/webmasters/ajax-crawling/). It states there 
 should be a servlet filter, that serves a different view to the google bot. 
 But how can this work? If i use for example the activities and places 
 pattern, than the page changes are on the client-side only and there is no 
 servlet involved - servlet filter does not work here.

 Can someone give me an explanation? Or is there another good tutorial 
 tailored to gwt how to do this?

 Thanks and best regards
 Jan



-- 
You received this message because you are subscribed to the Google Groups 
Google Web Toolkit group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-web-toolkit/-/hsIhh6WEZ0cJ.
To post to this group, send email to google-web-toolkit@googlegroups.com.
To unsubscribe from this group, send email to 
google-web-toolkit+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-web-toolkit?hl=en.



Re: GWT Crawlable (SEO)

2012-12-29 Thread darkflame
I solved this by effectively having a crudely laidout, but text/
content identical php system that gives the content when javascript
isnt present and a ?_escaped_fragment_  url is given.
As a bonus to making my site crawlable, this also makes it usable(ish)
for those without javascript on.

On Dec 28, 9:32 pm, Jens jens.nehlme...@gmail.com wrote:
 The servlet filter is only for the crawler and the crawler will not
 navigate your app using PlaceChangeEvents. The crawler just loads an URL
 that will hit your server and your servlet filter.

 If the bot finds a hyperlink like #!myPlace then it calls your server
 using http://domain.com/?_escaped_fragment_=myPlace; and thus hitting your
 server. If you have two servers (a dedicated web server for static content
 + application server) then you have to proxy the request to your
 application server as soon as the URL contains the _escaped_fragment_ query
 parameter, so that the server can generate a HTML snapshot on the fly or
 you have to pre-generate all possible snapshots and serve them directly
 from the dedicated web server (and update them regularly using a cron job).

 Basically your server needs to follow the spec described at:

 https://developers.google.com/webmasters/ajax-crawling/docs/specifica...

 -- J.

-- 
You received this message because you are subscribed to the Google Groups 
Google Web Toolkit group.
To post to this group, send email to google-web-toolkit@googlegroups.com.
To unsubscribe from this group, send email to 
google-web-toolkit+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-web-toolkit?hl=en.



Re: GWT Crawlable (SEO)

2012-12-28 Thread Jens
The servlet filter is only for the crawler and the crawler will not 
navigate your app using PlaceChangeEvents. The crawler just loads an URL 
that will hit your server and your servlet filter.

If the bot finds a hyperlink like #!myPlace then it calls your server 
using http://domain.com/?_escaped_fragment_=myPlace; and thus hitting your 
server. If you have two servers (a dedicated web server for static content 
+ application server) then you have to proxy the request to your 
application server as soon as the URL contains the _escaped_fragment_ query 
parameter, so that the server can generate a HTML snapshot on the fly or 
you have to pre-generate all possible snapshots and serve them directly 
from the dedicated web server (and update them regularly using a cron job).

Basically your server needs to follow the spec described at:

https://developers.google.com/webmasters/ajax-crawling/docs/specification

-- J.

-- 
You received this message because you are subscribed to the Google Groups 
Google Web Toolkit group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-web-toolkit/-/eYSMCKNDl9YJ.
To post to this group, send email to google-web-toolkit@googlegroups.com.
To unsubscribe from this group, send email to 
google-web-toolkit+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-web-toolkit?hl=en.



GWT - Crawlable (SEO)

2012-12-27 Thread Jan
Hi,

i like to make my gwt-app searchable by google. I found this article, that 
describes how to do 
it: https://developers.google.com/webmasters/ajax-crawling/

But it does not really make sense to me: If i use a servlet filter to 
present a special view to the google bot: This can not really work on the 
client side. If i change the view with the activties and places pattern, 
this only affects the client side an there is no servlet involved - 
servlet filter does nothing.

Does some one has an explanation, example or even better a tutorial for me?

Thanks and best regards
Jan

-- 
You received this message because you are subscribed to the Google Groups 
Google Web Toolkit group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-web-toolkit/-/8zHXKHgWnL0J.
To post to this group, send email to google-web-toolkit@googlegroups.com.
To unsubscribe from this group, send email to 
google-web-toolkit+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-web-toolkit?hl=en.



GWT Crawlable (SEO)

2012-12-27 Thread Jan
Hi

I like to make my GWT-App by the google bot. I found this article 
(https://developers.google.com/webmasters/ajax-crawling/). It states there 
should be a servlet filter, that serves a different view to the google bot. 
But how can this work? If i use for example the activities and places 
pattern, than the page changes are on the client-side only and there is no 
servlet involved - servlet filter does not work here.

Can someone give me an explanation? Or is there another good tutorial 
tailored to gwt how to do this?

Thanks and best regards
Jan

-- 
You received this message because you are subscribed to the Google Groups 
Google Web Toolkit group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-web-toolkit/-/xNsogezpy90J.
To post to this group, send email to google-web-toolkit@googlegroups.com.
To unsubscribe from this group, send email to 
google-web-toolkit+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-web-toolkit?hl=en.