[google-appengine] HTTPS on my own domain
I'm trying to make a determination if I should use app engine for a project I'm starting. I need to be able to take a user's username and password to some banking information (think of this similar to mint.com). As I understand it, I need to do this on a HTTPS page and one cannot serve an https page through appengine if you are using your own domain. Apparently this can only be done on app-id.appspot.com. I read the faq about ssl & https here (http://code.google.com/ appengine/kb/general.html#httpsapps), but I don't quite understand it. What does it mean to redirect traffic through appspot? Will that page still show up as https for the user on my domain? It would be unacceptable to switch off of mydomain.com and onto app-id.appspot.com for the https part. Is it feasible to somehow make it appear that this is https on my domain? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Redirect http to https?
This is a great pointer! However, I'm having a little trouble getting this to actually work and I'm confused as to why nothing seems to redirect. I would think the following would just redirect everything on my site through https. Any idea why that doesn't work or a way to instrument what is going on? I'm on the latest appengine & gwt versions. Section I added to web.xml: * CONFIDENTIAL On Jun 25, 1:13 am, "l.denardo" wrote: > The same in Java configuring web.xml as stated here: > > http://code.google.com/appengine/docs/java/config/webxml.html#Secure_... > > (on appspot.com only, not for custom apps domains) > > Regards > Lorenzo > > On Jun 25, 4:44 am, Robert Kluin wrote: > > > > > If you are using python you can configure app.yaml to automatically > > redirect to https. Just add "secure: always" to you handler mappings. > > >http://code.google.com/appengine/docs/python/config/appconfig.html > > > Robert > > > On Jun 24, 2010, at 16:09, Phil McDonnell > > wrote: > > > > Is there any way to redirect http traffic to https on app engine? For > > > instance, I want users who type inhttp://x.appspot.comintothe browser to > > > automatically get redirected tohttps://x.appspot.com. Any idea if this > > > is possible in GAE? > > > > Thanks, > > > Phil > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "Google App Engine" group. > > > To post to this group, send email to google-appeng...@googlegroups.com. > > > To unsubscribe from this group, send email to > > > google-appengine+unsubscr...@googlegroups.com. > > > For more options, visit this group > > > athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Redirect http to https?
It turns out that I needed to add a tag. Here's the working piece: Protected Area /* CONFIDENTIAL On Jun 28, 12:38 am, "l.denardo" wrote: > Sorry but I can't really help, since it looks like your web.xml has > everything correct. > > The only suggestions I can give are: > -Try using /* instead of * in your constraint. This might seem a > stupid suggestion, but I faced similar problems many times (escape > characters in URLs seem particularly prone to errors). > -Be aware that https is only available on appspot.com subdomains, and > does not work if you deploy your app to your own site. > > Regards > Lorenzo > > On Jun 26, 12:31 am, Phil wrote:> This is a > great pointer! However, I'm having a little trouble getting > > this to actually work and I'm confused as to why nothing seems to > > redirect. I would think the following would just redirect everything > > on my site through https. Any idea why that doesn't work or a way to > > instrument what is going on? I'm on the latest appengine & gwt > > versions. > > > Section I added to web.xml: > > > > > > > > > * > > > > > > CONFIDENTIAL > > > > > > > On Jun 25, 1:13 am, "l.denardo" wrote: > > > > The same in Java configuring web.xml as stated here: > > > >http://code.google.com/appengine/docs/java/config/webxml.html#Secure_... > > > > (on appspot.com only, not for custom apps domains) > > > > Regards > > > Lorenzo > > > > On Jun 25, 4:44 am, Robert Kluin wrote: > > > > > If you are using python you can configure app.yaml to automatically > > > > redirect to https. Just add "secure: always" to you handler mappings. > > > > >http://code.google.com/appengine/docs/python/config/appconfig.html > > > > > Robert > > > > > On Jun 24, 2010, at 16:09, Phil McDonnell > > > > wrote: > > > > > > Is there any way to redirect http traffic to https on app engine? > > > > > For instance, I want users who type > > > > > inhttp://x.appspot.comintothebrowserto automatically get redirected > > > > > tohttps://x.appspot.com. Any idea if this is possible in GAE? > > > > > > Thanks, > > > > > Phil > > > > > -- > > > > > You received this message because you are subscribed to the Google > > > > > Groups "Google App Engine" group. > > > > > To post to this group, send email to > > > > > google-appeng...@googlegroups.com. > > > > > To unsubscribe from this group, send email to > > > > > google-appengine+unsubscr...@googlegroups.com. > > > > > For more options, visit this group > > > > > athttp://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Datastore design question
It sounds like the list property can't be appended to without a transaction? If so, it seems it'll be better to create two tables, one for Users and one for Items. Just to answer the above questions... I expect many reads of the data and few writes. I also expect the normal case to have few items (1-2 on avg) and it won't change often. The key to the Items table would be user_id-item_name. Are prefix scans in GQL efficient? Also, in terms of data I'm storing about the items, I have ~5-10 fields of metadata. For now I'm assuming that the right thing to do here is to split the data between tables. Even if it seems to be an unlikely problem now, I don't want to put myself in a situation where I'm limited by the QPS that transactions can support. Thanks, Phil On Jun 27, 11:17 pm, Robert Kluin wrote: > The answer to this question depends on several other questions too. > For example: > 1) how many items are you expecting? > 2) how often do a users items change, and how do they get changed > (the user or something else)? > 3) what type of querying / reporting do you need to be able to do? > 4) what type of information would you need to store about each users item? > > Robert > > > > On Sun, Jun 27, 2010 at 9:59 PM, Tom Wu wrote: > > Hi Luís, > > > If you have a "User" model, with a "items" heavy Property like TextProperty > > which is not necessary for every query. > > Which db structure is better ? > > > Best Regards > > Tom Wu > > > 2010/6/28 Luís Marques > > >> Hello Phil, > > >> Anyone correct me if I'm wrong but you use one of the following > >> options, among others. > > >> You can have a "User" model, with a "items" ListProperty. The pros: if > >> you have the key for the user (e.g. you can use the email), then with > >> a simple get (faster than a query) you can retrieve the entity > >> including the items. Writing a new object is transactional. The cons: > >> you must always get a set the entire user entity. The entity might get > >> large if there are a lot of items. If you use custom indexes with the > >> "items" property the index might get large quickly, especially if you > >> use more than one ListProperty (exploding indexes). > > >> You can have a "User" model, and a "UserItem" whose parent is the > >> User, making it part of a transaction group. Cons: you have limited > >> QPS writes to the transaction group (about 1-10 QPS), but that's the > >> same limitation you have to a standalone User with items. You have to > >> query (seek) the items, although I wouldn't call that a problem > >> without profile data. Pros: you can write individual UserItems. You > >> can have transactions for the user and the items s/he has. > > >> You can have a "User" model and a "UserItem" with a User key > >> reference. Cons: you can no longer have a transaction depending on the > >> user and the items s/he has. Pros: you can write individual items > >> without write collisions to the User. > > >> You can have a "User" and a flat list (e.g. text, non-indexed) of the > >> corresponding items. Cons: limits the queries you can make, have to > >> update all items at once. Pros: better index performance. > > >> Etc. I hope it was helpful and correct? > > >> Best regards, > >> Luís > > >> -- > >> You received this message because you are subscribed to the Google Groups > >> "Google App Engine" group. > >> To post to this group, send email to google-appeng...@googlegroups.com. > >> To unsubscribe from this group, send email to > >> google-appengine+unsubscr...@googlegroups.com. > >> For more options, visit this group at > >>http://groups.google.com/group/google-appengine?hl=en. > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To post to this group, send email to google-appeng...@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine+unsubscr...@googlegroups.com. > > For more options, visit this group at > >http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: HTTPS on my own domain
Does anyone have experience setting up an https capable proxy? I don't even know where to start. Searching found a number of proxy lists and instructions to setup a regular http proxy. Maybe I'm not looking for the right thing here? Thanks! Phil On Jun 14, 5:26 am, Barry Hunter wrote: > > Is it feasible to somehow make it appear that this is https on my > > domain? > > Not currently entirely with Google. It but is appently on the roadmap > for AppEngine for Business. > > The only way currently would be to setup a HTTPS capable proxy. Your > proxy receives HTTPS requests from the user, and forwards them in the > background tohttps://app-id.appspot.com/. > > This would maintain encryption security as both sites of the proxy > would be encrypted channels. > > I beleive you can setup a subdomain to point to your own server, eg > use secure.domain.com for secure which go via proxy.www.domain.com > goes via normal Apps proxy to AppEngine. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Problem : unable to find valid certification path to requested target
Hello, I've created the example code 'guestbook'. However, when I upload the program, I receive this error : com.google.appengine.tools.admin.AdminException: Unable to update app: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target at com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java: 62) I use the OS linux (Ubuntu). What could be the problem? Many thanks -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Problem : unable to find valid certification path to requested target
I've found my problem. I needed to add the certificate of Google into my cacerts of java. Thanks On 26 juil, 12:02, Phil wrote: > Hello, > > I've created the example code 'guestbook'. However, when I upload the > program, I receive this error : > > com.google.appengine.tools.admin.AdminException: Unable to update app: > sun.security.validator.ValidatorException: PKIX path building failed: > sun.security.provider.certpath.SunCertPathBuilderException: unable to > find valid certification path to requested target > at > com.google.appengine.tools.admin.AppAdminImpl.update(AppAdminImpl.java: > 62) > > I use the OS linux (Ubuntu). > > What could be the problem? > > Many thanks -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] How to visualize a spreadsheet?
Hello, I'd like to visualize/edit/create a spreadsheet form my web application located on GAE. Does it exist a framework that is able to show/edit a spreadsheet? I mean, I'd like an existing GUI that is able to show/modify/create a spreadsheet. In ohter words, something similar to google Docs. Actually I only use the library of Python and I must create the GUI in HTML. Many thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] blueimp-fileupload
Has anyone used blueimp-fileupload with app engine and python start to finish? I could use the code examples. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE + JAXWS bug
Any advices for fixing this issue because I got the same problem when I deploy my application on google server. It works fine in local developement. Thanks for your feedback Le samedi 19 novembre 2011 22:51:13 UTC+1, Deepak Singh a écrit : > > I believe GAE team has stopped resolving bug. So make sure we need to > cooperate with this. > > Thanks to GAE for not commenting this issue. > > Regards > Deepak > > On Fri, Nov 18, 2011 at 8:26 PM, ZM >wrote: > >> Exactly same thing here, working on local dev environment, after upload >> got same exception, >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To view this discussion on the web visit >> https://groups.google.com/d/msg/google-appengine/-/u13-NkJ7SUUJ. >> To post to this group, send email to >> google-a...@googlegroups.com >> . >> To unsubscribe from this group, send email to >> google-appengi...@googlegroups.com . >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > > > -- > Deepak Singh > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/KKIEUyD5QmkJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE + JAXWS bug
Thanks for your quick answer. However, I haven't any jaxb on my classpath. I use the one of app engine. Any other advices? Many thanks for your help, I really need to fix this issue. Le mercredi 19 septembre 2012 13:55:46 UTC+2, Emanuele Ziglioli a écrit : > > Have you got a jaxb jar in your classpath? > If that's the case, you have to remove it and rely on the JRE > implementation of jaxb. > The GAE runtime wants you to use their jaxb and jaxws implementations. > You can use a jaxb jar without jaxws but not toghether (the reason escapes > me). > I had to adapt my code (and the restlet jaxb adaptor) to do so. > > On Wednesday, 19 September 2012 22:11:15 UTC+12, Phil wrote: >> >> Any advices for fixing this issue because I got the same problem when I >> deploy my application on google server. It works fine in local developement. >> >> Thanks for your feedback >> >> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/MCo6MOLUUywJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE + JAXWS bug
I already add one by one some packages on the basic projects..Without success. Do you mean that I can add Force.com SOAP as plugin into my app engine Project? If I understand, my app engine project could call a Web service by using Force.com SOAP? Le mercredi 19 septembre 2012 14:57:58 UTC+2, Emanuele Ziglioli a écrit : > > By the way, I've also managed to get the Force.com SOAP implementation > running on GAE, it's older than their implementation but pehaps faster and > I can also set timeouts. It relies on top of URLfetch: > > http://www.youtube.com/watch?v=HCslNMue6OY > > http://wiki.developerforce.com/page/Introduction_to_the_Force.com_Web_Services_Connector > > > Their code generator is a bit buggy > > On Thursday, 20 September 2012 00:03:37 UTC+12, Phil wrote: >> >> Thanks for your quick answer. However, I haven't any jaxb on my >> classpath. I use the one of app engine. >> Any other advices? >> >> Many thanks for your help, I really need to fix this issue. >> >> Le mercredi 19 septembre 2012 13:55:46 UTC+2, Emanuele Ziglioli a écrit : >>> >>> Have you got a jaxb jar in your classpath? >>> If that's the case, you have to remove it and rely on the JRE >>> implementation of jaxb. >>> The GAE runtime wants you to use their jaxb and jaxws implementations. >>> You can use a jaxb jar without jaxws but not toghether (the reason >>> escapes me). >>> I had to adapt my code (and the restlet jaxb adaptor) to do so. >>> >>> On Wednesday, 19 September 2012 22:11:15 UTC+12, Phil wrote: >>>> >>>> Any advices for fixing this issue because I got the same problem when >>>> I deploy my application on google server. It works fine in local >>>> developement. >>>> >>>> Thanks for your feedback >>>> >>>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/ypOqxj2ZXksJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE + JAXWS bug
I mean that I create a web application project from Eclipse, then add my code for calling the webservice. When I run in local, It works however on server I got the above exception. But I didn't add any of my jar in the projet. I only use the one of Google App Enfin. Could you tell me where is the tutorial SOAP that you're talking about? Le mercredi 19 septembre 2012 15:14:18 UTC+2, Emanuele Ziglioli a écrit : > > > > On Thursday, 20 September 2012 01:07:57 UTC+12, Phil wrote: >> >> I already add one by one some packages on the basic projects..Without >> success. > > > do you mean that you didn't manage to reproduce the problem on the > production server? > so you're saying that the SOAP tutorial works with all the jars from your > project but your project doesn't, is that what you mean? > > >> >> Do you mean that I can add Force.com SOAP as plugin into my app engine >> Project? If I understand, my app engine project could call a Web service by >> using Force.com SOAP? >> > > yes, you can use their implementation (that is not jax-ws compliant) > instead. That's what I did when I got desperate. > Their code generator didn't work 100% well with our schema but I managed > to fix the generated code somehow. > > > https://groups.google.com/forum/#!msg/google-appengine/Kwwc6sFdf_s/wl1Hi0OurcYJ > > http://code.google.com/p/googleappengine/issues/detail?id=4910 > > >> Le mercredi 19 septembre 2012 14:57:58 UTC+2, Emanuele Ziglioli a écrit : >>> >>> By the way, I've also managed to get the Force.com SOAP implementation >>> running on GAE, it's older than their implementation but pehaps faster and >>> I can also set timeouts. It relies on top of URLfetch: >>> >>> http://www.youtube.com/watch?v=HCslNMue6OY >>> >>> http://wiki.developerforce.com/page/Introduction_to_the_Force.com_Web_Services_Connector >>> >>> >>> Their code generator is a bit buggy >>> >>> On Thursday, 20 September 2012 00:03:37 UTC+12, Phil wrote: >>>> >>>> Thanks for your quick answer. However, I haven't any jaxb on my >>>> classpath. I use the one of app engine. >>>> Any other advices? >>>> >>>> Many thanks for your help, I really need to fix this issue. >>>> >>>> Le mercredi 19 septembre 2012 13:55:46 UTC+2, Emanuele Ziglioli a >>>> écrit : >>>>> >>>>> Have you got a jaxb jar in your classpath? >>>>> If that's the case, you have to remove it and rely on the JRE >>>>> implementation of jaxb. >>>>> The GAE runtime wants you to use their jaxb and jaxws implementations. >>>>> You can use a jaxb jar without jaxws but not toghether (the reason >>>>> escapes me). >>>>> I had to adapt my code (and the restlet jaxb adaptor) to do so. >>>>> >>>>> On Wednesday, 19 September 2012 22:11:15 UTC+12, Phil wrote: >>>>>> >>>>>> Any advices for fixing this issue because I got the same problem >>>>>> when I deploy my application on google server. It works fine in local >>>>>> developement. >>>>>> >>>>>> Thanks for your feedback >>>>>> >>>>>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/gRce0CTKKocJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE + JAXWS bug
I tried Force.com API. Unfortunetly, when I generate code from WSDL, I got the error message : Found more than one wsdl:binding. WSDL with multiple binding not supported I guest that the WSDL won't work with Force.com? Le mercredi 19 septembre 2012 15:20:13 UTC+2, Phil a écrit : > > I mean that I create a web application project from Eclipse, then add my > code for calling the webservice. When I run in local, It works however on > server I got the above exception. But I didn't add any of my jar in the > projet. I only use the one of Google App Enfin. > > Could you tell me where is the tutorial SOAP that you're talking about? > > Le mercredi 19 septembre 2012 15:14:18 UTC+2, Emanuele Ziglioli a écrit : >> >> >> >> On Thursday, 20 September 2012 01:07:57 UTC+12, Phil wrote: >>> >>> I already add one by one some packages on the basic projects..Without >>> success. >> >> >> do you mean that you didn't manage to reproduce the problem on the >> production server? >> so you're saying that the SOAP tutorial works with all the jars from your >> project but your project doesn't, is that what you mean? >> >> >>> >>> Do you mean that I can add Force.com SOAP as plugin into my app engine >>> Project? If I understand, my app engine project could call a Web service by >>> using Force.com SOAP? >>> >> >> yes, you can use their implementation (that is not jax-ws compliant) >> instead. That's what I did when I got desperate. >> Their code generator didn't work 100% well with our schema but I managed >> to fix the generated code somehow. >> >> >> https://groups.google.com/forum/#!msg/google-appengine/Kwwc6sFdf_s/wl1Hi0OurcYJ >> >> http://code.google.com/p/googleappengine/issues/detail?id=4910 >> >> >>> Le mercredi 19 septembre 2012 14:57:58 UTC+2, Emanuele Ziglioli a écrit : >>>> >>>> By the way, I've also managed to get the Force.com SOAP implementation >>>> running on GAE, it's older than their implementation but pehaps faster and >>>> I can also set timeouts. It relies on top of URLfetch: >>>> >>>> http://www.youtube.com/watch?v=HCslNMue6OY >>>> >>>> http://wiki.developerforce.com/page/Introduction_to_the_Force.com_Web_Services_Connector >>>> >>>> >>>> Their code generator is a bit buggy >>>> >>>> On Thursday, 20 September 2012 00:03:37 UTC+12, Phil wrote: >>>>> >>>>> Thanks for your quick answer. However, I haven't any jaxb on my >>>>> classpath. I use the one of app engine. >>>>> Any other advices? >>>>> >>>>> Many thanks for your help, I really need to fix this issue. >>>>> >>>>> Le mercredi 19 septembre 2012 13:55:46 UTC+2, Emanuele Ziglioli a >>>>> écrit : >>>>>> >>>>>> Have you got a jaxb jar in your classpath? >>>>>> If that's the case, you have to remove it and rely on the JRE >>>>>> implementation of jaxb. >>>>>> The GAE runtime wants you to use their jaxb and jaxws implementations. >>>>>> You can use a jaxb jar without jaxws but not toghether (the reason >>>>>> escapes me). >>>>>> I had to adapt my code (and the restlet jaxb adaptor) to do so. >>>>>> >>>>>> On Wednesday, 19 September 2012 22:11:15 UTC+12, Phil wrote: >>>>>>> >>>>>>> Any advices for fixing this issue because I got the same problem >>>>>>> when I deploy my application on google server. It works fine in local >>>>>>> developement. >>>>>>> >>>>>>> Thanks for your feedback >>>>>>> >>>>>>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/-np4IlDKniUJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: GAE + JAXWS bug
Thanks for your help. Good night Le mercredi 19 septembre 2012 15:43:06 UTC+2, Emanuele Ziglioli a écrit : > > I'm going to bed now (almost 2am NZ time). Good luck! > > > On Thursday, 20 September 2012 01:35:41 UTC+12, Phil wrote: >> >> I tried Force.com API. Unfortunetly, when I generate code from WSDL, I >> got the error message : Found more than one wsdl:binding. WSDL with >> multiple binding not supported >> >>> >>>>>>>>> >>>>>>>>> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/wiH4u7bHRQIJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Google App Engine SOAP call SocketTimeoutException
Emmanuele, Could you more describe your solution?
I've a lot of problem with timeout exception and Jax-ws. I'm looking for
new solution for substituing Jax-RS for calling web services.
Thanks
Le jeudi 26 juillet 2012 07:26:55 UTC+2, Emanuele Ziglioli a écrit :
>
> Hi everyone,
>
> After a lot of digging I've given up on GAE's implementation of jaxws.
> Their implementation can't be found by the Factory classloader, period.
>
> So I've picked the Force.com Web Services Connector and managed to make it
> work.
> There were bugs in the code generation process, in the generated code, and
> also the GAE connector needed some fixes.
>
> I'm tempted to created a project on GitHub to show what I've done.
> This implementation is faster and also you can set the socket timeout!
>
> Cheers,
> Emanuele
>
> On Thursday, 26 July 2012 09:14:38 UTC+12, Emanuele Ziglioli wrote:
>>
>> Yes! +1
>>
>> is there a way to do it?
>> I'm also experiencing a different problem on the production server:
>>
>> http://stackoverflow.com/questions/11643218/error-in-javax-xml-ws-service-initialization-on-app-engine
>>
>>
>> Deepak,
>> it sounds you found a workaround for issue 4910, it that's the case,
>> could you share your solution? thanks
>> http://code.google.com/p/googleappengine/issues/detail?id=4910
>>
>>
>>
>> On Thursday, 26 July 2012 04:12:59 UTC+12, Deepak Singh wrote:
>>>
>>> Hi Takashi,
>>>
>>> How can we increase the deadline in case of SOAP client ?
>>>
>>> Thanks
>>> Deepak
>>>
>>> On Wed, Jul 25, 2012 at 7:50 PM, Thiago Catoto
>>>
>>> > wrote:
>>>
Thanks Takashi!
And sorry about the wrong info Emanuele...
On Wed, Jul 25, 2012 at 11:01 AM, Takashi Matsuo
> wrote:
>
> For clarification, it used to be 10 secs, but now the maximum deadline
> of the urlfetch is 60 seconds for online requests, 600 seconds for
> offline
> requests(taskqueue and cron).
>
> -- Takashi
>
>
> On Wed, Jul 25, 2012 at 10:36 PM, Thiago Catoto
>
> > wrote:
>
>> Hi,
>>
>> I'm pretty sure Appengine has the limit of 10s for UrlFetch (
>> https://developers.google.com/appengine/docs/java/urlfetch/overview).
>>
>> You may need to change the request to Task Queue if you have the need
>> of longer requests, but it would get more complicated to handling the
>> response to the SOAP "caller".
>>
>> Hope it helps.
>>
>> Best regards,
>> Thiago Catoto.
>>
>>
>> On Tue, Jul 24, 2012 at 10:13 PM, Emanuele Ziglioli <
>> the...@emanueleziglioli.it > wrote:
>>
>>> It times out for me at times on the local server. Haven't found a
>>> way to increase the socket timeout. Have tried:
>>> System.setProperty("sun.net.client.defaultConnectTimeout",
>>> "1");
>>> System.setProperty("sun.net.client.defaultReadTimeout", "1");
>>>
>>> It makes no difference. Then have tried:
>>>((BindingProvider)
>>> port).getRequestContext().put(BindingProviderProperties.REQUEST_TIMEOUT,
>>>
>>> 30);
>>>
>>> but it says "BindingProviderProperties is not supported by Google
>>> App Engine's Java runtime environment".
>>> But at least when testing locally, it works most of the time.
>>>
>>> Instead, on GAE servers, it fails. Have tried catching any exception
>>> but can't even do that.
>>> The call that fails is:
>>>
>>> new javax.xml.ws.Service(java.net.URL wsdlDocumentLocation, QName
>>> serviceName)
>>>
>>>
>>>
>>> On Thursday, 21 June 2012 21:49:28 UTC+12, Michel Jonker wrote:
Yes I have the same issue, I cannot find a way to increase the
connect timeout through JAX-WS that is allowed by Google...
On Friday, June 1, 2012 11:32:20 AM UTC+2, Deepak Singh wrote:
>
> Hi Aljaz,
>
> I am still facing the same problem and app is running with problem.
>
> Let us do something out of the box so that google puts an
> attention over the issue.
>
> Thanks
> Deepak
>
> On Fri, Jun 1, 2012 at 2:35 PM, Aljaz Delakorda
>
> > wrote:
>
>> Hi Deepak,
>>
>> Sorry to contact you in this way, but the Issue where you were
>> discussing has been marked as obsolete.
>>
>> I am having exact same Problem as you described here:
>> http://code.google.com/p/**googleappengine/issues/detail?**
>> id=5927#c5
>>
>> I am calling a soap service (via jax-ws) which uses UrlFetch
>> internally. I become very often a SocketTimeotException while
>> fetching the
>> response... Did you find a way how to increase this Timeout? How did
>> you
>> solve the prob
Re: [google-appengine] Re: Google App Engine SOAP call SocketTimeoutException
Thanks Emmanuel. Am I able to consume other web services with Force.Com or
only the one of SaleForce?
I'm little bit confused of what is possible with Force.com.
By the way, Could you tell me if you know how to globally change the
timeout of URL fetching in Google App Engine?
Thanks a lot.
Le mercredi 26 septembre 2012 23:51:29 UTC+2, Emanuele Ziglioli a écrit :
>
> Ok,
>
> have you managed to generate any code with the SalesForce tool?
> As I wrote, I did get an error but most of the code generated anyway. I'll
> post the command line options I used if I can find them.
>
> The generated code contains three packages:
>
> com.sforce.ws.transport
> GaeHttpTransport.java (this is not specific to any WSDL)
>
> com.sforce.soap.types
> Many classes, mostly dependent on the WSDL, similar to the code
> generated by jaxws
>
> com.sforce.soap.service.dataxmldistribution // followed by the URL of
> your WSDL
> Connector.java
> SoapConnection.java
>
> This last package, as far as I recall, was the one that had some problems.
> I've attached Connector.java.
> We've also made some proprietary changes to SoapConnection.
> We're using the implementation in wsc-22.jar
>
> Example of usage:
> try {
> ConnectorConfig config = new ConnectorConfig();
> config.setTransport( GaeHttpTransport.class );
> config.setTraceMessage(true);
> config.setReadTimeout(7000); // this is the important part
> SoapConnection connection = Connector.newConnection(config);
> String xmlres = connection.getXml( parameters );
> }
> catch (ConnectionException e) {
> }
>
> You really need to pass the first stage of code generation, don't worry
> about errors, see if anything at all has been generated, look at the
> command line options. Look at their source code and google for errors.
> Their source code shows more options that are not documented.
>
> Hope that helps,
> E.
>
> On Thursday, 27 September 2012 02:53:16 UTC+12, Phil wrote:
>>
>> Emmanuele, Could you more describe your solution?
>> I've a lot of problem with timeout exception and Jax-ws. I'm looking for
>> new solution for substituing Jax-RS for calling web services.
>>
>> Thanks
>>
>>>
>>>>>
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/so9smdzffngJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Statistics Calculation
I have an application which displays on the statistics page a total number of entities of 1,646 however when I add up the total entities by Kind it only totals to 1,316. Can someone explain this 25% increase (or perhaps ~300 entities - my other applications are not showing their statistics so I cannot tell which it is), specifically, is the total size on disk used also inflated by 25%? I don't mind for this application specifically due to its small size, however want to make sure my larger applications' space are being calculated correctly given so many recent posts about size used. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Vacuum Indexes - Datastore Indices Count
Hi, I've come across the issue regardng vacuuming of indexes not correctly releasing resources creating the following exception: "Your application is exceeding a quota: Datastore Indices Count" Can someone please reset the quota on my application "5starlivesbeta". Also, I found it was much quicker removing all indexes before clearing down my test data (which I did with vacuum indexes) and then recreated indexes once the datastore was empty - is this the recommended approach? Cheers! --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Index stuck building
An index is taking over 30 minutes to build and my application (http:// honeymoon-registry.appspot.com/) is inaccessible meanwhile. My datastore only contains a small amount of data Is there a way that I can just delete the index and start over? Will the Google Team read this post and fix the problem? Thanks, Phil --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Re: http://code.google.com/status/appengine Error: Server Error
I'm seeing the same thing and my Google application is not working either. I haven't seen any official reports for the reason. Anyone have an official report? On Jul 2, 10:55 am, Tom Wu wrote: > http://code.google.com/status/appengine Error: Server Error > > And I can appcfg.py update my app. > > Best Regards > Tom Wu --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
[google-appengine] Redirect http to https?
Is there any way to redirect http traffic to https on app engine? For instance, I want users who type in http://x.appspot.com into the browser to automatically get redirected to https://x.appspot.com. Any idea if this is possible in GAE? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Datastore design question
I'm using JDO to connect to the datastore and wondering how I should design my tables. I have users who sign up. Users have items. In the RDMS world I'd have a User table and a Items table and the Items table would have a field of user_id which would join with a primary key in the User table. However, with bigtable I thought you could append values to a cell. In this situation I might just have my User table with a column "items". For each item that gets added to the user over time I could then write something to that user's "items" column and it would be appended to the other items also written to that column. Is there an atomic way to do this in the AppEngine datastore? I could imagine doing it through a transactional read-write operation, but locking on every write like that seems like a bad idea. I'm looking to squeeze everything into the Users table because I assume the read will be much faster if I can do a lookup on a particular row as opposed to a table scan query on a separate items table, even if I indexed the items table on user_id. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] HTTPS on my domain through proxy?
Has anyone found a way to setup https on their own domain? I need https for a portion of my site and using app-id.appspot.com for that is unacceptable. Has anyone found a way to configure their service to work by proxying https://www.mydomain.com to https://app-id.appspot.com? If not, this looks like a clear deal breaker for us on app engine. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Offline processing
I know there are a number of different frameworks and mechanisms to process data offline on GAE. I need to have a daily job that scans one of my datastore tables and computes an updated profile for all my users. What would be the best mechanism to do this? Are task queues appropriate? Should I be using some sort of mapreduce? If I should use some sort of mapreduce framework, how does that integrate with GAE? My user base right now is small, but I intend to scale this. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Offline processing
I see how this is possible, but it feels very clunky. Is this standard practice? Thanks, Phil On Mon, Jul 12, 2010 at 7:09 PM, Pieter Coucke wrote: > For a similar problem I use a task A which fetches 10 entities, creates > subtasks B for them and then creates a new task A with the datastore cursor > as a parameter so this task can continue creating subtasks. > > > > On Mon, Jul 12, 2010 at 1:31 AM, Phil McDonnell < > phil.a.mcdonn...@gmail.com> wrote: > >> I know there are a number of different frameworks and mechanisms to >> process data offline on GAE. I need to have a daily job that scans one of >> my datastore tables and computes an updated profile for all my users. What >> would be the best mechanism to do this? Are task queues appropriate? >> Should I be using some sort of mapreduce? If I should use some sort of >> mapreduce framework, how does that integrate with GAE? My user base right >> now is small, but I intend to scale this. >> >> Thanks, >> Phil >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appeng...@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com >> . >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > > > -- > Pieter Coucke > Onthoo BVBA > http://www.onthoo.com > http://www.koopjeszoeker.be > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appeng...@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com > . > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Source control java app engine
What would you guys recommend for a source control system on GAE for Java? My team started out with github, but the eclipse plug-in has been giving us lots of trouble and we're fed up with it. My team is on windows. I'd love to move to something hosted, like github, in order to keep us from needing a central server. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Non-Google user accounts
We've been initially setting up our user accounts through the UserService. We are wondering how we can have a user account system within our own site. It seems a little strange to have to redirect through Google. Is this possible? If so, what frameworks or techniques are you using? I'm on Java GAE. Thanks so much, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Deploying jsps
I'm deploying my project which contains some jsps. It compiles and runs fine locally. I set it up locally with the jdk instead of the jre to get the jsps to compile locally. When I go to deploy my project through eclipse it says that the jsps won't compile for the deploy I assume that it is linking to the jre still for the deploy instead of the jdk. Does anyone know how to fix this? Error message in eclipse:* Unable to update app: Failed to compile jsp files.* * * Thanks so much, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Deploying jsps
I'm on windows. Any help you can lend on the configuration of this would be much appreciated! Thanks, Phil On Sun, May 8, 2011 at 12:24 PM, supercobra wrote: > I had the same problem. On Windows I just kept the JDK and removed the > JRE. On Linux I had to install a JDK package that was missing. What OS > do you use? > > > -- superco...@gmail.com > http://supercobrablogger.blogspot.com/ > > > > On Sun, May 8, 2011 at 9:32 AM, Phil McDonnell > wrote: > > I'm deploying my project which contains some jsps. It compiles and runs > > fine locally. I set it up locally with the jdk instead of the jre to get > > the jsps to compile locally. When I go to deploy my project through > eclipse > > it says that the jsps won't compile for the deploy > > I assume that it is linking to the jre still for the deploy instead of > the > > jdk. Does anyone know how to fix this? > > > > Error message in eclipse: Unable to update app: Failed to compile jsp > files. > > > > Thanks so much, > > Phil > > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To post to this group, send email to google-appengine@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine+unsubscr...@googlegroups.com. > > For more options, visit this group at > > http://groups.google.com/group/google-appengine?hl=en. > > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Non-Google user accounts
Does anyone have experience integrating the facebook API or anything else for sign ins? I'm shocked that there are not alternatives to using a Google account log-in page. Am I missing something here? Thanks so much, Phil On Wed, May 4, 2011 at 6:36 PM, Phil McDonnell wrote: > We've been initially setting up our user accounts through the UserService. > We are wondering how we can have a user account system within our own site. > It seems a little strange to have to redirect through Google. Is this > possible? If so, what frameworks or techniques are you using? I'm on Java > GAE. > > Thanks so much, > Phil > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Non-Google user accounts
This is a great start conceptually. We're on java and this is using the python libraries. Do you know if someone has done something similar in java? Thanks so much, Phil On Wed, May 11, 2011 at 11:11 PM, Scott Ellis wrote: > Check this out: > > > https://github.com/facebook/python-sdk/blob/master/examples/oauth/facebookoauth.py > > On 12 May 2011 12:55, Phil McDonnell wrote: > >> Does anyone have experience integrating the facebook API or anything else >> for sign ins? I'm shocked that there are not alternatives to using a Google >> account log-in page. Am I missing something here? >> >> Thanks so much, >> Phil >> >> >> On Wed, May 4, 2011 at 6:36 PM, Phil McDonnell < >> phil.a.mcdonn...@gmail.com> wrote: >> >>> We've been initially setting up our user accounts through the >>> UserService. We are wondering how we can have a user account system within >>> our own site. It seems a little strange to have to redirect through Google. >>> Is this possible? If so, what frameworks or techniques are you using? I'm >>> on Java GAE. >>> >>> Thanks so much, >>> Phil >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Dynamic urls
I have an app that contains a number of products. I want these individual product pages to SEO well. So for instance, I want to mysite.com/mini-shop-vac to be the url for my product that is titled "Mini Shop Vac". I have about a thousand products and my inventory is always being updated. I know that urls are normally named via the web.xml file, but is there some way to do more dynamic naming based on something like the title of the data object that is the focus of a page? I am working on app engine in java. Thanks so much, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Best practices for GAE & iOS
Does anyone know of some good best practices out there for building an iOS client on top of your GAE project? If you know of any good tutorials or presentations, that would be fantastic. We have a site built using GAE and we're just designing our mobile strategy. We are starting with iOS, but plan to expand to Android too. We've been searching around and reading up, but I would really appreciate any pointers & wisdom you might have. Thanks so much, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] IOError 0 from simpletext_connector.py during bulk download
I'm downloading data from my app's datastore and applying a simpletext connector to save keys and b64-encoded data from some fields of all entities of a particular type to disk on my local Windows system. The download itself succeeds, giving me a .sql3 database of 50GB, which is consistent with the total entity size reported by the AppEngine dashboard -- so I believe everything gets downloaded okay. However, the simpletext transform fails partway through unpacking the .sql3 database and writing the text file, with an IO error 0. A transcript of the session, including the Python interpreter's call stack, is at the bottom of this post. The command line includes the db_filename and result_db_filename arguments because this is an attempt to resume an earlier session that had failed in the exact same way. Not sure if any of the following is significant: -- I'm doing the download to the E: drive of a VM; this VM has 150GB of storage, about 140GB of which were free before the start of the download -- so there should be enough disk space to store the transformed data. There's only about 1.2GB free on the VM's C: drive. -- The last 2 entries in the call stack refer to files on the C: drive that don't exist -- I had originally installed the AppEngine SDK on C: but moved it to E: before this run, in the belief that the download was failing because there wasn't enough space on C: for temporary storage during the download. The SDK is now on the E: drive, and both TMP and TEMP environment variables are set to e:\temp, which does exist. -- I'm using Python 2.5.4. -- The transfer fails partway through, writing several GB of transformed data to the output file but without completing the transforms. Any tips or clues would be appreciated -- thanks! E:\work\Swapper>appcfg.py download_data --kind=SomeKind --url=http:// someapp.appspot.com/_ah/remote_api --filename=output.dat --config_file=config.yaml --db_filename=bulkloader- progress-20110620.103156.sql3 --result_db_filename=bulkloader- results-20 110620.103156.sql3 --http_limit=10 --bandwidth_limit=25 Downloading data records. [INFO] Logging to bulkloader-log-20110624.113729 [INFO] Throttling transfers: [INFO] Bandwidth: 25 bytes/second [INFO] HTTP connections: 10/second [INFO] Entities inserted/fetched/modified: 20/second [INFO] Batch Size: 10 2011-06-24 11:37:30,858 WARNING appengine_rpc.py:435 ssl module not found. Without the ssl module, the identity of the remote host cannot be verified, and connections may NOT be secure. To fix this, please install the ssl module from http://pypi.python.org/pypi/ssl . To learn more, see http://code.google.com/appengine/kb/general.html#rpcssl . Please enter login credentials for someapp.appspot.com Email: some_u...@gmail.com Password for some_u...@gmail.com: [INFO] Opening database: bulkloader-progress-20110620.103156.sql3 [INFO] Opening database: bulkloader-results-20110620.103156.sql3 [INFO] Connecting to someapp.appspot.com/_ah/remote_api [INFO] Downloading kinds: ['SomeKind'] Traceback (most recent call last): File "E:\google_appengine\appcfg.py", line 76, in run_file(__file__, globals()) File "E:\google_appengine\appcfg.py", line 72, in run_file execfile(script_path, globals_) File "E:\google_appengine\google\appengine\tools\appcfg.py", line 3592, in main(sys.argv) File "E:\google_appengine\google\appengine\tools\appcfg.py", line 3583, in main result = AppCfgApp(argv).Run() File "E:\google_appengine\google\appengine\tools\appcfg.py", line 2229, in Run self.action(self) File "E:\google_appengine\google\appengine\tools\appcfg.py", line 3368, in __call__ return method() File "E:\google_appengine\google\appengine\tools\appcfg.py", line 3174, in PerformDownload run_fn(args) File "E:\google_appengine\google\appengine\tools\appcfg.py", line 3087, in RunBulkloader sys.exit(bulkloader.Run(arg_dict)) File "E:\google_appengine\bulkloader.py", line 4360, in Run File "E:\google_appengine\bulkloader.py", line 4255, in _PerformBulkload File "E:\google_appengine\bulkloader.py", line 3551, in Run File "E:\google_appengine\bulkloader.py", line 2489, in WorkFinished File "C:\google_appengine\google\appengine\ext\bulkload \bulkloader_config.py", line 500, in output_entities File "C:\google_appengine\google\appengine\ext\bulkload \simpletext_connector.py", line 112, in write_dict IOError: [Errno 0] Error -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: How to do a 'count' in App Engine
What's wrong with using the count() method of the returned query set?
i.e.
words = db.GqlQuery("SELECT * FROM MyWords where bookname = 'book1'")
if words.count() > 5:
blah blah
Not the most efficient way if you're only interested in the count (and not
the results).
Phil
On 4 July 2011 09:45, Vlad Software wrote:
> Are you using Python or Java?
> If Python you can write your result to list and use len(my_result).
> But how to put result to list please read manual
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Weekend project: keep your app warm
Isn't the end of point 4.4 applicable here... "or otherwise access the Service in a manner intended to avoid incurring fees" ...as you are avoiding paying the $9/month for an always running instance? Phil On 12 July 2011 08:10, Max wrote: > Agree with your point on tragedy of the commons. The thing is this is not a > new concept. It's already a common practice among many appengine developers. > Without my application, one can still write a dummy cron in 5 mins. Given > that they (unfortunately including me at the moment) will do it anyway, my > app is saving 5 min dev time and 1 cron job execution per minute for each > single url. > > Of course, this is definitely a suboptimal solution. But it should be > Google rather than us to do something on this. I don't think Google has to > build some intelligence to detect this behavior, but at least they should > give use some guideline in forum or GAE document. For example, multiple > deployment of same app is explicitly documented > here<http://code.google.com/appengine/terms.html>(point > 4.4), but I can't find any term applicable to my case. Instead I saw this > same topic been discussed here for many times but no Googler ever give a > negative comment. I will disable my app if I get guideline officially or > un-officially. > > From other side, I don't think it's fair for a site gain a better > performance just because more users are using it. From my point of view, > such regenerative feedback is even worse than your tragedy of the commons. > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/xFonPhtvbLEJ. > > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Team member Google+ profiles
I've heard of it, but can't use it because I'm a Google apps user with my own domain. Any news on when us apps users can create the required Google profile? Phil On 28 July 2011 23:33, Ikai Lan (Google) wrote: > Hey everybody! > > Unless you’ve been under a rock, you’ve probably heard about the Google+ > project. Several of the team members are already on it, and I wanted to post > a thread with our profile information so you can add us to your circles if > you like. A few of us occasionally hold video hangouts which we’ll be > announcing on our Google+ streams. > > Guido van Rossum: https://plus.google.com/115212051037621986145/posts > > Ikai Lan (this is me): https://plus.google.com/115212051037621986145/posts > > Nick Johnson: https://plus.google.com/107671409514652376955/posts > > Johan Euphrosine: https://plus.google.com/111042085517496880918/posts > > Takashi Matsuo (lots of Japanese language hangouts!): > https://plus.google.com/110554344789668969711/posts > > Fred Sauer: https://plus.google.com/115640166224745944209/posts > > Chris Schalk: https://plus.google.com/104599745903075924418/posts > > Patrick Chanezon: https://plus.google.com/106130679598095630483/posts > > Alon Levi (engineering manager): > https://plus.google.com/104703109675446407948/posts > > Most of us talk a lot about Google or developer topics. Guido, for > instance, enjoys running the occasional hangout because he likes to see > people face to face. I post slides from time to time from talks I give. > > Google+ isn't a replacement for these groups, so you'll still want to post > your questions here, but it might be interesting to get to know many of you > on a more personal level. > > Hope to see you all online! > > - Ikai > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] https for mydomain.com?
Can I use https for mydomain.com? I know that I can configure app engine to use https for the myapp.appspot.com, but can I require https for mydomain.com? I'm on Java and my domain is with godaddy. I think I remember this being a recent (within the last year) feature added, but I can't quite figure out how to make it work. Thanks so much, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: https for mydomain.com?
This is pretty disappointing. I was sure it had long since been done. I remember it being on the Q4 2010 roadmap. Is there some work around for this? Thanks, Phil On Fri, Aug 19, 2011 at 4:30 PM, Tim Hoffman wrote: > Nope > > Sorry not here yet, lots of us hanging out for it > > T > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/h0vRLd6u1n4J. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: https for mydomain.com?
I wasn't trying to differentiate mydomain.com vs. www.mydomain.com. I realize there might be issues with naked domains and I'd probably need to have godady forward them to the www equivalent. Does that help at all? On Fri, Aug 19, 2011 at 5:33 PM, Phil McDonnell wrote: > This is pretty disappointing. I was sure it had long since been done. I > remember it being on the Q4 2010 roadmap. Is there some work around for > this? > > Thanks, > Phil > > > On Fri, Aug 19, 2011 at 4:30 PM, Tim Hoffman wrote: > >> Nope >> >> Sorry not here yet, lots of us hanging out for it >> >> T >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To view this discussion on the web visit >> https://groups.google.com/d/msg/google-appengine/-/h0vRLd6u1n4J. >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] New free Datastore backup tool announcement
Anyone using this? Anyone know of other solutions? Thanks, Phil On Tue, Aug 30, 2011 at 6:45 AM, Eli wrote: > Hello all! > > I'd like to introduce you to our newly released App Engine Datastore > backup tool: DatastoreBackup. > We all wanted it for a long time. > Get it at: > http://www.datastorebackup.com > > It can do incremental backups, compression and lots more. > > Go get it! > > Eli, > http://www.datastorebackup.com > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Deploy drops data
Twice now a deploy has cleared several of the data tables in my deployed datastore. Does anyone know what causes this? The symptoms both times are consistent. I do a deploy and the datastore drops several of the tables. Strangely, one very old (and generally unused) table is not dropped and my blob data is still there. Is this dropping of data/tables on deploy a known "feature" that I'm somehow not understanding? Note, this does not happen on every deploy. We are still pre-launch, but I'm extremely concerned that this could happen when we are live. If we drop our data when we are live it would cost us a lot of money. Thanks so much, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Deploy drops data
Hi guys, Apologies for using unclear terminology on this. I understand the details of how the data is stored on BT. This is not local - this is on the production instance. This idea of something happening that makes the data inaccessible sounds possible. I'm running on version 2 of my app. Could that be an issue? I'm not very familiar with the namespace feature, but I can read up on this. Are there other ways that the data might disappear? Ikai, in case it's useful, my app id is coupflipsite. Thanks so much for all the thoughts here. Getting to the bottom of this is extremely important for us and I very much appreciate your wisdom on this. Thanks again, Phil On Fri, Oct 28, 2011 at 2:18 PM, Ikai Lan (Google) wrote: > Thanks for the explanation Barry. Phil, it sounds like you are talking > about the local datastore. Can you clarify? > > -- > Ikai Lan > Developer Programs Engineer, Google App Engine > plus.ikailan.com | twitter.com/ikai > > > > On Fri, Oct 28, 2011 at 3:29 AM, Barry Hunter wrote: > >> That doesn't even make sense >> >> The Datastore has no concept of 'table'. >> >> All Entities - regardless of their kind- are stored in one 'bigtable' >> - they are all intermingled. In fact all Entities from everyone's apps >> are stored in the same bigtable. >> >> So to delete a 'table' - which is really just all entities of a given >> kind for a given app - would need to loop though and delete each >> individual entity. Once there are no entities of a given kind/model >> left, the 'kind' has effectively been dropped. >> >> >> I would guess need to check you aren't somehow using the application >> version in the Kind name or even the key?. Then when the application >> is updated, the version changes and therefore the old entities become >> inaccessible. >> >> >> >> >> >> On Thu, Oct 27, 2011 at 10:17 PM, Phil McDonnell >> wrote: >> > Twice now a deploy has cleared several of the data tables in my deployed >> > datastore. Does anyone know what causes this? The symptoms both times >> are >> > consistent. I do a deploy and the datastore drops several of the >> tables. >> > Strangely, one very old (and generally unused) table is not dropped and >> my >> > blob data is still there. Is this dropping of data/tables on deploy a >> > known "feature" that I'm somehow not understanding? Note, this does not >> > happen on every deploy. >> > We are still pre-launch, but I'm extremely concerned that this could >> happen >> > when we are live. If we drop our data when we are live it would cost us >> a >> > lot of money. >> > Thanks so much, >> > Phil >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups >> > "Google App Engine" group. >> > To post to this group, send email to google-appengine@googlegroups.com. >> > To unsubscribe from this group, send email to >> > google-appengine+unsubscr...@googlegroups.com. >> > For more options, visit this group at >> > http://groups.google.com/group/google-appengine?hl=en. >> > >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> >> > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Deploy drops data
I investigated the namespace idea and I don't believe that's being used here at all. The one data class that is still accessible is a remnant from some earlier work and no longer used which may explain why it doesn't become inaccessible/disappear. Any more ideas on how entire datastore classes might become inaccessible directly after a deploy? It does not happen every time I deploy, but when it does it makes all of our data inaccessible, with the exception of the one data class that we don't use anymore. Thanks for your help and input, Phil On Fri, Oct 28, 2011 at 4:18 PM, Phil McDonnell wrote: > Hi guys, > > Apologies for using unclear terminology on this. I understand the details > of how the data is stored on BT. This is not local - this is on the > production instance. > > This idea of something happening that makes the data inaccessible sounds > possible. I'm running on version 2 of my app. Could that be an issue? I'm > not very familiar with the namespace feature, but I can read up on this. > Are there other ways that the data might disappear? > > Ikai, in case it's useful, my app id is coupflipsite. > > Thanks so much for all the thoughts here. Getting to the bottom of this > is extremely important for us and I very much appreciate your wisdom on > this. > > Thanks again, > Phil > > On Fri, Oct 28, 2011 at 2:18 PM, Ikai Lan (Google) wrote: > >> Thanks for the explanation Barry. Phil, it sounds like you are talking >> about the local datastore. Can you clarify? >> >> -- >> Ikai Lan >> Developer Programs Engineer, Google App Engine >> plus.ikailan.com | twitter.com/ikai >> >> >> >> On Fri, Oct 28, 2011 at 3:29 AM, Barry Hunter wrote: >> >>> That doesn't even make sense >>> >>> The Datastore has no concept of 'table'. >>> >>> All Entities - regardless of their kind- are stored in one 'bigtable' >>> - they are all intermingled. In fact all Entities from everyone's apps >>> are stored in the same bigtable. >>> >>> So to delete a 'table' - which is really just all entities of a given >>> kind for a given app - would need to loop though and delete each >>> individual entity. Once there are no entities of a given kind/model >>> left, the 'kind' has effectively been dropped. >>> >>> >>> I would guess need to check you aren't somehow using the application >>> version in the Kind name or even the key?. Then when the application >>> is updated, the version changes and therefore the old entities become >>> inaccessible. >>> >>> >>> >>> >>> >>> On Thu, Oct 27, 2011 at 10:17 PM, Phil McDonnell >>> wrote: >>> > Twice now a deploy has cleared several of the data tables in my >>> deployed >>> > datastore. Does anyone know what causes this? The symptoms both >>> times are >>> > consistent. I do a deploy and the datastore drops several of the >>> tables. >>> > Strangely, one very old (and generally unused) table is not dropped >>> and my >>> > blob data is still there. Is this dropping of data/tables on deploy a >>> > known "feature" that I'm somehow not understanding? Note, this does >>> not >>> > happen on every deploy. >>> > We are still pre-launch, but I'm extremely concerned that this could >>> happen >>> > when we are live. If we drop our data when we are live it would cost >>> us a >>> > lot of money. >>> > Thanks so much, >>> > Phil >>> > >>> > -- >>> > You received this message because you are subscribed to the Google >>> Groups >>> > "Google App Engine" group. >>> > To post to this group, send email to google-appengine@googlegroups.com >>> . >>> > To unsubscribe from this group, send email to >>> > google-appengine+unsubscr...@googlegroups.com. >>> > For more options, visit this group at >>> > http://groups.google.com/group/google-appengine?hl=en. >>> > >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Google App Engine" group. >>> To post to this group, send email to google-appengine@googlegroups.com. >>> To unsubscribe from this group, send email to >>> google-appengine+unsubscr...@googlegroups.com. >>> For more options, visit this group at >>> http://groups.google.com/group/google-appengine?hl=en. >>> >>> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Deploy drops data
Also, minor possibility, but I noticed "Datastore Admin" was enabled in my settings. Perhaps there is a bug associated with that and deploys? Thanks, Phil On Mon, Oct 31, 2011 at 10:27 AM, Phil McDonnell wrote: > I investigated the namespace idea and I don't believe that's being used > here at all. The one data class that is still accessible is a remnant from > some earlier work and no longer used which may explain why it doesn't > become inaccessible/disappear. > > Any more ideas on how entire datastore classes might become inaccessible > directly after a deploy? It does not happen every time I deploy, but when > it does it makes all of our data inaccessible, with the exception of the > one data class that we don't use anymore. > > Thanks for your help and input, > Phil > > > On Fri, Oct 28, 2011 at 4:18 PM, Phil McDonnell < > phil.a.mcdonn...@gmail.com> wrote: > >> Hi guys, >> >> Apologies for using unclear terminology on this. I understand the >> details of how the data is stored on BT. This is not local - this is on the >> production instance. >> >> This idea of something happening that makes the data inaccessible sounds >> possible. I'm running on version 2 of my app. Could that be an issue? I'm >> not very familiar with the namespace feature, but I can read up on this. >> Are there other ways that the data might disappear? >> >> Ikai, in case it's useful, my app id is coupflipsite. >> >> Thanks so much for all the thoughts here. Getting to the bottom of this >> is extremely important for us and I very much appreciate your wisdom on >> this. >> >> Thanks again, >> Phil >> >> On Fri, Oct 28, 2011 at 2:18 PM, Ikai Lan (Google) wrote: >> >>> Thanks for the explanation Barry. Phil, it sounds like you are talking >>> about the local datastore. Can you clarify? >>> >>> -- >>> Ikai Lan >>> Developer Programs Engineer, Google App Engine >>> plus.ikailan.com | twitter.com/ikai >>> >>> >>> >>> On Fri, Oct 28, 2011 at 3:29 AM, Barry Hunter wrote: >>> >>>> That doesn't even make sense >>>> >>>> The Datastore has no concept of 'table'. >>>> >>>> All Entities - regardless of their kind- are stored in one 'bigtable' >>>> - they are all intermingled. In fact all Entities from everyone's apps >>>> are stored in the same bigtable. >>>> >>>> So to delete a 'table' - which is really just all entities of a given >>>> kind for a given app - would need to loop though and delete each >>>> individual entity. Once there are no entities of a given kind/model >>>> left, the 'kind' has effectively been dropped. >>>> >>>> >>>> I would guess need to check you aren't somehow using the application >>>> version in the Kind name or even the key?. Then when the application >>>> is updated, the version changes and therefore the old entities become >>>> inaccessible. >>>> >>>> >>>> >>>> >>>> >>>> On Thu, Oct 27, 2011 at 10:17 PM, Phil McDonnell >>>> wrote: >>>> > Twice now a deploy has cleared several of the data tables in my >>>> deployed >>>> > datastore. Does anyone know what causes this? The symptoms both >>>> times are >>>> > consistent. I do a deploy and the datastore drops several of the >>>> tables. >>>> > Strangely, one very old (and generally unused) table is not dropped >>>> and my >>>> > blob data is still there. Is this dropping of data/tables on deploy >>>> a >>>> > known "feature" that I'm somehow not understanding? Note, this does >>>> not >>>> > happen on every deploy. >>>> > We are still pre-launch, but I'm extremely concerned that this could >>>> happen >>>> > when we are live. If we drop our data when we are live it would cost >>>> us a >>>> > lot of money. >>>> > Thanks so much, >>>> > Phil >>>> > >>>> > -- >>>> > You received this message because you are subscribed to the Google >>>> Groups >>>> > "Google App Engine" group. >>>> > To post to this group, send email to >>>> google-appengine@googlegroups.com. >>
Re: [google-appengine] Deploy drops data
Sadly, the source app is java so I can't run the datastore admin. Enabling the feature it was a mistake. On Mon, Oct 31, 2011 at 10:35 AM, Barry Hunter wrote: > Well I was just going to suggest you use the datasotre admin > http://code.google.com/appengine/docs/adminconsole/datastoreadmin.html > > to view your datastore, to see if the data is still there. > > On Mon, Oct 31, 2011 at 2:32 PM, Phil McDonnell > wrote: > > Also, minor possibility, but I noticed "Datastore Admin" was enabled in > my > > settings. Perhaps there is a bug associated with that and deploys? > > Thanks, > > Phil > > > > On Mon, Oct 31, 2011 at 10:27 AM, Phil McDonnell > > wrote: > >> > >> I investigated the namespace idea and I don't believe that's being used > >> here at all. The one data class that is still accessible is a remnant > from > >> some earlier work and no longer used which may explain why it doesn't > become > >> inaccessible/disappear. > >> Any more ideas on how entire datastore classes might become inaccessible > >> directly after a deploy? It does not happen every time I deploy, but > when > >> it does it makes all of our data inaccessible, with the exception of > the one > >> data class that we don't use anymore. > >> Thanks for your help and input, > >> Phil > >> > >> On Fri, Oct 28, 2011 at 4:18 PM, Phil McDonnell > >> wrote: > >>> > >>> Hi guys, > >>> Apologies for using unclear terminology on this. I understand the > >>> details of how the data is stored on BT. This is not local - this is > on the > >>> production instance. > >>> This idea of something happening that makes the > data inaccessible sounds > >>> possible. I'm running on version 2 of my app. Could that be an issue? > I'm > >>> not very familiar with the namespace feature, but I can read up on > this. > >>> Are there other ways that the data might disappear? > >>> Ikai, in case it's useful, my app id is coupflipsite. > >>> Thanks so much for all the thoughts here. Getting to the bottom of > this > >>> is extremely important for us and I very much appreciate your wisdom on > >>> this. > >>> Thanks again, > >>> Phil > >>> On Fri, Oct 28, 2011 at 2:18 PM, Ikai Lan (Google) > >>> wrote: > >>>> > >>>> Thanks for the explanation Barry. Phil, it sounds like you are talking > >>>> about the local datastore. Can you clarify? > >>>> -- > >>>> Ikai Lan > >>>> Developer Programs Engineer, Google App Engine > >>>> plus.ikailan.com | twitter.com/ikai > >>>> > >>>> > >>>> On Fri, Oct 28, 2011 at 3:29 AM, Barry Hunter > > >>>> wrote: > >>>>> > >>>>> That doesn't even make sense > >>>>> > >>>>> The Datastore has no concept of 'table'. > >>>>> > >>>>> All Entities - regardless of their kind- are stored in one 'bigtable' > >>>>> - they are all intermingled. In fact all Entities from everyone's > apps > >>>>> are stored in the same bigtable. > >>>>> > >>>>> So to delete a 'table' - which is really just all entities of a given > >>>>> kind for a given app - would need to loop though and delete each > >>>>> individual entity. Once there are no entities of a given kind/model > >>>>> left, the 'kind' has effectively been dropped. > >>>>> > >>>>> > >>>>> I would guess need to check you aren't somehow using the application > >>>>> version in the Kind name or even the key?. Then when the application > >>>>> is updated, the version changes and therefore the old entities become > >>>>> inaccessible. > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> > >>>>> On Thu, Oct 27, 2011 at 10:17 PM, Phil McDonnell > >>>>> wrote: > >>>>> > Twice now a deploy has cleared several of the data tables in my > >>>>> > deployed > >>>>> > datastore. Does anyone know what causes this? The symptoms both > >>>>> > times are > >>>>> > consisten
Re: [google-appengine] Deploy drops data
My understanding is that only python services can be backed up using the datastore admin. The wording on the "A Note for Java Developers" is only for the "target" application. I'm trying to back up a java app which means my java app is the "source" instead of the "target". On Tue, Nov 1, 2011 at 1:38 PM, Barry Hunter wrote: > You can > http://code.google.com/appengine/docs/adminconsole/datastoreadmin.html > > See the "A Note for Java Developers" section. > > > > On Tue, Nov 1, 2011 at 4:45 PM, Phil McDonnell > wrote: > > Sadly, the source app is java so I can't run the datastore admin. > Enabling > > the feature it was a mistake. > > > > On Mon, Oct 31, 2011 at 10:35 AM, Barry Hunter > > wrote: > >> > >> Well I was just going to suggest you use the datasotre admin > >> http://code.google.com/appengine/docs/adminconsole/datastoreadmin.html > >> > >> to view your datastore, to see if the data is still there. > >> > >> On Mon, Oct 31, 2011 at 2:32 PM, Phil McDonnell > >> wrote: > >> > Also, minor possibility, but I noticed "Datastore Admin" was enabled > in > >> > my > >> > settings. Perhaps there is a bug associated with that and deploys? > >> > Thanks, > >> > Phil > >> > > >> > On Mon, Oct 31, 2011 at 10:27 AM, Phil McDonnell > >> > wrote: > >> >> > >> >> I investigated the namespace idea and I don't believe that's being > used > >> >> here at all. The one data class that is still accessible is a remnant > >> >> from > >> >> some earlier work and no longer used which may explain why it doesn't > >> >> become > >> >> inaccessible/disappear. > >> >> Any more ideas on how entire datastore classes might become > >> >> inaccessible > >> >> directly after a deploy? It does not happen every time I deploy, but > >> >> when > >> >> it does it makes all of our data inaccessible, with the exception of > >> >> the one > >> >> data class that we don't use anymore. > >> >> Thanks for your help and input, > >> >> Phil > >> >> > >> >> On Fri, Oct 28, 2011 at 4:18 PM, Phil McDonnell > >> >> wrote: > >> >>> > >> >>> Hi guys, > >> >>> Apologies for using unclear terminology on this. I understand the > >> >>> details of how the data is stored on BT. This is not local - this is > >> >>> on the > >> >>> production instance. > >> >>> This idea of something happening that makes the > >> >>> data inaccessible sounds > >> >>> possible. I'm running on version 2 of my app. Could that be an > issue? > >> >>> I'm > >> >>> not very familiar with the namespace feature, but I can read up on > >> >>> this. > >> >>> Are there other ways that the data might disappear? > >> >>> Ikai, in case it's useful, my app id is coupflipsite. > >> >>> Thanks so much for all the thoughts here. Getting to the bottom of > >> >>> this > >> >>> is extremely important for us and I very much appreciate your wisdom > >> >>> on > >> >>> this. > >> >>> Thanks again, > >> >>> Phil > >> >>> On Fri, Oct 28, 2011 at 2:18 PM, Ikai Lan (Google) < > ika...@google.com> > >> >>> wrote: > >> >>>> > >> >>>> Thanks for the explanation Barry. Phil, it sounds like you are > >> >>>> talking > >> >>>> about the local datastore. Can you clarify? > >> >>>> -- > >> >>>> Ikai Lan > >> >>>> Developer Programs Engineer, Google App Engine > >> >>>> plus.ikailan.com | twitter.com/ikai > >> >>>> > >> >>>> > >> >>>> On Fri, Oct 28, 2011 at 3:29 AM, Barry Hunter > >> >>>> > >> >>>> wrote: > >> >>>>> > >> >>>>> That doesn't even make sense > >> >>>>> > >> >>>>> The Datastore has no concept of 'table'. > >> >>>>> > >> >>
Re: [google-appengine] Re: broken Duplicate Application button preventing HRD migration
Thanks Brandon. So it seems to work for you but not me. I expected the behavior you describe with a new app called "oldappname-hrd" being created. But nothing happened. The "oldappname-hrd" is still available for creation. I think there must be something broken in my account that is preventing me from creating new apps or duplicating old ones. I will probably need Google to fix that. I guess I will have to pony up the $500/month. Sigh. Phil On 11/23/11 12:50 PM, Brandon Wirtz wrote: I pushed the button. And I don't think it did anything except make a new app with the new APP Id, and a "title" the same as the duped App. I think it did take the Developer and Admin permissions, but I suspect I'm one of the few people that has admins and developers, and not just 1 account that does everything. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Datastore applied
I'm in java on GWT app engine and I'm having some intermittent issues where it looks like datastore put() commands are not being reflected by subsequent get() calls. From my reading I thought this was not possible. Am I mistaken? Here's what I'm doing... // STATE A Entity x = ... datastore.put(x); // STATE B ... x = ... some new values ... datastore.put(x); // STATE C ... datastore.get(keyOfX); The final get() sometimes returns an x of state C and sometimes it returns an x of state B. Any idea why this happens? I'm assuming it's some sort of concurrency thing within my app, but perhaps I've misunderstood the datastore guarantees? Should the get() always get an x from state C? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Datastore applied
No, the puts/gets are executing normally. I did try wrapping the puts() in a transaction, but it didn't help. If I wrap just the get() in a transaction should that somehow trigger the puts() to apply? Is there some way to wait? Thanks so much, Phil On Tue, Dec 6, 2011 at 10:17 PM, Jeff Schnitzer wrote: > Are you executing in a transaction? get()s in a transaction always show > the entity "frozen in time" as of the start of the transaction. Even if > you put() a change, get() will show the old value until the transaction is > committed. > > Jeff > > On Tue, Dec 6, 2011 at 10:26 PM, Phil McDonnell < > phil.a.mcdonn...@gmail.com> wrote: > >> I'm in java on GWT app engine and I'm having some intermittent issues >> where it looks like datastore put() commands are not being reflected by >> subsequent get() calls. From my reading I thought this was not possible. >> Am I mistaken? >> >> Here's what I'm doing... >> >> // STATE A >> Entity x = ... >> datastore.put(x); >> // STATE B >> ... >> x = ... some new values ... >> datastore.put(x); >> // STATE C >> ... >> datastore.get(keyOfX); >> >> >> The final get() sometimes returns an x of state C and sometimes it >> returns an x of state B. Any idea why this happens? I'm assuming it's >> some sort of concurrency thing within my app, but perhaps I've >> misunderstood the datastore guarantees? Should the get() always get an x >> from state C? >> >> Thanks, >> Phil >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > > > -- > We are the 20% > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Datastore applied
As it turns out, I was using a Query and not a get(). I believe Queries might not be guaranteed to return everything that has been put(), right? That would explain the inconsistencies I've been seeing if this is the case. Can someone confirm this? Thanks, Phil On Tue, Dec 6, 2011 at 9:31 PM, YuchTing wrote: > check > http://code.google.com/status/**appengine<http://code.google.com/status/appengine>for > GAE current status. > > Is GAE datastore abnomal? > > 于 2011-12-7 10:26, Phil McDonnell 写道: > >> I'm in java on GWT app engine and I'm having some intermittent issues >> where it looks like datastore put() commands are not being reflected by >> subsequent get() calls. From my reading I thought this was not >> possible. Am I mistaken? >> >> Here's what I'm doing... >> >>// STATE A >>Entity x = ... >>datastore.put(x); >>// STATE B >>... >>x = ... some new values ... >>datastore.put(x); >>// STATE C >>... >>datastore.get(keyOfX); >> >> >> The final get() sometimes returns an x of state C and sometimes it >> returns an x of state B. Any idea why this happens? I'm assuming it's >> some sort of concurrency thing within my app, but perhaps I've >> misunderstood the datastore guarantees? Should the get() always get an >> x from state C? >> >> Thanks, >> Phil >> >> -- >> You received this message because you are subscribed to the Google >> Groups "Google App Engine" group. >> To post to this group, send email to >> google-appengine@googlegroups.**com >> . >> To unsubscribe from this group, send email to >> google-appengine+unsubscribe@**googlegroups.com >> . >> For more options, visit this group at >> http://groups.google.com/**group/google-appengine?hl=en<http://groups.google.com/group/google-appengine?hl=en> >> . >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to > google-appengine@googlegroups.**com > . > To unsubscribe from this group, send email to > google-appengine+unsubscribe@**googlegroups.com > . > For more options, visit this group at http://groups.google.com/** > group/google-appengine?hl=en<http://groups.google.com/group/google-appengine?hl=en> > . > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Watij on appengine
Has anyone used Watij on appengine? This is a library that runs a browser locally in order to automate filling out fields in a webpage. I just tried using it from a jsp servlet to test and it failed because it calls some privileged methods to run the browser. Has anyone gotten it to work? Anyone know if it'll work in regular java if I trigger it via a task queue instead of a jsp? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: Watij on appengine
As a follow up, would htmlunit be a better choice for web scraping / automation within App Engine? On Tue, Dec 13, 2011 at 6:48 PM, Phil McDonnell wrote: > Has anyone used Watij on appengine? This is a library that runs a browser > locally in order to automate filling out fields in a webpage. > > I just tried using it from a jsp servlet to test and it failed because it > calls some privileged methods to run the browser. Has anyone gotten it to > work? Anyone know if it'll work in regular java if I trigger it via a task > queue instead of a jsp? > > Thanks, > Phil > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Exception invoking jsxGet_cookie using HTMLUnit 2.8
Did you ever find a fix to this? I'm on HtmlUnit 2.9. I'm hitting the
exact same issue.
Thanks,
Phil
On Sun, Feb 20, 2011 at 5:20 AM, sheamuso wrote:
> Hi,
>
> I get the exception: java.lang.RuntimeException: Server Error: Wrapped
> com.gargoylesoftware.htmlunit.ScriptException: Exception invoking
> jsxGet_cookie
>
> Error occurs when trying to run HTMLUnit 2.8 against a GWT web page.
> It works when trying to fetch the html unit home page.
>
> Also if I run it within a main method in the same project this code
> works, but not within app engine:
> final HtmlPage page4 = webClient.getPage("http://gwt.google.com/
> samples/Showcase/Showcase.html#!CwBasicPopup");
> log.info(page4.getTitleText());
>
> Any ideas?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Watij on appengine
I tried HtmlUnit too, but hit what I believe is a bug stopping it from working with AppEngine. Have others not his the issue with jsx cookies described here? http://old.nabble.com/%22Exception-invoking-jsxFunction_send%22-when-using-NicelyResynchronizingAjaxController-in-Google-App-Engine-environment-td32076273.html I is apparently an appengine bug from here: http://code.google.com/p/googleappengine/issues/detail?id=4784 On Wed, Dec 14, 2011 at 2:12 AM, Ernesto Oltra wrote: > I've used HtmlUnit before. It has a nice integration with the restricted > environment of AppEngine. It works. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/ZknSo0OTxR4J. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Moving history from external js
I have a GWT app that is wrapped in an iframe within a base html page. I'd like to add a few navigational links (not actual links, but js powered ones) in the html wrapper part that allow me to change the state of the GWT app. I was thinking that I could change the src attribute in the iframe that wraps the GWT app to navigate to a desired history token. Is there a better way to do this navigation from outside gwt, apart from putting everything in gwt? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Automated Java backup solutions
What are people using for GAE java automated backup these days? I know there is a python solution out there. Has anyone implemented the python solution for their java app? If so, how did it go? I'd really like an automated solution. I'm on the standard (non-HRD) database. Would I be better to just upgrade to HRD instead? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Saving session data from javascript
I know app engine saves the session data into the datastore. Is there a way to get access to this from my javascript? For instance, my users log into facebook via a js api so I'd like to be able to quickly save the fb id handles to the session from my js code. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Saving session data from javascript
I definitely get that I need to connect the js to the java server side code via some sort of AJAX. Are there some standard or easy ways to implement this? I remember from a past project that there were some clunky, but generally good ways to do this in GWT. Does regular java appengine have anything similar or is there a popular way to do this? Thanks so much, Phil On Wed, Jan 18, 2012 at 4:13 PM, Jeff Deskins wrote: > You would have to make an AJAX call passing the data to your app. From > there, your server side code (Java/Python/Go) can save the info into the > datastore or put it into session. > > Jeff > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/tPKQc1l6vv0J. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Gmail API from GAE
Has anyone been able to automatically access a gmail account via the gmail api from GAE in Java? I had one of my engineers try to access the gmail api, but he's hitting a number of security constraints with oauth that are baked into GAE. Is it hopeless? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Channel API issues
BeaconPush are stopping offering a hosted service as of September 2012. See http://blog.beaconpush.com/post/17708826108/discontinuation-of-cloud-plan Your options now are Pusher <http://pusher.com> (who I work for) and others listed on my realtime web technology guide<http://www.leggetter.co.uk/real-time-web-technologies-guide> . Regards, Phil @leggetter On Tuesday, 3 April 2012 11:03:52 UTC+1, Aleksei Rovenski wrote: > > You are probably right. We should consider something like beaconpush, > maybe it makes more sense. > > cheers, > Aleksei > > On Monday, April 2, 2012 9:33:54 PM UTC+3, Tom Davis wrote: >> >> On Mon, 02 Apr 2012 07:08:29 -0700, Aleksei Rovenski wrote: >> > Hi all, >> > >> > This is critical and started to happen 2-3 hours ago. >> > First of all connected presence is not coming anymore (disconnected >> comes). >> > This broke a flow in our application (yagoloo-chat). >> > We added a tmp workaround to exclude connected presence handler from >> app >> > flow, but only to find out that messages are now not reaching clients. >> > So client creates the channel and notifies the server that it is ready >> to >> > receive messages, server sends message, but client never gets it. >> > Maybe one out of 20 is getting the message. This is really critical as >> our >> > application is a chat app. >> > Please help, >> >> Not terribly helpful perhaps, but in using the channel API I always had >> to build >> in polling backups because it wasn't uncommon at all for messages to not >> be >> received. Presumably the chat messages are stored somewhere, so how about >> adding >> a timeout such that if the client doesn't receive a message within N >> seconds, >> poll for any missed messages? >> >> Maybe it's just me, but I never considered the channel API to be very >> robust. >> Tokens randomly didn't work, exceptions were raised from the library for >> seemingly no reason, etc. I just use it as a tool to drastically cut down >> on >> Datastore queries, not as the foundation of an application. >> >> > >> > cheers, >> > Aleksei >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups "Google App Engine" group. >> > To view this discussion on the web visit >> https://groups.google.com/d/msg/google-appengine/-/4PMdsL9OPJIJ. >> > To post to this group, send email to google-appengine@googlegroups.com. >> > To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> > For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > >> >> -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/WUby-8JKYUgJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] 10mb deploy size limit
Does anyone know what is counted in the size limit for deploying? It would seem my war and src directories are counted. Are jars counted too? Are they compressed? I'm trying to trim the size of my project, but I'm not entirely sure why it's too big. I assume there is no way to expand this limit? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: 10mb deploy size limit
Did something recently change here? I've been trimming the fat from my app for half the afternoon and I'm still not there. This wasn't an issue for my team as of yesterday. Any ideas what could be happening? Any ideas on debugging it? Are other seeing this? Thanks, Phil On Wed, Aug 1, 2012 at 3:24 PM, Phil McDonnell wrote: > Does anyone know what is counted in the size limit for deploying? It would > seem my war and src directories are counted. Are jars counted too? Are they > compressed? I'm trying to trim the size of my project, but I'm not entirely > sure why it's too big. > > I assume there is no way to expand this limit? > > Thanks, > Phil > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: 10mb deploy size limit
>From previous discussions here, I'm pretty sure 10MB is the code size limit for the whole code app, not just for a single file. I think people normally run into this as a problem when they upload data files as part of their war directory, but I'm not doing that here. Also, this seems to be pretty different than what was happening a day ago. Are the restrictions different when deploying from eclipse or ant? How does one deploy from ant? I'm looking for an explanation from someone who knows what files are counted towards this 10MB limit and where these files live (class directories, the entire war, etc?). It looks like we're only getting through about 300 of 525 application files so we're not even close. This has worked for a year previously. See below for the console output from eclipse. Thanks, Phil Deploying frontend Preparing to deploy: Created staging directory at: 'C:\Users\LOCAL~1.ADM\AppData\Local\Temp\appcfg1953522436737383216.tmp' Scanning for jsp files. Compiling jsp files. Scanning files on local disk. Scanned 250 files. Scanned 500 files. Initiating update. Cloning 62 static files. Cloning 525 application files. Cloned 100 files. Cloned 200 files. Cloned 300 files. on backend null. com.google.appengine.tools.admin.HttpIoException: Error posting to URL: https://appengine.google.com/api/appversion/clonefiles?app_id=coupflipsite&version=9&; 400 Bad Request See https://developers.google.com/appengine/docs/quotas#Code : Uploaded application size has exceeded the limit: 1074329404 > 1073741824 On Wed, Aug 1, 2012 at 10:39 PM, Richard Watson wrote: > That size limit would be for a single file, not the whole app. Are you > deploying via ant or eclipse? Try deploying to a different test app and > see if you hit the same issues. > > > On Thursday, August 2, 2012 2:00:39 AM UTC+2, Phil wrote: > >> Did something recently change here? I've been trimming the fat from my >> app for half the afternoon and I'm still not there. This wasn't an issue >> for my team as of yesterday. Any ideas what could be happening? Any ideas >> on debugging it? Are other seeing this? >> >> Thanks, >> Phil >> >> >> On Wed, Aug 1, 2012 at 3:24 PM, Phil McDonnell wrote: >> >>> Does anyone know what is counted in the size limit for deploying? It >>> would seem my war and src directories are counted. Are jars counted too? >>> Are they compressed? I'm trying to trim the size of my project, but I'm not >>> entirely sure why it's too big. >>> >>> I assume there is no way to expand this limit? >>> >>> Thanks, >>> Phil >>> >> >> -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/-fW043HNIp8J. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: 10mb deploy size limit
Christina, Andrei, You guys are life savers. Thank you so much! As you identified, I was simply looking at this wrong because I misread the error message and thought I hit the 10MB limit for a single code version (maybe the 10MB limit doesn't even exist these days?). Anyhow, we definitely do have several versions out there that we've used for testing. I will zap those and get it back deploying. Thanks again for your help! Phil On Thu, Aug 2, 2012 at 11:19 AM, Christina Ilvento wrote: > Hi All, > > This is likely due to the 1GB of code and static files quota for all > versions <https://developers.google.com/appengine/docs/quotas#Code> -- > try deleting an older version of your app if you are hitting this limit > consistently to free up some space. In a future release, we plan to allow > applications to pay for additional code and static files storage beyond the > current 1GB limit. If you're still having a problem, please contact me > directly with your app-id. > > > Thanks, > Christina > > > On Thu, Aug 2, 2012 at 11:03 AM, Andrei Volgin > wrote: > >> Phil, >>> >>> >> Your record shows that you exceeded 1GB limit (1073741824 bytes), not >> 10MB. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To view this discussion on the web visit >> https://groups.google.com/d/msg/google-appengine/-/_1QJBWIITmoJ. >> >> To post to this group, send email to google-appengine@googlegroups.com. >> To unsubscribe from this group, send email to >> google-appengine+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Wildcard in web.xml creates infinite directories?
Apparently, I am creating infinite sub-directories from a web crawler's perspective due to a wildcard I have in my web.xml. I have a single jsp file that dynamically handles all requests to the directory mysite.com/deals/*. The goal here was for the jsp to handle mysite.com/deals/some-deal-name-here. However, crawlers apparently are also picking up on mysite.com/deals/deals/some-deal-name-herewhich unfortunately looks like duplicate content from a web crawler perspective. This is not good for search ranking. Is there a way to configure my web.xml in order to stop this from happening? *Here's what I have in my web.xml:* deal */deals/** deal /deal.jsp *Here's what I tried to fix it:* deal */deals/[a-z0-9_A-Z-]** deal /deal.jsp Any ideas for other ways to potentially configure this? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Wildcard in web.xml creates infinite directories?
Fantastic. This is a perfect way to get around the issue. Thanks for your help! Phil On Tue, Aug 7, 2012 at 6:27 PM, hyperflame wrote: > If crawlers are requesting deals/deals/deal-name instead of deals/deal- > name, that means that someone is linking to your site ( or you're > linking to your own site ) with the first method. You might want to > double check that your internal links, and any links that you're > promoting, are correctly written. It's easy to accidentally do this, > especially when you're using relative links. > > If you can't find anything wrong, then you can write some code into > your Deal servlet to correctly route the request. Use getRequestURI > ( > http://docs.oracle.com/javaee/6/api/javax/servlet/http/HttpServletRequest.html#getRequestURI() > ) to get the path the request used. If you find "deals" twice in the > path, you can issue a 301 Moved Permanently, then redirect the client > to deals/deal-name appropriately. Crawlers won't penalize you for a > 301. > > On Aug 7, 8:04 pm, Phil McDonnell wrote: > > Apparently, I am creating infinite sub-directories from a web crawler's > > perspective due to a wildcard I have in my web.xml. I have a single jsp > > file that dynamically handles all requests to the directory > > mysite.com/deals/*. The goal here was for the jsp to handle > > mysite.com/deals/some-deal-name-here. However, crawlers apparently are > > also picking up on mysite.com/deals/deals/some-deal-name-herewhich > > unfortunately looks like duplicate content from a web crawler > > perspective. This is not good for search ranking. Is there a way to > > configure my web.xml in order to stop this from happening? > > > > *Here's what I have in my web.xml:* > > > > deal > > */deals/** > > > > > > deal > > /deal.jsp > > > > > > *Here's what I tried to fix it:* > > > > deal > > */deals/[a-z0-9_A-Z-]** > > > > > > deal > > /deal.jsp > > > > > > Any ideas for other ways to potentially configure this? > > > > Thanks, > > Phil > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Setting chunksize on datastore queries?
Any best practices out there for setting chunksize on datastore queries? I have a query that looks through 80k Entities of a particular kind. I get a warning about setting my chunksize on query, but I'm not really sure what would be appropriate or even what the default is. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Queries hitting deadline
In some initialization work my app needs to run through the all of the datastore entities of a given kind. I have a lot of these entities (80k currently) and it's increasing rapidly. I'm currently trying to read these in using a single datastore query, but running up against the default datastore timeout of 30 seconds. Is there a good practice for sharding this or otherwise breaking this up so that I won't hit these deadlines? I was thinking I would do a keyOnly query and then break up the keys into a number of reasonably sized sub-queries, but perhaps there is a better approach out there? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] HRD Migration & Blob keys
I'm looking at migrating to HRD and I use the blob store. In my datastore I have one Kind of entity that stores a blob key as one of the fields in the Entity. I see that the HRD migration warns about blob keys stored in "serialized form." Pardon my ignorance, but are my blob keys that I mentioned stored in serialized form? Quotation from the documentation & example of my blob key in the Entity (highlighted yellow) below. Thanks, Phil *Warning from the HRD Migration:* If your application has blob data in Blobstore, you need to migrate that blob data as well. Check the checkbox labeled *Migrate Blobstore Data*. The blobs will be copied and given new blob keys in the new application, and the Datastore will be updated with the new blob keys. (However, any blob keys stored in serialized form within the Datastore will *not* be migrated; see Migrating Serialized Blob Keys<https://developers.google.com/appengine/docs/adminconsole/migration#Migrating_Serialized_Blob_Keys>, below, for more information.) *Example of my datastore from the datastore viewer:* ID/NamecompletecouponKeydatedealIDdealVariantfraudulentnumSoldppemailprice purchasesolduidverifiedaddress1address2charitycityfullnamestatezipid=174125<https://appengine.google.com/datastore/edit?app_id=coupflipsite&version_id=3.361250345819739095&key=agxjb3VwZmxpcHNpdGVyEwsSC1RyYW5zYWN0aW9uGK3QCgw> True AMIfv95dj6WTPGjP8P38yQrSmjbPs6eqWCFpvafA0Y9KoROcostO8OiHMWOwZKFfqmNwfi2s9pXyK7Bz8cOIG-CSPnv-T9r0ac9Fn_c5carOHrpRBxFz-Pm3zcI4j93-MDHssxDpC6PdnKY5P3Dr66BrGLHWqoBNzQ View blob<https://appengine.google.com/blobstore/detail?app_id=coupflipsite&key=AMIfv95dj6WTPGjP8P38yQrSmjbPs6eqWCFpvafA0Y9KoROcostO8OiHMWOwZKFfqmNwfi2s9pXyK7Bz8cOIG-CSPnv-T9r0ac9Fn_c5carOHrpRBxFz-Pm3zcI4j93-MDHssxDpC6PdnKY5P3Dr66BrGLHWqoBNzQ> 2012-01-23 05:19:04.658000asdf0False1asdf@asdf.com4.0FalseTrue10709668True -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Queries hitting deadline
I can definitely do the work in a task, but the deadline I'm hitting is the read deadline from the datastore. I believe that will be the same for tasks, right? Thanks, Phil On Fri, Aug 24, 2012 at 12:18 AM, timh wrote: > If your count keeps increasing you will always run into some sort of time > limit. Why not consider doing this processing in a task (they can run for > 10mins, or multiple tasks. ) I am assuming your trying to summarise etc > > T > > > On Friday, August 24, 2012 3:26:00 AM UTC+8, Phil wrote: >> >> In some initialization work my app needs to run through the all of the >> datastore entities of a given kind. I have a lot of these entities (80k >> currently) and it's increasing rapidly. I'm currently trying to read these >> in using a single datastore query, but running up against the default >> datastore timeout of 30 seconds. >> >> Is there a good practice for sharding this or otherwise breaking this up >> so that I won't hit these deadlines? I was thinking I would do a keyOnly >> query and then break up the keys into a number of reasonably sized >> sub-queries, but perhaps there is a better approach out there? >> >> Thanks, >> Phil >> > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/5x0WQc9ODVwJ. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: HRD Migration & Blob keys
Is anyone familiar with this blobstore issue in the HRD migration? Thanks, Phil On Thu, Aug 23, 2012 at 4:39 PM, Phil McDonnell wrote: > I'm looking at migrating to HRD and I use the blob store. In my datastore > I have one Kind of entity that stores a blob key as one of the fields in > the Entity. I see that the HRD migration warns about blob keys stored in > "serialized form." Pardon my ignorance, but are my blob keys that I > mentioned stored in serialized form? Quotation from the documentation & > example of my blob key in the Entity (highlighted yellow) below. > > Thanks, > Phil > > *Warning from the HRD Migration:* > > If your application has blob data in Blobstore, you need to migrate that > blob data as well. Check the checkbox labeled *Migrate Blobstore Data*. > The blobs will be copied and given new blob keys in the new application, > and the Datastore will be updated with the new blob keys. (However, any > blob keys stored in serialized form within the Datastore will *not* be > migrated; see Migrating Serialized Blob > Keys<https://developers.google.com/appengine/docs/adminconsole/migration#Migrating_Serialized_Blob_Keys>, > below, for more information.) > > *Example of my datastore from the datastore viewer:* > ID/Namecomplete couponKeydate dealIDdealVariant fraudulentnumSoldppemail > price purchasesold uidverified address1address2 charitycity fullnamestatezip > id=174125<https://appengine.google.com/datastore/edit?app_id=coupflipsite&version_id=3.361250345819739095&key=agxjb3VwZmxpcHNpdGVyEwsSC1RyYW5zYWN0aW9uGK3QCgw>True > AMIfv95dj6WTPGjP8P38yQrSmjbPs6eqWCFpvafA0Y9KoROcostO8OiHMWOwZKFfqmNwfi2s9pXyK7Bz8cOIG-CSPnv-T9r0ac9Fn_c5carOHrpRBxFz-Pm3zcI4j93-MDHssxDpC6PdnKY5P3Dr66BrGLHWqoBNzQ > View > blob<https://appengine.google.com/blobstore/detail?app_id=coupflipsite&key=AMIfv95dj6WTPGjP8P38yQrSmjbPs6eqWCFpvafA0Y9KoROcostO8OiHMWOwZKFfqmNwfi2s9pXyK7Bz8cOIG-CSPnv-T9r0ac9Fn_c5carOHrpRBxFz-Pm3zcI4j93-MDHssxDpC6PdnKY5P3Dr66BrGLHWqoBNzQ> > 2012-01-23 05:19:04.658000 asdf 0False 1a...@asdf.com 4.0 FalseTrue10709668 > True > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Re: HRD Migration & Blob keys
Think I've got it now. No need to reply here. Thanks, Phil On Fri, Aug 24, 2012 at 10:46 AM, Phil McDonnell wrote: > Is anyone familiar with this blobstore issue in the HRD migration? > > Thanks, > Phil > > > On Thu, Aug 23, 2012 at 4:39 PM, Phil McDonnell < > phil.a.mcdonn...@gmail.com> wrote: > >> I'm looking at migrating to HRD and I use the blob store. In my >> datastore I have one Kind of entity that stores a blob key as one of the >> fields in the Entity. I see that the HRD migration warns about blob keys >> stored in "serialized form." Pardon my ignorance, but are my blob keys that >> I mentioned stored in serialized form? Quotation from the documentation & >> example of my blob key in the Entity (highlighted yellow) below. >> >> Thanks, >> Phil >> >> *Warning from the HRD Migration:* >> >> If your application has blob data in Blobstore, you need to migrate that >> blob data as well. Check the checkbox labeled *Migrate Blobstore Data*. >> The blobs will be copied and given new blob keys in the new application, >> and the Datastore will be updated with the new blob keys. (However, any >> blob keys stored in serialized form within the Datastore will *not* be >> migrated; see Migrating Serialized Blob >> Keys<https://developers.google.com/appengine/docs/adminconsole/migration#Migrating_Serialized_Blob_Keys>, >> below, for more information.) >> >> *Example of my datastore from the datastore viewer:* >> ID/Namecomplete couponKeydate dealIDdealVariant fraudulentnumSoldppemail >> price purchasesold uidverified address1address2 charitycity fullnamestatezip >> id=174125<https://appengine.google.com/datastore/edit?app_id=coupflipsite&version_id=3.361250345819739095&key=agxjb3VwZmxpcHNpdGVyEwsSC1RyYW5zYWN0aW9uGK3QCgw> >> True >> AMIfv95dj6WTPGjP8P38yQrSmjbPs6eqWCFpvafA0Y9KoROcostO8OiHMWOwZKFfqmNwfi2s9pXyK7Bz8cOIG-CSPnv-T9r0ac9Fn_c5carOHrpRBxFz-Pm3zcI4j93-MDHssxDpC6PdnKY5P3Dr66BrGLHWqoBNzQ >> View >> blob<https://appengine.google.com/blobstore/detail?app_id=coupflipsite&key=AMIfv95dj6WTPGjP8P38yQrSmjbPs6eqWCFpvafA0Y9KoROcostO8OiHMWOwZKFfqmNwfi2s9pXyK7Bz8cOIG-CSPnv-T9r0ac9Fn_c5carOHrpRBxFz-Pm3zcI4j93-MDHssxDpC6PdnKY5P3Dr66BrGLHWqoBNzQ> >> 2012-01-23 05:19:04.658000 asdf 0False 1a...@asdf.com 4.0 FalseTrue10709668 >> True >> > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Search service design
I am integrating the Search service and I plan to initially push data into the index that the search service creates. Is it correct to assume that these indexes & other search components are created in the datastore or some sort of backend? I'm trying to understand if it creates the search data structure once per front-end server or once per app. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Full Text Search - how do I retrieve the score of a document?
Does anyone have an example of how they implemented scoring using the Text Search API? The documentation exposes ANDs and ORs in the search query with a sort ASC/DESC type of sorting on a field, but that sorting is not super helpful for most search applications. I imagine most any real use case here needs scoring implemented. Any examples out there? Thanks, Phil On Mon, Jun 11, 2012 at 1:59 AM, jon wrote: > Hi, > > For a given ScoredDocument, how do I get its "relevance score"? The > official example app doesn't demonstrate scoring. This documentation > implies that QueryOptions.Builder has a setScorer() method but it > doesn't exist. > https://developers.google.com/appengine/docs/java/javadoc/com/google/appengine/api/search/Query > > I can see that ScoredDocument has a getSortScores() method that > returns a List. I'm not quite sure what this is. I will try it out and > see what it does. In the meantime if someone has some info on scoring > I'll be grateful if you can shed some light. > > Thanks, > Jon > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
[google-appengine] Tracing the source of datastore reads/writes
Is there a way to trace where the bulk of datastore reads are coming from in appengine? I'm on Java and I've recently noticed that our datastore reads are starting to cost a significant amount of money per day. I'd like to optimize our code, but I'm not sure where to begin since our app is fairly large and complex. Are there any good tools out there associate with AppEngine to help with this? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Tracing the source of datastore reads/writes
That's perfect. Thanks! On Sun, Oct 7, 2012 at 6:55 PM, Brian Quinlan wrote: > Hi Phil, > > Have you looked at Appstats? > https://developers.google.com/appengine/docs/java/tools/appstats > > Cheers, > Brians > > On Mon, Oct 8, 2012 at 12:42 PM, Phil McDonnell > wrote: > > Is there a way to trace where the bulk of datastore reads are coming > from in > > appengine? I'm on Java and I've recently noticed that our datastore reads > > are starting to cost a significant amount of money per day. I'd like to > > optimize our code, but I'm not sure where to begin since our app is > fairly > > large and complex. Are there any good tools out there associate with > > AppEngine to help with this? > > > > Thanks, > > Phil > > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group. > > To post to this group, send email to google-appengine@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine+unsubscr...@googlegroups.com. > > For more options, visit this group at > > http://groups.google.com/group/google-appengine?hl=en. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] ssl certificate for custom domains
cheers Aswath, does the filename or extension matter for the concatenated file from step 4? On Wednesday, 13 February 2013 22:06:25 UTC-8, aswath wrote: > > Hi, > I did this a week ago for my test appid. I don't have the wildcard cert. > But for normal case,the steps are. > > 1. Generate a private key > openssl genrsa -out myprivkey.pem 1024 > > 2. generate the csr using the above private key and upload to comodo > openssl req -new -key myprivkey.pem -out mykey.csr > > 3. generate the unencrypted private key > openssl rsa -in myprivkey.pem -out unmyprivkey.pem > > > 4. After doing step 2, the comodo, will send 3 cert files in a zip by > email. Extract them out and concat them using the notepad. > > 5. Upload 3 and 4 files in the Google apps domain panel. > > Hope this helps. > > -Aswath > www.AccountingGuru.in > > On Sat, Feb 9, 2013 at 2:59 AM, > > wrote: > >> I bought a wildcard cert from comodo and created the csr with this >> command: >> openssl req -out certificate.csr -new -newkey rsa:2048 -nodes -keyout >> certificate.key >> When trying to upload the certificate and private key I get the error >> >> Both the private key and SSL certificate should be in unencrypted PEM >> format. >> >> even though as far as I know both files are. >> Does anyone know how to solve this? >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to google-appengi...@googlegroups.com . >> To post to this group, send email to >> google-a...@googlegroups.com >> . >> Visit this group at http://groups.google.com/group/google-appengine?hl=en >> . >> For more options, visit https://groups.google.com/groups/opt_out. >> >> >> > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Problem with SSL on mobile browsers
I've setup SSL with a VIP on my GAE account. It works fine on my mac in chrome, safari, etc. However, when I pull up the https site on my android browser (both android stock broswer & android chrome) I get a "security certificated is not trusted" warning. Is this normal? I used GoDaddy to create a cert and followed the directions here<http://blog.zlocation.com/post/27014425678/configuring-ssl-https-for-google-app-engine-gae> . Here's in detail what I did... 1. GoDaddy gives you yourdomain.com.crt and gd_bundle.crt, which is the intermediate bundle. 2. I copied those two crt files together into one file and called it combined.pem 3. I unencrypted my key file an called it unencrypted.pem 4. Uploaded the combined.pem and unencrypted.pem to Google 5. Changed my cname to point to the right ghs domain. Like I said, it works fine on desktop, but just seems broken on mobile. Any ideas what might be wrong? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Problem with SSL on mobile browsers
Yes, I've definitely setup the CNAME correctly and waited for that to propagate. GoDaddy's site looks fine on my android browser so I think their cert should generally speaking work. I believe the issue I have is hooking up the GoDaddy issued cert and intermediate bundle. I assume I must not be formatting this correctly or something. The weird thing is that the site works fine on desktop, but from the article I linked earlier it sounds like there are some sort of mobile specific issues that the intermediate crt bundle can solve when you copy and paste them together. Anyone know the steps to correctly plug these together? Thanks, Phil On Sun, Apr 28, 2013 at 1:26 PM, Barry Hunter wrote: > According to this > > http://support.godaddy.com/help/article/1139/which-browsers-and-devices-are-your-ssl-certificates-compatible-with > GoDaddy's Root Authority should be installed on Android. > > Can you visit? > https://www.godaddy.com/ > (they of course use their own CA :) > > > And to confirm have you definitly set the right CNAME (ie something like > ghs-svc-https-c.ghs-ssl.googlehosted.com<http://ghs-svc-https-c.ghs-ssl.googlehosted.com/>. > not just ghs.google.com). And allowed enough time for it to propogate, eg > mobile still has the old settings cached somewhere). > > > > > On Sun, Apr 28, 2013 at 9:02 PM, Phil McDonnell < > phil.a.mcdonn...@gmail.com> wrote: > >> I've setup SSL with a VIP on my GAE account. It works fine on my mac in >> chrome, safari, etc. However, when I pull up the https site on my android >> browser (both android stock broswer & android chrome) I get a "security >> certificated is not trusted" warning. >> >> Is this normal? I used GoDaddy to create a cert and followed the directions >> here<http://blog.zlocation.com/post/27014425678/configuring-ssl-https-for-google-app-engine-gae> >> . >> >> Here's in detail what I did... >> >>1. GoDaddy gives you yourdomain.com.crt and gd_bundle.crt, which is >>the intermediate bundle. >>2. I copied those two crt files together into one file and called it >>combined.pem >>3. I unencrypted my key file an called it unencrypted.pem >>4. Uploaded the combined.pem and unencrypted.pem to Google >>5. Changed my cname to point to the right ghs domain. >> >> Like I said, it works fine on desktop, but just seems broken on mobile. >> Any ideas what might be wrong? >> >> Thanks, >> Phil >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to google-appengine+unsubscr...@googlegroups.com. >> To post to this group, send email to google-appengine@googlegroups.com. >> Visit this group at http://groups.google.com/group/google-appengine?hl=en >> . >> For more options, visit https://groups.google.com/groups/opt_out. >> >> >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to google-appengine+unsubscr...@googlegroups.com. > To post to this group, send email to google-appengine@googlegroups.com. > Visit this group at http://groups.google.com/group/google-appengine?hl=en. > For more options, visit https://groups.google.com/groups/opt_out. > > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] URLFetch and asynchronous pages
I'm trying to grab in the html from a web page. I think the standard GAE way to do this is to use UrlFetch. I'm running into an issue that the page I'm grabbing loads much of it's content asynchronously. Is there anyway to have UrlFetch grab the html that loads via javascript? Specifically, I'm trying to grab this page: http://www.groupon.com/browse/san-francisco?category=restaurants-and-bars Any idea how to get the html that loads via js in the middle of the page? Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine?hl=en. For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Caching certain pages for long periods
I have certain pages (sitemaps, etc) that are very expensive for my site to render. The underlying data changes often, but I could live with only updating these pages once a week. Is there a way to configure app engine to cache dynamic pages for long periods and not serve a new one? Would this be effective given that server instances regularly turn over? I do not have PageSpeed service enabled although I could enable it. I am on Java. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
Re: [google-appengine] Caching certain pages for long periods
Hi Barry,
Thanks so much for the advice here. I think it helps me understand the
options a lot better. I've added PageSpeed as it seems like a good idea
generally. I've also added the below cache-control snippet. We'll see if
this works and if Google respects it. Hopefully it'll help.
<%
response.setHeader("Cache-Control", "max-age=60, must-revalidate"); //
HTTP 1.1
%>
Thanks,
Phil
On Sat, Jun 29, 2013 at 12:45 PM, Barry Hunter wrote:
> If you set good Cache-Control headers, then you are allowing proxies to
> cache the file for you.
>
> Google sometimes (or least did) have a optimistic caching-proxy - you
> would often get that caching your pages (if the headers allowed it to!)
>
> But with PageSpeed, its more explicit, that will cache if you allow it to.
> So that's definitely an option.
>
> However there are many 'front end caches' (be it PageSpeed, or the other
> optimistic one) - so even though one caches it, you might still get
> requests from the other caches. So wont mean your server only generate it
> once per week, but it does mean it wont generate it for every request.
>
>
> But you also have MemCache at your disposal. Thats specificity designed as
> cache, and should work well in this situation.
> (you can also cache the file explicitly in the Datastore or Google
> Storage/Blobstore)
> so your instance can just fetch a regenerated file, rather generating it
> from scratch.
>
>
>
>
> On Sat, Jun 29, 2013 at 8:34 PM, Phil McDonnell <
> phil.a.mcdonn...@gmail.com> wrote:
>
>> I have certain pages (sitemaps, etc) that are very expensive for my site
>> to render. The underlying data changes often, but I could live with only
>> updating these pages once a week. Is there a way to configure app engine to
>> cache dynamic pages for long periods and not serve a new one? Would this be
>> effective given that server instances regularly turn over?
>>
>> I do not have PageSpeed service enabled although I could enable it. I am
>> on Java.
>>
>> Thanks,
>> Phil
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at http://groups.google.com/group/google-appengine.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>
>>
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>
--
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/groups/opt_out.
[google-appengine] Re: Custom domain going to Google on some networks
I have a similar problem - well, two problems now as I have grumpy clients as well as no sites. Phil On Wednesday, March 12, 2014 9:48:43 AM UTC+13, GregF wrote: > > We have several custom domains (e.g. www.schoolinterviews.co.nz) mapped > to our application. Starting this morning, many users (from one ISP?) are > getting "a Google page" instead of our app.Others (including ourselves) are > getting the app correctly, which seems to imply that the domain is being > mapped to the app correctly at least sometimes. > > I'm at a loss - has anyone got any ideas what could be going on? > > Cheers! > Greg. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Client latency performance and time synchronisation
I'm just starting out with getting up to speed with Google Apps Engine. A useful tool that I'd like to develop to help me learn (as well as being useful personally) is to create an app that will simulate a buzzer for a game show. Someone will setup a new game show (the manager for the group) and various other people will join the game (as contestants). Each contestant will then be able to buzz in and the fastest buzzer will be shown to the manager. The intention is for this to be used by people who are in the same room. They may be connected via the same WiFi or they could be connected via their own mobile network. My question is, what can I do to make it fair so the actual first buzz is shown on the manager as the first buzz. I'm worried that network latency may re-order the buzzes. I'm not worried about buzzes that are milliseconds apart, I'm only interested in ones where it is noticeable by a person that they are registering in a different order. I'm not looking to make it bullet proof from exploits as I'm not planning to make it public. I'm currently only going to use it for family and friends. TIA -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/e01077d3-60c4-4573-b2fe-9e9c18e45c6d%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Client latency performance and time synchronisation
Thank you very much for your comments. It's given me a bit more to think about. I can see how using server time stamps wouldn't work due to latency but I'm not quite sure how to make client time stamps work on a practical level. Let's say for argument sake that the maximum a real person can detect inaccurate buzz order is a 10th of a second. Therefore, the objective is for client time stamps to be in sync within 1/10 second. Even if the mobile device clocks are sync'd with NTP, I don't see how they can be in sync to an accuracy of 1/10 second. After all, synchronisation to NTP will happen over the Internet which itself could suffer from latency. Perhaps using the Internet to determine first buzz is not realistic. I may need to think of another application for learning with App Engine. On Tuesday, January 5, 2016 at 8:20:09 PM UTC, Nicholas (Google Cloud Support) wrote: > > Thanks for the interesting question. > > For starters, you are correct. There will be network latency. Your > application will be deployed to the region of your choosing > <https://cloud.google.com/appengine/docs/python/console/#server-location> > and respond to requests from there. Any HTTP requests between users will > have to travel there and back, thus incurring this network latency. > Therefore, one cannot rely on the arrival time of the HTTP request (in this > case, buzzer) to determine the order. > > The time one should look for is the time at which the 'button' is pressed > which is best known by the client device. If your client is running in the > browser for instance, you could use Javascript's Date.now() > <https://developer.mozilla.org/en/docs/Web/JavaScript/Reference/Global_Objects/Date/now> > function > and provide its result when sending the 'buzz' HTTP request to your > application. > > As noted from MDN: > >> The Date.now() method returns the number of milliseconds elapsed since 1 >> January 1970 00:00:00 UTC. > > > The downside here is that the user can manually change to time set on > their device to always be listed first. As far as I know, Date.now() gets > its time from the device time as I've found nothing to the contrary in the > EMCAScript-262 > spec about Javascript <http://www.ecma-international.org/ecma-262/6.0/>. > If the user were to set their device time manually to an hour before > everyone else, they will always register as the first buzzer. Barring this, > most modern devices automatically sync time with accurate time servers. > If your client is running on Android devices for example, you could use > calendarObject.getTimeInMillis > <http://developer.android.com/reference/java/util/Calendar.html#getTimeInMillis()>() > > to get the time in milliseconds and add the offset from calendarObject. > getTimeZone > <http://developer.android.com/reference/java/util/Calendar.html#getTimeZone()> > ().getOffset > <http://developer.android.com/reference/java/util/TimeZone.html#getOffset(long)>(calendarObject.getTimeInMillis()) > > to get the milliseconds since 1 January 1970 00:00:00 UTC. This again gives > the same vulnerability though as manually changing the device time will > affect these values. At least, with an application running on Android, you > can determine if the time has been manually set by checking the > Global.AUTO_TIME > <http://developer.android.com/reference/android/provider/Settings.Global.html#AUTO_TIME> > > property. > > Given the use case you described with family and friends, I'd say this may > be a simple and effective solution until someone is motivated enough to > find a way to cheat or if they manually set date and time on their device > for whatever reason. > > Cheers. > > > On Tuesday, January 5, 2016 at 8:36:41 AM UTC-5, Phil Johnstone wrote: >> >> I'm just starting out with getting up to speed with Google Apps Engine. A >> useful tool that I'd like to develop to help me learn (as well as being >> useful personally) is to create an app that will simulate a buzzer for a >> game show. Someone will setup a new game show (the manager for the group) >> and various other people will join the game (as contestants). Each >> contestant will then be able to buzz in and the fastest buzzer will be >> shown to the manager. The intention is for this to be used by people who >> are in the same room. They may be connected via the same WiFi or they could >> be connected via their own mobile network. >> >> My question is, what can I do to make it fair so the actual first buzz is >> shown on the manager as the first buzz. I'm worried that network latency >&
[google-appengine] Re: Client latency performance and time synchronisation
That's great, thank you for the link :-) On Thursday, January 7, 2016 at 7:38:49 PM UTC, Nicholas (Google Cloud Support) wrote: > > For some very 'Hello world'-like examples, Udacity has a nice free course > called Deploying Scalable App in Java > <https://www.udacity.com/course/developing-scalable-apps-in-java--ud859> > that will walk you through building a conference-organizing application > using some essential App Engine components. The sample code will sometimes > require that you not look into the black box too much and accept what's > working but with some study, one can get a good idea of what is actually > happening. Hope this helps! > > On Wednesday, January 6, 2016 at 11:35:33 AM UTC-5, Phil Johnstone wrote: >> >> Thank you very much for your comments. It's given me a bit more to think >> about. >> >> I can see how using server time stamps wouldn't work due to latency but >> I'm not quite sure how to make client time stamps work on a practical >> level. Let's say for argument sake that the maximum a real person can >> detect inaccurate buzz order is a 10th of a second. Therefore, the >> objective is for client time stamps to be in sync within 1/10 second. Even >> if the mobile device clocks are sync'd with NTP, I don't see how they can >> be in sync to an accuracy of 1/10 second. After all, synchronisation to NTP >> will happen over the Internet which itself could suffer from latency. >> Perhaps using the Internet to determine first buzz is not realistic. >> >> I may need to think of another application for learning with App Engine. >> >> >> On Tuesday, January 5, 2016 at 8:20:09 PM UTC, Nicholas (Google Cloud >> Support) wrote: >>> >>> Thanks for the interesting question. >>> >>> For starters, you are correct. There will be network latency. Your >>> application will be deployed to the region of your choosing >>> <https://cloud.google.com/appengine/docs/python/console/#server-location> >>> and respond to requests from there. Any HTTP requests between users will >>> have to travel there and back, thus incurring this network latency. >>> Therefore, one cannot rely on the arrival time of the HTTP request (in this >>> case, buzzer) to determine the order. >>> >>> The time one should look for is the time at which the 'button' is >>> pressed which is best known by the client device. If your client is running >>> in the browser for instance, you could use Javascript's Date.now() >>> <https://developer.mozilla.org/en/docs/Web/JavaScript/Reference/Global_Objects/Date/now> >>> function >>> and provide its result when sending the 'buzz' HTTP request to your >>> application. >>> >>> As noted from MDN: >>> >>>> The Date.now() method returns the number of milliseconds elapsed since >>>> 1 January 1970 00:00:00 UTC. >>> >>> >>> The downside here is that the user can manually change to time set on >>> their device to always be listed first. As far as I know, Date.now() gets >>> its time from the device time as I've found nothing to the contrary in the >>> EMCAScript-262 >>> spec about Javascript <http://www.ecma-international.org/ecma-262/6.0/>. >>> If the user were to set their device time manually to an hour before >>> everyone else, they will always register as the first buzzer. Barring this, >>> most modern devices automatically sync time with accurate time servers. >>> If your client is running on Android devices for example, you could use >>> calendarObject.getTimeInMillis >>> <http://developer.android.com/reference/java/util/Calendar.html#getTimeInMillis()>() >>> >>> to get the time in milliseconds and add the offset from calendarObject. >>> getTimeZone >>> <http://developer.android.com/reference/java/util/Calendar.html#getTimeZone()> >>> ().getOffset >>> <http://developer.android.com/reference/java/util/TimeZone.html#getOffset(long)>(calendarObject.getTimeInMillis()) >>> >>> to get the milliseconds since 1 January 1970 00:00:00 UTC. This again gives >>> the same vulnerability though as manually changing the device time will >>> affect these values. At least, with an application running on Android, you >>> can determine if the time has been manually set by checking the >>> Global.AUTO_TIME >>> <http://developer.android.com/reference/android/pro
[google-appengine] Managing multiple international domains
Hi all, I run a coupon trading site in the US that's based on a .com domain. I'm setup with SSL on a VIP as well so we can process payments. Any recommendations for the best way to expand to other country domains using appengine? For instance, I'm running xyz.com now and I'd like to add: xyz.fr, xyz.co.uk, xyz.nl, etc. I'd love any guidance on how to work with AppEngine or just general strategy here. Thanks, Phil -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Penetration Test Notification
Hi, I am releasing a platform hosted on google app engine where the underlying client needs to have the system pen tested before launch. I cannot find any information on who I need to notify on pen test initiation. Is there any policy I need to adhere to for this? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/6b426860-6192-439a-8b4c-4dc1fd4d22e4%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Issues with Cloud SQL query parsing
Hi, I experience EXACTLY the same issue, newly deployed GAE apps (running newer appengine version) stopped working suddenly. The only way I was able to fix the issue was to roll back to an older version of my app (a 30+ days old version). That caused a hell of a mess, our apps simply stopped working. Phil On Tuesday, June 16, 2015 at 12:09:20 AM UTC-4, Glenn Molnar wrote: > > Hi, > > > We are suddenly seeing SQLExceptions when attempting to execute a Cloud > SQL query, in a particular application environment as follows: > > > java.sql.SQLException: Wrong number of parameters: expected 0, was given 1 > Query: delete from ppq.channel where clientId = ? Parameters: > [7a8261ef-a3ff-480b-8024-05f959ccd762] > > > The error message does not make a whole lot of sense, as clearly the query > has a ? parameter. This stopped working all of a sudden without any new > code being deployed, but only in a single app engine application. The exact > same code is running OK in other environments. > > > The only difference we have been able to spot is that the environment we > are getting the error on is running appengine 1.9.23, but the others are > are still working are running 1.9.22. Has something changed that we need to > be aware of? > > > Thanks > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/fbdfedcb-680b-4050-99ed-fb3758d093cf%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Rate Limit Exceeded when creating new project through devloper's console
I'm getting the message "Rate Limit Exceeded" when I try to create a new project through the developer's console. I have no idea what rate it is referring to, and so no idea how to fix the problem. Any help would be appreciated. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/b04a5c17-87c5-4841-9a6c-4e505fa8e246%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Rate Limit Exceeded when creating new project through devloper's console
Hi Nick, It's working now. The fix was either an extremely weird bug, or there was an an amazing coincidence. I tried to create the the project several times over the period of a few hours, always with the same error. I gave it one more try, and it failed again. I then dismissed that "billing has been moved to settings" pop-up, which had been on the screen all day, and tried again. This time it worked. I don't really see how the two could be related. On the other hand, I tried it 5 seconds before dismissing the box, and it failed, I tried it 5 seconds after dismissing it, and it worked. Very odd. On Thursday, 9 July 2015 15:20:36 UTC+2, Phil Side wrote: > > > I'm getting the message "Rate Limit Exceeded" when I try to create a new > project through the developer's console. I have no idea what rate it is > referring to, and so no idea how to fix the problem. Any help would be > appreciated. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/f8681a3e-9268-4235-bcbe-75423b0bc164%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] GAE Inbound Email to non-default Module
I want to use the inbound email facility in GAE but need to have a different module handle the incoming mail. I can setup inbound mail on the default module but I cannot see how to handle the inbound mail from a different module, is this possible? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/896b748e-e5bf-45f8-811b-5fd1c8afbb60%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Re: GAE Inbound Email to non-default Module
Thanks. I restructured my modules to put the mail handlers on the default module. It would certainly be a useful feature to allow the incoming mail handler to be on the non-default module. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/83b7254d-0c78-4ffa-9ee2-6b5449d4f97c%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Saving incoming email to datastore
I need to handle incoming email in an app I am building. I have setup the incoming mail handler and this is working well. Next stage is to persist the mail I to the Datastore. Is there an accepted best practice for handling this? I was planning on pickling the incoming mail to persist it. Is there a better approach? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/239c6ec4-8d60-4632-8117-e653afd9f621%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Saving incoming email to datastore
I've realised storing in the datastore is a bad idea given the size limitation of a Datastore entity. Instead I'm saving the raw email to gcs with a Datastore entity giving just email headers. Seems to work well. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/e85a44f8-db26-49ba-888c-ae22eb2feb77%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Duplicate Existing, Deployed GAE Project
This backend GAE server is in prod but hasn't been updated in a few years. Now I need to make changes and so much has changed including Eclipse, GAE and Objectify. After struggling to get even a deployable, updated project working I decided to just start with a fresh install of Eclipse, the Google Cloud plugin etc and rebuild the server and update Objectify to the latest version. What I'd like to do is duplicate the existing project in the Google Cloud Console somehow, including the database, get a new version working against that server, then do a final database copy from prod to dev and then go live. I have no idea whether this is possible. Seems simple in theory but I don't see a duplicate feature in the app console and I'm not entirely sure I can go from Objectify 3 to the latest version. Also posted here... https://groups.google.com/forum/#!topic/objectify-appengine/v_-i5gVkyz4 -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/e15a1ff8-3c90-4725-a888-e96b3190d5a2%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: ListProperty substring matching and filtering
Cerea,
This may help - I was doing something similiar and noticed different
behaviour between the dev server and live server. Specifically, the
dev server seemed to funciton as documented (however not as you
desire) and return everything that has a record either < or >, however
live seemed to operate more like the big table specs in that it does
an index scan from the lower bound up to the upper bound (therefor
only including items starting with "book" which should give you what
you want).
So if you're only experiencing your issue on the dev server, it may
well work on live. If you're experiencing it on live however I dont
think i can help
Good luck.
On Jul 4, 9:10 am, Bill wrote:
> You could use your approach if each keyword were in a separate child
> entity where the parent is BlogPage. The child entity would be like
> the Relation index described by Slatkin in his Google I/O talk, but in
> your case, you'd have a single StringProperty instead of a
> StringListProperty so you could do a prefix matching.
>
> class BlogKeyword:
> # Parent is some BlogPage
> keyword = StringProperty()
>
> Your proposed query would be modified to return keys then the parents:
>
> query = BlogKeyword.all(keys_only=True) \
> .filter('keyword >= ', searchWord) \
> .filter('keyword < ', searchWord + u"\ufffd") \
> .order('keyword')
> ordered_post_keys = [key.parent() for key in query.fetch(100)]
>
> I don't think the way you've appended the counts to the keywords will
> work, because ordering will be via string comparison and '3' will
> evaluate as larger than '20'. So you should pad the counts based on
> max # of digits for your counts, e.g., book_00020 not book_20.
>
> Having a separate entity per keyword seems wasteful, so I'll think
> about it more.
> -Bill
>
> On Jul 4, 12:50 am, Bill wrote:
>
> > I think the answer is in the documentation for
> > ListProperty:http://code.google.com/appengine/docs/python/datastore/typesandproper...
>
> > In particular: "list_property < value tests if any of the members of
> > the list are less than the given value,..."
>
> > So your inequality filters will succeed for that entity because one
> > member of the list will be >= searchWord and another member of the
> > list will be < searchWord.
>
> > As to your question on doing both substring matching + ordering, I'll
> > think about it and post if I come up with something.
> > -Bill
>
> > On Jul 3, 12:43 pm, cerea wrote:
>
> > > Hi,
>
> > > I'm new to app engine & coding in general, so any help or advice would
> > > be greatly appreciated.
>
> > > Background:
> > > I am making a blog and each page has a list of keywords stored in a
> > > db.StringListProperty. Those keywords will be used when someone
> > > searches the site. I also want each keyword to have an integer
> > > associated with it which hold the number of occurrences of that
> > > keyword in the page.
>
> > > My Attempt:
> > > I have code which populates a StringListProperty named 'keywords' when
> > > a page is created. It looks like this: ["books_20", "lotto_100",
> > > "wallet_2"], where "books" is the keyword and "20" is the number of
> > > occurrences. My goal was to be able to perform a query to filter out
> > > all pages that starts with a certain keyword, then order it by the
> > > number of occurrences. Here is an example of my query:
>
> > > query = BlogPage.all()
> > > # my attempt at substring matching
> > > # based on the tip
> > > here:http://code.google.com/appengine/docs/python/datastore/queriesandinde...
> > > query = query.filter('keywords >= ', searchWord)
> > > query = query.filter('keywords < ', searchWord + u"\ufffd")
> > > query.order('keywords')
>
> > > Problem:
> > > The query doesn't work correctly. If I search for the word "cat" even
> > > though it's not in the list, the blog page containing ["books_20",
> > > "lotto_100", "wallet_2"] still gets returned. I'm sure there is a
> > > logic behind the query and what is returned, but I don't understand.
>
> > > Questions:
> > > Is there a way to perform substring matching on a StringListProperty
> > > and also have it ordered? And Is there a better approach to what I'm
> > > trying to accomplish?
>
> > > Thanks so much for taking the time to read my post.
--~--~-~--~~~---~--~~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~--~~~~--~~--~--~---
[google-appengine] Re: GAE alternatives? :-)
not to the whole package ... but you can get Django hosting in various places ... eg. Webfaction On Fri, Feb 27, 2009 at 8:03 PM, KillIEbrowser wrote: > > Do alternatives exist? > > > --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~--~~~~--~~--~--~---
