Re: [google-appengine] Re: making project strictly use HTTPS , and deny and redirect HTTP urls to HTTPS.

['Alex Martelli' via Google App Engine]

On Wed, Jun 24, 2015 at 11:59 AM, Hristo  wrote:

> I think you can just set the "secure" parameter in app.yaml:
>

That's a perfectly acceptable alternative, too, but many prefer their Java
GAE configs to be in XML, so that's what I suggested instead (since the
task can be accomplished either way).

Personally I love yaml more than XML, but, that's just my own individual
taste, not an "official" statement of any kind -- so, anyway, thanks for
also surfacing this alternative!


Alex


>
> https://cloud.google.com/appengine/docs/java/configyaml/appconfig_yaml#Java_app_yaml_Secure_URLs
>
> - Hristo
>
>
>
> On Wednesday, June 24, 2015 at 9:17:55 AM UTC-7, nav...@senspan.com wrote:
>>
>> I have made a project that can Run on HTTPS but now I want it to use only
>> HTTPS not HTTP ,
>> my project is in java and i used eclipse in development ,
>> I found out that we need to redirect all request and make changes in
>> Httpd's configuration file  and remove listen port 80 , from that file ,
>>  but i was not able to find these configurations files.
>>
>> please suggest me how to make site strictly HTTPS.
>>
>>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/2f833ca4-6068-4118-8612-e03e896f203c%40googlegroups.com
> 
> .
>
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAE46Be_2JbzF%2B2J6BJMkOBKagNX7hWtzD24O%2BtKgwq-nxxp_VA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] switch database instance , keeping the source code same

['Alex Martelli' via Google App Engine]

On Wed, Jun 24, 2015 at 12:49 PM,  wrote:

> we are in testing phase of our application ,
> so we have to database
> 1. live database
> 2. test database.
>
> so can anyone please suggest a way to  dynamically switch from  live
> database to  test database  ,
> for now we have created 2 different source code and have created 2
> instance of application, but we want to keep the source code same.
>

Personally, I would use *namespaces* for this -- so the "two" databases are
really just one, but segregated.  (If your use of the datastore already
involve namespaces for other reasons, just *prefix* e.g "test-" to the
namespace you'd otherwise be using, if you're "just testing").

As for doing the switch "dynamically", it depends on what exactly you mean
by that -- e.g, if you mean that your app receives a signal of some kind
(for example a POST to an HTTPS admin-only special control URL) and must
then switch "correctly", careful design is likely to be needed to determine
what happens to already-started queries, tasks in queues, &c -- presumably
those need to run to completion with whatever DB they've been started with,
but *new* incoming ones must use the DB that's just been set, which is
*not* a trivial problem in terms of architecting things. However this would
apply *no matter what* mens you used to address the GAE-specific issue of
"switching" -- the problem is with the "dynamically" part, as I just tried
to interpret it, and it's an architectural problem you'd have to face in
any such cases (e.g imagine instead of the datastore you were using two
CloudSQL DBs at different URLs -- very different technology but exactly the
same architectural issues arise, showing it's a problem of exact
requirements and of architecture, *not* in any way GAE-specific).

If you can arrange things so that each incoming query specifically marks
itself as a "test" one if it is, the server-side architecture becomes
trivial -- but this moves the difficulty to the client side. E.g, you might
have two versions of your app (with the same source code) or otherwise
different URLs.

One mixed architecture might involve queries to your app being "tagged" as
test or not as they come in and carrying that key bit of state around for
each query's life (with tasks spawned from queries also "inheriting" it) --
it could be mixed with the idea in the previous paragraph via e.g
redirects, or via dispatching within your code, depending on what framework
you're using (how dynamical it lets the actual dispatching be).

If you specify very precisely what you mean by "dynamically", perhaps
correspondingly more precise architectural suggestions can be offered.


Alex




>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/c75c499d-9cf4-405f-95d6-bb228949e7ed%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAE46Be-jx%2B1qnCLMRzYmSpSkPgh_Rr8H%2BG0Wyh-0vUViKcLqrw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: How to run a long task until it ends ?

[nilsleroux]

Thank you Chad Vincent for your answer.

I added some logging, but it didn't gave me more relevant information. 
Everything is running fine until the "unexplainable" failure. Therefore, I 
guess that it is related to a memory issue. It retrieves data and caches 
until the memory is full and then crashes.

I spent some time tonight reading the Objectify documentation. I came 
across 
this: 
https://code.google.com/p/objectify-appengine/wiki/BasicOperations#The_Session_Cache
 
. It could really be related to my issue. Unfortunately calling 
ofy().clear() sometimes did not solve anything. Moreover, I read that 
assigning ObjectifyService.ofy() was a bad idea. But requesting ofy() 
directly each time I needed it did not help neither.

Any other idea or suggestion is welcome. Thank you :) .
G.

Le mercredi 24 juin 2015 22:30:38 UTC+2, Chad Vincent a écrit :
>
> Then I would definitely add more logging so you can see what is and is not 
> getting done before the instance bails.
>
> On Wednesday, June 24, 2015 at 1:48:07 AM UTC-5, nilsl...@gmail.com wrote:
>>
>> Thank you for answering me.
>>
>> Here is the only log I'm getting :
>> /task/update-known-devices 500 151600ms 0kb AppEngine-Google; (+
>> http://code.google.com/appengine) module=default version=dev
>>
>>1. 
>>
>>0.1.0.2 - - [23/Jun/2015:23:23:07 -0700] "POST /task/update-known-devices 
>> HTTP/1.1" 500 0 
>> "http://freemobile-netstat.appspot.com/cron/update-known-devices"; 
>> "AppEngine-Google; (+http://code.google.com/appengine)" 
>> "freemobile-netstat.appspot.com" ms=151600 cpu_ms=3530 
>> queue_name=update-queue task_name=81805458203132447311 exit_code=202 
>> app_engine_release=1.9.22 trace_id=b86eb2915714ad73aae5f54bfbef746d 
>> instance=00c61b117c5b3b509e154cd4930e3af3083a8a68 
>> 
>>
>>2. E2015-06-24 08:23:07.492
>>
>>A problem was encountered with the process that handled this request, 
>> causing it to exit. This is likely to cause a new process to be used for the 
>> next request to your application. (Error code 202)
>>
>>
>> This log appears for each retry (around 3 times per task).
>>
>> G.
>> Le mercredi 24 juin 2015 01:00:49 UTC+2, Chad Vincent a écrit :
>>>
>>> What are you getting in your logs?  Any uncaught exceptions?
>>>
>>> You might want to add some debug logging statements and lower the 
>>> logging level for a while to see what is happening.  You do get 10 minutes 
>>> for queries from the TaskQueue, so it isn't a timeout issue.
>>>
>>> On Tuesday, June 23, 2015 at 1:31:59 PM UTC-5, nilsl...@gmail.com wrote:

 Hi everybody,
 I have a long task to run under my App Engine application with a lot of 
 computing. But after a while running the task (~2 minutes), it stops and 
 just retries. Obviously, my task restarts from the beginning and cannot 
 end.
 I would like to configure App Engine to run the task until it is 
 finished. I've heard about a 10 minutes limit for the tasks. I guess it 
 should be enough if it didn't retries everytime.

 My source code is (hopefully) freely available here : 
 https://github.com/gilbsgilbs/freemobilenetstat-gae . The two tasks 
 under *src/main/java/org/pixmob/freemobile/netstat/gae/web/task* are 
 problematic (since it computes a lot of data). They are pushed the the 
 queue from a cron under 
 *src/main/java/org/pixmob/freemobile/netstat/gae/web/cron/CronServlet.java*
 .

 Note that I'm really new to App Engine and that my code might not be 
 optimal. I'm not sure of the exact issue and maybe it is just a memory 
 overflow (which I wouldn't known how to fix).

 Thank you !
 G.

>>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/6d6a9ad3-4ed9-4121-abf5-a34b51c8bd67%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: 404 when trying to create backup in a Google App Engine project

[Nick (Cloud Platform Support)]

Hi Tony,

Yes, stackoverflow provides persistent links to questions using a unique ID 
system. This is a common practice on many websites and doesn't change the 
fundamental dynamic at play here. The issue is that this forum is not for 
technical support, and is definitely not for simply posting links to other 
sites that are meant for technical support (of a very specific, 
community-based, volunteer character), but is rather meant as a place to 
have general discussion of the platform. 

If everybody did the same thing, creating a thread just to say "go here, 
answer my question", this forum would be full of such threads, and despite 
how much you want to get an answer for your stackoverflow question, you'll 
have to admit that would significantly degrade the quality of this forum. 
If you ask yourself, "what if everybody did what I've done?" and the 
hypothetical situation results in a very high noise-to-signal ratio in the 
forum you posted to, it's likely that your actions amount to spam. 

You've already done everything you can do (short of do more debugging / 
studying yourself ;) ) in regards to getting this issue to the attention of 
people who might help. If you'd like on-demand 1-on-1 technical support, 
you can always purchase a support package . 


If you feel that your issue represents an issue on the platform (behaviour 
isn't as documented), then you should open a public issue tracker thread 
 with enough 
information to allow reproduction of the behaviour by the person reading 
your issue, preferably attaching a basic project which demonstrates the 
issue.

Finally, no, re-posting the content of your StO question here would not be 
valid. As you can read on the main page of this forum, stackoverflow or the 
public issue tracker are the places to get help with specific technical 
issues. Those two sites have different purposes and procedures, so I 
encourage you to consider that when making your next move. 

I wish you the best of luck in getting your question answered, and rest 
assured that I'm personally looking it over right now.

On Tuesday, June 23, 2015 at 4:56:35 PM UTC-4, A. Kong wrote:
>
> Nick, 
>
> I think you are misguided.  At the button of each SO question there is 
> this line: "Know someone who can answer? Share a link to this question via 
> email, Google+, Twitter, or Facebook.". It is OK to share a link with 
> people who might know the answer. 
>
> At the end of the day, I just want to get an answer to my question to 
> resolve my issue. Will posting the whole question here, instead of a link 
> to the SO, meets your  'net etiquette' standard?
>
>
> Cheers, Tony
>
>
>
> On Wednesday, 24 June 2015 04:35:26 UTC+10, Nick (Cloud Platform Support) 
> wrote:
>>
>> Hey Tony,
>>
>> Stackoverflow has its own process for determining whether your question 
>> will get an answer or not (basically, if it's well-researched and a user 
>> who wants to answer can answer it, they might, and if they do, you'll get a 
>> notification). Attempting to short-circuit that system by cross-posting to 
>> other forums asking for someone to look at your stackoverflow question is 
>> bad net etiquette in general, so please avoid this in future. It's 
>> essentially spamming since there's no content to your post other than 
>> "please go to this link".
>>
>> If you have any real discussion to start on the platform / services, 
>> please feel free to open a new thread for that purpose, and have a nice day!
>>
>> On Tuesday, June 23, 2015 at 2:04:59 AM UTC-4, A. Kong wrote:
>>>
>>>
>>> I have posted the question to stackoverflow but there is no response so 
>>> far. 
>>> http://stackoverflow.com/questions/30970735/404-when-trying-to-create-backup-in-a-google-app-engine-project
>>>
>>> I would appreciate if someone may take a look at the question and 
>>> hopefully has an answer
>>>
>>> Cheers, Tony
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/16d0a75b-41bd-4df1-ad6d-85028d6e1f62%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: How to run a long task until it ends ?

[Chad Vincent]

Then I would definitely add more logging so you can see what is and is not 
getting done before the instance bails.

On Wednesday, June 24, 2015 at 1:48:07 AM UTC-5, nilsl...@gmail.com wrote:
>
> Thank you for answering me.
>
> Here is the only log I'm getting :
> /task/update-known-devices 500 151600ms 0kb AppEngine-Google; (+
> http://code.google.com/appengine) module=default version=dev
>
>1. 
>
>0.1.0.2 - - [23/Jun/2015:23:23:07 -0700] "POST /task/update-known-devices 
> HTTP/1.1" 500 0 
> "http://freemobile-netstat.appspot.com/cron/update-known-devices"; 
> "AppEngine-Google; (+http://code.google.com/appengine)" 
> "freemobile-netstat.appspot.com" ms=151600 cpu_ms=3530 
> queue_name=update-queue task_name=81805458203132447311 exit_code=202 
> app_engine_release=1.9.22 trace_id=b86eb2915714ad73aae5f54bfbef746d 
> instance=00c61b117c5b3b509e154cd4930e3af3083a8a68 
> 
>
>2. E2015-06-24 08:23:07.492
>
>A problem was encountered with the process that handled this request, 
> causing it to exit. This is likely to cause a new process to be used for the 
> next request to your application. (Error code 202)
>
>
> This log appears for each retry (around 3 times per task).
>
> G.
> Le mercredi 24 juin 2015 01:00:49 UTC+2, Chad Vincent a écrit :
>>
>> What are you getting in your logs?  Any uncaught exceptions?
>>
>> You might want to add some debug logging statements and lower the logging 
>> level for a while to see what is happening.  You do get 10 minutes for 
>> queries from the TaskQueue, so it isn't a timeout issue.
>>
>> On Tuesday, June 23, 2015 at 1:31:59 PM UTC-5, nilsl...@gmail.com wrote:
>>>
>>> Hi everybody,
>>> I have a long task to run under my App Engine application with a lot of 
>>> computing. But after a while running the task (~2 minutes), it stops and 
>>> just retries. Obviously, my task restarts from the beginning and cannot end.
>>> I would like to configure App Engine to run the task until it is 
>>> finished. I've heard about a 10 minutes limit for the tasks. I guess it 
>>> should be enough if it didn't retries everytime.
>>>
>>> My source code is (hopefully) freely available here : 
>>> https://github.com/gilbsgilbs/freemobilenetstat-gae . The two tasks 
>>> under *src/main/java/org/pixmob/freemobile/netstat/gae/web/task* are 
>>> problematic (since it computes a lot of data). They are pushed the the 
>>> queue from a cron under 
>>> *src/main/java/org/pixmob/freemobile/netstat/gae/web/cron/CronServlet.java*
>>> .
>>>
>>> Note that I'm really new to App Engine and that my code might not be 
>>> optimal. I'm not sure of the exact issue and maybe it is just a memory 
>>> overflow (which I wouldn't known how to fix).
>>>
>>> Thank you !
>>> G.
>>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9c88fadf-c187-4863-9a4d-485069826109%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: How do I share code between different App-Engine modules ?

[Nick (Cloud Platform Support)]

No worries, Dor. I wish you the best of luck!

On Monday, June 22, 2015 at 4:27:40 PM UTC-4, Dor litay wrote:
>
> I wanted to use symbolic links, but mixing them with git on windows and 
> mac got me into troubles.
> I guess i will write a small script of this.
>
> Thank you Nick for the replay.
>
>
> On Mon, Jun 22, 2015 at 11:16 PM Nick (Cloud Platform Support) <
> pay...@google.com> wrote:
>
>> You'll need to make sure that the .py files that contain the model 
>> definitions are available to both modules when deployed. The naive way to 
>> do this is to simply copy the files.
>>
>> Another option is that you can put the definitions in a central location 
>> and use symbolic links to include them into the module's subfolder when 
>> deploying. 
>>
>> If you have a need to transfer the project between operating systems, you 
>> should package everything into one folder, and use a build tool to copy the 
>> libs into the necessary location within a module before deploying that 
>> module.
>>
>> If you'd like to make a feature request for app.yaml to include a stanza 
>> which allows the inclusion of paths relative to app.yaml (including 
>> directories above the module's directory in the file-system tree), you 
>> should post this to the public issue tracker, although the other solutions 
>> given have sufficed pretty generally for the times when I've faced this 
>> need.
>>
>>
>> On Monday, June 22, 2015 at 12:21:34 PM UTC-4, Dor litay wrote:
>>>
>>>
>>> I have an App-Engine application that is compose of different modules, 
>>> how can I share code between them (specifically I want to share my NDB 
>>> models).
>>>
>>>
>>> I did a little searching and found the "appengine_config.py" and the 
>>> "symbols link", but "appengine_config.py" doesn't seems to work at all with 
>>> the new gcloud, and I can't use "symbols link" because I have an 
>>> multi-platform development environment.
>>>
>>>
>>> Any help will be appreciate.
>>>
>>  -- 
>> You received this message because you are subscribed to a topic in the 
>> Google Groups "Google App Engine" group.
>> To unsubscribe from this topic, visit 
>> https://groups.google.com/d/topic/google-appengine/RfdaiPeAWOY/unsubscribe
>> .
>> To unsubscribe from this group and all its topics, send an email to 
>> google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at http://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/d0544296-9cc0-473b-91d1-dae0167c7709%40googlegroups.com
>>  
>> 
>> .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/a74c8197-8606-4e27-bdaa-341ff002abc8%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: docker daemon leaking memory on Managed VM

[Michael (Cloud Platform Support)]

Hi Shantanu!

This sort of issue would be best directed to the Public Issue Tracker for 
App Engine 
. Once 
there, I highly recommend creating a Defect Report and describing your 
issue so that our engineering team can handle it as quickly as possible and 
supply anyone else with this issue any further updates. Once you have 
created the issue, please link to it here.

Cheers!

On Tuesday, June 23, 2015 at 2:51:14 AM UTC-4, Shantanu Tushar wrote:
>
> Hi,
>
> One of our business apps is deployed on a Managed VM in AppEngine with the 
> Go runtime. The app itself is pretty lightweight and hence we have a 0.5 
> CPU and 1GB RAM instance requested in app.yaml. A surprise to us, we 
> started noticing frequent reboots of the the VM causing quite some 
> downtime. After some analysis, we found that docker daemon was ending up 
> consuming ~80% of RAM after 8-10 hours of uptime, making the system 
> unresponsive (including ah health checks). This made GAE treat the host 
> unhealthy and restarted the VM.
>
> We tried increasing the instance RAM size to see if docker daemon is 
> leaking or its just that it needs ~800M to work. As expected, after few 
> days of uptime docker daemon is now consuming ~80% of 3GB of RAM (around 
> 2.7G resident, screenshot attached).
>
> A bit of searching online took me to discussions such as 
> https://github.com/docker/docker/issues/12899#issuecomment-98709947 which 
> suggests docker 1.7 contains fixes.
>
> Has anybody faced this problem on managed VMs? If so, any possible 
> fix/workaround?
>
> Shantanu Tushar,
> SoStronk 
>  
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/0a63141b-71af-419e-a4b1-36650fbd20d5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: PayPal service upgrade for merchants on AppEngine

[Nick (Cloud Platform Support)]

As observed in the other thread and confirmed independently on my end, 
testing seems to work, indicating that the standards are met. Urllib2 will 
not use SHA256, although UrlFetch does, so it's important to use UrlFetch. 
More documentation on UrlFetch is a current goal of the product team, so 
expect that updates to the docs which elaborate these details to come in 
the short-to-medium term.

On Saturday, June 6, 2015 at 3:05:09 PM UTC-4, Iron Mountain Foundry wrote:
>
> Cross-referencing another thread discussing this same topic:
>
> https://groups.google.com/forum/#!topic/google-appengine/YyTC6PBgYxw
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/e5517fa8-c967-4660-8086-26df962f866e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: How and where to request addtion appengine module limit

[Ryan (Cloud Platform Support)]

Salutations,

Can you send me your app-id in a private message. I cannot guarantee an 
increase but we can look into it.

On Tuesday, June 23, 2015 at 12:37:07 AM UTC-4, poke wrote:
>
> We have big - very big project , so i want to increase number of modules 
> limit up to 100
> How and where to request addtion appengine module limit
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/207d5c38-59e3-4d43-a461-5602e1425e47%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Outgoing bandwidth is far higher than possible

[PaintingInAir]

Currently, the outgoing bandwidth for one of my apps is exactly 2.0 GB, and 
I am being billed for 1.0 GB. My app is not popular, and traffic statistics 
show a peak of 300 Bytes per second (and that is for less than a minute). 
Even at 300 Bytes per second, for the 7 hours the instance has been active, 
I would have only used about 7 Mb.

P.S. I would contact support directly, but I see no way to.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/83247538-6110-4076-a98b-2e84d651ad1b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: billing problem

[Nick (Cloud Platform Support)]

Hi Navneet,

This seems like an issue that you should resolve with your company, since 
they seem to have done the set-up for the others projects you describe as 
working properly. Another option is for them to open a support ticket 
. Another option you should look into is 
contacting 
Billing Support 
. Finally, 
the limited advice I *can *give is to look in the Developers Console for 
your project (insert your app id):

https://console.developers.google.com/project/**/settings

Here you can check which billing account is associated with the project (it 
should be your company's).

Other than this, I'll remind that this isn't the right place to look for 
billing support. As mentioned above and in previous threads, you should 
contact Billing Support to get something like this resolved. The purpose of 
this forum, the Google Groups App Engine forum, is to have general and 
high-level discussions of the platform and its services, not for one-on-one 
support.

Best of luck!

Nick

On Wednesday, June 24, 2015 at 12:44:07 PM UTC-4, navn...@senspan.com wrote:
>
> my company owns this domain * "xx.com "* 
>  , so they created and gave me goole app engin account , so i login using 
> "myname***@xxx.com " every developer in my firm has his own goole 
> app engin account provided to them by our company
>
>
>
> when ever other employess of my company create a new projet or a database 
> instance , the new instance is created with name   
> *.com:projectname:instance 
> name  * and bills are listed to company account, but when i create my 
> application I didnt  get *x.com : 
> as a prefix in my instance name *,and billing is done on to my personal 
> card
>
>
> I didnt found any company billing details linked to my google app engine 
> account, please tell me why this is happening  and how to resolve this . 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c5a1ec1a-1a7a-4b15-9779-c71bb3281ac1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] switch database instance , keeping the source code same

[navneet]

we are in testing phase of our application ,
so we have to database 
1. live database
2. test database.

so can anyone please suggest a way to  dynamically switch from  live 
database to  test database  , 
for now we have created 2 different source code and have created 2 instance 
of application, but we want to keep the source code same.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/c75c499d-9cf4-405f-95d6-bb228949e7ed%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: "Request was aborted after waiting too long to attempt to service your request"

[Eric Froemling]

I started seeing this too a day or so ago too (somewhere around 9-10PM EST 
monday night). For me it's not limited to deferred requests; I'm seeing 
large numbers of these failures across all my requests.  I've found I can 
keep things under control by cranking max_idle_instances way up (I usually 
leave it at zero), but I really hope this gets resolved soon.  I also 
noticed this exact same thing happening several weeks back; in that case it 
lasted started on a saturday and seemed to get resolved the following 
monday.

Anyone else seeing this or know what could be happening here?
Thanks,
-Eric

On Tuesday, June 23, 2015 at 2:01:42 AM UTC-7, PK wrote:
>
> For the past few days I see a lot of aborted calls with the message
>
> "Request was aborted after waiting too long to attempt to service your 
> request”
>
> It comes from deferred and other queued requests, I have not seen any 
> change with interactive calls. Has anybody else noticed similar behavior? I 
> use the scheduler with the default settings. Has anything changed?
>
> Thanks,
> PK
> p...@gae123.com 
>
>
>
>  
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/b18882aa-d5e4-4d01-8297-7479f6b2ca51%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: making project strictly use HTTPS , and deny and redirect HTTP urls to HTTPS.

[Hristo]

I think you can just set the "secure" parameter in app.yaml:

https://cloud.google.com/appengine/docs/java/configyaml/appconfig_yaml#Java_app_yaml_Secure_URLs

- Hristo



On Wednesday, June 24, 2015 at 9:17:55 AM UTC-7, nav...@senspan.com wrote:
>
> I have made a project that can Run on HTTPS but now I want it to use only 
> HTTPS not HTTP , 
> my project is in java and i used eclipse in development , 
> I found out that we need to redirect all request and make changes in 
> Httpd's configuration file  and remove listen port 80 , from that file ,
>  but i was not able to find these configurations files.
>
> please suggest me how to make site strictly HTTPS. 
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2f833ca4-6068-4118-8612-e03e896f203c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: making project strictly use HTTPS , and deny and redirect HTTP urls to HTTPS.

[navneet]

thanks a lot , it was simple and perfect :)


On Wednesday, June 24, 2015 at 12:17:55 PM UTC-4, nav...@senspan.com wrote:
>
> I have made a project that can Run on HTTPS but now I want it to use only 
> HTTPS not HTTP , 
> my project is in java and i used eclipse in development , 
> I found out that we need to redirect all request and make changes in 
> Httpd's configuration file  and remove listen port 80 , from that file ,
>  but i was not able to find these configurations files.
>
> please suggest me how to make site strictly HTTPS. 
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/4dcc64d3-b344-452b-96c3-c2c23cf935d2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: high latency in urlfetch when calling an external API with google app engine

[Nick (Cloud Platform Support)]

Hey ssmcookiemonster,

When debugging latency of a request, it's best to only surround the request 
action itself with timing code, so you should profile the time to execute 
the following two lines only:

Future future = fetcher.fetchAsync(url);
HTTPResponse responseHttp = future.get();

This will minimize the impact of memory-management, object-creation, 
string-buffering, etc., and tend to show a more accurate measure of network 
latency. 

Another way to get insight into the problem is to ping / traceroute / mtr 
the target of your request from various locations. You might want to run 
these diagnostic tools from:

* your local development box
* a compute-engine instance in the same region as your app (US or EU)
* other locations around the world

This will allow you get a handle on how traffic will be routed to the 
endpoint you're attempting to reach, and the relative latencies from 
different locations.

You may also want to run Url Fetch requests to locations that are closer to 
your app and/or development box and see how latency is affected.

Finally, you can install AppStats (Java 
 | Python 
) on your 
app to see the statistics around UrlFetch calls your app makes.

I hope this information has provided a helpful guide to debugging latency 
with Url Fetch. 

On Wednesday, June 24, 2015 at 4:23:23 AM UTC-4, ssmcookiemons...@gmail.com 
wrote:
>
> We have a Java application that make use of urlfetch calling an external 
> api. We are having issues with the request time. When we do a request in a 
> local environment we have a mean time of 300ms, however in production we 
> have times of 1s or 1.4s.
>
> This is the code we are using:
>
> Calendar start = Calendar.getInstance();
>
> try {
>
>   URLFetchService fetcher = 
> URLFetchServiceFactory.getURLFetchService();
>
>   URL url = new URL( String.format( API_URL, productsIds ) );
>   Future future = fetcher.fetchAsync(url);
>
>
>   HTTPResponse responseHttp = future.get();
>   byte[] content = responseHttp.getContent();
>
>   response = new String(content);
>
>   System.out.println("request time :" + 
> (Calendar.getInstance().getTimeInMillis() - start.getTimeInMillis() ) );
>
>
> } catch ( Exception e ) {
> LOGGER.log( Level.SEVERE, "Error calling api : " + e.getMessage() );
> }
>
>
> Is Google doing any kind of validation that produces this time increase?
>
> Is there a way to reduce the request time?
>
> Thank you very much
>
>
>
>
>
>
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/3447916e-079b-4186-be6a-7a84fa99f1ea%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] billing problem

[navneet]

my company owns this domain * "xx.com"*  , so they created and gave 
me goole app engin account , so i login using "myname***@xxx.com " 
every developer in my firm has his own goole app engin account provided to 
them by our company



when ever other employess of my company create a new projet or a database 
instance , the new instance is created with name   
*.com:projectname:instance 
name  * and bills are listed to company account, but when i create my 
application I didnt  get *x.com: as a prefix in my instance 
name *,and billing is done on to my personal card


I didnt found any company billing details linked to my google app engine 
account, please tell me why this is happening  and how to resolve this . 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9e0b6d97-64bc-4418-aa54-245c331344c6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] making project strictly use HTTPS , and deny and redirect HTTP urls to HTTPS.

['Alex Martelli' via Google App Engine]

On Wed, Jun 24, 2015 at 9:17 AM,  wrote:

> I have made a project that can Run on HTTPS but now I want it to use only
> HTTPS not HTTP ,
> my project is in java and i used eclipse in development ,
> I found out that we need to redirect all request and make changes in
> Httpd's configuration file  and remove listen port 80 , from that file ,
>  but i was not able to find these configurations files.
>

Indeed, App Engine does not use those configuration files, but its own ones.


>
> please suggest me how to make site strictly HTTPS.
>

See https://cloud.google.com/appengine/docs/java/config/webxml#Secure_URLs
-- i.e if you're running as *.appspot.com, all you need to do is to use the
deployment descriptor to set the desired URL pattern to "CONFIDENTIAL" (if
you're running as your own domain, follow the link in that page for further
information).


Alex


>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/0b5b5394-c696-4d79-9262-678b23c58bb5%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAE46Be9%2BDTQA1KHFXNM5e%2BkP8S3UyNekCG%2BHtiFtmLV3gs_vyw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] creating a database instance independent of any project .

[navneet]

I have 7 to 8 projects on google app engine, that my whole team works on , 
and now we have decided to create a test database, so their is a way to 
create this database instance , and name it testdb, because the only way i 
found out to create a instance is vis a application and going to sql cloud 
and then creating a new instance , but in that case the name if database 
instance is linked with project name . 


  

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ff171766-ba3a-486a-b661-9a5c47eff967%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] making project strictly use HTTPS , and deny and redirect HTTP urls to HTTPS.

[navneet]

I have made a project that can Run on HTTPS but now I want it to use only 
HTTPS not HTTP , 
my project is in java and i used eclipse in development , 
I found out that we need to redirect all request and make changes in 
Httpd's configuration file  and remove listen port 80 , from that file ,
 but i was not able to find these configurations files.

please suggest me how to make site strictly HTTPS. 
   

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/0b5b5394-c696-4d79-9262-678b23c58bb5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Google Cloud Datastore Incremental Backups

[Ryan (Cloud Platform Support)]

You would create a cron job 
 to hit a URL 
in your app. That URL would then start the mapreduce 

 
job programmably.

On Wednesday, June 24, 2015 at 4:00:42 AM UTC-4, Gubbi wrote:
>
> Thanks Ryan.
>
> We were looking at the Mapreduce code that does the backup and also the 
> Cloud Dataflow code for DatastoreIO. We can do our own custom backups today 
> using a query via dataflow. Only restriction seems to be that the query 
> can't have inequality operators.
>
> However, we are not able to find a way to schedule Dataflow pipelines. 
> Questions to this effect on StackOverflow have gone unanswered. The 
> Dataflow FAQ however has this:
>
> Is there a built-in scheduling mechanism to execute pipelines at given 
> time or interval?
>
> You can automate pipeline execution through Google App Engine or custom 
> (CRON) job processes on GCE. Future releases of the SDK will support 
> command line options for finer grained control over job management.
>
>
> But there is no documentation on how to automate execution using Appengine 
> or Cron. If you could please help me with this, I'll have a solution.
>
>
> Thanks,
> Vinuth.
>
>
>
> On Thu, Jun 18, 2015 at 7:10 PM, Ryan (Cloud Platform Support) <
> rbruy...@google.com> wrote:
>
>> I will process your PIT later today. 
>>
>> Unfortunately there is no way to do incremental backups at this time.
>>
>>
>> On Thursday, June 18, 2015 at 1:02:25 AM UTC-4, Gubbi wrote:
>>>
>>> I have created a new feature request here: 
>>> https://code.google.com/p/googleappengine/issues/detail?id=12071
>>>
>>> starred the old feature request as well.
>>>
>>> Are there any strategies I can use now for incremental backups?
>>>
>>>
>>> On Wed, Jun 17, 2015 at 12:56 AM, Jason Collins <
>>> jason.a.coll...@gmail.com> wrote:
>>>
 I have an old feature request here if you want to star it:

   https://code.google.com/p/googleappengine/issues/detail?id=7428


 On Tuesday, 16 June 2015 08:37:46 UTC-7, Ryan (Cloud Platform Support) 
 wrote:
>
> Salutations Gubbi,
>
> This Feature Request would best be posted in the Public Issue Tracker 
> .
>  
> When you fill out the report let me know on this thread and I will 
> process 
> it for you.
>
> On Tuesday, June 16, 2015 at 10:53:47 AM UTC-4, Gubbi wrote:
>>
>> Hi,
>>
>> The official backup method only supports full backup as of now. I 
>> don't know when, if at all, it'll support incremental backup.  It'll be 
>> wasteful to take full backups every time.
>>
>> What strategies are you using for taking incremental backups of your 
>> datastore? 
>>
>>
>> Thanks,
>> Vinuth.
>>
>>
>>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at http://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/06f79b85-be73-4dc4-a774-07dfc6cf9cb0%40googlegroups.com
>>  
>> 
>> .
>>
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/143a8860-8148-48a0-941c-aeb27c66063b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: How can I Serve SVG over SSL

[Michael (Cloud Platform Support)]

Hi Jesus!

There are a few possible reasons for your application not using the correct 
MIME type. I'd like you to send me the contents of your app.yaml file 
through private message so that I may better identify a possible cause for 
this behavior.

Cheers!


On Sunday, June 21, 2015 at 6:08:10 PM UTC-4, Jesus Noland wrote:
>
> When I run the local development environment my SVG file renders correctly 
> on the web page but when I upload the app to my custom domain with SSL the 
> image type is octet-stream. I have tried updating the app's YAML file but I 
> can't get it to serve right. What do I need to do to get the SVG file to 
> render as an image on a webpage on a custom domain with SSL?
>
> My app is running on Python2.7 and Flask.
>
> Your answers are great appreciated. Thanks
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/0cb01018-4f3d-48c8-aca0-b50ed56fab15%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: App Engine site returning 503 Over Quota when I am under quota and have billing enabled

[Ryan (Cloud Platform Support)]

Creative Cubs' answer will most likely fix your issue. If after adding a 
daily budget of at least one penny you are still hitting that error you 
might be hitting a safety limit 
.
 
Make sure you are not doing any bursty calls.

On Wednesday, June 24, 2015 at 1:06:33 AM UTC-4, Creative Cubs wrote:
>
> Enabling billing is not sufficient.  You need to set app engine daily 
> quotas, for app engine to provision new instances beyond free tier. 
>
> See 
> http://stackoverflow.com/questions/31017902/google-app-engine-quote-is-expired-how-to-provision-new-instances-on-emergency
>
>
> On Monday, September 9, 2013 at 2:23:56 AM UTC+5:30, Elaine Ou wrote:
>>
>> I've had this problem for 3 days now -- My App Engine site is returning 
>> 503 Over Quota Error, but in my dashboard quota details, (
>> https://appengine.google.com/dashboard/quotadetails) all rows show that 
>> the rate is "Okay".
>>
>> Furthermore, I have billing enabled for my account so I don't know why 
>> this would arise.
>>
>> Are there other sources of quota violations that are not listed on the 
>> Quota Details page?
>>
>> Thank you!
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/2233505a-3aab-4f6c-885a-590449e722a4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] high latency in urlfetch when calling an external API with google app engine

[ssmcookiemonster]

We have a Java application that make use of urlfetch calling an external 
api. We are having issues with the request time. When we do a request in a 
local environment we have a mean time of 300ms, however in production we 
have times of 1s or 1.4s.

This is the code we are using:

Calendar start = Calendar.getInstance();

try {

  URLFetchService fetcher = URLFetchServiceFactory.getURLFetchService();

  URL url = new URL( String.format( API_URL, productsIds ) );
  Future future = fetcher.fetchAsync(url);


  HTTPResponse responseHttp = future.get();
  byte[] content = responseHttp.getContent();

  response = new String(content);

  System.out.println("request time :" + 
(Calendar.getInstance().getTimeInMillis() - start.getTimeInMillis() ) );


} catch ( Exception e ) {
LOGGER.log( Level.SEVERE, "Error calling api : " + e.getMessage() );
}


Is Google doing any kind of validation that produces this time increase?

Is there a way to reduce the request time?

Thank you very much








-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/16504e78-314c-4838-9b45-9aa89c30ae5a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [google-appengine] Re: Google Cloud Datastore Incremental Backups

[Vinuth Madinur]

Thanks Ryan.

We were looking at the Mapreduce code that does the backup and also the
Cloud Dataflow code for DatastoreIO. We can do our own custom backups today
using a query via dataflow. Only restriction seems to be that the query
can't have inequality operators.

However, we are not able to find a way to schedule Dataflow pipelines.
Questions to this effect on StackOverflow have gone unanswered. The
Dataflow FAQ however has this:

Is there a built-in scheduling mechanism to execute pipelines at given time
or interval?

You can automate pipeline execution through Google App Engine or custom
(CRON) job processes on GCE. Future releases of the SDK will support
command line options for finer grained control over job management.


But there is no documentation on how to automate execution using Appengine
or Cron. If you could please help me with this, I'll have a solution.


Thanks,
Vinuth.



On Thu, Jun 18, 2015 at 7:10 PM, Ryan (Cloud Platform Support) <
rbruy...@google.com> wrote:

> I will process your PIT later today.
>
> Unfortunately there is no way to do incremental backups at this time.
>
>
> On Thursday, June 18, 2015 at 1:02:25 AM UTC-4, Gubbi wrote:
>>
>> I have created a new feature request here:
>> https://code.google.com/p/googleappengine/issues/detail?id=12071
>>
>> starred the old feature request as well.
>>
>> Are there any strategies I can use now for incremental backups?
>>
>>
>> On Wed, Jun 17, 2015 at 12:56 AM, Jason Collins <
>> jason.a.coll...@gmail.com> wrote:
>>
>>> I have an old feature request here if you want to star it:
>>>
>>>   https://code.google.com/p/googleappengine/issues/detail?id=7428
>>>
>>>
>>> On Tuesday, 16 June 2015 08:37:46 UTC-7, Ryan (Cloud Platform Support)
>>> wrote:

 Salutations Gubbi,

 This Feature Request would best be posted in the Public Issue Tracker
 .
 When you fill out the report let me know on this thread and I will process
 it for you.

 On Tuesday, June 16, 2015 at 10:53:47 AM UTC-4, Gubbi wrote:
>
> Hi,
>
> The official backup method only supports full backup as of now. I
> don't know when, if at all, it'll support incremental backup.  It'll be
> wasteful to take full backups every time.
>
> What strategies are you using for taking incremental backups of your
> datastore?
>
>
> Thanks,
> Vinuth.
>
>
>>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at http://groups.google.com/group/google-appengine.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/google-appengine/06f79b85-be73-4dc4-a774-07dfc6cf9cb0%40googlegroups.com
> 
> .
>
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAEKebv%2BqCR7eH_WupAcorXxN65hNKoZyd75dGY3WqV%2Bdt01_Uw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.