Re: [google-appengine] Best Practices for Search API?

2017-06-13 Thread Emlyn
"The search API is pretty cool. I hope Google makes an official service out
of it someday."

I second this! I live in fear of deprecation. How could we possibly replace
it?

On 10 June 2017 at 16:04, Jeff Schnitzer  wrote:

> No not at all; quite the opposite, really. I was storing word fragments
> for typeahead, eg “foobar” became [“f”, “fo”, “foo”, “foob”, “fooba”,
> “foobar”]. It was very expensive to index in the datastore and very cheap
> to index in the search api.
>
> The search API is pretty cool. I hope Google makes an official service out
> of it someday.
>
> Jeff
>
> On Fri, Jun 9, 2017 at 3:45 PM, Nickolas Daskalou 
> wrote:
>
>> Jeff, were you storing docs in the Search API somewhat intelligently,
>> e.g. using short field names, "0" instead of "false" for boolean values
>> etc., or you just sent documents to the Search API without much thought and
>> it was still efficiently storing them?
>>
>> Nick
>> On 10/06/2017 8:40 AM, "Jeff Schnitzer"  wrote:
>>
>>> The search index is incredibly efficient. I had some data I was indexing
>>> in the datastore, and the index was consuming 100GB+. When I moved it to
>>> the Search API, the index consumed a few GB. Afterwards I felt silly for
>>> asking for the quota raise in advance.
>>>
>>> YMMV, of course.
>>>
>>> Not a direct answer to your question but something to keep in mind. I
>>> was surprised by how small the index is.
>>>
>>> Jeff
>>>
>>> On Thu, Jun 8, 2017 at 11:34 PM, Emlyn  wrote:
>>>
 I've just noticed that the old 10GB limit on search indices can be
 raised on request to 200GB max, on an index by index basis.

 I've got a use case where I'd ideally like search indices to be
 unbounded, but 200GB will go a long way. Is there any penalty associated
 with this, though? Do the indices perform worse as they get larger? Does
 anyone know why there is a limit at all?

 --
 Emlyn

 http://point7.wordpress.com - My blog
 https://plus.google.com/u/0/100281903174934656260 - Google+

 --
 You received this message because you are subscribed to the Google
 Groups "Google App Engine" group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to google-appengine+unsubscr...@googlegroups.com.
 To post to this group, send email to google-appengine@googlegroups.com.
 Visit this group at https://groups.google.com/group/google-appengine.
 To view this discussion on the web visit https://groups.google.com/d/ms
 gid/google-appengine/CAMp1VPBcfZZUT14s3v7mxCoPy33Yryv3T2OaxP
 g_kvX4-aUm3w%40mail.gmail.com
 
 .
 For more options, visit https://groups.google.com/d/optout.

>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Google App Engine" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to google-appengine+unsubscr...@googlegroups.com.
>>> To post to this group, send email to google-appengine@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/google-appengine.
>>> To view this discussion on the web visit https://groups.google.com/d/ms
>>> gid/google-appengine/CADK-0uhbRNHBDpj5%2BspLM0rp_-o5Ga_fsAVX
>>> TSjQt1qYGNMCJQ%40mail.gmail.com
>>> 
>>> .
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to google-appengine+unsubscr...@googlegroups.com.
>> To post to this group, send email to google-appengine@googlegroups.com.
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit https://groups.google.com/d/ms
>> gid/google-appengine/CAOj3zuDkQLAE%2BV5H1WWXxu4hj-MWNpddNiSh
>> C7R8YkWE5fug9Q%40mail.gmail.com
>> 
>> .
>>
>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/CADK-0uhhw4f%2BOwpJ%2Bw

[google-appengine] App Version - testing

2017-06-13 Thread Richard Cheesmar
Hi, 

Will adding data to a non default app version (testing) add it to the 
default ndb store? 

I haven't deployed another version yet just need to confirm this in advance 
as the new version uses modified model entities and I don't want to change 
the live version model entities whilst testing the new version.

Cheers

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/d0cbcce4-af89-48ae-833f-f1af01fb1fad%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] App Version - testing

2017-06-13 Thread Emlyn
All versions share the same data. Be careful there :-)

On 13 June 2017 at 18:51, Richard Cheesmar  wrote:

> Hi,
>
> Will adding data to a non default app version (testing) add it to the
> default ndb store?
>
> I haven't deployed another version yet just need to confirm this in
> advance as the new version uses modified model entities and I don't want to
> change the live version model entities whilst testing the new version.
>
> Cheers
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/d0cbcce4-af89-48ae-833f-
> f1af01fb1fad%40googlegroups.com
> 
> .
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Emlyn

http://point7.wordpress.com - My blog
https://plus.google.com/u/0/100281903174934656260 - Google+

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAMp1VPDJ-wvFLAEqG4HKwUTwO-rMYrFzKZ4ZasN7yrJfVKvm3g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: App Version - testing

2017-06-13 Thread Richard Cheesmar
I thought as much, ok ,this means I'll have to launch straight out after 
more extensive local testing and then run some up front tasks to change the 
data structure of existing models when I launch.


On Tuesday, June 13, 2017 at 12:21:26 PM UTC+3, Richard Cheesmar wrote:
>
> Hi, 
>
> Will adding data to a non default app version (testing) add it to the 
> default ndb store? 
>
> I haven't deployed another version yet just need to confirm this in 
> advance as the new version uses modified model entities and I don't want to 
> change the live version model entities whilst testing the new version.
>
> Cheers
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/61ef2240-0be2-4201-8b09-481b54320ee9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] App engine deployments with endpoint best practices

2017-06-13 Thread Lance Myrick
All, just wondering if anyone has some best practices for deploying an app 
engine flexible api implementation with an endpoint?  I have read the api 
appengine docs from googles site.

The clunkiness I have run into is there does not seem to be a good way to 
build and deploy the endpoints and app engine code at the same time as 
the endpoints_api_service>config_id parameter of the app.yaml file needs to 
be populated from the service-management config_id once the endpoint is 
deployed which is done by the glcoud service-management command not the 
maven deploy phase.

Our API implementation is a java maven project.  We are using the swagger 
maven plugin to generate the openapi.json file at build time.  Right now 
our jenkins job builds and deploys the endpoint only if there is a change 
to the openapi.json file, then grabs the config_id just created and 
populates the app.yaml file, after that we deploy the API code to app 
engine.  This process is simple enough; however, it feels clunky.  When I 
saw the maven appengine plugin I assumed that the plugin would handle not 
only the app engine api implementation but also the endpoints, this is not 
the case.

Am I missing something?

Thanks,  Lance


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/310b6b48-b9d3-4aed-a290-d5b56502dd4a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Is Google App Engine Launcher being deprecated? Why??

2017-06-13 Thread Alejandro Pivaral
Yes, please! Google App Engine Launcher was great, specially for Windows 
users, I also want to focus in writing code not in command line stuff :(

On Sunday, May 21, 2017 at 3:41:30 PM UTC-6, Mike Elugelab wrote:
>
> I can't tell you how valuable the Launcher is.  I want to write code -- I 
> don't want to get entwined in the tortured world of devops scripting.  Yes, 
> understand Google wants us to use Cloud SDK, but the Launcher is such a 
> great front door to get in.  If you didn't have Launcher I'd change to 
> Heroku and never again think about App Engine again or tell my friends how 
> good it is/was.
>
> @Justin: please keep supporting (unofficially, of course) your GUI.  Maybe 
> Google will make it official.
>
> Meanwhile, a discussion on Stack Overflow pointed to this link where the 
> original App Engine Launcher can still be downloaded:
>
>
> https://cloud.google.com/appengine/docs/standard/python/download#appengine_sdk
>
>
> http://stackoverflow.com/questions/38982261/has-the-google-app-engine-launcher-for-mac-osx-been-deprecated
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/186530be-d5e2-4c1f-9e73-a25505267c18%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: Anyone experiencing the new console log view being a bit busted?

2017-06-13 Thread 'George (Cloud Platform Support)' via Google App Engine
Hello Emlyn, 

This issue seems to manifest itself in particular circumstances, as I can 
not reproduce it based on the received information. More detail is needed, 
preferably a step-by-step description of the procedure. What types of logs 
are these, for which operations? 

All other information you deem relevant will be highly appreciated. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/22c28b34-d34e-4a9c-a080-63582cb8db91%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Unable to get TLS 1.2 working on Mac OS

2017-06-13 Thread NP


1) I'm running Google App Engine SDK on Mac OS X El Capitan. I have Python 
2.7.13


2) While trying to test my app with Stripe, I get the following error

 Request req_ApPsfecKnLFJxb: Stripe no longer supports API requests 
made with TLS 1.0. Please initiate HTTPS connections with TLS 1.2 or later. 
You can learn more about thisat 
https://stripe.com/blog/upgrading-tls.


3) I did some Googling and based on what I found, I did the following


   -  Used brew to upgrade my OpenSSL
   - Confirmed that when I do 'which openssl', I get
   
 /usr/local/opt/openssl/bin/openssl

 and when I do 'openssl version', I get

OpenSSL 1.0.2l



   - If I do
   
   >>> import ssl

  >>> ssl.OPENSSL_VERSION, I get

  >>> 'OpenSSL 1.0.2l 23 May 2017'


But I still get the error from Stripe about not using TLS 1.2.


I found this SO question 
 but 
it didn't solve my problem. I also found this Google Group Discussion 
 and after running the 
steps in #5, it shows app engine is still pointing to the old version of 
OPENSSL because the output shows 'OpenSSL 0.9.8zh 14 Jan 2016'


4) Based on the earlier referenced Google Group Discussion, I ran the 
following code in both GAE Dev and directly in my python intepreter


import ssl 

print ssl.__file__ 



GAE DEV: 
/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/ssl.pyc


Python Interpreter: 
/usr/local/Cellar/python/2.7.13/Frameworks/Python.framework/Versions/2.7/lib/python2.7/ssl.pyc



They're pointing to different files. How do I fix this? How do I get App 
Engine to use the newer version of OpenSSL that I've installed?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/f7852c12-254b-4df6-9bf3-d07a0e46ff73%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Create new app and copy all settings and ndb (via backup) from old app to new app

2017-06-13 Thread Richard Cheesmar
As per subject is that possible and if so is there a how to out there?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/35f67fb2-dc78-4362-be0f-f42d836fd406%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Re: App engine deployments with endpoint best practices

2017-06-13 Thread 'Jordan (Cloud Platform Support)' via Google App Engine
Google Cloud Endpoints  allows you to 
choose your own framework to configure your API. You specifically chose the 
Open 
API specification 
, but you 
could have alternatively chose to use the provided Google Cloud Java 
Endpoints Framework 
. 

Note, if you require specific technical support for Cloud Endpoints, it is 
suggested to post your technical questions on Stack Overflow 
 using the supported 
Google Cloud tags. 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ea1f02e1-5bb6-476e-9e67-32cada70c8d3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [google-appengine] Re: Anyone experiencing the new console log view being a bit busted?

2017-06-13 Thread Emlyn
They're logs from a Python (standard) AppEngine application.

But today the view has reverted back to how it used to be, everything's
working again. Maybe I was B in an A/B test?

On 14 June 2017 at 00:01, 'George (Cloud Platform Support)' via Google App
Engine  wrote:

> Hello Emlyn,
>
> This issue seems to manifest itself in particular circumstances, as I can
> not reproduce it based on the received information. More detail is needed,
> preferably a step-by-step description of the procedure. What types of logs
> are these, for which operations?
>
> All other information you deem relevant will be highly appreciated.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to google-appengine+unsubscr...@googlegroups.com.
> To post to this group, send email to google-appengine@googlegroups.com.
> Visit this group at https://groups.google.com/group/google-appengine.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/google-appengine/22c28b34-d34e-4a9c-a080-
> 63582cb8db91%40googlegroups.com
> 
> .
>
> For more options, visit https://groups.google.com/d/optout.
>



-- 
Emlyn

https://medium.com/the-infinite-machine - A publication about Google App
Engine
sutllang.com - My language sUTL
https://plus.google.com/u/0/100281903174934656260 - Google+

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAMp1VPBrbDV_7bxcQiAx597s_wviQSmhskut2ckxbe9abbigUQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


[google-appengine] Task rate limits?

2017-06-13 Thread Emlyn
I'm doing a lot with code that enqueues huge amounts of tasks (hundreds of
thousands) in short periods of time (over a couple of minutes). Some tasks
enqueue other tasks, in a fan-out.

I'm 99% sure that I'm hitting some kind of hidden rate limitation from time
to time. The behaviour I'm seeing is that my queue stops processing any
events suddenly, for a few minutes, might be for ten minutes. Then it picks
up and continues like nothing happened.

Is there some kind of rate limit under the covers that I'm hitting?

-- 
Emlyn

https://medium.com/the-infinite-machine - A publication about Google App
Engine
sutllang.com - My language sUTL
https://plus.google.com/u/0/100281903174934656260 - Google+

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/CAMp1VPBYJFLEB7sbC3N9Kk814MEEs4HEbSZUytbZb0yRp_29zw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.