Re: [google-appengine] Re: Connecting from app engine instance to compute engine instance directly

[AJ Ross]

I would like to connect to a microservice running on kubernetes cluster 
from my appengine application, while avoiding the need to transit the 
public internet. Since flex runs my appengine application as a cluster in 
GCE it seems like this should be possible?

On Friday, May 26, 2017 at 1:26:50 PM UTC-7, Justin Beckwith wrote:
>
> No no no no :) We don't enable this directly in flex.  May I ask - why are 
> you trying to connect directly to a single instance?  
>
> On Fri, May 26, 2017 at 1:20 PM, AJ Ross > 
> wrote:
>
>> If you're willing to migrate to Flex, it appears as though you can do it:
>>
>> https://groups.google.com/d/msg/google-appengine/5RsoKIPWyTQ/pnxyI-anBAAJ
>>
>> On Wednesday, April 26, 2017 at 8:03:29 PM UTC-7, Bjorn Harvold wrote:
>>>
>>> Definitely a needed feature!
>>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Google App Engine" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to google-appengi...@googlegroups.com .
>> To post to this group, send email to google-a...@googlegroups.com 
>> .
>> Visit this group at https://groups.google.com/group/google-appengine.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/google-appengine/9dc63deb-1bf5-49af-a26f-319a6c86dc80%40googlegroups.com
>>  
>> <https://groups.google.com/d/msgid/google-appengine/9dc63deb-1bf5-49af-a26f-319a6c86dc80%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>>
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
>
> -- 
>
> Justin Beckwith | Google Cloud Platform | @justinbeckwith 
> <http://twitter.com/JustinBeckwith> | http://jbeckwith.com
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/eb002bc3-a383-4fdb-8a7a-937feb5b1cbd%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: Connecting from app engine instance to compute engine instance directly

[AJ Ross]

If you're willing to migrate to Flex, it appears as though you can do it:

https://groups.google.com/d/msg/google-appengine/5RsoKIPWyTQ/pnxyI-anBAAJ

On Wednesday, April 26, 2017 at 8:03:29 PM UTC-7, Bjorn Harvold wrote:
>
> Definitely a needed feature!
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/9dc63deb-1bf5-49af-a26f-319a6c86dc80%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Re: App Engine to Compute Engine communication via internal IP

[AJ Ross]

Hey Lorne, thanks for the information. I have a "standard" instance and I'm 
migrating to "flex" in order to be able to open direct connections to a 
Kubernetes cluster. Good to know that this should work!

On Wednesday, January 4, 2017 at 10:25:40 AM UTC-8, Lorne Kligerman wrote:
>
> As Adam mentioned, this is only possible right now with the flex.  However 
> we do know this is a problem and are working towards a solution for 
> standard, nothing more to report at this time.
>
>
> On Friday, December 30, 2016 at 1:53:53 PM UTC-8, Nick (Cloud Platform 
> Support) wrote:
>>
>> Hey Jitenda,
>>
>> The Flexible Environment can be used by any user, although of course 
>> being a beta product, it isn't covered by the same SLA's as other products. 
>> You should check our documentation including the terms of service 
>> , service level agreements 
>> , and the explanation of launch 
>> stages .
>>
>> Cheers,
>>
>> Nick
>> Cloud Platform Community Support
>>
>> On Thursday, December 29, 2016 at 9:14:50 AM UTC-5, JITENDRA GANGWAR 
>> wrote:
>>>
>>> Thanks Adam for your answer , But  as per this documentation 
>>>  App Engine flexible 
>>> environment is still in beta release , can it be used in production ?
>>>
>>> On Saturday, June 25, 2016 at 2:38:46 AM UTC+5:30, Adam (Cloud Platform 
>>> Support) wrote:

 You should be able to do this if you use a Flexible Environment 
 instance, and specify the same network name 
 
  
 in the app.yaml that your Compute Engine instance running MySQL is on. It 
 won't work for Standard Environment instances as they are on separate, 
 physical networks.

 I say "should" as I haven't played around with this, and there's an 
 additional layer of network routing from the Docker container the app 
 lives 
 in which also has its own local subnet.

 On Friday, June 24, 2016 at 10:43:29 AM UTC-4, Stephen Dunkley wrote:
>
> I have a Java Web application deployed on a Compute Engine instance 
> connecting to MySql running on another Compute Engine instance in the 
> same 
> project. I am able to connect to MySql using the internal IP address 
> (jdbc:mysql://10.240.0.4:3306/).
>
> If I deploy the same web application to an App Engine instance within 
> the same project, I can only connect to the MySql instance via the 
> extermal 
> IP address (jdbc:mysql://104.196.148.141:3306/
> If I try to use the internal IP address, I get a Communication Link 
> Failure, Permission Denied due to policy.
>
> My question is how do I open up communication between an App Engine 
> instance and a Compute Engine instance via an internal IP address? The 
> performance is about 5 x faster when using the internal IP address.
>
> Any help would be much appreciated
>


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/dd0f921f-06ff-49ad-97af-a391b407cde9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] Unable to create new Client ID for Android Application

[AJ West]

After generating my release key and finding the SHA1 I go into my app 
engine project Dev Console under the APIs&Auth->Credentials section.

>From here I click, "Create a new Client ID"
Select "Installed Application"
Click "Android" radio button
Put in my package name: ca.ajwest.pythonapi
And paste in my SHA1 certificate fingerprint
Deep linking is enabled

After I click "Create Client ID" the lightbox popup returns to the console 
screen with the new Client ID for Android application with the SHA1 and 
package name displayed properly. When refreshing the console or navigating 
away and back to the credentials screen, the newly created Android Client 
ID no longer lists the SHA1, and the Deep linking option has been changed 
to disabled.

Just in case, I tried an authenticated call with the backend and the server 
logs display say that my client id is not authorized, despite it being 
clearly listed in my project's dev console (but now without the SHA1 field 
filled in for some reason).

I have tried creating an entirely new project, *and *a new 
keystore/certificate with the same results. Is there a problem with App 
Engine creating client ID credentials? 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

[google-appengine] pricing details of blobstore API

[Aj Jack]

Im looking for a detailed pricing details of Blobstore API. Like quota for 
calling the APIs or calling the write operations.

eg: With an app deployed , if 50gb of data are uploaded by 100 users 
through this app, what would be the approx amount per month.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/G2NhnCSK_osJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] dump table data and restart index

[AJ Chen]

I have a few tables in my app that I want to dump the data and the indexes
associated with the tables.  what's the good way to do that?

I tried to delete data from the table like this.  The table seems to be
empty after the deletion, but the index remains and the storage usage has no
change (>90%).

DatastoreService datastore = DatastoreServiceFactory.getDatastoreService();
  Query query = new Query(classname);
  for (Entity entity : datastore.prepare(query).asIterable()) {
datastore.delete(entity.getKey());
  }

thanks,
-- 
AJ Chen, PhD
Chair, Semantic Web SIG, sdforum.org
http://web2express.org
twitter @web2express
Palo Alto, CA, USA

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] reminder for tonight's event in Palo Alto: Intelligence from the Cloud

[AJ Chen]

Hi, some of you might be interested in tonight's SDForum semantic web event:
*Intelligence from the Cloud. * Please see below for event program or
sdforum.org<http://www.sdforum.org/index.cfm?fuseaction=Page.viewPage&pageId=656&parentID=483&nodeID=1>for
details.

6:30 PM - 9:00 PM March 3, 2010   Cubberley Community Center - Room H-1  4000
Middlefield Road  Palo Alto, CA

*Intelligence from the Cloud*

The computing cloud is forming on top of the web. It's going to change the
way we  develop and use applications. This event, "Intelligence from the
Cloud" will look at the connection between the cloud and web intelligence.
The focus will be the new infrastructures available today that are enabling
easy creation and consumption of web intelligence and semantics in the
cloud.

Wesley Chun from Google AppEngine Team will introduce Google App Engine
platform, an application development and hosting platform that lets you
build & deploy web applications on Google's high-traffic infrastructure. App
Engine executes apps (written in Python or Java) on servers that use the
same technology that powers Google's websites for speed and reliability.
There is no need to think about virtual machine images or disk
requirements... you just provide the code. This is a high-level talk
introducing attendees to Google App Engine, including its components and
architecture as well as some of its most popular developer APIs, such as
memcache, users (Google accounts), email, URLFetch, XMPP, Blobstore, etc.
Time-permitting we'll go through a simple example using Python.

The terms “Business Intelligence,” “Semantics,” “Analytics,” and “Cloud”
mean a variety of things to different audiences. Andrew Lampitt from
Jaspersoft and zAgile will give a sweeping view of  these topics and show
how they mesh together to solve real-world problems today. Jaspersoft
enables easy deployment of business intelligence to the Infrastructure as a
Service (IaaS) cloud as well as a semantic layer to shield business users
from technical jargon of the underlying physical database. zAgile delivers
an ontology-driven context server that enables semantic integration of
enterprise information across tools and applications, and it can also act as
the comprehensive semantic description of the complete information
architecture. A combination of Jaspersoft and zAgile technologies delivers
the most leading edge semantically driven business intelligence solution as
well as deep, contextual collaboration for business intelligence consumers.
Case studies will explore how customers are applying the latest techniques
to solve painful problems in an elegant and affordable way, that simply were
not possible just a couple years ago.

Wondering what's behind the Cloud? Aliens and Intelligence.

*Agenda:*

6:30pm - 7:30pm  Registration / Networking / Refreshments / Pizza

7:00pm - 7:10pm  Introduction by AJ Chen (Moderator)

7:10pm - 7:50pm  Wesley Chun: Google App Engine

7:50pm - 8:30pm  Andrew Lampitt: Enterprise Business Intelligence in the
Cloud

8:30pm - 9:00pm  Joint Q&A.

best,
-aj--

-- 
AJ Chen, PhD
Chair, Semantic Web SIG, sdforum.org
http://web2express.org
@web2express on twitter
Palo Alto, CA, USA
650-283-4091
*Building social media monitoring pipeline and connect it to CRM*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Re: [google-appengine] Re: how to improve performance

[AJ Chen]

great tips. thanks so much.
I'm using GAE1.3.1 and will try the cursor for reading data.
yes, I get lots of "com.google.apphosting.runtime.HardDeadlineExceededError"
because the 30sec limit. Will try to re-engineer to make each task smaller.

-aj

On Mon, Feb 22, 2010 at 10:31 AM, Marc Provost  wrote:

> Hi AJ,
>
> Here's a few tips from my experience:
>
> * If your application currently does not have much traffic, most of
> your requests will be "loading requests". This could explain the
> randomness your are seeing. The app engine needs to load and prepare
> your application to handle a request. In my application (java), a
> loading request takes around 2-6 seconds. Once your application is
> loaded, it will stay in memory for some time and subsequent requests
> will be "normal requests". See
> http://googleappengine.blogspot.com/2009/12/request-performance-in-java.html
> for more info. Also, make sure you are using the most recent version
> of the app engine so that pre-compilation is enabled by default. I
> have not tried the python implementation of the app engine yet, but I
> heard that it process loading requests faster.
>
> * Once my application is loaded, fetching the 20 first results of a
> simple query takes at most 1-2 seconds, most of the time less than a
> second. I use memcache to cache the derived product (usually an html
> page) of common requests. Once a request is cached, it will take
> 100-200ms to serve.
>
> * When you list the topics, make sure you are using cursors:
>
> http://code.google.com/appengine/docs/java/datastore/queriesandindexes.html#Query_Cursors
>
> * When you fetch feeds, you will need to split the work in very small
> chunks because of the 30 seconds limit. When you say "fails randomly",
> are you getting
> "com.google.apphosting.runtime.HardDeadlineExceededError"? From my
> experience, appengine behave much better when each of your tasks write
> to very few entities. In my application, I'm being very strict: each
> task writes to at most one entity. For example, I also need to parse
> an external feed and then update 1000 entities with the data from that
> feed. In order to achieve that efficiently, I spawn a thousand tasks,
> each one updating only one entity.
>
> Hope it helps,
> Marc
>
>
> On Feb 21, 7:02 pm, AJ Chen  wrote:
> > I like the potential of appengine as cloud computing platform. Using
> > eclipse, I can code in eclipse and then one-click to deploy the changes
> to
> > production. It's awesome!  It's also an exciting experience to learn the
> new
> > programing patterns GAE requires, such as task queue, object data store,
> > mencache. All these new stuff are fine as long as it delivers the
> > performance at the end. After running my apphttp://realmon9.appspot.comon
> > production for a while, I found the response time very often is too long,
> > 5-20sec, in the unusable range. Of course, the performce depends on how
> > complicated it is to generate the response per request. I'm going to give
> a
> > very brief description of a typical request, and appreciate your
> suggestion
> > for improving the performance..
> >
> > My app "realmon9" <http://realmon9.appspot.com> is a social media
> monitoring
> > application designed as a component in the google cloud so that it can be
> > connected to enterprise CRM like salesforce. It basically allows
> > organization to monitor a large number of topics on social media and
> brings
> > the relevant conversations/leads to CRM for marketing/PR/support/research
> > purpose. The topics, twiter conversations and blogs are stored in
> datastore
> > and the operation is quite simple and straightforward. For example,
> listing
> > a list of topics or listing conversations (20 per page) for a topic. I
> > expect this type of viewing request takes <1 sec to respond. It requires
> > querying 2-4 kinds of data per request and there are only small number of
> > data in this initial stage. But, very often it takes 10 second to respond
> to
> > a simple request.  I'm using java and JDO to query datastore. I have not
> > done anything to customize the index configuration yet. Where should I
> look
> > for performance optimization?
> >
> > I also use task queue to fetch feeds in the background. Because the
> reponse
> > is slow, a large percentage of simple feed fatch tasks fail randomly.
> >
> > One observation: viewing the same page (e.g. listing topics) sometimes
> takes
> > no time, but sometimes takes 10 second. it's all random, which is
> probably

[google-appengine] how to improve performance

[AJ Chen]

I like the potential of appengine as cloud computing platform. Using
eclipse, I can code in eclipse and then one-click to deploy the changes to
production. It's awesome!  It's also an exciting experience to learn the new
programing patterns GAE requires, such as task queue, object data store,
mencache. All these new stuff are fine as long as it delivers the
performance at the end. After running my app http://realmon9.appspot.com on
production for a while, I found the response time very often is too long,
5-20sec, in the unusable range. Of course, the performce depends on how
complicated it is to generate the response per request. I'm going to give a
very brief description of a typical request, and appreciate your suggestion
for improving the performance..

My app "realmon9" <http://realmon9.appspot.com> is a social media monitoring
application designed as a component in the google cloud so that it can be
connected to enterprise CRM like salesforce. It basically allows
organization to monitor a large number of topics on social media and brings
the relevant conversations/leads to CRM for marketing/PR/support/research
purpose. The topics, twiter conversations and blogs are stored in datastore
and the operation is quite simple and straightforward. For example, listing
a list of topics or listing conversations (20 per page) for a topic. I
expect this type of viewing request takes <1 sec to respond. It requires
querying 2-4 kinds of data per request and there are only small number of
data in this initial stage. But, very often it takes 10 second to respond to
a simple request.  I'm using java and JDO to query datastore. I have not
done anything to customize the index configuration yet. Where should I look
for performance optimization?

I also use task queue to fetch feeds in the background. Because the reponse
is slow, a large percentage of simple feed fatch tasks fail randomly.

One observation: viewing the same page (e.g. listing topics) sometimes takes
no time, but sometimes takes 10 second. it's all random, which is probably
due to the distributed nature of GAE. It may be hard to figure out what to
improve on the app side when GAE varies wildly in terms response time.
Anybody know the expected response time or behavior from GAE?

This google app is porting from my server application on
http://web2express.org. I can make the responce on regular tomcat server
fast, but GAE is the uncharted torritory. I"m still learning and looking for
best practice ideas.

thanks,
-aj
-- 
AJ Chen, PhD
Chair, Semantic Web SIG, sdforum.org
http://web2express.org
@web2express on twitter
Palo Alto, CA, USA
650-283-4091
*Monitoring social media in real time*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] cloud computing event: Intelligence from the Cloud

[AJ Chen]

SDForum's next event will talk about google cloud computing and
intelligence. AppEngine team member Wesley Chun will present app engine. Andrew
Lampitt from Jaspersoft will talk about BI and cloud. I thought some of you
might be interested in the topic.  Time: 6:30-9pm, March 3rd, 2010.
Location: palo alto.  See event description below and details on sdforum.org
website.
<http://sdforum.org/index.cfm?fuseaction=Page.viewPage&pageId=656&parentID=483&nodeID=1>

*Intelligence from the Cloud*

The computing cloud is forming on top of the web. It's going to change the
way we  develop and use applications. This event, "Intelligence from the
Cloud" will look at the connection between the cloud and web intelligence.
The focus will be the new infrastructures available today that are enabling
easy creation and consumption of web intelligence and semantics in the
cloud.

Wesley Chun from Google AppEngine Team will introduce Google App Engine
platform, an application development and hosting platform that lets you
build & deploy web applications on Google's high-traffic infrastructure. App
Engine executes apps (written in Python or Java) on servers that use the
same technology that powers Google's websites for speed and reliability.
There is no need to think about virtual machine images or disk
requirements... you just provide the code. This is a high-level talk
introducing attendees to Google App Engine, including its components and
architecture as well as some of its most popular developer APIs, such as
memcache, users (Google accounts), email, URLFetch, XMPP, Blobstore, etc.
Time-permitting we'll go through a simple example using Python.

The terms “Business Intelligence,” “Semantics,” “Analytics,” and “Cloud”
mean a variety of things to different audiences. Andrew Lampitt from
Jaspersoft and zAgile will give a sweeping view of  these topics and show
how they mesh together to solve real-world problems today. Jaspersoft
enables easy deployment of business intelligence to the Infrastructure as a
Service (IaaS) cloud as well as a semantic layer to shield business users
from technical jargon of the underlying physical database. zAgile delivers
an ontology-driven context server that enables semantic integration of
enterprise information across tools and applications, and it can also act as
the comprehensive semantic description of the complete information
architecture. A combination of Jaspersoft and zAgile technologies delivers
the most leading edge semantically driven business intelligence solution as
well as deep, contextual collaboration for business intelligence consumers.
Case studies will explore how customers are applying the latest techniques
to solve painful problems in an elegant and affordable way, that simply were
not possible just a couple years ago.

Wondering what's behind the Cloud? Aliens and Intelligence.


Hope to see some of you on the event.
Best,
AJ
-- 
AJ Chen, PhD
Chair, Semantic Web SIG, sdforum.org
http://web2express.org
@web2express on twitter
Palo Alto, CA, USA
650-283-4091
*Monitoring social media in real time*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

[google-appengine] new event to introduce google appengine to sdforum audience

[AJ Chen]

Hi appengine team, I have started developing web app on appengine
recently. It does not take too long to realize the appengine platform
will potential revolutionize cloud computing. I'm thinking to devote
the next sdforum Semantic Web SIG event to introduce appengine to the
sdforum audience in silicon valley. The topic will be around google
appengine and intelligence in the cloud. My initial thoughts are: one
speaker from google appengine team to introduce appengine plstform,
and another speaker from a company developing intelligence application
on appengine.

Please let me know the appropriate channel for me to invite an
appenigne team member to speak on this upcoming sdforum event (March
3rd, 6:30-9pm in palo alto). SDForum.org is the largest non-profit
software org in the bay area and our Semantic Web SIG organizes events
every two months to discuss new technologies that matters to the web
and enterprise. For past events, please see sdforum.org web site at
http://sdforum.org/index.cfm?fuseaction=Page.viewPage&pageId=656&parentID=483&nodeID=1

thanks,
-aj--
AJ Chen, PhD
Chair, Semantic Web SIG, sdforum.org
http://web2express.org
@web2express on twitter
Palo Alto, CA, USA
650-283-4091
*Monitoring social media in real time*

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.