Re: [google-appengine] Will cloud Dataflows replace the MapReduce/Pipeline API?
Currently, mapreduce does not support namespaces well and takes takes longer time to setup and code. Any idea, on the the dataflow when it will be for public? Will it support for processing namespaces data in appengine? -Aswath On Fri, Jun 27, 2014 at 12:18 AM, 'Tom Kaitchuck' via Google App Engine google-appengine@googlegroups.com wrote: No -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Problem with Passive FTP with Appengine
Hi, I am trying to use Appengine (Java) to connect to a ftp server in passive mode. As you may known, passive mode use 2 simultanous connections : 1 on port 21, and another on port chosen by the server. The problem I encounter, is that the two connections are not done from the same IP, as Appengine Socket Api use a load balencer and therefore issues connections with different source IPs. The problem with this is that the FTP server simply deny IPs that haven't initiated connection on port 21. Is there any way to keep the same source IP for successive socket connection ? Thanks. Fabien. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Strange requests in my log
It is strange that some game list or hair salon site have link to my gae website, especially that they didn't followed and downloaded any other html/js/css/image/etc file beside initial html and always in three paralel request. I don't think that these are regular 'user clicked' requests. 46.119.115.111 - - [13/Jul/2014:12:02:39 -0700] GET / HTTP/1.1 200 2901 http://www.skladvaz.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FunWebProducts) www.my_gae_app.com ms=180 cpu_ms=103 cpm_usd=0.000324 instance=00c61b117c28e72f8f6c5890b0387186cb03b033 app_engine_release=1.9.6 trace_id=adccb1df9a0702098775eb29a62ef4ac 94.153.9.85 - - [14/Jul/2014:19:31:25 -0700] GET / HTTP/1.1 200 2901 http://moscow-propusk.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1) Netscape/8.0.4 www.my_gae_app.com ms=73 cpu_ms=41 cpm_usd=0.000324 instance=00c61b117cb18440f58d1099f3b7fbcac5ed8809 app_engine_release=1.9.7 trace_id=946343abbec484b6cd0c45c67562e40c 89.223.53.7 - - [14/Jul/2014:21:33:27 -0700] GET / HTTP/1.1 200 2901 http://electrolivefest.spb.ru/news/138.htm?ref=694652; Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/34.0.1847.131 Safari/537.36 www.my_gae_app.com ms=92 cpu_ms=104 cpm_usd=0.000324 instance=00c61b117cb18440f58d1099f3b7fbcac5ed8809 app_engine_release=1.9.7 trace_id=62519fd410918d890b60acc7066f2249 46.118.159.53 - - [15/Jul/2014:08:26:15 -0700] GET / HTTP/1.1 200 2901 http://notfastfood.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) www.my_gae_app.com ms=87 cpu_ms=21 cpm_usd=0.000324 instance=00c61b117cb18440f58d1099f3b7fbcac5ed8809 app_engine_release=1.9.7 trace_id=629f4e82fba55b4930636ff51ddb7aca 193.150.120.14 - - [15/Jul/2014:08:33:34 -0700] GET / HTTP/1.1 200 2901 http://brus-vsem.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; Win64; AMD64) www.my_gae_app.com ms=161 cpu_ms=42 cpm_usd=0.000324 instance=00c61b117cb18440f58d1099f3b7fbcac5ed8809 app_engine_release=1.9.7 trace_id=63ba5bac001b231cb7edb639238bd8e3 46.119.115.111 - - [15/Jul/2014:08:57:23 -0700] GET / HTTP/1.1 200 2901 http://greatgrace.ru/; Mozilla/0.6 Beta (Windows) www.my_gae_app.com ms=128 cpu_ms=47 cpm_usd=0.000324 instance=00c61b117cb18440f58d1099f3b7fbcac5ed8809 app_engine_release=1.9.7 trace_id=4a2bcba1043bc17d0d45bcdd8b6b1324 46.119.115.111 - - [15/Jul/2014:08:57:25 -0700] GET / HTTP/1.1 200 2901 http://www.skladvaz.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; InfoPath.1 www.my_gae_app.com ms=83 cpu_ms=20 cpm_usd=0.000324 instance=00c61b117cb18440f58d1099f3b7fbcac5ed8809 app_engine_release=1.9.7 trace_id=8df3a2dbb28a5e173088497c94250227 94.153.9.85 - - [15/Jul/2014:10:53:24 -0700] GET / HTTP/1.1 200 2901 http://mastermolotok.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; APC; .NET CLR 1.0.3705; .NET CLR 1.1.4322; .NET CLR 2.0.50215; InfoPath.1) www.my_gae_app.com ms=88 cpu_ms=21 cpm_usd=0.000324 instance=00c61b117cb18440f58d1099f3b7fbcac5ed8809 app_engine_release=1.9.7 trace_id=2894a8a7e4baa55246e1c7b0a8bc22fd 94.153.9.85 - - [16/Jul/2014:15:59:17 -0700] GET / HTTP/1.1 200 2901 http://vrotike.ru/; Mozilla/4.0 (compatible; MSIE 6.0; AOL 9.0; Windows NT 5.1) www.my_gae_app.com ms=71 cpu_ms=41 cpm_usd=0.000324 instance=00c61b117c986a7c3cde68455b49bdd0717c0b80 app_engine_release=1.9.7 trace_id=e8eefefe03375cd0f292c3b8092116a1 134.249.76.109 - - [16/Jul/2014:23:58:01 -0700] GET / HTTP/1.1 200 2901 http://gcup.ru/; Opera/8.00 (Windows NT 5.1; U; en) www.my_gae_app.com ms=72 cpu_ms=479 cpm_usd=0.000324 instance=00c61b117c986a7c3cde68455b49bdd0717c0b80 app_engine_release=1.9.7 trace_id=c03cdcdb889b5fccbea8723b8aea8db5 46.118.159.53 - - [17/Jul/2014:04:17:21 -0700] GET / HTTP/1.1 200 2901 http://digest-project.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FunWebProducts) www.my_gae_app.com ms=83 cpu_ms=20 cpm_usd=0.000324 instance=00c61b117c986a7c3cde68455b49bdd0717c0b80 app_engine_release=1.9.7 trace_id=83ed5e33a479376adc5e97d9d9302aff 46.119.115.111 - - [17/Jul/2014:05:41:10 -0700] GET / HTTP/1.1 200 2901 http://replica-watch.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) www.my_gae_app.com ms=67 cpu_ms=20 cpm_usd=0.000324 instance=00c61b117c986a7c3cde68455b49bdd0717c0b80 app_engine_release=1.9.7 trace_id=74768093dc9147a4276d4ef891c8b89b 94.153.9.85 - - [17/Jul/2014:07:33:14 -0700] GET / HTTP/1.1 200 2901 http://www.ww1943.ru/; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) www.my_gae_app.com ms=107 cpu_ms=20 cpm_usd=0.000324 instance=00c61b117c986a7c3cde68455b49bdd0717c0b80 app_engine_release=1.9.7 trace_id=88ae97072de134ca97a5afdf1bd162ed 193.150.120.14 - - [17/Jul/2014:11:58:12 -0700] GET / HTTP/1.1 200 2901 http://ru-tao.kz/; Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) Opera 6.01 [en] www.my_gae_app.com ms=83 cpu_ms=41 cpm_usd=0.000324
Re: [google-appengine] Strange requests in my log
On 24 July 2014 09:53, Matija matija.jerko...@gmail.com wrote: It is strange that some game list or hair salon site have link to my gae website, especially that they didn't followed and downloaded any other html/js/css/image/etc file beside initial html and always in three paralel request. I don't think that these are regular 'user clicked' requests. Its probably attempted Referer Spam http://en.wikipedia.org/wiki/Referer_spam ... in fact by publishing extracts of your log, you've fallen for the trap they trying to set! You've published a (via Google Groups) a bunch of links to their websites, where they seeking to gain backlinks. Hopefully Groups 'rel=nofollows' them so the the exposure is limited, but it has worked! The requests would of been made via some sort of 'backlinks' generator software. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Strange requests in my log
Tnx for info. I have deleted my previuos posts and put them in ip addresses blacklist. With referer spam I can live :D On Thursday, July 24, 2014 1:04:42 PM UTC+2, barryhunter wrote: On 24 July 2014 09:53, Matija matija@gmail.com javascript: wrote: It is strange that some game list or hair salon site have link to my gae website, especially that they didn't followed and downloaded any other html/js/css/image/etc file beside initial html and always in three paralel request. I don't think that these are regular 'user clicked' requests. Its probably attempted Referer Spam http://en.wikipedia.org/wiki/Referer_spam ... in fact by publishing extracts of your log, you've fallen for the trap they trying to set! You've published a (via Google Groups) a bunch of links to their websites, where they seeking to gain backlinks. Hopefully Groups 'rel=nofollows' them so the the exposure is limited, but it has worked! The requests would of been made via some sort of 'backlinks' generator software. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] Will cloud Dataflows replace the MapReduce/Pipeline API?
Mapreduce does support namespaces: https://code.google.com/p/appengine-mapreduce/source/browse/trunk/java/src/main/java/com/google/appengine/tools/mapreduce/inputs/DatastoreInput.java#28 On Thu, Jul 24, 2014 at 12:28 AM, Aswath Satrasala aswath.satras...@gmail.com wrote: Currently, mapreduce does not support namespaces well and takes takes longer time to setup and code. Any idea, on the the dataflow when it will be for public? Will it support for processing namespaces data in appengine? -Aswath On Fri, Jun 27, 2014 at 12:18 AM, 'Tom Kaitchuck' via Google App Engine google-appengine@googlegroups.com wrote: No -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Server Error when Opening App in Console
When I open up the Google App Engine console and click on one particular app I get:- Server Error (500) A server error has occurred. Additional info:- - This only happens for one app (I have 8 in total). - The app is deployed and I can view it no dramas via the appspot URL. - It happens as soon as I click the app name in the Applications Overview page - I am unable to view the console for that app at all. - There are no errors when deploying from the GAE Launcher and I've tried re-deploying several times. - I was able to login at one point but I have been receiving this error for a few days now. - The app is Python (as are all my apps). - I tried logging in incognito and on a different PC without success. - I also tried deleting all the *.pyc files and re-compiling them but it made no difference. Has anyone else come across this issue? Any suggestions on how to resolve it? At this stage I would be happy if someone could tell me how I might remove the app, and I'll re-create it under another name. I've tried going to https://appengine.google.com/disabling?app_id=s~my-app-name but I just get the above error. Thanks. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: OverQuotaException without being over quota
I have the same issue. App id is: *vp3golemProject Number:*6228584443 All operations (DB, Queue, etc..) raise OverQuotaException Although billing is enabled, and quotas all seems OK on the admin console. Please help! -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Google App Engine SDK for Python ships vulnerable PHP
Google App Engine SDK for Python 1.9.7 ships an older, vulnerable PHP (5.4.28). ETA on shipping with an updated PHP? -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
Re: [google-appengine] How long to wait for submitting a request for additional email quota
Hi Vinny, Thank you so much for your commenting. I will wait. I am already using SendGrid. Also thanks. Now, three weeks have passed and no reply. 2014年7月22日火曜日 13時53分07秒 UTC+9 Vinny P: On Sat, Jul 19, 2014 at 2:10 AM, Ryota Yamada will...@willpowerdevelopment.com javascript: wrote: My quota of the Recipients-Emailed is 100 and I have submitted for submitting a request for additional email quota in the link Already two week has passed, I still could not have any reply, approval or deny, and message in the Dashboard is still Your request for increased email quota has been received and is currently under review. I wan to know how long to wait usually... I saw in the forum, ti's around a week... There's no specific time frame to wait. Usually it takes between 1 - 2 weeks, but it could take longer. If you have a pressing need to send email, you should consider using the SendGrid integration: https://developers.google.com/appengine/docs/python/mail/sendgrid#send_an_email . You get a 25,000 emails per month free quota and it's easy to expand past that. - -Vinny P Technology Media Consultant Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: Server Error when Opening App in Console
I was able to delete the app via http://console.developers.google.com rather than http://appengine.google.com. I've been able to re-create it under another name; all is now working fine. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To unsubscribe from this group and stop receiving emails from it, send an email to google-appengine+unsubscr...@googlegroups.com. To post to this group, send email to google-appengine@googlegroups.com. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
[google-appengine] Re: ndb, get_by_id can not get an entity with a parent key only by id?
I wrote a simple test app that used both the db and ndb api and deployed it
to app engine. Using appstats I confirmed that both RunQuery when getting
the list of articles.
On Wednesday, July 23, 2014 8:03:40 PM UTC-5, Jay wrote:
I refer you to line 3865 of __init__ in the ext.db package in the sdk.
This is on a _ReverseReferenceProperty that gets setup.
If I have time tomorrow I will write a quick test to demonstrate.
On Wednesday, July 23, 2014 11:11:31 AM UTC-5, saintthor wrote:
are you sure?
i tested in two apps. the first is using query. when i do a query, the
read ops increases about 300. the second is using referenceproperty as
above, after 5 times showing, there is no obviously increase.
the articles in the second app is much more than the first. so i don't
think it run a query.
在 2014年7月22日星期二UTC+8下午11时20分14秒，Jay写道：
When you use that api in db, it is doing a query underneath the covers.
On Monday, July 21, 2014 11:27:08 PM UTC-5, saintthor wrote:
in db, i set such a property in model article:
auth = db.ReferenceProperty( author, collection_name=AuthSet )
and use author.AuthSet to get all articles written by the certain
author. there is no query. how can i do the same thing in ndb?
在 2014年7月22日星期二UTC+8上午3时55分28秒，Jay写道：
Responding to your first post ... that is right. The parent key is
part of the entity's key. When you use get_by_id, this is just shorthand
for Key('Foo', 99).get().
You cannot get an entity by key unless you know the key, the whole
key.
You say you don't want to query, but your use case ... give me all
articles for user A ... sounds like a query.
articles = Article.query(Article.author == user_key)...
If you want to do something like most recent n articles then you can
store those keys in a 'secondary index' of sorts and use ndb.get_multi()
On Monday, July 21, 2014 8:11:20 AM UTC-5, saintthor wrote:
to query may cost too many ops. i don't query.
在 2014年7月21日星期一UTC+8下午8时53分29秒，Kaan Soral写道：
Not associated with google, also not an expert on ndb
As far as I know key groups are related with consistency, in my
opinion, you shouldn't put article's and author's in the same group,
there
is a 1/s write speed limit on entity groups, if you put them in the
same
entity group, you could hit this limit more easily
You don't even have to use referenceproperty's - I would just put
the author key in an article StringProperty named author and query
for
it, if I were you
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To unsubscribe from this group and stop receiving emails from it, send an email
to google-appengine+unsubscr...@googlegroups.com.
To post to this group, send email to google-appengine@googlegroups.com.
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.
