Re: [appengine-java] Re: [google-appengine] Re: CMS for GAE

2011-07-20 Thread Anton Danilchenko
Thanks for a question!

Yes, blog application allow you to create sections (categories) and create 
pages (articles) into selected section. This is similar with CMS 
functionality. But we have not support change templates in web-based editor. 
You can change design of your web site one time, and this is affected each 
page.

Currently we have moved our applications to new version 2.0. But this apps 
not tested yet. We have two blogging systems - blog and blogs applications. 
Blog app - allow only for admin create and edit articles and sections. Blogs 
app - allow each user create personal blog and work with this blog. We need 
to complete both this applications to add flexibility to use for a different 
tasks.

Best regards, Anton.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/8uz_2_eO0DIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Need help understanding Appengine billing

2011-07-20 Thread Kwame
I've been using Appengine for a while, and I haven't yet exhausted my
free quota. I'm running a business and I would need to set a budget
for my server costs. I'm not able to understand how the billing units
like CPU Time, Outgoing Bandwidth, Incoming Bandwidth & Total Stored
data apply in real world usage of a typical busy website. Can anyone
give me some sample charges for a typical website and approximately
how much of these resources can be expected to be consumed, so I can
compare with my site to get an approximate estimate.

Thanks.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Upload data to development server

2011-07-20 Thread Renan
OMG!

IT WORKS!!! I develop with Java SDK App Engine

I just download the Charles Proxy app (Mac OSX), run it and use the command 
line:
./appcfg.py upload_data --application=myapplicationid 
--filename=data/mydatastorebackup.cvs --url=http://localhost:/remote_api

I don't know why and how it works! BUT WORKS!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/ogPYDf73y9MJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Loading Datastore Authentication Problem

2011-07-20 Thread Renan Mobile
OMG!

IT WORKS!!!

I just download the Charles Proxy app (Mac OSX), run it and use the command
line:
./appcfg.py upload_data --application=myapplicationid
--filename=data/mydatastorebackup.cvs --url=http://localhost:/remote_api

I don't know why and how it works! BUT WORKS!

2011/7/7 Renan Mobile 

> Hello! I'll detail what i did.
>
> *What i need*: I always want upload production data to the development
> server.
> *Development Environment*:
> Notebook: Macbook Pro/ Snow Leopard
> Eclipse: Helios/ AppEngine Java SDK
>
> *What i searched and found*:
> *First i found this discussions*:
>
> https://groups.google.com/d/topic/google-appengine-java/f_Jf_3R5t8s/discussion(
> *Remote_api in Java works in Development Server?*)
>
> https://groups.google.com/d/topic/google-appengine-java/OOhnk1yrF-E/discussion(
> *How to use Python Bulk uploader to import data in local_db.bin ?*)
>
> https://groups.google.com/d/topic/google-appengine-java/mEwbR0fBpE4/discussion(
> *Python bulk loader tool with local dev server of GAE Java*)
> https://groups.google.com/d/topic/google-appengine/5NHTMV8OneA/discussion(
> *Upload data to development server*)* - This last link post a workaround,
> but it didn't work for me*.
>
> *After that i found a chapter of a book and an article from*
> http://appengine-cookbook.appspot.com :
>
> http://books.google.com.br/books?id=6cL_kCZ4NJ4C&pg=PA280&lpg=PA280&dq=bulk+to+local+development+authentication+failed&source=bl&ots=sJbePRNRji&sig=oa03p1NCys1YxQVbXz3iYCz_zzQ&hl=pt-BR&ei=f5y_TZGlMMHDgQfsltDXBQ&sa=X&oi=book_result&ct=result&resnum=2&ved=0CB8Q6AEwAQ#v=onepage&q=bulk%20to%20local%20development%20authentication%20failed&f=false(
> *BOOK*)
>
>
>
> http://appengine-cookbook.appspot.com/recipe/the-complete-guide-to-managing-datastore-on-google-app-engine-for-java-using-bulk-loader/?id=ahJhcHBlbmdpbmUtY29va2Jvb2tylwELEgtSZWNpcGVJbmRleCI8YWhKaGNIQmxibWRwYm1VdFkyOXZhMkp2YjJ0eUZ3c1NDRU5oZEdWbmIzSjVJZ2xFWVhSaGMzUnZjbVVNDAsSBlJlY2lwZSI-YWhKaGNIQmxibWRwYm1VdFkyOXZhMkp2YjJ0eUZ3c1NDRU5oZEdWbmIzSjVJZ2xFWVhSaGMzUnZjbVVNNzMM#add-comments-container(
> *Article*)
>
> *What i beg for*:
> Please... i really need this help. it'll make my work a lot of easier.
>
> *Thanks for create this discussion, Joseph Mansigian*
>
>
> 2011/7/7 Renan Mobile 
>
>> I get stopped on authentication too!  When i tried too update my dowloaded
>> appengine data to the development server...
>>
>> I'll post everything that i tried to avoid this error later.
>>
>> Please, someone help us.
>>
>> Thanks
>> Em 07/07/2011 08:27, "Joseph Mansigian"  escreveu:
>>
>> > Hello,
>> >
>> > I am trying to move data from my local datastore to the appengine live
>> > datastore by downloading from
>> > my local datastore to a file I intend as input in an appcfg.py
>> upload_data
>> > action. I am getting stopped
>> > on authentication. I have carefully retried to rule out entering wrong
>> > email/password. My questions are :
>> >
>> > 1) Am I on the right track with the method I am using ?
>> >
>> > 2) What do I have to do to be seen as authenticated on the development
>> > server for appcfg.py use ?
>> >
>> > 3) Is it necessary for me to generate or write a configuration file if I
>>
>> > only want
>> > to upload my local datastore with no transformations on the data already
>>
>> > in there ?
>> >
>> > Thanks, Joe
>> >
>> >
>> > COMMAND :
>> >
>> > appcfg.py download_data --application=pathways-energy-demo
>> > --url=http://localhost:8080 --filename=dump
>> >
>> > LOG FILE :
>> >
>> > [INFO ] Logging to bulkloader-log-20110707.065327
>> > [INFO ] Throttling transfers:
>> > [INFO ] Bandwidth: 25 bytes/second
>> > [INFO ] HTTP connections: 8/second
>> > [INFO ] Entities inserted/fetched/modified: 20/second
>> > [INFO ] Batch Size: 10
>> > [INFO ] Opening database: bulkloader-progress-20110707.065327.sql3
>> > [INFO ] Opening database: bulkloader-results-20110707.065327.sql3
>> > Please enter login credentials for localhost
>> > Email: jcmansig...@gmail.com
>> > Password for jcmansig...@gmail.com:
>> > [INFO ] Connecting to localhost:8080
>> > [ERROR ] Exception during authentication
>> > Traceback (most recent call last):
>> > File
>> > "/home/joe/google_appengine_1.5.1/google/appengine/tools/bulkloader.py",
>>
>> > line 3431, in Run
>> > self.request_manager.Authenticate()
>> > File
>> > "/home/joe/google_appengine_1.5.1/google/appengine/tools/bulkloader.py",
>>
>> > line 1319, in Authenticate
>> > remote_api_stub.MaybeInvokeAuthentication()
>> > File
>> >
>> "/home/joe/google_appengine_1.5.1/google/appengine/ext/remote_api/remote_api_stub.py",
>>
>> > line 656, in MaybeInvokeAuthentication
>> > datastore_stub._server.Send(datastore_stub._path, payload=None)
>> > File
>> >
>> "/home/joe/google_appengine_1.5.1/google/appengine/tools/appengine_rpc.py",
>> > line 365, in Send
>> > f = self.opener.open(req)
>> > File "/usr/lib/python2.6/urllib2.py", line 397, in open
>> > response = meth(req, response)
>> > File "/usr/lib/python2.6/urllib

Re: [google-appengine] removing developer key in the dashboard

2011-07-20 Thread Robert Kluin
Hi Robert,
  Is this an App Engine question?



Robert




On Wed, Jul 20, 2011 at 05:55, Robert Ojok  wrote:
> I have mistakenly created a developer key in the dash board for a
> youtube site in the wrong google account and would like to remove the
> dev key BUT there is no way of removing the created key. There is a
> button for editing BUT not remove or delete.
>
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Bad Performance for Dedupe of 2 million records using mapreduce on Appengine

2011-07-20 Thread charming30

I have about 2 million records which have about 4 string fields each
which needs to be checked for duplicates. To be more specific I have
name, phone, address and fathername as fields and I must check for
dedupe using all these fields with rest of data. The resulting unique
records need to be noted into db.

I have been able to implement mapreduce, iterarate of all records.
Task rate is set to 100/s and bucket-size to 100. Billing enabled.

Currently, everything is working, but performance is very very slow. I
have been able to complete only 1000 records dedupe processing among a
test dataset of 10,000 records in 6 hours.

The current design in java is:

In every map iteration, I compare the current record with the previous
record
- Previous record is a single record in db which acts like a global
variable which I overwrite with another previous record in each map
iteration
- Comparison is done using an algorithm and result is written as a new
entity to db
- At the end of one Mapreduce job, i programatically create another
job
- The previous record variable helps the job to compare with next
candidate record with rest of the data
- I am ready to increase any amount of GAE resources to achieve this
in shortest time.

My Questions are:

- Will the accuracy of dedupe (checking for duplicates) affect due to
parallel jobs/tasks?
- How can this design be improved?
- Will this scale to 20 million records
- Whats the fastest way to read/write variables (not just counters)
during map iteration which can be used across one mapreduce job.
- Freelancers most welcome to assist in this.

Thanks for your help.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] How to select version of Django when using 'import template'

2011-07-20 Thread lezizi


How to select version of Django when using 'import template'

from google.appengine.ext.webapp import template

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/jEdHGKGypssJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] GAE Remote API or GWT’s RequestFactory?

2011-07-20 Thread Rafael Dipold
Hi,

I want to build an software financial control that's uses infraestrutura of 
GAE to data and logic tier.
In the presentation tier I would like to use the JavaFX technology.
My doubt is with relation the comunication between the presentation and 
logic tier.
I read and tested two technology in a single CRUD app and both work's fine:


   - Remote API
   - GWT’s RequestFactory


The Remote API is more simple but I'm not sure if I understand the best use 
for this toolset. I read in Nick Johnson blog's that is intended purely for 
administrative access, but it work's fine in a single CRUD test that I 
created.
What technology you advises to build data-oriented (CRUD) software like I 
described??

Second question is with the fact that's in my country there are a federal 
law that forces the offline access of any software that's issue receipt for 
sale to consumers. 

There are anyway to do with that there are replication/synchronization 
between a local db like mysql and the datastore in GAE infrastruture?
I read about AppRocket  but I'm not 
sure if this delivers what it promises. Anybody has a suggestion about this?

I'm open to new ideas and appreciate any sugestion.

Kind regards,

Rafael Dipold 

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/fejX74jIF20J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: How to restrict access to non-default versions?

2011-07-20 Thread Craig
I was thinking of something to click in the admin web console, but making 
the configuration change will certainly do it - I didn't think of doing it 
that way.  Thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/VsxuIjOkdrwJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: How to restrict access to non-default versions?

2011-07-20 Thread Jose Montes de Oca
Hi,

just need to add a restriction to the app configuration file to only access 
by the admin.

If you are working with python you would need to modify app.yaml and add 
login: admin to the urls in the handlers section. more info:
http://code.google.com/appengine/docs/python/config/appconfig.html#Requiring_Login_or_Administrator_Status

For java: you would need to add security constrains to your web.xml. more 
info:
http://code.google.com/appengine/docs/java/config/webxml.html#Security_and_Authentication

Hope this helps!

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/ayfJNq1YjlkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Adapting an existing webapp to GAE: accessing datastore

2011-07-20 Thread Jeff Schnitzer
In Eclipse, go to Project Properties -> Google -> App Engine and check the
"Use Google App Engine" box.  That should be enough to get the User Library
added and the libraries set up in WEB-INF/lib, although you might need to
close/reopen the project (and use the auto-correct feature to "synchronize
WEB-INF/lib").

If you want an example Objectify project, look here:

https://github.com/stickfigure/motomapia

Just make sure you have all files in the right place, and you should be
fine.

Jeff

On Wed, Jul 20, 2011 at 3:16 AM, Florent Georges  wrote:

>  Hi,
>
>  I have an existing Java EE web application.  As it uses only
> the Java EE subset accepted on GAE, I successfully deployed it by
> exploding the WAR to a tmp dir, adding the appengine-web.xml
> descriptor to WEB-INF/, and calling the SDK update command from
> the command line.
>
>  So far so good.
>
>  But now I'd like to use the datastore (through JDO, JPA or even
> better, through Objectify).  Because it is an existing webapp, I
> can't start from scratch using the SDK's example project.
>
>  I struggle to configure the application correctly.  That is,
> which libraries to add to the project and where?  What has to be
> added to the development classpath (for compilation) and what has
> to be added to the WAR itself?
>
>  Any clue and/or article?
>
>  Thank you, regards,
>
> --
> Florent Georges
> http://fgeorges.org/
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Problem using Google Apps Viewer to view a blob

2011-07-20 Thread Joshua Smith
Excellent question. No, I hadn't.

I just added this:

self.response.headers['Content-Type'] = 
str(mimetypes.guess_type(document.title)[0]) or 'application/octet-stream'

and the headers now say:

HTTP/1.1 200 OK
Cache-Control: no-cache
Expires: Fri, 01 Jan 1990 00:00:00 GMT
Content-Type: 
application/vnd.openxmlformats-officedocument.wordprocessingml.document
Date: Wed, 20 Jul 2011 16:06:14 GMT
Server: Google Frontend
Content-Length: 10762

But there is no change.  .doc files still work, and .docx files do not.

Any other ideas?

-Joshua

On Jul 19, 2011, at 11:59 PM, Nick Johnson (Google) wrote:

> Have you checked what Mime-Type you're serving the documents as, and if it's 
> valid for docx documents?
> 
> -Nick Johnson
> 
> On Wed, Jul 20, 2011 at 9:55 AM, Joshua Smith  
> wrote:
> If you look at this URL:
> 
> http://www.mytowngovernment.org/meeting/1234040
> 
> and click the link for one of the .doc files, they work in google's viewer.  
> But if you click on one of the .docx files, they don't.
> 
> When you click on the link to view, it does this:
> 
>   dlurl=re.sub('viewer','download',self.request.uri)
>   self.redirect("http://docs.google.com/viewer?url=%s"; % urllib.quote(dlurl))
> 
> and the download handler is simply:
> 
>   documentKey = self.request.get("document")
>   document = DocumentModel.get(documentKey)
>   self.send_blob(document.blob.key())
> 
> Everything I've read says that google's docs viewer should be able to view 
> .docx files, so I'm guessing the problem is in the way the blob is served 
> from GAE to Google Apps.
> 
> Any ideas?
> 
> -Joshua
> 
> --
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.
> 
> 
> 
> 
> -- 
> Nick Johnson, Developer Programs Engineer, App Engine
> 
> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to 
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at 
> http://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] removing developer key in the dashboard

2011-07-20 Thread Robert Ojok
I have mistakenly created a developer key in the dash board for a
youtube site in the wrong google account and would like to remove the
dev key BUT there is no way of removing the created key. There is a
button for editing BUT not remove or delete.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: File downloading to GAE Servers

2011-07-20 Thread Webhoundx
Philip & Simon, Thanks a lot for the replies. For starters I will look at 
the URL Fetch interface first...

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/RCvp6qvVI8IJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] How to restrict access to non-default versions?

2011-07-20 Thread Craig
Is there a simple way to restrict access to non-default versions?  I'd like 
for administrators to have access to them, but nobody else.  I'm sure it's 
not too bad to code up something to handle this, but it seems like something 
the platform would provide (although I couldn't find any such feature).

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/iMGzbFZxsLsJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Mailing alerts with appengine

2011-07-20 Thread Ernesto Oltra
Other option: Amazon SES:
  http://aws.amazon.com/ses/

Just out of curiosity, been from Google you can't use GMail infrastructure?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/e7_kZur_IBEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: File downloading to GAE Servers

2011-07-20 Thread Simon Knott
Hi,

You can use the URL Fetch interface 
(http://code.google.com/appengine/docs/python/urlfetch/overview.html) to 
retrieve the file, and then store it in the datastore or Blobstore as Philip 
has suggested.  If the file is less than 1MB, then you can use the datastore 
and not worry about the Blobstore.

Please note that if you use the Blobstore, you have to have billing enabled 
although you won't pay anything unless you go over the 1GB storage limit.

Cheers,
Simon

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/sgnf57GQOXkJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: File downloading to GAE Servers

2011-07-20 Thread Philip
Your GAE app is hosted on a read-only filesystem. You have to store
that data in blobstore or datastore.

Best Regards
Philip

On Jul 20, 9:04 am, Webhoundx  wrote:
> Hi,
>
> Is it possible to download a file hosted on another server to GAE
> server?
> For example if you 
> visit,http://www.cse.lk/listedcompanies/overview.htm?d-16544-e=1&6578706f72...
>
> You will be prompted to save a csv file on the local machine. I would
> like to make a copy of this file everyday at a certain time on the GAE
> server.
> I'm a total newbie and really appreciate some directions.
>
> Thanks in advance
> webhoundx

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Mailing alerts with appengine

2011-07-20 Thread MiuMeet Support
One thing you should consider is if you want to use appengine as an email
infrastructure.
We run a social network on appengine with 1M+ users and we love it to run
everything on it,
except email. EMail deliverability on appengine is not really great. You
can't do DKIM signing,
you can't send from a dedicated IP address and so on.
We send about 250k emails out per day, but for this we host our own
mailserver with an
http interface that we call via urlfetch. Deliverability is much higher...
but of course it's
an additional point of failure. This morning greengeeks (our hosting
provider) turned off the
server without notice "due to extensive use". So make sure you choose a
dedicated server
provider that doesnt just turn off your machines when they send a lot of
emails. We are now
switching to hetzner.de. A friend of mine runs mailservers there with
millions of emails per day
and claims he never had problems, as long as the emails are legitimate.

Just my 20 cents.

-Andrin

On Tue, Jul 19, 2011 at 8:12 PM, Michal Makarewicz wrote:

> A have a scenario where I have to send customized alerts to large
> amount of users (~30k) in certain, specified beforehand, time. My main
> idea was to make a cron job, which would check every minute if there
> is an alert to send and if so mark this alert as queued and add task
> to task queue (this would be done in transactional manner). Now I have
> two available approaches:
> Approach I:
> Have two different queue commands:
> 1. Split email list into smaller chunks (I'm not sure how big, I was
> thinking about ~500) and for each of them put second command on queue.
> (this one will be queued in cron job)
> 2. Send mail for each email address in the list.
> My main concern with this approach is lack of control on how many
> emails will be send simultaneously and possibility that my email will
> be classified as spam.
>
> Approach II:
> Just one task:
> 1. Send emails for predetermined number of people (again ~500)
> starting from start_index add to queue the same task with start_index
> + ~500.
> This approach will be slower, so is less preferable.
>
> I have pretty much unlimited quota so that wouldn't be a problem.
> Which approach is better in this situation?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Adapting an existing webapp to GAE: accessing datastore

2011-07-20 Thread Florent Georges
  Hi,

  I have an existing Java EE web application.  As it uses only
the Java EE subset accepted on GAE, I successfully deployed it by
exploding the WAR to a tmp dir, adding the appengine-web.xml
descriptor to WEB-INF/, and calling the SDK update command from
the command line.

  So far so good.

  But now I'd like to use the datastore (through JDO, JPA or even
better, through Objectify).  Because it is an existing webapp, I
can't start from scratch using the SDK's example project.

  I struggle to configure the application correctly.  That is,
which libraries to add to the project and where?  What has to be
added to the development classpath (for compilation) and what has
to be added to the WAR itself?

  Any clue and/or article?

  Thank you, regards,

--
Florent Georges
http://fgeorges.org/

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: [appengine-java] can xmpp api send and receive messages using gmail ids?

2011-07-20 Thread Prashant
no, it cannot

--
Prashant
code.google.com/p/claymus/

On Wed, Jul 20, 2011 at 3:11 PM, Алексей Паламарчук wrote:

> why do i have such issue:
>
>
> java.lang.IllegalArgumentException: Invalid jabber ID:  slon...@gmail.com>
>   at 
> com.google.appengine.api.xmpp.XMPPServiceImpl.sendInvitation(XMPPServiceImpl.java:161)
>
>
> slon...@gmail.com - is a valid GMail id.
>
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To view this discussion on the web visit
> https://groups.google.com/d/msg/google-appengine/-/o9CDRWQuCgIJ.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: [appengine-java] can xmpp api send and receive messages using gmail ids?

2011-07-20 Thread Алексей Паламарчук
why do i have such issue:

java.lang.IllegalArgumentException: Invalid jabber ID: 
at 
com.google.appengine.api.xmpp.XMPPServiceImpl.sendInvitation(XMPPServiceImpl.java:161)


slon...@gmail.com - is a valid GMail id.


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/o9CDRWQuCgIJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] File downloading to GAE Servers

2011-07-20 Thread Webhoundx
Hi,

Is it possible to download a file hosted on another server to GAE
server?
For example if you visit,
http://www.cse.lk/listedcompanies/overview.htm?d-16544-e=1&6578706f7274=1

You will be prompted to save a csv file on the local machine. I would
like to make a copy of this file everyday at a certain time on the GAE
server.
I'm a total newbie and really appreciate some directions.

Thanks in advance
webhoundx

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Mailing alerts with appengine

2011-07-20 Thread Michal Makarewicz
A have a scenario where I have to send customized alerts to large
amount of users (~30k) in certain, specified beforehand, time. My main
idea was to make a cron job, which would check every minute if there
is an alert to send and if so mark this alert as queued and add task
to task queue (this would be done in transactional manner). Now I have
two available approaches:
Approach I:
Have two different queue commands:
1. Split email list into smaller chunks (I'm not sure how big, I was
thinking about ~500) and for each of them put second command on queue.
(this one will be queued in cron job)
2. Send mail for each email address in the list.
My main concern with this approach is lack of control on how many
emails will be send simultaneously and possibility that my email will
be classified as spam.

Approach II:
Just one task:
1. Send emails for predetermined number of people (again ~500)
starting from start_index add to queue the same task with start_index
+ ~500.
This approach will be slower, so is less preferable.

I have pretty much unlimited quota so that wouldn't be a problem.
Which approach is better in this situation?

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: High CPU usage and how to improve performance

2011-07-20 Thread observer247
Almost the same usage is now triggering 10times the daily cost ! Not
sure what changed as far as billing.

Checking appstats and instances.

On Jul 19, 2:55 pm, Barry Hunter  wrote:
> Have you tried 
> AppStats?http://code.google.com/appengine/docs/python/tools/appstats.html
>
>
>
>
>
>
>
> On Tue, Jul 19, 2011 at 8:31 PM, observer247  wrote:
> > My python app engine app is somewhat popular, mainly used as via api
> > from my iphone app.
>
> > Recently I am seeing high over usage charges.
>
> > The most used call already use 15 CPU hours , with stats:
> >        3.7 calls/sec   26.15K requests in 12hrs        603 (0) [cpu]
>
> > HTTP/1.1" 200 1839 - "QandA/5.4 CFNetwork/485.12.7 Darwin/10.4.0"
> > "may.latest.nuvusanswers.appspot.com" ms=1490 cpu_ms=467 api_cpu_ms=0
> > cpm_usd=0.013200 pending_ms=1058 throttle_code=1
> > instance=00c61b117c8b0de1286e8d90c22f4d5b3897c8
>
> > This call just reads a memcache and returns the data. Thats it. Will
> > really like to know are memcache reads so expensive ? Am I using a lot
> > more memcache that I need ?
>
> > I have removed all other versions and have just one version running.
> > The number of instances now is
>
> > 28 total        0.510 (Average QPS)     281.1 ms (Average Latency)      
> > 59.5 MBytes
> > (Average Memory)
>
> > As this is the most expensive call, I am first going after that. but I
> > am seeing most of my calls are now using a LOT of CPU. Will be great
> > if anyone can point me to things I can debug to find out the high
> > usage across the board.
>
> > Thank you for reading this !
>
> > --
> > You received this message because you are subscribed to the Google Groups 
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to 
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group 
> > athttp://groups.google.com/group/google-appengine?hl=en.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Python app unstable

2011-07-20 Thread Vinuth Madinur
Yes. It worked after a while. But even the HR app was unstable yesterday for
a while. Things are looking ok now.

Now have to figure out how to migrate blobstore.

Thanks,
Vinuth.


On Wed, Jul 20, 2011 at 7:04 AM, Robert Kluin wrote:

> Hey Vinuth,
>  I was seeing sporadic deploy issues late last week.  Did your HR
> deploy ever go through?
>
>
>
> Robert
>
>
>
>
> On Tue, Jul 19, 2011 at 10:45, Vinuth Madinur 
> wrote:
> > Hi,
> > Since last 25 hours, my application is getting DeadlineExceeded Errors.
> Out
> > of 30 attempts, 1 succeeds. (sen6app.appspot.com) Even requests that
> dont
> > access database fail with latency more than 5ms. I thought this could
> be
> > due to unpredictable behavior of Master Slave DB and thought of doing the
> > migration to HR.
> > For migration, I tried deploying the application with a different name.
> But
> > that also fails with a typical 500 response:
> > Cloning 1563 application files.
> > Rolling back the update.
> > Error 500: --- begin server output ---
> > 
> > 
> > 500 Server Error
> > 
> > 
> > Error: Server Error
> > The server encountered an error and could not complete your
> > request.If the problem persists, please  > HREF="http://code.google.com/appengine/community.html";>report your
> > problem and mention this error message and the query that caused it.
> > 
> > 
> > --- end server output ---
> >
> > So I'm stuck since yesterday with almost all requests failing and not
> being
> > able to migrate to HR. I dont think it is a DB problem as even app
> > deployment is failing.
> > However, another application also in python has been working fine.
> > (india-governs.appspot.com)
> > Anyone else facing these problems?
> >
> > Thanks,
> > Vinuth.
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "Google App Engine" group.
> > To post to this group, send email to google-appengine@googlegroups.com.
> > To unsubscribe from this group, send email to
> > google-appengine+unsubscr...@googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/google-appengine?hl=en.
> >
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to google-appengine@googlegroups.com.
> To unsubscribe from this group, send email to
> google-appengine+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.