On Fri, Nov 21, 2008 at 1:26 AM, [EMAIL PROTECTED] <
[EMAIL PROTECTED]> wrote:
>
> local store is a dummy datastore and It could be slow...
>
> how are you managing the 10MBytes of datastore limitation with your
> 500k entities ?
This is a commercial proposal. Still it is in analysis stage. I have
tried in local datastore as a prototype of the application for
demo.
Please clarify me,
I have three possibilities for uploading data to the AppEngine
datastore.
These are:
1. For all 500K entities, I have the Instance list module.
[ I created it from the cvs file using my own python
script, so it doesn't raise any error or exceptions, already testing is
completed]
If I use this, will it be slow?
2. I have the csv file exported from MySql db. For this If I
use bulkload utility, it checks for empty values, and raises import
Failure error.Is any ways are available?
3. Using Fixture support, I can recreate the DataModels. Is it
really necessary?
Rescue me from the above three cylones!
Can I use the same instance list modules for creating the datastore in
AppEngine during application upload?
Of else, Do I need to create the instance Model classes using Fixture
kind of stuff?
I created this instance list from
>
> On Nov 20, 9:11 am, Selva <[EMAIL PROTECTED]> wrote:
> > I have a requirement of loading around 500000 entities to a data
> > model. Each entity contains max of 20 attributes.
> > But the no.of attributes for each entity is varying(i.e, some records
> > will not have all the field values).
> > When I am trying to use bulkload utility to load the data.
> >
> > Since the absence of some attribute values, import failure error Iam
> > getting.
> > If I use empty field bw two commas, except string type data, converter
> > method raises exception.
> >
> > Could any body help me to overcome this issue? Any other options to
> > upload the huge amount of data values
> > to the datastore in very short time. I used the straight forward
> > instance creation mechanism, but after a period of 10 hr also it has
> > not completed.
> >
> > FYI: The application is not yet been uploaded in App Engine. All the
> > data store have been created in in the local
> > machine.
> >
>
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~----------~----~----~----~------~----~------~--~---
