On Fri, Nov 21, 2008 at 1:26 AM, [EMAIL PROTECTED] < [EMAIL PROTECTED]> wrote:
> > local store is a dummy datastore and It could be slow... > > how are you managing the 10MBytes of datastore limitation with your > 500k entities ? This is a commercial proposal. Still it is in analysis stage. I have tried in local datastore as a prototype of the application for demo. Please clarify me, I have three possibilities for uploading data to the AppEngine datastore. These are: 1. For all 500K entities, I have the Instance list module. [ I created it from the cvs file using my own python script, so it doesn't raise any error or exceptions, already testing is completed] If I use this, will it be slow? 2. I have the csv file exported from MySql db. For this If I use bulkload utility, it checks for empty values, and raises import Failure error.Is any ways are available? 3. Using Fixture support, I can recreate the DataModels. Is it really necessary? Rescue me from the above three cylones! Can I use the same instance list modules for creating the datastore in AppEngine during application upload? Of else, Do I need to create the instance Model classes using Fixture kind of stuff? I created this instance list from > > On Nov 20, 9:11 am, Selva <[EMAIL PROTECTED]> wrote: > > I have a requirement of loading around 500000 entities to a data > > model. Each entity contains max of 20 attributes. > > But the no.of attributes for each entity is varying(i.e, some records > > will not have all the field values). > > When I am trying to use bulkload utility to load the data. > > > > Since the absence of some attribute values, import failure error Iam > > getting. > > If I use empty field bw two commas, except string type data, converter > > method raises exception. > > > > Could any body help me to overcome this issue? Any other options to > > upload the huge amount of data values > > to the datastore in very short time. I used the straight forward > > instance creation mechanism, but after a period of 10 hr also it has > > not completed. > > > > FYI: The application is not yet been uploaded in App Engine. All the > > data store have been created in in the local > > machine. > > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---