Hey Robert, My data models are quite similar to relational database schema, for example, i have employee, department, project models defined in my GAE web application. There are relationships among them (e.g one department has many employees, one employee can work for one department. One employee can work on many projects and one project can concern many employees).
"One solution I've used in the past is to manually generate a user's worth of realistic data by using an app. I then wrote a simple process to analize that data then randomly generate data with similar patterns -- relationships, range of values, etc...." Your solution seems to work for my case. What do you think? Any suggestions? Is it possible to share your solution code with me? Thanks a lot! Bruce On Aug 21, 5:44 pm, Robert Kluin <robert.kl...@gmail.com> wrote: > Hey Bruce, > I don't really know of or have any general examples. One solution I've > used in the past is to manually generate a user's worth of realistic data by > using an app. I then wrote a simple process to analize that data then > randomly generate data with similar patterns -- relationships, range of > values, etc.... > > I still think the best way to do this depends very much on your data > models. For instance, if your app is collecting data with simple numerical > values with known distributions, you can probably use task queues to produce > a bunch of random values from the distributions and insert matching > entities. If you've got complex relationships between entities it will be > trickier, since you'll need to know about the patterns those follow, but the > same ideas apply. > > Hope that helps a little bit. > > Robert > > On Aug 21, 2011 8:09 AM, "Bruce Aloe" <brucea...@gmail.com> wrote: > > > > > > > Hey Robert, > > > Thanks for your reply! > > > My system can basically query the data from a model stored in GAE and > > do join among the models in GAE as well. I want to increase the amount > > of data up to different levels (e.g 1k, 10k, 100k, 1m, etc) stored in > > the models and see how my system performance will be. That is the > > scalability i need to test. Therefore i need a benchmark to generate > > different volumn data for me. > > > For your suggestion, I agree that generating the data using GAE is > > more efficient than doing it locally and uploading the data. > > > Have you used GAE to generate the testing data for your system? Any > > examples? > > > Do you know any examples of generating data using task queues or > > backends? > > > Thanks a lot! > > > Bruce > > > On Aug 21, 7:47 am, Robert Kluin <robert.kl...@gmail.com> wrote: > > > Hey Bruce, > > > What aspect of scalability are you trying to test? > > > > I would suggest you generate your test data on GAE using task queues > or > > > backends. You might find generating the data using GAE is more efficient > > > than doing it locally and uploading the data. How you generate that > data > > > will depend very much on your data. > > > > Robert > > > > On Aug 19, 2011 10:59 AM, "Bruce Aloe" <brucea...@gmail.com> wrote: > > > > > Hello, > > > > > I have defined some models(tables) in GAE data store and upload little > > > > amount of data to each of them using GAE bulkloader. I have also > > > > written a system in Java to query the data stored in the models of > > > > GAE. Now i want to test the scalability of my system. Therefore i need > > > > a benchmark to generate big amount of data for the model i defined in > > > > GAE. > > > > > Is there any such benckmark from GAE? What are your suggestions? > > > > > Any help is very appreciated. > > > > > Thanks a lot! > > > > > Bruce > > > > > -- > > > > You received this message because you are subscribed to the Google > Groups > > > > "Google App Engine" group.> To post to this group, send email to > > google-appengine@googlegroups.com. > > > > > > > To unsubscribe from this group, send email to > > > > google-appengine+unsubscr...@googlegroups.com.> For more options, visit > this group at > > > >http://groups.google.com/group/google-appengine?hl=en. > > > > - Hide quoted text - > > > > - Show quoted text -- Hide quoted text - > > > > - Show quoted text - > > > -- > > You received this message because you are subscribed to the Google Groups > > "Google App Engine" group.> To post to this group, send email to > google-appengine@googlegroups.com. > > To unsubscribe from this group, send email to > > google-appengine+unsubscr...@googlegroups.com.> For more options, visit this > group at > > http://groups.google.com/group/google-appengine?hl=en. > > > > - Hide quoted text - > > - Show quoted text -- Hide quoted text - > > - Show quoted text -- Hide quoted text - > > - Show quoted text - -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
