Subj, tested several times:
out_data.csv: 4000 unique entities
class Artist(db.Model):
artist_id = db.IntegerProperty()
name = db.StringProperty()
Last try: (in previous 2 attempts all params was the same, but results
different; with another params results also varied...)
appcfg.py upload_data --config_file=loader.py --filename=../
out_data.csv --kind=Artist --db_filename=loader.db --num_threads=20 --
batch_size=100 --rps_limit=1000 --http_limit=1000
In logs in production: - 62 requests (instead of 40) to remote_api
url.
After upload the data run "clean" script (http://pastebin.com/
m2f26cfbf) and get 5351 entites (instead of 4000) - after each clean
workflow results was different.
Bulkloader log - http://pastebin.com/m632e4507
Question: it's error in my "clean-counter" script or incorrect work
your bulkloader?
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Google App Engine" group.
To post to this group, send email to google-appengine@googlegroups.com
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en
-~----------~----~----~----~------~----~------~--~---
