i know the 1.4.0 version was released, the limit was raised to 32mb.
http://googleappengine.blogspot.com/2010/12/happy-holidays-from-app-engine-team-140.html
so i wanna upload my dem data .
the data dem.bil is under the /war/dem.bil directory.and these are my
codes to fetch the data dem.bil that is
gle)"
Reply-To:
Date: Wed, 24 Nov 2010 10:29:17 -0800
To:
Subject: Re: [appengine-java] Mapper & Blobstore bytes read limit
BTW - did you have any data that would have created a sequentially
increasing index?
For instance, a "Created At" timestamp? This sort of thing in a
ob-based mapper job, CPU cost remains a
>> little high (190 CPU hours), but I can't complain.
>> Thank you guys.
>>
>> From: "Ikai Lan (Google)"
>> Reply-To:
>> Date: Wed, 17 Nov 2010 16:06:07 -0800
>>
>> To:
>> Subject: Re: [appengi
uot;Ikai Lan (Google)"
> Reply-To:
> Date: Wed, 17 Nov 2010 16:06:07 -0800
>
> To:
> Subject: Re: [appengine-java] Mapper & Blobstore bytes read limit
>
> The bug has been fixed. Check out the latest code from the
> appengine-mapreduce project.
>
> Note that
t;Ikai Lan (Google)"
Reply-To:
Date: Wed, 17 Nov 2010 16:06:07 -0800
To:
Subject: Re: [appengine-java] Mapper & Blobstore bytes read limit
The bug has been fixed. Check out the latest code from the
appengine-mapreduce project.
Note that the ratio between blobstore bytes read and blob siz
Can't wait. Thanks.
>
> From: "Ikai Lan (Google)"
> Reply-To:
> Date: Tue, 16 Nov 2010 12:07:59 -0800
>
> To:
> Subject: Re: [appengine-java] Mapper & Blobstore bytes read limit
>
> We discovered a bug. We're not reading in the entire blob, but we
VERY good news.
Can't wait. Thanks.
From: "Ikai Lan (Google)"
Reply-To:
Date: Tue, 16 Nov 2010 12:07:59 -0800
To:
Subject: Re: [appengine-java] Mapper & Blobstore bytes read limit
We discovered a bug. We're not reading in the entire blob, but we are
reading in
500,000 lines csv file (20 Mb
> file).
> Performance looks better. To me, blob file size may have an influence on
> the mapper performance.
>
> If you need more details, let me know.
>
> From: "Ikai Lan (Google)"
> Reply-To:
> Date: Wed, 3 Nov 2010 12:22:10
t;
Reply-To:
Date: Wed, 3 Nov 2010 12:22:10 -0700
To:
Subject: Re: [appengine-java] Mapper & Blobstore bytes read limit
This behavior doesn't seem right. No, the entire blob should not be getting
read. We'll look into this.
Do you have any more details? Could tasks be gettin
This behavior doesn't seem right. No, the entire blob should not be getting
read. We'll look into this.
Do you have any more details? Could tasks be getting retried?
--
Ikai Lan
Developer Programs Engineer, Google App Engine
Blogger: http://googleappengine.blogspot.com
Reddit: http://www.reddit.c
I've been testing Ikai's bulkload mapper (see url below) with a pretty big
csv file (200 Mb).
It works great, and I encourage most of you to consider implementing this
for entity uploads.
Yet, I do face one last issue with an unexpected quota : blobstore bytes
read.
This quota cannot be tuned via
11 matches
Mail list logo
