Re: [google-appengine] How to upload date/time csv data in google app engine with bulkloader tool ?
Hi Philippe,
try this,
import 'datetime' on the preamble
- import: datetime
import transform for uploading '2011-03-22 10:10:21.812274' style
datetime(omit milliseconds)
import_transform: lambda
x:datetime.datetime.strptime(x.split(.)[0], %Y-%m-%d %H:%M:%S)
or if you want current datetime,
import_transform: lambda x:datetime.datetime.today()
hope this might help,
Pomu
2011/3/25 Philippe REGALL philippe.reg...@gmail.com:
How to upload date/time csv data in google app engine with bulkloader
tool ?
For example, I uploaded a csv file:
date,tag,value
2011-03-22 10:10:21.812274,abacus,abaque
but in the datastore viewer I have a null type value loaded into
date column:
ID/name date tag value
id=13108 null abacus abaque
My bulkloader.yaml looks like:
python_preamble:
- import: base64
- import: re
- import: google.appengine.ext.bulkload.transform
- import: google.appengine.ext.bulkload.bulkloader_wizard
- import: google.appengine.ext.db
- import: google.appengine.api.datastore
- import: google.appengine.api.users
transformers:
- kind: StoredData
connector: csv
property_map:
- property: date
external_name: date
# Type: Date/Time Stats: 11 properties of this type in this kind.
import_transform: transform.import_date_time('%Y-%m-%dT%H:%M:%S')
export_transform: transform.export_date_time('%Y-%m-%dT%H:%M:%S')
- property: tag
external_name: tag
# Type: String Stats: 11 properties of this type in this kind.
- property: value
external_name: value
# Type: String Stats: 11 properties of this type in this kind.
= How to upload date/time value from my csv file ?
In fact, I don't mind if it is an auto generated date/time when
uploading.
Many thanks in advance.
Philippe R
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Re: Frequent deadline exceeded errors.
My app(appid: mb4sqjp) also have similar problem for these couple of days...
Sometimes it leaves message I've never seen.
For the most part, log says
- Request was aborted after waiting too long to attempt to service
your request. This may happen sporadically when the App Engine serving
cluster is under unexpectedly high or uneven load. If you see this
message frequently, please contact the App Engine team.
I also found,
- 10-20 08:44AM 03.505
A serious problem was encountered with the process that handled this
request, causing it to exit. This is likely to cause a new process to
be used for the next request to your application. If you see this
message frequently, you should contact the App Engine team. (Error
code 203)
I saw this message for the first time,
- Failed startup of context
com.google.apphosting.utils.jetty.runtimeappenginewebappcont...@831a91{/,/base/data/home/apps/mb4sqjp/xxx.345605032354519732}
com.google.apphosting.runtime.security.SystemFailureException: Unable
to get a resource
at
com.google.appengine.runtime.Request.process-75e3768d20b77cee(Request.java)
at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:336)
Other versions of my app also end with 500 very frequently.
Thanks in advance,
Pomu
2010/10/20 Carlos Ble ble.jur...@gmail.com:
More info:
10-20 04:41AM 48.795 / 500 38679ms 919cpu_ms -
(DeadeLineExceededError)
Instances:
Total number of instances Average QPS Average Latency
Average
Memory
2 total 0.017 160.2 ms 35.4 MBytes
Instances QPS Latency Memory
0.000 0.0 ms 39.6 MBytes
0.033 320.5 ms 31.2 MBytes
On 20 oct, 12:40, Carlos Ble ble.jur...@gmail.com wrote:
Hi,
We are facing several DeadlineExceededError since yesterday. Appid =
mavencharts
10-20 04:30AM 24.323 / 500 31863ms 1539cpu_ms
At that time Average QPS was about 0.04 and there was 2 instances
running.
Thanks
On 18 oct, 12:03, Stepan stepan.wag...@gmail.com wrote:
Last 3-4 days my app has like 80% DeadlineExceededErro; app ID is
pixycity. That's sort of unacceptable. Please let us know what's
happening. Thanks
-stepan
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appeng...@googlegroups.com.
To unsubscribe from this group, send email to
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/google-appengine?hl=en.
Re: [google-appengine] Problem with OAuth and Twitter
I got this problem too. Not only oauth, posting tweets also fails at a highly rate. It seems to continuously happen since 22:45 GMT. Pomu 2010/7/23 ke...@kanno.com ke...@kanno.com: Hi, I have a problem with OAuth and Twitter right now. My application is a small Twitter client and was working fine about 6 hours ago but after that I couldn't connect to Twitter anymore. I checked Twitter and their OAuth and all the APIs are working perfect. It seems like GAE's urlfetch is not working to Twitter. I heard my friends also have a problem with connecting Twitter with OAuth on GAE. Does anyone know how to solve this problem? Thanks, Keiya Kanno -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
