[google-appengine] Re: Memcache problem on a production application

2012-05-21 Thread Mathieu Clavel
The application is used in as a production.
Appengine was driving to develop specific implementations using tasks 
and/or backends to bypass HardDeadlineExceed Exceptions.
We have no control on the app server : maintenance, what to do when there 
are problems, how many time berfore it starts working again, ...

More specifically, we are going to use webservices necessitating client 
certificat and also to integrate the application to SAP.

Mathieu

Le samedi 19 mai 2012 12:56:06 UTC+2, jon a écrit :

 Thanks for starring Mathieu. I you don't mind, why are you leaving? 

 Michael the ticket has been stuck on started for a long while now :-( 

 On May 19, 5:37 am, Rick Mangi r...@broadcastr.com wrote: 
  Wise man. 
  
  
  
  
  
  
  
  On Friday, May 18, 2012 10:08:27 AM UTC-4, Mathieu Clavel wrote: 
  
   Hi Jon, 
  
   I also starred your ticket, but as I'm leaving appengine, I'm not 
 going to 
   have this problem anymore. 
   Others problems on Tomcat, sure, but I will be in control of the 
   application server. 
  
   Thanks, 
  
   Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/PX3yQrxAtokJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Memcache problem on a production application

2012-05-18 Thread Mathieu Clavel
Hi Per,

yes my app is not design to work with memcache failure.
It's also not designe for other appengine failure but that's another story.
Even if I did design or if I redesign it to be memcache failure resilient, 
appengine is also using it for jsp (see the logs in my first message), so : 
no jsp... Too bad.
I'm not going to have other problem with appengine as my app is already 
rewritten to run on a Tomcat server.
I'm still using gwt, but bye-bye appengine and datastore, hello tomcat and 
mysql.

Regards,

Mathieu

Le jeudi 17 mai 2012 12:36:37 UTC+2, Per a écrit :

 Hi Mathieu,

 not sure if you're aware of this (it took me a while as well) but you need 
 to design your application so it doesn't flinch even when memcache is 
 unavailable. Try-catch everything. We had an issue at the same time as you 
 as well, and it turned out that in one part of the application we had also 
 forgotten to try-catch memcache errors. Just keep improving until it's 100% 
 robust. Because memcache just isn't. A large scale downtime would probably 
 show up on the system status page, but local issues won't.

 Cheers,
 Per



 On Wednesday, May 16, 2012 7:14:49 PM UTC+2, Mathieu Clavel wrote:

 Memcache is now working as expected.
 Problem was from 16h to 18h (UTC+2)

 Mathieu

 Le mercredi 16 mai 2012 17:49:45 UTC+2, Mathieu Clavel a écrit :

 Hello,

 My production application is currently having memcache problem.
 Nothing is visible in the global appengine system status : 
 https://code.google.com/status/appengine/

 Error is :

 Caused by: com.google.appengine.api.memcache.MemcacheServiceException: 
 Memcache put: Error setting single item (...)


 Nothing is working : Jasper also has error :

 org.apache.jasper.runtime.JspFactoryImpl internalGetPageContext: Exception 
 initializing page context
 com.google.appengine.api.memcache.MemcacheServiceException: Memcache put: 
 Error setting single item (_ahsXuelLhc5ClPxy8Dra2vPUQ)


 My application name is oav-agz.


 Regards,


 Mathieu



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/XnVavaH9M7EJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Memcache problem on a production application

2012-05-18 Thread Mathieu Clavel
Hi Jon,

I also starred your ticket, but as I'm leaving appengine, I'm not going to 
have this problem anymore.
Others problems on Tomcat, sure, but I will be in control of the 
application server.

Thanks,

Mathieu

Le jeudi 17 mai 2012 15:37:37 UTC+2, jon a écrit :

 This is actually a GAE bug. According to GAE documentation the 
 memcache service should by default log and ignore infrastructure 
 faults (which would be a very sensible thing to do) but it doesn't. 

 I opened a ticket 6 months ago (yes, half a year!) 
 http://code.google.com/p/googleappengine/issues/detail?id=6236 

 There is no excuse for leaving this broken for so long. It's an 
 extremely harmful bug and yet easy to fix. I've been raising this 
 issue every chance I get but the response from fellow GAE developers 
 on this group has been muted. We should be outraged, people :-) 
 Seriously, this bug can take down any of your sites if it happens to 
 link up with a dodgy memcache service. From experience this can last 
 up to half an hour. 

 On May 17, 8:36 pm, Per per.fragem...@gmail.com wrote: 
  Hi Mathieu, 
  
  not sure if you're aware of this (it took me a while as well) but you 
 need 
  to design your application so it doesn't flinch even when memcache is 
  unavailable. Try-catch everything. We had an issue at the same time as 
 you 
  as well, and it turned out that in one part of the application we had 
 also 
  forgotten to try-catch memcache errors. Just keep improving until it's 
 100% 
  robust. Because memcache just isn't. A large scale downtime would 
 probably 
  show up on the system status page, but local issues won't. 
  
  Cheers, 
  Per 
  
  
  
  
  
  
  
  On Wednesday, May 16, 2012 7:14:49 PM UTC+2, Mathieu Clavel wrote: 
  
   Memcache is now working as expected. 
   Problem was from 16h to 18h (UTC+2) 
  
   Mathieu 
  
   Le mercredi 16 mai 2012 17:49:45 UTC+2, Mathieu Clavel a écrit : 
  
   Hello, 
  
   My production application is currently having memcache problem. 
   Nothing is visible in the global appengine system status : 
  https://code.google.com/status/appengine/ 
  
   Error is : 
  
   Caused by: 
 com.google.appengine.api.memcache.MemcacheServiceException: Memcache put: 
 Error setting single item (...) 
  
   Nothing is working : Jasper also has error : 
  
   org.apache.jasper.runtime.JspFactoryImpl internalGetPageContext: 
 Exception initializing page context 
   com.google.appengine.api.memcache.MemcacheServiceException: Memcache 
 put: Error setting single item (_ahsXuelLhc5ClPxy8Dra2vPUQ) 
  
   My application name is oav-agz. 
  
   Regards, 
  
   Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/MnJDCxHVizYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Memcache problem on a production application

2012-05-16 Thread Mathieu Clavel
Hello,

My production application is currently having memcache problem.
Nothing is visible in the global appengine system status 
: https://code.google.com/status/appengine/

Error is :

Caused by: com.google.appengine.api.memcache.MemcacheServiceException: Memcache 
put: Error setting single item (...)


Nothing is working : Jasper also has error :

org.apache.jasper.runtime.JspFactoryImpl internalGetPageContext: Exception 
initializing page context
com.google.appengine.api.memcache.MemcacheServiceException: Memcache put: Error 
setting single item (_ahsXuelLhc5ClPxy8Dra2vPUQ)


My application name is oav-agz.


Regards,


Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/wnw0n_KYeyEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Memcache problem on a production application

2012-05-16 Thread Mathieu Clavel
Memcache is now working as expected.
Problem was from 16h to 18h (UTC+2)

Mathieu

Le mercredi 16 mai 2012 17:49:45 UTC+2, Mathieu Clavel a écrit :

 Hello,

 My production application is currently having memcache problem.
 Nothing is visible in the global appengine system status : 
 https://code.google.com/status/appengine/

 Error is :

 Caused by: com.google.appengine.api.memcache.MemcacheServiceException: 
 Memcache put: Error setting single item (...)


 Nothing is working : Jasper also has error :

 org.apache.jasper.runtime.JspFactoryImpl internalGetPageContext: Exception 
 initializing page context
 com.google.appengine.api.memcache.MemcacheServiceException: Memcache put: 
 Error setting single item (_ahsXuelLhc5ClPxy8Dra2vPUQ)


 My application name is oav-agz.


 Regards,


 Mathieu



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/EqN6glz5EmoJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Last deployed version not shown in Versions panel nor in the drop-down list

2012-03-29 Thread Mathieu Clavel


Hi,

I have deployed a new version of my app to appengine via the eclipse google 
plugin.
Deployment was successful : 

 Verifying availability:
 Will check again in 1 seconds.
 Will check again in 2 seconds.
 Will check again in 4 seconds.
 Will check again in 8 seconds.
 Will check again in 16 seconds.
 Closing update: new version is ready to start serving.


The problem is that that new version isn't shown in the list of versions so 
I can't make it the default app.
I verified deployment was successful by using the version url of the app : 
http://[version].[app-id].appspot.com/ and the version is responding.

I'm always keeping 10 versions (the max) in my list of versions, so before 
deployment I delete the oldest one ; that version is not anymore in the 
list.
I then deployed the new version, but when I refresh the versions list, it 
wasn't in it.

I tried in another browser, same problem.

Do other people have the same problem ?

Thanks,

Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Fd3gX3B5vbAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Last deployed version not shown in Versions panel nor in the drop-down list

2012-03-29 Thread Mathieu Clavel
I forget to tell something in my previous message : I'm using eclipse 
plugin for the deployment.

I fixed the problem (for now but I hope it will not come again) :
- I deleted another old version to see if it fixed the problem - no
- I deployed the version again from another eclipse project - the version 
is now showing in the list

So I don't know why it wasn't there the first time and why it's there now.

The first deployment was from an eclipse project with the eclipse maven 
plugin used on the project.
Since version 2.5.0 of the google plugin, deployments were broken from that 
project (see issue 
39https://code.google.com/p/google-plugin-for-eclipse/issues/detail?id=39
).
So I created another project, synchronized with the first via source 
versionning, where I didn't activate the maven plugin.
I'm usually deploying from that latter project, but today, I used the 
former project by mistake.

Deployment work, but with the problem I report in my previous post.
The second deployment from the latter project worked and fixed the problem.

So now, I don't know 2 things :
- why is deployment now working from my former project ?
- why wasn't the version showing in the list : was it a problem of the gae 
admin or a problem from the plugin deployment ?
- maybe it was because I made that deployment when only 8 versions where 
showing in the list (because I delete another old version before deploying).

If think that case need to be look up because either the plugin has a 
problem or the app administration has a problem.
Maybe the plugin has a problem only in my eclipse, but how to know ?

Thanks,

Mathieu

Le jeudi 29 mars 2012 15:37:02 UTC+2, Mathieu Clavel a écrit :



 Hi,

 I have deployed a new version of my app to appengine via the eclipse 
 google plugin.
 Deployment was successful : 

 Verifying availability:
 Will check again in 1 seconds.
 Will check again in 2 seconds.
 Will check again in 4 seconds.
 Will check again in 8 seconds.
 Will check again in 16 seconds.
 Closing update: new version is ready to start serving.


 The problem is that that new version isn't shown in the list of versions 
 so I can't make it the default app.
 I verified deployment was successful by using the version url of the app : 
 http://[version].[app-id].appspot.com/ and the version is responding.

 I'm always keeping 10 versions (the max) in my list of versions, so before 
 deployment I delete the oldest one ; that version is not anymore in the 
 list.
 I then deployed the new version, but when I refresh the versions list, it 
 wasn't in it.

 I tried in another browser, same problem.

 Do other people have the same problem ?

 Thanks,

 Mathieu


-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Mf22tmNYYEUJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Channel API, Bugs on IE

2012-01-18 Thread Mathieu Clavel
Yep, same problem with IE7 where messages were not received.
I'm now using polling and it's working like a charm.

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/xlIlDRLoKIMJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



{SAP-Jobs-SAP-FAQ} www.bignlife.in--[e-mail sending Job]-- [google-appengine] Importing data to datastore with bulkloader : error and long back off, but import finish ok

2011-11-22 Thread Mathieu Clavel
Hello,

I'm importing data to my app datastore (slave/master) with the bulkloader.
I'm on Windows Xp, with Python 2.7.1 and Appengine SDK 1.6.0

appcfg.py upload_data --num_threads=1 --batch_size=1000 --rps_limit=1000 
--config_file=bulkloader.yaml --filename=contrats.csv --kind=Contrat --url 
https://XXX.appspot.com/remote_api;

Uploading data records.
[INFO] Logging to bulkloader-log-2022.102427
[INFO] Throttling transfers:
[INFO] Bandwidth: 25 bytes/second
[INFO] HTTP connections: 8/second
[INFO] Entities inserted/fetched/modified: 1000/second
[INFO] Batch Size: 1000
[INFO] Opening database: bulkloader-progress-2022.102427.sql3
[INFO] Connecting to XXX.appspot.com/remote_api
[INFO] Starting import; maximum 1000 entities per post
.[INFO] [WorkerThread-0] Backing off due to errors: 1.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 2.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 4.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 8.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 16.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 32.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 64.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 128.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 256.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 512.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 1024.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 2048.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 4096.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 8192.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 16384.0 seconds

[INFO] 14115 entities total, 0 previously transferred
[INFO] 14115 entities (17642966 bytes) transferred in 17328.7 seconds
[INFO] All entities successfully transferred

When looking in the log, I have this :
[DEBUG2011-11-22 10:24:31,710 adaptive_thread_pool.py] [WorkerThread-0] 
WorkerThread: started
[DEBUG2011-11-22 10:24:32,444 bulkloader.py] [Thread-2] 
ProgressTrackerThread: started
[DEBUG2011-11-22 10:24:32,444 bulkloader.py] [Thread-3] 
DataSourceThread: started
[INFO 2011-11-22 10:24:32,444 bulkloader.py] Starting import; maximum 
1000 entities per post
[DEBUG2011-11-22 10:24:33,085 adaptive_thread_pool.py] [WorkerThread-0] 
Got work item [1-1000]
[DEBUG2011-11-22 10:24:37,944 bulkloader.py] [Thread-3] 
DataSourceThread: exiting
[DEBUG2011-11-22 10:24:37,960 bulkloader.py] Waiting for worker threads 
to finish...
[DEBUG2011-11-22 10:25:45,318 bulkloader.py] [WorkerThread-0] [1-1000] 
Transferred 1000 entities in 71.1 seconds
[INFO 2011-11-22 10:25:45,318 adaptive_thread_pool.py] [WorkerThread-0] 
Backing off due to errors: 1.0 seconds
[DEBUG2011-11-22 10:25:46,318 adaptive_thread_pool.py] [WorkerThread-0] 
Got work item [1001-2000]
[DEBUG2011-11-22 10:26:39,582 bulkloader.py] [WorkerThread-0] 
[1001-2000] Transferred 1000 entities in 53.2 seconds
[INFO 2011-11-22 10:26:39,582 adaptive_thread_pool.py] [WorkerThread-0] 
Backing off due to errors: 2.0 seconds
[DEBUG2011-11-22 10:26:41,582 adaptive_thread_pool.py] [WorkerThread-0] 
Got work item [2001-3000]
[DEBUG2011-11-22 10:27:36,644 bulkloader.py] [WorkerThread-0] 
[2001-3000] Transferred 1000 entities in 55.0 seconds
[INFO 2011-11-22 10:27:36,644 adaptive_thread_pool.py] [WorkerThread-0] 
Backing off due to errors: 4.0 seconds
[DEBUG2011-11-22 10:27:40,644 adaptive_thread_pool.py] [WorkerThread-0] 
Got work item [3001-4000]
[DEBUG2011-11-22 10:28:34,846 bulkloader.py] [WorkerThread-0] 
[3001-4000] Transferred 1000 entities in 54.2 seconds
[INFO 2011-11-22 10:28:34,846 adaptive_thread_pool.py] [WorkerThread-0] 
Backing off due to errors: 8.0 seconds
[DEBUG2011-11-22 10:28:42,846 adaptive_thread_pool.py] [WorkerThread-0] 
Got work item [4001-5000]
[DEBUG2011-11-22 10:29:36,253 bulkloader.py] [WorkerThread-0] 
[4001-5000] Transferred 1000 entities in 53.4 seconds
[INFO 2011-11-22 10:29:36,253 adaptive_thread_pool.py] [WorkerThread-0] 
Backing off due to errors: 16.0 seconds
[DEBUG2011-11-22 10:29:52,253 adaptive_thread_pool.py] [WorkerThread-0] 
Got work item [5001-6000]
[DEBUG2011-11-22 10:30:45,611 bulkloader.py] [WorkerThread-0] 
[5001-6000] Transferred 1000 entities in 53.3 seconds
[INFO 2011-11-22 10:30:45,611 adaptive_thread_pool.py] [WorkerThread-0] 
Backing off due to errors: 32.0 seconds
[DEBUG2011-11-22 10:31:17,627 adaptive_thread_pool.py] [WorkerThread-0] 
Got work item [6001-7000]
[DEBUG2011-11-22 10:32:18,844 bulkloader.py] [WorkerThread-0] 
[6001-7000] Transferred 1000 entities in 61.2 seconds
[INFO 2011-11-22 10:32:18,844 adaptive_thread_pool.py] [WorkerThread-0] 
Backing off due to errors: 64.0 seconds
[DEBUG

[google-appengine] Re: Using bulkloader to load 13k entities from 1 kind consume all Datastore Write Operations free quota and load only 2k entities on a Master/Slave datastore

2011-11-17 Thread Mathieu Clavel
Here is the error log (using only 1 thread instead of default 10) :

Uploading data records.
[INFO] Logging to bulkloader-log-2017.113920
[INFO] Throttling transfers:
[INFO] Bandwidth: 25 bytes/second
[INFO] HTTP connections: 8/second
[INFO] Entities inserted/fetched/modified: 1000/second
[INFO] Batch Size: 1000
[INFO] Opening database: bulkloader-progress-2017.113920.sql3
[INFO] Connecting to altergaz-oav.appspot.com/remote_api
[INFO] Starting import; maximum 1000 entities per post
.[INFO] [WorkerThread-0] Backing off due to errors: 1.0 seconds
.[INFO] [WorkerThread-0] Backing off due to errors: 2.0 seconds
[ERROR   ] [WorkerThread-0] WorkerThread:
Traceback (most recent call last):
  File 
C:\Dev\sdk\pyActuel\google\appengine\tools\adaptive_thread_pool.py, line 
176, in WorkOnItems
status, instruction = item.PerformWork(self.__thread_pool)
  File C:\Dev\sdk\pyActuel\google\appengine\tools\bulkloader.py, line 
764, in PerformWork
transfer_time = self._TransferItem(thread_pool)
  File C:\Dev\sdk\pyActuel\google\appengine\tools\bulkloader.py, line 
935, in _TransferItem
self.request_manager.PostEntities(self.content)
  File C:\Dev\sdk\pyActuel\google\appengine\tools\bulkloader.py, line 
1420, in PostEntities
datastore.Put(entities)
  File C:\Dev\sdk\pyActuel\google\appengine\api\datastore.py, line 602, 
in Put
return PutAsync(entities, **kwargs).get_result()
  File C:\Dev\sdk\pyActuel\google\appengine\datastore\datastore_rpc.py, 
line 783, in get_result
result = rpc.get_result()
  File C:\Dev\sdk\pyActuel\google\appengine\api\apiproxy_stub_map.py, 
line 592, in get_result
return self.__get_result_hook(self)
  File C:\Dev\sdk\pyActuel\google\appengine\datastore\datastore_rpc.py, 
line 1547, in __put_hook
self.check_rpc_success(rpc)
  File C:\Dev\sdk\pyActuel\google\appengine\datastore\datastore_rpc.py, 
line 1182, in check_rpc_success
rpc.check_success()
  File C:\Dev\sdk\pyActuel\google\appengine\api\apiproxy_stub_map.py, 
line 558, in check_success
self.__rpc.CheckSuccess()
  File C:\Dev\sdk\pyActuel\google\appengine\api\apiproxy_rpc.py, line 
156, in _WaitImpl
self.request, self.response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 248, in MakeSyncCall
handler(request, response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 391, in _Dynamic_Put
'datastore_v3', 'Put', put_request, put_response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 177, in MakeSyncCall
self._MakeRealSyncCall(service, call, request, response)
  File 
C:\Dev\sdk\pyActuel\google\appengine\ext\remote_api\remote_api_stub.py, 
line 199, in _MakeRealSyncCall
raise UnknownJavaServerError(An unknown error has occured in the 
UnknownJavaServerError: An unknown error has occured in the Java remote_api 
handler for this call.
[INFO] An error occurred. Shutting down...
[ERROR   ] Error in WorkerThread-0: An unknown error has occured in the 
Java remote_api handler for this call.

[INFO] 13320 entities total, 0 previously transferred
[INFO] 2000 entities (3920912 bytes) transferred in 162.3 seconds
[INFO] Some entities not successfully transferred

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/mfL3HlrjEccJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Using bulkloader to load 13k entities from 1 kind consume all Datastore Write Operations free quota and load only 2k entities on a Master/Slave datastore

2011-11-17 Thread Mathieu Clavel
52 indexes...
I'm vaccuming old indexes, I though it was done when uploading a new 
version.
I will try again when it will be clean.

Thanks, now I know why all quota is used.

Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/oxOvDawyPcAJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Using bulkloader to load 13k entities from 1 kind consume all Datastore Write Operations free quota and load only 2k entities on a Master/Slave datastore

2011-11-16 Thread Mathieu Clavel
Hello,

I'm trying to load data to the datastore to use my application.
I'm loading more than 13.000 entities of one kind from a cvs file via the 
bulkloader.
Since the new free quota, loading fail by consuming all quota loading only 
1.000-2.000 entities.

I'm using the python sdk 1.5.3 (I've not yet tested the 1.6.0).
The command line I use is :

 appcfg.py upload_data --batch_size=1000 --rps_limit=1000 
 --config_file=bulkloader.yaml --filename=contrats.csv --kind=Contrat --url 
 https://%APP_HOST%.appspot.com/remote_api;


My bulkloader.yaml look like this (not every properties)

 transformers:

 - kind: Contrat
   connector: csv
   connector_options:
 # TODO: Add connector options here--these are specific to each 
 connector.
 encoding: windows-1252
 import_options:
 dialect: 'excel'
 delimiter: ';'
 export_options:
 dialect: 'excel'
 delimiter: ';'
   property_map:
 - property: __key__
   external_name: key
   export_transform: transform.key_id_or_name_as_string
   import_transform: transform.create_foreign_key('Contrat', 
 key_is_id=True)

 - property: canalClientId
   external_name: canalClientId
   # Type: Integer Stats: 6010 properties of this type in this kind.
   import_transform: transform.none_if_empty(int)

 - property: codePostalPDL
   external_name: codePostalPDL
   # Type: String Stats: 7135 properties of this type in this kind.


My file contrats.csv is obtain by downloading data from another server 
using the bulkloader.
Upload is working on the local dev server (not the same command line) and 
on another paying appengine app.

How can trying to load 13k entities can consume 50k datastore entities (and 
loading only 2k) ?
(Datastore Write Operation was at 0% before the first try)


Thanks,

Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/e-6IOEteTVYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Prerelease SDK 1.5.5 available for download!

2011-10-12 Thread Mathieu Clavel
Nice, I'm going to test that now that version 1.5.5 is out.

Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/2hHj7HtC8TEJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



Re: [google-appengine] Re: Prerelease SDK 1.5.5 available for download!

2011-10-12 Thread Mathieu Clavel
Hi,

Here's how to do it in java :
// given you have an URL url :
URLConnection conn = url.openConnection();
conn.setConnectTimeout(6); // 6ms = 60s

Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/7zbmTqNxrzYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[appengine-java] Re: Prerelease SDK 1.5.5 available for download!

2011-10-10 Thread Mathieu Clavel
Hi,

For Java, We have increased the URLFetch maximum deadline from 10 seconds 
to 60 seconds.
Will the new limit be usable from previous sdk version on appengine, or must 
there be a version migration ?

Regards,

Mathieu CLAVEL

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine-java/-/yNIVZlSFcBYJ.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



[google-appengine] Re: Prerelease SDK 1.5.5 available for download!

2011-10-10 Thread Mathieu Clavel
Hi,

For Java, We have increased the URLFetch maximum deadline from 10 seconds 
to 60 seconds.
Will the new limit be usable from previous sdk version on appengine, or must 
there be a version migration ?

Regards,

Mathieu CLAVEL

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/yNIVZlSFcBYJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Re: Prerelease SDK 1.5.5 available for download!

2011-10-10 Thread Mathieu Clavel
Hi everyone,

Will the URLFetch maximum deadline raise be enabled on previous version of 
appengine (I'm using 1.5.3), or will I have to use v1.5.5 ?

Regards,

Mathieu CLAVEL

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/sEUL3XoaeM8J.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] The process handling this request unexpectedly died. (Error code 203)

2011-08-05 Thread Mathieu Clavel
Hello everyones,

I have an application developped in java on appengine.
Recently, I migrated my webservice calls from stub written from scratch to 
stub generated form the wsdl by JAX.
With this new version of my app, I have more and more error with appengine, 
but it might not be related.

An async call is made from the gwt part of the app to an actionhandler.
The instance executing the action fails without any logs except that message 
:

The process handling this request unexpectedly died. This is likely to cause a 
new process to be used for the next request to your application. (Error code 
203)

Is there a problem with the code made by JAX, or is that problem unrelated ?

Environnement :
GWT 2.1.0
GAE 1.5.2
Java 1.6.0_26 

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/H1YYEBTUs8IJ.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[google-appengine] Do JAX generated webservice stubs kill process (Error code 203) or is it a problem between GWT 2.1.0 ang GAE 1.5.2

2011-08-05 Thread Mathieu Clavel
Hello,

I migrated the stub use by my application for webservice calls to stub
made by hand to stubs generated by JAX.
Since then, I have a lot of dead process while using those webservices
(I think because logs are missing).

An action is send from GWT (2.1.0) to GAE (1.5.2).
It works most of the time, but sometime, the process doing the action
dies without giving any logs except :

The process handling this request unexpectedly died. This is likely to
cause a new process to be used for the next request to your
application. (Error code 203)

I did to things while migrating my webservices :
- updating GAE from 1.4.2 to 1.5.2 (needed for JAX stubs)
- using the new Stubs.

Do anyone know what causes that problem ?

Thanks,

Mathieu

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.



[appengine-java] Re: Could Not Verify SSL Certificate

2011-04-07 Thread Mathieu Clavel
Hello everybody,

I have a similar problem, but with the version 1.4.3
The site I'm connecting to (web services) has a bad ssl certificat (not 
right for the domain). I added it successfully to the cacerts of the jdk.
Using v1.4.2, the ssl connection is working.
When trying to use the v1.4.3, the connection fail : Could not verify SSL 
certificate
Going back to 1.4.2 : working

Using : 
Windows XP
jdk-6u24
eclipse
gae in dev mode

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-java@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.