[jira] Commented: (COUCHDB-197) Replication renders CouchDB unresponsive.

2009-01-28 Thread Jason Davies (JIRA) 

[ 
https://issues.apache.org/jira/browse/COUCHDB-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668212#action_12668212
 ] 

Jason Davies commented on COUCHDB-197:
--

Re: using an nginx SSL proxy: the redirection does work fine if you use 
proxy_pass http://backend; instead of proxy_pass http://backend/;

> Replication renders CouchDB unresponsive.
> -
>
> Key: COUCHDB-197
> URL: https://issues.apache.org/jira/browse/COUCHDB-197
> Project: CouchDB
>  Issue Type: Bug
>  Components: Database Core
>Affects Versions: 0.9
>Reporter: Maximillian Dornseif
>Priority: Blocker
> Fix For: 0.9
>
> Attachments: couch_redirects.2.diff, couch_redirects.3.diff, 
> couch_redirects.diff, couch_tests.js.diff, ibrowse.diff, 
> push_replication_fix.diff
>
>
> I am quite sure this is not the same issue as in COUCHDB-193.
> Im trying to replicte a somewhat big database 
> {"doc_count":541394,"doc_del_count":265692,"update_seq":2118390,"purge_seq":0,"compact_running":false,"disk_size":16552608803}
>  to an other machine. 
> I started replication with this:
> send: 'POST /_replicate HTTP/1.1\r\nHost: 
> couchdb1.local.xxx:5984\r\nAccept-Encoding: identity\r\ncontent-length: 
> 90\r\ncontent-type: application/json\r\naccept: 
> application/json\r\nuser-agent: couchdb-python 0.5dev-r127\r\n\r\n'
> send: '{"source": "hulog_events", "target": 
> "http://couchdb2.local.xxx:5984/hulog_events"}'
> reply: ''
> connect: (couchdb1.local.hudora.biz, 5984)
> send: 'POST /_replicate HTTP/1.1\r\nHost: 
> couchdb1.local.:5984\r\nAccept-Encoding: identity\r\ncontent-length: 
> 90\r\ncontent-type: application/json\r\naccept: 
> application/json\r\nuser-agent: couchdb-python 0.5dev-r127\r\n\r\n'
> send: '{"source": "hulog_events", "target": 
> "http://couchdb2.local.:5984/hulog_events"}'
> (no reply so far)
> On the source server (couchdb1) I see following logentries:
> Mon, 05 Jan 2009 19:34:21 GMT] [info] [<0.12745.45>] 192.168.0.30 - - 'POST' 
> /_replicate 200
> [Mon, 05 Jan 2009 19:35:36 GMT] [info] [<0.107.0>] Compaction for db 
> "hulog_events_test" completed.
> [Mon, 05 Jan 2009 19:35:45 GMT] [info] [<0.12746.45>] 127.0.0.1 - - 'GET' 
> /hulog_events/ 200
> [Mon, 05 Jan 2009 19:35:46 GMT] [info] [<0.95.0>] Compaction for db "eap" 
> completed.
> [Mon, 05 Jan 2009 19:42:17 GMT] [error] [<0.12765.45>] ** Generic server 
> <0.12765.45> terminating 
> ** Last message in was {'EXIT',<0.12762.45>,
> {timeout,
>  {gen_server,call,
>   [<0.12768.45>,
>{write,
> <<0,0,1,36,131,104,2,104,1,108,0,0,0,8,104,2,
>   109,0,0,0,7,112,114,111,100,117,99,116,109,
>   0,0,0,8,54,53,49,52,48,47,69,75,104,2,109,0,
>   0,0,11,116,114,97,110,115,97,99,116,105,111,
>   110,109,0,0,0,8,114,101,116,114,105,101,118,
>   101,104,2,109,0,0,0,4,116,121,112,101,109,0,
>   0,0,4,117,110,105,116,104,2,109,0,0,0,11,97,
>   114,99,104,105,118,101,100,95,97,116,109,0,
>   0,0,22,50,48,48,56,48,50,50,50,84,49,50,49,
>   52,48,53,46,53,50,54,51,56,52,104,2,109,0,0,
>   0,10,99,114,101,97,116,101,100,95,97,116,
>   109,0,0,0,22,50,48,48,55,49,49,50,56,84,49,
>   53,52,50,48,54,46,51,52,52,54,49,56,104,2,
>   109,0,0,0,4,112,114,111,112,104,1,108,0,0,0,
>   2,104,2,109,0,0,0,8,108,111,99,97,116,105,
>   111,110,109,0,0,0,6,65,85,83,76,65,71,104,2,
>   109,0,0,0,6,104,101,105,103,104,116,98,0,0,
>   7,158,106,104,2,109,0,0,0,3,109,117,105,109,
>   0,0,0,18,51,52,48,48,53,57,57,56,49,48,48,
>   48,48,51,49,50,53,50,104,2,109,0,0,0,8,113,
>   117,97,110,116,105,116,121,97,11,106,106>>}]}}}
> ** When Server state == {file_descriptor,prim_file,{#Port<0.904761>,24}}
> ** Reason for termination == 
> ** {timeout,{gen_server,call,
> [<0.12768.45>,
>  {write,<<0,0,1,36,131,104,2,104,1,108,0,0,0,8,104,
>   2,109,0,0,0,7,112,114,111,100,117,99,116,
>   109,0,0,0,8,54,53,49,52,48,47,69,75,104,
>   2,109,0,0,0,11,116,114,97,110,115,97,99,
>   116,105,111,110,109,0,0,0,8,114,101,116,
>

Re: [jira] Created: (COUCHDB-190) _uuid should respond to GET, not POST

2009-01-28 Thread Jan Lehnardt 

Hi Zach,

On 28 Jan 2009, at 16:38, Zachary Zolton wrote:


Placed a patch to fix this issue into JIRA.



Thanks! We get a notification email from JIRA when
a new issue is opened, no need to send a reminder :)

Cheers
Jan
--

Re: [jira] Created: (COUCHDB-190) _uuid should respond to GET, not POST

2009-01-28 Thread Zachary Zolton 
Placed a patch to fix this issue into JIRA.

Cheers,
Zach

[jira] Commented: (COUCHDB-197) Replication renders CouchDB unresponsive.

2009-01-28 Thread Jason Davies (JIRA) 

[ 
https://issues.apache.org/jira/browse/COUCHDB-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668011#action_12668011
 ] 

Jason Davies commented on COUCHDB-197:
--

Hi Adam, thanks for the feedback.  I've updated the code and put it on github 
to keep better track of it: http://github.com/jasondavies/couchdb/tree/master 
(feel free to fork and make further changes).  It now retries all requests and 
also retries if it gets a 500 error response.

I've tested redirects (using couchdb_httpd:absolute_uri) behind an nginx SSL 
proxy and they work fine.  The only problem is that nginx appears to 
automatically rewrite design doc URLs so they don't need to redirect (i.e. 
_design%2Ftest -> _design/test).  The /_utils URL redirects to /_utils/ 
properly as expected though.  The only requirement is that the proxy rewrites 
the request's Host: and the response's Location: headers appropriately - I'm 
not sure if all proxies do this.

1) I've changed the 5 second timeout to be 10 seconds for now.  Any ideas what 
an appropriate value should be?

2) What value of ChunkSize should we use here?  I agree that getting to the 
bottom of these errors would be a good idea, in case there is something amiss 
in MochiWeb...

> Replication renders CouchDB unresponsive.
> -
>
> Key: COUCHDB-197
> URL: https://issues.apache.org/jira/browse/COUCHDB-197
> Project: CouchDB
>  Issue Type: Bug
>  Components: Database Core
>Affects Versions: 0.9
>Reporter: Maximillian Dornseif
>Priority: Blocker
> Fix For: 0.9
>
> Attachments: couch_redirects.2.diff, couch_redirects.3.diff, 
> couch_redirects.diff, couch_tests.js.diff, ibrowse.diff, 
> push_replication_fix.diff
>
>
> I am quite sure this is not the same issue as in COUCHDB-193.
> Im trying to replicte a somewhat big database 
> {"doc_count":541394,"doc_del_count":265692,"update_seq":2118390,"purge_seq":0,"compact_running":false,"disk_size":16552608803}
>  to an other machine. 
> I started replication with this:
> send: 'POST /_replicate HTTP/1.1\r\nHost: 
> couchdb1.local.xxx:5984\r\nAccept-Encoding: identity\r\ncontent-length: 
> 90\r\ncontent-type: application/json\r\naccept: 
> application/json\r\nuser-agent: couchdb-python 0.5dev-r127\r\n\r\n'
> send: '{"source": "hulog_events", "target": 
> "http://couchdb2.local.xxx:5984/hulog_events"}'
> reply: ''
> connect: (couchdb1.local.hudora.biz, 5984)
> send: 'POST /_replicate HTTP/1.1\r\nHost: 
> couchdb1.local.:5984\r\nAccept-Encoding: identity\r\ncontent-length: 
> 90\r\ncontent-type: application/json\r\naccept: 
> application/json\r\nuser-agent: couchdb-python 0.5dev-r127\r\n\r\n'
> send: '{"source": "hulog_events", "target": 
> "http://couchdb2.local.:5984/hulog_events"}'
> (no reply so far)
> On the source server (couchdb1) I see following logentries:
> Mon, 05 Jan 2009 19:34:21 GMT] [info] [<0.12745.45>] 192.168.0.30 - - 'POST' 
> /_replicate 200
> [Mon, 05 Jan 2009 19:35:36 GMT] [info] [<0.107.0>] Compaction for db 
> "hulog_events_test" completed.
> [Mon, 05 Jan 2009 19:35:45 GMT] [info] [<0.12746.45>] 127.0.0.1 - - 'GET' 
> /hulog_events/ 200
> [Mon, 05 Jan 2009 19:35:46 GMT] [info] [<0.95.0>] Compaction for db "eap" 
> completed.
> [Mon, 05 Jan 2009 19:42:17 GMT] [error] [<0.12765.45>] ** Generic server 
> <0.12765.45> terminating 
> ** Last message in was {'EXIT',<0.12762.45>,
> {timeout,
>  {gen_server,call,
>   [<0.12768.45>,
>{write,
> <<0,0,1,36,131,104,2,104,1,108,0,0,0,8,104,2,
>   109,0,0,0,7,112,114,111,100,117,99,116,109,
>   0,0,0,8,54,53,49,52,48,47,69,75,104,2,109,0,
>   0,0,11,116,114,97,110,115,97,99,116,105,111,
>   110,109,0,0,0,8,114,101,116,114,105,101,118,
>   101,104,2,109,0,0,0,4,116,121,112,101,109,0,
>   0,0,4,117,110,105,116,104,2,109,0,0,0,11,97,
>   114,99,104,105,118,101,100,95,97,116,109,0,
>   0,0,22,50,48,48,56,48,50,50,50,84,49,50,49,
>   52,48,53,46,53,50,54,51,56,52,104,2,109,0,0,
>   0,10,99,114,101,97,116,101,100,95,97,116,
>   109,0,0,0,22,50,48,48,55,49,49,50,56,84,49,
>   53,52,50,48,54,46,51,52,52,54,49,56,104,2,
>   109,0,0,0,4,112,114,111,112,104,1,108,0,0,0,
>   2,104,2,109,0,0,0,8,108,111,99,97,116,105,
>   111,110,109,0,0,0,6,65,85,83,76,65,71,104,2,
>   109,0,0,0,6,104,101,105,1