[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-17 Thread Paul Joseph Davis (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Joseph Davis updated COUCHDB-1246:
---

Attachment: COUCHDB-1246.patch

Cleaned up the test. Everything passes for me locally.

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, COUCHDB-1246.patch, categories, 
 os_pool_trunk.patch, os_pool_trunk.patch, os_pool_trunk.patch


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-17 Thread Paul Joseph Davis (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Joseph Davis updated COUCHDB-1246:
---

Attachment: COUCHDB-1246.patch

Finally found the delete attachments button. It was like a scavenger hunt. Only 
it sucked.

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, categories, os_pool_trunk.patch, 
 os_pool_trunk.patch, os_pool_trunk.patch


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-17 Thread Paul Joseph Davis (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Joseph Davis updated COUCHDB-1246:
---

Attachment: (was: COUCHDB-1246.patch)

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, categories, os_pool_trunk.patch, 
 os_pool_trunk.patch, os_pool_trunk.patch


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-17 Thread Paul Joseph Davis (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Joseph Davis updated COUCHDB-1246:
---

Attachment: (was: COUCHDB-1246.patch)

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, categories, os_pool_trunk.patch, 
 os_pool_trunk.patch, os_pool_trunk.patch


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-16 Thread Filipe Manana (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Filipe Manana updated COUCHDB-1246:
---

Attachment: os_pool_trunk.patch

Paul, as we were discussing on IRC, I've a reproducible case where querying a 
view just hangs and we get os pool full, blocking subsequent requests.

I attach here a wip patch, which adds an etap test (your patch is making this 
test fail).


 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, categories, os_pool_trunk.patch


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-16 Thread Filipe Manana (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Filipe Manana updated COUCHDB-1246:
---

Attachment: os_pool_trunk.patch

Thanks Paul. I'll probably be updating the patch one or two times until then.

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, categories, os_pool_trunk.patch, 
 os_pool_trunk.patch


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-16 Thread Filipe Manana (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Filipe Manana updated COUCHDB-1246:
---

Attachment: os_pool_trunk.patch

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, categories, os_pool_trunk.patch, 
 os_pool_trunk.patch, os_pool_trunk.patch


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-11 Thread Michael Newman (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Newman updated COUCHDB-1246:


Attachment: categories

Using this view, a reduce overflow error is created which spawns a CouchJS 
process that doesn't die. 

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: categories


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (COUCHDB-1246) CouchJS process spawned and not killed on each Reduce Overflow Error

2011-08-11 Thread Paul Joseph Davis (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Joseph Davis updated COUCHDB-1246:
---

Attachment: COUCHDB-1246.patch

Yeah, this is quite the racy error condition. This patch should fix things 
though. Basic idea is that instead of doing a link dance we just monitor every 
new os process and remove them when they exit.

Also, couch_os_process's were traping exits and ignoring info messages which 
left them open, hence the system build up.

This passes my local tests, but I'm not sure how to write an etap for them. 
I'll commit it if someone else can duplicate the fix though.

 CouchJS process spawned and not killed on each Reduce Overflow Error
 

 Key: COUCHDB-1246
 URL: https://issues.apache.org/jira/browse/COUCHDB-1246
 Project: CouchDB
  Issue Type: Bug
  Components: JavaScript View Server
Affects Versions: 1.1
 Environment: Linux Debian Squeeze
 [query_server_config]
 reduce_limit = true
 os_process_limit = 25
Reporter: Michael Newman
 Attachments: COUCHDB-1246.patch, categories


 Running the view attached results in a reduce_overflow_error. For each 
 reduce_overflow_error a process of /usr/lib/couchdb/bin/couchjs 
 /usr/share/couchdb/server/main.js starts running. Once this gets to 25, which 
 is the os_process_limit by default, all views result in a server error: 
 timeout {gen_server,call,[couch_query_servers,{get_proc,javascript}]}
 As far as I can tell, these processes and the non-response from the views 
 will continue until couch is restarted.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira