[jira] Commented: (COUCHDB-719) Bad escaping in Futon view document list

2010-03-30 Thread Dirkjan Ochtman (JIRA)

[ 
https://issues.apache.org/jira/browse/COUCHDB-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12851312#action_12851312
 ] 

Dirkjan Ochtman commented on COUCHDB-719:
-

Also, I'm pretty sure this is a regression from 0.10.1.

 Bad escaping in Futon view document list
 

 Key: COUCHDB-719
 URL: https://issues.apache.org/jira/browse/COUCHDB-719
 Project: CouchDB
  Issue Type: Bug
  Components: Futon
Affects Versions: 0.11
Reporter: Dirkjan Ochtman
Priority: Minor
 Fix For: 0.11.1


 I have a database where document ID's include '' and ''. When I browse the 
 database, Futon shows 'lt;' for the key (double-escaping the actual value). 
 On the other hand, for the ID just below that, the entire value is missing, 
 suggesting that it's not escaped at all in that case.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Created: (COUCHDB-719) Bad escaping in Futon view document list

2010-03-30 Thread Dirkjan Ochtman (JIRA)
Bad escaping in Futon view document list


 Key: COUCHDB-719
 URL: https://issues.apache.org/jira/browse/COUCHDB-719
 Project: CouchDB
  Issue Type: Bug
  Components: Futon
Affects Versions: 0.11
Reporter: Dirkjan Ochtman
Priority: Minor
 Fix For: 0.12


I have a database where document ID's include '' and ''. When I browse the 
database, Futon shows 'lt;' for the key (double-escaping the actual value). On 
the other hand, for the ID just below that, the entire value is missing, 
suggesting that it's not escaped at all in that case.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (COUCHDB-719) Bad escaping in Futon view document list

2010-03-30 Thread Dirkjan Ochtman (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dirkjan Ochtman updated COUCHDB-719:


Fix Version/s: (was: 0.12)
   0.11.1

 Bad escaping in Futon view document list
 

 Key: COUCHDB-719
 URL: https://issues.apache.org/jira/browse/COUCHDB-719
 Project: CouchDB
  Issue Type: Bug
  Components: Futon
Affects Versions: 0.11
Reporter: Dirkjan Ochtman
Priority: Minor
 Fix For: 0.11.1


 I have a database where document ID's include '' and ''. When I browse the 
 database, Futon shows 'lt;' for the key (double-escaping the actual value). 
 On the other hand, for the ID just below that, the entire value is missing, 
 suggesting that it's not escaped at all in that case.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



Re: [jira] Commented: (COUCHDB-716) CouchDB fails to start, just hangs.

2010-03-30 Thread Benoit Chesneau
On Tue, Mar 30, 2010 at 12:45 PM, Robert Dionne
dio...@dionne-associates.com wrote:
 I'm curious if it's starting the dependent apps. It might be a bad build. Can 
 you try:

 couch_app:start(_,[]).

 That's an underscore and a period at the end


you should change your font if you need to explain ;)


[jira] Updated: (COUCHDB-700) Performance Regression for view generation in 0.11

2010-03-30 Thread Henrik Thostrup Jensen (JIRA)

 [ 
https://issues.apache.org/jira/browse/COUCHDB-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Henrik Thostrup Jensen updated COUCHDB-700:
---

Fix Version/s: 0.12
Affects Version/s: (was: 0.10)
   0.11

 Performance Regression for view generation in 0.11
 --

 Key: COUCHDB-700
 URL: https://issues.apache.org/jira/browse/COUCHDB-700
 Project: CouchDB
  Issue Type: Improvement
  Components: Database Core
Affects Versions: 0.11
 Environment: Ubuntu 9.04: Stock CouchDB 0.10 / Own build of CoucDB 
 0.11 branch.
Reporter: Henrik Thostrup Jensen
 Fix For: 0.12

 Attachments: couchdb_011_view_speedup.diff


 Copied from mail to dev at March 15, 2010:
 I have a synthetic benchmark for view generation over 70K documents. In stock 
 CouchDB 0.10, the view will be checkpointed about 15-17
 times. Around 9 times with the batch_save_size and batch_save_interval set to 
 1. CouchDB 0.11 on the other hand performs a whopping
 108/109 checkpoints of the view. Due to shadow B-trees this generates 
 significantly larger view files (2-3x much) and more time is spend
 writing to disk. Generating the view takes roughly twice as long in 0.11 as 
 it does in 0.10.
 I've tracked down the problem to the new view generation architecture; 
 particularly the small sizes of the work queues defined in 
 couch_view_updater.erl. The attached patch decreases the number of 
 checkpoints to around 15, and makes view generation slightly faster
 than 0.10. It basically increases the size of the write queue. Inserting a 
 500 ms sleep in do_writes increased the performance a bit
 more, but that is not a nice or right solution.
 I suspect the patch is not the completely right solution (tm), as a lot 
 checkpoints are performed initially whereafter it backs off and
 starts to take longer time/revisions between the checkpoints. I suspect that 
 the code is just writing repeatedly and as writes start
 to take longer time, more revisions are added per checkpoint. Though I am not 
 really sure of this.
 Still, it is a 2 line patch, and it significantly increases view generation 
 performance. I'd very much like to see this in 0.11, to
 avoid a rather large performance regression between 0.10 and 0.11. If 0.11 
 comes out as it is, we would either have to stick with 0.10 or build our own 
 patched 0.11.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



Re: [jira] Commented: (COUCHDB-716) CouchDB fails to start, just hangs.

2010-03-30 Thread Robert Dionne
thanks for thinking of me, I'm getting new glasses next week anyway so I should 
be ok.




On Mar 30, 2010, at 7:18 AM, Benoit Chesneau wrote:

 On Tue, Mar 30, 2010 at 12:45 PM, Robert Dionne
 dio...@dionne-associates.com wrote:
 I'm curious if it's starting the dependent apps. It might be a bad build. 
 Can you try:
 
 couch_app:start(_,[]).
 
 That's an underscore and a period at the end
 
 
 you should change your font if you need to explain ;)



Please fix #665 for CouchDB 1.0

2010-03-30 Thread Michael Stapelberg
Hi!

Before the release of CouchDB 1.0, it would be great if you could fix #665.
The patch is very simple, as it is just the missing 'inet6' option which
prevents replication to work via IPv6. Merging/testing the patch is also
very simple and should not take longer than 15 minutes. If you have any
questions, please just ask (and please CC me, as I am not on this list).

Best regards,
Michael


Compaction issue after upgrade 0.10.1-0.11.0

2010-03-30 Thread Dirkjan Ochtman
So this morning I went to upgrade one of my servers to 0.11. Installed
it, fixed up the config files, then restarted CouchDB. It picked up on
my databases just fine, so everything looked good. I tried some views,
and it had to re-index all of my ddocs (which I found surprising, but
okay). After that I went and compacted the database, then the views.

However, later today I got some exception mails from my web
application. It appears that something has gotten confused. For
example, take this document:

{_id: page-22, _rev: 2-1835830930, lb: null, content: blah blah
yadda, type: page, _deleted_conflicts: [4-4212453249,
2-1982019940, 2-1964049796, 2-1096626370]}

Note all the _deleted_conflicts. However, this is the document
returned by a view (which emits(doc.lb, doc))! When I actually request
this document, I get this:

{_id:page-22,_rev:4-4212453249} (it would be helpful to have a
member _deleted:true, or something, to show that it's not just empty,
but that something was there before).

Requesting the 2-1835830930 revision results in the complete document,
as shown above.

So, that got me pretty scared, because I thought I lost my document
(and my site actually started failing)! What would be the best way to
fix up my database? And do we have any diagnosis on what the cause of
this is? I'm happy I deployed this on a less-critical site first, and
wouldn't want to deploy at work unless we figure out what's going on
here.

Cheers,

Dirkjan


[jira] Commented: (COUCHDB-716) CouchDB fails to start, just hangs.

2010-03-30 Thread Victor Igumnov (JIRA)

[ 
https://issues.apache.org/jira/browse/COUCHDB-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12851458#action_12851458
 ] 

Victor Igumnov commented on COUCHDB-716:


I am fairly sure solaris is a well supported target. If this was the case then 
couchdb 0.10.1 would not work.

 CouchDB fails to start, just hangs.
 ---

 Key: COUCHDB-716
 URL: https://issues.apache.org/jira/browse/COUCHDB-716
 Project: CouchDB
  Issue Type: Bug
  Components: Database Core
Affects Versions: 0.11
 Environment: opensolaris/snv98 
Reporter: Victor Igumnov

 CouchDB 0.10.x works well while CouchDB 0.11 fails to start, it just hangs 
 with no debug information. I have used truss to trace the execution to the 
 hang point.
 Truss debug info
 http://temp.fabulously40.com/~victori/couch.txt
 Pstack info on the hanged process
 http://temp.fabulously40.com/~victori/couchdb-pstack.txt

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



Re: Compaction issue after upgrade 0.10.1-0.11.0

2010-03-30 Thread Damien Katz
I'm interested in your problem, which might be related to something Simon 
Eisenmann was seeing. Can you put the database and the server log file 
somewhere I can access it?

-Damien


On Mar 30, 2010, at 8:19 AM, Dirkjan Ochtman wrote:

 So this morning I went to upgrade one of my servers to 0.11. Installed
 it, fixed up the config files, then restarted CouchDB. It picked up on
 my databases just fine, so everything looked good. I tried some views,
 and it had to re-index all of my ddocs (which I found surprising, but
 okay). After that I went and compacted the database, then the views.
 
 However, later today I got some exception mails from my web
 application. It appears that something has gotten confused. For
 example, take this document:
 
 {_id: page-22, _rev: 2-1835830930, lb: null, content: blah blah
 yadda, type: page, _deleted_conflicts: [4-4212453249,
 2-1982019940, 2-1964049796, 2-1096626370]}
 
 Note all the _deleted_conflicts. However, this is the document
 returned by a view (which emits(doc.lb, doc))! When I actually request
 this document, I get this:
 
 {_id:page-22,_rev:4-4212453249} (it would be helpful to have a
 member _deleted:true, or something, to show that it's not just empty,
 but that something was there before).
 
 Requesting the 2-1835830930 revision results in the complete document,
 as shown above.
 
 So, that got me pretty scared, because I thought I lost my document
 (and my site actually started failing)! What would be the best way to
 fix up my database? And do we have any diagnosis on what the cause of
 this is? I'm happy I deployed this on a less-critical site first, and
 wouldn't want to deploy at work unless we figure out what's going on
 here.
 
 Cheers,
 
 Dirkjan



[jira] Commented: (COUCHDB-707) Proposal for Filter Views

2010-03-30 Thread Luke Burton (JIRA)

[ 
https://issues.apache.org/jira/browse/COUCHDB-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12851512#action_12851512
 ] 

Luke Burton commented on COUCHDB-707:
-

I'll have a crack at implementing something simple. At the very least, it's 
worth conducting the experiment!

 Proposal for Filter Views
 ---

 Key: COUCHDB-707
 URL: https://issues.apache.org/jira/browse/COUCHDB-707
 Project: CouchDB
  Issue Type: New Feature
  Components: JavaScript View Server
Affects Versions: 0.11
Reporter: Luke Burton

 A common operation I find myself performing repeatedly is:
 * request a view (maybe with some basic filter like keys or a range of keys)
 * in my client, filter this view based on some complex criteria, leaving me 
 with a small set of document IDs (complex as in array intersections, compound 
 boolean operations,  other stuff not possible in the HTTP view API)
 * go back to Couch and fetch the complete documents for these IDs.
 List Views almost get me to the point of doing this purely in Couch. I can 
 enumerate over a view and do some complex things with it. But I can't output 
 entire documents, unless I use the include_docs=true flag which murders the 
 performance of the list view.Apparently because the entire view is fetched 
 with including docs, THEN passed on to the list view JS. Typically my complex 
 filter criteria is contained in the view itself, so there is no need to fetch 
 the entire document until I know I have a match.
 In summary, a Filter View would execute some arbitrary JavaScript on each 
 view row, with access to HTTP request parameters, and return true for rows 
 that match. The output would be a list of IDs for whom the function returned 
 true. include_docs=true would include the matching documents.
 Performance would certainly not be as good as fetching a raw view, but it 
 would indisputably be better than fetching the entire view over HTTP to a 
 client, deserializing the JSON, doing some stuff, then making another HTTP 
 request, and deserializing more JSON.
 I looked at the various entry points for list views in the Couch source. 
 Unfortunately it will take me some time to come up to speed with the source 
 (if I ever have the time ...), and I hope that what I'm asking for could be a 
 simple extension to the List Views for someone very familiar with this area.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (COUCHDB-716) CouchDB fails to start, just hangs.

2010-03-30 Thread Randall Leeds (JIRA)

[ 
https://issues.apache.org/jira/browse/COUCHDB-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12851587#action_12851587
 ] 

Randall Leeds commented on COUCHDB-716:
---

It looks like there should be another trailing } in there to close the 
application record.
Is this a copy/paste mistake? If not, can you try adding } to the end of 
couch.app?

 CouchDB fails to start, just hangs.
 ---

 Key: COUCHDB-716
 URL: https://issues.apache.org/jira/browse/COUCHDB-716
 Project: CouchDB
  Issue Type: Bug
  Components: Database Core
Affects Versions: 0.11
 Environment: opensolaris/snv98 
Reporter: Victor Igumnov

 CouchDB 0.10.x works well while CouchDB 0.11 fails to start, it just hangs 
 with no debug information. I have used truss to trace the execution to the 
 hang point.
 Truss debug info
 http://temp.fabulously40.com/~victori/couch.txt
 Pstack info on the hanged process
 http://temp.fabulously40.com/~victori/couchdb-pstack.txt

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Commented: (COUCHDB-716) CouchDB fails to start, just hangs.

2010-03-30 Thread Paul Joseph Davis (JIRA)

[ 
https://issues.apache.org/jira/browse/COUCHDB-716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12851588#action_12851588
 ] 

Paul Joseph Davis commented on COUCHDB-716:
---

Also the modules section is empty which is probably the real issue. Trying to 
track it down on IRC.

 CouchDB fails to start, just hangs.
 ---

 Key: COUCHDB-716
 URL: https://issues.apache.org/jira/browse/COUCHDB-716
 Project: CouchDB
  Issue Type: Bug
  Components: Database Core
Affects Versions: 0.11
 Environment: opensolaris/snv98 
Reporter: Victor Igumnov

 CouchDB 0.10.x works well while CouchDB 0.11 fails to start, it just hangs 
 with no debug information. I have used truss to trace the execution to the 
 hang point.
 Truss debug info
 http://temp.fabulously40.com/~victori/couch.txt
 Pstack info on the hanged process
 http://temp.fabulously40.com/~victori/couchdb-pstack.txt

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Created: (COUCHDB-721) possible data corruption after upgrade compaction

2010-03-30 Thread Timothy Smith (JIRA)
possible data corruption after upgrade  compaction
---

 Key: COUCHDB-721
 URL: https://issues.apache.org/jira/browse/COUCHDB-721
 Project: CouchDB
  Issue Type: Bug
  Components: Database Core
Affects Versions: 0.11
Reporter: Timothy Smith


Problem report filed on behalf of dev@couchdb.apache.org e-mail, subject 
Compaction issue after upgrade 0.10.1-0.11.0.

So this morning I went to upgrade one of my servers to 0.11. Installed
it, fixed up the config files, then restarted CouchDB. It picked up on
my databases just fine, so everything looked good. I tried some views,
and it had to re-index all of my ddocs (which I found surprising, but
okay). After that I went and compacted the database, then the views.

However, later today I got some exception mails from my web
application. It appears that something has gotten confused. For
example, take this document:

{_id: page-22, _rev: 2-1835830930, lb: null, content: blah blah
yadda, type: page, _deleted_conflicts: [4-4212453249,
2-1982019940, 2-1964049796, 2-1096626370]}

Note all the _deleted_conflicts. However, this is the document
returned by a view (which emits(doc.lb, doc))! When I actually request
this document, I get this:

{_id:page-22,_rev:4-4212453249} (it would be helpful to have a
member _deleted:true, or something, to show that it's not just empty,
but that something was there before).

Requesting the 2-1835830930 revision results in the complete document,
as shown above.

So, that got me pretty scared, because I thought I lost my document
(and my site actually started failing)! What would be the best way to
fix up my database? And do we have any diagnosis on what the cause of
this is? I'm happy I deployed this on a less-critical site first, and
wouldn't want to deploy at work unless we figure out what's going on
here.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



Re: Compaction issue after upgrade 0.10.1-0.11.0

2010-03-30 Thread Tim Smith
On Tue, Mar 30, 2010 at 10:53 AM, Damien Katz dam...@apache.org wrote:
 I'm interested in your problem, which might be related to something Simon 
 Eisenmann was seeing. Can you put the database and the server log file 
 somewhere I can access it?

This problem has been converted into a JIRA issue:

https://issues.apache.org/jira/browse/COUCHDB-721

Tim
-- 
If you're not part of the solution, you're part of the precipitate


Re: (lack of) couchdb windows binaries

2010-03-30 Thread Mark Hammond

On 30/03/2010 5:00 PM, Noah Slater wrote:


On 30 Mar 2010, at 01:58, Mark Hammond wrote:


I understand that - however, the Windows issues are well known,
have existed forever and has never before been raised as a blocker
for a windows binary.  If I knew it would be considered as such I
would not have invested any further efforts in Windows binaries
until the windows issues were resolved.


If you're happy preparing the binary, I am happy to call a vote on
it.


Great - it can be found at http://people.apache.org/~mhammond/dist/0.11.0/

...


As above, I have no interest in, or knowledge of the issues here,
so I will leave the honours to someone who does (or at least
someone who has enough grasp of this to consider it a problem.)


Actually, I think you're the only person with enough knowledge to
handle this. You're not expected to know anything about the law. The
purpose of the list is for people with the technical knowledge to ask
the people with the legal knowledge what the best way forward is. If
you start a thread on legal telling them how the Windows binary is
constructed, and asking them if that is okay, that should be all that
you have to do.


Sorry, but this needs to be undertaken by someone who actually believes 
there is an issue and can articulate it.  This person also needs to 
understand the couchdb dependencies on any platform (Windows is no 
different in this regard) and understands the concept of a binary 
release.  While I meet the last 2 criteria, I don't meet the first.


So please let me be completely clear and explicitly decline for the 3rd 
time :)


Cheers,

Mark


Re: (lack of) couchdb windows binaries

2010-03-30 Thread Juhani Ränkimies
On Wed, Mar 31, 2010 at 4:03 AM, Mark Hammond skippy.hamm...@gmail.com wrote:
 On 30/03/2010 5:00 PM, Noah Slater wrote:

 On 30 Mar 2010, at 01:58, Mark Hammond wrote:

 I understand that - however, the Windows issues are well known,
 have existed forever and has never before been raised as a blocker
 for a windows binary.  If I knew it would be considered as such I
 would not have invested any further efforts in Windows binaries
 until the windows issues were resolved.

 If you're happy preparing the binary, I am happy to call a vote on
 it.

 Great - it can be found at http://people.apache.org/~mhammond/dist/0.11.0/


This is a relief. Thank you. I was rather worried for a while.

Providing binaries is a critical for CouchDB adoption on windows. And
the build should definitely be part of the release process, IMO.
Otherwise there's a risk of getting stuck in a chicken and egg
situation: crippling bugs - don't release - not enough users
complaining about the bugs - nobody fixes the bugs.

Cheers!
-juhani