idea-christian commented on issue #5544:
URL: https://github.com/apache/couchdb/issues/5544#issuecomment-2897844753
Thanks for coming back. I adjusted the Systemd job as indicated in the
documentation, no idea why I missed this initially...
> What is your partition key? View updates will by per-shard, not
per-partition.
The partition keys are for topics/types in the data, for example, there is
one partition key there is used for all task items in the system and another
one for the history created by the tasks.
All partition keys are following a pattern of:
`ClientNumber-SystemPart:UUID`
`So for example: 0000-Task:1e79d26a-bac4-49bc-9816-07b240a5abfe`
I think it would be fair to say that we currently use the partition keys a
bit like tables in SQL. Some views/the related map function have code like
this:
```
function (doc) {
if(doc._id.indexOf('-certificate_detail:') == -1) return;
emit(doc.FleetMasterDetailID, 1);
}
```
The idea was to kick-out not needed documents directly. Does this help at
all?
I guess our problem are more the mango indexes, we have a lot to support
multiple filters (guess is 700).
> For this we need more info about your hardware, data sizes and shapes, and
traffic patterns.
Currently, its a single node, VM running Debian with 12 cores, and 62GB of
RAM. The database range from a few MB to around 5GB, where the bigger onces
size is due to thumbnails attached to documents. Each database is in
replication with another server running on the client side.
Beside that CouchDB is used through our API to server the web frontend, this
is mostly views and mango queries. We also use full text search with clouseau.
Regarding the deleted documents, thanks for the details. I guess in that
case we wait, as we don't plan to add new indexes right now and adding further
DB's to the system (given the load issues) sounds not like a good idea.
I'm just surprised that we run into this issues now as this is not a new
server, and even with me removing a lot of the unneeded clutter it still seems
to have issues. Again, any help is appreciated as I'm a bit clueless what todo
next.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
