sergey-safarov opened a new issue #1119: Could not open shard
URL: https://github.com/apache/couchdb/issues/1119
 
 
   ## Expected Behavior
   CouchDB must open shards without any error.
   
   ## Current Behavior
   When replicated database from other server to standalone CouchDB time to 
time i see errors like this
   ```
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [notice] 
2018-01-15T10:34:47.577647Z [email protected] <0.25708.3> -------- 
10.0.9.10 - - GET / 200
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [notice] 
2018-01-15T10:34:47.880163Z [email protected] <0.25433.3> -------- 
Retrying GET request to 
http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/ in 4.0 
seconds due to error {code,500}
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.893174Z [email protected] <0.25726.3> -------- Could 
not open file 
./data/shards/00000000-1fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.893399Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/00000000-1fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.894595Z [email protected] <0.25730.3> -------- Could 
not open file 
./data/shards/20000000-3fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.895033Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/20000000-3fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.895562Z [email protected] <0.25734.3> -------- Could 
not open file 
./data/shards/40000000-5fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.895868Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/40000000-5fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.896352Z [email protected] <0.25738.3> -------- Could 
not open file 
./data/shards/60000000-7fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.896630Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/60000000-7fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.897154Z [email protected] <0.25742.3> -------- Could 
not open file 
./data/shards/80000000-9fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.897454Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/80000000-9fffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.897923Z [email protected] <0.25746.3> -------- Could 
not open file 
./data/shards/a0000000-bfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.898239Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/a0000000-bfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.898754Z [email protected] <0.25750.3> -------- Could 
not open file 
./data/shards/c0000000-dfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.899083Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/c0000000-dfffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.899571Z [email protected] <0.25754.3> -------- Could 
not open file 
./data/shards/e0000000-ffffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479.couch:
 no such file or directory
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [info] 
2018-01-15T10:34:47.899888Z [email protected] <0.206.0> -------- 
open_result error {not_found,no_db_file} for 
shards/e0000000-ffffffff/account/51/b3/d5b4883ebe3261b1250e401deca0.1516012479
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.900597Z [email protected] <0.25433.3> -------- 
Replicator, request GET to 
"http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/"; failed 
due to error {code,500}
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.900935Z [email protected] <0.25433.3> -------- 
exit:{http_error_code,500,<<"GET 
http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/";>>}: 
Replication 77d0d1cc310aa875647f25011de294cf+create_target failed to start 
"http://217.12.247.210:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/"; 
-> "http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/"; doc 
null:null 
stack:[{couch_replicator_api_wrap,db_open,3,[{file,"src/couch_replicator_api_wrap.erl"},{line,119}]},{couch_replicator_scheduler_job,init_state,1,[{file,"src/couch_replicator_scheduler_job.erl"},{line,590}]}]
   Jan 15 10:34:47 node0.docker.rcsnet.ru sh[1690]: [error] 
2018-01-15T10:34:47.901167Z [email protected] <0.357.0> -------- 
couch_replicator_scheduler : Transient job 
{"77d0d1cc310aa875647f25011de294cf","+create_target"} failed, removing. Error: 
<<"{http_error_code,500,\n                 <<\"GET 
http://10.0.9.9:5984/account%2f51%2fb3%2fd5b4883ebe3261b1250e401deca0/\";>>}">>
   Jan 15 10:34:48 node0.docker.rcsnet.ru sh[1690]: [notice] 
2018-01-15T10:34:48.682942Z [email protected] <0.25757.3> 8f8d36eae3 
undefined 10.0.9.10 undefined GET / 200 ok 0
   Jan 15 10:34:49 node0.docker.rcsnet.ru sh[1690]: [notice] 
2018-01-15T10:34:49.578731Z [email protected] <0.25774.3> -------- 
10.0.9.10 - - GET / 200
   ```
   
   ## Possible Solution
   Not sure but this may by thread sync issue. Similar error is described here 
for other erlang program.
   [link 1](https://github.com/2600hz/kazoo/pull/3809)
   [link2](https://2600hz.atlassian.net/browse/KAZOO-5354)
   
   ## Steps to Reproduce (for bugs)
   
   1. start docker container
   2. start replication about 1500 databases (total 25 Gb) from other server. 
   
   ## Context
   I want migrate date from other CouchDB server.
   
   ## Your Environment
   * Version used: [docker image](https://hub.docker.com/r/apache/couchdb/) tag 
2.1.1
   * Browser Name and version: Google Chrome 63.0.3239.132 (Official Build) 
(64-bit)
   * Operating System and version (desktop or mobile): Fedora 27 + Docker 
17.12.0-ce
   * Link to your project: none
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to