Hi gitlab gurus, I have inherited an old gitlab installation from a previous sys admin who is long gone. It has been working fine for years without any need to touch it. It was working fine of Friday 05 Apr 2019. When I tried to do a pull, or push a change to it this morning, Monday 08 Apr 2019, I got following error every time:
> git push Authorised use only. All activity may be monitored and reported. Counting objects: 9, done. Delta compression using up to 4 threads. Compressing objects: 100% (5/5), done. Writing objects: 100% (5/5), 613 bytes, done. Total 5 (delta 3), reused 0 (delta 0) remote: /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:141:in `read_nonblock': end of file reached (EOFError) remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:141:in `rbuf_fill' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:122:in `readuntil' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:132:in `readline' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:2563:in `read_status_line' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:2552:in `read_new' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1320:in `block in transport_request' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1317:in `catch' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1317:in `transport_request' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1294:in `request' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_net.rb:76:in `block in get' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:746:in `start' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_net.rb:76:in `get' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_net.rb:31:in `allowed?' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_update.rb:39:in `exec' remote: from hooks/update:17:in `<main>' remote: error: hook declined to update refs/heads/master To g...@gitlab.test.camelot:unix/puppet.git ! [remote rejected] master -> master (hook declined) error: failed to push some refs to 'g...@gitlab.test.camelot:unix/puppet.git' In gitlab.test.camelot:/path/to/unicorn/current 2019-04-08_12:52:24.12611 E, [2019-04-08T13:52:24.125890 #1039] ERROR -- : worker=1 PID:2011 timeout (31s > 30s), killing 2019-04-08_12:52:24.13788 E, [2019-04-08T13:52:24.137465 #1039] ERROR -- : reaped #<Process::Status: pid 2011 SIGKILL (signal 9)> worker=1 2019-04-08_12:52:24.13789 I, [2019-04-08T13:52:24.137690 #1039] INFO -- : worker=1 spawning... 2019-04-08_12:52:24.14417 I, [2019-04-08T13:52:24.143973 #2179] INFO -- : worker=1 spawned pid=2179 2019-04-08_12:52:24.14454 I, [2019-04-08T13:52:24.144465 #2179] INFO -- : worker=1 ready unicorn['worker_processes'] and unicorn['worker_timeout'] were not specified in /etc/gitlab/gitlab.rb so were defaulting to 2 and 30 secs. I added: unicorn['worker_processes'] = 3 unicorn['worker_timeout'] = 60 and ran gitlab-ctl reconfigure. Now, git pull with no changes seems to sometimes work, but trying to push a change it consistently says: git push Mon Apr 8 15:58:16 BST 2019 Authorised use only. All activity may be monitored and reported. Counting objects: 9, done. Delta compression using up to 4 threads. Compressing objects: 100% (5/5), done. Writing objects: 100% (5/5), 618 bytes, done. Total 5 (delta 3), reused 0 (delta 0) remote: /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:146:in `rescue in rbuf_fill': Timeout::Error (Timeout::Error) remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:140:in `rbuf_fill' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:122:in `readuntil' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/protocol.rb:132:in `readline' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:2563:in `read_status_line' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:2552:in `read_new' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1320:in `block in transport_request' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1317:in `catch' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1317:in `transport_request' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:1294:in `request' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_net.rb:76:in `block in get' remote: from /opt/gitlab/embedded/lib/ruby/1.9.1/net/http.rb:746:in `start' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_net.rb:76:in `get' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_net.rb:31:in `allowed?' remote: from /opt/gitlab/embedded/service/gitlab-shell/lib/gitlab_update.rb:39:in `exec' remote: from hooks/update:17:in `<main>' remote: error: hook declined to update refs/heads/master To g...@gitlab.test.camelot:unix/puppet.git ! [remote rejected] master -> master (hook declined) error: failed to push some refs to 'g...@gitlab.test.camelot:unix/puppet.git' and gitlab.test.camelot:/path/to/unicorn/current still says: 2019-04-08_15:33:35.58059 E, [2019-04-08T16:33:35.580354 #3981] ERROR -- : worker=1 PID:4222 timeout (61s > 60s), killing 2019-04-08_15:33:35.58737 E, [2019-04-08T16:33:35.587071 #3981] ERROR -- : reaped #<Process::Status: pid 4222 SIGKILL (signal 9)> worker=1 2019-04-08_15:33:35.58738 I, [2019-04-08T16:33:35.587260 #3981] INFO -- : worker=1 spawning... 2019-04-08_15:33:35.59819 I, [2019-04-08T16:33:35.597529 #4893] INFO -- : worker=1 spawned pid=4893 2019-04-08_15:33:35.59864 I, [2019-04-08T16:33:35.598537 #4893] INFO -- : worker=1 ready I found https://forum.gitlab.com/t/troubleshooting-guide-wiki/31 but bundle is not in the git user path, and I locate several different instances of it in various locations, so don't know which to use: > locate bundle | egrep "\/bundle$" | xargs ls -lad | egrep "^-" -rwxr-xr-x 1 root root 473 May 12 2014 /opt/gitlab/embedded/bin/bundle -rwxr-xr-x 1 root root 592 May 12 2014 /opt/gitlab/embedded/lib/ruby/gems/1.9.1/gems/bundler-1.5.3/bin/bundle -rw-r--r-- 1 root root 2626 May 12 2014 /opt/gitlab/embedded/lib/ruby/gems/1.9.1/gems/bundler-1.5.3/lib/bundler/man/bundle -rwxr-xr-x 1 root root 129 May 12 2014 /opt/gitlab/embedded/service/gem/ruby/1.9.1/gems/bootstrap-sass-3.0.3.0/test/dummy/bin/bundle -rwxr-xr-x 1 root root 129 May 12 2014 /opt/gitlab/embedded/service/gem/ruby/1.9.1/gems/devise-3.0.4/test/rails_app/bin/bundle -rwxr-xr-x 1 root root 148 May 12 2014 /opt/gitlab/embedded/service/gem/ruby/1.9.1/gems/rails-4.0.5/guides/code/getting_started/bin/bundle -rw-r--r-- 1 root root 109 May 12 2014 /opt/gitlab/embedded/service/gem/ruby/1.9.1/gems/railties-4.0.5/lib/rails/generators/rails/app/templates/bin/bundle -rwxr-xr-x 1 root root 129 May 12 2014 /opt/gitlab/embedded/service/gem/ruby/1.9.1/gems/sass-rails-4.0.3/test/fixtures/engine_project/test/dummy/bin/bundle -rwxrwxr-x 1 root root 129 May 12 2014 /opt/gitlab/embedded/service/gitlab-rails/bin/bundle I am running out of google searches that help at all. I am completely new to gitlab admin, and don't know where to go from here. Can someone advise how to find the problem and fix it please? thanx in advance, Paul. -- This e-mail is subject to our Legal Notice which you can view here: Camelot’s Legal Notice <http://www.camelotgroup.co.uk/camelotemaildisclaimer1> -- You received this message because you are subscribed to the Google Groups "GitLab" group. To unsubscribe from this group and stop receiving emails from it, send an email to gitlabhq+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/gitlabhq/88ac2505-a4e7-4aa6-8a38-b0dd5711673f%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
