[RE]Re: Kallithea 0.7.0 Running Environment Questions
Hello Kallithea, Thank you so much.We ended up upgradingthe EC2 instane from
t2.micro to r5.xlarge.So the specifications of the instance are as
follows.(Intel Xeon3.1GHzSkylake-SP orCascade Lake) vCPU = 4, RAM = 32GiBWe set
the thread value to 1 when you configure the ini file, the download will
proceed as a result, although it is slow.The thing is the server would not be
able to process anything else until the download is complete, so I want to
increase the thread value more in the ini file.I'd like to know the possible
risks.There is no other program running in the instance except for
Kallithea.- Original Message -From : Mads Kiilerich
To : "김태호" ,
Cc : "박정환" Sent
: 2021-06-17 06:07:21Subject : Re: Kallithea 0.7.0 Running Environment Questions
On 6/15/21 1:02 PM, 김태호 wrote:
We are testing by
installing 0.7.0 version of Kallithea in two different
environments.
One was installed on
WSL2 on my Windows 10 computer, and the other on EC2
(t2.Micro, Ubuntu20.04) on AWS.
The Kallithea git repo
that I want to download is about 2.84GB.
There was no problem when I installed it on my PC to verify
that the installation process or configuration was wrong.
If I run the Kallithea
in WSL2, there is no problem with the download.
The specifications of
WSL2 are as follows.
CPU : Intel(R) Core(TM)
i7-1065G7 CPU @ 1.30GHz 1.50 GHz ( 8 core )
RAM: 16 GB
EC2 is (t2.Micro)
vCPU:
1
RAM:
1
However, if I run on an
EC2 instance, the following error :
-->
start
error: RPC failed; HTTP
417 curl 22 The requested URL returned error: 417
fatal: the remote
end hung up unexpectedly
-->
end
Debug
level log txt fileis attached.
You saw this at the end of the log file:
2021-06-15 10:31:38.805 DEBUG
[kallithea.config.middleware.pygrack] handling cmd ['git',
'upload-pack', '--stateless-rpc',
'/var/kallithea/repos/Hicare-Smart/v2/hub-android']
2021-06-15 10:33:12.303 ERROR
[kallithea.config.middleware.pygrack] Traceback (most recent call
last):
File
"/home/ubuntu/kallithea/lib/python3.8/site-packages/kallithea/config/middleware/pygrack.py",
line 160, in backend
out = subprocessio.SubprocessIOChunker(
File
"/home/ubuntu/kallithea/lib/python3.8/site-packages/kallithea/lib/vcs/subprocessio.py",
line 365, in __init__
raise EnvironmentError("Subprocess exited due to an error: %s"
% err)
OSError: Subprocess exited due to an error: b'error: pack-objects
died of signal 9\nerror: git upload-pack: git-pack-objects died
with error.\nfatal: git upload-pack: aborting due to possible
repository corruption on the remote side.\n'
Kallithea is invoking 'git', and Git fails, probably because the
server is out of memory.
You can perhaps reproduce pretty much the same problem by running
this on the server:
cd /var/kallithea/repos/Hicare-Smart/v2/hub-android
git bundle create /tmp/bundle --all
On the machine where the operation works on the same repo, you
can try to use
/usr/bin/time -v git bundle create /tmp/bundle --all
and the line with "Maximum resident set size (kbytes)" will tell how
much memory it is using.
While it is hard to give any advice on server size, it seems
reasonable that the the server at least must be of similar size as
the repo, multiplied by some factor. Next, the server size will
depend on for example how many simultaneous operations it should
handle.
I guess it would work (but be slow) if the system is configured
with plenty of swap space. But real RAM is better.
/Mads
___
kallithea-general mailing list
kallithea-general@sfconservancy.org
https://lists.sfconservancy.org/mailman/listinfo/kallithea-general
[RE]Re: Authentication log Questions
Hello KallitheaThank you for your answer !We have solved Question1 and Question3 but the second one.So, let me elaborate on the second question.The following attempts have been made to download kallithea-git repository which is about 150MB size:1.Changed the http_server option from gearbox to waitress.This makes it possible to download more files than the gearbox, but the 150MB file still fails.>> Command that I tired.ubuntu@DESKTOP-VD6IGV2:~$ git clone https://taeho...@scm.dev.my-company.net/my-company-smart/v2/hub-androidCloning into 'hub-android'...Password for 'https://taeho...@scm.dev.my-company.net:error: RPC failed; HTTP 504 curl 22 The requested URL returned error: 504fatal: the remote end hung up unexpectedly2. git config -> http.postbuffer=524288000It did not work at all...I wonder if it only works for git push command.3. NginxI thought Nginx possibly could solve this problem so I applied this to my server :https://kallithea.readthedocs.io/en/default/setup.html#nginx-virtual-host-examplethen it leaves log (kallithea.access.log) as following:13.209.204.126 - - [11/Jun/2021:07:59:04 +] "GET /my-company-Smart/v2/hub-android/info/refs?service=git-upload-pack HTTP/1.1" 401 448 "-" "git/2.25.1"13.209.204.126 - admin [11/Jun/2021:07:59:04 +] "GET /my-company-Smart/v2/hub-android/info/refs?service=git-upload-pack HTTP/1.1" 401 448 "-" "git/2.25.1"13.209.204.126 - admin [11/Jun/2021:07:59:06 +] "GET /my-company-Smart/v2/hub-android/info/refs?service=git-upload-pack HTTP/1.1" 200 7807 "-" "git/2.25.1"4. Changed repository settingI changedenable downloads option. (checked the box) So I could download the zip file.I don't think I can keep using this because all my coworkers usingSourcetree app. ButBut I think it's going to be a clue to solve this problem.Please let me know if you need me to try something else or more information.Thank you again !- Original Message -From : Mads Kiilerich To : "김태호" , Cc : "박정환" Sent : 2021-06-10 21:26:19Subject : Re: Authentication log Questions Hi On 6/10/21 9:25 AM, 김태호 wrote: >> Question 1 We are constantly getting this kind of log as following (at WARNING level) : ... 2021-06-10 07:04:42.989 ERROR [kallithea.lib.auth_modules.auth_internal] user admin had a bad password 2021-06-10 07:04:42.989 WARNI [kallithea.lib.auth_modules] User `admin` failed to authenticate against kallithea.lib.auth_modules.auth_internal 2021-06-10 07:04:48.507 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:04:48.853 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:05:18.535 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:05:18.848 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:05:48.560 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:05:48.859 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:06:18.592 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:06:18.865 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:06:39.255 WARNI [kallithea.lib.auth_modules] User `member1` failed to authenticate against kallithea.lib.auth_modules.auth_crowd 2021-06-10 07:06:45.635 WARNI [kallithea.lib.auth_modules] User `member1` failed to authenticate against kallithea.lib.auth_modules.auth_crowd 2021-06-10 07:06:48.719 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:06:48.884 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index [2021-06-10 07:07:10 +] [5664] [INFO] Handling signal: winch 2021-06-10 07:07:18.640 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index 2021-06-10 07:07:18.911 WARNI [kallithea.lib.auth] user is
Authentication log Questions
Hello Kallithea>> Question 1We are constantly getting this kind of log as following (at WARNING level) :...2021-06-10 07:04:42.989 ERROR [kallithea.lib.auth_modules.auth_internal] user admin had a bad password2021-06-10 07:04:42.989 WARNI [kallithea.lib.auth_modules] User `admin` failed to authenticate against kallithea.lib.auth_modules.auth_internal2021-06-10 07:04:48.507 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:04:48.853 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:05:18.535 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:05:18.848 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:05:48.560 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:05:48.859 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:06:18.592 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:06:18.865 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:06:39.255 WARNI [kallithea.lib.auth_modules] User `member1` failed to authenticate against kallithea.lib.auth_modules.auth_crowd2021-06-10 07:06:45.635 WARNI [kallithea.lib.auth_modules] User `member1` failed to authenticate against kallithea.lib.auth_modules.auth_crowd2021-06-10 07:06:48.719 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:06:48.884 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index[2021-06-10 07:07:10 +] [5664] [INFO] Handling signal: winch2021-06-10 07:07:18.640 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:07:18.911 WARNI [kallithea.lib.auth] user is anonymous and NOT authenticated with regular auth @ HomeController:index2021-06-10 07:07:22.535 WARNI [kallithea.lib.auth_modules] User `member1` failed to authenticate against kallithea.lib.auth_modules.auth_crowd2021-06-10 07:07:28.507 WARNI [kallithea.lib.auth_modules] User `member1` failed to authenticate against kallithea.lib.auth_modules.auth_crowd...I wonder why the log prints that the authentication failedeven if login is successful.>> Question 2We changed http_server to waitress to download a large size file from my kallithea-git.Also I put larger value for channel_timeout andmax_request_body_size(channel_timeout = 180, max_request_body_size = 322122547200) in my .ini file.But I still haven't received the same size file as the next attached picture.But I can still download small size files from Kallithea.>> Question 3As a guest, whenever I push to git repositoy, the following error message occurs.ERROR MESSAGE 1:POSTgit-receive-pack(642bytes)remote:Traceback(mostrecentcalllast):remote:File"hooks/pre-receive",line16,inremote:fromkallithea.lib.hooksimporthandle_git_pre_receiveas_handlerremote:ModuleNotFoundError:Nomodulenamed'kallithea' ERROR MESSAGE 2:Enumeratingobjects:46,done.Deltacompressionusingupto8threadsTotal32(delta17),reused0(delta0),pack-reused0POSTgit-receive-pack(34113bytes)Remote:Traceback(mostrecentcalllast):Remote:File"hooks/pre-receive",line16,inRemote:fromkallithea.lib.hooksimporthandle_git_pre_receiveas_handlerRemote:ModuleNotFoundError:Nomodulenamed'kallithea' Why cannot it find the 'kallithea' module?___ kallithea-general mailing list kallithea-general@sfconservancy.org https://lists.sfconservancy.org/mailman/listinfo/kallithea-general
Kallithea git big file pull/push timeout error question
Hello KallitheaWe are currnetly using Kallithea on AWS EC2 instance.The sturcture of it is follow as:AWS Load Balancer -> EC2 (Kallithea)The ini file has been made by the CLI of :kallithea-cli config-create my.ini database_engine=postgres http_server=gearboxWhenever my team try to download this big file(approx 2GB), following error comes out:RPCfailed;HTTP504curl22TherequestedURLreturnederror:504Related to this, I wonder if there isthe file that can change the settings for timeout for gearbox or something else.Or please let me know if there is another solution for this problem.___ kallithea-general mailing list kallithea-general@sfconservancy.org https://lists.sfconservancy.org/mailman/listinfo/kallithea-general
Hello again Kallithea I got a question with Crowd Authentication Plugin
Hello :) I am setting up the Crowd Authentication Plugin. Crowd server is on another EC2 instance, and we obviously checked everything. We have tried the Domain name and IP of the Crowd page too. But this does not work I wonder what else we can do on Kallithea Auth settings? Or should I talk to the Atlassian team? Regards ___ kallithea-general mailing list kallithea-general@sfconservancy.org https://lists.sfconservancy.org/mailman/listinfo/kallithea-general
Hello Kallithea :) I have a question
Hello Kallithea :) I have a question I am planning a toy project with a bunch of groups of people in my school. So I want to create a server on AWS to have Kallithea, and I wonder if there is a minimum or recommended hardware specification. Regards :) ___ kallithea-general mailing list kallithea-general@sfconservancy.org https://lists.sfconservancy.org/mailman/listinfo/kallithea-general
