Re: [gitorious] Is gitorious scalable?

2010-10-20 Thread Marius Mårnes Mathiesen
On Tue, Oct 19, 2010 at 11:25 PM, Renato Isidio  wrote:

> I'm planning to put more servers to balance requisitions to git-
> daemon. Do I have to install gitorious and git on the other server and
> point its repository to the same path on a remote filer? Is this
> right?
>

I'm don't think I can picture the exact architecture you're planning, but
generally the one thing that currently cannot be moved across multiple
machines is the actual Git repositories. The web app needs disk level access
to the repositories, so currently the app server and the repositories need
to be on the same machine. The Git/SSH traffic could easily be proxied to
other boxen from a front end server, although Gitorious currently does not
have a notion of different machines, just the location of the repositories
on disk.

The good news is that this is something we need to change for gitorious.org,
and pretty soon too. We've started the work and aim to complete it in Q1
2011.

Cheers,
- Marius

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


Re: [gitorious] Page blot and browser performance issues with a repository containing numerous tags

2010-10-20 Thread Marius Mårnes Mathiesen
On Tue, Oct 19, 2010 at 9:02 PM, Dun Peal  wrote:

> Hi. I just finished porting a very large SVN repsoitory to Git. The
> repository contains many (tens of thousands of) tags.
>

I won't ask...


> So having many tags bloats up the amount of HTML that get sent to each
> user, which given our user count is a problem, but also the causes
> browser performance issues rendering a very long page with thousands
> of vertical tag elements.
>

I suppose the right thing to do is to only display a subset of the tags,
which would require a UI to search/browse the tags. Furthermore, I suspect
there's a performance penalty in having repositories with such a large
number of tags - all the tags are fetched from the repository in several
places - so this should probably be handled as well.

Is this a private Gitorious installation?

Cheers,
- Marius

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


Re: [gitorious] /opt/gitorious/script/git-daemon:76:in `peeraddr': Transport endpoint is not connected - getpeername(2) (Errno::ENOTCONN)

2010-10-20 Thread Marius Mårnes Mathiesen
On Mon, Oct 18, 2010 at 8:19 PM, Renato Isidio  wrote:

> Can you help us? We've noticed that our git-daemon is quitting
> sometimes. We dont dont exactly what is the problem. Here we have a
> lot of CIs servers (Continuous Integration Servers) that keeps seeing
> if theres something new on git server. We have concurrent connections
> that are not too much (I mean =~70 / per minute(10 projects * 7
> repositories) ). Do you think this could be the problem?
>

The git poller is a very basic thing and probably won't be able to handle a
lot of concurrent users. On Gitorious.org we use a piece of software called
proxymachine (http://github.com/mojombo/proxymachine) to have a single entry
point towards several regular git daemon processes.

Cheers,
- Marius

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


Re: [gitorious] Clone errors: "The remote end hung up unexpectedly" and "Unable to get pack file"

2010-10-20 Thread Marius Mårnes Mathiesen
On Fri, Oct 15, 2010 at 7:41 PM, Zbyl  wrote:

> C:\VSProjects\WebKit\WebKitCE>git clone
> git://gitorious.org/+wincewebkit-developers/webkit/wincewebkit.git
> Cloning into wincewebkit...
> fatal: The remote end hung up unexpectedly
> fatal: early EOF
> fatal: index-pack failed
>

We have been seeing this in repositories owned by a group and thereby having
a plus sign in the Git URL. Someone mentioned on IRC that a recent commit in
Git itself solves an issue with this - so we'll be upgrading Git on the
servers later this week.

One thing you could try in the meantime is to use an alternate Git URL that
doesn't have the plus sign in its URL:

git://gitorious.org/webkit/wincewebkit.git

- and please let us know if this works better.

Cheers,
- Marius

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


[gitorious] db:create ERROR on Ubuntu 10.10

2010-10-20 Thread Donflopez
Hello i have this error on the database create.


** Invoke db:create (first_time)
** Invoke db:load_config (first_time)
** Invoke rails_env (first_time)
** Execute rails_env
** Execute db:load_config
** Execute db:create
rake aborted!
undefined method `[]' for nil:NilClass
/var/www/gitorious/vendor/rails/railties/lib/tasks/databases.rake:
55:in `create_database'
/var/www/gitorious/vendor/rails/railties/lib/tasks/databases.rake:31
/usr/lib/ruby/1.8/rake.rb:636:in `call'
/usr/lib/ruby/1.8/rake.rb:636:in `execute'
/usr/lib/ruby/1.8/rake.rb:631:in `each'
/usr/lib/ruby/1.8/rake.rb:631:in `execute'
/usr/lib/ruby/1.8/rake.rb:597:in `invoke_with_call_chain'
/usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
/usr/lib/ruby/1.8/rake.rb:590:in `invoke_with_call_chain'
/usr/lib/ruby/1.8/rake.rb:583:in `invoke'
/usr/lib/ruby/1.8/rake.rb:2051:in `invoke_task'
/usr/lib/ruby/1.8/rake.rb:2029:in `top_level'
/usr/lib/ruby/1.8/rake.rb:2029:in `each'
/usr/lib/ruby/1.8/rake.rb:2029:in `top_level'
/usr/lib/ruby/1.8/rake.rb:2068:in `standard_exception_handling'
/usr/lib/ruby/1.8/rake.rb:2023:in `top_level'
/usr/lib/ruby/1.8/rake.rb:2001:in `run'
/usr/lib/ruby/1.8/rake.rb:2068:in `standard_exception_handling'
/usr/lib/ruby/1.8/rake.rb:1998:in `run'
/usr/bin/rake:28

Any can help me?
Sorry about my english.

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


[gitorious] How do you import existing repos into Gitorious?

2010-10-20 Thread Nate P
I think I must be missing something obvious, but how do you import
existing repos into a new local install of Gitorious?  I see that
gitorious has it's own special naming scheme for the repos you create
in it, so I assume one needs to do some kind of formal import?  I have
about 50 repos and am hoping there is some easy way to suck them in?

Any thoughts / help greatly appreciated!

Thanks!
nate

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


[gitorious] Re: Is gitorious scalable?

2010-10-20 Thread Renato Isidio
Hi Marius!

Thanks for answering me. We're using unix servers and we want to
install git / gitorious on those servers. What we're not sure is if
the repository is gonna crash, I mean, If git-1 (imagine 2 gits / one
per server) tryies to write a code into the disk (that is a filer and
its shared as mount points) and the other git-2 process on the other
server wants to write at the same time. Whats gonna happen? This
semaphore is managed by software? Or its not managed? Actually I dont
know if this question belongs to gitorious or git only.

thank you!

Renato



On 20 out, 14:42, Marius Mårnes Mathiesen 
wrote:
> On Tue, Oct 19, 2010 at 11:25 PM, Renato Isidio  wrote:
> > I'm planning to put more servers to balance requisitions to git-
> > daemon. Do I have to install gitorious and git on the other server and
> > point its repository to the same path on a remote filer? Is this
> > right?
>
> I'm don't think I can picture the exact architecture you're planning, but
> generally the one thing that currently cannot be moved across multiple
> machines is the actual Git repositories. The web app needs disk level access
> to the repositories, so currently the app server and the repositories need
> to be on the same machine. The Git/SSH traffic could easily be proxied to
> other boxen from a front end server, although Gitorious currently does not
> have a notion of different machines, just the location of the repositories
> on disk.
>
> The good news is that this is something we need to change for gitorious.org,
> and pretty soon too. We've started the work and aim to complete it in Q1
> 2011.
>
> Cheers,
> - Marius

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


[gitorious] Re: /opt/gitorious/script/git-daemon:76:in `peeraddr': Transport endpoint is not connected - getpeername(2) (Errno::ENOTCONN)

2010-10-20 Thread Renato Isidio
Thank you Marius again!

Im gonna take a look and keep you in touch.

Best Regards!

Renato Isidio

On 20 out, 14:51, Marius Mårnes Mathiesen 
wrote:
> On Mon, Oct 18, 2010 at 8:19 PM, Renato Isidio  wrote:
> > Can you help us? We've noticed that our git-daemon is quitting
> > sometimes. We dont dont exactly what is the problem. Here we have a
> > lot of CIs servers (Continuous Integration Servers) that keeps seeing
> > if theres something new on git server. We have concurrent connections
> > that are not too much (I mean =~70 / per minute(10 projects * 7
> > repositories) ). Do you think this could be the problem?
>
> The git poller is a very basic thing and probably won't be able to handle a
> lot of concurrent users. On Gitorious.org we use a piece of software called
> proxymachine (http://github.com/mojombo/proxymachine) to have a single entry
> point towards several regular git daemon processes.
>
> Cheers,
> - Marius

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com


Re: [gitorious] Clone errors: "The remote end hung up unexpectedly" and "Unable to get pack file"

2010-10-20 Thread Zbyszek Skowron
This link didn't work either:

$ git clone git://gitorious.org/webkit/wincewebkit.git
Cloning into wincewebkit...
remote: Counting objects: 902995, done.
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed

Zbyl

On 20 October 2010 18:54, Marius Mårnes Mathiesen
 wrote:
> On Fri, Oct 15, 2010 at 7:41 PM, Zbyl  wrote:
>>
>> C:\VSProjects\WebKit\WebKitCE>git clone
>> git://gitorious.org/+wincewebkit-developers/webkit/wincewebkit.git
>> Cloning into wincewebkit...
>> fatal: The remote end hung up unexpectedly
>> fatal: early EOF
>> fatal: index-pack failed
>
> We have been seeing this in repositories owned by a group and thereby having
> a plus sign in the Git URL. Someone mentioned on IRC that a recent commit in
> Git itself solves an issue with this - so we'll be upgrading Git on the
> servers later this week.
> One thing you could try in the meantime is to use an alternate Git URL that
> doesn't have the plus sign in its URL:
> git://gitorious.org/webkit/wincewebkit.git
> - and please let us know if this works better.
> Cheers,
> - Marius
>
> --
> To post to this group, send email to gitorious@googlegroups.com
> To unsubscribe from this group, send email to
> gitorious+unsubscr...@googlegroups.com
>

-- 
To post to this group, send email to gitorious@googlegroups.com
To unsubscribe from this group, send email to
gitorious+unsubscr...@googlegroups.com