Re: How to resume broke clone ?

2013-12-05 Thread Michael Haggerty
This discussion has mostly been about letting small Git servers delegate the work of an initial clone to a beefier server. I haven't seen any explicit mention of the inverse: Suppose a company has a central Git server that is meant to be the single source of truth, but has worldwide offices and

Re: How to resume broke clone ?

2013-12-05 Thread Shawn Pearce
On Thu, Dec 5, 2013 at 5:21 AM, Michael Haggerty mhag...@alum.mit.edu wrote: This discussion has mostly been about letting small Git servers delegate the work of an initial clone to a beefier server. I haven't seen any explicit mention of the inverse: Suppose a company has a central Git

Re: How to resume broke clone ?

2013-12-05 Thread Jeff King
On Wed, Dec 04, 2013 at 10:50:27PM -0800, Shawn Pearce wrote: I wasn't thinking about using a well known blob for this. Jonathan, Dave, Colby and I were kicking this idea around on Monday during lunch. If the initial ref advertisement included a mirrors capability the client could respond

Re: How to resume broke clone ?

2013-12-05 Thread Jeff King
On Thu, Dec 05, 2013 at 02:21:09PM +0100, Michael Haggerty wrote: A better alternative would be to ask users to clone from the central server. In this case, the central server would want to tell the clients to grab what they can from their local bootstrap mirror and then come back to the

Re: How to resume broke clone ?

2013-12-05 Thread Junio C Hamano
Jeff King p...@peff.net writes: Right, I think that's the most critical one (though you could also just use the convention of .bundle in the URL). I think we may want to leave room for more metadata, though. Good. I like this line of thinking. Heck, remote.origin.url might already be a

Re: How to resume broke clone ?

2013-12-05 Thread Jeff King
On Thu, Dec 05, 2013 at 10:01:28AM -0800, Junio C Hamano wrote: You could have a git-advertise-upstream that generates a mirror blob from your remotes config and pushes it to your publishing point. That may be overkill, but I don't think it's possible with a .git/config-based solution.

Re: How to resume broke clone ?

2013-12-04 Thread Jeff King
On Thu, Nov 28, 2013 at 11:15:27AM -0800, Shawn Pearce wrote: - better integration with git bundles, provide a way to seamlessly create/fetch/resume the bundles with git clone and git fetch We have been thinking about formalizing the /clone.bundle hack used by repo on Android. If the

Re: How to resume broke clone ?

2013-12-04 Thread Shawn Pearce
On Wed, Dec 4, 2013 at 12:08 PM, Jeff King p...@peff.net wrote: On Thu, Nov 28, 2013 at 11:15:27AM -0800, Shawn Pearce wrote: - better integration with git bundles, provide a way to seamlessly create/fetch/resume the bundles with git clone and git fetch We have been thinking about

Re: How to resume broke clone ?

2013-11-28 Thread Duy Nguyen
On Thu, Nov 28, 2013 at 2:41 PM, zhifeng hu z...@ancientrocklab.com wrote: Thanks for reply, But I am developer, I want to clone full repository, I need to view code since very early. if it works with --depth =1, you can incrementally run fetch --depth=N with N larger and larger. But it may

Re: How to resume broke clone ?

2013-11-28 Thread Karsten Blees
Am 28.11.2013 09:14, schrieb Duy Nguyen: On Thu, Nov 28, 2013 at 2:41 PM, zhifeng hu z...@ancientrocklab.com wrote: Thanks for reply, But I am developer, I want to clone full repository, I need to view code since very early. if it works with --depth =1, you can incrementally run fetch

RE: How to resume broke clone ?

2013-11-28 Thread Max Kirillov
git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git I am in china. our bandwidth is very limitation. Less than 50Kb/s. You could manually download big packed bundled from some http remote. For example http://repo.or.cz/r/linux.git * create a new repository, add the remote there.

Re: How to resume broke clone ?

2013-11-28 Thread Duy Nguyen
On Thu, Nov 28, 2013 at 3:35 PM, Karsten Blees karsten.bl...@gmail.com wrote: Or simply download the individual files (via ftp/http) and clone locally: wget -r ftp://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/ git clone git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git

Re: How to resume broke clone ?

2013-11-28 Thread zhifeng hu
The repository growing fast, things get harder . Now the size reach several GB, it may possible be TB, YB. When then, How do we handle this? If the transfer broken, and it can not be resume transfer, waste time and waste bandwidth. Git should be better support resume transfer. It now seems not

Re: How to resume broke clone ?

2013-11-28 Thread Duy Nguyen
On Thu, Nov 28, 2013 at 3:55 PM, zhifeng hu z...@ancientrocklab.com wrote: The repository growing fast, things get harder . Now the size reach several GB, it may possible be TB, YB. When then, How do we handle this? If the transfer broken, and it can not be resume transfer, waste time and

Re: How to resume broke clone ?

2013-11-28 Thread Jeff King
On Thu, Nov 28, 2013 at 01:32:36AM -0700, Max Kirillov wrote: git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git I am in china. our bandwidth is very limitation. Less than 50Kb/s. You could manually download big packed bundled from some http remote. For example

Re: How to resume broke clone ?

2013-11-28 Thread Jeff King
On Thu, Nov 28, 2013 at 04:09:18PM +0700, Duy Nguyen wrote: Git should be better support resume transfer. It now seems not doing better it’s job. Share code, manage code, transfer code, what would it be a VCS we imagine it ? You're welcome to step up and do it. On top of my head

Re: How to resume broke clone ?

2013-11-28 Thread zhifeng hu
Once using git clone —depth or git fetch —depth, While you want to move backward. you may face problem git fetch --depth=105 error: Could not read 483bbf41ca5beb7e38b3b01f21149c56a1154b7a error: Could not read aacb82de3ff8ae7b0a9e4cfec16c1807b6c315ef error: Could not read

Re: How to resume broke clone ?

2013-11-28 Thread Duy Nguyen
On Thu, Nov 28, 2013 at 4:29 PM, Jeff King p...@peff.net wrote: - stablize pack order so we can resume downloading a pack I think stabilizing in all cases (e.g., including ones where the content has changed) is hard, but I wonder if it would be enough to handle the easy cases, where nothing

Re: How to resume broke clone ?

2013-11-28 Thread Shawn Pearce
On Thu, Nov 28, 2013 at 1:29 AM, Jeff King p...@peff.net wrote: On Thu, Nov 28, 2013 at 04:09:18PM +0700, Duy Nguyen wrote: Git should be better support resume transfer. It now seems not doing better it’s job. Share code, manage code, transfer code, what would it be a VCS we imagine it

Re: How to resume broke clone ?

2013-11-28 Thread Shawn Pearce
On Thu, Nov 28, 2013 at 1:29 AM, zhifeng hu z...@ancientrocklab.com wrote: Once using git clone —depth or git fetch —depth, While you want to move backward. you may face problem git fetch --depth=105 error: Could not read 483bbf41ca5beb7e38b3b01f21149c56a1154b7a error: Could not read

Re: How to resume broke clone ?

2013-11-28 Thread Jakub Narebski
zhifeng hu zf at ancientrocklab.com writes: Once using git clone —depth or git fetch —depth, While you want to move backward. you may face problem git fetch --depth=105 error: Could not read 483bbf41ca5beb7e38b3b01f21149c56a1154b7a error: Could not read

How to resume broke clone ?

2013-11-27 Thread zhifeng hu
Hello all: Today i want to clone the Linux Kernel git repository. git://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git I am in china. our bandwidth is very limitation. Less than 50Kb/s. The clone progress is very slow, and broken times and time. I am very unhappy. Because i could

Re: How to resume broke clone ?

2013-11-27 Thread zhifeng hu
Thanks for reply, But I am developer, I want to clone full repository, I need to view code since very early. zhifeng hu On Nov 28, 2013, at 3:39 PM, Trần Ngọc Quân vnwild...@gmail.com wrote: On 28/11/2013 10:13, zhifeng hu wrote: Hello all: Today i want to clone the Linux Kernel git