[git-users] Re: Git pull/checkout streaming API/CLI
Hi again :) Thanks for all the feedback, really appreciate it! If when you say “run git locally” you mean perform the actual checkout by running the usual commands, that is what I’m currently doing just to unlock myself, but being this part of an API server and being the purpose to store the whole repo (compressed) in a cloud storage, I am really keen to make it stream based, hoping to lower disk footprint and increase concurrency on each node (otherwise bound by the disk space consumed by concurrent invocations. I’ll check the other links you have provided, thanks a million. F -- You received this message because you are subscribed to the Google Groups "Git for human beings" group. To unsubscribe from this group and stop receiving emails from it, send an email to git-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/git-users/5c2fea5a-822a-4be0-bc2b-39e12d313a41%40googlegroups.com.
[git-users] Re: Git pull/checkout streaming API/CLI
Hi F, Yes, the https://git-scm.com/book/en/v2/Git-Internals-Transfer-Protocols are the ones that could be considered as an API. Though it maybe worth simply running Git locally so that you don't need to write any code..just a few scripts. Other options are looking at Git Bundle, which is normally used for sneakernet environments but can be used as a fake CDN (Content Delivery Network). Have a look over the archives https://public-inbox.org/git/?q=CDN for various discussions. Philip On Sunday, September 8, 2019 at 2:56:51 PM UTC+1, fru xo wrote: > > Hi Phillip, > thanks for the pointers. > > I did not know about fast-import/export, I’ll have a look as streaming is > what I need :) > As far as pack streams, is this what you refer to > https://git-scm.com/book/en/v2/Git-Internals-Transfer-Protocols ? I’ve > read it this morning, not sure yet if it’ll do but it’s one more tool in my > box which might be handy. > > I’ll check the first option, thanks again. > F > > On Sunday, 8 September 2019 13:04:26 UTC+1, Philip Oakley wrote: >> >> On Sunday, September 8, 2019 at 9:55:23 AM UTC+1, fru xo wrote: >>> >>> Hi all, >>> I’d love to be able to issue a git pull/checkout and stream its results >>> to an on-line cloud storage for another party there to actually downloading >>> it and working with the source. >>> Roughly just pipe all from a Git repo into that sink, but I presume I >>> would have to compress it somehow on the way. >>> >>> So: >>> 1. any off-the-shelf solution for this (I’ve Googled but no success so >>> far)? >>> 2. any description of the application-level protocol used by Git when >>> cloning/pulling/checking-out a repo? >>> >>> Thanks in advance, >>> Francesco >>> >> >> Have you looked at `fast-import` and `fast-export` as they are designed >> as a streaming method. >> >> However, do decide where control and response lies. Your question makes >> it sound like you are looking at Git as a service - you maybe just want to >> look directly at the Git pack streams that underlie a push/fetch >> Philip >> > -- You received this message because you are subscribed to the Google Groups "Git for human beings" group. To unsubscribe from this group and stop receiving emails from it, send an email to git-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/git-users/382587ae-57b2-45c0-b22c-b33af2ef8934%40googlegroups.com.
[git-users] Re: Git pull/checkout streaming API/CLI
Hi Phillip, thanks for the pointers. I did not know about fast-import/export, I’ll have a look as streaming is what I need :) As far as pack streams, is this what you refer to https://git-scm.com/book/en/v2/Git-Internals-Transfer-Protocols ? I’ve read it this morning, not sure yet if it’ll do but it’s one more tool in my box which might be handy. I’ll check the first option, thanks again. F On Sunday, 8 September 2019 13:04:26 UTC+1, Philip Oakley wrote: > > On Sunday, September 8, 2019 at 9:55:23 AM UTC+1, fru xo wrote: >> >> Hi all, >> I’d love to be able to issue a git pull/checkout and stream its results >> to an on-line cloud storage for another party there to actually downloading >> it and working with the source. >> Roughly just pipe all from a Git repo into that sink, but I presume I >> would have to compress it somehow on the way. >> >> So: >> 1. any off-the-shelf solution for this (I’ve Googled but no success so >> far)? >> 2. any description of the application-level protocol used by Git when >> cloning/pulling/checking-out a repo? >> >> Thanks in advance, >> Francesco >> > > Have you looked at `fast-import` and `fast-export` as they are designed > as a streaming method. > > However, do decide where control and response lies. Your question makes it > sound like you are looking at Git as a service - you maybe just want to > look directly at the Git pack streams that underlie a push/fetch > Philip > -- You received this message because you are subscribed to the Google Groups "Git for human beings" group. To unsubscribe from this group and stop receiving emails from it, send an email to git-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/git-users/fc103fc7-c7b1-4d92-a700-a0ecdd7e5c2b%40googlegroups.com.
[git-users] Re: Git pull/checkout streaming API/CLI
On Sunday, September 8, 2019 at 9:55:23 AM UTC+1, fru xo wrote: > > Hi all, > I’d love to be able to issue a git pull/checkout and stream its results to > an on-line cloud storage for another party there to actually downloading it > and working with the source. > Roughly just pipe all from a Git repo into that sink, but I presume I > would have to compress it somehow on the way. > > So: > 1. any off-the-shelf solution for this (I’ve Googled but no success so > far)? > 2. any description of the application-level protocol used by Git when > cloning/pulling/checking-out a repo? > > Thanks in advance, > Francesco > Have you looked at `fast-import` and `fast-export` as they are designed as a streaming method. However, do decide where control and response lies. Your question makes it sound like you are looking at Git as a service - you maybe just want to look directly at the Git pack streams that underlie a push/fetch Philip -- You received this message because you are subscribed to the Google Groups "Git for human beings" group. To unsubscribe from this group and stop receiving emails from it, send an email to git-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/git-users/61516c5e-a9f4-4933-8b11-66ffe81ddbe9%40googlegroups.com.
