If somebody’s writing this up, it might be worth differentiating between large text files and large binaries.
Both are potentially problematic, but the binaries far more so! (at least if they change much) From: Discuss [mailto:discuss-boun...@lists.software-carpentry.org] On Behalf Of Aron Ahmadia Sent: 18 November 2014 16:28 To: Naupaka Zimmerman Cc: Jed Brown; Software Carpentry Discussion; Karin Lagesen; Chris Kees Subject: Re: [Discuss] version control of big files Hi Karin, Heavy binary versioning is an unsolved problem. A very trusted developer from my community (and friend), Jed Brown, has implemented a lightweight alternative to git annex called git-fat that is implemented in Python and intentionally easy to install. Here's the first reference to it in the discussion list, when it was a bare two weeks old: http://lists.software-carpentry.org/pipermail/tutors_lists.software-carpentry.org/2012-November/000415.html You may also want to look into bup, especially if you're trying to version the differences between large files, instead of just their signatures. I'm cc-ing Jed on the discussion, as well as another member of my research laboratory who has been looking at this issue. Regards, Aron On Tue, Nov 18, 2014 at 11:19 AM, Naupaka Zimmerman <naup...@gmail.com<mailto:naup...@gmail.com>> wrote: Hi Karin - I believe at one point there was a lot of talk about using git annex for this purpose: https://git-annex.branchable.com Haven't used it myself, but perhaps others have and can chime in. Best, Naupaka On 18 Nov 2014, at 9:15, Karin Lagesen wrote: Hi! I am working in a project where we have a lot of big files that we should be keeping under version control - I am talking about GB sized files here. I suspect that there are people on this list that have been in a similar situation, and I was wondering what solutions people have ended up with using? Thanks! Karin -- Karin Lagesen, Ph.D. Department of Medical Genetics Oslo University Hospital http://blog.karinlag.no _______________________________________________ Discuss mailing list Discuss@lists.software-carpentry.org<mailto:Discuss@lists.software-carpentry.org> http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org _______________________________________________ Discuss mailing list Discuss@lists.software-carpentry.org<mailto:Discuss@lists.software-carpentry.org> http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org ----- We invite research leaders and ambitious early career researchers to join us in leading and driving research in key inter-disciplinary themes. Please see www.hw.ac.uk/researchleaders for further information and how to apply. Heriot-Watt University is a Scottish charity registered under charity number SC000278.
_______________________________________________ Discuss mailing list Discuss@lists.software-carpentry.org http://lists.software-carpentry.org/mailman/listinfo/discuss_lists.software-carpentry.org
