Since you mentioned GitHub, have you looked at Git Large File Storage?

https://github.com/blog/1986-announcing-git-large-file-storage-lfs

On Monday, June 22, 2015 at 4:09:31 PM UTC-4, Mohit Thatte wrote:
>
> AWS S3 is a great place to put large files 
> <https://aws.amazon.com/blogs/aws/amazon-s3-object-size-limit/>. You can 
> use S3 sync <http://docs.aws.amazon.com/cli/latest/reference/s3/sync.html>  
> to keep things current.
>
> ~Mohit
>
> On Mon, Jun 22, 2015 at 9:34 PM, Lawrence Krubner <lawr...@rollioforce.com 
> <javascript:>> wrote:
>
>>
>> This is more of Java eco-system/development question, but I am curious 
>> what folks in the Clojure community might regard as "best practice". Up 
>> till now most of the projects that I've worked on we've been able to share 
>> resources informally via "scp" and email, or via Github, but on the current 
>> project we are dealing with a lot of massive files, over 100 megs, many 
>> over a gig. These are things such as Natural Language Processing 
>> classifiers/dictionaries, many of which are huge. We need to have them 
>> available on our machines so we can do development work. We're trying to 
>> figure a way such that when we add new paths or new files we can tell each 
>> other, or find a way that they can do something similar to "git fetch 
>> origin" and see what changes have happened. 
>>
>> How do others handle this? 
>>
>>
>>
>>
>>  -- 
>> You received this message because you are subscribed to the Google
>> Groups "Clojure" group.
>> To post to this group, send email to clo...@googlegroups.com 
>> <javascript:>
>> Note that posts from new members are moderated - please be patient with 
>> your first post.
>> To unsubscribe from this group, send email to
>> clojure+u...@googlegroups.com <javascript:>
>> For more options, visit this group at
>> http://groups.google.com/group/clojure?hl=en
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Clojure" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to clojure+u...@googlegroups.com <javascript:>.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
>
> -- 
> -Mohit Thatte
>  

-- 
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clojure@googlegroups.com
Note that posts from new members are moderated - please be patient with your 
first post.
To unsubscribe from this group, send email to
clojure+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
--- 
You received this message because you are subscribed to the Google Groups 
"Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to clojure+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to