Re: Efficiency of rep-sharing (deduplication) in 1.8 and later (chunking?)

2014-12-03 Thread Thomas Harold
> > Representation cache is based on the sha of the rep. So it does not > matter what the filename is or where it is stored. If it has the same > sha as an existing rep, then it will be be shared. > > The small improvement in 1.8 was simply to do this for files being added > within the same rev

Efficiency of rep-sharing (deduplication) in 1.8 and later

2014-09-12 Thread Thomas Harold
I have a question about how efficient SVN is at de-duplication within a repository with regards to files that appear in multiple locations, but which have the same content. I know a small improvement was made in 1.8... http://subversion.apache.org/docs/release-notes/1.8.html#fsfs-enhancements >

Re: Repository Structure Question

2014-01-03 Thread Thomas Harold
On 1/2/2014 5:25 PM, Mike Fochtman wrote: Currently the team hasn't used any form of version control on these applications because 'it would be too hard...' I think you can get 99% of the way there by making sure that application 'A' is under full version control. Some version control is bette

Re: svn hotcopy

2013-12-28 Thread Thomas Harold
On 12/26/2013 3:42 PM, Listman wrote: I am using svn 1.5.5 and I backup with hotcopy. I am starting to see that my repository which 50G is backing up as 48G with hotcopy. I can’t figure it out and my friend google is not helping at all. Does any one have a clue? I agree with Thorsten. Ther

Re: Upgrade Subversion Repository from 1.5 into 1.8

2013-12-17 Thread Thomas Harold
On 12/16/2013 9:03 AM, Krishnamoorthi Gopal wrote: Thanks for your clarification pavel.. If i used existing repositories in Subversion 1.8 then how can i benefit features in new version.. Shall i use commands like "svnadmin Upgrade" to upgrade my existing repos into latest.. As Mark says, "

Re: Tools for projecting growth of repository storage?

2013-12-12 Thread Thomas Harold
On 12/2/2013 7:58 PM, Eric Johnson wrote: Anyone have a suggestion for a tool that projects the growth of repository storage. I've got repos taking over 75% of a disk volume, and I'm curious to project out when I'll need new storage. Obviously, this is approximate, but has anyone got a tool for

Re: Update-Only Checkout Enhancement

2013-12-12 Thread Thomas Harold
On 12/11/2013 2:19 PM, Bob Archer wrote: On 11.12.2013 17:21, Mark Kneisler wrote: I think making the pristine files optional would work for me. Here’s an idea. Instead of having pristine copies of all files, how about adding to the pristine directory only when a file is changed? You k

Re: Update-Only Checkout Enhancement

2013-12-12 Thread Thomas Harold
On 12/10/2013 8:45 PM, Mark Kneisler wrote: I have several environments where I’d like to use a SVN checkout, but where I’d never ever want to make changes to the files or perform a commit. For these environments, I’d only want to perform an update or an update to revision. In cases where you

Re: svn backup

2013-10-07 Thread Thomas Harold
On 10/7/2013 3:37 PM, rvaede wrote: > > > I am confused on how to backup my repositary. Note: Making a raw file-level backup of a SVN repository is not advisable. There may be open files, files that changed while the backup is running, etc. So you will need to use one of the hotcopy / du

Re: Breaking up a monolothic repository

2013-10-04 Thread Thomas Harold
On 10/2/2013 10:36 AM, Ullrich Jans wrote: I'm now facing the same problem. My users want the rebasing, but during the dump/load instead of after the fact (apparently, it causes issues with their environment when they need to go back to an earlier revision to reproduce something). They also want

Re: Push ?

2013-09-16 Thread Thomas Harold
On 9/15/2013 11:32 AM, Dan White wrote: The issue is that the client end of the transaction is in a DMZ A connection from a DMZ to one’s internal network is a very high security risk. What I was hoping for was a way to define a very specific connection from the Subversion server to the DMZ clien

Re: Breaking up a monolothic repository

2013-09-10 Thread Thomas Harold
On 9/10/2013 7:22 AM, Nico Kadel-Garcia wrote: But keeping thousands of empty commits in a project they're not relevant to is confusing and wasteful. The repository and repository URL's for the old project should be preserved, if possible, locked down and read-only, precisely for this kind of ch

Re: Breaking up a monolothic repository

2013-09-10 Thread Thomas Harold
On 9/9/2013 8:49 PM, Trent W. Buck wrote: I'm partway through provisioning the replacement Debian 7 server, which will have subversion 1.6.17dfsg-4+deb7u3 apache22.2.22-13 ...hm, still 1.6. Is it worth me backporting a newer svn? Yes, it's worth installing 1.8.3. http://www.

Re: Error after server upgrade to 1.8.3 - E160052: Revprop caching disabled

2013-09-05 Thread Thomas Harold
On 9/5/2013 6:41 PM, Gordon Moore wrote: Is this a known issue with 1.8.3? Any ideas on what is going on, how I can investigate, or what I might do to correct this? I'd start with: - How are you accessing the SVN repository? http? svn+ssh? svn? - What are the ownership and permissions on the

Re: Planning a SVN upgrade

2013-08-26 Thread Thomas Harold
On 8/23/2013 4:09 PM, Maureen Barger wrote: Has anyone made a jump this large before? Any comments about my upgrade plan? We jumped from 1.5 to 1.8 on our server-side repositories. Our clients were using a mix of 1.6 and 1.7 (most of the "important to us" improvements in SVN 1.6 and 1.7 were

Re: How Big A Dump File Can Be Handled? (svn 1.8 upgrade)

2013-08-22 Thread Thomas Harold
On 8/22/2013 7:11 PM, Geoff Field wrote: 6. Create the repository in svn 1.8. I'm sure there's an "upgrade" command that would do it all in-place. 7. Strip permissions on the repository back down to 700, owned by root:root while we reload the data. While, or before? Step 6 created the rep

Re: How Big A Dump File Can Be Handled? (svn 1.8 upgrade)

2013-08-22 Thread Thomas Harold
On 8/21/2013 7:13 PM, Geoff Field wrote:> I'm keeping the original BDB repositories, with read-only permissions. If I really have the need, I can restart Apache 2 with SVN 1.2.3 and go back to the original repositories. Otherwise, I also have the option of re-running my batch file (modifying it i

Re: server config

2013-08-20 Thread Thomas Harold
On 8/19/2013 6:19 PM, Ben Reser wrote: On 8/19/13 9:07 AM, Scott Frankel wrote: I'm new to SVN server configuration and find myself setting up a CentOS 6.4 server with svn version 1.6.1, following the red-bean book. I'd strongly urge you not to use 1.6.1, see the list of applicable security is

Re: server config

2013-08-20 Thread Thomas Harold
On 8/20/2013 1:19 AM, olli hauer wrote: On 2013-08-20 01:41, Nico Kadel-Garcia wrote: I think he meant "subversion-1.6.11", which is the default version for CentOS 6.4. Check the SELinux settings in /etc/sysconfig/selinux. Set the line to 'SELINUX=permissive' (or disabled) After changing the

Re: server config

2013-08-19 Thread Thomas Harold
On 8/19/2013 12:42 PM, David Chapman wrote: How many repositories do you have? You shouldn't use SVNParentPath if you have only one repository; use SVNPath. I don't know if that is the direct cause of your problem, but you should fix it. I suggest planning for multiple repositories from the

Re: Suggestion to change the name "Subversion"

2013-08-15 Thread Thomas Harold
On 8/12/2013 8:03 PM, Nico Kadel-Garcia wrote: No one else remember the old "Satan" monitoring toolkit, that had an option to change the displayed name and icon to "Santa"? The name "Subversion" has enough positive reputation that changing it, just to avoid NSA style monitoring, seems very desta

Re: hotcopy --incremental auto-upgrade Re: Backup strategy sanity check

2013-08-11 Thread Thomas Harold
On 8/10/2013 6:28 PM, Daniel Shahaf wrote: Daniel Shahaf wrote on Sun, Aug 11, 2013 at 01:25:24 +0300: Thomas Harold wrote on Sat, Aug 10, 2013 at 10:53:43 -0400: With the 'svnadmin hotcopy --incremental' backups, we have to do extra checking in the script (comparing reponame

Re: Backup strategy sanity check

2013-08-10 Thread Thomas Harold
On 7/25/2013 7:30 AM, Stefan Sperling wrote: On Wed, Jul 24, 2013 at 03:22:11PM -0400, Thomas Harold wrote: What we might do once 1.8 server is stable is switch to doing the new "incremental" style hotcopy on Mon-Sat evenings and do a full hotcopy on Sun. In Subversion 1.8, a full

svnadmin verify performance - CPU bottleneck

2013-08-06 Thread Thomas Harold
On our setup (10k RPM SAS RAID-10 across 6 spindles, AMD Opteron 4180 2.6GHz), we're finding that "svnadmin verify" is CPU-bound and only uses a single CPU core. Is it possible that "svnadmin verify" could be multi-process in the future to spread the work over more cores? Or is that technical

Re: svn 1.8 migration - directory deltification and revprop packing

2013-08-05 Thread Thomas Harold
On 8/2/2013 3:21 PM, Thomas Harold wrote: Our migration process: > > 0. svnadmin verify oldreponame 1. svnadmin dump oldreponame 2. svnadmin create newreponame 3. Modify db/fsfs.conf [rep-sharing] enable-rep-sharing = true # defaults to true in 1.8 [deltification] enable-dir-deltifi

Re: SVN FSFS format value for 1.8?

2013-08-04 Thread Thomas Harold
On 8/4/2013 6:30 PM, Ryan Schmidt wrote: Check the file /backup/svndump/test3/db/format. # cat /backup/svndump/test3/db/format 6 layout sharded 1000 Okay, so I was looking at the wrong thing. That still raises the question (in my mind) of why the two values are different on a freshly create

SVN FSFS format value for 1.8?

2013-08-04 Thread Thomas Harold
According to the release notes: http://subversion.apache.org/docs/release-notes/1.8.html#fsfs-enhancements We should have seen a bump in the FSFS format number to '6' for 1.8. But when I'm looking at the 'format' file inside the FSFS repository directory on the server, I'm seeing '5'. # svnad

Re: svn 1.8 migration - directory deltification and revprop packing

2013-08-02 Thread Thomas Harold
Fuhrmann just gave me to your questions. On 06/10/2013 03:05 PM, Thomas Harold wrote: a) Why are directory/property deltifications turned off by default? Stefan's jovial first answer was, "Because I'm a chicken." :-) Fortunately, he didn't stop there. He explain

Re: SVN performance -URGENT

2013-08-01 Thread Thomas Harold
On 8/1/2013 10:52 AM, Somashekarappa, Anup (CWM-NR) wrote: Bandwidth is 35.4 MBytes/secfrom my system(London) to server(New york) when i checked with iperf tool. We are using LDAP AuthzLDAPAuthoritative off AuthType Basic AuthBasicProvider ldap AuthName "Windows Credentials" As per message afte

Re: problem building 1.8.1 (sqlite-amalgamation)

2013-07-29 Thread Thomas Harold
From my notes back when I compiled 1.8.0, I had to download the sqlite-amalgamation ZIP file and add it into the source directory. $ cd /usr/local/src/subversion-1.8.0/ $ wget http://www.sqlite.org/sqlite-amalgamation-3071501.zip $ unzip sqlite-amalgamation-3071501.zip $ mv sqlite-amalgamation-3

Re: Backup strategy sanity check

2013-07-25 Thread Thomas Harold
On 7/24/2013 4:21 PM, Les Mikesell wrote: Is that better than using svnsync from a remote server plus some normal file backup approach for the conf/hooks directories? Not sure, I have not tried out svnsync. We also don't use post-commit hooks (yet). I am under the impression that hotcopy do

Re: Backup strategy sanity check

2013-07-24 Thread Thomas Harold
On 7/24/2013 2:59 PM, Andy Levy wrote: I'm planning my upgrade to SVN 1.8 & to go along with it, setting up a new backup process. Here's what I'm thinking: * Monday overnight, take a full backup (svnadmin hotcopy, then compress the result for storage) * Tuesday through Sunday overnights, increme

Re: How to prune old versions of an artefact?

2013-07-15 Thread Thomas Harold
On 7/15/2013 5:49 AM, Cooke, Mark wrote: For your uses, perhaps you could spin this artifact off into it's own repository (use "external"s from your main repo if required) and then you can archive that repo off whenever necessary? Sound advice for any sort of large artifact, or in the case wh

Re: Expected performance (svn+ssh)

2013-07-08 Thread Thomas Harold
On 7/8/2013 2:18 PM, Naumenko, Roman wrote: That box has more than enough CPUs (forty), cores are barely utilized. How is the access over ssh can be configured? I thought it's only http(s) or svn proto. http://svnbook.red-bean.com/en/1.7/svn.basic.in-action.html#svn.advanced.reposurls http:/

Re: Expected performance

2013-07-08 Thread Thomas Harold
On 7/8/2013 11:32 AM, Naumenko, Roman wrote: Hello, How fast would you expect svn checkout to be from a server like one below? Considering eveyrthing on the server functioning as expected. Our bottleneck is usually the CPU, but we're doing svn+ssh access. So I lean towards a few less but mo

Re: WebDAV support in future versions of SVN server?

2013-06-26 Thread Thomas Harold
On 6/26/2013 8:15 AM, Nico Kadel-Garcia wrote: On Tue, Jun 25, 2013 at 9:55 AM, Thomas Harold wrote: Is it still a long-term goal to maintain the ability to mount a SVN repository as a WebDAV folder? Out of curiosity, why do you feel the need for this? Working in a remote copy isn't e

WebDAV support in future versions of SVN server?

2013-06-25 Thread Thomas Harold
Is it still a long-term goal to maintain the ability to mount a SVN repository as a WebDAV folder? Based on this message from 2009: http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=1180976 It sounds like the SVN server is still planning on supporting WebDAV clients, bu

Re: Advice for changing filename case in SVN on case insensitive system

2013-06-21 Thread Thomas Harold
On 6/20/2013 6:56 PM, Geoff Hoffman wrote: deleting the file from Subversion, then adding the copy with the correct case. Question: Doesn't that blow away revision history? If I didn't care about revision history I would just start over with a fresh repo. If you use "svn mv" to do the change,

Re: Subversion Exception! line 647: assertion failed (peg_revnum != SVN_INVALID_REVNUM)

2013-06-20 Thread Thomas Harold
On 6/20/2013 11:55 PM, Sandeepan Kundu wrote: Tried going back to 1.7, but it is telling project is in higher version :(( how to use now, my development is getting affected!!! I suggest renaming your old (upgraded to 1.8) working copy out of the way, doing a fresh checkout using 1.7 into a f

Re: Crash in 1.8.0 (db/format layout linear)

2013-06-19 Thread Thomas Harold
On 6/19/2013 5:30 AM, Daniel Shahaf wrote: Does %REPOS_DIR%\db\format contain "4 layout linear"? If so, that's a known issue that will be fixed in 1.8.1. Out of curiosity, which versions of SVN produced a "layout linear"? I'm guessing that was from back in the SVN 1.4 days (repo format #2)

Re: Apache Subversion 1.8.0 Released (An appropriate version of serf could not be found)

2013-06-18 Thread Thomas Harold
And the last hurdle I had to jump over to get svn 1.8.0 to compile on my CentOS 6 box. When running ./configure, I had the following message show up: checking was serf enabled... no An appropriate version of serf could not be found, so libsvn_ra_serf will not be built. If you want

Re: Apache Subversion 1.8.0 Released (Can't locate ExtUtils/Embed.pm in @INC)

2013-06-18 Thread Thomas Harold
On 6/18/2013 8:06 AM, Branko Čibej wrote: We're happy to announce the release of Apache Subversion 1.8.0. Another little thing that I found when compiling 1.8 on CentOS 6 is that we now need to install the perl ExtUtils packages. Can't locate ExtUtils/Embed.pm in @INC (@INC contains: /usr/l

Re: Apache Subversion 1.8.0 Released (Apache module support via DSO through APXS)

2013-06-18 Thread Thomas Harold
On 6/18/2013 8:06 AM, Branko Čibej wrote: We're happy to announce the release of Apache Subversion 1.8.0. While running ./configure (on CentOS 6), I see the following in the output: checking for Apache module support via DSO through APXS... no ==

Re: svn 1.8 migration - svnadmin hotcopy

2013-06-11 Thread Thomas Harold
On 6/11/2013 10:20 AM, Stefan Sperling wrote: On Tue, Jun 11, 2013 at 10:13:15AM -0400, Thomas Harold wrote: Right now, the size of our dumpfile directory is 207G, while the hotcopy is only 104G. So the size savings could be big for us. The hotcopy backup is still our preferred solution, with

Re: svn 1.8 migration - directory deltification and revprop packing

2013-06-11 Thread Thomas Harold
On 6/11/2013 8:52 AM, C. Michael Pilato wrote: One advantage of being in a room full of Subversion developers, specifically the guy that implemented all this stuff, is that I can ask him directly about how to respond to this mail. :-) Hopefully I will accurately represent the answers Stefan Fuh

svn 1.8 migration - directory deltification and revprop packing

2013-06-10 Thread Thomas Harold
Questions about the 1.8 upgrade path: #1 - In reading the release notes for 1.8, I'm interested in the directory/property storage reduction as described in: http://subversion.apache.org/docs/release-notes/1.8.html#fsfs-enhancements Directory and property storage reduction For each changed n

SVN externals - using a GUID style instead of a path?

2011-07-29 Thread Thomas Harold
http://subversion.apache.org/docs/release-notes/1.5.html#externals The relative URLs being allowed in svn:externals was a huge step forward. But it still relies on the source path not ever changing. For example: /repos/zag foo/bar1 Which is fine as long as "zag" never changes its name. Wha

Re: AW: Web site: checkout or export?

2011-07-29 Thread Thomas Harold
On 7/27/2011 8:57 AM, Markus Schaber wrote: Hi, Andy, Von: Andy Canfield [mailto:andy.canfi...@pimco.mobi] - Using 'svn checkout', the working web site will have the subversion control files in the .svn subdirectory, which might be a security hole. You could use some pattern based access con

Re: Subversion access control / Linux users etc.

2011-07-21 Thread Thomas Harold
The issues with passwords is why we ended up going with SSH public-key authentication. Load the SSH key into the SSH agent, unlock it with the passphrase, then don't worry about it again until we reset the SSH agent at logout. Less prompts, happier users. (Plus it makes it harder to get into

Re: Subversion: existing users

2011-07-20 Thread Thomas Harold
On 7/17/2011 2:07 AM, Andy Canfield wrote: The most obvious authorization scheme is that of the host server; if there is a user named "andy" on that server with a password "jackel" then I would like to simply be able to talk to the subversion server as user named "andy" password "jackel". This is

Re: Move to a new repo and keep the history, Part 2

2011-07-14 Thread Thomas Harold
On 7/14/2011 12:29 PM, K F wrote: Recap – I would like to move some directories from one repository to another while keeping the history. I went through this a few months ago (and maybe this will help). We were using a big monolithic repository for all of our jobs. Our repository was arrang

Re: Problem Loading Huge Repository

2011-06-17 Thread Thomas Harold
On 6/17/2011 10:54 AM, Daniel Shahaf wrote: Thomas Harold wrote on Fri, Jun 17, 2011 at 10:31:43 -0400: And if you have a choice of file systems for the repository to be stored on, make sure that it's something which can deal with a few hundred thousand tiny files. On Linux, I'd sug

Re: Problem Loading Huge Repository

2011-06-17 Thread Thomas Harold
On 6/16/2011 7:05 PM, Bruno Antunes wrote: Do you know any faster way to load the dump file or to filter out some projects/revisions so I can speed up the process? Are you CPU-bound? Or are you limited by disk speed? If you're limited by disk access times, make sure that the source file that

Re: Subversion 1.6.17 Released

2011-06-02 Thread Thomas Harold
On 6/1/2011 7:27 PM, Daniel Shahaf wrote: Be advised: the 1.6.17 tag [1] in our repository does not match the tarballs at the time of this writing. Until we fix this, please use the tarballs or zip archives, and avoid installing 1.6.17 from the tag. Daniel [1] https://svn.apache.org/repos/asf

Re: How do I share files?

2010-01-05 Thread Thomas Harold
On 1/5/2010 10:05 AM, Andy Levy wrote: As of SVN 1.6, file-level externals are supported. This is very close to VSS's sharing IIRC (been a few years since I've dealt with VSS). http://subversion.tigris.org/svn_1.6_releasenotes.html#externals http://svnbook.red-bean.com/nightly/en/svn.advanced.e

Re: How do I share files?

2010-01-05 Thread Thomas Harold
On 1/4/2010 7:20 PM, Rolf Marsh wrote: Hello... I have two projects in Subversion. I am trying, in Visual Studio 2008 Pro, to share some of the .cs files in Project 'A' with a new project ('B') I am writing. I know how to share .cs files from within VS, but how to I get them out of the repositor