Re: [matplotlib-devel] git-svn matplotlib mirror
On Wed, Jan 26, 2011 at 6:35 AM, Jae-Joon Lee wrote: > On Wed, Jan 26, 2011 at 7:28 PM, Pauli Virtanen wrote: >> The complete magic stanza is: >> >> git reflog expire --expire=0 --all >> git prune >> git repack -f -a -d >> git gc --prune=0 > > Wonderful! > With this, I get about 40 MB! How did you manage to do that? Using these steps (which have been added to the postprocess.sh script): --- run git filter-branch --index-filter \ 'git rm --cached --ignore-unmatch release/osx/matplotlib-0.98.5.tar.gz' \ -- 750059aa09340^.. rm -Rf refs/original rm -Rf logs run git reflog expire --expire=0 --all run git prune run git repack -f -a -d --depth=250 --window=250 run git gc --prune=0 --- I only get down to 65 MB, at which point "git fsck --unreachable HEAD" indicates a slew of unreachable blobs, trees, and commits, one of which is: 3b8b6c010f8ce59afac1e811b1bbc3efc21b770a release/osx/matplotlib-0.98.5.tar.gz yet "git log --pretty=oneline -- release/osx/matplotlib-0.98.5.tar.gz" shows it is no longer associated with any commits. Rerunning the "reflog/prune/repack/gc" block doesn't seem to help at this point. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
Re: [matplotlib-devel] git-svn matplotlib mirror
On Tue, Jan 25, 2011 at 11:37 PM, Jae-Joon Lee wrote: > And some of the biggest blobs are associated with svg and pdf files. > It seems possible to remove these files (if needed) from the > repository using "git-filter-branch" to further reduce the size, but > I'm not sure if we need that. Some of this appears to be the result of some svn tags referencing the contents of trunk/htdocs. It looks like I can cut 25 MB off the size of the repo. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
Re: [matplotlib-devel] git-svn matplotlib mirror
On Thu, Jan 27, 2011 at 10:26 AM, Darren Dale wrote: > On Tue, Jan 25, 2011 at 11:37 PM, Jae-Joon Lee wrote: >> And some of the biggest blobs are associated with svg and pdf files. >> It seems possible to remove these files (if needed) from the >> repository using "git-filter-branch" to further reduce the size, but >> I'm not sure if we need that. > > Some of this appears to be the result of some svn tags referencing the > contents of trunk/htdocs. It looks like I can cut 25 MB off the size > of the repo. That feels pretty good to me, considering that the compressed release tarball is 13MB. If we can get the whole history for twice that, then you must be getting pretty close to the limit. JDH -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
Re: [matplotlib-devel] git-svn matplotlib mirror
On Thu, Jan 27, 2011 at 12:00 PM, John Hunter wrote: > On Thu, Jan 27, 2011 at 10:26 AM, Darren Dale wrote: >> On Tue, Jan 25, 2011 at 11:37 PM, Jae-Joon Lee wrote: >>> And some of the biggest blobs are associated with svg and pdf files. >>> It seems possible to remove these files (if needed) from the >>> repository using "git-filter-branch" to further reduce the size, but >>> I'm not sure if we need that. >> >> Some of this appears to be the result of some svn tags referencing the >> contents of trunk/htdocs. It looks like I can cut 25 MB off the size >> of the repo. > > That feels pretty good to me, considering that the compressed release > tarball is 13MB. If we can get the whole history for twice that, then > you must be getting pretty close to the limit. Me too. I just posted the latest version of the repository to github.com/darrendale/matplotlib.git . Its ~42MB, but it has a bunch of unreachable objects. As soon as we figure out how to git rid of them, I think we will be ready to freeze the svn repo and wrap this up. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
Re: [matplotlib-devel] git-svn matplotlib mirror
Thu, 27 Jan 2011 12:39:48 -0500, Darren Dale wrote: [clip] > Me too. I just posted the latest version of the repository to > github.com/darrendale/matplotlib.git . Its ~42MB, but it has a bunch of > unreachable objects. As soon as we figure out how to git rid of them, I > think we will be ready to freeze the svn repo and wrap this up. Unreachable from where? How do you know there are unreachable objects? Note that the snippet git fsck --unreachable HEAD $(git for-each-ref --format="%(objectname)" refs/heads) only checks for objects unreachable from branches (by definition, stuff under refs/heads). However, there's also other stuff under refs/: tags and hidden branches. Especially the postprocess.sh script hides some branches. To see all that is there, check the output from git for-each-ref -- Pauli Virtanen -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
Re: [matplotlib-devel] git-svn matplotlib mirror
to, 2011-01-27 kello 13:44 -0500, Darren Dale kirjoitti: [clip] > Still, Even after removing the the largest blob in the repo with > > run git filter-branch --index-filter \ >'git rm --cached --ignore-unmatch release/osx/matplotlib-0.98.5.tar.gz' \ >-- 750059aa09340^.. > > the blob still exists, but is not associated with a commit according to > > git log --pretty=oneline -- release/osx/matplotlib-0.98.5.tar.gz > > That blob accounts for 1/4 of the total size of the repo. It would be > nice to get rid of it, if possible. I think "git log" will show you only the current branch by default. Do git log --pretty=oneline --all -- release/osx/matplotlib-0.98.5.tar.gz to get all branches, and do for branch in `git for-each-ref --format='%(refname)'`; do S=`git log --pretty=oneline $branch -- release/osx/matplotlib-0.98.5.tar.gz`; if test -n "$S"; then echo "$branch"; echo "$S"; fi; done to see which refs have the commits containing it. Similarly, git-filter-branch rewrites only the current branch unless told otherwise. To filter everything, it's best to do git filter-branch --index-filter \ 'git rm --cached --ignore-unmatch release/osx/matplotlib-0.98.5.tar.gz' \ -- `git for-each-ref --format="750059aa09340^..%(refname)"` Note that all branches and tags should be filtered in the same way: since rewriting changes the hashes of all following commits, you end up with incompatible histories otherwise. After that, I get down to 34 MB. -- Pauli Virtanen -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
Re: [matplotlib-devel] git-svn matplotlib mirror
On Thu, Jan 27, 2011 at 12:57 PM, Pauli Virtanen wrote: > Thu, 27 Jan 2011 12:39:48 -0500, Darren Dale wrote: > [clip] >> Me too. I just posted the latest version of the repository to >> github.com/darrendale/matplotlib.git . Its ~42MB, but it has a bunch of >> unreachable objects. As soon as we figure out how to git rid of them, I >> think we will be ready to freeze the svn repo and wrap this up. > > Unreachable from where? How do you know there are unreachable > objects? > > Note that the snippet > > git fsck --unreachable HEAD $(git for-each-ref --format="%(objectname)" > refs/heads) > > only checks for objects unreachable from branches (by definition, > stuff under refs/heads). However, there's also other stuff under refs/: > tags and hidden branches. Especially the postprocess.sh script hides > some branches. > > To see all that is there, check the output from > > git for-each-ref Oh, I didn't understand what I was doing with the git fsck command. Still, Even after removing the the largest blob in the repo with run git filter-branch --index-filter \ 'git rm --cached --ignore-unmatch release/osx/matplotlib-0.98.5.tar.gz' \ -- 750059aa09340^.. the blob still exists, but is not associated with a commit according to git log --pretty=oneline -- release/osx/matplotlib-0.98.5.tar.gz That blob accounts for 1/4 of the total size of the repo. It would be nice to get rid of it, if possible. Darren -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
Re: [matplotlib-devel] git-svn matplotlib mirror
On Thu, Jan 27, 2011 at 4:18 PM, Pauli Virtanen wrote: > to, 2011-01-27 kello 13:44 -0500, Darren Dale kirjoitti: > [clip] >> Still, Even after removing the the largest blob in the repo with >> >> run git filter-branch --index-filter \ >> 'git rm --cached --ignore-unmatch release/osx/matplotlib-0.98.5.tar.gz' \ >> -- 750059aa09340^.. >> >> the blob still exists, but is not associated with a commit according to >> >> git log --pretty=oneline -- release/osx/matplotlib-0.98.5.tar.gz >> >> That blob accounts for 1/4 of the total size of the repo. It would be >> nice to get rid of it, if possible. > > I think "git log" will show you only the current branch by default. Do > > git log --pretty=oneline --all -- release/osx/matplotlib-0.98.5.tar.gz > > to get all branches, and do > > for branch in `git for-each-ref --format='%(refname)'`; do S=`git log > --pretty=oneline $branch -- release/osx/matplotlib-0.98.5.tar.gz`; if test -n > "$S"; then echo "$branch"; echo "$S"; fi; done > > to see which refs have the commits containing it. > > Similarly, git-filter-branch rewrites only the current branch unless > told otherwise. To filter everything, it's best to do > > git filter-branch --index-filter \ > 'git rm --cached --ignore-unmatch > release/osx/matplotlib-0.98.5.tar.gz' \ > -- `git for-each-ref --format="750059aa09340^..%(refname)"` > > Note that all branches and tags should be filtered in the same way: > since rewriting changes the hashes of all following commits, you end up > with incompatible histories otherwise. > > After that, I get down to 34 MB. You are brilliant. If you send me your address off-list, I'll send you a bottle of scotch, or tequila, or a doughnut, or whatever you want. -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
[matplotlib-devel] MacOS X backend possible leak
Paris (U.E.), le 28/01/2011
Bonsoir
I am trying to code a specialized data visualization technique
(quite old and mostly forgotten), which I will release under the Python
Software License. I want to customize the navigation bar read-out so as to give
more relevant information than cartesian coordinates. I am not quite there yet,
and may be missing a few things, but I have run into a problem.
If I try to output a specific string to the navigation bar,
using
fig.canvas.toolbar.set_message("Toto")
then sure enough the correct message appears in the right place. However, using
the MacOS X backend, I get the leak message reproduced at the end of this
message. I would much prefer to code in a backend-agnostic manner. Could
someone please point me in the right direction?
Merci
Hubert Holin
8>< === ><8
2011-01-27 15:22:27.892 Python[747:10b] *** _NSAutoreleaseNoPool(): Object
0x10ad544c0 of class NSCFString autoreleased with no pool in place - just
leaking
Stack: (0x7fff82cc8d24 0x7fff82ba348c 0x103193750 0x1dd78 0x1000e4910
0x100033df0 0x1dd78 0x1000eb2f0 0x1000ed840 0x1000eb098 0x1000eaffc
0x1000eaffc 0x1000ed840 0x1000e8300 0x1000ed840 0x1000eb098 0x1000ed840
0x1000eb098 0x1000eaffc 0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098
0x1000ed840 0x1000eb098 0x1000ed840 0x1000ed950 0x1001188bc 0x100118d60
0x100133654 0x10f54 0x3)
2011-01-27 15:22:27.895 Python[747:10b] *** _NSAutoreleaseNoPool(): Object
0x10ad89aa0 of class NSSelectionArray autoreleased with no pool in place - just
leaking
Stack: (0x7fff82cc8d24 0x7fff82ba348c 0x7fff81618b2c 0x7fff81618abc
0x7fff815499b4 0x7fff815496b8 0x7fff81632598 0x7fff8152a814 0x7fff8152a2d8
0x103193770 0x1dd78 0x1000e4910 0x100033df0 0x1dd78 0x1000eb2f0
0x1000ed840 0x1000eb098 0x1000eaffc 0x1000eaffc 0x1000ed840 0x1000e8300
0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000eaffc 0x1000ed840
0x1000eb098 0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000ed840
0x1000ed950 0x1001188bc 0x100118d60 0x100133654 0x10f54 0x3)
2011-01-27 15:22:27.897 Python[747:10b] *** _NSAutoreleaseNoPool(): Object
0x10ad70ad0 of class NSSelectionArray autoreleased with no pool in place - just
leaking
Stack: (0x7fff82cc8d24 0x7fff82ba348c 0x7fff8161a1e0 0x7fff81618e64
0x7fff81618abc 0x7fff815499b4 0x7fff815496b8 0x7fff81632598 0x7fff8152a814
0x7fff8152a2d8 0x103193770 0x1dd78 0x1000e4910 0x100033df0 0x1dd78
0x1000eb2f0 0x1000ed840 0x1000eb098 0x1000eaffc 0x1000eaffc 0x1000ed840
0x1000e8300 0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000eaffc
0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098
0x1000ed840 0x1000ed950 0x1001188bc 0x100118d60 0x100133654 0x10f54
0x3)
2011-01-27 15:22:27.899 Python[747:10b] *** _NSAutoreleaseNoPool(): Object
0x1025f9350 of class NSSelectionArray autoreleased with no pool in place - just
leaking
Stack: (0x7fff82cc8d24 0x7fff82ba348c 0x7fff8161ad88 0x7fff816192f4
0x7fff81618abc 0x7fff815499b4 0x7fff815496b8 0x7fff81632598 0x7fff8152a814
0x7fff8152a2d8 0x103193770 0x1dd78 0x1000e4910 0x100033df0 0x1dd78
0x1000eb2f0 0x1000ed840 0x1000eb098 0x1000eaffc 0x1000eaffc 0x1000ed840
0x1000e8300 0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000eaffc
0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098
0x1000ed840 0x1000ed950 0x1001188bc 0x100118d60 0x100133654 0x10f54
0x3)
2011-01-27 15:22:27.901 Python[747:10b] *** _NSAutoreleaseNoPool(): Object
0x10ad6d480 of class NSAttributeDictionaryEnumerator autoreleased with no pool
in place - just leaking
Stack: (0x7fff82cc8d24 0x7fff82ba348c 0x7fff83041f08 0x7fff83042100
0x7fff83044bf0 0x7fff830449a8 0x7fff81619a58 0x7fff81618abc 0x7fff815499b4
0x7fff815496b8 0x7fff81632598 0x7fff8152a814 0x7fff8152a2d8 0x103193770
0x1dd78 0x1000e4910 0x100033df0 0x1dd78 0x1000eb2f0 0x1000ed840
0x1000eb098 0x1000eaffc 0x1000eaffc 0x1000ed840 0x1000e8300 0x1000ed840
0x1000eb098 0x1000ed840 0x1000eb098 0x1000eaffc 0x1000ed840 0x1000eb098
0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000ed840 0x1000ed950
0x1001188bc 0x100118d60 0x100133654 0x10f54 0x3)
2011-01-27 15:22:27.903 Python[747:10b] *** _NSAutoreleaseNoPool(): Object
0x10ad8a8f0 of class NSCFDictionary autoreleased with no pool in place - just
leaking
Stack: (0x7fff82cc8d24 0x7fff82ba348c 0x7fff81619a58 0x7fff81618abc
0x7fff815499b4 0x7fff815496b8 0x7fff81632598 0x7fff8152a814 0x7fff8152a2d8
0x103193770 0x1dd78 0x1000e4910 0x100033df0 0x1dd78 0x1000eb2f0
0x1000ed840 0x1000eb098 0x1000eaffc 0x1000eaffc 0x1000ed840 0x1000e8300
0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000eaffc 0x1000ed840
0x1000eb098 0x1000ed840 0x1000eb098 0x1000ed840 0x1000eb098 0x1000ed840
0x1000ed950 0x1001188bc 0x100118d60 0x100133654 0x10f54 0x30
[matplotlib-devel] git migration this weekend
Hi Folks, I'm planning on freezing the sourceforge svn repository Friday evening at 8:00 (NY time), and moving the git repository to its new home on Saturday morning. If you have concerns, please speak up. Darren -- Special Offer-- Download ArcSight Logger for FREE (a $49 USD value)! Finally, a world-class log management solution at an even better price-free! Download using promo code Free_Logger_4_Dev2Dev. Offer expires February 28th, so secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsight-sfd2d ___ Matplotlib-devel mailing list Matplotlib-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/matplotlib-devel
