Re: [O] Largest org file you have + performance
Hi, SW sabrewo...@gmail.com writes: Is this performance overhead just a result of poorly-scalable overlays, rather than an inherent shortcoming of Emacs and/or org-mode? I would say this is a combination of the implementation overlays and the use of overlays in outline.el. Perhaps we should dive into outline.el and see how we can improve things from there. (We tend to forget that Org is just a derived mode from outline.el!) -- Bastien
Re: [O] Largest org file you have + performance
I'm not familiar enough with Emacs to comment about the performance of overlays, etc., but I'm surprised that processing *text* can be so CPU intensive. These days we have games running with millions of pixels and shading or whatever (some use the GPU of course), and browsers with fancy Flash animation and dozens of tabs open and spreadsheets with thousands of cells and word processor documents with hundreds of formatted pages on dual cores and quad cores with GB of RAM. Is this performance overhead just a result of poorly-scalable overlays, rather than an inherent shortcoming of Emacs and/or org-mode?
Re: [O] Largest org file you have + performance
Hi Matt, Matt Lundin m...@imapmail.org writes: There was brief talk on emacs-dev of rewriting text-properties so that outline-mode could use them instead of overlays, but I do not believe the proposal was pursued further: http://permalink.gmane.org/gmane.emacs.devel/131304 Quite interesting, thanks for the link. I would love to see some optimization in this area. -- Bastien
Re: [O] Largest org file you have + performance
jiangzuo...@gmail.com jiangzuo...@gmail.com writes: My largest org file is QuanSongCi.org, contains ci poetry of Song dynasty, about 6MB size. Editing in emacs is very slow, save needs to wait about minutes. convert to html needs to wait about minutes, too. So, sometimes, sed like tools is preferred to do editing and converting. Thanks for these details. I can report similar experiences with large files. As far as I understand, large org-mode buffers are slow because there are many overlays, which (unlike text properties), don't scale well: (info (elisp) Overlays) This is right now an inescapable limitation of org-mode, since outline-mode relies on overlays. There was brief talk on emacs-dev of rewriting text-properties so that outline-mode could use them instead of overlays, but I do not believe the proposal was pursued further: http://permalink.gmane.org/gmane.emacs.devel/131304 Best, Matt
Re: [O] Largest org file you have + performance
My largest org file is an org-drill file of almost 1 MB size, containing about 32000 lines (most of them are entry properties) and 2000 org-drill entries. It's well useable but tag and property editing is better to be done by hand instead of using org commands and I have to use some folding trick to prevent org-drill performance problems.
Re: [O] Largest org file you have + performance
My largest org file is QuanSongCi.org, contains ci poetry of Song dynasty, about 6MB size. Editing in emacs is very slow, save needs to wait about minutes. convert to html needs to wait about minutes, too. So, sometimes, sed like tools is preferred to do editing and converting. Changsheng Jiang On Fri, Aug 5, 2011 at 04:18, Milan Zamazal p...@zamazal.org wrote: My largest org file is an org-drill file of almost 1 MB size, containing about 32000 lines (most of them are entry properties) and 2000 org-drill entries. It's well useable but tag and property editing is better to be done by hand instead of using org commands and I have to use some folding trick to prevent org-drill performance problems.
[O] Largest org file you have + performance
Hey list, What's the largest orgmode file you have, and what's the performance you get while manipulating/navigating it? Mine is a 5k lines file called reference.org, and I basically keep all kind of notes and attachments there. It's a bit slow to navigate on my Emacs 240.50.1, orgmode 7.4, although still usable. I'm just afraid that it will keep getting slower with time at the point of being unusable inside emacs+orgmode. I'm curious if there are users with larger orgmode files and what their experience is, and open to suggestions on how to improve performance. Cheers, Marcelo.
Re: [O] Largest org file you have + performance
Hi Marcelo, On Mon, Aug 1, 2011 at 6:35 PM, Marcelo de Moraes Serpa celose...@gmail.com wrote: What's the largest orgmode file you have, and what's the performance you get while manipulating/navigating it? Mine is a 5k lines file called reference.org, and I basically keep all kind of notes and attachments there. My largest agenda file used to be ~2k lines. Now I have archived many things, so my 2nd largest agenda file is ~1.5k lines. I don't see any performance problems. All agenda commands are almost instantaneous. Hope this helps. -- Suvayu Open source is the future. It sets us free.
Re: [O] Largest org file you have + performance
What platform? OSX? On Mon, Aug 1, 2011 at 11:54 AM, suvayu ali fatkasuvayu+li...@gmail.comwrote: Hi Marcelo, On Mon, Aug 1, 2011 at 6:35 PM, Marcelo de Moraes Serpa celose...@gmail.com wrote: What's the largest orgmode file you have, and what's the performance you get while manipulating/navigating it? Mine is a 5k lines file called reference.org, and I basically keep all kind of notes and attachments there. My largest agenda file used to be ~2k lines. Now I have archived many things, so my 2nd largest agenda file is ~1.5k lines. I don't see any performance problems. All agenda commands are almost instantaneous. Hope this helps. -- Suvayu Open source is the future. It sets us free.
Re: [O] Largest org file you have + performance
Marcelo de Moraes Serpa celose...@gmail.com writes: Hey list, What's the largest orgmode file you have, and what's the performance you get while manipulating/navigating it? Mine is a 5k lines file called reference.org, and I basically keep all kind of notes and attachments there. It's a bit slow to navigate on my Emacs 240.50.1, orgmode 7.4, although still usable. I'm just afraid that it will keep getting slower with time at the point of being unusable inside emacs+orgmode. I'm curious if there are users with larger orgmode files and what their experience is, and open to suggestions on how to improve performance. emacs-bzr, org-7.7 The largest file I have is 7.2M. Some 6300 entries, 137k lines. Agenda commands are slow, of course, but otherwise the performance is acceptable. Anything that involves completion is quite slow. Opening ID links is also slower than I would like. Anything that works on the whole buffer can take a long time (cycling from OVERVIEW to CONTENTS takes more than a minute), so try to avoid that. (I keep old notes in that file, so mostly I search or link to entries.) If you are using the current bzr version of emacs, make sure to set `bidi-display-reordering' to nil. Cheers, Marcelo. -- Florian Beck
Re: [O] Largest org file you have + performance
On Mon, Aug 01 2011, Marcelo de Moraes Serpa wrote: Hey list, What's the largest orgmode file you have, and what's the performance you get while manipulating/navigating it? Mine is a 5k lines file called reference.org, and I basically keep all kind of notes and attachments there. It's a bit slow to navigate on my Emacs 240.50.1, orgmode 7.4, although still usable. I'm just afraid that it will keep getting slower with time at the point of being unusable inside emacs+orgmode. I'm curious if there are users with larger orgmode files and what their experience is, and open to suggestions on how to improve performance. My largest file is 32k lines. It's a novel translation (so essentially two very long novels in one file), and there's no perceptible lag in navigation/folding. BUT! It's almost all plain text, very little fontification besides the headlines, and I understand that fontification is one of the major causes of lag. So, dunno if that's helpful, but it's another data point. Eric (Using the Ubuntu version of Emacs, 23.3 I believe, and yesterday's org-mode)
Re: [O] Largest org file you have + performance
On Mon, Aug 1, 2011 at 7:06 PM, Marcelo de Moraes Serpa celose...@gmail.com wrote: What platform? OSX? Linux x86_64 I also have other files which are larger (~3k lines) but they are not in the agenda files. These other files have lots of source code blocks and are meant for exporting to pdf via latex. -- Suvayu Open source is the future. It sets us free.
