Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Carsten Dominik wrote: > Nick, > > do you have time to do the following exercise? > > Remove the entries in org-export-latex-default-packages-alist > one by one to see which packages are the worst offenders? > > That would be a great help. > Carsten, hyperref is the culprit: without it, the time for org-export-as-html drop from about 9-9.5s to about 3.8s. I also tried a couple of combinations (omit hyperref and inputenc, hyperref and inputenc and \tolerance) but the difference there is in the noise. | Package omitted| Time for org-export-as-html | |+-| | none (before) | 13.49 | | amssymb|9.13 | | latexsym |9.33 | | wasysym|9.32 | | marvosym |9.32 | | textcomp |9.25 | | t1enc |9.43 | | soul |9.30 | | wrapfig|9.48 | | float |9.65 | | longtable |9.53 | | graphicx |9.45 | | fixltx2e |9.45 | | hyperref |3.84 | | fontenc|9.59 | | inputenc |9.08 | | \tolerance |9.07 | | none (after) |9.68 | | none (after - 2nd) |9.77 | The first "none" entry probably takes longer because of cold caches. The "none" entries at the end of the table are more typical (and also give an idea of typical variances). I repeated the no-hyperref measurement a few times just to make sure: it always was around 3.8s. The rest of the times are single-shot. HTH, Nick ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
On Apr 26, 2010, at 6:46 PM, Nick Dokos wrote: Carsten Dominik wrote: Nick, do you have time to do the following exercise? Remove the entries in org-export-latex-default-packages-alist one by one to see which packages are the worst offenders? That would be a great help. - Carsten I can't do it immediately, but I'll try to do it later on tonight. Of course not immediately. Any time would be a great help. Thanks! Nick - Carsten ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Carsten Dominik wrote: > Nick, > > do you have time to do the following exercise? > > Remove the entries in org-export-latex-default-packages-alist > one by one to see which packages are the worst offenders? > > That would be a great help. > > - Carsten > I can't do it immediately, but I'll try to do it later on tonight. Nick ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Nick, do you have time to do the following exercise? Remove the entries in org-export-latex-default-packages-alist one by one to see which packages are the worst offenders? That would be a great help. - Carsten On Apr 19, 2010, at 8:02 AM, Nick Dokos wrote: Nick Dokos wrote: ... The complete profiling results are attached. I also did an ls -lR to get some sizes after Lucas's mail above, but I have not looked into that yet - nevertheless, the sizes are also in the results file. The results file was incomplete: I forgot to save the file before sending it out - sorry about that. The complete results are attached here. Nick * Org-mode version 6.35trans (release_6.35i) ** profile org-export 1 10.622031 10.622031 org-export-as-html 1 9.529249 9.529249 org-export-preprocess-string 1 9.510265 9.510265 org-export-html-preprocess 1 9.502661 9.502661 org-format-latex 1 9.502494 9.502494 org-create-formula-image 5 9.479597 1.8959194 org-mode 1 0.004826 0.004826 org-export-push-to-kill-ring 1 0.003082 0.003082 org-kill-new 1 0.001904 0.001904 org-fit-window-to-buffer 1 0.001263 0.001263 org-html-expand 13 0.001239 9.530...e-05 org-install-agenda-files-menu 1 0.001225 0.001225 org-html-do-expand 18 0.000931 5.172...e-05 org-agenda-files 1 0.000757 0.000757 org-splice-latex-header 5 0.000594 0.0001188 org-infile-export-plist 3 0.000572 0.000190 org-export-normalize-links 1 0.000553 0.000553 org-file-image-p 5 0.000525 0.000105 org-image-file-name-regexp 5 0.000468 9.36e-05 org-default-export-plist 1 0.000405 0.000405 org-set-regexps-and-options 1 0.000344 0.000344 org-export-define-heading-targets 1 0.000267 0.000267 org-export-html-convert-sub-super 18 0.000245 1.361...e-05 org-latex-packages-to-string 5 0.000236 4.719...e-05 org-export-blocks-preprocess 1 0.000223 0.000223 org-link-unescape 10 0.000220 2.21e-05 org-export-html-format-image 5 0.000189 3.780...e-05 org-html-handle-time-stamps 10 0.000181 1.810...e-05 org-footnote-normalize 1 0.000156 0.000156 org-html-level-start 2 0.000146 7.3e-05 org-export-attach-captions-and-attributes 1 0.000142 0.000142 org-export-html-convert-special-strings 18 0.000122 6.777...e-06 org-export-html-convert-emphasize 18 0.000120 6.666...e-06 org-export-remove-headline-metadata 1 0.000115 0.000115 org-export-concatenate-multiline-emphasis 1 0.000114 0.000114 org-open-par 7 0.000111 1.585...e-05 org-export-select-backend-specific-text 1 0.000109 0.000109 org-section-number 3 0.000104 3.466...e-05 org-export-protect-verbatim 1 0.000104 0.000104 org-make-options-regexp 4 0.000102 2.55e-05 org-export-replace-src-segments-and-examples 1 9.5e-05 9.5e-05 org-html-protect 18 8.300...e-05 4.611...e-06 org-file-menu-entry 15 7.900.
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Nick Dokos wrote: > ... > The complete profiling results are attached. I also did an ls -lR to get > some sizes after Lucas's mail above, but I have not looked into that yet > - nevertheless, the sizes are also in the results file. > The results file was incomplete: I forgot to save the file before sending it out - sorry about that. The complete results are attached here. Nick * Org-mode version 6.35trans (release_6.35i) ** profile org-export1 10.622031 10.622031 org-export-as-html1 9.529249 9.529249 org-export-preprocess-string 1 9.510265 9.510265 org-export-html-preprocess1 9.502661 9.502661 org-format-latex 1 9.502494 9.502494 org-create-formula-image 5 9.479597 1.8959194 org-mode 1 0.004826 0.004826 org-export-push-to-kill-ring 1 0.003082 0.003082 org-kill-new 1 0.001904 0.001904 org-fit-window-to-buffer 1 0.001263 0.001263 org-html-expand 13 0.001239 9.530...e-05 org-install-agenda-files-menu 1 0.001225 0.001225 org-html-do-expand18 0.000931 5.172...e-05 org-agenda-files 1 0.000757 0.000757 org-splice-latex-header 5 0.000594 0.0001188 org-infile-export-plist 3 0.000572 0.000190 org-export-normalize-links1 0.000553 0.000553 org-file-image-p 5 0.000525 0.000105 org-image-file-name-regexp5 0.000468 9.36e-05 org-default-export-plist 1 0.000405 0.000405 org-set-regexps-and-options 1 0.000344 0.000344 org-export-define-heading-targets 1 0.000267 0.000267 org-export-html-convert-sub-super 18 0.000245 1.361...e-05 org-latex-packages-to-string 5 0.000236 4.719...e-05 org-export-blocks-preprocess 1 0.000223 0.000223 org-link-unescape 10 0.000220 2.21e-05 org-export-html-format-image 5 0.000189 3.780...e-05 org-html-handle-time-stamps 10 0.000181 1.810...e-05 org-footnote-normalize1 0.000156 0.000156 org-html-level-start 2 0.000146 7.3e-05 org-export-attach-captions-and-attributes 1 0.000142 0.000142 org-export-html-convert-special-strings 18 0.000122 6.777...e-06 org-export-html-convert-emphasize 18 0.000120 6.666...e-06 org-export-remove-headline-metadata 1 0.000115 0.000115 org-export-concatenate-multiline-emphasis 1 0.000114 0.000114 org-open-par 7 0.000111 1.585...e-05 org-export-select-backend-specific-text 1 0.000109 0.000109 org-section-number3 0.000104 3.466...e-05 org-export-protect-verbatim 1 0.000104 0.000104 org-make-options-regexp 4 0.000102 2.55e-05 org-export-replace-src-segments-and-examples 1 9.5e-05 9.5e-05 org-html-protect 18 8.300...e-05 4.611...e-06 org-file-menu-entry 15 7.900...e-05 5.266...e-06 org-babel-exp-inline-src-blocks 1 7.8e-05 7.8e-05 org-export-handle-export-tags 1 7.6e-05 7.6e-05 org-split-string 5 6.900...e-05 1
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Lucas Peng wrote:
> I wanted to export some files to html, and they contain lots of LaTeX
> fragments.
> I've done some test on 6.35i and 6.34c.
> 6.35i included more packages when converting LaTeX to PNG, and that's a big
> issue for me because it is time consuming.
> And the result .dvi is much larger than 6.34c.
>
> these are some of my test result.
> 6.35i
> http://pastebin.com/0YPhjdW2
>
> 6.34c
> http://pastebin.com/A1azh7dW
>
I did some profiling with these two releases and can confirm that 6.35i
is slower (by about a factor of 2.5 in my particular case). I exported
the following file (pretty much lifted from the manual) to HTML with
org-export-with-LaTeX-fragments set to t:
,
|
| * foo
|
| \begin{equation} % arbitrary environments,
| x=\sqrt{b}% even tables, figures
| \end{equation}% etc
|
| If $a^2=b$ and \( b=2 \), then the solution must be
| either $$ a=+\sqrt{2} $$ or \[ a=-\sqrt{2} \].
`
The profile starts like this for 6.35i:
org-export1
10.622031 10.622031
org-export-as-html1
9.529249 9.529249
org-export-preprocess-string 1
9.510265 9.510265
org-export-html-preprocess1
9.502661 9.502661
org-format-latex 1
9.502494 9.502494
org-create-formula-image 5
9.479597 1.8959194
org-mode 1
0.004826 0.004826
...
and like this for 6.34c:
org-export2
4.470028 2.235014
org-export-as-html2
2.172419 1.0862095
org-export-preprocess-string 2
2.03408 1.01704
org-export-html-preprocess2
2.02233 1.011165
org-format-latex 1
2.021664 2.021664
org-create-formula-image 5
1.978296 0.3956592
org-mode 4
0.213101 0.0532754999
Clearly, org-create-formula-image is eating much more time nowadays.
The complete profiling results are attached. I also did an ls -lR to get
some sizes after Lucas's mail above, but I have not looked into that yet
- nevertheless, the sizes are also in the results file.
Nick
* Org-mode version 6.35trans (release_6.35i)
** profile
org-export1
10.622031 10.622031
org-export-as-html1
9.529249 9.529249
org-export-preprocess-string 1
9.510265 9.510265
org-export-html-preprocess1
9.502661 9.502661
org-format-latex 1
9.502494 9.502494
org-create-formula-image 5
9.479597 1.8959194
org-mode 1
0.004826 0.004826
org-export-push-to-kill-ring 1
0.003082 0.003082
org-kill-new 1
0.001904 0.001904
org-fit-window-to-buffer 1
0.001263 0.001263
org-html-expand 13
0.001239 9.530...e-05
org-install-agenda-files-menu 1
0.001225 0.001225
org-html-do-expand18
0.000931 5.172...e-05
org-agenda-files 1
0.000757 0.000757
org-splice-latex-header 5
0.000594 0.0001188
org-infile-export-plist 3
0.000572 0.000190
org-export-normalize-links1
0.000553 0.000553
org-file-image-p 5
0.000525 0.000105
org-image-file-name-regexp5
0.000468 9.36e-05
org-default-export-plist 1
0.000405 0.000405
org-set-regexps-and-options 1
0.000344 0.000344
org-export-define-heading-targets 1
0.000267
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Hello, I wanted to export some files to html, and they contain lots of LaTeX fragments. I've done some test on 6.35i and 6.34c. 6.35i included more packages when converting LaTeX to PNG, and that's a big issue for me because it is time consuming. And the result .dvi is much larger than 6.34c. these are some of my test result. 6.35i http://pastebin.com/0YPhjdW2 6.34c http://pastebin.com/A1azh7dW Thanks, Lucas ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Nick Dokos writes: > Carsten Dominik wrote: > >> >> On Apr 16, 2010, at 11:50 PM, Nick Dokos wrote: >> >> > Bernt Hansen wrote: >> > >> >> Lucas Peng writes: >> >> >> >>> Thanks for your prompt response, >> >>> >> >>> 1. I get "Org-mode version 6.35i" with M-x org-version. >> >> >> >> Strange. The current latest tagged version in the git repo is >> >> release_6.35g >> >> >> >> We haven't gotten to 'i' yet unless you've come back from the >> >> future ;) >> >> >> > >> > I was confused by that too, but the tarball on the website says >> > 6.35i, so >> > my guess was that Carsten forgot to add tags to the git tree. >> >> >> The tags are there, but I pushed them from a branch. >> >> > > Indeed they are. I did ``git fetch --tags'' to get them. Hmmm. Yes they are. Ah they are on a separate branch that master doesn't reference. Sorry for the noise. -Bernt ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Carsten Dominik wrote: > > On Apr 16, 2010, at 11:50 PM, Nick Dokos wrote: > > > Bernt Hansen wrote: > > > >> Lucas Peng writes: > >> > >>> Thanks for your prompt response, > >>> > >>> 1. I get "Org-mode version 6.35i" with M-x org-version. > >> > >> Strange. The current latest tagged version in the git repo is > >> release_6.35g > >> > >> We haven't gotten to 'i' yet unless you've come back from the > >> future ;) > >> > > > > I was confused by that too, but the tarball on the website says > > 6.35i, so > > my guess was that Carsten forgot to add tags to the git tree. > > > The tags are there, but I pushed them from a branch. > > Indeed they are. I did ``git fetch --tags'' to get them. Thanks, Nick ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Bernt Hansen writes: > Lucas Peng writes: > >> Thanks for your prompt response, >> >> 1. I get "Org-mode version 6.35i" with M-x org-version. > > Strange. The current latest tagged version in the git repo is release_6.35g > > We haven't gotten to 'i' yet unless you've come back from the future ;) Obviously, there's a piece of evidence! Could save Carsten a lot of work, if you send him that. Some here might be interested in all those new features, too!! :-D Sebastian ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
On Apr 16, 2010, at 11:50 PM, Nick Dokos wrote: Bernt Hansen wrote: Lucas Peng writes: Thanks for your prompt response, 1. I get "Org-mode version 6.35i" with M-x org-version. Strange. The current latest tagged version in the git repo is release_6.35g We haven't gotten to 'i' yet unless you've come back from the future ;) I was confused by that too, but the tarball on the website says 6.35i, so my guess was that Carsten forgot to add tags to the git tree. The tags are there, but I pushed them from a branch. - Carsten ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
Re: [Orgmode] Re: Bug: create latex png while export to HTML become very slow [6.35i]
Bernt Hansen wrote: > Lucas Peng writes: > > > Thanks for your prompt response, > > > > 1. I get "Org-mode version 6.35i" with M-x org-version. > > Strange. The current latest tagged version in the git repo is release_6.35g > > We haven't gotten to 'i' yet unless you've come back from the future ;) > I was confused by that too, but the tarball on the website says 6.35i, so my guess was that Carsten forgot to add tags to the git tree. Nick ___ Emacs-orgmode mailing list Please use `Reply All' to send replies to the list. Emacs-orgmode@gnu.org http://lists.gnu.org/mailman/listinfo/emacs-orgmode
