Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi Hilmar,
Thank you for your suggestion.
I filed "6GB real memory is used by lualatex even with small input"
issue at https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=930292
It is independent of Japanese localization of lualatex.
Best regards,
Ryutaroh
From: Hilmar Preuße
Subject: Re: Bug#929128: fonts-noto-cjk: not recognized by lualatex until
mktexlsr
Date: Mon, 10 Jun 2019 00:02:00 +0200
> Am 26.05.2019 um 03:52 teilte Ryutaroh Matsumoto mit:
>
> Matsumoto-san,
>
>> You are right. The way to reproduce this issue (not related to
>> mktexlsr)
>> is
>> (1) Install texlive-full and fonts-noto-cjk from experimental.
>> (2) Run lualatex with the below LaTeX source and have error
>> "Package fontspec Error: The font "NotoSerifCJKJPLight" cannot be
>> found."
>> (3) Installation of fonts-noto-cjk-extra fixes the issue even though
>> no font from
>> fonts-noto-cjk-extra is used. XeLaTeX (with
>> \usepackage[noto]{zxjafont}) and
>> uplatex (with \usepackage[unicode,noto-otc]{pxchfon}) produce the
>> desired
>> PDF without fonts-noto-cjk-extra.
>>
> I'm able to process your file using lualatex right now. Then I tried
> to
> process it using uplatex and xelatex and both did not work. I always
> get
> messages like
>
> (/usr/share/texlive/texmf-dist/tex/luatex/luatexja/luatexja.sty
> ! Undefined control sequence.
> l.46 \directlua
>{require('ltj-unicode-ccfix.lua')}% catcode of ideographs
>
> I guess the document class needs luatex. ;-)
>
> Hilmar
> --
> #206401 http://counter.li.org
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi
> (2) Run lualatex with the below LaTeX source and have error
> "Package fontspec Error: The font "NotoSerifCJKJPLight" cannot be found."
Yes, because luatexja preloads all the fonts defined in the noto-otf
preset:
\ltjpreset_declare_preset:nx{noto-otf}{
mc-m = Noto~Serif~CJK~JP~Regular,
mc-bx = Noto~Serif~CJK~JP~Bold,
gt-d = Noto~Sans~CJK~JP~Regular,
gt-bx = Noto~Sans~CJK~JP~Bold,
gt-u = Noto~Sans~CJK~JP~Medium,
gt-eb = Noto~Sans~CJK~JP~Black,
mg-m = Noto~Sans~CJK~JP~Black,
mc-l = Noto~Serif~CJK~JP~Light,
__custom = false, __office = false, __noembed = false,
}
Thus it fails if the font is not installed.
I haven't seen the uplatex version of your document, but I guess you
load the fonts with the otf package. There the fonts are only necessary
when calling dvipdfmx, and thus only the actually needed fonts are
loaded.
> This seems a feature or a bug in TeXLive 2019 upstream, which should not have
> been filed in BTS. So I close this issue.
I think this is neither a feature nor a bug, it is just that the two
systems work differently.
You can ask the luatexja maintainers to implement on-demand loading of
fonts, but I am not sure how feasible this is.
All the best
Norbert
--
PREINING Norbert http://www.preining.info
Accelia Inc. +JAIST +TeX Live +Debian Developer
GPG: 0x860CDC13 fp: F7D8 A928 26E3 16A1 9FA0 ACF0 6CAC A448 860C DC13
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
> (/usr/share/texlive/texmf-dist/tex/luatex/luatexja/luatexja.sty Yes, luatexja needs lualatex, you cannot use anything else. Norbert -- PREINING Norbert http://www.preining.info Accelia Inc. +JAIST +TeX Live +Debian Developer GPG: 0x860CDC13 fp: F7D8 A928 26E3 16A1 9FA0 ACF0 6CAC A448 860C DC13
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Am 26.05.2019 um 03:52 teilte Ryutaroh Matsumoto mit:
Matsumoto-san,
You are right. The way to reproduce this issue (not related to mktexlsr)
is
(1) Install texlive-full and fonts-noto-cjk from experimental.
(2) Run lualatex with the below LaTeX source and have error
"Package fontspec Error: The font "NotoSerifCJKJPLight" cannot be found."
(3) Installation of fonts-noto-cjk-extra fixes the issue even though
no font from
fonts-noto-cjk-extra is used. XeLaTeX (with \usepackage[noto]{zxjafont}) and
uplatex (with \usepackage[unicode,noto-otc]{pxchfon}) produce the desired
PDF without fonts-noto-cjk-extra.
I'm able to process your file using lualatex right now. Then I tried to
process it using uplatex and xelatex and both did not work. I always get
messages like
(/usr/share/texlive/texmf-dist/tex/luatex/luatexja/luatexja.sty
! Undefined control sequence.
l.46 \directlua
{require('ltj-unicode-ccfix.lua')}% catcode of ideographs
I guess the document class needs luatex. ;-)
Hilmar
--
#206401 http://counter.li.org
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Am 27.05.2019 um 04:09 teilte Ryutaroh Matsumoto mit: Matsumoto-san, thanks for your interest and comment. It is (in my opinion) a well-known issue among Japanese LuaLaTeX users, and I can show a even worse example (for your fun), which needs 6 GB of real RAM and 10 minutes to compile three lines, in the first time you process a CJK tex source as below :-) OK, after re-configuring my VM (put more RAM into it) and stopping a RAM eating process I was able to compile your document. I guess your comment in https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=929128#40 is completely valid. The font needed by the document is "NotoSerifCJKJPLight" and this font is provided by fonts-noto-cjk-extra, not by fonts-noto-cjk. I just checked the package from experimental. root@sid:~# dpkg -L fonts-noto-cjk|grep opentype /usr/share/fonts/opentype /usr/share/fonts/opentype/noto /usr/share/fonts/opentype/noto/NotoSansCJK-Bold.ttc /usr/share/fonts/opentype/noto/NotoSansCJK-Regular.ttc /usr/share/fonts/opentype/noto/NotoSerifCJK-Bold.ttc /usr/share/fonts/opentype/noto/NotoSerifCJK-Regular.ttc root@sid:~# dpkg -L fonts-noto-cjk-extra|grep opentype /usr/share/fonts/opentype /usr/share/fonts/opentype/noto /usr/share/fonts/opentype/noto/NotoSansCJK-Black.ttc /usr/share/fonts/opentype/noto/NotoSansCJK-DemiLight.ttc /usr/share/fonts/opentype/noto/NotoSansCJK-Light.ttc /usr/share/fonts/opentype/noto/NotoSansCJK-Medium.ttc /usr/share/fonts/opentype/noto/NotoSansCJK-Thin.ttc /usr/share/fonts/opentype/noto/NotoSerifCJK-Black.ttc /usr/share/fonts/opentype/noto/NotoSerifCJK-ExtraLight.ttc /usr/share/fonts/opentype/noto/NotoSerifCJK-Light.ttc /usr/share/fonts/opentype/noto/NotoSerifCJK-Medium.ttc /usr/share/fonts/opentype/noto/NotoSerifCJK-SemiBold.ttc Once lualatex complies it, the same file is compiled in much shorter time and much smaller memory. (So one needs "rm -rf ~/.texlive201?" to see long compilation time.) I am a bit reluctant to file the above issue to texlive-lang-japanese (or texlive-luatex??) because it does not seem a packaging problem by the Debian TeX team and they tell us in "reportbug" that Yes, I'm aware that our reportbug scripts tell this. The reason is that the Debian TeX team is currently quite small (just Norbert and me) and we have to push as much as possible work back to the submitter. However I'm willing to submit and track serious upstream bugs if I have time. Hilmar -- #206401 http://counter.li.org
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi Hilmar,
thanks for your interest and comment.
It is (in my opinion) a well-known issue among
Japanese LuaLaTeX users, and I can show a even worse
example (for your fun), which needs 6 GB of real RAM
and 10 minutes to compile three lines, in the first time
you process a CJK tex source as below :-)
Please process it by "lualatex" after "rm -rf ~/.texlive201?"
and installing texlive-full and fonts-noto-cjk
and fonts-noto-cjk-extra.
It should produce a PDF document with 7 CJK typefaces.
Once lualatex complies it, the same file is compiled
in much shorter time and much smaller memory.
(So one needs "rm -rf ~/.texlive201?" to see long compilation time.)
I was told that luajitlatex (on Windows) needed even longer
time to compile it :-)
\documentclass[a4paper,12pt]{ltjsarticle}
\usepackage[noto-otf,deluxe]{luatexja-preset}
\begin{document}
\Large\noindent
{\mcfamily \ltseries 細明朝体\\ \mdseries 明朝体\\ \bfseries 太明朝体}\\
{\gtfamily ゴシック体\\ \bfseries 太ゴシック体\\ \ebseries 極太ゴシック体}\\
{\mgfamily 丸ゴシック体}\\
\end{document}
I am a bit reluctant to file the above issue to
texlive-lang-japanese (or texlive-luatex??) because
it does not seem a packaging problem by the Debian TeX team and
they tell us in "reportbug" that
> -- Package-specific info:
> IMPORTANT INFORMATION: We will only consider bug reports concerning
> the packaging of TeX Live as relevant. If you have problems with
> combination of packages in a LaTeX document, please consult your
> local TeX User Group, the comp.text.tex user group, the author of
> the original .sty file, or any other help resource.
>
> In particular, bugs that are related to up-upstream, i.e., neither
> Debian nor TeX Live (upstream), but the original package authors,
> will be closed immediately.
>
>*** The Debian TeX Team is *not* a LaTeX Help Desk ***
Best regards,
Ryutaroh
From: Hilmar Preuße
Subject: Re: Bug#929128: fonts-noto-cjk: not recognized by lualatex until
mktexlsr
Date: Sun, 26 May 2019 17:45:14 +0200
> Am 26.05.2019 um 03:52 teilte Ryutaroh Matsumoto mit:
>
> Matsumoto-san,
>
> I followed your instructions and tried to reproduce some kind of
> issue.
> I compiled your document using TL from experimental; it triggered some
> kind of memory leak in luatex. At least I would not expect that luatex
> needs 1,5 GB of RAM to compile your document:
>
> %Cpu(s): 1.3 us, 47.8 sy, 0.3 ni, 0.0 id, 50.5 wa, 0.0 hi, 0.0 si,
> 0.0 st
> MiB Mem : 938.3 total, 59.5 free, 860.5 used, 18.3 buff/cache
> MiB Swap: 1376.6 total, 295.4 free, 1081.2 used. 21.0 avail Mem
>
> PID USER PR NIVIRTRESSHR S %CPU %MEM TIME+
> COMMAND
> 137 root 0 -20 0 0 0 I 32.2 0.0 0:11.56
> kworker/0+
> 5014 root 20 0 1533540 669688168 D 8.3 69.7 1:13.58
> lualatex
>
> Please file a bug against our package texlive-binaries, version
> 2019.20190507.51032-1 .
>
> Many thanks!
>
> Hilmar
>
>>> Matsumoto-san, I am actually surprised that mktexlsr call fixed it,
>>> since luatex doesn't use ls-R files.
>>> Do you have a way to reproduce this behaviour?
>>
>> You are right. The way to reproduce this issue (not related to
>> mktexlsr)
>> is
>> (1) Install texlive-full and fonts-noto-cjk from experimental.
>> (2) Run lualatex with the below LaTeX source and have error
>> "Package fontspec Error: The font "NotoSerifCJKJPLight" cannot be
>> found."
>> (3) Installation of fonts-noto-cjk-extra fixes the issue even though
>> no font from
>> fonts-noto-cjk-extra is used. XeLaTeX (with
>> \usepackage[noto]{zxjafont}) and
>> uplatex (with \usepackage[unicode,noto-otc]{pxchfon}) produce the
>> desired
>> PDF without fonts-noto-cjk-extra.
>>
>> \documentclass[a4paper,12pt]{ltjsarticle}
>> \usepackage[noto-otf]{luatexja-preset}
>>
>> \begin{document}
>> 日本語
>> \end{document}
>>
>> This seems a feature or a bug in TeXLive 2019 upstream, which should
>> not have
>> been filed in BTS. So I close this issue.
>>
>
>
> --
> #206401 http://counter.li.org
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi Hideki, thanks for your kind comment. My understanding is that it is related to luatexja-preset.sty (or Japanese localization of LuaLaTeX). When we run the "report-bug" against a tex package, it tells us that > -- Package-specific info: > IMPORTANT INFORMATION: We will only consider bug reports concerning > the packaging of TeX Live as relevant. If you have problems with > combination of packages in a LaTeX document, please consult your > local TeX User Group, the comp.text.tex user group, the author of > the original .sty file, or any other help resource. > > In particular, bugs that are related to up-upstream, i.e., neither > Debian nor TeX Live (upstream), but the original package authors, > will be closed immediately. > >*** The Debian TeX Team is *not* a LaTeX Help Desk *** So, provided that the issue is in luatexja-preset.sty, the Debian TeX team may unwelcome it... Is it OK to reopen it (and maybe reassign it to texlive-lang-japanese)? If I understand the issue correctly, the problem is that * lualatex + luatexja-preset.sty requires "NotoSerifCJKJPLight" even when "NotoSerifCJKJPLight" font is not used in a document, while uplatex or xelatex (with their localizations files) does not require "NotoSerifCJKJPLight" unless it is used. But the above behavior seems a kind of "design"... And a solution can be inclusion of all CJK font files into "fonts-noto-cjk", which suggests that this issue should be filed against "fonts-noto-cjk". Your feedbacks are welcome. Ryutaroh From: Hideki Yamane Subject: Re: Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr Date: Sun, 26 May 2019 16:08:15 +0900 > Hi, > > On Sun, 26 May 2019 10:52:36 +0900 > Ryutaroh Matsumoto wrote: >> Sorry again for bothering all of you > > To be clear, it's _nothing_ wrong with you, IMHO. > Maybe it's better to reopen and reassign to appropriate texlive package > with "upstream" tag. > > -- > Regards, > > Hideki Yamane henrich @ debian.org/iijmio-mail.jp
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Am 26.05.2019 um 03:52 teilte Ryutaroh Matsumoto mit:
Matsumoto-san,
I followed your instructions and tried to reproduce some kind of issue.
I compiled your document using TL from experimental; it triggered some
kind of memory leak in luatex. At least I would not expect that luatex
needs 1,5 GB of RAM to compile your document:
%Cpu(s): 1.3 us, 47.8 sy, 0.3 ni, 0.0 id, 50.5 wa, 0.0 hi, 0.0 si,
0.0 st
MiB Mem :938.3 total, 59.5 free,860.5 used, 18.3 buff/cache
MiB Swap: 1376.6 total,295.4 free, 1081.2 used. 21.0 avail Mem
PID USER PR NIVIRTRESSHR S %CPU %MEM TIME+
COMMAND
137 root 0 -20 0 0 0 I 32.2 0.0 0:11.56
kworker/0+
5014 root 20 0 1533540 669688168 D 8.3 69.7 1:13.58
lualatex
Please file a bug against our package texlive-binaries, version
2019.20190507.51032-1 .
Many thanks!
Hilmar
Matsumoto-san, I am actually surprised that mktexlsr call fixed it,
since luatex doesn't use ls-R files.
Do you have a way to reproduce this behaviour?
You are right. The way to reproduce this issue (not related to mktexlsr)
is
(1) Install texlive-full and fonts-noto-cjk from experimental.
(2) Run lualatex with the below LaTeX source and have error
"Package fontspec Error: The font "NotoSerifCJKJPLight" cannot be found."
(3) Installation of fonts-noto-cjk-extra fixes the issue even though
no font from
fonts-noto-cjk-extra is used. XeLaTeX (with \usepackage[noto]{zxjafont}) and
uplatex (with \usepackage[unicode,noto-otc]{pxchfon}) produce the desired
PDF without fonts-noto-cjk-extra.
\documentclass[a4paper,12pt]{ltjsarticle}
\usepackage[noto-otf]{luatexja-preset}
\begin{document}
日本語
\end{document}
This seems a feature or a bug in TeXLive 2019 upstream, which should not have
been filed in BTS. So I close this issue.
--
#206401 http://counter.li.org
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi all, > It is a dpkg trigger on /u/s/fonts as far as I remember. That is, if files > are installed there the postins if tex-common should be called and the > necessary actions taken. Sorry, completely wrong. We only have interest (dpkg-interest) in /u/share/texmf/fonts etc. So nothing will be triggered. Matsumoto-san, I am actually surprised that mktexlsr call fixed it, since luatex doesn't use ls-R files. Do you have a way to reproduce this behaviour? Best Norbert -- PREINING Norbert http://www.preining.info Accelia Inc. +JAIST +TeX Live +Debian Developer GPG: 0x860CDC13 fp: F7D8 A928 26E3 16A1 9FA0 ACF0 6CAC A448 860C DC13
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Sorry for brevity, traveling with daughter intercontinental. It is a dpkg trigger on /u/s/fonts as far as I remember. That is, if files are installed there the postins if tex-common should be called and the necessary actions taken. I will look into it and see what is the reason, my guess is that it is not mktexlsr but some mtxrun invocation that is necessary. More later Norbert On May 24, 2019 7:04:31 AM GMT+02:00, Hideki Yamane wrote: >Hi, > >On Fri, 24 May 2019 13:15:46 +0900 (JST) >Ryutaroh Matsumoto wrote: >> "postinst" scripts are very different between >> fonts-ipaexfont-mincho and fonts-noto-cjk. > > Yes, but it's for obsolete config and alternatives. > > >> mktexlsr in installation of a font package is executed >> as a trigger to tex-common as we often see >> "Processing triggers for tex-common", if I understand it >> correctly. > > How is this triggered? -- PREINING Norbert http://www.preining.info Accelia Inc. + JAIST + TeX Live + Debian Developer GPG: 0x860CDC13 fp: F7D8 A928 26E3 16A1 9FA0 ACF0 6CAC A448 860C DC13
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
>> mktexlsr in installation of a font package is executed >> as a trigger to tex-common as we often see >> "Processing triggers for tex-common", if I understand it >> correctly. > > How is this triggered? For the case of "fonts-ipaex-mincho", "apt-get install texlive-full" installs "fonts-ipaex-mincho" and "texlive-fonts-recommended" by the dependency. Then the "postinst" in "texlive-fonts-recommended" runs "update-texmf-config map", which in turn runs "mktexlsr". That's my understanding. Ryutaroh From: Hideki Yamane Subject: Re: Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr Date: Fri, 24 May 2019 14:04:31 +0900 > Hi, > > On Fri, 24 May 2019 13:15:46 +0900 (JST) > Ryutaroh Matsumoto wrote: >> "postinst" scripts are very different between >> fonts-ipaexfont-mincho and fonts-noto-cjk. > > Yes, but it's for obsolete config and alternatives. > > >> mktexlsr in installation of a font package is executed >> as a trigger to tex-common as we often see >> "Processing triggers for tex-common", if I understand it >> correctly. > > How is this triggered? > > > -- > Hideki Yamane
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi, On Fri, 24 May 2019 13:15:46 +0900 (JST) Ryutaroh Matsumoto wrote: > "postinst" scripts are very different between > fonts-ipaexfont-mincho and fonts-noto-cjk. Yes, but it's for obsolete config and alternatives. > mktexlsr in installation of a font package is executed > as a trigger to tex-common as we often see > "Processing triggers for tex-common", if I understand it > correctly. How is this triggered? -- Hideki Yamane
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi Hideki, > Isn't it a issue on mktexlsr, instead of fonts? mktexlsr in installation of a font package is executed as a trigger to tex-common as we often see "Processing triggers for tex-common", if I understand it correctly. fonts-ipaexfont-mincho package installs its fonts to /usr/share/fonts/opentype, and the font file is recognized by uplatex and lualatex after its installation. "postinst" scripts are very different between fonts-ipaexfont-mincho and fonts-noto-cjk. My guess is that mimicing fonts-ipaexfont-mincho in the postinst of fonts-noto-cjk addresses this issue. If my guess is correct, fonts-noto-cjk-extra should also have the same issue. Ryutaroh From: Hideki Yamane Subject: Re: Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr Date: Fri, 24 May 2019 11:59:24 +0900 > Hi, > > On Fri, 17 May 2019 23:53:05 +0900 > Ryutaroh Matsumoto wrote: >> I suggest to execute mktexlsr in the installation of fonts-noto-cjk >> if mktexlsr is installed. > > Isn't it a issue on mktexlsr, instead of fonts? > > > -- > Hideki Yamane
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Hi, On Fri, 17 May 2019 23:53:05 +0900 Ryutaroh Matsumoto wrote: > I suggest to execute mktexlsr in the installation of fonts-noto-cjk > if mktexlsr is installed. Isn't it a issue on mktexlsr, instead of fonts? -- Hideki Yamane
Bug#929128: fonts-noto-cjk: not recognized by lualatex until mktexlsr
Package: fonts-noto-cjk Version: 1:20181130+repack1-1~exp1 Severity: normal Dear Maintainer, Font Noto CJK can be used by lualatex (in texlive-latex-base). But lualatex does not recognize the Noto fonts until one executes mktexlsr. I suggest to execute mktexlsr in the installation of fonts-noto-cjk if mktexlsr is installed. -- System Information: Debian Release: buster/sid APT prefers testing APT policy: (990, 'testing'), (500, 'unstable'), (1, 'experimental') Architecture: amd64 (x86_64) Kernel: Linux 4.19.0-4-amd64 (SMP w/4 CPU cores) Locale: LANG=ja_JP.UTF-8, LC_CTYPE=ja_JP.UTF-8 (charmap=UTF-8), LANGUAGE=ja_JP.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Init: systemd (via /run/systemd/system) LSM: AppArmor: enabled fonts-noto-cjk depends on no packages. fonts-noto-cjk recommends no packages. Versions of packages fonts-noto-cjk suggests: ii fonts-noto-cjk-extra 1:20181130+repack1-1~exp1 -- no debconf information
