Re: [XeTeX] Extra trailing space in IPA font with xltxtra
2010/9/23 Khaled Hosny > [...] > > No, fontspec just loads xunicode (assuming you are using the latest > version in texlive). OK, my bad: I wasn’t aware of this. Sorry, all; thank you, Khaled. "Mystery" solved, then. :-) Paolo -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On 2010-09-23 20:38:14 +0930, Paolo Matteucci said: Therefore *maybe", whatever approach is used to address this bug, the same "fix" should be applied to fontspec, too...? The \scantokens is somewhere in tipa.sty or its accompanying packages. But the problem only occurs if fontspec is loaded. I don't know why that would be, though, off the top of my head. Sorry, I'm out of time tonight to look any further. W -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On Thu, Sep 23, 2010 at 12:08:14PM +0100, Paolo Matteucci wrote: > Although admittedly it doesn't make much sense to load tipa without loading > xltxtra or xunicode as well, if you just load fontspec [v2.1] (*and* tipa, of > course), you still get the extra trailing space with the \textipa command, and > this because —I believe— fontspec invokes \scantokens, too. So xunicode's > behaviour is "consistent" in that it preserves fontspec's behaviour. :-) No, fontspec just loads xunicode (assuming you are using the latest version in texlive). -- Khaled Hosny Arabic localiser and member of Arabeyes.org team Free font developer -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
2010/9/22 Philip Taylor (Webmaster, Ret'd)
> P.S. This may be a more elegant solution :
>
> [...]
>
> \def\implementTIPAtextx#1{\scantokens{#1\endinput}\egroup}
Thank you, Phil: that certainly is.
2010/9/22 Philip Taylor (Webmaster, Ret'd)
>
>
> Ross Moore wrote:
>
> However, I'm not convinced that this is the most robust way
>> of tackling this issue.
>> Should it be localised to just when linguex is used?
>>
>> [...]
>
>
> Not convinced this is optimal.
> [...]
>
> might it not be better to simply use \scantokens
> regardless ?
Also, I'd like to stress one thing I mentioned earlier on in this thread
(and had completely forgotten about!), *just in case* it might be
important:-
Although admittedly it doesn't make much sense to load tipa without loading
xltxtra or xunicode as well, if you just load fontspec [v2.1] (*and* tipa,
of course), you still get the extra trailing space with the \textipa
command, and this because —I believe— fontspec invokes \scantokens, too. So
xunicode's behaviour is "consistent" in that it preserves fontspec's
behaviour. :-)
Therefore *maybe", whatever approach is used to address this bug, the same
"fix" should be applied to fontspec, too...?
Paolo
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
It's fairly basic. It just maps the capital letters, numbers, and some symbols. For \*,\;,\:, and \! I'd have to add commands to map them to an unused symbol, maybe & (so you'd get something convoluted like &*& > &, and &;B > U+0299 ; small capital B)*. If you think this should be submitted to CTAN, I can certainly do it, but it seems somewhat incomplete as is. -Andy *Charis SIL actually has two sets of small capitals. Its \textsc forms resemble the kind of small caps you get from work, but it also has a full set of IPA extension small caps which are x-height. On Wed, Sep 22, 2010 at 19:13, Alan Munn wrote: > On Sep 22, 2010, at 2:37 PM, Andy Lin wrote: > >> >> >> If it works with linguex, that's great. If not, and you need textipa >> with linguex, I have a TECkit mapping I can upload that converts >> uppercase and numeric input into their textipa forms. > > Hi Andy, it would be great if you could upload a TECkit mapping to CTAN. > Is it complete, or are there other things that would need to be added to it? > > Alan > > > -- > Alan Munn > am...@gmx.com > > > > > > > -- > Subscriptions, Archive, and List information, etc.: > http://tug.org/mailman/listinfo/xetex > xetex-textipa.map Description: Binary data xetex-textipa.tec Description: Binary data xetex-textipa-sample.tex Description: TeX document xetex-textipa-sample.pdf Description: Adobe PDF document -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On Sep 22, 2010, at 2:37 PM, Andy Lin wrote: If it works with linguex, that's great. If not, and you need textipa with linguex, I have a TECkit mapping I can upload that converts uppercase and numeric input into their textipa forms. Hi Andy, it would be great if you could upload a TECkit mapping to CTAN. Is it complete, or are there other things that would need to be added to it? Alan -- Alan Munn am...@gmx.com -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
P.S. This may be a more elegant solution :
\documentclass{article}
\usepackage{xltxtra} %or xunicode
\usepackage{linguex}
\setmainfont{Charis SIL}
\begin{document}
\def\implementTIPAtextx#1{\scantokens{#1\endinput}\egroup}
\ex. \textipa{DOES THIS WORK?}
\end{document}
** Phil.
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
Ross Moore wrote:
However, I'm not convinced that this is the most robust way
of tackling this issue.
Should it be localised to just when linguex is used?
Here is how I think this kind of interaction-between-packages
specific kind of issue should be solved. What do you think?
\def\implementTIPAtextx#1{#1\egroup}
\def\implementTIPAtextxx#1{\endlinechar=-1 \scantokens{#1}\egroup}
\AtBeginDocument{\let\textipa\implementTIPAtext}
\expandafter\ifx\csname scantokens\endcsname\relax
\else
\atbegindocumen...@ifpackageloaded{linguex}{%
\let\implementTIPAtextx\implementTIPAtextxx}}
\fi
If everyone agrees, this is how the next subversion
of Xunicode will deal with this.
Not convinced this is optimal. Whilst linguex may be
unusual in grabbing everything up to the next \par as
#1 to \ex., there can be no guarantee that it is the
only package so to do. Therefore, rather than risk
having to add additional packages to the
\...@ifpackageloaded {linguex}
test, might it not be better to simply use \scantokens
regardless ? As to whether eTeX is buggy in its
implementation of \scantokens, I would argue not :
the documentation clearly says --
\scantokens,
when followed by a , decomposes the
> of the into the
> corresponding sequence of characters as if the
> were written unexpanded to a file;
> it then uses TeX's \input mechanism to re-process
> these characters under the current \catcode régime.
> As the \input mechanism is used, even hex notation
>(^^xy) will be re-interpreted. Parentheses and a single
> space representing the pseudo-file will be displayed
> if \tracingscantokens (q.v.) is positive and non-zero.
where the key part is "uses TeX's \input mechanism"; if it
is unclear why this yields a final space, please try
the following :
File "A" : pre\input B\relax post\end
File "B" : middle
Philip Taylor
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
Hi Andy, Ulrike, Paolo, Heiko,
On 23/09/2010, at 4:37 AM, Andy Lin wrote:
> \scantokens is my fault. I noticed that the IPA support in xunicode
> didn't work with the linguex package, and Ross suggested the use of
> \scantokens. I haven't tried to use linguex with xunicode recently,
> but to give you an idea of where it used to fail:
>
> \documentclass{article}
> \usepackage{xltxtra} %or xunicode
> \usepackage{linguex}
> \setmainfont{Charis SIL}
> \begin{document}
> \ex. \textipa{DOES THIS WORK?} %would give DOES THIS WORK? instead of
> the textipa replacements
>
>
> \end{document}
\ex is reading ahead, before knowing about the catcode changes
needed to make \textipa do its thing.
Hence the need to rescan the tokens.
I knew nothing about the extra space being inserted at the end.
Why is this? Is there a good reason for it, or is it really
just a buggy implementation in the internals of eTeX ?
Anyway, being what it is, including the \endlinechar=-1
as follows (in xunicode.sty) certainly fixes the immediate problem:
>>> \expandafter\ifx\csname scantokens\endcsname\relax
>>> \def\implementTIPAtextx#1{#1\egroup}
>>> \else
>>> % \def\implementTIPAtextx#1{\scantokens{#1}\egroup}
>>> \def\implementTIPAtextx#1{\endlinechar=-1 \scantokens{#1}\egroup}
>>> \fi
However, I'm not convinced that this is the most robust way
of tackling this issue.
Should it be localised to just when linguex is used?
Here is how I think this kind of interaction-between-packages
specific kind of issue should be solved. What do you think?
>>> \def\implementTIPAtextx#1{#1\egroup}
>>> \def\implementTIPAtextxx#1{\endlinechar=-1 \scantokens{#1}\egroup}
>>> \AtBeginDocument{\let\textipa\implementTIPAtext}
>>> \expandafter\ifx\csname scantokens\endcsname\relax
>>> \else
>>> \atbegindocumen...@ifpackageloaded{linguex}{%
>>> \let\implementTIPAtextx\implementTIPAtextxx}}
>>> \fi
If everyone agrees, this is how the next subversion
of Xunicode will deal with this.
> If it works with linguex, that's great. If not, and you need textipa
> with linguex, I have a TECkit mapping I can upload that converts
> uppercase and numeric input into their textipa forms.
Yes, using a TECkit mapping is a good solution.
But that is specific to XeTeX only, isn't it?
People are wanting to use Xunicode also with LuaTeX, so there
would need to be an alternative solution in that context (sic).
>
> -Andy
Hope this helps,
Ross
Ross Moore ross.mo...@mq.edu.au
Mathematics Department office: E7A-419
Macquarie University tel: +61 (0)2 9850 8955
Sydney, Australia 2109 fax: +61 (0)2 9850 8114
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
\scantokens is my fault. I noticed that the IPA support in xunicode
didn't work with the linguex package, and Ross suggested the use of
\scantokens. I haven't tried to use linguex with xunicode recently,
but to give you an idea of where it used to fail:
\documentclass{article}
\usepackage{xltxtra} %or xunicode
\usepackage{linguex}
\setmainfont{Charis SIL}
\begin{document}
\ex. \textipa{DOES THIS WORK?} %would give DOES THIS WORK? instead of
the textipa replacements
\end{document}
If it works with linguex, that's great. If not, and you need textipa
with linguex, I have a TECkit mapping I can upload that converts
uppercase and numeric input into their textipa forms.
-Andy
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
2010/9/22 Ulrike Fischer
>
> xunicode has changed the definition of \implementTIPAtextx. It is
> now (in 0.95)
>
> \expandafter\ifx\csname scantokens\endcsname\relax
> \def\implementTIPAtextx#1{#1\egroup}
> \else
> \def\implementTIPAtextx#1{\scantokens{#1}\egroup}
> \fi
>
> Reverting to the old definition from 0.91
>
> \usepackage{xltxtra}
> \def\implementTIPAtextx#1{#1\egroup}
>
> removes the trailing space.
>
> So it is a bug in xunicode.
>
>
Thank you, Ulrike. Then I think we should ask Ross to have a look at this:
if he used \scantokens (when defined), there must be a reason! ;-)
Paolo
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
Am Wed, 22 Sep 2010 16:22:16 +0100 schrieb Paolo Matteucci:
> OK, I have now compared all three file lists (mine is appended) below, and
> can see that the [main] differences are:
> P. xunicode.sty 0.95 ~ U: xunicode.sty 0.91
xunicode has changed the definition of \implementTIPAtextx. It is
now (in 0.95)
\expandafter\ifx\csname scantokens\endcsname\relax
\def\implementTIPAtextx#1{#1\egroup}
\else
\def\implementTIPAtextx#1{\scantokens{#1}\egroup}
\fi
Reverting to the old definition from 0.91
\usepackage{xltxtra}
\def\implementTIPAtextx#1{#1\egroup}
removes the trailing space.
So it is a bug in xunicode.
--
Ulrike Fischer
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
2010/9/22 Ulrike Fischer > Am Wed, 22 Sep 2010 14:35:22 +0100 schrieb Paolo Matteucci: > > > >> In the meantime the problem seems to be fixed: > >> > >> *File List* > >> [...] > >> fontspec.sty2010/08/01 v2.0c Advanced font selection for > >> [...] > >> > > > > But you seem to be using fontspec 2.0c (and no xunicode?), whereas the > > latest version appears to be 2.1, i.e.: it's not fixed for me (although I > do > > have the workaround mentioned earlier on in this thread). > > Your example works fine for me, there are no trailing spaces. OK, I have now compared all three file lists (mine is appended) below, and can see that the [main] differences are: - between mine (P) and Heiko's (H): P: fontspec.sty 2.1 ~ H: fontspec.sty 2.0c P: fontspec-patches.sty 2.1 ~ H: fontspec-patches.sty 2.0c P: xunicode.sty 0.95 (actually 0.96, I think) ~ H: --- (?) -between mine and Ulrike's (U): P. xunicode.sty 0.95 ~ U: xunicode.sty 0.91 Paolo *File List* article.cls2007/10/19 v1.4h Standard LaTeX document class size10.clo2007/10/19 v1.4h Standard LaTeX file (size option) xltxtra.sty2010/09/20 v0.5e Improvements for the "XeLaTeX" format ifluatex.sty2010/03/01 v1.3 Provides the ifluatex switch (HO) ifxetex.sty2010/09/12 v0.6 Provides ifxetex conditional fontspec.sty2010/09/19 v2.1 Advanced font selection for XeLaTeX/LuaLaTeX expl3.sty2010/09/14 v2020 L3 Experimental code bundle wrapper l3names.sty2010/07/25 v1987 L3 Experimental Naming Scheme for TeX Primitiv es etex.sty1998/03/26 v2.0 eTeX basic definition package (PEB) l3basics.sty2010/08/04 v1992 L3 Experimental basic definitions l3expan.sty2010/08/04 v1991 L3 Experimental Argument Expansion module l3tl.sty2010/05/22 v1919 L3 Experimental Token Lists l3intexpr.sty2010/06/15 v1957 L3 Integer Expressions l3quark.sty2010/03/21 v1853 L3 Experimental Quark Commands l3seq.sty2010/03/29 v1879 L3 Experimental sequences and stacks l3toks.sty2010/05/25 v1933 L3 Experimental Token Registers l3int.sty2010/05/25 v1933 L3 Experimental Integer module l3prg.sty2010/08/04 v1992 L3 Experimental control structures l3clist.sty2010/08/04 v1992 L3 Experimental comma separated lists l3token.sty2010/04/11 v1890 L3 Experimental token investigation and manipu lation l3prop.sty2010/03/21 v1857 L3 Experimental Property Lists l3msg.sty2010/03/23 v1866 L3 Experimental LaTeX Messages module l3io.sty2010/05/22 v1923 L3 Experimental i/o module l3skip.sty2010/05/25 v1933 L3 Experimental skip registers l3box.sty2010/09/03 v2015 L3 Experimental Box module l3keyval.sty2010/04/11 v1890 L3 Experimental keyval processing l3keys.sty2010/05/24 v1931 L3 Experimental key-value support l3precom.sty2010/02/09 v1793 L3 Experimental precompilation module l3xref.sty2010/02/09 v1786 L3 Experimental cross referencing l3file.sty2010/03/21 v1853 L3 Experimental file loading l3fp.sty2010/09/14 v2021 L3 Experimental floating-point operations l3luatex.sty2010/07/18 v1985 L3 Experimental LuaTeX functions calc.sty2007/08/22 v4.3 Infix arithmetic (KKT,FJ) xparse.sty2010/05/23 v1927 Generic document command parser xkeyval.sty2008/08/13 v2.6a package option processing (HA) xkeyval.tex2008/08/13 v2.6a key=value parser (HA) fontspec-patches.sty2010/09/19 v2.1 Advanced font selection for XeLaTeX/Lua LaTeX fixltx2e.sty2006/09/13 v1.1m fixes to LaTeX fontenc.sty eu1enc.def2010/05/27 v0.1h Experimental Unicode font encodings eu1lmr.fd2009/10/30 v1.6 Font defs for Latin Modern xunicode.sty2010/05/18 v0.95 provides access to latin accents and many othe r characters in Unicode lower plane fontspec.cfg realscripts.sty2010/09/20 v0.2 Access OpenType subscripts and superscripts metalogo.sty2010/05/29 v0.12 Extended TeX logo macros graphicx.sty1999/02/16 v1.0f Enhanced LaTeX Graphics (DPC,SPQR) graphics.sty2009/02/05 v1.0o Standard LaTeX Graphics (DPC,SPQR) trig.sty1999/03/16 v1.09 sin cos tan (DPC) graphics.cfg2010/04/23 v1.9 graphics configuration of TeX Live xetex.def2009/11/22 v0.94 LaTeX color/graphics driver for XeTeX (RRM/JK) tipa.sty2002/08/08 TIPA version 1.1 fontenc.sty t3enc.def2001/12/31 T3 encoding eu1lmss.fd2009/10/30 v1.6 Font defs for Latin Modern eu1enc.def2010/05/27 v0.1h Experimental Unicode font encodings t3cmr.fd2001/12/31 TIPA font definitions *** -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
Am Wed, 22 Sep 2010 14:35:22 +0100 schrieb Paolo Matteucci: >> In the meantime the problem seems to be fixed: >> >> *File List* >> [...] >> fontspec.sty2010/08/01 v2.0c Advanced font selection for >> [...] >> > > But you seem to be using fontspec 2.0c (and no xunicode?), whereas the > latest version appears to be 2.1, i.e.: it's not fixed for me (although I do > have the workaround mentioned earlier on in this thread). Your example works fine for me, there are no trailing spaces. *File List* article.cls2007/10/19 v1.4h Standard LaTeX document class size10.clo2007/10/19 v1.4h Standard LaTeX file (size option) xltxtra.sty2010/09/20 v0.5e Improvements for the "XeLaTeX" format ifluatex.sty2010/03/01 v1.3 Provides the ifluatex switch (HO) ifxetex.sty2010/09/12 v0.6 Provides ifxetex conditional fontspec.sty2010/09/19 v2.1 Advanced font selection for XeLaTeX/LuaLaTeX expl3.sty2010/09/14 v2020 L3 Experimental code bundle wrapper l3names.sty2010/07/25 v1987 L3 Experimental Naming Scheme for TeX Primitiv es etex.sty1998/03/26 v2.0 eTeX basic definition package (PEB) l3basics.sty2010/08/04 v1992 L3 Experimental basic definitions l3expan.sty2010/08/04 v1991 L3 Experimental Argument Expansion module l3tl.sty2010/05/22 v1919 L3 Experimental Token Lists l3intexpr.sty2010/06/15 v1957 L3 Integer Expressions l3quark.sty2010/03/21 v1853 L3 Experimental Quark Commands l3seq.sty2010/03/29 v1879 L3 Experimental sequences and stacks l3toks.sty2010/05/25 v1933 L3 Experimental Token Registers l3int.sty2010/05/25 v1933 L3 Experimental Integer module l3prg.sty2010/08/04 v1992 L3 Experimental control structures l3clist.sty2010/08/04 v1992 L3 Experimental comma separated lists l3token.sty2010/04/11 v1890 L3 Experimental token investigation and manipu lation l3prop.sty2010/03/21 v1857 L3 Experimental Property Lists l3msg.sty2010/03/23 v1866 L3 Experimental LaTeX Messages module l3io.sty2010/05/22 v1923 L3 Experimental i/o module l3skip.sty2010/05/25 v1933 L3 Experimental skip registers l3box.sty2010/09/03 v2015 L3 Experimental Box module l3keyval.sty2010/04/11 v1890 L3 Experimental keyval processing l3keys.sty2010/05/24 v1931 L3 Experimental key-value support l3precom.sty2010/02/09 v1793 L3 Experimental precompilation module l3xref.sty2010/02/09 v1786 L3 Experimental cross referencing l3file.sty2010/03/21 v1853 L3 Experimental file loading l3fp.sty2010/09/14 v2021 L3 Experimental floating-point operations l3luatex.sty2010/07/18 v1985 L3 Experimental LuaTeX functions calc.sty2007/08/22 v4.3 Infix arithmetic (KKT,FJ) xparse.sty2010/05/23 v1927 Generic document command parser xkeyval.sty2008/08/13 v2.6a package option processing (HA) xkeyval.tex2008/08/13 v2.6a key=value parser (HA) fontspec-patches.sty2010/09/19 v2.1 Advanced font selection for XeLaTeX/Lua LaTeX fixltx2e.sty2006/09/13 v1.1m fixes to LaTeX fontenc.sty eu1enc.def2010/05/27 v0.1h Experimental Unicode font encodings eu1lmr.fd2009/10/30 v1.6 Font defs for Latin Modern xunicode.sty2008/02/08 v0.91 provides access to latin accents and many othe r characters in Unicode lower plane fontspec.cfg realscripts.sty2010/09/20 v0.2 Access OpenType subscripts and superscripts metalogo.sty2010/05/29 v0.12 Extended TeX logo macros graphicx.sty1999/02/16 v1.0f Enhanced LaTeX Graphics (DPC,SPQR) graphics.sty2009/02/05 v1.0o Standard LaTeX Graphics (DPC,SPQR) trig.sty1999/03/16 v1.09 sin cos tan (DPC) graphics.cfg2007/01/18 v1.5 graphics configuration of teTeX/TeXLive xetex.def2009/11/22 v0.94 LaTeX color/graphics driver for XeTeX (RRM/JK) tipa.sty2002/08/08 TIPA version 1.1 fontenc.sty t3enc.def2001/12/31 T3 encoding eu1lmss.fd2009/10/30 v1.6 Font defs for Latin Modern eu1enc.def2010/05/27 v0.1h Experimental Unicode font encodings t3cmr.fd2001/12/31 TIPA font definitions -- Ulrike Fischer -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
2010/9/22 Heiko Oberdiek
>
> #1 is "a" (without blank space), \scantokens then reads
> a new line "a" and is converted to {blank space}...
>
Thank you for the TeXnical explanation, Heiko, although I must confess I can
only follow it up to a point... ;-)
> In the meantime the problem seems to be fixed:
>
> *File List*
> [...]
> fontspec.sty2010/08/01 v2.0c Advanced font selection for
> [...]
>
But you seem to be using fontspec 2.0c (and no xunicode?), whereas the
latest version appears to be 2.1, i.e.: it's not fixed for me (although I do
have the workaround mentioned earlier on in this thread).
Thanks,
Paolo
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On Tue, Sep 21, 2010 at 11:26:37PM +0100, Paolo Matteucci wrote:
> ?At least something "in the neighbourhood of" \scantokens, as some tracing
> reveals:
>
> [without xltxtra:]
>
> {changing \...@encoding=macro:->OT1}
> {into \...@encoding=macro:->T3}
> {the letter a}
> {end-group character }}
>
> [with xltxtra:]
>
> \implementTIPAtextx #1->\scantokens {#1}\egroup
> #1<-a
> {\scantokens}
> {the letter a}
> {blank space }
> {end-group character }}
>
> ?but my TeXnical knowledge stops here. :-(
#1 is "a" (without blank space), \scantokens then reads
a new line "a" and is converted to {blank space}.
I don't know, why \scantokens is used at all -- it usually
causes more problems than it solves. But if it is being used,
then the code should take care of
* end of line, e.g. can be suppressed by \endlinechar=-1 %
* \everyeof that might not be empty.
In the meantime the problem seems to be fixed:
*File List*
article.cls2007/10/19 v1.4h Standard LaTeX document class
size10.clo2007/10/19 v1.4h Standard LaTeX file (size option)
xltxtra.sty2010/09/20 v0.5e Improvements for the "XeLaTeX" format
ifluatex.sty2010/03/01 v1.3 Provides the ifluatex switch (HO)
ifxetex.sty2010/09/12 v0.6 Provides ifxetex conditional
fontspec.sty2010/08/01 v2.0c Advanced font selection for
XeLaTeX/LuaLaTeX
expl3.sty2010/09/14 v2020 L3 Experimental code bundle wrapper
l3names.sty2010/07/25 v1987 L3 Experimental Naming Scheme for TeX
Primitives
etex.sty1998/03/26 v2.0 eTeX basic definition package (PEB)
l3basics.sty2010/08/04 v1992 L3 Experimental basic definitions
l3expan.sty2010/08/04 v1991 L3 Experimental Argument Expansion module
l3tl.sty2010/05/22 v1919 L3 Experimental Token Lists
l3intexpr.sty2010/06/15 v1957 L3 Integer Expressions
l3quark.sty2010/03/21 v1853 L3 Experimental Quark Commands
l3seq.sty2010/03/29 v1879 L3 Experimental sequences and stacks
l3toks.sty2010/05/25 v1933 L3 Experimental Token Registers
l3int.sty2010/05/25 v1933 L3 Experimental Integer module
l3prg.sty2010/08/04 v1992 L3 Experimental control structures
l3clist.sty2010/08/04 v1992 L3 Experimental comma separated lists
l3token.sty2010/04/11 v1890 L3 Experimental token investigation and
manipulation
l3prop.sty2010/03/21 v1857 L3 Experimental Property Lists
l3msg.sty2010/03/23 v1866 L3 Experimental LaTeX Messages module
l3io.sty2010/05/22 v1923 L3 Experimental i/o module
l3skip.sty2010/05/25 v1933 L3 Experimental skip registers
l3box.sty2010/09/03 v2015 L3 Experimental Box module
l3keyval.sty2010/04/11 v1890 L3 Experimental keyval processing
l3keys.sty2010/05/24 v1931 L3 Experimental key-value support
l3precom.sty2010/02/09 v1793 L3 Experimental precompilation module
l3xref.sty2010/02/09 v1786 L3 Experimental cross referencing
l3file.sty2010/03/21 v1853 L3 Experimental file loading
l3fp.sty2010/09/14 v2021 L3 Experimental floating-point operations
l3luatex.sty2010/07/18 v1985 L3 Experimental LuaTeX functions
calc.sty2007/08/22 v4.3 Infix arithmetic (KKT,FJ)
xparse.sty2009/11/06 v1727 Generic document command parser
xkeyval.sty2008/08/13 v2.6a package option processing (HA)
xkeyval.tex2008/08/13 v2.6a key=value parser (HA)
fontspec-patches.sty2010/08/01 v2.0c Advanced font selection for
XeLaTeX/LuaLaTeX
fixltx2e.sty2006/09/13 v1.1m fixes to LaTeX
fontenc.sty
eu1enc.def2010/05/27 v0.1h Experimental Unicode font encodings
eu1lmr.fd2009/10/30 v1.6 Font defs for Latin Modern
fontspec.cfg
realscripts.sty2010/09/20 v0.2 Access OpenType subscripts and
superscripts
metalogo.sty2010/05/29 v0.12 Extended TeX logo macros
graphicx.sty1999/02/16 v1.0f Enhanced LaTeX Graphics (DPC,SPQR)
graphics.sty2009/02/05 v1.0o Standard LaTeX Graphics (DPC,SPQR)
trig.sty1999/03/16 v1.09 sin cos tan (DPC)
graphics.cfg2010/04/23 v1.9 graphics configuration of TeX Live
xetex.def2009/11/22 v0.94 LaTeX color/graphics driver for XeTeX
(RRM/JK)
tipa.sty2002/08/08 TIPA version 1.1
fontenc.sty
t3enc.def2001/12/31 T3 encoding
eu1lmss.fd2009/10/30 v1.6 Font defs for Latin Modern
eu1enc.def2010/05/27 v0.1h Experimental Unicode font encodings
t3cmr.fd2001/12/31 TIPA font definitions
***
Yours sincerely
Heiko Oberdiek
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
2010/9/21 Paolo Matteucci
>
> 2010/9/20 Alan Munn
>
>
>> Putting \relax after the last character in the TIPA string will solve
>> the problem.
>>
>> \textipa{a\relax}
>>
>
> Thank you, Alan, for the quick fix, although this doesn’t explain why this
> is happening in the first place, and where the "bug" is…
>
By the way, if anyone is interested, I found out that the only way to fix
this without having to explicitly change all the occurrences of \textipa in
my document(s) was to add something like this *in the preamble*:
\let\oldImplementTIPAtext\implementTIPAtext
\def\implementTIPAtext#1{\oldImplementTIPAtext{#1\relax}}% renewcommand
doesn't work here
2010/9/21 Heiko Oberdiek
>
> A bug, probably the use of \scantokens without \endlinechar=-1,
> thus the space is the consequence of the uncommented endline character.
…At least something "in the neighbourhood of" \scantokens, as some tracing
reveals:
[without xltxtra:]
{changing \...@encoding=macro:->OT1}
{into \...@encoding=macro:->T3}
{the letter a}
{end-group character }}
[with xltxtra:]
\implementTIPAtextx #1->\scantokens {#1}\egroup
#1<-a
{\scantokens}
{the letter a}
{blank space }
{end-group character }}
…but my TeXnical knowledge stops here. :-(
Paolo
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On Tue, Sep 21, 2010 at 03:30:20PM +0200, Heiko Oberdiek wrote: > After an update of TL, the example breaks with lots of errors and warnings: Sorry false alarm, an old fontspec.sty in the scratch directory was found first. Yours sincerely Heiko Oberdiek -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On Mon, Sep 20, 2010 at 03:42:07PM +0100, Paolo Matteucci wrote:
> Hi all. I?ve updated my TexLive distribution today, and started noticing
> that, if you invoke the tipa package with xltxtra (and hence fontspec and
> xunicode) loaded, you get an extra trailing space just before the end of the
> \textipa environment.
>
> Minimal example:
>
>
> % !Mode:: "TeX:UTF-8"
> %&xelatex
>
> %!TEX TS-program = xelatex
>
> %!TEX encoding = UTF-8 Unicode
>
>
> \documentclass{article}
>
> \usepackage{xltxtra}
>
> \usepackage{tipa}
>
> \begin{document}
>
> \section*{Test}
>
> [\textipa{a}]
>
> \end{document}
A bug, probably the use of \scantokens without \endlinechar=-1,
thus the space is the consequence of the uncommented endline character.
After an update of TL, the example breaks with lots of errors and warnings:
LaTeX Warning: You have requested, on input line 27, version
`2010/05/14 v2.0' of package fontspec,
but only version
`2009/11/02 v2.0 Advanced font selection for XeLaTeX'
is available.
LaTeX Warning: You have requested, on input line 15, version
`2010/05/14 v2.0' of package fontspec,
but only version
`2009/11/02 v2.0 Advanced font selection for XeLaTeX'
is available.
! Undefined control sequence.
\DeclareDocumentCommand
\fakesubscript {m...@textsubscript
{\sele...
l.29 }
Yours sincerely
Heiko Oberdiek
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On Sep 20, 2010, at 1:07 PM, Peter Dyballa wrote:
> You're obvious using a TeX Live 2010 binary with the TeX Live 2009
> distribution:
>
Ahem, are we sure about this? ;-)
Comparing my log with Alan’s, I’d say I’ve got TeX Live 2010 binaries *and*
distribution: simply, it looks like the TeX Live Manager updated my 2009
distribution "in situ" in the 2009 *directory* (on Windows without even
notifying me: on the Mac, the TeX Live Utility told me about
distribution/TeX Manager incompatibility, but by reinstalling the TeX Live
Manager from it, it proceeded as on Windows): whether this behaviour should
be prevented, or vice versa encouraged by making it more obvious, might be
the topic for a different discussion (on a different list?).
2010/9/20 Alan Munn
> Putting \relax after the last character in the TIPA string will solve the
> problem.
>
> \textipa{a\relax}
>
Thank you, Alan, for the quick fix, although this doesn’t explain why this
is happening in the first place, and where the "bug" is. After further
investigation, fontspec [v2.1] (i.e. *not* xltxtra or xunicode) seems to be
the "culprit" here: it could be as simple as a percent sign missing
somewhere or be due to some subtle font/encoding interaction. Will or Khaled
might want to have a look at this…
Many thanks,
Paolo
--
Subscriptions, Archive, and List information, etc.:
http://tug.org/mailman/listinfo/xetex
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
On Sep 20, 2010, at 1:07 PM, Peter Dyballa wrote:
Am 20.09.2010 um 16:42 schrieb Paolo Matteucci:
I’ve updated my TexLive distribution today, and started noticing
that, if you invoke the tipa package with xltxtra (and hence
fontspec and
xunicode) loaded, you get an extra trailing space just before the
end of the
\textipa environment.
You're obvious using a TeX Live 2010 binary with the TeX Live 2009
distribution:
This is XeTeX, Version 3.1415926-2.2-0.9997.4 (Web2C 2010)
(format=xelatex 2010.9.20) 20 SEP 2010 15:38
entering extended mode
restricted \write18 enabled.
%&-line parsing enabled.
**tipa_test.tex
(./tipa_test.tex
LaTeX2e <2009/09/24>
Babel and hyphenation patterns for ... loaded.
(z:/texlive/2009/texmf-dist/tex/latex/base/article.cls
Document Class: article 2007/10/19 v1.4h Standard LaTeX document
class
(z:/texlive/2009/texmf-dist/tex/latex/base/size10.clo
File: size10.clo 2007/10/19 v1.4h Standard LaTeX file (size option)
You see?
Although that's true, it's not the source of the problem. I get the
same output with TL 2010. Putting \relax after the last character in
the TIPA string will solve the problem.
\textipa{a\relax}
You see? :-)
This is XeTeX, Version 3.1415926-2.2-0.9997.4 (TeX Live 2010)
restricted \write18 enabled.
entering extended mode
(./include-test.tex
LaTeX2e <2009/09/24>
Babel and hyphenation patterns for english, dumylang,
nohyphenation, ge
rman-x-2009-06-19, ngerman-x-2009-06-19, ancientgreek, ibycus, arabic,
armenian
, basque, bulgarian, catalan, pinyin, coptic, croatian, czech, danish,
dutch, u
kenglish, usenglishmax, esperanto, estonian, farsi, finnish, french,
galician,
german, ngerman, swissgerman, monogreek, greek, hungarian, icelandic,
assamese,
bengali, gujarati, hindi, kannada, malayalam, marathi, oriya,
panjabi, tamil,
telugu, indonesian, interlingua, irish, italian, kurmanji, lao, latin,
latvian,
lithuanian, mongolian, mongolianlmc, bokmal, nynorsk, polish,
portuguese, roma
nian, russian, sanskrit, serbian, slovak, slovenian, spanish, swedish,
turkish,
turkmen, ukrainian, uppersorbian, welsh, loaded.
(/usr/local/texlive/2010/texmf-dist/tex/latex/base/article.cls
Document Class: article 2007/10/19 v1.4h Standard LaTeX document class
(/usr/local/texlive/2010/texmf-dist/tex/latex/base/size10.clo))
(/usr/local/texlive/2010/texmf-dist/tex/xelatex/xltxtra/xltxtra.sty
(/usr/local/texlive/2010/texmf-dist/tex/generic/oberdiek/ifluatex.sty)
(/usr/local/texlive/2010/texmf-dist/tex/generic/ifxetex/ifxetex.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/fontspec/fontspec.sty
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/expl3.sty
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3names.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/etex-pkg/etex.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3basics.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3expan.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3tl.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3intexpr.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3quark.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3seq.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3toks.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3int.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3prg.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3clist.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3token.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3prop.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3msg.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3io.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3skip.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3box.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3keyval.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3keys.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3precom.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3xref.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3file.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3fp.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/expl3/l3luatex.sty)
(/usr/local/texlive/2010/texmf-dist/tex/latex/tools/calc.sty))
(/usr/local/texlive/2010/texmf-dist/tex/latex/xpackages/xbase/
xparse.sty)
(/usr/local/texlive/2010/texmf-dist/tex/generic/kastrup/binhex.tex)
(./xkeyval.sty (./xkeyval.tex (./keyval.tex)))
(/usr/local/texlive/2010/texmf-dist/tex/latex/fontspec/fontspec-
patches.sty
(/usr/local/texlive/2010/texmf-dist/tex/latex/base/fixltx2e.sty))
(/usr/local/texlive/2010/texmf-dist/tex/latex/base/fontenc.sty
(/usr/local/texlive/2010/texmf-dist/tex/latex/euenc/eu1enc.def)
(/usr/local/texlive/2010/texmf-dist/tex/latex/euenc/eu1lmr.fd))
fontspec.cfg loaded.
(/usr/local/texlive/201
Re: [XeTeX] Extra trailing space in IPA font with xltxtra
Am 20.09.2010 um 16:42 schrieb Paolo Matteucci: I’ve updated my TexLive distribution today, and started noticing that, if you invoke the tipa package with xltxtra (and hence fontspec and xunicode) loaded, you get an extra trailing space just before the end of the \textipa environment. You're obvious using a TeX Live 2010 binary with the TeX Live 2009 distribution: This is XeTeX, Version 3.1415926-2.2-0.9997.4 (Web2C 2010) (format=xelatex 2010.9.20) 20 SEP 2010 15:38 entering extended mode restricted \write18 enabled. %&-line parsing enabled. **tipa_test.tex (./tipa_test.tex LaTeX2e <2009/09/24> Babel and hyphenation patterns for ... loaded. (z:/texlive/2009/texmf-dist/tex/latex/base/article.cls Document Class: article 2007/10/19 v1.4h Standard LaTeX document class (z:/texlive/2009/texmf-dist/tex/latex/base/size10.clo File: size10.clo 2007/10/19 v1.4h Standard LaTeX file (size option) You see? -- Greetings Pete There are two major products that come out of Berkeley: LSD and UNIX. We don't believe this to be a coincidence. - Jeremy S. Anderson -- Subscriptions, Archive, and List information, etc.: http://tug.org/mailman/listinfo/xetex
