Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Thu, May 25, 2017 at 09:09:03PM +0200, Jean-Pierre wrote:
> 
> 
> 
>  Message d'origine 
> De : Scott Kostyshak <skost...@lyx.org>
> Envoyé : 25 mai 2017 16:59:17 GMT+02:00
> À : lyx-devel@lists.lyx.org
> Objet : Re: LyX docs: cleaning up math options
> 
> Jean-Pierre, what is the status on this? I have not followed closely all
> the discussions in this thread. Is anything blocking progress?
> 
> I posted a progress point on the list 3 weeks ago or so. As I did not  get an 
> answer, I opened a ticket to collect comments there (#10661).

Ah I forgot about that. I'll post there.

Thanks,

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Jean-Pierre]

 Message d'origine 
De : Scott Kostyshak <skost...@lyx.org>
Envoyé : 25 mai 2017 16:59:17 GMT+02:00
À : lyx-devel@lists.lyx.org
Objet : Re: LyX docs: cleaning up math options

Jean-Pierre, what is the status on this? I have not followed closely all
the discussions in this thread. Is anything blocking progress?

I posted a progress point on the list 3 weeks ago or so. As I did not  get an 
answer, I opened a ticket to collect comments there (#10661).

-- 
Jean-Pierre

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

Jean-Pierre, what is the status on this? I have not followed closely all
the discussions in this thread. Is anything blocking progress?

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Samstag, 15. April 2017 um 18:58:28, schrieb Guenter Milde 

> >> It seems you are missing some docbook export requirements.
> >> What does Help>LaTeX Configuratin tell you about Docbook support?
> >> (Here, it says: "Found: no".)
> 
> > "Found: yes" all right.
> 
> Then, its really strange. But as I don't have Docbook, I cannot help.

In the meantime we figured it out. Missing converter from DocBook to Postscript.
(E.g. after installing sgmltools it is now OK)

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2017-04-15, Jean-Pierre Chrétien wrote:
> Le 15/04/2017 à 11:51, Guenter Milde a écrit :
>> On 2017-04-14, Jean-Pierre Chrétien wrote:


>> If agutex.cls is not in TeXLive, the tests requiring it should be added
>> to unreliableTests under the Sublabel: nonstandard
>> (Preferably with an URL for the class file)

> The link is not available any more. Kornel has it, should we put it in
> the wiki?

IMV, it does not makes sense to make copies of obsoleted class files
available in the wiki.

>> If the class file is no longer available at all, we should deprecate the
>> layout (i.e. support it for existing documents but don't let it show up in
>> the documentclass selection list).

> Right, it is obsoleted by AGU and replaced by agujournal.cls, I plan to
> adapt the AGU layout to this new class.

We had discussed¹ options for "Layouts for document classes with
incompatible versions" and placed a section in Development.lyx last year.

¹ http://permalink.gmane.org/gmane.editors.lyx.devel/161126

> Note that the same problem arises about ACM, the new acmart.cls class
> aims to replace obsoleted acmsiggraph.cls and such. John Perry proposed
> a layout for the new class today.

> So deprecation must affect agutex.layout, agu-dtd.layout, agums.layout,
> acmsiggraph-0.92.layout, acmsiggraph.layout,  acm-sigs-alt.layout and
> acm-sigs.layout.

According to Development.lyx, deprecation includes:

* Update the GUI name in the old layout file (whose name should not be
  changed), e.g.:\DeclareLaTeXClass{ACM SIGGRAPH (obsolete)}

  (Actually hiding it from the user would require changes to the GUI
  code, but the user is clearly warned at least.)

* update the example and template files to use the new layout. Add a note
  about the changes (preferably with a pointer to the documentation of
  the changes).

  This way, new documents based on the template or example will use the
  up-to-date document class version.



> BTW, as noweb is obsoleted in CTAN, all noweb-dependent layouts should
> also be deprecated.

Is there a recommendation what to use instead of noweb?
Is noweb still available from another place?

Unless we have something to replace it, it should not be deprecated in the
sense above. However, the relevant ctest tests should be added to 
unreliableTests Sublabel: nonstandard.


>>> and I'm puzzled by the docbook_article error, if I open the file with
>>> LyX I have only LyXhtml output available, in spite of the DEFAULTOUTPUT
>>> label.

>> It seems you are missing some docbook export requirements.
>> What does Help>LaTeX Configuratin tell you about Docbook support?
>> (Here, it says: "Found: no".)

> "Found: yes" all right.

Then, its really strange. But as I don't have Docbook, I cannot help.

>> In any case, no worry for the math options :-)

> It seems that one can insert math in docbook_article, right ?

Don't know. Even if it is possible in LyX, I don't know how good it is
supported in Docbook (if at all).

Günter

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 15/04/2017 à 11:51, Guenter Milde a écrit :

On 2017-04-14, Jean-Pierre Chrétien wrote:




If agutex.cls is not in TeXLive, the tests requiring it should be added
to unreliableTests under the Sublabel: nonstandard
(Preferably with an URL for the class file)


The link is not available any more. Kornel has it, should we put it in the wiki?



If the class file is no longer available at all, we should deprecate the
layout (i.e. support it for existing documents but don't let it show up in
the documentclass selection list).


Right, it is obsoleted by AGU and replaced by agujournal.cls, I plan to adapt 
the AGU layout to this new class.


Note that the same problem arises about ACM, the new acmart.cls class aims to 
replace obsoleted acmsiggraph.cls and such. John Perry proposed a layout for the 
new class today.


So deprecation must affect agutex.layout, agu-dtd.layout, agums.layout, 
acmsiggraph-0.92.layout, acmsiggraph.layout,  acm-sigs-alt.layout and 
acm-sigs.layout.


BTW, as noweb is obsoleted in CTAN, all noweb-dependent layouts should also be 
deprecated.





and I'm puzzled by the docbook_article error, if I open the file with
LyX I have only LyXhtml output available, in spite of the DEFAULTOUTPUT
label.


It seems you are missing some docbook export requirements.
What does Help>LaTeX Configuratin tell you about Docbook support?
(Here, it says: "Found: no".)


"Found: yes" all right.


In any case, no worry for the math options :-)


It seems that one can insert math in docbook_article, right ?

--
Jean-Pierre

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 15/04/2017 à 11:22, Kornel Benko a écrit :

Am Freitag, 14. April 2017 um 23:36:26, schrieb Jean-Pierre Chrétien 


The following tests FAILED:
3285 - DEFAULTOUTPUT_export/examples/docbook_article_pdf (Failed)
5644 - export/templates/AGUTeX_pdf (Failed)
5645 - export/templates/AGUTeX_pdf2 (Failed)

I still do not have agutex.cls, I asked to AGU to get it, and I'm puzzled by the
docbook_article error, if I open the file with LyX I have only LyXhtml output
available, in spite of the DEFAULTOUTPUT label.


I don't see it
# ctest -L default -N | grep docbook_article
  Test #3344: DEFAULTOUTPUT_export/examples/docbook_article_pdf


Sure, but what happen if you really run it ?



Jean-Pierre, I can send you the content of my 
/usr/local/texlive/texmf-local/tex/latex/agutex.
# ls -l
-rw-rw-r-- 1 kornel kornel  31453 mar 26  2008 agu-ps.sty
-rw-rw-r-- 1 kornel kornel 226294 aug  6  2013 agutex.cls
lrwxrwxrwx 1 kornel kornel 10 apr 15 09:42 AGUTeX.cls -> 
agutex.cls
-rw-rw-r-- 1 kornel kornel 225581 mar 11  2013 AGUTeX.cls.old
-rw-rw-r-- 1 kornel kornel  16182 mar 18  2013 agutmpl.tex
I got them from http://publications.agu.org/files/2013/03/AGU-LaTeX.zip, but 
this page does not longer exist.


That's my problem, it is not more available, so please, send me the zip file by 
private mail.


--
Jean-Pierre

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2017-04-14, Jean-Pierre Chrétien wrote:

> With this I'm down to 3 failures.

> The following tests FAILED:
>   3285 - DEFAULTOUTPUT_export/examples/docbook_article_pdf (Failed)
>   5644 - export/templates/AGUTeX_pdf (Failed)
>   5645 - export/templates/AGUTeX_pdf2 (Failed)

> I still do not have agutex.cls, I asked to AGU to get it,

If agutex.cls is not in TeXLive, the tests requiring it should be added
to unreliableTests under the Sublabel: nonstandard
(Preferably with an URL for the class file)

If the class file is no longer available at all, we should deprecate the
layout (i.e. support it for existing documents but don't let it show up in
the documentclass selection list).

> and I'm puzzled by the docbook_article error, if I open the file with
> LyX I have only LyXhtml output available, in spite of the DEFAULTOUTPUT
> label.

It seems you are missing some docbook export requirements.
What does Help>LaTeX Configuratin tell you about Docbook support?
(Here, it says: "Found: no".)
In any case, no worry for the math options :-)

Günter

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Freitag, 14. April 2017 um 23:36:26, schrieb Jean-Pierre Chrétien 

> The following tests FAILED:
> 3285 - DEFAULTOUTPUT_export/examples/docbook_article_pdf (Failed)
> 5644 - export/templates/AGUTeX_pdf (Failed)
> 5645 - export/templates/AGUTeX_pdf2 (Failed)
> 
> I still do not have agutex.cls, I asked to AGU to get it, and I'm puzzled by 
> the 
> docbook_article error, if I open the file with LyX I have only LyXhtml output 
> available, in spite of the DEFAULTOUTPUT label.

I don't see it
# ctest -L default -N | grep docbook_article
  Test #3344: DEFAULTOUTPUT_export/examples/docbook_article_pdf

Jean-Pierre, I can send you the content of my 
/usr/local/texlive/texmf-local/tex/latex/agutex.
# ls -l 
-rw-rw-r-- 1 kornel kornel  31453 mar 26  2008 agu-ps.sty
-rw-rw-r-- 1 kornel kornel 226294 aug  6  2013 agutex.cls
lrwxrwxrwx 1 kornel kornel 10 apr 15 09:42 AGUTeX.cls -> 
agutex.cls
-rw-rw-r-- 1 kornel kornel 225581 mar 11  2013 AGUTeX.cls.old
-rw-rw-r-- 1 kornel kornel  16182 mar 18  2013 agutmpl.tex
I got them from http://publications.agu.org/files/2013/03/AGU-LaTeX.zip, but 
this page does not longer exist.

With this installed:
# ctest -R export/templates/AGUTeX_pdf
Test project /BUILD/BUILDMint17/BuildLyxGitQt5.9beta-gcc6.2
Start 5710: export/templates/AGUTeX_pdf
1/7 Test #5710: export/templates/AGUTeX_pdf    Passed9.39 sec
Start 5711: export/templates/AGUTeX_pdf2
2/7 Test #5711: export/templates/AGUTeX_pdf2 ...   Passed2.62 sec
Start 5712: export/templates/AGUTeX_pdf3
3/7 Test #5712: export/templates/AGUTeX_pdf3 ...   Passed7.52 sec
Start 5713: export/templates/AGUTeX_pdf4_texF
4/7 Test #5713: export/templates/AGUTeX_pdf4_texF ..   Passed3.88 sec
Start 5714: export/templates/AGUTeX_pdf4_systemF
5/7 Test #5714: export/templates/AGUTeX_pdf4_systemF ...   Passed8.44 sec
Start 5715: export/templates/AGUTeX_pdf5_texF
6/7 Test #5715: export/templates/AGUTeX_pdf5_texF ..   Passed3.95 sec
Start 5716: export/templates/AGUTeX_pdf5_systemF
7/7 Test #5716: export/templates/AGUTeX_pdf5_systemF ...   Passed   11.81 sec

100% tests passed, 0 tests failed out of 7

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 13/04/2017 à 10:33, Kornel Benko a écrit :

Am Donnerstag, 13. April 2017 um 09:53:06, schrieb Jean-Pierre Chrétien 


Le 12/04/2017 à 15:20, Kornel Benko a écrit :

Am Mittwoch, 12. April 2017 um 14:31:23, schrieb Jean-Pierre Chrétien 



  2/ the noweb files miss a literate to latex converter (5/33)


You mean NoWeb-> latex


Ok I see, literate is the short name of the file format


The converter I use is "noweave", part package "noweb".



The Tool/Noweb page of the wiki mentions only notangle, it seems outdated.
So, what exactly is the noweave command that I shouls put in the Noweb->latex
converter? Is it normal that this is not configured by LyX at reconfigure time
when noweb is present ?



No, I had nothing to do here. Simply install noweb, reconfigure and you should 
be done.


You're right, I forgot to put /usr/local/noweb/bin in the PATH, and to copy the 
contents of .lyx2.3/ in Testing/.lyx to get the noweb converters, and I 
understood that I must rerun the prefTest.pl command after each reconfigure.


With this I'm down to 3 failures.

The following tests FAILED:
3285 - DEFAULTOUTPUT_export/examples/docbook_article_pdf (Failed)
5644 - export/templates/AGUTeX_pdf (Failed)
5645 - export/templates/AGUTeX_pdf2 (Failed)

I still do not have agutex.cls, I asked to AGU to get it, and I'm puzzled by the 
docbook_article error, if I open the file with LyX I have only LyXhtml output 
available, in spite of the DEFAULTOUTPUT label.


But I think I can enter now in the test phase of the math options cleanup.
Thanks for you help, Kornel, José and Günther. I'm glad to have a ctest 
configuration almost operational.


--
Jean-Pierre

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Donnerstag, 13. April 2017 um 09:53:06, schrieb Jean-Pierre Chrétien 

> Le 12/04/2017 à 15:20, Kornel Benko a écrit :
> > Am Mittwoch, 12. April 2017 um 14:31:23, schrieb Jean-Pierre Chrétien 
> > 
> >
> >>   2/ the noweb files miss a literate to latex converter (5/33)
> >
> > You mean NoWeb-> latex
> 
> Ok I see, literate is the short name of the file format
> 
> > The converter I use is "noweave", part package "noweb".
> >
> 
> The Tool/Noweb page of the wiki mentions only notangle, it seems outdated.
> So, what exactly is the noweave command that I shouls put in the Noweb->latex 
> converter? Is it normal that this is not configured by LyX at reconfigure 
> time 
> when noweb is present ?
> 

No, I had nothing to do here. Simply install noweb, reconfigure and you should 
be done.

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 12/04/2017 à 15:20, Kornel Benko a écrit :

Am Mittwoch, 12. April 2017 um 14:31:23, schrieb Jean-Pierre Chrétien 



  2/ the noweb files miss a literate to latex converter (5/33)


You mean NoWeb-> latex


Ok I see, literate is the short name of the file format


The converter I use is "noweave", part package "noweb".



The Tool/Noweb page of the wiki mentions only notangle, it seems outdated.
So, what exactly is the noweave command that I shouls put in the Noweb->latex 
converter? Is it normal that this is not configured by LyX at reconfigure time 
when noweb is present ?


--
Jean-Pierre

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2017-04-12, Jean-Pierre Chrétien wrote:
> Le 12/04/2017 à 12:05, Guenter Milde a écrit :
...
>>> I applied this, and I am now down to 33 failures :

>>> The following tests FAILED:
>>> 1777 - export/doc/cs/Tutorial_pdf (Failed)
>>> 1778 - DEFAULTOUTPUT_export/doc/cs/Tutorial_pdf2 (Failed)
...

>> These work here for me (subset of Debian TeXLive packages).
>> It seems you are missing some language definition files.

> I'm puzzled, the failure is due to missing document class either Book or 
> Article, which makes no sense as all the previous test on doc files passed.

This is rather a mixup or failure of the error reporting.

> Here is an example of the ctest log:

> 
> 1777/6420 Testing: export/doc/cs/Tutorial_pdf
...
> Warning: Document class not available
...
> document cannot be compiled until the following
> prerequisites are installed:
> book.cls
> 

What happens, if you compile cs/Tutorial.lyx "by hand" (using the same LyX
instance as the test suite)?

Günter

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Mittwoch, 12. April 2017 um 14:31:23, schrieb Jean-Pierre Chrétien 

...

>   - I had not installed knitr and dependencies in R, knitr.lyx and
>   Rjournal.lyx
> 
> work OK now by hand (I documented the installation in the wiki);

You may want to configure converters for ctest-lyx too, e.g
# cd lyx-build-dir
# ./bin/lyx -userdir ./Testing/.lyx

>   - templates/AGUtex.lyx fails because I do not have agutex.cls installed,
>   and
> 
> won't be able to do it from Internet as the class has been obsoleted by AGU.
> If someone has it... (just for the sake of completeness).
> To summarize:
>   1/ all the tests failing because of missing packages run OK when I compile 
> by 
> hand (21/33)
>   2/ the noweb files miss a literate to latex converter (5/33)

You mean NoWeb-> latex
The converter I use is "noweave", part package "noweb".

>   3/ the files using module Rnw work by hand, I expect them to run with ctest 
> (4/33)

Again, missing converter in ctest-lyx?

>   4/ the AGUtex file misses an obsoleted class file (2/33)
>   5/ the docbook file is irrelevant (1/33).
> 
> I'm going to investigate problem 1/ further. I built the cmake tree from 
> scratch, but I may try again, or run from the intermediate files created to 
> execute the tests. I need info to cope with 2/ and 4/.
> 
> -- 
> Jean-Pierre

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 12/04/2017 à 12:05, Guenter Milde a écrit :

On 2017-04-11, Jean-Pierre Chrétien wrote:

Le 11/04/2017 à 10:13, Kornel Benko a écrit :

Am Dienstag, 11. April 2017 um 09:33:15, schrieb Jean-Pierre Chrétien 




I applied this, and I am now down to 33 failures :



The following tests FAILED:
1777 - export/doc/cs/Tutorial_pdf (Failed)
1778 - DEFAULTOUTPUT_export/doc/cs/Tutorial_pdf2 (Failed)
2177 - export/doc/eu/Intro_pdf (Failed)
2178 - DEFAULTOUTPUT_export/doc/eu/Intro_pdf2 (Failed)
2193 - export/doc/eu/Tutorial_pdf (Failed)
2194 - DEFAULTOUTPUT_export/doc/eu/Tutorial_pdf2 (Failed)
2716 - export/doc/pl/Intro_pdf (Failed)
2717 - DEFAULTOUTPUT_export/doc/pl/Intro_pdf2 (Failed)
2732 - export/doc/pl/Tutorial_pdf (Failed)
2733 - DEFAULTOUTPUT_export/doc/pl/Tutorial_pdf2 (Failed)


...

These work here for me (subset of Debian TeXLive packages).
It seems you are missing some language definition files.


I'm puzzled, the failure is due to missing document class either Book or 
Article, which makes no sense as all the previous test on doc files passed.

Here is an example of the ctest log:


1777/6420 Testing: export/doc/cs/Tutorial_pdf
1777/6420 Test: export/doc/cs/Tutorial_pdf
Command: "/usr/bin/cmake" "-DLYX_ROOT=/ext/lyx/master/lib/doc" 
"-DLYX_TESTS_USERDIR=/ext/lyx/buildmaster/Testing/.lyx" 
"-Dlyx=/ext/lyx/buildmaster/bin/lyx2.3" 
"-DWORKDIR=/ext/lyx/buildmaster/autotests/out-home" "-Dformat=pdf" 
"-Dfonttype=defaultF" "-Dextension=pdf" "-Dfile=cs/Tutorial" "-Dinverted=0" 
"-DTOP_SRC_DIR=/ext/lyx/master" "-DIgnoreErrorMessage=" 
"-DPERL_EXECUTABLE=/usr/local/bin/perl" "-DXMLLINT_EXECUTABLE=/usr/bin/xmllint" 
"-DENCODING=default" "-P" "/ext/lyx/master/development/autotests/export.cmake"

Directory: /ext/lyx/buildmaster/autotests/out-home
"export/doc/cs/Tutorial_pdf" start time: Apr 11 14:14 CEST
Output:
--
-- IgnoreErrorMessage =
-- using fonttype = defaultF
-- LYX_TESTS_USERDIR = /ext/lyx/buildmaster/Testing/.lyx
-- Converting with perl /ext/lyx/master/development/autotests/useSystemFonts.pl
-- Using source "/ext/lyx/master/lib/doc/cs/Tutorial.lyx"
-- Using dest 
"/ext/lyx/buildmaster/autotests/out-home/AbC_1tT0pf/cs/Tutorial_pdf_defaultF.lyx"
res1 = 1 for "/ext/lyx/master/lib/doc/cs/Tutorial.lyx" to be copied to 
/ext/lyx/buildmaster/autotests/out-home/AbC_1tT0pf/cs/Tutorial_pdf_defaultF.lyx
-- Executing /ext/lyx/buildmaster/bin/lyx2.3  -userdir 
"/ext/lyx/buildmaster/Testing/.lyx" -E pdf cs/Tutorial_defaultF.pdf 
"/ext/lyx/buildmaster/autotests/out-home/AbC_1tT0pf/cs/Tutorial_pdf_defaultF.lyx"

Warning: Document class not available

The selected document class
Book (Standard Class)
requires external files that are not available.
The document class can still be used, but the
document cannot be compiled until the following
prerequisites are installed:
book.cls




2955 - export/doc/zh_CN/Intro_pdf (Failed)
2956 - DEFAULTOUTPUT_export/doc/zh_CN/Intro_pdf2 (Failed)
2968 - export/doc/zh_CN/Tutorial_pdf (Failed)
2969 - DEFAULTOUTPUT_export/doc/zh_CN/Tutorial_pdf2 (Failed)


I don't have Chinese TeX installed.


I have it, missing article.cls file here.




3061 - export/examples/Literate_pdf (Failed)
3062 - export/examples/Literate_pdf2 (Failed)


Fails here as well.


I had not installed noweb because it is obsolete, but after the test I did and 
LyX finds all right noweb.sty. I still get however a LyX message asking for a


   literate->latex

converter. I do not have a literate file format, and I do have any idea of what 
the converter should do, the wiki does not help on this.
This message appears also with other noweb based example files, as 
listerrors.lyx and noweb2lyx.lyx.





I think I can investigate file by file now.


Then
 - I get the same latex file dependencies problem as seen before with

examples/pl/splash.lyx (article.cls not found)
examples/ja/beamer.lyx (beamer.cls and other common sty files missing)
examples/sweave.lyx (article.cls and fancyvrb.sty missing)
templates/aastex6.lyx (aastex6.cls and other common sty files missing)

 - as José pointed out DocBook won't use math anyway, I can safely remove it 
from the tests.


 - I had not installed knitr and dependencies in R, knitr.lyx and Rjournal.lyx 
work OK now by hand (I documented the installation in the wiki);


 - templates/AGUtex.lyx fails because I do not have agutex.cls installed, and 
won't be able to do it from Internet as the class has been obsoleted by AGU. If 
someone has it... (just for the sake of completeness).


To summarize:
 1/ all the tests failing because of missing packages run OK when I compile by 
hand (21/33)

 2/ the noweb files miss a literate to latex converter (5/33)
 3/ the files using module Rnw work by hand, I expect them to run with 

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2017-04-11, Jean-Pierre Chrétien wrote:
> Le 11/04/2017 à 10:13, Kornel Benko a écrit :
>> Am Dienstag, 11. April 2017 um 09:33:15, schrieb Jean-Pierre Chrétien 
>> 

> I applied this, and I am now down to 33 failures :

> The following tests FAILED:
>   1777 - export/doc/cs/Tutorial_pdf (Failed)
>   1778 - DEFAULTOUTPUT_export/doc/cs/Tutorial_pdf2 (Failed)
>   2177 - export/doc/eu/Intro_pdf (Failed)
>   2178 - DEFAULTOUTPUT_export/doc/eu/Intro_pdf2 (Failed)
>   2193 - export/doc/eu/Tutorial_pdf (Failed)
>   2194 - DEFAULTOUTPUT_export/doc/eu/Tutorial_pdf2 (Failed)
>   2716 - export/doc/pl/Intro_pdf (Failed)
>   2717 - DEFAULTOUTPUT_export/doc/pl/Intro_pdf2 (Failed)
>   2732 - export/doc/pl/Tutorial_pdf (Failed)
>   2733 - DEFAULTOUTPUT_export/doc/pl/Tutorial_pdf2 (Failed)

...

These work here for me (subset of Debian TeXLive packages).
It seems you are missing some language definition files.

>   2955 - export/doc/zh_CN/Intro_pdf (Failed)
>   2956 - DEFAULTOUTPUT_export/doc/zh_CN/Intro_pdf2 (Failed)
>   2968 - export/doc/zh_CN/Tutorial_pdf (Failed)
>   2969 - DEFAULTOUTPUT_export/doc/zh_CN/Tutorial_pdf2 (Failed)

I don't have Chinese TeX installed.

>   3061 - export/examples/Literate_pdf (Failed)
>   3062 - export/examples/Literate_pdf2 (Failed)

Fails here as well.

...

> I think I can investigate file by file now.

This would be best.

Thanks,

Günter

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 11/04/2017 à 18:00, José Abílio Matos a écrit :

On Tuesday, 11 April 2017 16.11.06 WEST Jean-Pierre Chrétien wrote:

I still get errors with Literate, knitr, listerrors, noweb2lyx, sweave,
DocBook and Rjournal.


Not that DocBook is not related with latex. So you can remove it from your
list of failures. :-)



I included all these literate programming files because they have some maths 
options set (generally to "do not load"). So equivalently, I can ignore these 
failures if I change math options I guess.


--
Jean-Pierre

Re: LyX docs: cleaning up math options

[José Abílio Matos]

On Tuesday, 11 April 2017 16.11.06 WEST Jean-Pierre Chrétien wrote:
> I still get errors with Literate, knitr, listerrors, noweb2lyx, sweave,
> DocBook and Rjournal.

Not that DocBook is not related with latex. So you can remove it from your 
list of failures. :-)

-- 
José Abílio

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 11/04/2017 à 10:13, Kornel Benko a écrit :

Am Dienstag, 11. April 2017 um 09:33:15, schrieb Jean-Pierre Chrétien 





I'm going to run ctest on last up-to-date master with last up-to-date TL 2016
  - on pdf2 output for all but literate programming files;


For literate programming files disable first security checks.
# cd build-dir
# ./prefTest.pl use_converter_needauth_forbidden=false 
use_converter_needauth=false



I applied this, and I am now down to 33 failures :

The following tests FAILED:
1777 - export/doc/cs/Tutorial_pdf (Failed)
1778 - DEFAULTOUTPUT_export/doc/cs/Tutorial_pdf2 (Failed)
2177 - export/doc/eu/Intro_pdf (Failed)
2178 - DEFAULTOUTPUT_export/doc/eu/Intro_pdf2 (Failed)
2193 - export/doc/eu/Tutorial_pdf (Failed)
2194 - DEFAULTOUTPUT_export/doc/eu/Tutorial_pdf2 (Failed)
2716 - export/doc/pl/Intro_pdf (Failed)
2717 - DEFAULTOUTPUT_export/doc/pl/Intro_pdf2 (Failed)
2732 - export/doc/pl/Tutorial_pdf (Failed)
2733 - DEFAULTOUTPUT_export/doc/pl/Tutorial_pdf2 (Failed)
2955 - export/doc/zh_CN/Intro_pdf (Failed)
2956 - DEFAULTOUTPUT_export/doc/zh_CN/Intro_pdf2 (Failed)
2968 - export/doc/zh_CN/Tutorial_pdf (Failed)
2969 - DEFAULTOUTPUT_export/doc/zh_CN/Tutorial_pdf2 (Failed)
3061 - export/examples/Literate_pdf (Failed)
3062 - export/examples/Literate_pdf2 (Failed)
3360 - export/examples/knitr_pdf (Failed)
3361 - export/examples/knitr_pdf2 (Failed)
3421 - DEFAULTOUTPUT_export/examples/listerrors_pdf (Failed)
3468 - export/examples/noweb2lyx_pdf (Failed)
3469 - export/examples/noweb2lyx_pdf2 (Failed)
3975 - export/examples/sweave_pdf (Failed)
3976 - export/examples/sweave_pdf2 (Failed)
5189 - DEFAULTOUTPUT_export/examples/ja/beamer_pdf (Failed)
5372 - export/examples/pl/splash_pdf (Failed)
5373 - export/examples/pl/splash_pdf2 (Failed)
5644 - export/templates/AGUTeX_pdf (Failed)
5645 - export/templates/AGUTeX_pdf2 (Failed)
5689 - DEFAULTOUTPUT_export/templates/DocBook_article_pdf (Failed)
5864 - export/templates/RJournal_pdf (Failed)
5865 - export/templates/RJournal_pdf2 (Failed)
5896 - export/templates/aastex6_pdf (Failed)
5897 - export/templates/aastex6_pdf2 (Failed)

I still get errors with Literate, knitr, listerrors, noweb2lyx, sweave, DocBook 
and Rjournal.
The Hebrew errors disppeared (maybe the culmus tree got finally recognized, when 
I ran tlmgr update --all), but I get errors in thecs, eu, pl, and zh_CN docs.


I think I can investigate file by file now.

--
Jean-Pierre

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Dienstag, 11. April 2017 um 09:33:15, schrieb Jean-Pierre Chrétien 

> Le 11/04/2017 à 06:22, Scott Kostyshak a écrit :
> > On Mon, Nov 21, 2016 at 10:00:19PM -0500, Scott Kostyshak wrote:
> >> On Mon, Nov 21, 2016 at 05:13:55PM +, Jean-Pierre Chrétien wrote:
> >>
> >>> 88% tests passed, 669 tests failed out of 5553
> >>> Does this sound correct? I have TL2016 with all language collections and
> >>> fonts installed.
> 
> I had other tries on branch, could downsize the result to 127 failures, see 
> attached.
> 
> I tested also on master, and I had a hope that the new defaultoutput label 
> introduced by Kornel about a month ago would ease the process, But I saw that 
> only a subset of the doc, examples and templates files seem to have a default 
> output set.
> I went down to 7 failures over about 1500 files. BTW, I do not remember the 
> command to run ctest with this label, and it is not documented in 
> Development.lyx :-(

The labelname is "defaultoutput". 
Here
# ctest -L defaultoutput -N
gives 1191 tests.
Yes, it is not documented yet.

...

> 
> I'm going to run ctest on last up-to-date master with last up-to-date TL 2016
>   - on pdf2 output for all but literate programming files;

For literate programming files disable first security checks.
# cd build-dir
# ./prefTest.pl use_converter_needauth_forbidden=false 
use_converter_needauth=false

>   - xhtml output for literate programming files.
> 
> Then I will change math options from no load to conditional load and rerun 
> the 
> tests.
> Then I will change math option from always load to conditional load  and 
> rerun 
> the tests.
> 
> Does this seems all right ?
> 

It does for me.

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 11/04/2017 à 06:22, Scott Kostyshak a écrit :

On Mon, Nov 21, 2016 at 10:00:19PM -0500, Scott Kostyshak wrote:

On Mon, Nov 21, 2016 at 05:13:55PM +, Jean-Pierre Chrétien wrote:


88% tests passed, 669 tests failed out of 5553
Does this sound correct? I have TL2016 with all language collections and
fonts installed.


I had other tries on branch, could downsize the result to 127 failures, see 
attached.


I tested also on master, and I had a hope that the new defaultoutput label 
introduced by Kornel about a month ago would ease the process, But I saw that 
only a subset of the doc, examples and templates files seem to have a default 
output set.
I went down to 7 failures over about 1500 files. BTW, I do not remember the 
command to run ctest with this label, and it is not documented in 
Development.lyx :-(


What is the status of my tests right now ?
On branch, I get failures on pdf2 output on
 - Hebrew doc files (Intro and Tutorial only), I tried to install culmus fonts 
without success, I may try again. But these failures can be declared harmless as 
the English Intro and Tutorial tests run fine;

 - Additional (German and French), I should investigate, but same remark;
 - literate programming files, but the tests should be run on xhtml output, 
right ?
 - the obsoleted AGUtex template.

So I'm next to a reliable set of tests on branch.
I'm going next to give a try with my branch command on master.



Doesn't seem too strange. If I run all the tests, I get 148 failing out
of 6469, but this is because I have spent a lot of time satisfying the
dependencies of the tests so that is expected.


That's what I did to restrain the number of failures. But do you edit the files 
(e.g. Hebrew to select the culmus fonts) ?





I won't touch the files with option 2 (always load).


Why not? I would prefer to change those to automatic also.


As this option has been explicitly set, I thought to leave as it is, but I can 
try this change of course. Does that mean that we could remove completely the UI 
interface for this ?





Any further idea ? In particular, should I run ctest with other options than 
export?


I think your plan is good. I will also save my ctest results
before/after your changes so I will double-check that no tests go from
passing to failing.



Jean-Pierre,

Any update on this?


I'm going to run ctest on last up-to-date master with last up-to-date TL 2016
 - on pdf2 output for all but literate programming files;
 - xhtml output for literate programming files.

Then I will change math options from no load to conditional load and rerun the 
tests.
Then I will change math option from always load to conditional load  and rerun 
the tests.


Does this seems all right ?

--
Jean-Pierre



306:export/doc/Additional_pdf
307:export/doc/Additional_pdf2
737:export/doc/de/Additional_pdf
738:export/doc/de/Additional_pdf2
917:export/doc/es/Additional_pdf
918:export/doc/es/Additional_pdf2
1112:export/doc/fr/Additional_pdf
1113:export/doc/fr/Additional_pdf2
1307:export/doc/he/Intro_pdf
1308:export/doc/he/Intro_pdf2
1322:export/doc/he/Tutorial_pdf
1323:export/doc/he/Tutorial_pdf2
1897:export/examples/Literate_lyx21
1904:export/examples/Literate_pdf
1905:export/examples/Literate_pdf2
2111:export/examples/docbook_article_pdf
2176:export/examples/knitr_lyx16
2177:export/examples/knitr_lyx21
2184:export/examples/knitr_pdf
2185:export/examples/knitr_pdf2
2206:export/examples/lilypond_lyx16
2207:export/examples/lilypond_lyx21
2214:export/examples/lilypond_pdf
2215:export/examples/lilypond_pdf2
2236:export/examples/listerrors_lyx16
2237:export/examples/listerrors_lyx21
2241:export/examples/listerrors_pdf
2278:export/examples/noweb2lyx_lyx21
2285:export/examples/noweb2lyx_pdf
2286:export/examples/noweb2lyx_pdf2
2769:export/examples/sweave_lyx16
2770:export/examples/sweave_lyx21
2777:export/examples/sweave_pdf
2778:export/examples/sweave_pdf2
3460:UNRELIABLE.NONSTANDARD_export/examples/fa/splash_pdf
3461:UNRELIABLE.NONSTANDARD_export/examples/fa/splash_pdf2
3754:export/examples/he/example_lyxified_pdf
3755:export/examples/he/example_lyxified_pdf2
3769:export/examples/he/example_raw_pdf
3770:export/examples/he/example_raw_pdf2
3784:export/examples/he/splash_pdf
3785:export/examples/he/splash_pdf2
3916:export/examples/ja/knitr_lyx16
3917:export/examples/ja/knitr_lyx21
3923:export/examples/ja/lilypond_lyx16
3924:export/examples/ja/lilypond_lyx21
3943:export/examples/ja/sweave_lyx16
3944:export/examples/ja/sweave_lyx21
4337:export/templates/AGUTeX_pdf
4338:export/templates/AGUTeX_pdf2
4379:export/templates/DocBook_article_pdf
4533:export/templates/RJournal_lyx16
4534:export/templates/RJournal_lyx21
4541:export/templates/RJournal_pdf
4542:export/templates/RJournal_pdf2
4795:UNRELIABLE.NONSTANDARD_export/templates/ja_beamer-conference-ornate-20min_pdf2

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Mon, Nov 21, 2016 at 10:00:19PM -0500, Scott Kostyshak wrote:
> On Mon, Nov 21, 2016 at 05:13:55PM +, Jean-Pierre Chrétien wrote:
> 
> > 88% tests passed, 669 tests failed out of 5553
> > Does this sound correct? I have TL2016 with all language collections and
> > fonts installed.
> 
> Doesn't seem too strange. If I run all the tests, I get 148 failing out
> of 6469, but this is because I have spent a lot of time satisfying the
> dependencies of the tests so that is expected.
> 
> > I won't touch the files with option 2 (always load).
> 
> Why not? I would prefer to change those to automatic also.
> 
> > Any further idea ? In particular, should I run ctest with other options 
> > than export?
> 
> I think your plan is good. I will also save my ctest results
> before/after your changes so I will double-check that no tests go from
> passing to failing.
> 
> Thanks,
> 
> Scott

Jean-Pierre,

Any update on this?

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Mon, Nov 21, 2016 at 05:13:55PM +, Jean-Pierre Chrétien wrote:

> 88% tests passed, 669 tests failed out of 5553
> Does this sound correct? I have TL2016 with all language collections and
> fonts installed.

Doesn't seem too strange. If I run all the tests, I get 148 failing out
of 6469, but this is because I have spent a lot of time satisfying the
dependencies of the tests so that is expected.

> I won't touch the files with option 2 (always load).

Why not? I would prefer to change those to automatic also.

> Any further idea ? In particular, should I run ctest with other options than 
> export?

I think your plan is good. I will also save my ctest results
before/after your changes so I will double-check that no tests go from
passing to failing.

Thanks,

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 21/11/2016 à 18:23, Kornel Benko a écrit :

Am Montag, 21. November 2016 um 17:13:55, schrieb Jean-Pierre Chrétien 


Le 16/10/2016 à 01:03, Scott Kostyshak a écrit :

On Sat, Oct 15, 2016 at 10:55:49PM +0200, jeanpierre.chret...@free.fr wrote:




When I'm ready, I will post how I plan to perform the changes.


Sounds good! Thanks for taking care of it.


While preparing for this task, I ran

ctest -R export

on master, I get this:

88% tests passed, 669 tests failed out of 5553

Does this sound correct? I have TL2016 with all language collections and fonts
installed.


I tried with my settings. It is worse here.
Failed 801 out of 3979.
From this 801 failed are 537 tests where lualatex is involved.
Practically most lualatex tests with system font fail.

Test-type   Failed  Total
dvi3_texF   3   265
pdf5_texF   3   265
dvi3_systemF262 282
pdf5_systemF266 292

Manually testing templates/letter.lyx (which fails with dvi3_systemF) leads to 
crash of the lyx executable.
support/lassert.cpp (51): ASSERTION status != ExportSuccess VIOLATED IN 
/usr2/src/lyx/lyx-git/src/Buffer.cpp:4368


Here viewing DVI (LuaTeX) of templates/letter.lyx after checking Use non-TeX 
fonts succeeds, but I see this in the command window:


kpathsea:make_tex: Invalid fontname 
`file:lmroman10-regular:script=latn;+trep;+tlig;', contains ':'
xdvi: Can't find pixel font file:lmroman10-regular:script=latn;+trep;+tlig;; 
using cmr10 instead at 600 dpi.

xdvi-xaw: Warning: Character 8220 not defined in font cmr10
xdvi-xaw: Warning: Character 8221 not defined in font cmr10

If I check the log of the failures, I get 54 dvi3_systemF failures among 168 
systemF failures.


--
Jean-Pierre

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Montag, 21. November 2016 um 19:23:54, schrieb Kornel Benko 
> Am Montag, 21. November 2016 um 17:13:55, schrieb Jean-Pierre Chrétien 
> 
> > Le 16/10/2016 à 01:03, Scott Kostyshak a écrit :
> > > On Sat, Oct 15, 2016 at 10:55:49PM +0200, jeanpierre.chret...@free.fr 
> > > wrote:
> > >
> > 
> > >> When I'm ready, I will post how I plan to perform the changes.
> > >
> > > Sounds good! Thanks for taking care of it.
> > 
> > While preparing for this task, I ran
> > 
> > ctest -R export
> > 
> > on master, I get this:
> > 
> > 88% tests passed, 669 tests failed out of 5553
> > 
> > Does this sound correct? I have TL2016 with all language collections and 
> > fonts 
> > installed.
> 
> I tried with my settings. It is worse here.
> Failed 801 out of 3979.

> From this 801 failed are 537 tests where lualatex is involved.
> Practically most lualatex tests with system font fail.
> 

OK, this is my fault. I was still using the wrapper patch from Tommaso.
Probably lualatex tries to write something to not allowed location (internal 
lualatex cache?).
Without this wrapper lyx does not crash.
Calling now 'ctest -j12 -R dvi3_systemF' ... this is now much better.
98% tests passed, 7 tests failed out of 301

Same with 'ctest -j12 -R pdf5_systemF'
97% tests passed, 9 tests failed out of 309

Kornel



signature.asc
Description: This is a digitally signed message part.

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Montag, 21. November 2016 um 17:13:55, schrieb Jean-Pierre Chrétien 

> Le 16/10/2016 à 01:03, Scott Kostyshak a écrit :
> > On Sat, Oct 15, 2016 at 10:55:49PM +0200, jeanpierre.chret...@free.fr wrote:
> >
> 
> >> When I'm ready, I will post how I plan to perform the changes.
> >
> > Sounds good! Thanks for taking care of it.
> 
> While preparing for this task, I ran
> 
> ctest -R export
> 
> on master, I get this:
> 
> 88% tests passed, 669 tests failed out of 5553
> 
> Does this sound correct? I have TL2016 with all language collections and 
> fonts 
> installed.

I tried with my settings. It is worse here.
Failed 801 out of 3979.
From this 801 failed are 537 tests where lualatex is involved.
Practically most lualatex tests with system font fail.

Test-type   Failed  Total
dvi3_texF   3   265
pdf5_texF   3   265
dvi3_systemF262 282
pdf5_systemF266 292

Manually testing templates/letter.lyx (which fails with dvi3_systemF) leads to 
crash of the lyx executable.
support/lassert.cpp (51): ASSERTION status != ExportSuccess VIOLATED IN 
/usr2/src/lyx/lyx-git/src/Buffer.cpp:4368
(  1) lyx2.3: lyx::doAssertWithCallstack(bool)
(  2) lyx2.3: lyx::doAssert(char const*, char const*, long)
(  3) lyx2.3: lyx::Buffer::preview(std::__cxx11::basic_string const&, bool) const
(  4) lyx2.3: lyx::Buffer::preview(std::__cxx11::basic_string const&) const
(  5) lyx2.3: lyx::Buffer::ExportStatus 
std::__invoke_impl const&) const, lyx::Buffer* 
const&, std::__cxx11::basic_string const&>(std::__invoke_memfun_deref, 
lyx::Buffer::ExportStatus (lyx::Buffer::* 
const&)(std::__cxx11::basic_string const&) const, lyx::Buffer* const&, 
std::__cxx11::basic_string 
const&)
(  6) lyx2.3: std::result_of, std::allocator > 
const&))(std::__cxx11::basic_string const&) const>::type 
std::__invoke, 
std::allocator > const&) const, lyx::Buffer* const&, 
std::__cxx11::basic_string 
const&>(lyx::Buffer::ExportStatus (lyx::Buffer::* 
const&)(std::__cxx11::basic_string const&) const, lyx::Buffer* const&, 
std::__cxx11::basic_string 
const&)
(  7) lyx2.3: decltype (__invoke((*this)._M_pmf, (forward)({parm#1}), (forward const&>)({parm#1}))) 
std::_Mem_fn_base, 
std::allocator > const&) const, true>::operator() 
const&>(lyx::Buffer* const&, std::__cxx11::basic_string const&) const
(  8) lyx2.3: lyx::Buffer::ExportStatus 
std::_Bind const&) const> (lyx::Buffer*, 
std::_Placeholder<1>)>::__call_c 
const&, 0ul, 1ul>(std::tuple const&>&&, 
std::_Index_tuple<0ul, 1ul>) const
(  9) lyx2.3: lyx::Buffer::ExportStatus 
std::_Bind const&) const> (lyx::Buffer*, 
std::_Placeholder<1>)>::operator() const&, 
lyx::Buffer::ExportStatus>(std::__cxx11::basic_string const&) const
( 10) lyx2.3: lyx::Buffer::ExportStatus 
lyx::frontend::GuiView::GuiViewPrivate::runAndDestroy const&) const> (lyx::Buffer*, std::_Placeholder<1>)> 
>(std::_Bind const&) const> (lyx::Buffer*, std::_Placeholder<1>)> 
const&, lyx::Buffer const*, lyx::Buffer*, std::__cxx11::basic_string const&)
( 11) lyx2.3: 
lyx::frontend::GuiView::GuiViewPrivate::previewAndDestroy(lyx::Buffer const*, 
lyx::Buffer*, std::__cxx11::basic_string const&)
( 12) lyx2.3: QtConcurrent::StoredFunctorCall3 
const&), lyx::Buffer const*, lyx::Buffer*, std::__cxx11::basic_string >::runFunctor()
( 13) lyx2.3: QtConcurrent::RunFunctionTask::run()
( 14) /usr/BUILD/BuildQt5/5.7/gcc_64/lib/libQt5Core.so.5: 
/usr/BUILD/BuildQt5/5.7/gcc_64/lib/libQt5Core.so.5(+0xa7ccd) [0x7fc0274afccd]
( 15) 

Re: LyX docs: cleaning up math options

[Kornel Benko]

Am Montag, 21. November 2016 um 17:13:55, schrieb Jean-Pierre Chrétien 

> Le 16/10/2016 à 01:03, Scott Kostyshak a écrit :
> > On Sat, Oct 15, 2016 at 10:55:49PM +0200, jeanpierre.chret...@free.fr wrote:
> >
> 
> >> When I'm ready, I will post how I plan to perform the changes.
> >
> > Sounds good! Thanks for taking care of it.
> 
> While preparing for this task, I ran
> 
> ctest -R export
> 
> on master, I get this:
> 
> 88% tests passed, 669 tests failed out of 5553
> 
> Does this sound correct? I have TL2016 with all language collections and 
> fonts 
> installed.
> 
> Now to come to the change of the default setting of the maths packages, here 
> is 
> what I find by exploring the doc, examples and templates directories
> for option 0 (do not load) which I intend to change to option 1 (autoload). I 
> won't touch the files with option 2 (always load). This is performed on 
> branch.
> 
> I ran
> 
> $ find lib/doc lib/examples lib/templates -name '*.lyx' -exec grep -l \ 
> '\\use_package  0' {} \; >/tmp/list_.txt
> 
> for each  in the ten possible packages, from amsmath to undertilde.
> 
> I get this:
> 
> $ wc /tmp/list_*.txt
>124   124  3603 /tmp/list_amsmath.txt
>125   125  3634 /tmp/list_amssymb.txt
>333   333  9881 /tmp/list_cancel.txt
>202   202  5788 /tmp/list_esint.txt
>  9 9   276 /tmp/list_mathdots.txt
>316   316  9427 /tmp/list_mathtools.txt
> 1010   321 /tmp/list_mhchem.txt
>333   333  9881 /tmp/list_stackrel.txt
>326   326  9674 /tmp/list_stmaryrd.txt
>323   323  9599 /tmp/list_undertilde.txt
> 
> stackrel or cancel contains all the 333 concerned files, as I can test like 
> this:
> 
> $ cat /tmp/list_*.txt |sort -u >/tmp/list_notloaded.txt
> $ wc /tmp/list_notloaded.txt
>   333  333 9881 /tmp/list_notloaded.txt
> 
> Among these files 13 are in attics, I guess I can remove them:
> 
> $ grep attic /tmp/list_notloaded.txt
> lib/doc/attic/aastex6_sample.lyx
> lib/doc/attic/DocStyle.lyx
> lib/doc/attic/eu_Additional.lyx
> lib/doc/attic/eu_Customization.lyx
> lib/doc/attic/eu_UserGuide.lyx
> lib/doc/attic/id_UserGuide.lyx
> lib/doc/attic/it_Customization.lyx
> lib/doc/attic/it_UserGuide.lyx
> lib/doc/attic/pl_Additional.lyx
> lib/doc/attic/sk_UserGuide.lyx
> lib/templates/attic/AGU_article.lyx
> lib/templates/attic/latex8.lyx
> lib/templates/attic/revtex.lyx
> 
> There remains 320 files on which I intend to perform these tasks:
>   * run ctest on export
>   * substitute  \use_package  0 by \use_package  1
>   * run ctest on export again
>   * check for any change.
> 
> Now to perform ctest on the files, I think that the simplest way is to 
> temporarily stash the files in doc, examples and templates which are not 
> among 
> the 320 files  and in autotests/export and run ctest -R export.
> I should only test the 320 files then.

Don't forget to always rebuild the cache ( #make rebuild_cache)

> Any further idea ? In particular, should I run ctest with other options than 
> export?
> 

I run the tests with
#ctest -j12 -timeout 300 -L export -E "xhtml|lyx16|lyx21|lyx22"
This gives 3979 tests instead of 5532 tests when using 'ctest -R export'.

Kornel

signature.asc
Description: This is a digitally signed message part.

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 16/10/2016 à 01:03, Scott Kostyshak a écrit :

On Sat, Oct 15, 2016 at 10:55:49PM +0200, jeanpierre.chret...@free.fr wrote:




When I'm ready, I will post how I plan to perform the changes.


Sounds good! Thanks for taking care of it.


While preparing for this task, I ran

ctest -R export

on master, I get this:

88% tests passed, 669 tests failed out of 5553

Does this sound correct? I have TL2016 with all language collections and fonts 
installed.


Now to come to the change of the default setting of the maths packages, here is 
what I find by exploring the doc, examples and templates directories
for option 0 (do not load) which I intend to change to option 1 (autoload). I 
won't touch the files with option 2 (always load). This is performed on branch.


I ran

$ find lib/doc lib/examples lib/templates -name '*.lyx' -exec grep -l \ 
'\\use_package  0' {} \; >/tmp/list_.txt


for each  in the ten possible packages, from amsmath to undertilde.

I get this:

$ wc /tmp/list_*.txt
  124   124  3603 /tmp/list_amsmath.txt
  125   125  3634 /tmp/list_amssymb.txt
  333   333  9881 /tmp/list_cancel.txt
  202   202  5788 /tmp/list_esint.txt
9 9   276 /tmp/list_mathdots.txt
  316   316  9427 /tmp/list_mathtools.txt
   1010   321 /tmp/list_mhchem.txt
  333   333  9881 /tmp/list_stackrel.txt
  326   326  9674 /tmp/list_stmaryrd.txt
  323   323  9599 /tmp/list_undertilde.txt

stackrel or cancel contains all the 333 concerned files, as I can test like 
this:

$ cat /tmp/list_*.txt |sort -u >/tmp/list_notloaded.txt
$ wc /tmp/list_notloaded.txt
 333  333 9881 /tmp/list_notloaded.txt

Among these files 13 are in attics, I guess I can remove them:

$ grep attic /tmp/list_notloaded.txt
lib/doc/attic/aastex6_sample.lyx
lib/doc/attic/DocStyle.lyx
lib/doc/attic/eu_Additional.lyx
lib/doc/attic/eu_Customization.lyx
lib/doc/attic/eu_UserGuide.lyx
lib/doc/attic/id_UserGuide.lyx
lib/doc/attic/it_Customization.lyx
lib/doc/attic/it_UserGuide.lyx
lib/doc/attic/pl_Additional.lyx
lib/doc/attic/sk_UserGuide.lyx
lib/templates/attic/AGU_article.lyx
lib/templates/attic/latex8.lyx
lib/templates/attic/revtex.lyx

There remains 320 files on which I intend to perform these tasks:
 * run ctest on export
 * substitute  \use_package  0 by \use_package  1
 * run ctest on export again
 * check for any change.

Now to perform ctest on the files, I think that the simplest way is to 
temporarily stash the files in doc, examples and templates which are not among 
the 320 files  and in autotests/export and run ctest -R export.

I should only test the 320 files then.

Any further idea ? In particular, should I run ctest with other options than 
export?

--
Jean-Pierre

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Sat, Oct 15, 2016 at 10:55:49PM +0200, jeanpierre.chret...@free.fr wrote:

> I can take this in charge if it not too urgent, because
>  - my linux box where I will perform tests is currently without internet 
> connexion (this should be solved by a couple of days hopefully);
>  - I had some problems with my cmake build, some tests failed with userdir 
> specified, this is solved, but I must perform some more checks.
> 
> When I'm ready, I will post how I plan to perform the changes.

Sounds good! Thanks for taking care of it.

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[jeanpierre . chretien]

> 
> Sounds good. Jean-Pierre, since you first proposed this would you
> like
> to make the changes or do you prefer for me to? I don't have a
> preference, but whichever of us does it just needs to make sure that
> no
> tests go from passing to failing after the change.
> 
> Scott
> 

I can take this in charge if it not too urgent, because
 - my linux box where I will perform tests is currently without internet 
connexion (this should be solved by a couple of days hopefully);
 - I had some problems with my cmake build, some tests failed with userdir 
specified, this is solved, but I must perform some more checks.

When I'm ready, I will post how I plan to perform the changes.

-- 
Jean-Pierre

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Fri, Oct 14, 2016 at 11:03:28PM +0200, Uwe Stöhr wrote:
> Am 14.10.2016 um 17:36 schrieb Guenter Milde:
> 
> > For the documentation people, the difference is:...
> 
> Hi Scott and Günter,
> 
> convinced, so fine with me to change everything to automatic. Please commit
> directly if the tests were passed to branch (when it is open again) and
> master (please keep there the fileformat).
> 
> Please also take care of the non-English files.

Sounds good. Jean-Pierre, since you first proposed this would you like
to make the changes or do you prefer for me to? I don't have a
preference, but whichever of us does it just needs to make sure that no
tests go from passing to failing after the change.

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Fri, Oct 14, 2016 at 08:47:48PM +, Guenter Milde wrote:
> On 2016-10-14, Scott Kostyshak wrote:
> 
> > [-- Type: text/plain, Encoding: quoted-printable --]
> 
> > On Fri, Oct 14, 2016 at 03:36:11PM +, Guenter Milde wrote:
> 
> >> For the end-user the difference is:
> 
> >> * with "no", there is a safeguard against relying on additional packages
> >>   without real need -> less dependencies when compiling the docs.
> 
> > Wouldn't this be a LyX bug if we rely on an unneededed depencency? To be
> > clear, I believe Jean-Pierre and I were on the same page of porposing
> > that the options be changed to "Load automatically". We are not
> > proposing "Load always".
> 
> Not a LyX bug. With "safeguard", I only mean the feadback by the compilation
> error if the editor/maintainer uses a feature requiring an additional package.
> If we decide now to allow this, we should set the options to "auto".

Ah I understand what you mean now. I did not think about that. In some
sense it provides protection against our future selves.

> I agree that this is a (small) benefit for the documentation people with a
> negligible impact on the average user.
> I.e. I am in favour of setting the math-package settings to "auto".

OK.

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2016-10-14, Scott Kostyshak wrote:

> [-- Type: text/plain, Encoding: quoted-printable --]

> On Fri, Oct 14, 2016 at 03:36:11PM +, Guenter Milde wrote:

>> For the end-user the difference is:

>> * with "no", there is a safeguard against relying on additional packages
>>   without real need -> less dependencies when compiling the docs.

> Wouldn't this be a LyX bug if we rely on an unneededed depencency? To be
> clear, I believe Jean-Pierre and I were on the same page of porposing
> that the options be changed to "Load automatically". We are not
> proposing "Load always".

Not a LyX bug. With "safeguard", I only mean the feadback by the compilation
error if the editor/maintainer uses a feature requiring an additional package.
If we decide now to allow this, we should set the options to "auto".
I agree that this is a (small) benefit for the documentation people with a
negligible impact on the average user.
I.e. I am in favour of setting the math-package settings to "auto".

Günter

Re: LyX docs: cleaning up math options

[Uwe Stöhr]

Am 14.10.2016 um 17:36 schrieb Guenter Milde:


For the documentation people, the difference is:...


Hi Scott and Günter,

convinced, so fine with me to change everything to automatic. Please 
commit directly if the tests were passed to branch (when it is open 
again) and master (please keep there the fileformat).


Please also take care of the non-English files.

many thanks for your help and best regards
Uwe

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Fri, Oct 14, 2016 at 03:36:11PM +, Guenter Milde wrote:

> For the end-user the difference is:
> 
> * with "no", there is a safeguard against relying on additional packages
>   without real need -> less dependencies when compiling the docs.

Wouldn't this be a LyX bug if we rely on an unneededed depencency? To be
clear, I believe Jean-Pierre and I were on the same page of porposing
that the options be changed to "Load automatically". We are not
proposing "Load always".

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2016-10-13, Uwe Stöhr wrote:
> Am 07.10.2016 um 19:01 schrieb Scott Kostyshak:

Dear Uwe,

>> My proposal is to change everything in all .lyx files to "Automatic".
>> Then run the ctests to see which exports start failing and revert the
>> changes to those corresponding documents.

> OK, if all test are passed, we don't risk anything. the question is 
> however, if this is really necessary. Setting a package to no or to 
> automatic does not change anything since if it works when setting to no, 
> it will also not be used wit automatic. So what is the benefit for the 
> user, what for LyX and what for us documentation people?

For the documentation people, the difference is:

* with "no", inserting any character from a package that is (currently)
  blocked will lead to a compilation error.
  
  It is up to the editor or maintainer to decide whether to go without this
  character or change the package-loading setting.

* with "automatic", you can use characters requiring any of the supported
  packages without further discussion or decision.


For the end-user the difference is:

* with "no", there is a safeguard against relying on additional packages
  without real need -> less dependencies when compiling the docs.
  

It is up to you to decide which is the more important.

Günter

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Fri, Oct 14, 2016 at 01:21:17AM +0200, Uwe Stöhr wrote:
> Am 07.10.2016 um 19:01 schrieb Scott Kostyshak:
> 
> OK, if all test are passed, we don't risk anything. the question is however,
> if this is really necessary. Setting a package to no or to automatic does
> not change anything since if it works when setting to no, it will also not
> be used wit automatic.

It is not a necessary change and I don't think the benefits would be
enormous. I do think that the small benefits would outweigh the very
small risks.

> So what is the benefit for the user

Users often use our examples and templates as the base of a new file. If
they do this and then try to use a feature of a package that we have
disabled, they will have problems and might not understand why.

> what for LyX and what for us documentation people?

For example, see the thread reported by Jean-Pierre here that was solved
by fixing the math options:
https://www.mail-archive.com/lyx-devel@lists.lyx.org/msg196026.html

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Uwe Stöhr]

Am 07.10.2016 um 19:01 schrieb Scott Kostyshak:


My proposal is to change everything in all .lyx files to "Automatic".
Then run the ctests to see which exports start failing and revert the
changes to those corresponding documents.


OK, if all test are passed, we don't risk anything. the question is 
however, if this is really necessary. Setting a package to no or to 
automatic does not change anything since if it works when setting to no, 
it will also not be used wit automatic. So what is the benefit for the 
user, what for LyX and what for us documentation people?


regards Uwe

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Sun, Oct 09, 2016 at 09:24:11PM +, Guenter Milde wrote:
> On 2016-10-09, Scott Kostyshak wrote:

> > I don't think I would want to spend the time to manually inspect the
> > output of all of the exports.
> 
> There is no need to test *all* exports, just the default (i.e. pdf2) and
> only for changes that may change the output.

OK.

> > Perhaps there is some automatic way to do it, using a tool that looks
> > for diffs in PDFs. diffpdf is useful, for example.
> 
> If you understand the consequences of a change, manual testing may be
> confined to one (or none for simple changes) document (not all
> translations, say).

I see. I do not understand all of the possible consequences of this
change. Let's first see what Uwe says. If he is in favor, then let's
continue the discussion about whether to make the change and check
manually or not make the change. If Uwe's not in favor, then spending
time on that discussion is not worth it yet.

Thanks for the feedback.

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2016-10-09, Scott Kostyshak wrote:

> [-- Type: text/plain, Encoding:  --]

> On Sun, Oct 09, 2016 at 04:50:35PM +, Guenter Milde wrote:

>> * Changes must not only tested for compilation success but also for correct
>>   output.

> I don't think I would want to spend the time to manually inspect the
> output of all of the exports.

There is no need to test *all* exports, just the default (i.e. pdf2) and
only for changes that may change the output.

>> That said, I am not against the proposed changes (but Uwe is the one to
>> decide).

> Because of what I said above, I think you would be against the proposed
> changes. Correct?

> Perhaps there is some automatic way to do it, using a tool that looks
> for diffs in PDFs. diffpdf is useful, for example.

If you understand the consequences of a change, manual testing may be
confined to one (or none for simple changes) document (not all
translations, say).

Günter

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Sun, Oct 09, 2016 at 04:50:35PM +, Guenter Milde wrote:

> * Changes must not only tested for compilation success but also for correct
>   output.

I don't think I would want to spend the time to manually inspect the
output of all of the exports.

> That said, I am not against the proposed changes (but Uwe is the one to
> decide).

Because of what I said above, I think you would be against the proposed
changes. Correct?

Perhaps there is some automatic way to do it, using a tool that looks
for diffs in PDFs. diffpdf is useful, for example.

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2016-10-08, Scott Kostyshak wrote:

> [-- Type: text/plain, Encoding:  --]

> On Sat, Oct 08, 2016 at 08:17:04AM +, Guenter Milde wrote:

>> I don't know whether this is the intention here, but I would give Uwe as
>> maintainer the say about the correct settings.

> OK, I CC'ed Uwe. I won't make any changes until we hear from him. In
> fact, if you are very against the proposed changes, then I will just not
> pursue it. I do not have a strong opinion on it.

General points:

* LyX defaults are not suited for every document, 
  (e.g. no font package but T1 font encoding is always bad,
   mixed, language-dependent input encodings is in most cases bad)
  so non-default settings are not bad per-se.

* Changes must not only tested for compilation success but also for correct
  output.

That said, I am not against the proposed changes (but Uwe is the one to
decide).

Günter

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Sat, Oct 08, 2016 at 08:17:04AM +, Guenter Milde wrote:

> I don't know whether this is the intention here, but I would give Uwe as
> maintainer the say about the correct settings.

OK, I CC'ed Uwe. I won't make any changes until we hear from him. In
fact, if you are very against the proposed changes, then I will just not
pursue it. I do not have a strong opinion on it.

Thanks for the feedback,

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2016-10-08, Scott Kostyshak wrote:
> On Fri, Oct 07, 2016 at 07:53:13PM +, Guenter Milde wrote:

>> It does not suffice to test whether compilation runs without an error.
>> This does in no way guarantee that the output is OK.

> I see. I suppose it comes down to whether we think that the proposed
> changes have a better chance of fixing something than breaking
> something. As Jean-Pierre pointed out, we already have a case where
> such changes fixed something. I don't know enough to estimate what the
> chance is that the proposed changes lead to an error that is not
> reported by compilation and that can only be seen by manual inspection.

In addition to possible wrong output, there can be other cases of
intentional non-default settings.

In the case of "banned" math-packages, it may be the intention to ensure
compilability with a minimal TeX installation. 

As compilation with pdflatex is a must for the docs, the "banning"
ensures the problem is spotted by any editor. A compilation error due to
missing packages would then mean that the content should be changed to
ensure the document can be compiled also without packages that are
present with a full installation but not in a custom "cut-down"
installation.

I don't know whether this is the intention here, but I would give Uwe as
maintainer the say about the correct settings.


Günter

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Fri, Oct 07, 2016 at 07:53:13PM +, Guenter Milde wrote:

> It does not suffice to test whether compilation runs without an error.
> This does in no way guarantee that the output is OK.

I see. I suppose it comes down to whether we think that the proposed
changes have a better chance of fixing something than breaking
something. As Jean-Pierre pointed out, we already have a case where such
changes fixed something. I don't know enough to estimate what the chance
is that the proposed changes lead to an error that is not reported by
compilation and that can only be seen by manual inspection.

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Scott Kostyshak]

On Fri, Oct 07, 2016 at 10:00:09PM +0200, Jean-Pierre Chrétien wrote:
> 
> Sure,  I  mentioned in a previous  thread that it could trigger an error e.g. 
> in splash.lyx.

Indeed, I think I stole the idea from you:
https://www.mail-archive.com/search?l=mid=caa2c11f-2c40-f782-6193-df1667b981a3%40free.fr

You are more than welcome to make the changes if we agree on the list
this is the right thing to do. But first we must discuss Günter's
concern.

Scott


signature.asc
Description: PGP signature

Re: LyX docs: cleaning up math options

[Jean-Pierre Chrétien]

Le 7 octobre 2016 19:01:26 CEST, Scott Kostyshak  a écrit :
>Many of our documents have custom Math options which I think are
>unnecessary for the most part. For example, the Tutorial has everything
>set to "Do not load", except for mathdots and mhchem. Setting
>everything
>to "Automatic" does not change compilation. I wonder these options
>might
>have been set by lyx2lyx (after introducing new options) over the
>years.
>
>I would like to set everything possible ("possible" meaning does not
>change compilation) to "Automatic" because one of our policies
>regarding
>documentation is to keep things as clean as possible so as to set a
>good
>example to users, and sometimes users copy LyX documentation files
>(especially templates and examples) as the basis of a new document.
>
>My proposal is to change everything in all .lyx files to "Automatic".
>Then run the ctests to see which exports start failing and revert the
>changes to those corresponding documents.
>

Sure,  I  mentioned in a previous  thread that it could trigger an error e.g. 
in splash.lyx.

-- 
Jean-Pierre 
 

Re: LyX docs: cleaning up math options

[Guenter Milde]

On 2016-10-07, Scott Kostyshak wrote:

> [-- Type: text/plain, Encoding:  --]

> Many of our documents have custom Math options which I think are
> unnecessary for the most part. For example, the Tutorial has everything
> set to "Do not load", except for mathdots and mhchem. Setting everything
> to "Automatic" does not change compilation. I wonder these options might
> have been set by lyx2lyx (after introducing new options) over the years.

> I would like to set everything possible ("possible" meaning does not
> change compilation) to "Automatic" because one of our policies regarding
> documentation is to keep things as clean as possible so as to set a good
> example to users, and sometimes users copy LyX documentation files
> (especially templates and examples) as the basis of a new document.

> My proposal is to change everything in all .lyx files to "Automatic".
> Then run the ctests to see which exports start failing and revert the
> changes to those corresponding documents.

> Any objection?

It does not suffice to test whether compilation runs without an error.
This does in no way guarantee that the output is OK.

You must also check for differences in the output.

Günter
  

LyX docs: cleaning up math options

[Scott Kostyshak]

Many of our documents have custom Math options which I think are
unnecessary for the most part. For example, the Tutorial has everything
set to "Do not load", except for mathdots and mhchem. Setting everything
to "Automatic" does not change compilation. I wonder these options might
have been set by lyx2lyx (after introducing new options) over the years.

I would like to set everything possible ("possible" meaning does not
change compilation) to "Automatic" because one of our policies regarding
documentation is to keep things as clean as possible so as to set a good
example to users, and sometimes users copy LyX documentation files
(especially templates and examples) as the basis of a new document.

My proposal is to change everything in all .lyx files to "Automatic".
Then run the ctests to see which exports start failing and revert the
changes to those corresponding documents.

Any objection?

Scott


signature.asc
Description: PGP signature