Failure affecting 2 French sites: "Latexmk: Errors, so I did not complete making targets"

[hugovk]

Follow on from #186, the other 3 "Badly handled exception, human, please help" lines in yesterday's 24-hour log are caused by:

2024-08-11 15:12:53,206 DEBUG fr/3.13: Run: "make -C /srv/docsbuild/cpython/Doc PYTHON=/srv/docsbuild/venv-3.13/bin/python SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build BLURB=/srv/docsbuild/venv-3.13/bin/blurb VENVDIR=/srv/docsbuild/venv-3.13 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0' SPHINXERRORHANDLING= autobuild-dev"
2024-08-11 15:44:37,172 ERROR fr/3.13: Run: "make -C /srv/docsbuild/cpython/Doc PYTHON=/srv/docsbuild/venv-3.13/bin/python SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build BLURB=/srv/docsbuild/venv-3.13/bin/blurb VENVDIR=/srv/docsbuild/venv-3.13 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0' SPHINXERRORHANDLING= autobuild-dev" KO:
    Latexmk: applying rule 'pdflatex'...
    Rule 'pdflatex':  Reasons for rerun
    Changed files or newly in use/created:
      library.aux
      library.ind
      library.toc

    Latexmk: Summary of warnings from last run of *latex:
      Latex found 2 multiply defined reference(s)
      =====Latex reported missing or unavailable character(s).
    =====See log file for details.
    Latexmk: Errors, so I did not complete making targets

    make[2]: *** [Makefile:29: library.pdf] Error 12
    make[2]: Leaving directory '/srv/docsbuild/cpython/Doc/build/latex'
    make[1]: *** [Makefile:216: dist] Error 2
    make[1]: Leaving directory '/srv/docsbuild/cpython/Doc'
    make: *** [Makefile:274: autobuild-dev] Error 2
    make: Leaving directory '/srv/docsbuild/cpython/Doc'

2024-08-11 15:44:37,176 ERROR fr/3.13: Badly handled exception, human, please help.
Traceback (most recent call last):
  File "/srv/docsbuild/scripts/build_docs.py", line 655, in run
    self.build()
  File "/srv/docsbuild/scripts/build_docs.py", line 762, in build
    run(
  File "/srv/docsbuild/scripts/build_docs.py", line 247, in run
    result.check_returncode()
  File "/usr/lib/python3.10/subprocess.py", line 457, in check_returncode
    raise CalledProcessError(self.returncode, self.args, self.stdout,
subprocess.CalledProcessError: Command '['make', '-C', '/srv/docsbuild/cpython/Doc', 'PYTHON=/srv/docsbuild/venv-3.13/bin/python', 'SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build', 'BLURB=/srv/docsbuild/venv-3.13/bin/blurb', 'VENVDIR=/srv/docsbuild/venv-3.13', 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0', 'SPHINXERRORHANDLING=', 'autobuild-dev']' returned non-zero exit status 2.
2024-08-11 15:44:37,178 DEBUG fr/3.13: Resetting dropped connection: sentry.io

It's happening for three French builds, the 3.13 and 3.14 builds:

2024-08-11 00:09:54,728 ERROR fr/3.14: Badly handled exception, human, please help.
2024-08-11 15:44:37,176 ERROR fr/3.13: Badly handled exception, human, please help.
2024-08-11 23:54:51,221 ERROR fr/3.14: Badly handled exception, human, please help.

https://docs.python.org/fr/3.13/ and https://docs.python.org/fr/3.14/ were last updated on 8th August. fr/3.12 is building fine.

[hugovk]

A fr/3.13 build happened to be running now and there's this matching the warnings above:

hugovk@docs:/srv/docsbuild/cpython/Doc/build$ grep -r "multiply def"
latex/library.log:LaTeX Warning: Label `library/string:grammar-token-format_spec' multiply define
latex/library.log:LaTeX Warning: Label `library/tkinter.ttk:layouts' multiply defined.

I'm not sure if they're the errors causing it to fail, but are a good place to start.

"multiply defined" means "defined multiple times".

[AA-Turner]

      =====Latex reported missing or unavailable character(s).
    =====See log file for details.

This also seems suspicious? Is there more detail in the log file?

A

[hugovk]

Here's the whole library.log, assuming it's referring to this one.

This is the contents of the build/latex I managed to copy before the next build cleared the directory. library.* do appear to be the last ones processed/created, but I don't know if anything was before the next build:

LICRcyr2utf8.xdy               howto-cporting.fls                           howto-gdb_helpers.toc                   howto-perf_profiling.out     howto-urllib2.idx
LICRlatin2utf8.xdy             howto-cporting.idx                           howto-instrumentation.aux               howto-perf_profiling.pdf     howto-urllib2.ind
LatinRules.xdy                 howto-cporting.ind                           howto-instrumentation.fdb_latexmk       howto-perf_profiling.tex     howto-urllib2.log
Makefile                       howto-cporting.log                           howto-instrumentation.fls               howto-perf_profiling.toc     howto-urllib2.out
c-api.aux                      howto-cporting.out                           howto-instrumentation.idx               howto-pyporting.aux          howto-urllib2.pdf
c-api.fdb_latexmk              howto-cporting.pdf                           howto-instrumentation.ind               howto-pyporting.fdb_latexmk  howto-urllib2.tex
c-api.fls                      howto-cporting.tex                           howto-instrumentation.log               howto-pyporting.fls          howto-urllib2.toc
c-api.idx                      howto-cporting.toc                           howto-instrumentation.out               howto-pyporting.idx          installing.aux
c-api.ind                      howto-curses.aux                             howto-instrumentation.pdf               howto-pyporting.ind          installing.fdb_latexmk
c-api.log                      howto-curses.fdb_latexmk                     howto-instrumentation.tex               howto-pyporting.log          installing.fls
c-api.out                      howto-curses.fls                             howto-instrumentation.toc               howto-pyporting.out          installing.idx
c-api.pdf                      howto-curses.idx                             howto-ipaddress.aux                     howto-pyporting.pdf          installing.ind
c-api.tex                      howto-curses.ind                             howto-ipaddress.fdb_latexmk             howto-pyporting.tex          installing.log
c-api.toc                      howto-curses.log                             howto-ipaddress.fls                     howto-pyporting.toc          installing.out
extending.aux                  howto-curses.out                             howto-ipaddress.idx                     howto-regex.aux              installing.pdf
extending.fdb_latexmk          howto-curses.pdf                             howto-ipaddress.ind                     howto-regex.fdb_latexmk      installing.tex
extending.fls                  howto-curses.tex                             howto-ipaddress.log                     howto-regex.fls              installing.toc
extending.idx                  howto-curses.toc                             howto-ipaddress.out                     howto-regex.idx              kde_example.png
extending.ind                  howto-descriptor.aux                         howto-ipaddress.pdf                     howto-regex.ind              latexmkjarc
extending.log                  howto-descriptor.fdb_latexmk                 howto-ipaddress.tex                     howto-regex.log              latexmkrc
extending.out                  howto-descriptor.fls                         howto-ipaddress.toc                     howto-regex.out              library.aux
extending.pdf                  howto-descriptor.idx                         howto-isolating-extensions.aux          howto-regex.pdf              library.fdb_latexmk
extending.tex                  howto-descriptor.ind                         howto-isolating-extensions.fdb_latexmk  howto-regex.tex              library.fls
extending.toc                  howto-descriptor.log                         howto-isolating-extensions.fls          howto-regex.toc              library.idx
faq.aux                        howto-descriptor.out                         howto-isolating-extensions.idx          howto-sockets.aux            library.ind
faq.fdb_latexmk                howto-descriptor.pdf                         howto-isolating-extensions.ind          howto-sockets.fdb_latexmk    library.log
faq.fls                        howto-descriptor.tex                         howto-isolating-extensions.log          howto-sockets.fls            library.out
faq.idx                        howto-descriptor.toc                         howto-isolating-extensions.out          howto-sockets.idx            library.pdf
faq.ind                        howto-enum.aux                               howto-isolating-extensions.pdf          howto-sockets.ind            library.tex
faq.log                        howto-enum.fdb_latexmk                       howto-isolating-extensions.tex          howto-sockets.log            library.toc
faq.out                        howto-enum.fls                               howto-isolating-extensions.toc          howto-sockets.out            make.bat
faq.pdf                        howto-enum.idx                               howto-logging-cookbook.aux              howto-sockets.pdf            pathlib-inheritance.png
faq.tex                        howto-enum.ind                               howto-logging-cookbook.fdb_latexmk      howto-sockets.tex            python.ist
faq.toc                        howto-enum.log                               howto-logging-cookbook.fls              howto-sockets.toc            reference.tex
hashlib-blake2-tree.png        howto-enum.out                               howto-logging-cookbook.idx              howto-sorting.aux            sphinx.sty
howto-annotations.aux          howto-enum.pdf                               howto-logging-cookbook.ind              howto-sorting.fdb_latexmk    sphinx.xdy
howto-annotations.fdb_latexmk  howto-enum.tex                               howto-logging-cookbook.log              howto-sorting.fls            sphinxhighlight.sty
howto-annotations.fls          howto-enum.toc                               howto-logging-cookbook.out              howto-sorting.idx            sphinxhowto.cls
howto-annotations.idx          howto-free-threading-extensions.aux          howto-logging-cookbook.pdf              howto-sorting.ind            sphinxlatexadmonitions.sty
howto-annotations.ind          howto-free-threading-extensions.fdb_latexmk  howto-logging-cookbook.tex              howto-sorting.log            sphinxlatexcontainers.sty
howto-annotations.log          howto-free-threading-extensions.fls          howto-logging-cookbook.toc              howto-sorting.out            sphinxlatexgraphics.sty
howto-annotations.out          howto-free-threading-extensions.idx          howto-logging.aux                       howto-sorting.pdf            sphinxlatexindbibtoc.sty
howto-annotations.pdf          howto-free-threading-extensions.ind          howto-logging.fdb_latexmk               howto-sorting.tex            sphinxlatexlists.sty
howto-annotations.tex          howto-free-threading-extensions.log          howto-logging.fls                       howto-sorting.toc            sphinxlatexliterals.sty
howto-annotations.toc          howto-free-threading-extensions.out          howto-logging.idx                       howto-timerfd.aux            sphinxlatexnumfig.sty
howto-argparse.aux             howto-free-threading-extensions.pdf          howto-logging.ind                       howto-timerfd.fdb_latexmk    sphinxlatexobjects.sty
howto-argparse.fdb_latexmk     howto-free-threading-extensions.tex          howto-logging.log                       howto-timerfd.fls            sphinxlatexshadowbox.sty
howto-argparse.fls             howto-free-threading-extensions.toc          howto-logging.out                       howto-timerfd.idx            sphinxlatexstyleheadings.sty
howto-argparse.idx             howto-functional.aux                         howto-logging.pdf                       howto-timerfd.ind            sphinxlatexstylepage.sty
howto-argparse.ind             howto-functional.fdb_latexmk                 howto-logging.tex                       howto-timerfd.log            sphinxlatexstyletext.sty
howto-argparse.log             howto-functional.fls                         howto-logging.toc                       howto-timerfd.out            sphinxlatextables.sty
howto-argparse.out             howto-functional.idx                         howto-mro.aux                           howto-timerfd.pdf            sphinxmanual.cls
howto-argparse.pdf             howto-functional.ind                         howto-mro.fdb_latexmk                   howto-timerfd.tex            sphinxmessages.sty
howto-argparse.tex             howto-functional.log                         howto-mro.fls                           howto-timerfd.toc            sphinxoptionsgeometry.sty
howto-argparse.toc             howto-functional.out                         howto-mro.idx                           howto-unicode.aux            sphinxoptionshyperref.sty
howto-clinic.aux               howto-functional.pdf                         howto-mro.ind                           howto-unicode.fdb_latexmk    sphinxpackageboxes.sty
howto-clinic.fdb_latexmk       howto-functional.tex                         howto-mro.log                           howto-unicode.fls            sphinxpackagecyrillic.sty
howto-clinic.fls               howto-functional.toc                         howto-mro.out                           howto-unicode.idx            sphinxpackagefootnote.sty
howto-clinic.idx               howto-gdb_helpers.aux                        howto-mro.pdf                           howto-unicode.ind            sphinxpackagesubstitutefont.sty
howto-clinic.ind               howto-gdb_helpers.fdb_latexmk                howto-mro.tex                           howto-unicode.log            tk_msg.png
howto-clinic.log               howto-gdb_helpers.fls                        howto-mro.toc                           howto-unicode.out            turtle-star.pdf
howto-clinic.out               howto-gdb_helpers.idx                        howto-perf_profiling.aux                howto-unicode.pdf            tutorial.tex
howto-clinic.pdf               howto-gdb_helpers.ind                        howto-perf_profiling.fdb_latexmk        howto-unicode.tex            using.tex
howto-clinic.tex               howto-gdb_helpers.log                        howto-perf_profiling.fls                howto-unicode.toc            whatsnew.tex
howto-clinic.toc               howto-gdb_helpers.out                        howto-perf_profiling.idx                howto-urllib2.aux            win_install_freethreaded.png
howto-cporting.aux             howto-gdb_helpers.pdf                        howto-perf_profiling.ind                howto-urllib2.fdb_latexmk    win_installer.png
howto-cporting.fdb_latexmk     howto-gdb_helpers.tex                        howto-perf_profiling.log                howto-urllib2.fls

[picnixz]

Here's the whole library.log, assuming it's referring to this one.

Not sure if it's you or GitHub but the logs seem truncated. Can you confirm that there are 5049 lines?

By the way, I don't think the issue is with the labels being redefined. Normally, labels being redefined are only warnings and shouldn't affect the build.

[hugovk]

Yes, this is how long the copy is on the server:

hugovk@docs:~$ wc -l fr-3.13-latex/latex/library.log
5048 fr-3.13-latex/latex/library.log
hugovk@docs:~$ ll fr-3.13-latex/latex/library.log
-rw-rw---- 1 hugovk hugovk 122880 Aug 12 15:41 fr-3.13-latex/latex/library.log

[hugovk]

fr/3.13 now has another error: 'pdflatex' needed too many passes

2024-09-17 15:17:53,682 ERROR fr/3.13: Run: "make -C /srv/docsbuild/cpython/Doc PYTHON=/srv/docsbuild/venv-3.13/bin/python SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build BLURB=/srv/docsbuild/venv-3.13/bin/blurb VENVDIR=/srv/docsbuild/venv-3.13 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0' SPHINXERRORHANDLING= autobuild-dev" KO:
       'pdflatex' needed too many passes
    ----------------------
    Latexmk: Sometimes, the -f option can be used to get latexmk
      to try to force complete processing.
      But normally, you will need to correct the file(s) that caused the
      error, and then rerun latexmk.
      In some cases, it is best to clean out generated files before rerunning
      latexmk after you've corrected the files.
    Latexmk: Summary of warnings from last run of *latex:
      Latex found 2 multiply defined reference(s)
      =====Latex reported missing or unavailable character(s).
    =====See log file for details.

    make[2]: *** [Makefile:29: library.pdf] Error 12
    make[2]: Leaving directory '/srv/docsbuild/cpython/Doc/build/latex'
    make[1]: *** [Makefile:226: dist] Error 2
    make[1]: Leaving directory '/srv/docsbuild/cpython/Doc'
    make: *** [Makefile:289: autobuild-dev] Error 2
    make: Leaving directory '/srv/docsbuild/cpython/Doc'

2024-09-17 15:17:53,687 ERROR fr/3.13: Badly handled exception, human, please help.
Traceback (most recent call last):
  File "/srv/docsbuild/scripts/build_docs.py", line 655, in run
    self.copy_build_to_webroot(http)
  File "/srv/docsbuild/scripts/build_docs.py", line 762, in build
    run(
  File "/srv/docsbuild/scripts/build_docs.py", line 247, in run
  File "/usr/lib/python3.10/subprocess.py", line 457, in check_returncode
    raise CalledProcessError(self.returncode, self.args, self.stdout,
subprocess.CalledProcessError: Command '['make', '-C', '/srv/docsbuild/cpython/Doc', 'PYTHON=/srv/docsbuild/venv-3.13/bin/python', 'SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build', 'BLURB=/srv/docsbuild/venv-3.13/bin/blurb', 'VENVDIR=/srv/docsbuild/venv-3.13', 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0', 'SPHINXERRORHANDLING=', 'autobuild-dev']' returned non-zero exit status 2.

However, https://docs.python.org/fr/3.14/ has now recovered: "Mis à jour le Sep 17, 2024 (10:36 UTC)."

Its last error was also 'pdflatex' needed too many passes on 2024-09-12 14:04.
Its first successful build was 2024-09-13 23:29.

(fr/3.12 is still building fine.)

[picnixz]

Some hypotheses:

• more passes are needed for fixing up references. Though it's weird that we have those warnings. I'll need to investigate locally.
• there seem to be unsupoorted unicode characters but we don't know which ones.

Now, do the logs have some "LaTeX Error" message? Have you tried using xelatex instead of pdflatex? (why is it saying pdflatex but you are specifying xelatex as the engine????) because I think that the regex section requires xelatex because of a special character somewhere in the document.

[hugovk]

No "LaTeX Error" in the logs. Here's the whole fr/3.13 part:

2024-09-18 16:19:13,943 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/cpython fetch'
2024-09-18 16:19:14,144 INFO fr/3.13: Running.
2024-09-18 16:19:14,144 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/cpython show-ref -s origin/3.13'
2024-09-18 16:19:14,148 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/cpython reset --hard 112b1704fa6165ce6386ce2d9363fb73dd799de5 --'
2024-09-18 16:19:14,174 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/cpython clean -dfqx'
2024-09-18 16:19:14,188 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/3.13/locale/fr/LC_MESSAGES fetch'
2024-09-18 16:19:14,506 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/3.13/locale/fr/LC_MESSAGES branch -r'
2024-09-18 16:19:14,511 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/3.13/locale/fr/LC_MESSAGES show-ref -s origin/3.11'
2024-09-18 16:19:14,514 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/3.13/locale/fr/LC_MESSAGES reset --hard 2d42a3c0d181f19ab1bd62400bfafc9a8304a4b1 --'
2024-09-18 16:19:14,568 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/3.13/locale/fr/LC_MESSAGES clean -dfqx'
2024-09-18 16:19:14,726 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/cpython rev-parse HEAD'
2024-09-18 16:19:14,729 DEBUG fr/3.13: Run: 'git -C /srv/docsbuild/3.13/locale/fr/LC_MESSAGES rev-parse HEAD'
2024-09-18 16:19:14,732 INFO fr/3.13: Should rebuild: new translations (from ceaeb373626e282ba17220752aa2c522fd046891 to 2d42a3c0d181f19ab1bd62400bfafc9a8304a4b1)
2024-09-18 16:19:14,732 DEBUG fr/3.13: Run: '/srv/docsbuild/venv/bin/python -m venv /srv/docsbuild/venv-3.13'
2024-09-18 16:19:17,377 DEBUG fr/3.13: Run: '/srv/docsbuild/venv-3.13/bin/python -m pip install --upgrade --upgrade-strategy=eager python-docs-theme jieba -rrequirements.txt'
2024-09-18 16:19:20,902 DEBUG fr/3.13: Run: '/srv/docsbuild/venv-3.13/bin/python -m pip freeze --all'
2024-09-18 16:19:21,494 INFO fr/3.13: Build start.
2024-09-18 16:19:21,494 INFO fr/3.13: Running make autobuild-dev
2024-09-18 16:19:21,494 DEBUG fr/3.13: Run: "sed -i 's/ *-A switchers=1//' /srv/docsbuild/cpython/Doc/Makefile"
2024-09-18 16:19:21,502 DEBUG fr/3.13: Run: "make -C /srv/docsbuild/cpython/Doc PYTHON=/srv/docsbuild/venv-3.13/bin/python SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build BLURB=/srv/docsbuild/venv-3.13/bin/blurb VENVDIR=/srv/docsbuild/venv-3.13 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0' SPHINXERRORHANDLING= autobuild-dev"
2024-09-18 16:49:43,031 ERROR fr/3.13: Run: "make -C /srv/docsbuild/cpython/Doc PYTHON=/srv/docsbuild/venv-3.13/bin/python SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build BLURB=/srv/docsbuild/venv-3.13/bin/blurb VENVDIR=/srv/docsbuild/venv-3.13 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0' SPHINXERRORHANDLING= autobuild-dev" KO:
       'pdflatex' needed too many passes
    ----------------------
    Latexmk: Sometimes, the -f option can be used to get latexmk
      to try to force complete processing.
      But normally, you will need to correct the file(s) that caused the
      error, and then rerun latexmk.
      In some cases, it is best to clean out generated files before rerunning
      latexmk after you've corrected the files.
    Latexmk: Summary of warnings from last run of *latex:
      Latex found 2 multiply defined reference(s)
      =====Latex reported missing or unavailable character(s).
    =====See log file for details.

    make[2]: *** [Makefile:29: library.pdf] Error 12
    make[2]: Leaving directory '/srv/docsbuild/cpython/Doc/build/latex'
    make[1]: *** [Makefile:226: dist] Error 2
    make[1]: Leaving directory '/srv/docsbuild/cpython/Doc'
    make: *** [Makefile:289: autobuild-dev] Error 2
    make: Leaving directory '/srv/docsbuild/cpython/Doc'

2024-09-18 16:49:43,116 ERROR fr/3.13: Badly handled exception, human, please help.
Traceback (most recent call last):
  File "/srv/docsbuild/scripts/build_docs.py", line 654, in run
    self.build()
  File "/srv/docsbuild/scripts/build_docs.py", line 762, in build
    run(
  File "/srv/docsbuild/scripts/build_docs.py", line 245, in run
    result.check_returncode()
  File "/usr/lib/python3.10/subprocess.py", line 457, in check_returncode
    raise CalledProcessError(self.returncode, self.args, self.stdout,
subprocess.CalledProcessError: Command '['make', '-C', '/srv/docsbuild/cpython/Doc', 'PYTHON=/srv/docsbuild/venv-3.13/bin/python', 'SPHINXBUILD=/srv/docsbuild/venv-3.13/bin/sphinx-build', 'BLURB=/srv/docsbuild/venv-3.13/bin/blurb', 'VENVDIR=/srv/docsbuild/venv-3.13', 'SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc=\\\\usepackage{fontspec} -q -D locale_dirs=/srv/docsbuild/3.13/locale -D language=fr -D gettext_compact=0', 'SPHINXERRORHANDLING=', 'autobuild-dev']' returned non-zero exit status 2.
2024-09-18 16:49:43,121 DEBUG fr/3.13: Starting new HTTPS connection (1): sentry.io:443

Have you tried using xelatex instead of pdflatex? (why is it saying pdflatex but you are specifying xelatex as the engine????)

I've not tried changing anything, it has this in config.toml:

[languages.fr]
name = "French"
sphinxopts = [
    '-D latex_engine=xelatex',
    '-D latex_elements.inputenc=',
    '-D latex_elements.fontenc=\\usepackage{fontspec}',
]

[picnixz]

This is really weird. In order to pinpoint the issue we may try to manually build the docs and see whether they fail (namely manually invoking make latex and possibly manually invoking the latex commands). There's a way to increase the number of passes but I don't remember the option.

I'll try to first compile the library.tex file (or maybe one file at a time) when I'm back home (next week). By default I think latemk does 5 passes (which is also one reason why latex builds can take a long time).

[jfbu]

      =====Latex reported missing or unavailable character(s).
    =====See log file for details.

This also seems suspicious? Is there more detail in the log file?

A

This by itself can not cause a LaTeX build failure (it would with \tracinglostchars=3 added to .tex file) but it must be investigated by the French translation team as it means the PDF is missing glyphs (maybe replaced by square boxes). It is strange though that this should arise only in French translation.

It should first be checked if the English language build has the same. Latexmk by default will not end with positive return status when emitting such a thing. It is not the reason there is build failure.

hugovk@docs:/srv/docsbuild/cpython/Doc/build$ grep -r "multiply def"
latex/library.log:LaTeX Warning: Label `library/string:grammar-token-format_spec' multiply define
latex/library.log:LaTeX Warning: Label `library/tkinter.ttk:layouts' multiply defined.

this only indicates some usually minor problem
it may mean though that internal hyperlinks will target wrong location

By the way, I don't think the issue is with the labels being redefined. Normally, labels being redefined are only warnings and shouldn't affect the build.

yes, agreed. Such latex warnings should be fixed but are not by themselves causing a build failure.

Here's the whole library.log, assuming it's referring to this one.

Unfortunately we can only deduce that the error occurred somewhere after page 250, probably on page 251, but this refers to output not input. And the problem is that contrarily to dvi/xdv format there can not be a partial pdf, if xelatex fails during pdf build, there is nothing at all. If latexmk is run with option -xelatex, it will make an xdv, which may still be validly processed by xdvipdfmx.

Anyway, the sole way is to build locally as said by @picnixz.

By default I think latemk does 5 passes (which is also one reason why latex builds can take a long time).

5 passes is the default maximal number. But most documents require usually 3 or 4 passes only (3 being often a minimum).

Have you tried using xelatex instead of pdflatex? (why is it saying pdflatex but you are specifying xelatex as the engine????)

This is due to some peculiarity (for legacy reasons of compatiblity with old Latexmk or other reasons now forgotten) of how Sphinx uses here Latexmk, the pdflatex here is a Perl variable $pdflatex = 'xelatex ' . $ENV{'LATEXOPTS'} . ' %O %S'; (you can see this in file latexmkrc in build directory). The log file did show that it is xelatex. With make latexpdf LATEXMKOPTS="-xelatex" it would have referred to 'xelatex'. This option would have left in the build directory an xdv file containing the 250 first pages. This would help locate in library.tex where to look for for manual investigation.

As @picnixz explains, the sole way to handle this is to recover the full build directory and (for example) add manually \stop inside library.tex and trigger manually the build inside the build directory. (because the nature of the crash seems to be such that we do not get a log file going til the error; but normally doing the build manually with an added \errorcontextlines=10 in the source should help). This is painful because aux file (also toc file etc) may have been corrupted and one has to remove them first each time. It is a bit rare when the LaTeX log file is truncated like this but it happens. Assuming it really is truncated which perhaps we will see it is not if building manually.

(I don't have much time myself and can only perhaps look at this in a few days, and after that I can't for at least 2 to 3 weeks).

[hugovk]

This by itself can not cause a LaTeX build failure (it would with \tracinglostchars=3 added to .tex file) but it must be investigated by the French translation team as it means the PDF is missing glyphs (maybe replaced by square boxes). It is strange though that this should arise only in French translation.

cc @JulienPalard