cpython/Doc
Pablo Galindo Salgado 1822f33b1a
[3.14] gh-91048: Refactor and optimize remote debugging module (#134652) (#134673)
gh-91048: Refactor and optimize remote debugging module (#134652)

Completely refactor Modules/_remote_debugging_module.c with improved
code organization, replacing scattered reference counting and error
handling with centralized goto error paths. This cleanup improves
maintainability and reduces code duplication throughout the module while
preserving the same external API.

Implement memory page caching optimization in Python/remote_debug.h to
avoid repeated reads of the same memory regions during debugging
operations. The cache stores previously read memory pages and reuses
them for subsequent reads, significantly reducing system calls and
improving performance.

Add code object caching mechanism with a new code_object_generation
field in the interpreter state that tracks when code object caches need
invalidation. This allows efficient reuse of parsed code object metadata
and eliminates redundant processing of the same code objects across
debugging sessions.

Optimize memory operations by replacing multiple individual structure
copies with single bulk reads for the same data structures. This reduces
the number of memory operations and system calls required to gather
debugging information from the target process.

Update Makefile.pre.in to include Python/remote_debug.h in the headers
list, ensuring that changes to the remote debugging header force proper
recompilation of dependent modules and maintain build consistency across
the codebase.

Also, make the module compatible with the free threading build as an extra :)

Co-authored-by: Ɓukasz Langa <lukasz@langa.pl>

(cherry picked from commit 42b25ad4d3)
2025-05-25 22:10:20 +00:00
..
_static Use sphinxext-opengraph to generate OpenGraph metadata (#99931) 2022-12-05 23:26:28 +02:00
c-api [3.14] Fix sphinx-lint warnings (default-role used). (GH-134647) (#134670) 2025-05-25 19:29:04 +00:00
data [3.14] gh-91048: Refactor and optimize remote debugging module (#134652) (#134673) 2025-05-25 22:10:20 +00:00
deprecations [3.14] gh-133823: update "Pending Removal in 3.15" notes about TypedDict (GH-133864) (#133870) 2025-05-11 08:16:28 +00:00
distributing GH-107987: Remove the Distributing Python Modules guide (#108016) 2023-08-17 13:01:14 +03:00
extending gh-111178: fix incorrect function signatures in docs (#132395) 2025-04-11 14:59:38 +00:00
faq Fix numbered list syntax in programming.rst (#130158) 2025-04-05 20:20:21 +01:00
howto [3.14] gh-134595: Update HOWTO to reflect change in CIBW option (GH-134598) (#134622) 2025-05-24 07:21:34 +00:00
includes GH-132330: Synchronise `Doc/includes/typestruct.h with PyTypeObject` (#132332) 2025-04-10 01:51:56 +01:00
installing GH-107987: Remove the Distributing Python Modules guide (#108016) 2023-08-17 13:01:14 +03:00
library [3.14] gh-133960: Improve typing.evaluate_forward_ref (GH-133961) (#134663) 2025-05-25 17:52:04 +00:00
reference [3.14] gh-134026: Fix grammar description of for statement (GH-134034) (GH-134424) 2025-05-21 18:43:07 +02:00
tools [3.14] Consistent sentence case in docs template files (GH-134412) (#134495) 2025-05-22 12:57:42 +03:00
tutorial [3.14] Docs: Add note to tutorial clarifying scope (GH-134534) (#134536) 2025-05-22 18:32:49 +00:00
using [3.14] Further improves Advanced installation docs for PyManager (GH-134541) (GH-134576) 2025-05-23 10:23:06 +00:00
whatsnew [3.14] gh-127945: Update What's New in Python 3.14 for free-threaded ctypes (GH-134332) (#134364) 2025-05-20 17:02:55 +00:00
.ruff.toml Lint: Create a project-wide `.ruff.toml` settings file (#133124) 2025-05-01 08:28:44 +00:00
about.rst Reword about.rst to not limit Sphinx (#128325) 2024-12-31 23:22:33 +02:00
bugs.rst Remove reference to docs mailing list for bug reports (#122323) 2024-07-26 13:56:39 -07:00
conf.py [3.14] gh-101100: Fix Sphinx warnings in library/decimal.rst (GH-134303) (#134338) 2025-05-20 14:52:11 +00:00
constraints.txt GH-125722: Increase minimum supported Sphinx to 8.1.3 (#128922) 2025-01-20 00:26:24 +00:00
contents.rst gh-122085: Create dedicated page for deprecations (#122352) 2024-07-28 10:53:21 +03:00
copyright.rst gh-126133: Only use start year in PSF copyright, remove end years (#126236) 2024-11-12 15:59:19 +02:00
glossary.rst [3.14] gh-75459: Doc: C API: Improve object life cycle documentation (GH-125962) (GH-134344) 2025-05-20 19:11:01 +02:00
license.rst gh-132983: Introduce _zstd bindings module (GH-133027) 2025-05-04 01:29:55 +00:00
make.bat GH-121970: Extract `misc_news` into a new extension (#129577) 2025-02-02 16:17:02 +00:00
Makefile Generate social media preview cards for the documentation (#132101) 2025-04-05 14:20:06 +00:00
README.rst Add lightweight comments to conf.py and update docs readme (GH-126100) 2024-10-29 17:45:03 +00:00
requirements.txt Generate social media preview cards for the documentation (#132101) 2025-04-05 14:20:06 +00:00

Python Documentation README
~~~~~~~~~~~~~~~~~~~~~~~~~~~

This directory contains the reStructuredText (reST) sources to the Python
documentation.  You don't need to build them yourself, `prebuilt versions are
available <https://docs.python.org/dev/download.html>`_.

Documentation on authoring Python documentation, including information about
both style and markup, is available in the "`Documenting Python
<https://devguide.python.org/documenting/>`_" chapter of the
developers guide.


Building the docs
=================

The documentation is built with several tools which are not included in this
tree but are maintained separately and are available from
`PyPI <https://pypi.org/>`_.

* `Sphinx <https://pypi.org/project/Sphinx/>`_
* `blurb <https://pypi.org/project/blurb/>`_
* `python-docs-theme <https://pypi.org/project/python-docs-theme/>`_

The easiest way to install these tools is to create a virtual environment and
install the tools into there.

Using make
----------

To get started on Unix, you can create a virtual environment and build
documentation with the commands::

  make venv
  make html

The virtual environment in the ``venv`` directory will contain all the tools
necessary to build the documentation downloaded and installed from PyPI.
If you'd like to create the virtual environment in a different location,
you can specify it using the ``VENVDIR`` variable.

You can also skip creating the virtual environment altogether, in which case
the ``Makefile`` will look for instances of ``sphinx-build`` and ``blurb``
installed on your process ``PATH`` (configurable with the ``SPHINXBUILD`` and
``BLURB`` variables).

On Windows, we try to emulate the ``Makefile`` as closely as possible with a
``make.bat`` file. If you need to specify the Python interpreter to use,
set the ``PYTHON`` environment variable.

Available make targets are:

* "clean", which removes all build files and the virtual environment.

* "clean-venv", which removes the virtual environment directory.

* "venv", which creates a virtual environment with all necessary tools
  installed.

* "html", which builds standalone HTML files for offline viewing.

* "htmlview", which re-uses the "html" builder, but then opens the main page
  in your default web browser.

* "htmllive", which re-uses the "html" builder, rebuilds the docs,
  starts a local server, and automatically reloads the page in your browser
  when you make changes to reST files (Unix only).

* "htmlhelp", which builds HTML files and a HTML Help project file usable to
  convert them into a single Compiled HTML (.chm) file -- these are popular
  under Microsoft Windows, but very handy on every platform.

  To create the CHM file, you need to run the Microsoft HTML Help Workshop
  over the generated project (.hhp) file.  The ``make.bat`` script does this for
  you on Windows.

* "latex", which builds LaTeX source files as input to ``pdflatex`` to produce
  PDF documents.

* "text", which builds a plain text file for each source file.

* "epub", which builds an EPUB document, suitable to be viewed on e-book
  readers.

* "linkcheck", which checks all external references to see whether they are
  broken, redirected or malformed, and outputs this information to stdout as
  well as a plain-text (.txt) file.

* "changes", which builds an overview over all versionadded/versionchanged/
  deprecated items in the current version. This is meant as a help for the
  writer of the "What's New" document.

* "coverage", which builds a coverage overview for standard library modules and
  C API.

* "pydoc-topics", which builds a Python module containing a dictionary with
  plain text documentation for the labels defined in
  ``tools/pyspecific.py`` -- pydoc needs these to show topic and keyword help.

* "check", which checks for frequent markup errors.

* "dist", (Unix only) which creates distributable archives of HTML, text,
  PDF, and EPUB builds.


Without make
------------

First, install the tool dependencies from PyPI.

Then, from the ``Doc`` directory, run ::

   sphinx-build -b<builder> . build/<builder>

where ``<builder>`` is one of html, text, latex, or htmlhelp (for explanations
see the make targets above).

Deprecation header
==================

You can define the ``outdated`` variable in ``html_context`` to show a
red banner on each page redirecting to the "latest" version.

The link points to the same page on ``/3/``, sadly for the moment the
language is lost during the process.


Contributing
============

Bugs in the content should be reported to the
`Python bug tracker <https://github.com/python/cpython/issues>`_.

Bugs in the toolset should be reported to the tools themselves.

To help with the documentation, or report any problems, please leave a message
on `discuss.python.org <https://discuss.python.org/c/documentation>`_.