cpython/Parser/tokenizer
2026-06-14 12:33:03 +00:00
..
file_tokenizer.c gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275) 2026-06-06 01:58:35 +00:00
helpers.c gh-151461: Fix encoding-related exception handling in file tokenizer (GH-151462) 2026-06-14 12:33:03 +00:00
helpers.h gh-151461: Fix encoding-related exception handling in file tokenizer (GH-151462) 2026-06-14 12:33:03 +00:00
readline_tokenizer.c gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing (#150275) 2026-06-06 01:58:35 +00:00
string_tokenizer.c gh-145234: Normalize decoded CR in string tokenizer (#145281) 2026-02-27 12:44:54 +00:00
tokenizer.h gh-104169: Refactor tokenizer into lexer and wrappers (#110684) 2023-10-11 15:14:44 +00:00
utf8_tokenizer.c gh-104169: Refactor tokenizer into lexer and wrappers (#110684) 2023-10-11 15:14:44 +00:00