Stowage/cpython
2
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2025-12-31 04:23:37 +00:00
Code Issues Projects Releases Packages Wiki Activity

bpo-44987: Speed up unicode normalization of ASCII strings (GH-28283)

Browse source
This commit is contained in:
Dong-hee Na 2021-09-11 15:04:38 +00:00 • committed by GitHub
parent 97ea18eced
commit 9abd07e596
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 9 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
Doc/whatsnew/3.11.rst
View file

@ -287,6 +287,9 @@ Optimizations
* :file:`.pdbrc` is now read with ``'utf-8'`` encoding.
* Pure ASCII strings are now normalized in constant time by :func:`unicodedata.normalize`.
(Contributed by Dong-hee Na in :issue:`bpo-44987`.)
CPython bytecode changes
========================

2
Misc/NEWS.d/next/Library/2021-09-11-14-41-02.bpo-44987.Mt8DiX.rst Normal file
View file

@ -0,0 +1,2 @@
Pure ASCII strings are now normalized in constant time by :func:`unicodedata.normalize`.
Patch by Dong-hee Na.

4
Modules/unicodedata.c
View file

@ -807,6 +807,10 @@ is_normalized_quickcheck(PyObject *self, PyObject *input, bool nfc, bool k,
return NO;
}
if (PyUnicode_IS_ASCII(input)) {
return YES;
}
Py_ssize_t i, len;
int kind;
const void *data;