cpython/Lib/urllib
Serhiy Storchaka 561d1b95b9
[3.13] gh-138907: Support RFC 9309 in robotparser (GH-138908) (GH-149376)
* empty lines are always ignored instead of separating groups
* the "user-agent" line after a rule starts a new group
* groups matching the same user agent are now merged
* the rule with the longest match wins instead of the first matching rule
* in case of equal matches, the “Allow” rule wins over “Disallow”
* special characters “$” and “*” are now supported in rules
* prefer full match for user agent

(cherry picked from commit bc285e5832)
2026-05-04 18:43:03 +00:00
..
__init__.py
error.py gh-101936: Update the default value of fp from io.StringIO to io.BytesIO (gh-102100) 2023-02-22 00:14:41 +09:00
parse.py [3.13] gh-144148: Update the urllib.parse documentation (GH-144497) (GH-144507) (GH-144509) 2026-02-05 15:47:52 +00:00
request.py [3.13] gh-143925: Reject control characters in data: URL mediatypes (#144111) 2026-01-25 17:06:01 +00:00
response.py bpo-12707: deprecate info(), geturl(), getcode() methods in favor of headers, url, and status properties for HTTPResponse and addinfourl (GH-11447) 2019-09-13 12:40:07 +01:00
robotparser.py [3.13] gh-138907: Support RFC 9309 in robotparser (GH-138908) (GH-149376) 2026-05-04 18:43:03 +00:00