cpython

Stowage/cpython

Fork 0

mirror of https://github.com/python/cpython.git synced 2025-10-31 13:41:24 +00:00

Commit graph

Author	SHA1	Message	Date
Serhiy Storchaka	13ad3b7a82	bpo-31462: Remove trailing whitespaces. (#3564 )	2017-09-14 09:38:36 +03:00
Martin v. Löwis	3c6938d22b	Ran svneol.py	2008-06-13 23:34:35 +00:00
Trent Nelson	428de65ca9	- Issue #719888 : Updated tokenize to use a bytes API. generate_tokens has been renamed tokenize and now works with bytes rather than strings. A new detect_encoding function has been added for determining source file encoding according to PEP-0263. Token sequences returned by tokenize always start with an ENCODING token which specifies the encoding used to decode the file. This token is used to encode the output of untokenize back to bytes. Credit goes to Michael "I'm-going-to-name-my-first-child-unittest" Foord from Resolver Systems for this work.	2008-03-18 22:41:35 +00:00

Author

SHA1

Message

Date

Serhiy Storchaka

13ad3b7a82

bpo-31462: Remove trailing whitespaces. (#3564 )

2017-09-14 09:38:36 +03:00

Martin v. Löwis

3c6938d22b

Ran svneol.py

2008-06-13 23:34:35 +00:00

Trent Nelson

428de65ca9

- Issue #719888 : Updated tokenize to use a bytes API. generate_tokens has been

renamed tokenize and now works with bytes rather than strings. A new
  detect_encoding function has been added for determining source file encoding
  according to PEP-0263. Token sequences returned by tokenize always start
  with an ENCODING token which specifies the encoding used to decode the file.
  This token is used to encode the output of untokenize back to bytes.

Credit goes to Michael "I'm-going-to-name-my-first-child-unittest" Foord from Resolver Systems for this work.

2008-03-18 22:41:35 +00:00

3 commits