7 commits

Author	SHA1	Message	Date
Tim Peters	3b5de4db92	Reverted whitespace normalization on this file. I should really change ... this thing so it doesn't rely on being unnormalized. (That's the editorial "I", if anyone's listening <wink>.)	2003-02-19 02:44:12 +00:00
Tim Peters	f2715e0764	Whitespace normalization.	2003-02-19 02:35:07 +00:00
Guido van Rossum	fc26c0730c	Undo Barry's change. This file is not imported, it's fed as input to ... the tokenize module by test_tokenize.py. The FutureWarnings only appeared during installation, and I've figured out a way to suppress those in a different way.	2002-08-29 15:10:30 +00:00
Barry Warsaw	266e6b1f4b	Quite down some FutureWarnings.	2002-08-28 16:36:11 +00:00
Jeremy Hylton	a4553c04fd	There's no need for the tokenize tests to include a SyntaxError.	2001-04-13 14:36:51 +00:00
Ka-Ping Yee	1ff08b1243	Add tokenizer support and tests for u'', U"", uR'', Ur"", etc.	2001-01-15 22:04:30 +00:00
Guido van Rossum	0874f7fdaf	Tests for tokenize.py (Ka-Ping Yee)	1997-10-27 22:15:06 +00:00