Ubuntu

Binary package “python3-tokenize-rt” in ubuntu oracular

  1. Oracular (24.10)
  2. python3-tokenize-rt

wrapper around the Python stdlib `tokenize` which roundtrips

 The stdlib tokenize module does not properly roundtrip. This wrapper
 around the stdlib provides two additional tokens ESCAPED_NL and
 UNIMPORTANT_WS, and a Token data type. Use src_to_tokens and
 tokens_to_src to roundtrip.
 .
 This library is useful if you're writing a refactoring tool based on
 the python tokenization.

Source package