OpenBSD Handbook

OpenBSD 7.9 release · amd64 · Generated 2026-09-09

py3-tokenize-rt-6.2.0

round-tripping wrapper for Python stdlib's "tokenize"

Back to search · Project homepage

Description

The stdlib tokenize module does not properly roundtrip. This wrapper around the stdlib provides two additional tokens ESCAPED_NL and UNIMPORTANT_WS, and a Token data type. Use src_to_tokens and tokens_to_src to roundtrip. This library is useful if you're writing a refactoring tool based on the Python tokenization.

Package information

Ports path
devel/py-tokenize-rt
Package architecture
amd64
Maintainer
The OpenBSD ports mailing-list <ports@openbsd.org>
Categories
devel, lang/python
Available flavors
None listed
Only for architectures
aarch64, amd64, arm, i386, mips64, mips64el, powerpc, powerpc64, riscv64, alpha, hppa, sparc64

These are ports metadata. Binary availability depends on the release, architecture and mirror. Build and test dependencies are not an installation checklist.

Direct dependencies

Runtime

Build

Used by (1 dependency relationships)

Includes library, runtime, build and test relationships. Results load 100 at a time.

Installing and updating packages · Package details as JSON