Skip to content

GitLab

Explore

Sign in

Sentience Tokenize

Project information

Sentience Tokenize

🔧🔗https://github.com/nbursa/sentience-tokenize Tiny zero‑dep tokenizer for small DSLs in Rust - iterator & zero‑copy modes, spans, keywords/nums/strings/parens/ops. Optional serde, MSRV 1.81.

rust parser parsing dsl tokenizer zero-copy serde

68 Commits
1 Branch
8 Tags

README
MIT License
CHANGELOG

Created on

August 26, 2025

Loading

🐾❤️ Strive to be the person your dogs believe you are ❤️🐾