pierrelf.com / we
we (web engine): Experimental web browser project to understand the limits of Claude
Star
Fork 0
Watch

Implement CSS tokenizer per CSS Syntax Module Level 3 master

Full tokenizer state machine producing all CSS token types: ident, function, at-keyword, hash, string, url, number, percentage, dimension, whitespace, delimiters, CDO/CDC. Handles escape sequences, comments, number consumption (integer/float/exponent), url tokens, and input preprocessing (CRLF normalization, null replacement). 43 unit tests covering all token types, edge cases, and real CSS patterns. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Author Pierre Le Fevre Co-author Claude Opus 4.6 Date Commit 8f5010ba Parent cfdd0280
+983
2 changed files