Something went wrong. Try again.
we (web engine): Experimental web browser project to understand the limits of Claude
Something went wrong. Try again.
Implement JS lexer/tokenizer (ECMAScript 2024) master
Add a full JavaScript lexer to the we-js crate supporting all ES2024 token types: keywords, identifiers (including Unicode), numeric literals (decimal, hex, octal, binary with separators), string literals with full escape sequences, template literals with ${} substitution tracking, regular expression literals with context-based disambiguation, and all punctuators/operators. Includes source position tracking (line/column) and newline tracking for automatic semicolon insertion. 48 unit tests covering all token types, edge cases, and error handling. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Author Pierre Le Fevre Co-author Claude Opus 4.6 (1M context) Committer Tangled Date (Mar 22, 2026, 8:19 AM UTC) Commit 9086495c 9086495c0f7522eea8cd7229423bb0d48b8adc85 Parent 4db56ec4 4db56ec4d178e530f29e5e04964fa6792eaa02e6