okikio.dev / wikitext
[READ-ONLY] Mirror of https://github.com/okikio/wikitext. Event-stream based wikitext parser
deno typescript wikitext-parser
Star
Fork 0
Watch

Commits on main

docs(instructions): refine guidance on ASCII diagrams and benchmarking practices
Signed-off-by: Okiki Ojo <hey@okikio.dev>
main
Okiki Ojo committed
chore(devcontainer): add customizations for VSCode extensions and Deno path
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
chore(devcontainer): add initial devcontainer lock configuration
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
ci(devcontainer): add initial configuration for Node.js & TypeScript environment
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(architecture): update parser-result and API direction notes for clarity
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(api): add new parsing methods for enhanced diagnostics and recovery
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
chore(parse): add diagnostics support for stateless and session parsing
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(readme): clarify range-first design choice and API capabilities
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
refactor(tree): replace TreeBuildMode with TreeMaterializationPolicy for consistency
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(session): add strict diagnostics benchmarks for pathological and synthetic articles
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
tests(session): add analyze and materialize methods tests for session functionality
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(session): add analyze and materialize methods for cached findings
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(parser): add diagnostics benchmarks for pathological and synthetic articles
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
tests(parser): add analyze and materialize functions for enhanced diagnostics
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(parse): introduce findings-first analysis and materialization workflow
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
refactor(mod): streamline re-exports for parser session methods
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
refactor(parser): expose internal interfaces for inline text group context
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(research): document lessons from other parser families for wikitext design
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs: add comprehensive examples for parser usage and diagnostics
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs: introduce parser result model documentation with clear separation of paths
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
tests(parser): add strict parsing and tree building options with diagnostics
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs: enhance re-exported parser capabilities with strict diagnostics
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
chore: add URI acceptance and rejection fixtures for testing
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(token): define stable token type map for tokenizer vocabulary
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(tree): refine tree materialization policies and diagnostics handling
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(parser): introduce strict diagnostics and recovery options for event parsing
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(session): add strict diagnostics parsing and improve session caching behavior
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(parser): enhance URI handling for inline events
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(filter): add benchmarks for filtering helpers and diagnostics
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
chore: introduce stable diagnostic code map for parser diagnostics
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
fix(parser): update BlockEventOptions to use diagnostics flag for recovery events
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(architecture): add detailed documentation for parser result models
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(architecture): introduce structured documentation for parser architecture
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(architecture): introduce comprehensive pipeline documentation for parser stages
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(architecture): introduce malformed input model for parser behavior
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(corpus): add corpus matrix for structured parser testing strategy
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(architecture): restructure architecture documentation for clarity and navigation
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(readme): add architecture and usage references for better guidance
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(parser): add strict and diagnostic parsing modes for improved error handling
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(parser): enhance parsing options with strict and diagnostic modes
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
test(mod): re-export orchestration and filter helpers for enhanced API access
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(events): add micro-benchmarks for event constructors and token validation
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
test(filter): add comprehensive tests for filter and diagnostic helpers
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
test(parse): add comprehensive tests for orchestration and tree-building APIs
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(parse): add benchmarks for parse orchestration and stateless workflows
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(blockParser): add benchmarks for block events processing
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
test(blockEvents): add tests for unclosed table recovery and Unicode payload stability
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
test(inline): add error recovery for malformed inline tags
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(inline): add benchmarks for inline parsing and helper construction
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(session): add benchmarks for cached session workflows
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
test(session): add comprehensive tests for session behavior and caching
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(tokenizer): add benchmarks for various text input scenarios
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
test(tokenizer): add tests for unicode text handling in tokens
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
bench(tree): add benchmarks for tree materialization performance
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
chore(session): add cold and warm drain functions for outline and events
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(recovery): clarify tree recovery types and their implications
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
docs(parser): document parseWithDiagnostics for stricter tree structure
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(mod): re-export additional parser and tree builder helpers for orchestration
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(inline-parser): add diagnostic support for unterminated and missing close tags
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed
feat(filter): add tree and event filtering helpers for common queries
Signed-off-by: Okiki Ojo <hey@okikio.dev>
Okiki Ojo committed