Tree-Sitter-Cyber
Tree-Sitter-Cyber
Custom Parser for the Cyber Language
Developed a complete Tree-sitter grammar for the Cyber scripting language including a custom C++ scanner for handling complex language features.
Technical Highlights
- Created precise grammar definitions in JavaScript using Tree-sitter’s DSL
- Implemented custom precedence rules for complex expression parsing
- Generated optimized Rust parser code from Tree-sitter grammar
- Developed custom highlighting queries for semantic tokens
- Built cross-platform compatibility with WASM compilation support
Custom C++ Scanner Implementation
- Created a sophisticated lexer using Tree-sitter’s external scanner API
- Implemented proper indentation-based scoping with indent/dedent token generation
- Developed robust string literal handling for single, double, and triple quotes
- Built support for multiline strings with appropriate delimiter tracking
- Implemented a delimiter stack system for proper nesting and context tracking
- Added debug facilities for development and troubleshooting
- Utilized modern C++ features for memory safety and performance