Function tokenize

tokenize(src: string, opts?: { file?: string }): Token[]
Tokenizes a whole CASC source.
Parameters
- src: string
- Optionalopts: { file?: string } = {}
Returns Token[]

Throws
stage lexer, when no token matches at some position
- Defined in src/grammar/lexer.cjs:222