Type representing acceptable formats to define token definitions for a
SimpleLexer
tokens: Record<keyof any, SimpleLexerTokenDefinition["pattern"]> | SimpleLexerTokenDefinition[]
Token definitions for this lexer. Can be specified as an array of token definition objects or
optional
ignoreCase: boolean
Set this to true
to make the lexer patterns ignore casing.
This cannot be set on a per-token basis, so if you need mixed case
sensitivity the token patterns must handle this by themselves (note that
flags on the pattern RegExp
s are ignored).