BNFC.Lex

Create a token with position.

Token without position.

Smart constructor for Tok for the sake of backwards compatibility.

Keyword or symbol tokens have a unique ID.

Token with position.

Pretty print a position.

Pretty print the position of the first token in the list.

Get the position of a token.

Get line and column of a token.

Get line and column of a position.

Convert a token into "position token" form.

Convert a token to its text.

Convert a token to a string.

Finite map from text to token organized as binary search tree.

Convert potential keyword into token or use fallback conversion.

The keywords and symbols of the language organized as binary search tree.

Unquote string literal.

Encode a Haskell String to a list of Word8 values, in UTF8 format.