Lexer

class Lexer(input: String)

Generates a list of tokens from the given input. This is usually the first step when parsing code.

Parameters

input

the string input to be tokenised

fun Lexer(input: String)

Generate an Array of Token from the given input