generateTokens

fun generateTokens(): Array<Token>

Generate an Array of Token from the given input

Return

an array of tokens

Throws

at the first unrecognised string