Package rekit.persistence.level.parser

Class Tokenizer

java.lang.Object

rekit.persistence.level.parser.Tokenizer

public class Tokenizer
extends Object

This class realizes a tokenizer for the LevelLanguage.

Author:

Dominik Fuchss

See Also:

• TokenType

Constructor Summary

Constructors

Constructor	Description
Tokenizer(String input)	Instantiate a new Tokenizer by input string.

Method Summary

Modifier and Type	Method	Description
Token	nextToken()	Get the next token.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Tokenizer

public Tokenizer(String input)

Instantiate a new Tokenizer by input string.

Parameters:

input - the input string

Method Details

nextToken

public Token nextToken()

Get the next token.

Returns:

the token