3.1.1.4.1. Tokenisable Languages

The following languages can be tokenised easily: C, C++, Python, Java, Eiffel, Pascal, Modula. [Only the Python tokeniser has been written].


3.1.1.4.1.1. Identifier reference