class documentation

class Tokenizer: (source)

Constructor: Tokenizer(string)

View In Hierarchy

Undocumented

Method __init__ Undocumented
Method error Undocumented
Method get Undocumented
Method getuntil Undocumented
Method getwhile Undocumented
Method match Undocumented
Method seek Undocumented
Method tell Undocumented
Instance Variable decoded_string Undocumented
Instance Variable index Undocumented
Instance Variable istext Undocumented
Instance Variable next Undocumented
Instance Variable string Undocumented
Property pos Undocumented
Method __next Undocumented
def __init__(self, string): (source)

Undocumented

def error(self, msg, offset=0): (source)

Undocumented

def get(self): (source)

Undocumented

def getuntil(self, terminator): (source)

Undocumented

def getwhile(self, n, charset): (source)

Undocumented

def match(self, char): (source)

Undocumented

def seek(self, index): (source)

Undocumented

def tell(self): (source)

Undocumented

decoded_string = (source)

Undocumented

Undocumented

Undocumented

Undocumented

Undocumented

Undocumented

def __next(self): (source)

Undocumented