TokenizerBasic Methods |
The TokenizerBasic type exposes the following members.
| Name | Description | |
|---|---|---|
| Equals | Determines whether the specified object is equal to the current object. (Inherited from Object.) | |
| ExecuteInputReplacers |
Executes all replacement rules from the InputReplacers collection
(Inherited from TokenizerBase.) | |
| Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) | |
| GetHashCode | Serves as the default hash function. (Inherited from Object.) | |
| GetType | Gets the Type of the current instance. (Inherited from Object.) | |
| MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) | |
| Tokenize |
Tokenizes the specified text, according to the configuration of the tokenizer
(Inherited from TokenizerBase.) | |
| ToString | Returns a string that represents the current object. (Inherited from Object.) |