Click or drag to resize

TokenizerBaseTokenize Method

Home | imbSCI | imbACE | imbNLP | imbWEM | imbWBI
Tokenizes the specified text, according to the configuration of the tokenizer

Namespace:  imbNLP.Toolkit.Processing
Assembly:  imbNLP.Toolkit (in imbNLP.Toolkit.dll) Version: 0.2.30
Syntax
C#
Copy
public virtual string[] Tokenize(
	string text
)

Parameters

text
Type: SystemString
The text.

Return Value

Type: String

[Missing <returns> documentation for "M:imbNLP.Toolkit.Processing.TokenizerBase.Tokenize(System.String)"]

Implements

ITokenizerTokenize(String)
See Also