Click or drag to resize

TokenizerBaseTokenSplitterChars Property

Home | imbSCI | imbACE | imbNLP | imbWEM | imbWBI
Characters that are going to be used to split the text into tokens

Namespace:  imbNLP.Toolkit.Processing
Assembly:  imbNLP.Toolkit (in imbNLP.Toolkit.dll) Version: 0.2.30
Syntax
C#
public char[] TokenSplitterChars { get; set; }

Property Value

Type: Char
The token splitter chars.
See Also