tokenDetection_select_tokenWithSplitter Field

[This is preliminary documentation and is subject to change.]

Regex select tokenWithSplitter : ([\w\d\.,:;\"-|]{1,})\b[\W]{0,3}

Namespace: imbNLP.Core.contentPreprocess
Assembly: imbNLP.Core (in imbNLP.Core.dll) Version: 0.2.24

Syntax

public static Regex _select_tokenWithSplitter

Type: Regex

Remarks

For text: example text

Selects: ex

tokenDetectionAddLanguageSpecificTextSet("LST916882E6_0?cpp=::|nu=.");_select_tokenWithSplitter Field