Click or drag to resize

imbStringWordWrapgetTokens Method (IEnumerableString, Boolean, Boolean, Boolean, Boolean, Int32)

imbSCI | imbACE | imbNLP | imbWEM | imbWBI
Simple String tokenization - extracts words without spaces and punctation

Namespace:  imbSCI.Core.extensions.text
Assembly:  imbSCI.Core (in imbSCI.Core.dll) Version: 0.3.58.
Syntax
C#
Copy
public static List<string> getTokens(
	this IEnumerable<string> contentSets,
	bool filterout_numbers = false,
	bool filterout_shortwords = false,
	bool filterin_cleanWords = false,
	bool filter_filewords = false,
	int shortWords = 4
)
Request Example View Source

Parameters

contentSets
Type: System.Collections.GenericIEnumerableString
filterout_numbers (Optional)
Type: SystemBoolean
filterout_shortwords (Optional)
Type: SystemBoolean
filterin_cleanWords (Optional)
Type: SystemBoolean
filter_filewords (Optional)
Type: SystemBoolean
shortWords (Optional)
Type: SystemInt32

Return Value

Type: ListString

Usage Note

In Visual Basic and C#, you can call this method as an instance method on any object of type IEnumerableString. When you use instance method syntax to call this method, omit the first parameter. For more information, see Extension Methods (Visual Basic) or Extension Methods (C# Programming Guide).
See Also