 | TokenDictionary Class |
Stores raw frequencies of the tokens
Inheritance HierarchyNamespace: imbNLP.Toolkit.Processing
Assembly: imbNLP.Toolkit (in imbNLP.Toolkit.dll) Version: 0.2.30
SyntaxC#
public class TokenDictionary
The TokenDictionary type exposes the following members.
Constructors| Name | Description | |
|---|---|---|
 | TokenDictionary |
Initializes a new instance of the TokenDictionary class.
|
| TokenDictionary(IEnumerableString) |
Builds dictionary from tokens specified
|
Properties| Name | Description | |
|---|---|---|
 | Count |
Gets the count of distinct tokens in the dictionary
|
 | TokenFrequency | |
| TokenID | |
| Tokens |
Methods| Name | Description | |
|---|---|---|
| AddToken |
Registers new token, returns assigned ID
|
| Contains | |
| CountToken |
Adds oscore point/s to the token frequency. If the token wasn't registered with the dictionary, it will register it automatically.
|
| CountTokens |
Counts the tokens.
|
| Equals | Determines whether the specified object is equal to the current object. (Inherited from Object.) |
 | Finalize | Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.) |
| GetHashCode | Serves as the default hash function. (Inherited from Object.) |
| GetMaxFrequency |
Returns maximum frequency
|
| GetRankedTokenFrequency |
Gets ranked list of tokens and their absolute frequencies
|
| GetSquareRootOfSumSquareFrequencies |
Returns square root of summation of the sqares of term frequencies
|
| GetSumFrequency |
Sum of all frequencies
|
| GetSumSquareFrequencies | |
| GetTokenByID |
Gets the token by identifier.
|
| GetTokenFrequency |
Gets frequency of the token
|
| GetTokenID |
Returns ID of the token specified
|
| GetTokenIDs |
Returns list of IDs for given token list
|
| GetTokens |
Gets list of currently known tokens
|
| GetType | Gets the Type of the current instance. (Inherited from Object.) |
| MemberwiseClone | Creates a shallow copy of the current Object. (Inherited from Object.) |
| MergeDictionary |
Collects all tokens and sums their frequencies with existing data in the dictionary
|
| ToString | Returns a string that represents the current object. (Inherited from Object.) |
Extension Methods| Name | Description | |
|---|---|---|
 | MakeTable |
Makes ranked table with term frequencies
(Defined by ReportGenerators.) |
See Also