plainTextTokenizator Class

[This is preliminary documentation and is subject to change.]

2016:C PRIMARNI TOKENIZATOR Experimentalni plain text tokenizator

Inheritance Hierarchy

SystemObject
  dataBindableBase
    imbBindable
      imbNLP.Core.contentStructure.tokenizatortokenizatorBase
        imbNLP.Core.contentStructure.tokenizatorplainTextTokenizator

Namespace: imbNLP.Core.contentStructure.tokenizator
Assembly: imbNLP.Core (in imbNLP.Core.dll) Version: 0.2.24

Syntax

public class plainTextTokenizator : tokenizatorBase

The plainTextTokenizator type exposes the following members.

Constructors

	Name	Description
	plainTextTokenizator	Initializes a new instance of the plainTextTokenizator class

Properties

	Name	Description
	settings	Podesavanja tokenizatora (Inherited from tokenizatorBase.)

Methods

	Name	Description
	compressNewLines	(Inherited from tokenizatorBase.)
	Equals	Determines whether the specified object is equal to the current object. (Inherited from Object.)
	Finalize	Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.)
	GetHashCode	Serves as the default hash function. (Inherited from Object.)
	GetType	Gets the Type of the current instance. (Inherited from Object.)
	MemberwiseClone	Creates a shallow copy of the current Object. (Inherited from Object.)
	OnPropertyChanged	(Inherited from dataBindableBase.)
	setSentencesFromContentTSentence, TToken	ZASTARELO (Inherited from tokenizatorBase.)
	tokenizeContent	Vrsi tokenizaciju String/PlainText sadrzaja.
	ToString	Returns a string that represents the current object. (Inherited from Object.)

Events

	Name	Description
	PropertyChanged	(Inherited from dataBindableBase.)