TFIDFConfiguration Class

[This is preliminary documentation and is subject to change.]

[Missing <summary> documentation for "T:imbWEM.Core.settings.TFIDFConfiguration"]

Inheritance Hierarchy

SystemObject
imbWEM.Core.settingsTFIDFConfiguration

Namespace: imbWEM.Core.settings
Assembly: imbWEM.Core (in imbWEM.Core.dll) Version: 0.1.0.0 (0.1.0.0)

Syntax

public class TFIDFConfiguration

The TFIDFConfiguration type exposes the following members.

Constructors

	Name	Description
	TFIDFConfiguration	Initializes a new instance of the TFIDFConfiguration class

Properties

	Name	Description
	doAutoConstructMasterTFfromStandardCC	Auto builds the master TF_IDF from exploited standard CC
	doExploitStandardCC	If true it will use [!:spider.targets.spiderDLContext.targets] TF-IDF as source
	doPerformLexicContraction	If true it will perform lexic contraction (packing all TermInstance into TermLemmas) for master TF build
	doSaveCacheOfDLCTables	If true it will save newly created TF-IDF tables to the cache
	doSaveDomainWordList	If true it will save wordlist for each domain
	doSaveMasterTFIDFonEndOfCrawl	If true it will save active master TF-IDF
	doSavePageWordlist	If true it will save wordlist for each processed page into index cache
	doSchedulePagesWithDLCTable	If true it will schedule also pages of domains that already have the DLC TF-IDF table in the cache. (for indexCrawler loading)
	doUseCachedDLCTables	If true it will use existing TF-IDF cached table
	doUseHeuristicDLCTFIDFConstruction	If true it will use alternative DLC TF-IDF construction that performes semantic contraction over total set of words and not on page TF-IDF way
	doUseOnlyRelevantPages	If true it will use only pages that are evaluated as relevant
	doUseOnlySingleMatch	If true it will use only single-dictionary matched words for MasterTF construction
	doUseSavedPageWordlists	If true it will use saved wordlists from each page if its found, and prevent indexCrawler load of that page
	doUseSeparateTFIDFperDLC_iterationEvaluation	If true it will create local copy of the master TF-IDF table for each DLC record

Methods