CrawlerJobEngineConfiguration Class

[This is preliminary documentation and is subject to change.]

Variables controling crawl job execution process, multi-threading, and monitoring features of the Crawl Job Engine

Inheritance Hierarchy

SystemObject
  dataBindableBase
    imbBindable
      imbWEM.Core.settingsCrawlerJobEngineConfiguration

Namespace: imbWEM.Core.settings
Assembly: imbWEM.Core (in imbWEM.Core.dll) Version: 0.3.55

Syntax

public class CrawlerJobEngineConfiguration : imbBindable

The CrawlerJobEngineConfiguration type exposes the following members.

Constructors

	Name	Description
	CrawlerJobEngineConfiguration	Initializes a new instance of the CrawlerJobEngineConfiguration class

Properties

	Name	Description
	CPULimit	On what CPU utilization level it should reduce TC_max
	CPUMargin	CPU rate tolerance for the adjustment
	CPUSampleForAutoAdjust	On what number of samples automatic TC_max should be based
	CPUSampleForAutoAdjustMax	Maximal number of sample takes to consider for trend estimationx
	CPUTarget	What is CPU utilization target ratio - for TC_max auto adjustment
	crawlerDomainCheckTickMs	Miliseconds between two status checks of multithreading operation status
	crawlerDoParallelTaskLoads	Enables Parallel.ForEach execution of WebLoader Tasks
	doAutoAdjustTC	It will automatically increase TC_max parameter if CPU utilization lower then set
	doDLCMulticoreOprimization	It will try to push CPU utilization by adjusting LT
	domainCountDoneForGC	Description of $property$
	doRandomizeSampleOrder	If true it will reorder the sample list before job run using random number generator
	doRandomizeSampleTake	If true and in cases where sample size limit is smaller than sample source list - it will take sample entries randomly
	doTaskTimeOutPrevention	It will try to prevent task timeout by pushing threads priorities to improve its progress
	loadCountForGC	Number of web loader loads to trigger Garbage Collection - memory clean up
	TCAutoLimit	Maximum TC for autoadjustment

Methods

	Name	Description
	Equals	Determines whether the specified object is equal to the current object. (Inherited from Object.)
	Finalize	Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection. (Inherited from Object.)
	GetHashCode	Serves as the default hash function. (Inherited from Object.)
	GetType	Gets the Type of the current instance. (Inherited from Object.)
	MemberwiseClone	Creates a shallow copy of the current Object. (Inherited from Object.)
	OnPropertyChanged	(Inherited from dataBindableBase.)
	prepare
	ToString	Returns a string that represents the current object. (Inherited from Object.)

Events

	Name	Description
	PropertyChanged	(Inherited from dataBindableBase.)