 | CrawlerJobEngineConfiguration Properties |
[This is preliminary documentation and is subject to change.]
The CrawlerJobEngineConfiguration type exposes the following members.
Properties| Name | Description | |
|---|---|---|
 | CPULimit | On what CPU utilization level it should reduce TC_max |
| CPUMargin | CPU rate tolerance for the adjustment |
| CPUSampleForAutoAdjust | On what number of samples automatic TC_max should be based |
| CPUSampleForAutoAdjustMax | Maximal number of sample takes to consider for trend estimationx |
| CPUTarget | What is CPU utilization target ratio - for TC_max auto adjustment |
| crawlerDomainCheckTickMs |
Miliseconds between two status checks of multithreading operation status
|
| crawlerDoParallelTaskLoads |
Enables Parallel.ForEach execution of WebLoader Tasks
|
| doAutoAdjustTC | It will automatically increase TC_max parameter if CPU utilization lower then set |
| doDLCMulticoreOprimization | It will try to push CPU utilization by adjusting LT |
| domainCountDoneForGC |
Description of $property$
|
| doRandomizeSampleOrder | If true it will reorder the sample list before job run using random number generator |
| doRandomizeSampleTake | If true and in cases where sample size limit is smaller than sample source list - it will take sample entries randomly |
| doTaskTimeOutPrevention | It will try to prevent task timeout by pushing threads priorities to improve its progress |
| loadCountForGC |
Number of web loader loads to trigger Garbage Collection - memory clean up
|
| TCAutoLimit | Maximum TC for autoadjustment |
See Also