HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.  2.0.0-chaika
Hierarchical Cluster Engine Python language binding
dc_crawler.HTTPProxyResolver.HTTPProxyResolver Member List

This is the complete list of members for dc_crawler.HTTPProxyResolver.HTTPProxyResolver, including all inherited members.

__getDefaultProxyName(siteProperties)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__getProxyListAllowedDomains(proxyList, url)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__getProxyListAllowedLimits(proxyList)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__getUserProxyJsonWrapper(siteProperties)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__init__(self)dc_crawler.HTTPProxyResolver.HTTPProxyResolver
__makFileName(filePath, siteId)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__readJsonFile(fileName)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__saveJsonFile(fileName, jsonData)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__usageAlgorithm(proxyList, algorithmType=DEFAULT_USAGE_ALGORITM)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
__usageAlgorithmFrequency(proxyList)dc_crawler.HTTPProxyResolver.HTTPProxyResolverprivatestatic
addFaults(siteProperties, siteId, proxyName, dbProxyWrapper=None, incrementSize=DEFAULT_VALUE_INCREMENT_FAULTS)dc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
checkTriesCount(siteProperties, currentTriesCount)dc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
DEFAULT_USAGE_ALGORITMdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
DEFAULT_VALUE_INCREMENT_FAULTSdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
ERROR_MSG_CHECK_ALLOWED_DOMAINSdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
ERROR_MSG_CHECK_ALLOWED_LIMITSdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
ERROR_MSG_EMPTY_PROXIES_LISTdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
ERROR_MSG_LOAD_SITE_PTOPERTIESdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
ERROR_MSG_NOT_EXIST_ANY_VALID_PROXYdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
ERROR_MSG_NOT_SUPPORT_ALGORITHMdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
ERROR_MSG_TRIES_LIMIT_EXCEEDEDdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
getProxy(siteProperties, siteId, url, dbProxyWrapper=None)dc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
getTriesCount(siteProperties)dc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
HTTP_PROXY_HOST_NAMEdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
HTTP_PROXY_PORT_NAMEdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
INDEX_FILE_EXTENTIONdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
isNeedRotateProxy(siteProperties, siteId, proxyName, dbProxyWrapper, rawContent)dc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
USAGE_ALGORITM_FREQUENCYdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic
USER_PROXY_PROPERTY_NAMEdc_crawler.HTTPProxyResolver.HTTPProxyResolverstatic