HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.  2.0.0-chaika
Hierarchical Cluster Engine Python language binding
dc_crawler.Fetcher.RequestsFetcher Member List

This is the complete list of members for dc_crawler.Fetcher.RequestsFetcher, including all inherited members.

__init__(self, dbWrapper=None, siteId=None)dc_crawler.Fetcher.RequestsFetcher
dc_crawler::Fetcher::BaseFetcher.__init__(self)dc_crawler.Fetcher.BaseFetcher
CONNECTION_TIMEOUTdc_crawler.Fetcher.BaseFetcherstatic
connectionTimeoutdc_crawler.Fetcher.BaseFetcher
dbWrapperdc_crawler.Fetcher.RequestsFetcher
fetchersdc_crawler.Fetcher.BaseFetcherstatic
fixWrongXMLHeader(self, contentStr)dc_crawler.Fetcher.RequestsFetcher
get_fetcher(typ, dbWrapper=None, siteId=None)dc_crawler.Fetcher.BaseFetcherstatic
getDomainNameFromURL(self, url, default='')dc_crawler.Fetcher.BaseFetcher
init(dbWrapper=None, siteId=None)dc_crawler.Fetcher.BaseFetcherstatic
loggerdc_crawler.Fetcher.BaseFetcher
open(self, url, method='get', headers=None, timeout=100, allow_redirects=True, proxies=None, auth=None, data=None, log=None, allowed_content_types=None, max_resource_size=None, max_redirects=CONSTS.MAX_HTTP_REDIRECTS_LIMIT, filters=None, executable_path=None, depth=None, macro=None)dc_crawler.Fetcher.RequestsFetcher
should_have_meta_res(self)dc_crawler.Fetcher.BaseFetcher
siteIddc_crawler.Fetcher.RequestsFetcher
TYP_AUTOdc_crawler.Fetcher.BaseFetcherstatic
TYP_CONTENTdc_crawler.Fetcher.BaseFetcherstatic
TYP_DYNAMICdc_crawler.Fetcher.BaseFetcherstatic
TYP_NORMALdc_crawler.Fetcher.BaseFetcherstatic
TYP_URLLIBdc_crawler.Fetcher.BaseFetcherstatic