HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.  2.0.0-chaika
Hierarchical Cluster Engine Python language binding
dc_crawler.Fetcher.ContentFetcher Member List

This is the complete list of members for dc_crawler.Fetcher.ContentFetcher, including all inherited members.

__init__(self)dc_crawler.Fetcher.BaseFetcher
CONNECTION_TIMEOUTdc_crawler.Fetcher.BaseFetcherstatic
connectionTimeoutdc_crawler.Fetcher.BaseFetcher
fetchersdc_crawler.Fetcher.BaseFetcherstatic
get_fetcher(typ, dbWrapper=None, siteId=None)dc_crawler.Fetcher.BaseFetcherstatic
getDomainNameFromURL(self, url, default='')dc_crawler.Fetcher.BaseFetcher
init(dbWrapper=None, siteId=None)dc_crawler.Fetcher.BaseFetcherstatic
loggerdc_crawler.Fetcher.BaseFetcher
open(self, url, kwargs)dc_crawler.Fetcher.ContentFetcher
dc_crawler::Fetcher::BaseFetcher.open(self, url, method='get', headers=None, timeout=100, allow_redirects=True, proxies=None, auth=None, data=None, log=None, allowed_content_types=None, max_resource_size=None, max_redirects=CONSTS.MAX_HTTP_REDIRECTS_LIMIT, filters=None, executable_path=None, depth=None, macro=None)dc_crawler.Fetcher.BaseFetcher
should_have_meta_res(self)dc_crawler.Fetcher.BaseFetcher
TYP_AUTOdc_crawler.Fetcher.BaseFetcherstatic
TYP_CONTENTdc_crawler.Fetcher.BaseFetcherstatic
TYP_DYNAMICdc_crawler.Fetcher.BaseFetcherstatic
TYP_NORMALdc_crawler.Fetcher.BaseFetcherstatic
TYP_URLLIBdc_crawler.Fetcher.BaseFetcherstatic