HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.  2.0.0-chaika
Hierarchical Cluster Engine Python language binding
dc_db.ProxyFindTask.ProxyFindTask Class Reference
Inheritance diagram for dc_db.ProxyFindTask.ProxyFindTask:
Collaboration diagram for dc_db.ProxyFindTask.ProxyFindTask:

Public Member Functions

def __init__ (self)
 
def process (self, proxyFinds, queryCallback)
 
def fetchProxy (self, proxyFind, queryCallback, localSiteId)
 
- Public Member Functions inherited from dc_db.BaseTask.BaseTask
def isSiteExist (self, siteId, queryCallback, userId=None)
 
def generateCriterionSQL (self, criterions, additionWhere=None, siteId=None)
 
def fetchByCriterions (self, criterions, queryCallback)
 
def dbLock (self, mutexName, queryCallback, sleepTime=1, mutexLockTTL=Constants.DEFAULT_LOCK_TTL)
 
def dbUnlock (self, mutexName, queryCallback)
 
def createUrlsInsertQuery (self, siteId, localKeys, localValues)
 
def copyUrlsToDcUrls (self, siteId, queryCallback)
 
def statisticLogUpdate (self, localObj, urlMd5, siteId, status, queryCallback, isInsert=False)
 
def calculateMd5FormUrl (self, url, urlType, useNormilize=False)
 

Additional Inherited Members

- Static Public Member Functions inherited from dc_db.BaseTask.BaseTask
def readValueFromSiteProp (siteId, propName, queryCallback, urlMd5=None)
 

Detailed Description

Definition at line 21 of file ProxyFindTask.py.

Constructor & Destructor Documentation

◆ __init__()

def dc_db.ProxyFindTask.ProxyFindTask.__init__ (   self)

Definition at line 26 of file ProxyFindTask.py.

26  def __init__(self):
27  super(ProxyFindTask, self).__init__()
28 
29 
def __init__(self)
constructor
Definition: UIDGenerator.py:19

Member Function Documentation

◆ fetchProxy()

def dc_db.ProxyFindTask.ProxyFindTask.fetchProxy (   self,
  proxyFind,
  queryCallback,
  localSiteId 
)

Definition at line 57 of file ProxyFindTask.py.

57  def fetchProxy(self, proxyFind, queryCallback, localSiteId):
58  ret = []
59  if localSiteId is None:
60  additionWhere = None
61  else:
62  additionWhere = "`Site_Id` = '%s'" % localSiteId
63  result = ProxyStatusTask.execCriterion(proxyFind, queryCallback, localSiteId, additionWhere)
64  if hasattr(result, '__iter__'):
65  for elem in result:
66  localProxy = dc.EventObjects.Proxy(elem["Site_Id"], elem["Host"])
67  localProxy.id = elem["Id"]
68  localProxy.domains = elem["Domains"]
69  localProxy.priority = elem["Priority"]
70  localProxy.state = elem["State"]
71  localProxy.countryCode = elem["CountryCode"]
72  localProxy.countryName = elem["CountryName"]
73  localProxy.regionCode = elem["RegionCode"]
74  localProxy.regionName = elem["RegionName"]
75  localProxy.cityName = elem["CityName"]
76  localProxy.zipCode = elem["ZipCode"]
77  localProxy.timeZone = elem["TimeZone"]
78  localProxy.latitude = elem["Latitude"]
79  localProxy.longitude = elem["Longitude"]
80  localProxy.metroCode = elem["MetroCode"]
81  localProxy.faults = elem["Faults"]
82  localProxy.faultsMax = elem["FaultsMax"]
83  localProxy.categoryId = elem["Category_Id"]
84  localProxy.limits = elem["Limits"]
85  localProxy.description = elem["Description"]
86  localProxy.cDate = elem["CDate"]
87  localProxy.uDate = elem["UDate"]
88  ret.append(localProxy)
89  return ret
Here is the caller graph for this function:

◆ process()

def dc_db.ProxyFindTask.ProxyFindTask.process (   self,
  proxyFinds,
  queryCallback 
)

Definition at line 35 of file ProxyFindTask.py.

35  def process(self, proxyFinds, queryCallback):
36  ret = []
37  for proxyFind in proxyFinds:
38  localSiteIds = []
39  if proxyFind.siteId is None:
40  if proxyFind.siteCriterions is not None and len(proxyFind.siteCriterions) > 0:
41  localSiteIds = SiteTask.execSiteCriterions(proxyFind.siteCriterions, queryCallback)
42  else:
43  localSiteIds.append(None)
44  else:
45  localSiteIds.append(proxyFind.siteId)
46  for localSiteId in localSiteIds:
47  ret += self.fetchProxy(proxyFind, queryCallback, localSiteId)
48  return ret
49 
50 
Here is the call graph for this function:
Here is the caller graph for this function:

The documentation for this class was generated from the following file: