HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.  2.0.0-chaika
Hierarchical Cluster Engine Python language binding
dc_db.ProxyUpdateTask.ProxyUpdateTask Class Reference
Inheritance diagram for dc_db.ProxyUpdateTask.ProxyUpdateTask:
Collaboration diagram for dc_db.ProxyUpdateTask.ProxyUpdateTask:

Public Member Functions

def __init__ (self)
 
def process (self, proxyUpdates, queryCallback)
 
def updateProxy (self, proxyUpdate, queryCallback)
 
- Public Member Functions inherited from dc_db.BaseTask.BaseTask
def isSiteExist (self, siteId, queryCallback, userId=None)
 
def generateCriterionSQL (self, criterions, additionWhere=None, siteId=None)
 
def fetchByCriterions (self, criterions, queryCallback)
 
def dbLock (self, mutexName, queryCallback, sleepTime=1, mutexLockTTL=Constants.DEFAULT_LOCK_TTL)
 
def dbUnlock (self, mutexName, queryCallback)
 
def createUrlsInsertQuery (self, siteId, localKeys, localValues)
 
def copyUrlsToDcUrls (self, siteId, queryCallback)
 
def statisticLogUpdate (self, localObj, urlMd5, siteId, status, queryCallback, isInsert=False)
 
def calculateMd5FormUrl (self, url, urlType, useNormilize=False)
 

Additional Inherited Members

- Static Public Member Functions inherited from dc_db.BaseTask.BaseTask
def readValueFromSiteProp (siteId, propName, queryCallback, urlMd5=None)
 

Detailed Description

Definition at line 21 of file ProxyUpdateTask.py.

Constructor & Destructor Documentation

◆ __init__()

def dc_db.ProxyUpdateTask.ProxyUpdateTask.__init__ (   self)

Definition at line 26 of file ProxyUpdateTask.py.

26  def __init__(self):
27  super(ProxyUpdateTask, self).__init__()
28 
29 
def __init__(self)
constructor
Definition: UIDGenerator.py:19

Member Function Documentation

◆ process()

def dc_db.ProxyUpdateTask.ProxyUpdateTask.process (   self,
  proxyUpdates,
  queryCallback 
)

Definition at line 35 of file ProxyUpdateTask.py.

35  def process(self, proxyUpdates, queryCallback):
36  generalResponse = GeneralResponse()
37  for proxyUpdate in proxyUpdates:
38  status = False
39 # if ProxyNewTask.lookProxyInDB(proxyUpdate, queryCallback):
40  if self.updateProxy(proxyUpdate, queryCallback):
41  status = True
42  generalResponse.statuses.append(status)
43  return generalResponse
44 
45 
Here is the call graph for this function:
Here is the caller graph for this function:

◆ updateProxy()

def dc_db.ProxyUpdateTask.ProxyUpdateTask.updateProxy (   self,
  proxyUpdate,
  queryCallback 
)

Definition at line 51 of file ProxyUpdateTask.py.

51  def updateProxy(self, proxyUpdate, queryCallback):
52  ret = False
53 
54  fields, values = Constants.getFieldsValuesTuple(proxyUpdate, Constants.ProxyTableDict)
55  fieldValueString = Constants.createFieldsValuesString(fields, values, Constants.proxyExcludeList)
56  if fieldValueString is not None and fieldValueString != "":
57  PROXY_UPDATE_TEMPLATE = "UPDATE `sites_proxy` SET %s WHERE `Site_Id` = '%s' AND `Host` = '%s'"
58  query = PROXY_UPDATE_TEMPLATE % (fieldValueString, proxyUpdate.siteId, proxyUpdate.host)
59 
60  print query
61  queryCallback(query, Constants.PRIMARY_DB_ID)
62  ret = True
63  return ret
64 
Here is the caller graph for this function:

The documentation for this class was generated from the following file: