dc_db.ProxyNewTask.ProxyNewTask Class Reference

Inheritance diagram for dc_db.ProxyNewTask.ProxyNewTask:

Collaboration diagram for dc_db.ProxyNewTask.ProxyNewTask:

Public Member Functions
def	__init__ (self)
def	process (self, proxies, queryCallback)
def	insertProxy (self, proxy, queryCallback)
Public Member Functions inherited from dc_db.BaseTask.BaseTask
def	isSiteExist (self, siteId, queryCallback, userId=None)
def	generateCriterionSQL (self, criterions, additionWhere=None, siteId=None)
def	fetchByCriterions (self, criterions, queryCallback)
def	dbLock (self, mutexName, queryCallback, sleepTime=1, mutexLockTTL=Constants.DEFAULT_LOCK_TTL)
def	dbUnlock (self, mutexName, queryCallback)
def	createUrlsInsertQuery (self, siteId, localKeys, localValues)
def	copyUrlsToDcUrls (self, siteId, queryCallback)
def	statisticLogUpdate (self, localObj, urlMd5, siteId, status, queryCallback, isInsert=False)
def	calculateMd5FormUrl (self, url, urlType, useNormilize=False)

Static Public Member Functions
def	lookProxyInDB (proxy, queryCallback)
Static Public Member Functions inherited from dc_db.BaseTask.BaseTask
def	readValueFromSiteProp (siteId, propName, queryCallback, urlMd5=None)

Detailed Description

Definition at line 20 of file ProxyNewTask.py.

Constructor & Destructor Documentation

__init__()

def dc_db.ProxyNewTask.ProxyNewTask.__init__

(

self

)

Definition at line 25 of file ProxyNewTask.py.

  def __init__(self):
    super(ProxyNewTask, self).__init__()

Member Function Documentation

insertProxy()

def dc_db.ProxyNewTask.ProxyNewTask.insertProxy	(		self,
			proxy,
			queryCallback
	)

Definition at line 69 of file ProxyNewTask.py.

  def insertProxy(self, proxy, queryCallback):
    ret = False
    fields, values = Constants.getFieldsValuesTuple(proxy, Constants.ProxyTableDict)
    fieldValueString = Constants.createFieldsValuesString(fields, values)
    if fieldValueString is not None and fieldValueString != "":
      query = Constants.INSERT_COMMON_TEMPLATE % ("sites_proxy", fieldValueString)
      queryCallback(query, Constants.PRIMARY_DB_ID)
      ret = True
    return ret

lookProxyInDB()

def dc_db.ProxyNewTask.ProxyNewTask.lookProxyInDB (   proxy,   queryCallback  )

static

Definition at line 35 of file ProxyNewTask.py.

  def lookProxyInDB(proxy, queryCallback):
    ret = False
    FETCH_PROXY_SQL = "SELECT * FROM `sites_proxy` WHERE `Site_Id` = '%s' AND `Host` = '%s'"
    query = FETCH_PROXY_SQL % (proxy.siteId, proxy.host)
    res = queryCallback(query, Constants.PRIMARY_DB_ID)
    if hasattr(res, '__iter__') and len(res) > 0 and res[0] is not None:
      ret = True
    return ret

process()

def dc_db.ProxyNewTask.ProxyNewTask.process	(		self,
			proxies,
			queryCallback
	)

Definition at line 50 of file ProxyNewTask.py.

  def process(self, proxies, queryCallback):
    ret = GeneralResponse()
    for proxy in proxies:
      if not ProxyNewTask.lookProxyInDB(proxy, queryCallback):
        if self.insertProxy(proxy, queryCallback):
          status = 0
        else:
          status = 1
      else:
        status = 2
      ret.statuses.append(status)
    return ret

Here is the call graph for this function:

Here is the caller graph for this function:

---

The documentation for this class was generated from the following file:

• sources/hce/dc_db/ProxyNewTask.py