dc_db.URLVerifyTask.URLVerifyTask Class Reference

Inheritance diagram for dc_db.URLVerifyTask.URLVerifyTask:

Collaboration diagram for dc_db.URLVerifyTask.URLVerifyTask:

Public Member Functions
def	process (self, urlVerifies, queryCallback, bdResolveFunc)
def	fetchUrl (self, urlVerify, queryCallback, bdResolveFunc)
Public Member Functions inherited from dc_db.BaseTask.BaseTask
def	isSiteExist (self, siteId, queryCallback, userId=None)
def	generateCriterionSQL (self, criterions, additionWhere=None, siteId=None)
def	fetchByCriterions (self, criterions, queryCallback)
def	dbLock (self, mutexName, queryCallback, sleepTime=1, mutexLockTTL=Constants.DEFAULT_LOCK_TTL)
def	dbUnlock (self, mutexName, queryCallback)
def	createUrlsInsertQuery (self, siteId, localKeys, localValues)
def	copyUrlsToDcUrls (self, siteId, queryCallback)
def	statisticLogUpdate (self, localObj, urlMd5, siteId, status, queryCallback, isInsert=False)
def	calculateMd5FormUrl (self, url, urlType, useNormilize=False)

Additional Inherited Members
Static Public Member Functions inherited from dc_db.BaseTask.BaseTask
def	readValueFromSiteProp (siteId, propName, queryCallback, urlMd5=None)

Detailed Description

Definition at line 20 of file URLVerifyTask.py.

Member Function Documentation

fetchUrl()

def dc_db.URLVerifyTask.URLVerifyTask.fetchUrl	(		self,
			urlVerify,
			queryCallback,
			bdResolveFunc
	)

Definition at line 42 of file URLVerifyTask.py.

  def fetchUrl(self, urlVerify, queryCallback, bdResolveFunc):
    url = None
    if urlVerify.dbName is not None:
      dbIndex = bdResolveFunc(urlVerify.dbName)
      if dbIndex is not None:
        tableName = Constants.DC_URLS_TABLE_NAME_TEMPLATE % urlVerify.siteId
        query = Constants.SELECT_SQL_TEMPLATE_SIMPLE % ("*", tableName)
        if urlVerify.urlType == dc.EventObjects.URLStatus.URL_TYPE_URL:
          localUrlMd5 = hashlib.md5(urlVerify.url).hexdigest()
        else:
          localUrlMd5 = urlVerify.url
        additionWere = ("`UrlMd5`= '%s'" % localUrlMd5)
        if urlVerify.criterions is not None:
          additionQueryStr = self.generateCriterionSQL(urlVerify.criterions, additionWere)
        else:
          additionQueryStr = self.generateCriterionSQL({}, additionWere)
        if additionQueryStr is not None and len(additionQueryStr) > 0:
          query += " "
          query += additionQueryStr
        res = queryCallback(query, dbIndex, Constants.EXEC_NAME)
        if res is not None and len(res) > 0:
          url = URLFetchTask.fillUrlObj(res[0])
      else:
        logger.error("Error: there isn't %s database connection", str(url.dbName))
    return url

process()

def dc_db.URLVerifyTask.URLVerifyTask.process	(		self,
			urlVerifies,
			queryCallback,
			bdResolveFunc
	)

Definition at line 29 of file URLVerifyTask.py.

  def process(self, urlVerifies, queryCallback, bdResolveFunc):
    urls = []
    for urlVerify in urlVerifies:
      urls.append(self.fetchUrl(urlVerify, queryCallback, bdResolveFunc))
    return urls

Here is the call graph for this function:

Here is the caller graph for this function:

---

The documentation for this class was generated from the following file:

• sources/hce/dc_db/URLVerifyTask.py