dc_db.AttrFetchTask.AttrFetchTask Class Reference

Inheritance diagram for dc_db.AttrFetchTask.AttrFetchTask:

Collaboration diagram for dc_db.AttrFetchTask.AttrFetchTask:

Public Member Functions
def	__init__ (self)
def	process (self, attrFetches, queryCallback)
Public Member Functions inherited from dc_db.BaseTask.BaseTask
def	isSiteExist (self, siteId, queryCallback, userId=None)
def	generateCriterionSQL (self, criterions, additionWhere=None, siteId=None)
def	fetchByCriterions (self, criterions, queryCallback)
def	dbLock (self, mutexName, queryCallback, sleepTime=1, mutexLockTTL=Constants.DEFAULT_LOCK_TTL)
def	dbUnlock (self, mutexName, queryCallback)
def	createUrlsInsertQuery (self, siteId, localKeys, localValues)
def	copyUrlsToDcUrls (self, siteId, queryCallback)
def	statisticLogUpdate (self, localObj, urlMd5, siteId, status, queryCallback, isInsert=False)
def	calculateMd5FormUrl (self, url, urlType, useNormilize=False)

Static Public Member Functions
def	fetchUrlsAttributes (siteId, urlMd5, queryCallback)
def	fetchUrlsAttributesByNames (siteId, urlMd5, queryCallback, attributeNames)
Static Public Member Functions inherited from dc_db.BaseTask.BaseTask
def	readValueFromSiteProp (siteId, propName, queryCallback, urlMd5=None)

Static Public Attributes
string	ATTR_FETCH_TEMPLATE = "SELECT * FROM `%s` "

Detailed Description

Definition at line 20 of file AttrFetchTask.py.

Constructor & Destructor Documentation

__init__()

def dc_db.AttrFetchTask.AttrFetchTask.__init__

(

self

)

Definition at line 26 of file AttrFetchTask.py.

  def __init__(self):
    super(AttrFetchTask, self).__init__()

Member Function Documentation

fetchUrlsAttributes()

def dc_db.AttrFetchTask.AttrFetchTask.fetchUrlsAttributes (   siteId,   urlMd5,   queryCallback  )

static

Definition at line 69 of file AttrFetchTask.py.

  def fetchUrlsAttributes(siteId, urlMd5, queryCallback):
    attrFetchTask = AttrFetchTask()
    attrFetches = [dc.EventObjects.AttributeFetch(siteId, None, {"WHERE": ("`URLMd5` = '%s'" % urlMd5)})]
    return attrFetchTask.process(attrFetches, queryCallback)

fetchUrlsAttributesByNames()

def dc_db.AttrFetchTask.AttrFetchTask.fetchUrlsAttributesByNames (   siteId,   urlMd5,   queryCallback,   attributeNames  )

static

Definition at line 83 of file AttrFetchTask.py.

  def fetchUrlsAttributesByNames(siteId, urlMd5, queryCallback, attributeNames):
    # variable for result
    ret = []
    # get full attributes list
    attributes = AttrFetchTask.fetchUrlsAttributes(siteId, urlMd5, queryCallback)
    if isinstance(attributeNames, list):
      # default behavior (return all attributes)
      if '*' in attributeNames:
        ret = attributes
      # search name form list
      else:
        localAttributes = []
        for attribute in attributes:
          if attribute.name in attributeNames:
            localAttributes.append(attribute)
        # save attributes list
        ret = localAttributes

    return ret

process()

def dc_db.AttrFetchTask.AttrFetchTask.process	(		self,
			attrFetches,
			queryCallback
	)

Definition at line 35 of file AttrFetchTask.py.

  def process(self, attrFetches, queryCallback):
    ret = []
    for attrFetch in attrFetches:
      if self.isSiteExist(attrFetch.siteId, queryCallback):
        try:
          additionWhere = None
          if attrFetch.name is None:
            additionWhere = self.generateCriterionSQL(attrFetch.criterions)
          else:
            additionWhere = ("WHERE `Name` = '%s'" % attrFetch.name)
          logger.debug(">>> additionWhere = " + str(additionWhere))
          if additionWhere is not None and len(additionWhere) > 0:
            query = AttrFetchTask.ATTR_FETCH_TEMPLATE % (Constants.DC_ATT_TABLE_NAME_TEMPLATE % attrFetch.siteId)
            res = queryCallback(query + additionWhere, Constants.ATT_DB_ID, Constants.EXEC_NAME)
            if res is not None and len(res) > 0:
              for elem in res:
                attribute = dc.EventObjects.Attribute(attrFetch.siteId, elem["Name"])
                attribute.urlMd5 = elem["URLMd5"]
                attribute.value = elem["Value"]
                attribute.cDate = elem["CDate"]
                ret.append(attribute)
        except Exception as excp:
          logger.debug(">>> [AttributeFetch] Some Exception = " + str(type(excp)) + " " + str(excp))

    return ret

Here is the call graph for this function:

Here is the caller graph for this function:

Member Data Documentation

ATTR_FETCH_TEMPLATE

string dc_db.AttrFetchTask.AttrFetchTask.ATTR_FETCH_TEMPLATE = "SELECT * FROM `%s` "

static

Definition at line 22 of file AttrFetchTask.py.

---

The documentation for this class was generated from the following file:

• sources/hce/dc_db/AttrFetchTask.py