app.UrlNormalize.UrlNormalize Class Reference

Inheritance diagram for app.UrlNormalize.UrlNormalize:

Collaboration diagram for app.UrlNormalize.UrlNormalize:

Public Member Functions
def	__init__ (self)

Static Public Member Functions
def	getNormalizeMask (siteProperties, defaultValue=Utils.UrlNormalizator.NORM_DEFAULT)
	get normalize mask More...
def	execute (siteProperties, base, url, supportProtocols=None, log=None)

Static Public Attributes
string	PROPERTY_OPTIONS_MASK = 'mask'
string	PROPERTY_OPTIONS_REPLACE = 'replace'
string	ERROR_MSG_FAILED_REPLACE = "Operation replace failed. Error: %s"

Detailed Description

Definition at line 21 of file UrlNormalize.py.

Constructor & Destructor Documentation

__init__()

def app.UrlNormalize.UrlNormalize.__init__

(

self

)

Definition at line 31 of file UrlNormalize.py.

  def __init__(self):
    pass

Member Function Documentation

execute()

def app.UrlNormalize.UrlNormalize.execute (   siteProperties,   base,   url,   supportProtocols = None,   log = None  )

static

Definition at line 61 of file UrlNormalize.py.

  def execute(siteProperties, base, url, supportProtocols=None, log=None):

    # check site property for exist replace rule
    if siteProperties is not None and isinstance(siteProperties, dict) and APP_CONSTS.URL_NORMALIZE in siteProperties:
      if log is not None:
        log.info("!!! siteProperties['%s']: '%s', type: %s", str(APP_CONSTS.URL_NORMALIZE), str(siteProperties[APP_CONSTS.URL_NORMALIZE]), 
                 str(type(siteProperties[APP_CONSTS.URL_NORMALIZE])))
      
      replaceList = []
      propertyDict = {}
      if isinstance(siteProperties[APP_CONSTS.URL_NORMALIZE], basestring):
        propertyDict = Utils.jsonLoadsSafe(jsonString=siteProperties[APP_CONSTS.URL_NORMALIZE], default=propertyDict, log=log)
      
      if isinstance(propertyDict, dict) and UrlNormalize.PROPERTY_OPTIONS_REPLACE in propertyDict:
        replaceList = propertyDict[UrlNormalize.PROPERTY_OPTIONS_REPLACE]

      if log is not None:
        log.debug("!!! replaceList: %s", str(replaceList))

      if isinstance(replaceList, list):
        for replaceElem in replaceList:
          if isinstance(replaceElem, dict):
            for pattern, repl in replaceElem.items():
              try:
                if log is not None:
                  log.debug("!!! pattern: %s, url: %s", str(pattern), str(url))
                url = re.sub(pattern=pattern, repl=repl, string=url, flags=re.U + re.I)
                if log is not None:
                  log.debug("!!! res url: %s", str(url))
              except Exception, err:
                if log is not None:
                  log.error(UrlNormalize.ERROR_MSG_FAILED_REPLACE, str(err))
    
    return Utils.urlNormalization(base=base, url=url, supportProtocols=supportProtocols, log=log)

getNormalizeMask()

def app.UrlNormalize.UrlNormalize.getNormalizeMask (   siteProperties,   defaultValue = Utils.UrlNormalizator.NORM_DEFAULT  )

static

get normalize mask

Parameters

siteProperties	- site properties
defaultValue	- default value

Returns

normalize mask

Definition at line 41 of file UrlNormalize.py.

  def getNormalizeMask(siteProperties, defaultValue=Utils.UrlNormalizator.NORM_DEFAULT):
    # variable for result
    ret = defaultValue
    
    if siteProperties is not None and isinstance(siteProperties, dict) and APP_CONSTS.URL_NORMALIZE in siteProperties and \
      isinstance(siteProperties[APP_CONSTS.URL_NORMALIZE], dict) and UrlNormalize.PROPERTY_OPTIONS_MASK in siteProperties[APP_CONSTS.URL_NORMALIZE]:
      ret = int(siteProperties[APP_CONSTS.URL_NORMALIZE][UrlNormalize.PROPERTY_OPTIONS_MASK])
    
    return ret
    

Member Data Documentation

ERROR_MSG_FAILED_REPLACE

string app.UrlNormalize.UrlNormalize.ERROR_MSG_FAILED_REPLACE = "Operation replace failed. Error: %s"

static

Definition at line 28 of file UrlNormalize.py.

PROPERTY_OPTIONS_MASK

string app.UrlNormalize.UrlNormalize.PROPERTY_OPTIONS_MASK = 'mask'

static

Definition at line 24 of file UrlNormalize.py.

PROPERTY_OPTIONS_REPLACE

string app.UrlNormalize.UrlNormalize.PROPERTY_OPTIONS_REPLACE = 'replace'

static

Definition at line 25 of file UrlNormalize.py.

---

The documentation for this class was generated from the following file:

• sources/hce/app/UrlNormalize.py