dc_postprocessor.PostprocessorTask.PostprocessorTask Class Reference

Inheritance diagram for dc_postprocessor.PostprocessorTask.PostprocessorTask:

Collaboration diagram for dc_postprocessor.PostprocessorTask.PostprocessorTask:

Classes
class	Meta

Public Member Functions
def	__init__ (self)
def	init (self)
def	setup (self)
def	run (self)
def	finalize (self)
def	instantiateModules (self)
def	loadConfig (self)
def	process (self)
Public Member Functions inherited from dc_postprocessor.PostProcessingApplicationClass.PostProcessingApplicationClass
def	__init__ (self)
def	setup (self)
def	run (self)
def	inputBatch (self)
def	outputBatch (self)
def	getConfigOption (self, sectionName, optionName, defaultValue=None)

Public Attributes
	modules
	modulesImport
	modulesOrder
	batch
Public Attributes inherited from dc_postprocessor.PostProcessingApplicationClass.PostProcessingApplicationClass
	exitCode
	logger
	configParser
	inputFile
	batch

Static Public Attributes
string	CONFIG_OPTION_MODULES_IMPORT = 'modulesImport'
string	CONFIG_OPTION_MODULES_ORDER = 'modulesOrder'
string	PACKAGE_MAME = 'dc_postprocessor'
string	ERROR_MSG_LOAD_CONFIG_OPTIONS = "Error load config options. Error: %s"
string	ERROR_MSG_INSTANTIATE_MODULES = "Error instantiate modules. Error: %s"
string	MSG_PROCESSING_STARTED = "Postprocessing for batch ID = %s started."
string	MSG_PROCESSING_FINISHED = "Postprocessing for batch ID = %s finished."
Static Public Attributes inherited from dc_postprocessor.PostProcessingApplicationClass.PostProcessingApplicationClass
string	MSG_ERROR_EMPTY_CONFIG_FILE_NAME = "Config file name is empty."
string	MSG_ERROR_WRONG_CONFIG_FILE_NAME = "Config file name is wrong"
string	MSG_ERROR_LOAD_APP_CONFIG = "Error loading application config file."
string	MSG_ERROR_READ_LOG_CONFIG = "Error read log config file."
string	MSG_ERROR_MISSED_SECTION = "Missed mandatory section '%s'"
string	MSG_DEBUG_INPUT_PICKLE = "Input pickle: "
string	MSG_DEBUG_INPUT_BATCH = "Input batch: "
string	MSG_DEBUG_OUTPUT_BATCH = "Output batch: "
string	MSG_DEBUG_OUTPUT_PICKLE = "Output pickle: "
string	MSG_DEBUG_SEND_PICKLE = "Send pickle. Done."
string	CONFIG_OPTION_LOG = "log"

Detailed Description

Definition at line 23 of file PostprocessorTask.py.

Constructor & Destructor Documentation

__init__()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.__init__

(

self

)

Definition at line 47 of file PostprocessorTask.py.

  def __init__(self):
    PostProcessingApplicationClass.__init__(self)

#     self.logger = None
    self.modules = []
    self.modulesImport = None
    self.modulesOrder = None

Member Function Documentation

finalize()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.finalize

(

self

)

Definition at line 92 of file PostprocessorTask.py.

  def finalize(self):
    self.outputBatch()

Here is the call graph for this function:

Here is the caller graph for this function:

init()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.init

(

self

)

Definition at line 60 of file PostprocessorTask.py.

  def init(self):
    self.inputBatch()
    self.loadConfig()
    self.instantiateModules()

Here is the call graph for this function:

Here is the caller graph for this function:

instantiateModules()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.instantiateModules

(

self

)

Definition at line 100 of file PostprocessorTask.py.

  def instantiateModules(self):
    for m in self.modulesImport:
      try:
        im = importlib.import_module(self.PACKAGE_MAME + '.' + m)
        mi = getattr(im, m)(self.getConfigOption, self.logger)
        mi.init()
        self.modules.append(mi)
      except Exception, err:
        self.logger.error(self.ERROR_MSG_INSTANTIATE_MODULES % str(err))


#   # #load log config file
#   #
#   # @return - None
#   def loadLogConfig(self, configName):
#
#     try:
#       if not isinstance(configName, str) or len(configName) == 0:
#         raise Exception(self.MSG_ERROR_EMPTY_CONFIG_FILE_NAME)
#
#       logging.config.fileConfig(configName)
#
#       # call rotation log files and initialization logger
#       self.logger = Utils.MPLogger().getLogger()
#       # self.logger = logging.getLogger(APP_CONSTS.LOGGER_NAME)
#
#     except Exception, err:
#       raise Exception(self.MSG_ERROR_READ_LOG_CONFIG + ' ' + str(err))

Here is the call graph for this function:

Here is the caller graph for this function:

loadConfig()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.loadConfig

(

self

)

Definition at line 134 of file PostprocessorTask.py.

  def loadConfig(self):
    try:
#       self.loadLogConfig(self.getConfigOption(APP_CONSTS.CONFIG_APPLICATION_SECTION_NAME, self.CONFIG_OPTION_LOG))


      self.modulesImport = self.getConfigOption(self.__class__.__name__, self.CONFIG_OPTION_MODULES_IMPORT).split(',')
      self.modulesOrder = self.getConfigOption(self.__class__.__name__, self.CONFIG_OPTION_MODULES_ORDER).split(',')

      self.modulesImport = [moduleName for moduleName in self.modulesImport if moduleName != ""]
      self.modulesOrder = [moduleName for moduleName in self.modulesOrder if moduleName != ""]

      self.logger.debug("self.modulesImport: %s", str(self.modulesImport))
      self.logger.debug("self.modulesOrder: %s", str(self.modulesOrder))

    except Exception, err:
      raise Exception(self.ERROR_MSG_LOAD_CONFIG_OPTIONS % str(err))

Here is the call graph for this function:

Here is the caller graph for this function:

process()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.process

(

self

)

Definition at line 156 of file PostprocessorTask.py.

  def process(self):

    self.logger.debug(self.MSG_PROCESSING_STARTED, str(self.batch.id))
    # process batch execution
    for moduleName in self.modulesOrder:
      for moduleInstance in self.modules:
        # if isinstance(moduleInstance, moduleName):
        if moduleName in str(type(moduleInstance)):
          self.batch = moduleInstance.processBatch(self.batch)

    # process batch item execution
    for i in xrange(len(self.batch.items)):
      for moduleName in self.modulesOrder:
        for moduleInstance in self.modules:
          # if isinstance(moduleInstance, moduleName):
          if moduleName in str(type(moduleInstance)):
            self.batch.items[i] = moduleInstance.processBatchItem(self.batch.items[i])

    self.logger.debug(self.MSG_PROCESSING_FINISHED, str(self.batch.id))

run()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.run

(

self

)

Definition at line 78 of file PostprocessorTask.py.

  def run(self):
    PostProcessingApplicationClass.run(self)

    self.init()
    self.process()
    self.finalize()
    # finish logging
    self.logger.info(APP_CONSTS.LOGGER_DELIMITER_LINE)

Here is the call graph for this function:

setup()

def dc_postprocessor.PostprocessorTask.PostprocessorTask.setup

(

self

)

Definition at line 70 of file PostprocessorTask.py.

  def setup(self):
    PostProcessingApplicationClass.setup(self)

Member Data Documentation

batch

dc_postprocessor.PostprocessorTask.PostprocessorTask.batch

Definition at line 164 of file PostprocessorTask.py.

CONFIG_OPTION_MODULES_IMPORT

string dc_postprocessor.PostprocessorTask.PostprocessorTask.CONFIG_OPTION_MODULES_IMPORT = 'modulesImport'

static

Definition at line 26 of file PostprocessorTask.py.

CONFIG_OPTION_MODULES_ORDER

string dc_postprocessor.PostprocessorTask.PostprocessorTask.CONFIG_OPTION_MODULES_ORDER = 'modulesOrder'

static

Definition at line 27 of file PostprocessorTask.py.

ERROR_MSG_INSTANTIATE_MODULES

string dc_postprocessor.PostprocessorTask.PostprocessorTask.ERROR_MSG_INSTANTIATE_MODULES = "Error instantiate modules. Error: %s"

static

Definition at line 33 of file PostprocessorTask.py.

ERROR_MSG_LOAD_CONFIG_OPTIONS

string dc_postprocessor.PostprocessorTask.PostprocessorTask.ERROR_MSG_LOAD_CONFIG_OPTIONS = "Error load config options. Error: %s"

static

Definition at line 32 of file PostprocessorTask.py.

modules

dc_postprocessor.PostprocessorTask.PostprocessorTask.modules

Definition at line 51 of file PostprocessorTask.py.

modulesImport

dc_postprocessor.PostprocessorTask.PostprocessorTask.modulesImport

Definition at line 52 of file PostprocessorTask.py.

modulesOrder

dc_postprocessor.PostprocessorTask.PostprocessorTask.modulesOrder

Definition at line 53 of file PostprocessorTask.py.

MSG_PROCESSING_FINISHED

string dc_postprocessor.PostprocessorTask.PostprocessorTask.MSG_PROCESSING_FINISHED = "Postprocessing for batch ID = %s finished."

static

Definition at line 37 of file PostprocessorTask.py.

MSG_PROCESSING_STARTED

string dc_postprocessor.PostprocessorTask.PostprocessorTask.MSG_PROCESSING_STARTED = "Postprocessing for batch ID = %s started."

static

Definition at line 36 of file PostprocessorTask.py.

PACKAGE_MAME

string dc_postprocessor.PostprocessorTask.PostprocessorTask.PACKAGE_MAME = 'dc_postprocessor'

static

Definition at line 29 of file PostprocessorTask.py.

---

The documentation for this class was generated from the following file:

• sources/hce/dc_postprocessor/PostprocessorTask.py