HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.  2.0.0-chaika
Hierarchical Cluster Engine Python language binding
ftests.ftest_UrlSchema Namespace Reference

Classes

class  Test
 

Functions

def getLogger ()
 
def test ()
 

Detailed Description

Created on Nov 23, 2015

@author: scorp

Function Documentation

◆ getLogger()

def ftests.ftest_UrlSchema.getLogger ( )

Definition at line 76 of file ftest_UrlSchema.py.

76 def getLogger():
77  # create logger
78  logger = logging.getLogger(APP_CONSTS.LOGGER_NAME)
79  logger.setLevel(logging.DEBUG)
80 
81  # create console handler and set level to debug
82  ch = logging.StreamHandler()
83  ch.setLevel(logging.DEBUG)
84 
85  # create formatter
86  formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
87 
88  # add formatter to ch
89  ch.setFormatter(formatter)
90 
91  # add ch to logger
92  logger.addHandler(ch)
93 
94  return logger
95 
96 
Here is the caller graph for this function:

◆ test()

def ftests.ftest_UrlSchema.test ( )

Definition at line 97 of file ftest_UrlSchema.py.

97 def test():
98  logger = getLogger()
99  testDataList = ['111', '222', '333', '1 2 3', '4 5']
100 
101  testUrl = 'http://127.0.0.1/some_test_url_%%'
102  testFilePath = '/tmp/urlSchemaTestFile.json'
103  urlSchemaData = "{\"type\":1, \"parameters\":{}, \"file_path\": \"%s\", \"mode\":1, \"max_items\":200, \"delimiter\":\"%s\",\"format\":\"plain-text\", \"url_encode\":1, \"batch_insert\":2}"
104  urlSchemaDelimiter = ''
105  urlSchemaParameter = urlSchemaData % (testFilePath, urlSchemaDelimiter)
106 
107  print urlSchemaParameter
108 
109  # fill data file
110  f = open(testFilePath, 'w')
111  if urlSchemaDelimiter == "":
112  for word in testDataList:
113  f.write(word + '\n')
114  else:
115  for word in testDataList:
116  f.write(word + urlSchemaDelimiter)
117  f.close()
118 
119 # f = open(testFilePath, 'r')
120 # data = f.read()
121 # f.close()
122 # print data
123 
124  schema = UrlSchema(schema=urlSchemaParameter)
125  resUrls = schema.generateUrlSchema(testUrl)
126 
127  print "Result:"
128  for url in resUrls:
129  print url
130 
131 # if os.path.isfile(testFilePath):
132 # os.remove(testFilePath)
133 
134 
Here is the call graph for this function: