HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.  2.0.0-chaika
Hierarchical Cluster Engine Python language binding
ftests.ftest_dc_normalize_url Namespace Reference

Functions

def getLogger ()
 

Variables

def logger = getLogger()
 
string url = '//192.168.253.114/template_scraping/index1.html'
 
string base = 'https://regex101.com\a\\\\\\\\\\b/index2.html'
 
list supportProtocols = ['http', 'https']
 
list baseUrls
 
list urls
 
 retUrl = urlNormalization(baseUrl, url, log=logger)
 

Function Documentation

◆ getLogger()

def ftests.ftest_dc_normalize_url.getLogger ( )

Definition at line 30 of file ftest_dc_normalize_url.py.

30 def getLogger():
31  # create logger
32  logger = logging.getLogger('hce')
33  logger.setLevel(logging.DEBUG)
34 
35  # create console handler and set level to debug
36  ch = logging.StreamHandler()
37  ch.setLevel(logging.DEBUG)
38 
39  # create formatter
40  formatter = logging.Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
41 
42  # add formatter to ch
43  ch.setFormatter(formatter)
44 
45  # add ch to logger
46  logger.addHandler(ch)
47 
48  return logger
49 
50 

Variable Documentation

◆ base

string ftests.ftest_dc_normalize_url.base = 'https://regex101.com\a\\\\\\\\\\b/index2.html'

Definition at line 65 of file ftest_dc_normalize_url.py.

◆ baseUrls

list ftests.ftest_dc_normalize_url.baseUrls
Initial value:
1 = ['http://www.developers.net/a/b/c/d/e/index.html',
2  'https://alexv:1234@developers.net/a/b/c/d/e/index.html',
3  'https://alexv:1234@developers.net:8080/a/b/c/d/e/index.html',
4  'http://www.developers.net/a/b/c/d/e/developers.net/a/b/c/d/e/index.html',
5  'https://regex101.com\a\\\\\\\\\\b/index2.html']

Definition at line 73 of file ftest_dc_normalize_url.py.

◆ logger

def ftests.ftest_dc_normalize_url.logger = getLogger()

Definition at line 52 of file ftest_dc_normalize_url.py.

◆ retUrl

ftests.ftest_dc_normalize_url.retUrl = urlNormalization(baseUrl, url, log=logger)

Definition at line 99 of file ftest_dc_normalize_url.py.

◆ supportProtocols

list ftests.ftest_dc_normalize_url.supportProtocols = ['http', 'https']

Definition at line 68 of file ftest_dc_normalize_url.py.

◆ url

string ftests.ftest_dc_normalize_url.url = '//192.168.253.114/template_scraping/index1.html'

Definition at line 54 of file ftest_dc_normalize_url.py.

◆ urls

list ftests.ftest_dc_normalize_url.urls
Initial value:
1 = ['http://www.cwi.nl/%7Eguido/FAQ.html',
2  '/FAQ.html',
3  './FAQ.html',
4  '../../FAQ.html',
5  '',
6  '//media.townhall.com/townhall/reu/ha/2017\33\\45\c70a08d0-cf34-45c3-b28d-5b685f4ed8bd.jpg',
7  '//media.townhall.com/townhall/reu/ha/2017/33/c70a08d0-cf34-45c3-b28d-5b685f4ed8bd.jpg',
8  '//media.townhall.com/townhall/reu/ha/2017%5C33%5Cc70a08d0-cf34-45c3-b28d-5b685f4ed8bd.jpg',
9  'https://regex101.com\a\\\\\\\\\\b/index.html']

Definition at line 79 of file ftest_dc_normalize_url.py.