HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.
2.0.0-chaika
Hierarchical Cluster Engine Python language binding
Main Page
Related Pages
+
Namespaces
Namespace List
+
Namespace Members
+
All
_
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
q
r
s
t
u
v
w
x
+
Functions
_
a
b
c
d
e
f
g
i
j
l
m
o
p
r
s
t
u
v
w
+
Variables
_
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
q
r
s
t
u
v
w
x
+
Classes
Class List
Class Index
Class Hierarchy
+
Class Members
+
All
_
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
q
r
s
t
u
v
w
x
z
+
Functions
_
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
r
s
t
u
v
w
x
+
Variables
_
a
b
c
d
e
f
g
h
i
j
k
l
m
n
o
p
q
r
s
t
u
v
w
x
z
+
Files
File List
▼
HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings.
►
HCE project, Python bindings, Distributed Tasks Manager application, Distributed Crawler service.
Todo List
►
Namespaces
►
Classes
▼
Files
►
File List
•
All
Classes
Namespaces
Files
Functions
Variables
Pages
scraper_utils.py
Go to the documentation of this file.
1
"""@package docstring
2
@file scraper_utils.py
3
@author Alexey <developers.hce@gmail.com>
4
@link http://hierarchical-cluster-engine.com/
5
@copyright Copyright © 2013 IOIX Ukraine
6
@license http://hierarchical-cluster-engine.com/license/
7
@package HCE project node API
8
@since 0.1
9
"""
10
11
12
import
base64
13
import
md5
14
15
16
# convert plain text to base64 encoded string
17
def
encode
(text):
18
return
base64.b64encode(text)
19
# convert base64 encoded string to plain text
20
def
decode
(text):
21
return
base64.b64decode(text)
22
23
24
def
unicode_decode
(text):
25
return
str(text).
decode
(
"utf-8"
)
26
27
28
def
md5_encode
(text):
29
return
str(md5.new(
unicode_decode
(text)).hexdigest())
dc_processor.scraper_utils.decode
def decode(text)
Definition:
scraper_utils.py:20
dc_processor.scraper_utils.encode
def encode(text)
Definition:
scraper_utils.py:17
dc_processor.scraper_utils.md5_encode
def md5_encode(text)
Definition:
scraper_utils.py:28
dc_processor.scraper_utils.unicode_decode
def unicode_decode(text)
Definition:
scraper_utils.py:24
sources
hce
dc_processor
scraper_utils.py
Generated on Fri Nov 24 2017 18:53:58 for HCE Project Python language Distributed Tasks Manager Application, Distributed Crawler Application and client API bindings. by
1.8.13