通過logging模塊，重寫一個logging2模塊，獨立開啟線程，將待寫的日志信息異步放入隊列，做到日志輸出不影響主流程性能，環境python3.8
logging2.py
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
|
import
os
import
threading
import
queue
import
time
import
datetime
import
logging
from
logging.handlers
import
RotatingFileHandler
class
logging2(threading.Thread):
AQueue
=
queue.Queue(
100000
)
nPID
=
os.getpid()
Adt
=
datetime.datetime.now().strftime(
'%Y%m%d'
)
nCount
=
1
def
__init__(
self
, threadID, name, module, logLevel):
threading.Thread.__init__(
self
)
self
.threadID
=
threadID
self
.name
=
name
self
.module
=
module
print
(
"set loglevel: [%s]"
%
(logLevel) )
formatter
=
logging.Formatter(
'%(asctime)s|%(name)s|%(process)d|%(levelname)s|%(message)s'
)
logfile
=
"log_"
+
self
.module
+
"_"
+
str
(logging2.nPID)
+
"_"
+
str
(logging2.Adt)
+
".log"
self
.logger
=
logging.getLogger(__name__)
self
.rHandler
=
RotatingFileHandler(logfile, maxBytes
=
10
*
1024
*
1024
, backupCount
=
10
)
self
.rHandler.setFormatter(formatter)
self
.console
=
logging.StreamHandler()
self
.console.setFormatter(formatter)
if
logLevel
=
=
'DEBUG'
:
self
.logger.setLevel(level
=
logging.DEBUG)
self
.rHandler.setLevel(logging.DEBUG)
self
.console.setLevel(logging.DEBUG)
elif
logLevel
=
=
'INFO'
:
self
.logger.setLevel(level
=
logging.INFO)
self
.rHandler.setLevel(logging.INFO)
self
.console.setLevel(logging.INFO)
elif
logLevel
=
=
'WARNING'
:
self
.logger.setLevel(level
=
logging.WARN)
self
.rHandler.setLevel(logging.WARN)
self
.console.setLevel(logging.WARN)
elif
logLevel
=
=
'ERROR'
:
self
.logger.setLevel(level
=
logging.ERROR)
self
.rHandler.setLevel(logging.ERROR)
self
.console.setLevel(logging.ERROR)
self
.logger.addHandler(
self
.rHandler)
self
.logger.addHandler(
self
.console)
#如果跨天了，則重新生成新的文件名
def
reSetLog(
self
):
AdtTemp
=
datetime.datetime.now().strftime(
'%Y%m%d'
)
#比較新的時間
if
AdtTemp
=
=
logging2.Adt:
return
(
True
)
logging2.Adt
=
AdtTemp
logfile
=
"log_"
+
self
.module
+
"_"
+
str
(logging2.nPID)
+
"_"
+
str
(AdtTemp)
+
".log"
self
.rHandler
=
RotatingFileHandler(logfile, maxBytes
=
1
*
1024
, backupCount
=
10
)
self
.logger.addHandler(
self
.rHandler)
self
.logger.addHandler(
self
.console)
logging2.nCount
+
=
1
def
run(
self
):
print
(
"開啟日志線程："
+
self
.name)
i
=
0
while
True
:
#data = "queue test data"
#debug(data)
#print("Queuesize: %s" % (logging2.AQueue.qsize()))
self
.reSetLog()
if
logging2.AQueue.empty()
=
=
False
:
#從隊列獲取日志消息
data
=
logging2.AQueue.get()
#解析日志消息，格式：日志級別，內容
level
=
list
(data.keys())[
0
]
content
=
data.get(level)
#把內容按分隔符|解析成list傳入參數
lstContent
=
list
(content.split(
'|'
))
if
level
=
=
'DEBUG'
:
self
.logger.debug(
*
lstContent)
elif
level
=
=
'INFO'
:
self
.logger.info(
*
lstContent)
elif
level
=
=
'WARNING'
:
self
.logger.warn(
*
lstContent)
elif
level
=
=
'ERROR'
:
self
.logger.error(
*
lstContent)
else
:
time.sleep(
0.5
)
print
(
"退出線程："
+
self
.name)
def
debug(
*
content):
logMsg
=
""
#傳入多個參數用豎線分隔符分開
for
i
in
range
(
len
(content)):
if
i
=
=
len
(content)
-
1
:
logMsg
+
=
content[i]
else
:
logMsg
+
=
content[i]
+
"|"
logging2.AQueue.put({
'DEBUG'
:logMsg})
def
info(
*
content):
logMsg
=
""
for
i
in
range
(
len
(content)):
if
i
=
=
len
(content)
-
1
:
logMsg
+
=
content[i]
else
:
logMsg
+
=
content[i]
+
"|"
logging2.AQueue.put({
'INFO'
:logMsg})
def
warn(
*
content):
logMsg
=
""
for
i
in
range
(
len
(content)):
if
i
=
=
len
(content)
-
1
:
logMsg
+
=
content[i]
else
:
logMsg
+
=
content[i]
+
"|"
logging2.AQueue.put({
'WARNING'
:logMsg})
def
error(
*
content):
logMsg
=
""
for
i
in
range
(
len
(content)):
if
i
=
=
len
(content)
-
1
:
logMsg
+
=
content[i]
else
:
logMsg
+
=
content[i]
+
"|"
logging2.AQueue.put({
'ERROR'
:logMsg})
def
init(module, level):
# 創建新線程
thread1
=
logging2(
1
,
"Thread-log"
, module, level)
# 開啟新線程
thread1.start()
# thread1.join()
|
測試樁logMain.py
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
|
import
sys
import
os
import
time
import
threading
if
__name__
=
=
'__main__'
:
import
logging2
logging2.init(
"logMain"
,
"DEBUG"
)
teststr
=
"22222"
while
True
:
logging2.debug(
'this is a debug log test [%s] '
, teststr)
logging2.info(
'this is a info log test [%s] [%s]'
, teststr, teststr)
logging2.warn(
'this is a warn log test'
)
logging2.error(
'this is a error log test'
)
#time.sleep(0.1)
print
(threading.
enumerate
())
print
(
'press ctrl_c to exit'
)
|
測試結果
生成日志文件：
-rw-rw-r--. 1 zxl zxl 10152463 6月 24 17:52 log_logMain_57554_20200624.log
文件內容如下：
以上就是本文的全部內容，希望對大家的學習有所幫助，也希望大家多多支持腳本之家。