MPLogger
Multi-processing capable print-like logger for Python
Requirements and Installation
Python 3.8+ is required
Pip
pip install mplogger
Manual
Poetry and (optionally) GNU Make are required.
git clone https://github.com/ELTE-DH/webarticlecurator.git- Run
make
On Windows or without Make (after cloning the repository):
poetry install --no-rootpoetry buildpoetry run pip install --upgrade dist/*.whl(the correct filename must be specified on Windows)
Usage
Single-process
from MLPlogger import Logger
# Initialize logger (default: STDERR only with INFO level)
logger = Logger(log_filename, logfile_mode, logfile_encoding, logfile_level, console_stream, console_level, console_format, file_format)
logger.log('INFO', 'First argument log level as string')
logger.log('WARNING', 'THIS IS A WARNING!', 'In multiple lines', 'just like print()', sep='\n')
logger.log('CRITICAL', 'Can also set line endings!', end='\r\n')
Multi-process
from itertools import repeat
from multiprocessing import Pool, Manager, current_process
from MLPlogger import Logger
def worker_process(par):
state, lq = par
retl = []
for n in range(100):
lq.log('WARNING', f'{current_process().name} message{state} {n}')
lq.log('WARNING', f'{current_process().name} finished')
return retl
log_obj = Logger('test.log', 'w') # Apply all parameters for logger here!
log_obj.log('INFO', 'NORMAL LOG BEGIN') # Normal logging
with Manager() as man:
log_queue = man.Queue()
with log_obj.init_mp_logging_context(log_queue) as mplogger, Pool() as p:
# Here one can log parallel from all processes!
return_queue = p.imap(worker_process, zip(range(10), repeat(mplogger)), chunksize=3)
for _ in return_queue:
pass
log_obj.log('INFO', 'NORMAL LOG END') # Normal logging
Licence
This project is licensed under the terms of the GNU LGPL 3.0 license.
2 Oct 2, 2022
3 Jan 10, 2022
1.5k Jan 6, 2023
365 Nov 11, 2022
43 Dec 27, 2022
17 Jul 17, 2022
795 Dec 18, 2022
13.7k Jan 2, 2023
1.4k Dec 31, 2022
15 Dec 29, 2022
2 Nov 25, 2021
39 Aug 26, 2022
23 Oct 04, 2021
2 Mar 27, 2022
1 Nov 10, 2021
17 May 03, 2022
2 Dec 04, 2021
1.4k Jan 04, 2023
7 Nov 30, 2022
2 Jan 05, 2022
1.4k Nov 11, 2022
1k Jan 04, 2023
2 Mar 05, 2022
15 Dec 16, 2022
2.3k Jan 05, 2023
2 Jan 13, 2022
824 Jan 08, 2023