A python tool for synchronizing the messages from different threads, processes, or hosts.

Last update: Aug 11, 2021

Overview

Sync-stream

This project is designed for providing the synchoronization of the stdout / stderr among different threads, processes, devices or hosts. The package could be used for the following cases:

Use syncstream.LineBuffer: Multiple threads are created. The messages (stdout) from different threads are required to be collected.
Use syncstream.LineProcBuffer in the main process, and syncstream.LineProcMirror in the sub-processes: Multiple sub-processes are created on the same device. The stdout / stderr of each process is redirected to a LineProcMirror, and the results are collected by LineProcBuffer.
Use syncstream.LineFileBuffer: Multiple processes are created. These processes may be deployed on different devices (even with different platforms), but all devices could get accessed to the same shared disk. In this case, the message could be shared by locked files. Each process would hold an independent LineFileBuffer pointing to the same log files.
Use syncstream.LineHostBuffer on the server side, and syncstream.LineHostMirror on the client side: Multiple processes are deployed on different devices, and they could not share the same disk. In this case, the message are synchronized by the web service. Each process would hold a LineHostMirror, and the results would be collected by LineHostBuffer.

The basic package would not contain the file and host modules. To install the package, please use the following options:

pip install syncstream[option1,option2...]

Option	Supports
`file`	Install dependencies for the `file` module. The module provides `syncstream.LineFileBuffer`.
`host`	Install dependencies for the `host` module. The module provides `syncstream.LineHostBuffer`, and `syncstream.LineHostMirror`.

Documentation

View the documentation here: 📘 https://cainmagi.github.io/sync-stream/

Update reports

0.3.3 @ 6/29/2021

Fix small typos.
Bump the dependencies to the newest versions.

0.3.2 @ 6/14/2021

Fix a bug caused by stopping the mirrors.
Format the meta-data defined in setup.py.
Add the documentation. Currently only the tutorial is finished.

0.3.0 @ 6/4/2021

Support the stop signal for mproc and host modules.
Fix some bugs in the testing script.
Fix typos.

0.2.2 @ 5/25/2021

Add clear() methods for all buffers and mirrors.
Fix typos in the package setup and info file.
Fix a bug caused by writing data to the host in the testing scripts for Linux.

0.2.1 @ 5/24/2021

Add the PyPI publish workflow.

0.2.0 @ 5/24/2021

Finish the synchronization based on the file lock package fasteners.
Finish the synchronization based on the web service packages flask, flask-restful and urllib3.
Fix the compatibility of the testing scripts for py36, py37.

0.1.0 @ 5/22/2021

Finish the synchronization based on the stdlib.
Create this project.

Provide error messages for Python exceptions, even if the original message is empty

errortext is a Python package to provide error messages for Python exceptions, even if the original message is empty.

0 Dec 7, 2021

Telegram bot to remove the forwarded tag from messages.

Anonymous Sender Bot @AnonySendBot Telegram bot to remove the forwarded tag from messages. Table of Contents Usage Deploy To Heroku Local Deploying En

26 Nov 24, 2022

Automatically remove user join messages when the user leaves the server.

CleanLeave Automatically remove user join messages when the user leaves the server. Installation You will need to install poetry to run this bot local

11 Sep 19, 2022

Simple script with AminoLab to send ghost messages

1 Nov 22, 2021

A Github Action for sending messages to a Matrix Room.

matrix-commit A Github Action for sending messages to a Matrix Room. Screenshot: Example Usage: # .github/workflows/matrix-commit.yml on: push:

3 Sep 11, 2022

ViberExport - Export messages from Viber messenger using viber.db file

📲 ViberExport Export messages from Viber messenger using viber.db file ⚡ Usage:

7 Nov 23, 2022

Telop - Encode and decode messages using an interpretation of the telegraphic code devised by José María Mathé

telop Telop (TELégrafoÓPtico) - Utilidad para codificar y descodificar mensajes de texto empleando una interpretación del código telegráfico ideado po

4 Nov 1, 2022

Automatically unpin old messages so you can always pin more!

PinRotate Automatically unpin old messages so you can always pin more! Installation You will need to install poetry to run this bot locally for develo

3 Sep 18, 2022

A tool to flash .ofp files in bootloader mode without needing MSM Tool, an alternative to official realme tool

Oppo/Realme Flash .OFP File on Bootloader A tool to flash .ofp files in bootloader mode without needing MSM Tool, an alternative to official realme to

70 Jan 2, 2023

Releases(0.3.3)

0.3.3(Jun 29, 2021)
Introduction

Sync-stream is a pure python tool for synchronizing the messages (including stdout, stderr, and raised exceptions or warnings) among threads, processes, devices, and hosts. This powerful tool is useful for capturing the updating logs from the sub-processes in some projects.

Updating reports

0.3.3 @ 6/29/2021

Fix small typos.

Bump the dependencies to the newest versions.

Source code(tar.gz)
Source code(zip)
0.3.2(Jun 14, 2021)
Introduction

Sync-stream is a pure python tool for synchronizing the messages (including stdout, stderr, and raised exceptions or warnings) among threads, processes, devices, and hosts. This powerful tool is useful for capturing the updating logs from the sub-processes in some projects.

Updating reports

0.3.2 @ 6/14/2021

Fix a bug caused by stopping the mirrors.

Format the meta-data defined in setup.py.

Add the documentation. Currently, only the tutorial is finished.

Source code(tar.gz)
Source code(zip)
0.3.0(Jun 4, 2021)
Introduction

Sync-stream is a pure python tool for synchronizing the messages (including stdout, stderr, and raised exceptions or warnings) among threads, processes, devices, and hosts. This powerful tool is useful for capturing the updating logs from the sub-processes in some projects.

Updating reports

0.3.0 @ 6/4/2021

Support the stop signal for mproc and host modules.

Fix some bugs in the testing script.

Fix typos.

Source code(tar.gz)
Source code(zip)
0.2.2(May 25, 2021)
Introduction

Sync-stream is a pure python tool for synchronizing the messages (including stdout, stderr, and raised exceptions or warnings) among threads, processes, devices, and hosts. This powerful tool is useful for capturing the updating logs from the sub-processes in some projects.

Updating reports

0.2.2 @ 5/25/2021

Add clear() methods for all buffers and mirrors.

Fix typos in the package setup and info file.

Fix a bug caused by writing data to the host in the testing scripts for Linux.

Source code(tar.gz)
Source code(zip)
0.2.1(May 24, 2021)
Introduction

This is the first release of this project. Sync-stream is a pure python tool for synchronizing the messages (including stdout, stderr, and raised exceptions or warnings) among threads, processes, devices, and hosts. This powerful tool is useful for capturing the updating logs from the sub-processes in some projects.

Updating reports

0.2.1 @ 5/24/2021

Add the PyPI publish workflow.

0.2.0 @ 5/24/2021

Finish the synchronization based on the file lock package fasteners.

Finish the synchronization based on the web service packages flask, flask-restful and urllib3.

Fix the compatibility of the testing scripts for py36, py37.

0.1.0 @ 5/22/2021

Finish the synchronization based on the stdlib.

Create this project.

Source code(tar.gz)
Source code(zip)

Owner

Yuchen Jin

A Ph.D student in University of Houston (UH). Interested area includes: machine learning, programming and religion.

GitHub Repository https://cainmagi.github.io/sync-stream/

A Python program for calculating the 95%CI for GNSS-derived site velocities

GNSS_Vel_95%CI A Python program for calculating the 95%CI for GNSS-derived site velocities Function_GNSS_95CI.py is a Python function for calculating

[email protected]"> 4 Dec 16, 2022

Check is a integer is even

Is Even Check if interger is even using isevenapi. https://isevenapi.xyz/ Main features: cache memoization api retry handler hide ads Install pip inst

45 Dec 19, 2022

A python script made for personal use to monitor for sports card restocks on target.com since they are sold out often

TargetProductMonitor A python script made for personal use to monitor for sports card resocks on target.com since they are sold out often. When a rest

2 Jul 31, 2022

100 Days of Python Programming

100 days of Python Following the initiative of my friend Helber Belmiro, who is almost done with his 100 days of Java, I have decided to start my 100

19 Nov 08, 2021

A project for the Qvault Hackathon, 2022-01-17

musical-octo-engine Steps to run brew install python-tk brew install portaudio

2 May 17, 2022

An ongoing curated list of frameworks, libraries, learning tutorials, software and resources in Python Language.

Python Development Welcome to the world of Python. An ongoing curated list of frameworks, libraries, learning tutorials, software and resources in Pyt

2 Dec 24, 2021

Validate UC alumni identifier numbers with Python 3.

UC number validator Validate UC alumni identifier numbers with Python 3. Getting started Install the library with: pip install -U ucnumber Usage from

1 Jul 07, 2021

Lock a program and kills it indefinitely if it is started.

Kill By Lock Lock a program and kills it indefinitely if it is started. How start it? It' simple, you just have to double-click on the python file (.p

1 Jan 12, 2022

Create rangebased on lists or values of the range itself. Range any type. Can you imagine?

funcao-allrange-for-python3 Create rangebased on lists or values of the range itself. Range any type. Can you imagine? WARNING!!! THIS MODULE DID NOT

1 Feb 09, 2022

HomeAssistant Linux Companion

Application to run on linux desktop computer to provide sensors data to homeasssistant, and get notifications as if it was a mobile device.

10 Dec 27, 2022

Skull shaped MOSFET cells for the Efabless's 130nm process

3 Dec 14, 2022

A Python utility belt containing simple tools, a stdlib like feel, and extra batteries. Hashing, Caching, Timing, Progress, and more made easy!

Ubelt is a small library of robust, tested, documented, and simple functions that extend the Python standard library. It has a flat API that all behav

638 Dec 13, 2022

A python tool for synchronizing the messages from different threads, processes, or hosts.

Related tags

Overview

Sync-stream

Documentation

Update reports

0.3.3 @ 6/29/2021

0.3.2 @ 6/14/2021

0.3.0 @ 6/4/2021

0.2.2 @ 5/25/2021

0.2.1 @ 5/24/2021

0.2.0 @ 5/24/2021

0.1.0 @ 5/22/2021

You might also like...

Provide error messages for Python exceptions, even if the original message is empty

Telegram bot to remove the forwarded tag from messages.

Automatically remove user join messages when the user leaves the server.

Simple script with AminoLab to send ghost messages

A Github Action for sending messages to a Matrix Room.

ViberExport - Export messages from Viber messenger using viber.db file

Telop - Encode and decode messages using an interpretation of the telegraphic code devised by José María Mathé

Automatically unpin old messages so you can always pin more!

A tool to flash .ofp files in bootloader mode without needing MSM Tool, an alternative to official realme tool

Releases(0.3.3)

0.3.3(Jun 29, 2021)

Introduction

Updating reports

0.3.3 @ 6/29/2021

0.3.2(Jun 14, 2021)

Introduction

Updating reports

0.3.2 @ 6/14/2021

0.3.0(Jun 4, 2021)

Introduction

Updating reports

0.3.0 @ 6/4/2021

0.2.2(May 25, 2021)

Introduction

Updating reports

0.2.2 @ 5/25/2021

0.2.1(May 24, 2021)

Introduction

Updating reports

0.2.1 @ 5/24/2021

0.2.0 @ 5/24/2021

0.1.0 @ 5/22/2021

Owner

Yuchen Jin

A Python program for calculating the 95%CI for GNSS-derived site velocities

Check is a integer is even

A python script made for personal use to monitor for sports card restocks on target.com since they are sold out often

100 Days of Python Programming

A project for the Qvault Hackathon, 2022-01-17

An ongoing curated list of frameworks, libraries, learning tutorials, software and resources in Python Language.

Validate UC alumni identifier numbers with Python 3.

Lock a program and kills it indefinitely if it is started.

Create rangebased on lists or values of the range itself. Range any type. Can you imagine?

HomeAssistant Linux Companion

Skull shaped MOSFET cells for the Efabless's 130nm process

A Python utility belt containing simple tools, a stdlib like feel, and extra batteries. Hashing, Caching, Timing, Progress, and more made easy!

Машинное обучение на ФКН ВШЭ

A code base for python programs the goal is to integrate all the useful and essential functions

A streaming animation of all the edits to a given Wikipedia page.

A python library for writing parser-based interactive fiction.

Generating rent availability info from Effort rent

Usos Semester average helper

This program generates automatically new folders containing old version of program

Covid-ChatBot - A Rapid Response Virtual Agent for Covid-19 Queries