rosny is a lightweight library for building concurrent systems.

Last update: Oct 05, 2021

Overview

rosny is a lightweight library for building concurrent systems.

Installation

Tested on:

Linux
Python >= 3.6

From pip:

pip install rosny

From source:

pip install git+https://github.com/lRomul/[email protected]

Example

from multiprocessing import Queue
from rosny import ThreadStream, ProcessStream, ComposeStream


class SenderStream(ThreadStream):  # using threading.Thread
    def __init__(self, queue: Queue):
        super().__init__(loop_rate=30)
        self.queue = queue
        self.count = 0

    # run the method in a loop in a separate thread
    def work(self):
        self.queue.put(self.count)
        self.logger.info(f'put {self.count}')
        self.count += 1


class ReceiverStream(ProcessStream):  # using multiprocessing.Process
    def __init__(self, queue: Queue):
        super().__init__()
        self.queue = queue

    # run the method in a loop in a separate process
    def work(self):
        value = self.queue.get(timeout=1)
        self.logger.info(f'get {value}')


class MainStream(ComposeStream):  # merging several streams
    def __init__(self):
        super().__init__()
        queue = Queue()
        self.sender = SenderStream(queue)
        self.receiver = ReceiverStream(queue)


if __name__ == "__main__":
    stream = MainStream()
    stream.start()
    stream.wait(5)
    stream.stop()
    stream.join()

Functional interface for concurrent futures, including asynchronous I/O.

Futured provides a consistent interface for concurrent functional programming in Python. It wraps any callable to return a concurrent.futures.Future,

11 Nov 27, 2022

A Python script that exports users from one Telegram group to another using one or more concurrent user bots.

ExportTelegramUsers A Python script that exports users from one Telegram group to another using one or more concurrent user bots. Make sure to set all

17 Jun 26, 2022

A wrapper around ffmpeg to make it work in a concurrent and memory-buffered fashion.

Media Fixer Have you ever had a film or TV show that your TV wasn't able to play its audio? Well this program is for you. Media Fixer is a program whi

3 May 4, 2022

A concurrent sync tool which works with multiple sources and targets.

Concurrent Sync A concurrent sync tool which works similar to rsync. It supports syncing given sources with multiple targets concurrently. Requirement

2 Jan 11, 2022

API for RL algorithm design & testing of BCA (Building Control Agent) HVAC on EnergyPlus building energy simulator by wrapping their EMS Python API

RL - EmsPy (work In Progress...) The EmsPy Python package was made to facilitate Reinforcement Learning (RL) algorithm research for developing and tes

20 Jan 5, 2023

A Python scikit for building and analyzing recommender systems

Overview Surprise is a Python scikit for building and analyzing recommender systems that deal with explicit rating data. Surprise was designed with th

5.7k Jan 1, 2023

Official repository for "Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems"

Action-Based Conversations Dataset (ABCD) This respository contains the code and data for ABCD (Chen et al., 2021) Introduction Whereas existing goal-

49 Oct 9, 2022

Repository for a project of the course EP2520 Building Networked Systems Security

EP2520_ACME_Project Repository for a project of the course EP2520 Building Networked Systems Security in Royal Institute of Technology (KTH), Stockhol

1 Dec 11, 2021

Example Python code for building RPi-controlled robotic systems

RPi Example Code Example Python code for building RPi-controlled robotic systems These python files have been compiled / developed by the Neurobionics

2 Feb 4, 2022

Sierra is a lightweight Python framework for building and integrating web applications

A lightweight Python framework for building and Integrating Web Applications. Sierra is a Python3 library for building and integrating web applications with HTML and CSS using simple enough syntax. You can develop your web applications with Python, taking advantage of its functionalities and integrating them to the fullest.

83 Sep 23, 2022

Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate everything from code deployment to network configuration to cloud management, in a language that approaches plain English, using SSH, with no agents to install on remote systems. https://docs.ansible.com.

Ansible Ansible is a radically simple IT automation system. It handles configuration management, application deployment, cloud provisioning, ad-hoc ta

55.9k Jan 4, 2023

An advanced multi-threaded, multi-client python reverse shell for hacking linux systems. There's still more work to do so feel free to help out with the development. Disclaimer: This reverse shell should only be used in the lawful, remote administration of authorized systems. Accessing a computer network without authorization or permission is illegal.

PwnLnX An advanced multi-threaded, multi-client python reverse shell for hacking linux systems. There's still more work to do so feel free to help out

212 Dec 24, 2022

Python toolkit for defining+simulating+visualizing+analyzing attractors, dynamical systems, iterated function systems, roulette curves, and more

Attractors A small module that provides functions and classes for very efficient simulation and rendering of iterated function systems; dynamical syst

1 Aug 4, 2021

generate HPC scheduler systems jobs input scripts and submit these scripts to HPC systems and poke until they finish

DPDispatcher DPDispatcher is a python package used to generate HPC(High Performance Computing) scheduler systems (Slurm/PBS/LSF/dpcloudserver) jobs in

23 Nov 30, 2022

Distributed-systems-algos - Distributed Systems Algorithms For Python

Distributed Systems Algorithms ISIS algorithm In an asynchronous system that kee

2 Nov 30, 2022

Code for Private Recommender Systems: How Can Users Build Their Own Fair Recommender Systems without Log Data? (SDM 2022)

Private Recommender Systems: How Can Users Build Their Own Fair Recommender Systems without Log Data? (SDM 2022) We consider how a user of a web servi

20 Aug 21, 2022

solsim is the Solana complex systems simulator. It simulates behavior of dynamical systems—DeFi protocols, DAO governance, cryptocurrencies, and more—built on the Solana blockchain

12 Jul 13, 2022

Control System Packer is a lightweight, low-level program to transform energy equations into the compact libraries for control systems.

Control System Packer is a lightweight, low-level program to transform energy equations into the compact libraries for control systems. Packer supports Python 🐍 , C 💻 and C++ 💻 libraries.

31 Sep 15, 2022

Endpoints is a lightweight REST api framework written in python and used in multiple production systems that handle millions of requests daily.

Endpoints Quickest API builder in the West! Endpoints is a lightweight REST api framework written in python and used in multiple production systems th

30 Mar 5, 2022

Releases(v0.0.6)

v0.0.6(Oct 17, 2022)
Docs

Setup material MkDocs.

Add logo.

Examples

Multiprocessing pose estimation with mediapipe example (link).

Threads inside process example (link).

Breaking Changes

Rename work_loop method to loop.

Rename on_work_loop_begin callback method to on_loop_begin.

Rename on_work_loop_end callback method to on_loop_end.

Source code(tar.gz)
Source code(zip)
v0.0.5(Jun 28, 2021)
New Features

Loop rate profiling via parameter profile_interval of ThreadStream and ProcessStream.

ProcessStream now works with any methods to start a process: spawn, fork, and forkserver. User should use multiprocessing.set_start_method() function before starting streams.

New callback methods: on_compile_begin, on_compile_end, on_work_loop_begin, on_work_loop_end.

Internal state is now a common_state and can be set by user via compile method.

Add handle_signals parameter of compile method. A boolean value indicating whether handling systems signals.

Examples

Video pipeline with mediapipe (link).

Breaking Changes

Remove callback methods: on_wait_begin, on_wait_end.

Remove SIGQUIT handling.

Source code(tar.gz)
Source code(zip)
v0.0.4(Jun 22, 2021)
New Features

rosny.process.ProcessStream like ThreadStream runs a task in a loop with the ability to set the loop frequency but in a separate process.

rosny.signal - set of functions for handling system signals (SIGINT, SIGTERM, SIGQUIT).

rosny.timing.LoopRateManager limits rate of a loop.

daemon parameter for ThreadStream/ProcessStream indicating whether thread/process will a daemon or not.

Examples

Threads vs processes on CPU-bound task (link).

Source code(tar.gz)
Source code(zip)
v0.0.3(Jun 19, 2021)
New Features

compiled, stopped, joined predicate methods of streams.

Edit logging messages.

Docs

Add badges to README.md.

CI/CD

Tests.

Upload code coverage to codecov (codecov).

Type checking with mypy.

Breaking Changes

rosny.thread.ThreadStream: make rate_manager as a public attribute.

Source code(tar.gz)
Source code(zip)
v0.0.2(Jun 17, 2021)
rosny is a simple library for building concurrency systems.

Features

rosny.thread.ThreadStream runs a task in a loop with the ability to set the loop frequency.

rosny.compose.ComposeStream orchestrates several streams.

rosny.timing.LoopRateManager limits rate of a loop.

Examples

Common counter (link).

Sender and receiver (link).

CI/CD

Publish а package to PyPI.

Check code style with flake8.

Run tests with pytest.

Source code(tar.gz)
Source code(zip)

Owner

Ruslan Baikulov

Tech Lead at osai.ai

GitHub Repository https://lRomul.github.io/rosny

A curated list of awesome Python asyncio frameworks, libraries, software and resources

Awesome asyncio A carefully curated list of awesome Python asyncio frameworks, libraries, software and resources. The Python asyncio module introduced

3.8k Jan 08, 2023

Unsynchronize asyncio by using an ambient event loop, or executing in separate threads or processes.

unsync Unsynchronize asyncio by using an ambient event loop, or executing in separate threads or processes. Quick Overview Functions marked with the @

802 Dec 28, 2022

Raise asynchronous exceptions in other thread, control the timeout of blocks or callables with a context manager or a decorator

stopit Raise asynchronous exceptions in other threads, control the timeout of blocks or callables with two context managers and two decorators. Attent

97 Oct 12, 2022

rosny is a lightweight library for building concurrent systems.

Related tags

Overview

Installation

Example

You might also like...

Functional interface for concurrent futures, including asynchronous I/O.

A Python script that exports users from one Telegram group to another using one or more concurrent user bots.

A wrapper around ffmpeg to make it work in a concurrent and memory-buffered fashion.

A concurrent sync tool which works with multiple sources and targets.

API for RL algorithm design & testing of BCA (Building Control Agent) HVAC on EnergyPlus building energy simulator by wrapping their EMS Python API

A Python scikit for building and analyzing recommender systems

Official repository for "Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems"

Repository for a project of the course EP2520 Building Networked Systems Security

Example Python code for building RPi-controlled robotic systems

Sierra is a lightweight Python framework for building and integrating web applications

Python toolkit for defining+simulating+visualizing+analyzing attractors, dynamical systems, iterated function systems, roulette curves, and more

generate HPC scheduler systems jobs input scripts and submit these scripts to HPC systems and poke until they finish

Distributed-systems-algos - Distributed Systems Algorithms For Python

Code for Private Recommender Systems: How Can Users Build Their Own Fair Recommender Systems without Log Data? (SDM 2022)

solsim is the Solana complex systems simulator. It simulates behavior of dynamical systems—DeFi protocols, DAO governance, cryptocurrencies, and more—built on the Solana blockchain

Control System Packer is a lightweight, low-level program to transform energy equations into the compact libraries for control systems.

Endpoints is a lightweight REST api framework written in python and used in multiple production systems that handle millions of requests daily.

Releases(v0.0.6)

v0.0.6(Oct 17, 2022)

Docs

Examples

Breaking Changes

v0.0.5(Jun 28, 2021)

New Features

Examples

Breaking Changes

v0.0.4(Jun 22, 2021)

New Features

Examples

v0.0.3(Jun 19, 2021)

New Features

Docs

CI/CD

Breaking Changes

v0.0.2(Jun 17, 2021)

Features

Examples

CI/CD

Owner

Ruslan Baikulov

A curated list of awesome Python asyncio frameworks, libraries, software and resources

Unsynchronize asyncio by using an ambient event loop, or executing in separate threads or processes.

Raise asynchronous exceptions in other thread, control the timeout of blocks or callables with a context manager or a decorator

Backport of the concurrent.futures package to Python 2.6 and 2.7

Python Multithreading without GIL

rosny is a lightweight library for building concurrent systems.

aiomisc - miscellaneous utils for asyncio

Jug: A Task-Based Parallelization Framework

🌀 Pykka makes it easier to build concurrent applications.

A concurrent sync tool which works with multiple sources and targets.

Thread-safe asyncio-aware queue for Python

A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.

SCOOP (Scalable COncurrent Operations in Python)

AnyIO is an asynchronous networking and concurrency library that works on top of either asyncio or trio.

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

A Python package for easy multiprocessing, but faster than multiprocessing

Ultra fast asyncio event loop.

Trio – a friendly Python library for async concurrency and I/O

Simple package to enhance Python's concurrent.futures for memory efficiency