Unified Distributed Execution

Last update: Dec 25, 2022

Related tags

Overview

Unified Distributed Execution

The framework supports multiple execution backends: Ray, Dask, MPI and MultiProcessing.

To run tests you need to install pytest package:

pip install pytest

Run tests using command:

pytest unidist/test/

For unidist MPI backend follow additional instructions.

Comments

FIX-#106: Change directories to be checked by linters
Signed-off-by: Igoshev, Yaroslav [email protected]

What do these changes do?

[x] passes flake8 unidist/

[x] passes black unidist/

[x] signed commit with git commit -s

[x] Resolves #106

[x] tests passing

[x] module layout described at docs/developer/architecture.rst is up-to-date
opened by YarShev 11
FIX-#99: Upgrade min python version
Signed-off-by: Igoshev, Yaroslav [email protected]

What do these changes do?

[x] passes flake8 .

[x] passes black .

[x] signed commit with git commit -s

[x] Resolves #99

[x] tests passing

[x] module layout described at docs/developer/architecture.rst is up-to-date
opened by YarShev 9
FEAT-#2: Add CLI interface for `unidist`
PR adds CLI interface for unidist. The examples of usage can be received:

user$: python unidist/cli -h

or if package is installed

user$: unidist --help

Signed-off-by: Alexey Prutskov [email protected]
opened by prutskov 8
FIX-#91: Add readthedocs config file
Signed-off-by: Alexey Prutskov [email protected]

What do these changes do?

PR adds .readthedocs.yaml configuration file. Only one difference from the main doc building flow is using python3.8 instead of using 3.7 by default. In case of using python3.7 we have documentation built failed because MPI backend in this case requires optional pickle5 package. Updating python version to 3.8 is a way to fix this.

[x] passes flake8 .

[x] passes black .

[x] signed commit with git commit -s

[x] Resolves #91

[ ] tests added and passing

[ ] module layout described at docs/developer/architecture.rst is up-to-date
opened by prutskov 7
FIX-#104: Add testing py3.9 in CI
Signed-off-by: Alexey Prutskov [email protected]

What do these changes do?

[x] passes flake8 .

[x] passes black .

[x] signed commit with git commit -s

[x] Resolves #104

[x] tests added and passing

[ ] module layout described at docs/developer/architecture.rst is up-to-date
opened by prutskov 6
FEAT-#54 Add unidist main logo image
What do these changes do?

Add logo to the README

[ ] passes flake8 .

[ ] passes black .

[ ] signed commit with git commit -s

[x] Resolves #54

[ ] tests added and passing

[ ] module layout described at docs/developer/architecture.rst is up-to-date

documentation 📜
opened by no-ponomarev 6
DOCS-#88: Update main/getting_started pages of rst docs
Signed-off-by: Alexey Prutskov [email protected]

What do these changes do?

[x] passes flake8 .

[x] passes black .

[x] signed commit with git commit -s

[x] Resolves #88

[x] tests passing

[ ] module layout described at docs/developer/architecture.rst is up-to-date
opened by prutskov 6

`mpi` backend can't start on Windows due to access violation

Unidist can't start mpi backend on Windows with the next exception:

Log

C:\Users\aprutsko\repositories\unidist>python unidist\cli -m pytest unidist\test\test_general.py -b mpi
Windows fatal exception: access violation

Current thread 0x00005c44 (most recent call first):
  File "<frozen importlib._bootstrap>", line 219 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 1174 in exec_module
  File "<frozen importlib._bootstrap>", line 671 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 975 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 991 in _find_and_load
  File "<frozen importlib._bootstrap>", line 219 in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1042 in _handle_fromlist
  File "C:\Users\aprutsko\repositories\unidist\unidist\core\backends\mpi\core\communication.py", line 18 in <module>
  File "<frozen importlib._bootstrap>", line 219 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 843 in exec_module
  File "<frozen importlib._bootstrap>", line 671 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 975 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 991 in _find_and_load
  File "C:\Users\aprutsko\repositories\unidist\unidist\core\backends\mpi\core\executor.py", line 13 in <module>
  File "<frozen importlib._bootstrap>", line 219 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 843 in exec_module
  File "<frozen importlib._bootstrap>", line 671 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 975 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 991 in _find_and_load
  File "C:\Users\aprutsko\repositories\unidist\unidist\core\backends\mpi\core\__init__.py", line 5 in <module>
  File "<frozen importlib._bootstrap>", line 219 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 843 in exec_module
  File "<frozen importlib._bootstrap>", line 671 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 975 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 991 in _find_and_load
  File "C:\Users\aprutsko\repositories\unidist\unidist\core\backends\mpi\backend.py", line 10 in <module>
  File "<frozen importlib._bootstrap>", line 219 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 843 in exec_module
  File "<frozen importlib._bootstrap>", line 671 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 975 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 991 in _find_and_load
  File "C:\Users\aprutsko\repositories\unidist\unidist\core\base\utils.py", line 88 in get_backend_proxy
  File "C:\Users\aprutsko\repositories\unidist\unidist\api.py", line 34 in make_decorator
  File "C:\Users\aprutsko\repositories\unidist\unidist\api.py", line 118 in remote
  File "C:\Users\aprutsko\repositories\unidist\unidist\test\utils.py", line 40 in <module>
  File "<frozen importlib._bootstrap>", line 219 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 843 in exec_module
  File "<frozen importlib._bootstrap>", line 671 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 975 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 991 in _find_and_load
  File "C:\Users\aprutsko\repositories\unidist\unidist\test\test_general.py", line 10 in <module>
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\assertion\rewrite.py", line 170 in exec_module
  File "<frozen importlib._bootstrap>", line 671 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 975 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 991 in _find_and_load
  File "<frozen importlib._bootstrap>", line 1014 in _gcd_import
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\importlib\__init__.py", line 127 in import_module
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\pathlib.py", line 524 in import_path
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\python.py", line 578 in _importtestmodule
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\python.py", line 500 in _getobj
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\python.py", line 291 in obj
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\python.py", line 516 in _inject_setup_module_fixture
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\python.py", line 503 in collect
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\runner.py", line 341 in <lambda>
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\runner.py", line 311 in from_call
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\runner.py", line 341 in pytest_make_collect_report
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_callers.py", line 39 in _multicall
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_manager.py", line 80 in _hookexec
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_hooks.py", line 265 in __call__
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\runner.py", line 458 in collect_one_node
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\main.py", line 808 in genitems
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\main.py", line 634 in perform_collect
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\main.py", line 333 in pytest_collection
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_callers.py", line 39 in _multicall
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_manager.py", line 80 in _hookexec
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_hooks.py", line 265 in __call__
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\main.py", line 322 in _main
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\main.py", line 269 in wrap_session
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\main.py", line 316 in pytest_cmdline_main
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_callers.py", line 39 in _multicall
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_manager.py", line 80 in _hookexec
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pluggy\_hooks.py", line 265 in __call__
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\config\__init__.py", line 162 in main
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\_pytest\config\__init__.py", line 185 in console_main
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\site-packages\pytest\__main__.py", line 5 in <module>
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\runpy.py", line 87 in _run_code
  File "C:\Users\aprutsko\.conda\envs\unidist\lib\runpy.py", line 194 in _run_module_as_main

===================================================================================

bug 🦗 P1

opened by prutskov 6

FIX-#36: Serialization caches.

Performance numbers

plasticc: | | I_MPI 112 previous | I_MPI 112 | MPICH 112 | |----------|--------------------|-----------|-----------| | read_csv | 187,14 | 185.85539 | | | t_etl | 735,44 | 380.46509 | |

ny_taxi: | | I_MPI 112 previous | I_MPI 112 | MPICH 112 | |----------|--------------------|-----------|-----------| | read_csv | 289,68 | 238.94134 | | | Q1 | 1,84 | 1.09677 | | | Q2 | 52,93 | 50.96434 | | | Q3 | 12,20 | 4.78096 | | | Q4 | 7,33 | 5.09975 | |

census: | | I_MPI 112 previous | I_MPI 112 | MPICH 112 | |----------|--------------------|-----------|-----------| | read_csv | 7,73 | 6.54384 | | | t_etl | 103,75 | 81.01938 | |

opened by no-ponomarev 5
FIX-#13: Busy wait MPI receive to remove unidist.get contention problem

Modin plasticc benchmark reveals heavy contention problem when using all CPU cores and MPI backend. One heavy worker task contents with unidist.get receive operation, which previously never went to sleep.

opened by no-ponomarev 5
FIX-#130: Make unidist be pure Python
Signed-off-by: Igoshev, Yaroslav [email protected]

What do these changes do?

[x] passes flake8 .

[x] passes black .

[x] signed commit with git commit -s

[x] Resolves #130

[x] tests passing

[x] module layout described at docs/developer/architecture.rst is up-to-date
opened by YarShev 4
FIX-#219: Update min Ray version to 1.13.0
Signed-off-by: Igoshev, Iaroslav [email protected]

What do these changes do?

[x] passes flake8 .

[x] passes black .

[x] signed commit with git commit -s

[x] Resolves #219

[x] tests passing

[x] module layout described at docs/developer/architecture.rst is up-to-date
opened by YarShev 0
FEAT-#0000: Add new implementation of actors for multiprocessing
What do these changes do?

[ ] passes flake8 .

[ ] passes black .

[ ] signed commit with git commit -s

[ ] Resolves #?

[ ] tests added and passing

[ ] module layout described at docs/developer/architecture.rst is up-to-date
opened by prutskov 0
[MPI] Shared object storage performance research
Look at benefits and possible data transfer protocol problems for MPI backend if we use shared object storage for each node.

[ ] Need to find scalable representative benchmark for this.

performance 🚀 P1
opened by no-ponomarev 0
Add documentation on execution flows of unidist with different backends
We should add sections/pages on execution flows of unidist with different backends:

unidist_on_ray

unidist_on_dask

unidist_on_mpi

unidist_on_multiprocessing

unidist_on_python

documentation 📜 P2 Epic
opened by YarShev 0

Releases(0.2.1)

0.2.1(Nov 22, 2022)
This release contains multiple important bugfixes for MPI backend, which makes it be more functional and stable.

Key Features and Updates

Stability and Bugfixes

FIX-#170: Fix serialization/deserialization for Ray actors (#171)

FIX-#172: Fix serialization/deserialization for Dask actors (#173)

FIX-#174: Fix serialization/deserialization for MPI actors (#177)

FIX-#179: Handle None return values correctly on MPI backend (#180)

FIX-#175: FIX-#178: Fix nested remote calls of remote tasks and actor methods (#176)

FIX-#187: Make Data_ID unique for different workers on MPI backend (#188)

FIX-#183: Fix serialization of dict_keys for MPI backend (#184)

FEAT-#185: Add communication logging (#186)

FIX-#189: Fix Actor scheduling (#190)

FIX-#191: Fix pendinq response after blocking GET request (#192)

FIX-#195: Fix serialization for pandas and numpy objects (#196)

FIX-#193: Fix actor async execution (#194)

FIX-#197: Initialize a backend when doing unidist.put (#198)

Update testing suite

TEST-#181: Added async actor tests (#182)

Contributors

@YarShev @Retribution98
Source code(tar.gz)
Source code(zip)
0.2.0(Sep 28, 2022)
This release adds support for the dynamic spawning of MPI worker processes, contains significant refactoring of MPI backend, cut off unidist CLI, includes important updates for documentation and a bunch of bugfixes.

Key Features and Updates

Stability and Bugfixes

FIX-https://github.com/modin-project/unidist/issues/130: Make unidist be pure Python (https://github.com/modin-project/unidist/pull/131)

FIX-https://github.com/modin-project/unidist/issues/133: Add support of running mpi backend via CLI on Windows (https://github.com/modin-project/unidist/pull/134)

FIX-https://github.com/modin-project/unidist/issues/69: Pin min msgpack version (https://github.com/modin-project/unidist/pull/135)

FIX-https://github.com/modin-project/unidist/issues/124: Set max_retries=0 for Ray backend (https://github.com/modin-project/unidist/pull/136)

FIX-https://github.com/modin-project/unidist/issues/142: Fix flake8 CI fail (https://github.com/modin-project/unidist/pull/143)

FIX-https://github.com/modin-project/unidist/issues/145: Synchronize Ray with latest changes (https://github.com/modin-project/unidist/pull/146)

FIX-https://github.com/modin-project/unidist/issues/137: Set threads_per_worker=1 for local Dask cluster (https://github.com/modin-project/unidist/pull/151)

FIX-https://github.com/modin-project/unidist/issues/152: Clean up MPI backend (https://github.com/modin-project/unidist/pull/153)

FIX-https://github.com/modin-project/unidist/issues/161: Propagate Backend.put('mpi') to MPI workers (https://github.com/modin-project/unidist/pull/162)

FIX-https://github.com/modin-project/unidist/issues/163: Fix unwrapping object refs and data IDs (https://github.com/modin-project/unidist/pull/164)

FIX-https://github.com/modin-project/unidist/issues/167: Set lowest bound for Ray versions (https://github.com/modin-project/unidist/pull/168)

New Features

FEAT-https://github.com/modin-project/unidist/issues/3: Add cluster_resources in API (https://github.com/modin-project/unidist/pull/35)

FEAT-https://github.com/modin-project/unidist/issues/139; REFACTOR-https://github.com/modin-project/unidist/issues/100: Implement the spawning of MPI processes dynamically (https://github.com/modin-project/unidist/pull/144)

FEAT-https://github.com/modin-project/unidist/issues/159: Add support for Async Actors on MPI backend (https://github.com/modin-project/unidist/pull/160)

FEAT-https://github.com/modin-project/unidist/issues/165: Add is_initialized feature to unidist API (https://github.com/modin-project/unidist/pull/166)

Refactor Codebase

REFACTOR-https://github.com/modin-project/unidist/issues/149: Cut off unidist CLI (https://github.com/modin-project/unidist/pull/150)

Documentation improvements

DOCS-https://github.com/modin-project/unidist/issues/128: Update installation section in docs (https://github.com/modin-project/unidist/pull/132)

DOCS-https://github.com/modin-project/unidist/issues/85: Add docs on running unidist with different backends (https://github.com/modin-project/unidist/pull/140)

DOCS-https://github.com/modin-project/unidist/issues/147: Update docs to be in line with the code base (https://github.com/modin-project/unidist/pull/148)

DOCS-https://github.com/modin-project/unidist/issues/154: Make documentation fail on warning (https://github.com/modin-project/unidist/pull/155)

DOCS-https://github.com/modin-project/unidist/issues/157: Set fail_on_warning: false (https://github.com/modin-project/unidist/pull/158)

Contributors

@YarShev, @prutskov, @no-ponomarev
Source code(tar.gz)
Source code(zip)
0.1.0(Feb 1, 2022)
This is the first release of undist, which includes support for different execution backends such as Ray, MPI, Dask, Python Multiprocessing, as well as a sequential Python backend for debugging. This release contains significant changes and upgrades to codebase, unidist's documentation, and some bugfixes.

Key Features and Updates

Initial changes

initial commit e9711d488f575b3ce09d9ef449f5b5b431b8bd6f

Stability and bugfixes

FIX-#13: Add busy wait mpi recv to remove unidist.get contention problem

TEST-#20: Add linters CI (#19)

FEAT-#4: Add configs for unidist behavior tuning (#21)

FEAT-#38: Add configs for Dask cluster setup (#39)

FIX-#45: Add What do these changes do section in PRs description (#46)

FIX-#29: Throw a user-friendly error message in case pickle5 is not installed (#31)

FIX-#25: Throw a user-friendly error message in case mpi4py is not installed (#32)

FEAT-#47: Add BackendName namespace class to use instead of strings (#48)

FIX-#49: Add check on entry in Parameter.choices (#50)

FIX-#51: Use lower-case for str TypeDescriptor (#52)

FEAT-#2: Add CLI interface for unidist (#14)

FIX-#58: Add exit status when run from CLI (#59)

FEAT-#62: Add ValueSource enum to check source of value in Parameter (#63)

FIX-#60: Align default value of REDIS_PASSWORD with Ray (#61)

TEST-#24: Add tests run to CI (#56)

FIX-#76: Rename UNIDIST_OBJECT_STORE_MEMORY to (#77)

FIX-#71: Fix for detecting compatible types for out-of-band serialization (#74)

FEAT-#96: Add python-versioneer to get exact unidist version (#105)

FIX-#109: Fix test_get_ip for Ray backend (#110)

FIX-#104: Add testing py3.9 in CI (#112)

FIX-#118: Choose dependencies for pip install unidist[all] based on platform (#119)

FIX-#79: Update copyright 2021 to 2021-2022 (#80)

Performance enhancements

FIX-#36: Use data serialization caches to improve performance for MPI backend (#53)

Refactor Codebase

FIX-#16: Apply black to all project (#17)

FIX-#97: Remove readme file for MPI backend (#98)

Dependencies

FIX-#22: Add dependencies for development and packaging (#23)

DOCS-#7: Add deps for building docs (#28)

FIX-#33: Add black and flake8 to env files (#34)

FIX-#40: Get rid of pandas dependency for Ray backend (#42)

FIX-#43: Add mpi4py to pip distribution dependencies (#44)

FIX-#41: Remove Pandas package reference (#57)

FIX-#67: Replace mpi4py to mpi4py-mpich in pip dependencies (#68)

FIX-#99: Upgrade min python version (#103)

FIX-#121: Downgrade min supported python version to 3.7.1 (#123)

Documentation improvements

DOCS-#5: Add a contributing page for unidist (#82)

DOCS-#73: Add documentation page on CLI usage (#83)

DOCS-#37: Add rst documentation for unidist.config (#78)

DOCS-#6: Update and extend readme.md (#87)

FIX-#91: Add readthedocs config file (#92)

DOCS-#81: Update High-Level Execution View section (#90)

FIX-#94: Change docs copyright statement to Modin Authors (#95)

DOCS-#88: Update main/getting_started pages of rst docs (#93)

FEAT-#54 Add unidist main logo image (#108)

FIX-#111: Fix build warning for communication module (#113)

FIX-#114: Change readthedocs icon format (#115)

FIX-#116: Add PyPI badge on README.md (#117)

FIX-#120: Change unidist logo path to absolute (#122)

Contributors

@YarShev, @prutskov, @no-ponomarev
Source code(tar.gz)
Source code(zip)

Owner

GitHub Repository

sfgp is a package that aggregates individual scripts and notebooks, primarily written for the basic analysis tasks of genetics and pharmacogenomics data.

1 Mar 31, 2022

Using graph_nets for pion classification and energy regression. Contributions from LLNL and LBNL

nbdev template Use this template to more easily create your nbdev project. If you are using an older version of this template, and want to upgrade to

3 Nov 23, 2022

Interactivity Lab: Household Pulse Explorable

Interactivity Lab: Household Pulse Explorable Goal: Build an interactive application that incorporates fundamental Streamlit components to offer a cur

1 Feb 10, 2022

A sage package for working with circular genomes represented by signed or unsigned permutations

Circular genome tools (cgt) A sage package for working with circular genomes represented by signed or unsigned permutations. It includes tools for con

1 Mar 10, 2022

Feature engineering library that helps you keep track of feature dependencies, documentation and schema

28 May 31, 2022

Open source tools to allow working with ESP devices in the browser

ESP Web Tools Allow flashing ESPHome or other ESP-based firmwares via the browser. Will automatically detect the board type and select a supported fir

195 Dec 31, 2022

The purpose of this code base is to add a specified signal-to-noise ratio noise from MUSAN dataset to a pure speech signal and to generate far-field speech data using room impulse response data from BUT [email protected] Reverb Database.

Add_noise_and_rir_to_speech The purpose of this code base is to add a specified signal-to-noise ratio noise from MUSAN dataset to a pure speech signal

7 Oct 30, 2022

Demo code for "Logs in distributed systems" webinar

Hexlet Logs Demo Пререквизиты docker-compose python3 Учетка в DataDog Базовое понимание, что такое логи (можно почитать гайд

1 Dec 01, 2021

Supply Chain will be a SAAS platfom to provide e-logistic facilites with most optimal

Shipp It Welcome To Supply Chain App [ Shipp It ] In "Shipp It" we are creating a full solution[web+app] for a entire supply chain from receiving orde

25 Dec 26, 2022

SimCSE在中文任务上的简单实验

SimCSE 中文测试 SimCSE在常见中文数据集上的测试，包含ATEC、BQ、LCQMC、PAWSX、STS-B共5个任务。介绍博客：https://kexue.fm/archives/8348 论文：《SimCSE: Simple Contrastive Learning of Sente

504 Jan 04, 2023

A one place destination to check whatever is trending on the top social and news websites at present.

UpTrend A one place destination to check whatever is trending on the top social and news websites at present. Explore the docs » View Demo · Report Bu

10 Oct 03, 2021

Demodulate and error correct FIS-B and ADS-B signals on 978 MHz.

FIS-B 978 ('fisb-978') is a set of programs that demodulates and error corrects FIS-B (Flight Information System - Broadcast) and ADS-B (Automatic Dep

2 Nov 15, 2022

Example applications, dashboards, scripts, notebooks, and other utilities built using Polygon.io

Polygon.io Examples Example applications, dashboards, scripts, notebooks, and other utilities built using Polygon.io. Examples Preview Name Type Langu

4 Jun 01, 2022

Click2call for asterisk with python

Click2call para Asterisk com Python Este projeto disponibiliza uma API construíd

1 Jan 17, 2022

Control your gtps with gtps-tools!

Note Please give credit to me! Do not try to sell this app, because this app is 100% open source! Do not try to reupload and rename the creator app! S

6 Feb 16, 2022

Python library for creating and parsing HSReplay XML files

python-hsreplay A python module for HSReplay support. https://hearthsim.info/hsreplay/ Installation The library is available on PyPI. pip install hsre

45 Mar 28, 2022

🦠 A simple and fast (< 200ms) API for tracking the global coronavirus (COVID-19, SARS-CoV-2) outbreak.

🦠 A simple and fast ( 200ms) API for tracking the global coronavirus (COVID-19, SARS-CoV-2) outbreak. It's written in python using the 🔥 FastAPI framework. Supports multiple sources!

1.6k Jan 04, 2023

Basit bir cc generator'ü.

Basit bir cc generator'ü. Setup What To Do; Python Installation We install python from CLICK Generator Board After installing the file and python, we

7 Jan 09, 2022

An alternative site to emplea.do due to inconsistent service of the app.

feline a agile and fast alternative to emplea.do License: MIT Settings Moved to settings. Basic Commands Setting Up Your Users To create a normal user

8 Nov 10, 2021

Final project in KAIST AI class

mmodal_mixer MLP-Mixer based Multi-modal image-text retrieval Image: Original image is cropped with 16 x 16 patch size without overlap. Then, it is re

5 May 30, 2022

Unified Distributed Execution

Related tags

Overview

Unified Distributed Execution

Comments

What do these changes do?

What do these changes do?

What do these changes do?

What do these changes do?

What do these changes do?

What do these changes do?

Performance numbers

What do these changes do?

What do these changes do?

What do these changes do?

Releases(0.2.1)

0.2.1(Nov 22, 2022)

Key Features and Updates

Contributors

0.2.0(Sep 28, 2022)

Key Features and Updates

Contributors

0.1.0(Feb 1, 2022)

Key Features and Updates

Contributors

Owner

sfgp is a package that aggregates individual scripts and notebooks, primarily written for the basic analysis tasks of genetics and pharmacogenomics data.

Using graph_nets for pion classification and energy regression. Contributions from LLNL and LBNL

Interactivity Lab: Household Pulse Explorable

A sage package for working with circular genomes represented by signed or unsigned permutations

Feature engineering library that helps you keep track of feature dependencies, documentation and schema

Open source tools to allow working with ESP devices in the browser

The purpose of this code base is to add a specified signal-to-noise ratio noise from MUSAN dataset to a pure speech signal and to generate far-field speech data using room impulse response data from BUT [email protected] Reverb Database.

Demo code for "Logs in distributed systems" webinar

Supply Chain will be a SAAS platfom to provide e-logistic facilites with most optimal

SimCSE在中文任务上的简单实验

A one place destination to check whatever is trending on the top social and news websites at present.

Demodulate and error correct FIS-B and ADS-B signals on 978 MHz.

Example applications, dashboards, scripts, notebooks, and other utilities built using Polygon.io

Click2call for asterisk with python

Control your gtps with gtps-tools!

Python library for creating and parsing HSReplay XML files

🦠 A simple and fast (< 200ms) API for tracking the global coronavirus (COVID-19, SARS-CoV-2) outbreak.

Basit bir cc generator'ü.

An alternative site to emplea.do due to inconsistent service of the app.

Final project in KAIST AI class