An open-source tool for visual and modular block programing in python

Last update: Jan 06, 2023

Related tags

Data Visualization PyFlow

Overview

PyFlow

PyFlow is an open-source tool for modular visual programing in python !

Although for now the tool is in Beta and features are coming in bit by bit, stay tuned for the first release soon !

Help the project !

Join our Discord to beta-test features, share your ideas or even contribute !

Features

Put your python code in small interconnected blocks
Export and Import your graphs and share them with other people in the new Interactive PYthon Graph format (.ipyg)
Chain your blocks to perform complex functions.

Installation

Make sure you have Python 3 installed. You can download it from here

Clone the current repo:

git clone https://github.com/MathisFederico/OpenCodeBlocks/

Install the dependencies

pip install -r requirements.txt

Run !

python -m opencodeblocks optional_path_to_ipyg

Contributing

If you are interested in contributing to the project, see CONTRIBUTING.md.

License

See LICENSE

Comments

Add ipynb conversion
This is a draft, many required features are missing. What is there

A basic converter which uses the default code block and fills it with the pieces of codes, and align them left to right

The load button now supports loading a ipynb file What is missing

Many crucial things (such as markdown and outputs) are ignored by the converter (see the TODOs in the python file)

There is not dedicated "load ipynb button" for now. It works with the load button when a .ipynb file is selected.

Unit tests might be required for this one, but are not yet present
opened by FabienRoger 11
:tada: Adds Visual Flow

https://user-images.githubusercontent.com/62465003/145698162-1afec762-46e0-4770-9be7-2a928c58af22.mp4

Pressing a run button will now highlight in green the graph traversal that is made to gather the blocks to run Running blocks are now highlighted in red

Closes #66
enhancement

opened by AlexandreSajus 5
Vertical structure

To help with lowering the barrier of entry between Jupyter and Pyflow, we could adopt a vertical structure where blocks are aligned top to bottom instead of left to right.

A good first step towards this would be having top and bottom sockets
enhancement

opened by AlexandreSajus 4
🛠️Execution Refactor & 🎉 Nested Nodes
A lot of new blocks have been added but they are not executable yet !

This pull request aims to:

Make the new blocks like slider executable

Polish the executing code

Fix some bugs

Introduce new node types

While this might seem like multiple features added at once, because they are all deeply intertwined, it makes sense to group them in the same branch. More specifically, we will try to fix:

#112

Tests to prevent #112 regressions

#94

Tests to prevent #94 regressions

#5
opened by vanyle 4
Add new shortcuts for block creations
In a Jupyter notebook, adding new blocks is easy. Just press "Shift+Enter" and it adds a new block after executing the current one. In OCB, for now, you have to right-click, new block, and link it with the previous one, which is cumbersome.

The new shortcuts which could be added:

Shift+ Arrow to add a new block linked to the current one in the direction of the arrow and launch the execution of the current cell

Shift+ Enter to add a new block linked to the current one to the right and launch the execution of the current cell

Control + Enter to execute the current cell

Something to insert a cell between two others (this is really slow with the current system)

enhancement
opened by FabienRoger 4
:tada: Add editing navigation using alt & escape
Adds:

Navigation can be trigger from inside editors using alt+arrow

Editing mode can be entered from navigation using alt

Selection & Focus can be cleared using escape
opened by MathisFederico 3
🎉 🎨 Add persistent colors

Add persistent colors to ease the user comprehension and let him remember what was run. Fixes #272 Refactored 'run_state' and 'has_been_run' using Enum for better maintenance.

opened by MathisFederico 3
stdout is not correctly rendered in some cases
import pandas as pd d = {'col1':[1,2],'col2':[3,4]} df = pd.DataFrame(data=d) df.describe()

On a jupyter notebook, the code above renders a pretty image:

This is not the case currently:
bug
opened by vanyle 3
Execution Flow
Executing a cell should trigger other cells depending of the graph.

Cells before should be run if they have not already or have been modified

Cells after should be run if the socket allows for it depending on socket flowtype (#47)

This should be sequentially at first, in a depth-first or breadth-first manner (this could be a user choice for both before and after cells).
enhancement
opened by MathisFederico 3

PyFlow crashes because undefined symbol: _ZdlPvm

Installation goes normally and without error. But try to run PyFlow and there is a message about an undefined symbol _ZdlPvm. What might the remedy be?

python3 -m pyflow
Traceback (most recent call last):
  File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/__main__.py", line 22, in <module>
    from pyflow.graphics.window import Window
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/graphics/window.py", line 22, in <module>
    from pyflow.graphics.widget import Widget
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/graphics/widget.py", line 11, in <module>
    from pyflow.scene import Scene
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/scene/__init__.py", line 6, in <module>
    from pyflow.scene.scene import Scene
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/scene/scene.py", line 17, in <module>
    from pyflow.blocks.block import Block
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/blocks/__init__.py", line 7, in <module>
    from pyflow.blocks.codeblock import CodeBlock
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/blocks/codeblock.py", line 15, in <module>
    from pyflow.blocks.pyeditor import PythonEditor
  File "/home/johnb/.local/lib/python3.9/site-packages/pyflow/blocks/pyeditor.py", line 18, in <module>
    from PyQt5.Qsci import QsciScintilla, QsciLexerPython
ImportError: /home/johnb/.local/lib/python3.9/site-packages/PyQt5/Qsci.abi3.so: undefined symbol: _ZdlPvm, version Qt_5

System info:

qmake --version
QMake version 3.1
Using Qt version 5.15.2 in /usr/lib/x86_64-linux-gnu

python3 --version
Python 3.9.7

cat /etc/lsb-release
DISTRIB_ID=Pop
DISTRIB_RELEASE=21.10
DISTRIB_CODENAME=impish
DISTRIB_DESCRIPTION="Pop!_OS 21.10"

qtdiag
Qt 5.15.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 11.2.0) on "xcb" 
OS: Pop!_OS 21.10 [linux version 5.16.11-76051611-generic]

Architecture: x86_64; features: SSE2 SSE3 SSSE3 SSE4.1 SSE4.2 AVX AVX2
<snip>

opened by johnblommers 2

Run right does not work: it executes itself multiple times

Steps to reproduce: Take the flow_test asset and add "counter += 1" in Cell 5 in the middle. Initialize the counter elsewhere. Run right the cell with the "counter += 1" Print what is in the counter elsewhere. It contains 4.

bug

opened by FabienRoger 2
Separate graphs should have different variables spaces

Graphs that are not connected together should work on separate kernels so that if the same variable name exists in both graphs, changing the variable in one graph should not change the variable in the other graph

For example:

This seems wrong
enhancement

opened by AlexandreSajus 1
Duplicating saves to clipboard permanently

Duplicating a block using Ctrl + D saves the block to clipboard permanently. Trying to Ctrl + C then Ctrl + V after duplicating will paste the duplicating block instead of the Ctrl + C one.

Duplicating should not save to clipboard and should not hinder copy pasting
bug

opened by AlexandreSajus 0
Dragging an edge on a block should highlight the block

During closed beta 2, a user complained about not getting feedback when dragging an edge onto a block.

He suggested that the block should be highlighted when dragging an edge over it to explain that the edge will connect to the block when dropped.

In this situation:

The block should be highlighted
enhancement

opened by AlexandreSajus 0

Releases(v1.0.0)

v1.0.0(Feb 24, 2022)
PyFlow - Release 1.0.0

First Full Release

We are happy to release the first full version of PyFlow by Bycelium ! Feel free to reach us on discord for feedback, suggestions, contribution or a simple chat !

What's Changed

:beetle: Fix block execution freeze by @AlexandreSajus in #138

:beetle: Fix zoom stuck by @FabienRoger in #145

:beetle: Fix socket missing when converting from .ipynb by @FabienRoger in #143

:beetle: Fix execution of complex ipynb by @AlexandreSajus in #147

:beetle: Deal with ipynb of different format by @FabienRoger in #221

:tada: Sort blocks when saving as ipynb by @FabienRoger in #144

:beetle: Paste exactly where the mouse is by @FabienRoger in #224

:tada: Restrict file loading to .ipyg and .ipynb by @FabienRoger in #223

:beetle: Fix click-selection bug by @FabienRoger in #226

🎉 Create a distinct clipboard for blocks by @FabienRoger in #229

🎉:art: Switch to vertical layout by @FabienRoger in #227

:tada: Add logging & improve CLI by @MathisFederico in #231

:tada: Add custom undo system by @FabienRoger in #118

:tada: Make execution flow ignore off-sockets by @FabienRoger in #255

🎉 Add socket on/off toggle by @FabienRoger in #254

:tada: Create a new add socket button by @FabienRoger in #249

:art: Make blocks output more visible by @FabienRoger in #257

:art: Highlight the add edge button on block hover by @FabienRoger in #258

:beetle: Removes kernel timeout by @AlexandreSajus in #259

☔ Add python 3.10 support by @MathisFederico in #262

:tada: Add interrupt execution on error by @AlexandreSajus in #265

🪲 Fix block removing crash by @FabienRoger in #267

:tada: Add button to create linked block by @AlexandreSajus in #266

:tada: Improve markdown editing by @FabienRoger in #269

:tada: Add new shortcuts by @AlexandreSajus in #264

🎉 Make shift+enter in editor run left by @FabienRoger in #270

:tada: Add prompt before exiting the program by @FabienRoger in #271

:beetle: Prevent crash when there is a loop by @FabienRoger in #279

🎉 🎨 Add persistent colors by @MathisFederico in #276

:beetle: Prevent checkpoint when the scene has not changed by @FabienRoger in #281

:art: Set exit font color to white by @AlexandreSajus in #285

:tada: Add zoom in and out shortcut by @FabienRoger in #286

:beetle: Fix Ctrl+z crash by @FabienRoger in #289

:tada: Add editing navigation using alt & escape by @MathisFederico in #287

:art: updated gifs and README by @AlexandreSajus in #290

Full Changelog: https://github.com/Bycelium/PyFlow/compare/v1.0.0-beta...v1.0.0
Source code(tar.gz)
Source code(zip)
v1.0.0-beta(Jan 8, 2022)
PyFlow - Release 1.0.0-beta

First Beta Release

We are happy to release the first beta version of PyFlow by Bycelium ! More is to come as we will have our features tested in the following weeks ! Feel free to reach us on discord for feedback, suggestions, contribution or a simple chat !

What's Changed

:tada: Add base node editor application inspired from this tutorials series by @MathisFederico

:tada: Bring selected blocks to the front. by @vanyle in https://github.com/Bycelium/PyFlow/pull/11

:memo: Write a CONTRIBUTING file with contributing guidelines by @vanyle in https://github.com/Bycelium/PyFlow/pull/13

:beetle: Fix the null pointer error issue when deleting a code block by @vanyle in https://github.com/Bycelium/PyFlow/pull/14

📝 Add docstrings to graphics classes by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/15

:tada: Add multiple windows handleling by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/18

:beetle: Fix cursor and resize by @vanyle in https://github.com/Bycelium/PyFlow/pull/29

:tada: Add select pasted items by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/30

☔ Integration tests by @vanyle in https://github.com/Bycelium/PyFlow/pull/31

:wrench: ☔ Refactor integration tests by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/34

:tada: :art: Syntax highlighting and Themes by @vanyle in https://github.com/Bycelium/PyFlow/pull/33

:tada: Add IPython kernel by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/17

:tada: Add IPython console by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/38

:memo: :art: better readme gif by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/39

✨ Autopep8, shorter lines, docstring and removed unnecessary function by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/40

📝 ☔ Add codacy workflow and total coverage badge by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/45

🔨 Sizes and widgets refactor by @vanyle in https://github.com/Bycelium/PyFlow/pull/41

:tada: :art: Adds ANSI color coding support in codeblocks by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/53

🎉 Add saves and loads codeblock output by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/55

:tada: Add separate threads for GUI and Kernel by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/58

:tada: Add socket flow type by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/59

:tada: New block creation by @vanyle in https://github.com/Bycelium/PyFlow/pull/60

:art: Increases output fontsize by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/69

🎉 Prevent bad autoscroll in PyEditor by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/73

:tada: Add arrow navigation from block to block by @vanyle in https://github.com/Bycelium/PyFlow/pull/74

:tada: 🔨 Improve autoscroll & Tests refactor by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/77

:beetle: Improve codeblock displays for tensorflow history by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/79

:tada: Add open example from command line by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/78

:beetle: Hide output panel without output by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/70

:tada: Editable titles and :wrench: Refactor of block widgets by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/81

Add move to global view by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/84

:memo: Add Discord link and beta disclaimer by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/87

:tada: Add support for new block types by @vanyle in https://github.com/Bycelium/PyFlow/pull/80

🎉 Add sockets on codeblocks by default by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/89

:tada: Functional flow execution by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/98

:tada: Add zoom on blocks pressing spacebar by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/91

🎉 Improve arrow navigation by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/99

:beetle: Fix splitter position saving by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/101

:beetle: Add html output support by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/102

:beetle: Add indentation in pyeditor by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/104

🪲 Fix 'Save As' bug by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/107

:beetle: Fix saving bug by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/105

:tada: Adds the ability to cancel execution by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/103

:sparkles: switched autopep8 to black by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/115

:tada: Add notebook-pygraph conversion by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/86

🪲 Fix default fields handling by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/96

:umbrella: Add execution flow testing by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/116

:sparkles: Apply black formatter to everything by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/120

:memo: Improve CONTRIBUTING.md by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/121

:umbrella: Add unit tests to ipynb conversion by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/117

🛠️ Execution Refactor & 🎉 Nested Nodes by @vanyle in https://github.com/Bycelium/PyFlow/pull/113

:tada: Add Visual Flow by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/114

:beetle: Fix editing a block resets output's states by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/127

🪲 Fix bug related to ipynb conversion by @FabienRoger in https://github.com/Bycelium/PyFlow/pull/129

📝 🎨 Adds gifs describing each main feature on README.md by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/130

:beetle: fixes run_right without output by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/134

🔨 Huge refactor before release by @AlexandreSajus in https://github.com/Bycelium/PyFlow/pull/133

:tada: Released the beta 1.0.0 by @MathisFederico in https://github.com/Bycelium/PyFlow/pull/135

New Contributors

@vanyle made their first contribution in https://github.com/Bycelium/PyFlow/pull/10

@AlexandreSajus made their first contribution in https://github.com/Bycelium/PyFlow/pull/17

@FabienRoger made their first contribution in https://github.com/Bycelium/PyFlow/pull/84

Source code(tar.gz)
Source code(zip)

Owner

GitHub Repository

Plot toolbox based on Matplotlib, simple and elegant.

Elegant-Plot Plot toolbox based on Matplotlib, simple and elegant. 绘制效果绘制过程数据准备每种图标类型的目录下有data.csv文件，依据样例数据填入自己的数据。

3 Jul 15, 2022

web application for flight log analysis & review

Flight Review This is a web application for flight log analysis. It allows users to upload ULog flight logs, and analyze them through the browser. It

145 Dec 20, 2022

Make your BSC transaction simple.

bsc_trade_history Make your BSC transaction simple. 中文ReadMe Background: inspired by debank ,Practice my hands on this small project Blog:Crypto-BscTr

7 Jul 06, 2022

MPL Plotter is a Matplotlib based Python plotting library built with the goal of delivering publication-quality plots concisely.

162 Nov 11, 2022

CONTRIBUTIONS ONLY: Voluptuous, despite the name, is a Python data validation library.

CONTRIBUTIONS ONLY What does this mean? I do not have time to fix issues myself. The only way fixes or new features will be added is by people submitt

1.8k Dec 31, 2022

A toolkit to generate MR sequence diagrams

mrsd: a toolkit to generate MR sequence diagrams mrsd is a Python toolkit to generate MR sequence diagrams, as shown below for the basic FLASH sequenc

3 Dec 25, 2021

nptsne is a numpy compatible python binary package that offers a number of APIs for fast tSNE calculation.

nptsne nptsne is a numpy compatible python binary package that offers a number of APIs for fast tSNE calculation and HSNE modelling. For more detail s

29 Jul 05, 2022

Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python

Petrel Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python. NOTE: The base Storm package provides storm.py, which

247 Dec 18, 2021

paintable GitHub contribute table

githeart paintable github contribute table how to use: Functions key color select 1,2,3,4,5 clear c drawing mode mode on turn off e print paint matrix

27 Nov 24, 2022

A tool for creating Toontown-style nametags in Panda3D

Toontown-Nametag Toontown-Nametag is a tool for creating Toontown Online/Toontown Rewritten-style nametags in Panda3D. It contains a function, createN

2 Dec 23, 2021

Squidpy is a tool for the analysis and visualization of spatial molecular data.

Squidpy is a tool for the analysis and visualization of spatial molecular data. It builds on top of scanpy and anndata, from which it inherits modularity and scalability. It provides analysis tools t

251 Dec 19, 2022

Visualizations of linear algebra algorithms for people who want a deep understanding

Visualising algorithms on symmetric matrices Examples QR algorithm and LR algorithm Here, we have a GIF animation of an interactive visualisation of t

3 May 05, 2022

Set of matplotlib operations that are not trivial

Matplotlib Snippets This repository contains a set of matplotlib operations that are not trivial. Histograms Histogram with bins adapted to log scale

1 Nov 15, 2021

matplotlib: plotting with Python

Matplotlib is a comprehensive library for creating static, animated, and interactive visualizations in Python. Check out our home page for more inform

16.7k Jan 08, 2023

Apache Superset is a Data Visualization and Data Exploration Platform

Superset A modern, enterprise-ready business intelligence web application. Why Superset? | Supported Databases | Installation and Configuration | Rele

50k Jan 06, 2023

Automatically Visualize any dataset, any size with a single line of code. Created by Ram Seshadri. Collaborators Welcome. Permission Granted upon Request.

AutoViz Automatically Visualize any dataset, any size with a single line of code. AutoViz performs automatic visualization of any dataset with one lin

1k Jan 02, 2023