Position detection system of mobile robot in the warehouse enviroment

Last update: Nov 24, 2021

Overview

Autonomous-Forklift-System

🎯 About

An application that run the autonomous forklift paletization aglorithms. Projekt was created for Engineering Thesis. It was fully completed. The last release of this application is available in this repository. Alication uses image processing (OpenCV library) to detect the position of Acuco markers. Based on the calculated positions of the forklift, pallets and the storage place, the trajectories for the truck are generated (mainly using Voronoi graph and Dijsktra algorithm). Then the module responsible for communication with the robot controls it, so the robot collects choosed pallets and puts them one on top of the other in the designated warehouse.

🖥️ GUI

The interface was created using the PyQt5 and pyqtgraph libraries.The following elements are shown in the figure:

Menu bar - user can change the FPTV coefficient, communication port and baudrate.
Image transmission - user can choose between three views. The first view displays the real image from the camera. View 2 displays marked tags with their identifiers. The third view displays the trajectories for a robot and updates it with each move robot (fig. 3.22).
Entering identifiers - to start system, the user has to enter the robot ID and the pallet that the robot has deliver to the storage area.
Parameters - In the Module statuses table you can observe camera, communication and navigation module status. The Warehouse table shows the status graphically storage place. The Parameters table shows in sequence: camera number (by default 1), COM port (COM14 by default), baud rate (9600 by default), ratio FPTV (25 by default), fault information, phase one status, phase two status, and the number of steps remaining to complete the phase.
Start and progress button that starts the palletization process (Start). It is available only after the correct robot and pallette identifiers are entered

🔬 Tests

Correctness of generated paths - The correct route is considered to be a safe route to the destination. In the first phase the palette is the goal. The robot has to reach the pallet and then pick it up. In the second phase the goal is the storage area (warehouse). Result: Correct

Correctness of completing the route - A correctly covered route is characterized by a minimal error between generated route and the route taken by the robot. This is equivalent to maintenance safety assumptions for every traffic. Result: Correct

Correctness of multi-level storage - This test checks whether the palletiser is correctly stacking the pallets. It is necessary to consider the created system as a multi-level palletizing system. Result: Correct

🏁 Starting

# Clone this project
$ git clone https://github.com/KamilGos/Autonomous_Forklift_System

# Access
$ cd Autonomous_Forklift_System

# Run the project
$ sudo python3 main.py

📝 License

This project is under license from MIT. For more details, see the LICENSE file.

🧑‍💻 Author

Made with ❤️ by Kamil Goś

Releases(v1.0.0)

v1.0.0(Nov 15, 2021)

Initial release for public github
Source code(tar.gz)
Source code(zip)

MOT-Tracking-by-Detection-Pipeline - For Tracking-by-Detection format MOT (Multi Object Tracking), is it a framework that separates Detection and Tracking processes?

MOT-Tracking-by-Detection-Pipeline Tracking-by-Detection形式のMOT(Multi Object Trac

41 Nov 23, 2022

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Apache MXNet (incubating) for Deep Learning Apache MXNet is a deep learning framework designed for both efficiency and flexibility. It allows you to m

20.2k Jan 8, 2023

20.2k Jan 5, 2023

19.3k Feb 12, 2021

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

4.7k Dec 29, 2022

The UI as a mobile display for OP25

OP25 Mobile Control Head A 'remote' control head that interfaces with an OP25 instance. We take advantage of some data end-points left exposed for the

13 Dec 28, 2022

Apache MXNet (incubating) for Deep Learning Master Docs License Apache MXNet (incubating) is a deep learning framework designed for both efficiency an

29 Nov 16, 2022

Spatial Intention Maps for Multi-Agent Mobile Manipulation (ICRA 2021)

spatial-intention-maps This code release accompanies the following paper: Spatial Intention Maps for Multi-Agent Mobile Manipulation Jimmy Wu, Xingyua

70 Jan 2, 2023

Spatial Action Maps for Mobile Manipulation (RSS 2020)

spatial-action-maps Update: Please see our new spatial-intention-maps repository, which extends this work to multi-agent settings. It contains many ne

27 Nov 30, 2022

Position detection system of mobile robot in the warehouse enviroment

Related tags

Overview

Autonomous-Forklift-System

🎯 About

🖥️ GUI

🔬 Tests

🏁 Starting

📝 License

🧑‍💻 Author

You might also like...

MOT-Tracking-by-Detection-Pipeline - For Tracking-by-Detection format MOT (Multi Object Tracking), is it a framework that separates Detection and Tracking processes?

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

The UI as a mobile display for OP25

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Spatial Intention Maps for Multi-Agent Mobile Manipulation (ICRA 2021)

Spatial Action Maps for Mobile Manipulation (RSS 2020)

Releases(v1.0.0)

v1.0.0(Nov 15, 2021)

Owner

Kamil Goś

Single-stage Keypoint-based Category-level Object Pose Estimation from an RGB Image

Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch

CNN visualization tool in TensorFlow

PyTorch implementation of Soft-DTW: a Differentiable Loss Function for Time-Series in CUDA

Official Implementation of "LUNAR: Unifying Local Outlier Detection Methods via Graph Neural Networks"

A Python library for common tasks on 3D point clouds

A object detecting neural network powered by the yolo architecture and leveraging the PyTorch framework and associated libraries.

Tensorflow 2 implementation of our high quality frame interpolation neural network

Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models Benchmark and Efficient Evaluation

Simple tool to combine(merge) onnx models. Simple Network Combine Tool for ONNX.

v objective diffusion inference code for JAX.

AugLiChem - The augmentation library for chemical systems.

f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentation

Based on the given clinical dataset, Predict whether the patient having Heart Disease or Not having Heart Disease

Random Walk Graph Neural Networks

Code for ICCV 2021 paper "Distilling Holistic Knowledge with Graph Neural Networks"

Implement slightly different caffe-segnet in tensorflow

[ICCV21] Self-Calibrating Neural Radiance Fields

Official Pytorch Implementation of Adversarial Instance Augmentation for Building Change Detection in Remote Sensing Images.

Source code for the plant extraction workflow introduced in the paper “Agricultural Plant Cataloging and Establishment of a Data Framework from UAV-based Crop Images by Computer Vision”