Scribosermo STT Setup

Scribosermo is a LGPL licensed, open-source speech recognition engine to "Train fast Speech-to-Text networks in different languages".

Evaluation tests for German language suggest that it's currently one of the fastest and most accurate open-source STT systems.

This repository trys to offer build scripts to run and test Scribosermo on different platforms focussing on Raspberry Pi SBC. Ultimately the goal is to build a module for SEPIA STT-Server.

Test Scribosermo

The easiest way to get started is to build and use the Docker container:

Use the scripts inside the build folder. Tested on aarch64 and amd64 platforms.
Download a model. Check tests folder for more info and licenses.
Put the model inside a folder and share this folder with your Docker container, e.g. use a run flag similar to: -v my/model/folder:/home/admin/scribosermo-stt-setup/tests/model
Run the container. It will automatically call the Python test script testing_tflite.py.
NOTE: The Python test script is currently configured to use German. You may need to modify it if you change the model or language.

Build wheels on Debian 10 (the long way)

If you can't find matching Python wheel files for your build this might help to fill the missing parts:

Install required packages: apt-get update && apt-get install -y --no-install-recommends sudo git wget curl nano unzip zip procps build-essential cmake python3-pip python3-dev python3-setuptools python3-wheel python3-venv libsndfile1
Install Rust compiler (might be required): curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh and refresh terminal source $HOME/.cargo/env
Create and activate Python virtual env: mkdir -p install && cd install && python3 -m venv env && source env/bin/activate
Make sure pip is updated (tested v21.3.1): pip3 install --upgrade pip
Install part 1: pip3 install wheel setuptools setuptools_rust transformers tqdm librosa datasets jiwer
Install part 2: pip3 install --extra-index-url https://google-coral.github.io/py-repo/ tflite_runtime
Install part 3: pip3 install ds-ctcdecoder==0.10.0a3;
Create wheels as needed: pip3 wheel [package]

Credits

DanBmh - Development and maintaining of Scribosermo
Domcross - German STT evaluation, scripts and packages
SEPIA Framework - Open assistant and STT server stuff

Athena is an open-source implementation of end-to-end speech processing engine.

Athena is an open-source implementation of end-to-end speech processing engine. Our vision is to empower both industrial application and academic research on end-to-end models for speech processing. To make speech processing available to everyone, we're also releasing example implementation and recipe on some opensource dataset for various tasks (Automatic Speech Recognition, Speech Synthesis, Voice Conversion, Speaker Recognition, etc).

34 Sep 8, 2022

This repository contains data used in the NAACL 2021 Paper - Proteno: Text Normalization with Limited Data for Fast Deployment in Text to Speech Systems

Proteno This is the data release associated with the corresponding NAACL 2021 Paper - Proteno: Text Normalization with Limited Data for Fast Deploymen

37 Dec 4, 2022

Unofficial Implementation of Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration

Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration This repo contains only model Implementation of Zero-Shot Text-to-Speech for Text

33 Sep 22, 2022

glow-speak is a fast, local, neural text to speech system that uses eSpeak-ng as a text/phoneme front-end.

Glow-Speak glow-speak is a fast, local, neural text to speech system that uses eSpeak-ng as a text/phoneme front-end. Installation git clone https://g

8 Dec 25, 2022

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

⚠️ Checkout develop branch to see what is coming in pyannote.audio 2.0: a much smaller and cleaner codebase Python-first API (the good old pyannote-au

2.2k Jan 9, 2023

Speech Recognition for Uyghur using Speech transformer

Speech Recognition for Uyghur using Speech transformer Training: this model using CTC loss and Cross Entropy loss for training. Download pretrained mo

11 Nov 17, 2022

Text-Summarization-using-NLP - Text Summarization using NLP to fetch BBC News Article and summarize its text and also it includes custom article Summarization

Text-Summarization-using-NLP Text Summarization using NLP to fetch BBC News Arti

21 Aug 6, 2022

Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.

TextBlob: Simplified Text Processing Homepage: https://textblob.readthedocs.io/ TextBlob is a Python (2 and 3) library for processing textual data. It

8.4k Dec 26, 2022

7.5k Feb 17, 2021

Installation, test and evaluation of Scribosermo speech-to-text engine

Related tags

Overview

Scribosermo STT Setup

Test Scribosermo

Build wheels on Debian 10 (the long way)

Credits

You might also like...

Athena is an open-source implementation of end-to-end speech processing engine.

This repository contains data used in the NAACL 2021 Paper - Proteno: Text Normalization with Limited Data for Fast Deployment in Text to Speech Systems

Unofficial Implementation of Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration

glow-speak is a fast, local, neural text to speech system that uses eSpeak-ng as a text/phoneme front-end.

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

Speech Recognition for Uyghur using Speech transformer

Text-Summarization-using-NLP - Text Summarization using NLP to fetch BBC News Article and summarize its text and also it includes custom article Summarization

Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.

Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.

Releases(v0.0.1)

v0.0.1(Oct 31, 2021)

Required files/pre-built libraries to install Scribosermo

Owner

Florian Quirin

Visual Automata is a Python 3 library built as a wrapper for Caleb Evans' Automata library to add more visualization features.

An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)

Türkçe küfürlü içerikleri bulan bir yapay zeka kütüphanesi / An ML library for profanity detection in Turkish sentences

NLPIR tutorial: pretrain for IR. pre-train on raw textual corpus, fine-tune on MS MARCO Document Ranking

Neural text generators like the GPT models promise a general-purpose means of manipulating texts.

TweebankNLP - Pre-trained Tweet NLP Pipeline (NER, tokenization, lemmatization, POS tagging, dependency parsing) + Models + Tweebank-NER

PyTorch source code of NAACL 2019 paper "An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models"

fastai ulmfit - Pretraining the Language Model, Fine-Tuning and training a Classifier

CLIPfa: Connecting Farsi Text and Images

Simple, hackable offline speech to text - using the VOSK-API.

NLP library designed for reproducible experimentation management

Blender addon - Scrub timeline from viewport with a shortcut

lightweight, fast and robust columnar dataframe for data analytics with online update

TTS is a library for advanced Text-to-Speech generation.

Faster, modernized fork of the language identification tool langid.py

Binaural Speech Synthesis

Blazing fast language detection using fastText model

A design of MIDI language for music generation task, specifically for Natural Language Processing (NLP) models.

Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization

Fast, general, and tested differentiable structured prediction in PyTorch