Image and video quality assessment

Related tags

VideoCenseoQoE
Overview

CenseoQoE: 视觉感知画质评价框架

PRs Welcome

项目介绍

图像/视频在编解码、传输和显示等过程中难免引入不同类型/程度的失真导致图像质量下降。图像/视频质量评价(IVQA)的研究目标是希望模仿人类视觉感知系统, 通过算法评估图片/视频在终端用户的眼中画质主观体验的好坏,目前在视频编解码、画质增强、画质监控、推荐算法、竞品分析等领域有广泛的应用。

CenseoQoE 提供图像/视频画质评价算法模型训练到应用落地的完整方案,主要包括 CenseoQoE-AlgorithmCenseoQoE-SDK两部分。 CenseoQoE-Algorithm 是通用的画质评价算法模型的训练框架,CenseoQoE-SDK集成了针对多种业务场景训练好的画质评价模型,可直接对UGC视频、PGC视频、游戏视频等做无参考/有参考的画质评价,实现开箱即用。

为什么叫CenseoQoECenseo 在拉丁语中是我认为/我觉得的意思,与图像/视频画质体验评价领域的主观评测概念相符,QoE则是体验质量(Quality of Experience)。

主要特性

  • CenseoQoE-Algorithm 提供图像/视频画质评价算法模型训练的codebase,集成自研的模型以及业界开源的算法模型,支持无参考和有参考。此外,我们会公开不同业务场景下 (UGC视频、PGC视频、游戏视频、直播视频等)的预训练模型,用户可以利用这些预训练模型在自己的数据集进行微调优化。
  • CenseoQoE-SDK 集成了基于CenseoQoE-Algorithm在我们自研的数据集上训练得到的多个业务场景下的画质评价模型,全部使用c++实现,编译之后可直接 对UGC视频、PGC视频、游戏视频等做画质评价,实现开箱即用。

快速开始

  • 如果你想做模型的训练或是优化改进,请参见CenseoQoE-Algorithm
  • 如果你想快速使用CenseoQoE推出的画质评价工具/SDK,请参见CenseoQoE-SDK

Demo

以下是我们针对游戏视频训练的两个模型(resnet-based和shufflenet-based)和vmaf的两个模型(vmaf-default和vmaf-phone)在同一个视频上的质量分数对比。

our model vs vmaf

常见问题

请参考 FAQ 了解其他用户的常见问题。

许可

该项目使用的开源协议为 MIT

引用

@misc{wen2021strong,
      title={A strong baseline for image and video quality assessment}, 
      author={Shaoguo Wen and Junle Wang},
      year={2021},
      eprint={2111.07104},
      archivePrefix={arXiv},
      primaryClass={eess.IV}
}

参与贡献

我们非常欢迎用户对于 CenseoQoE 做出的任何贡献,可以参考 CONTRIBUTION.md 文件了解更多细节。

致谢

我们感谢所有为该项目提供建议、数据、模型、使用样例和新功能支持的贡献者,以及提供宝贵反馈的用户。

Owner
Tencent
Tencent
A Python media index

pyvideo https://pyvideo.org is simply an index of Python-related media records. The raw data being used here comes out of the pyvideo/data repo. Befor

pyvideo 235 Dec 24, 2022
This is an example of building a video Question-Answer system using Jina.

example-video-search This is an example of building a video Question-Answer system using Jina. The index data is subtitle files of YouTube videos. Aft

Jina AI 9 Oct 18, 2022
Streamlink is a CLI utility which pipes video streams from various services into a video player

Streamlink is a CLI utility which pipes video streams from various services into a video player

8.2k Dec 26, 2022
A Telegram bot to convert videos into x265/x264 format via ffmpeg.

Video Encoder Bot A Telegram bot to convert videos into x265/x264 format via ffmpeg. Configuration Add values in environment variables or add them in

Adnan Ahmad 82 Jan 03, 2023
Adblocker for movie subtitles.

SubAdBlock Adblocker for movie subtitles. Usage Place "main.py" and "config.conf" in directory with subtitles and run "main.py". It will automatically

Marko Živić 1 Jan 09, 2022
MoviePy is a Python library for video editing, can read and write all the most common audio and video formats

MoviePy is a Python library for video editing: cutting, concatenations, title insertions, video compositing (a.k.a. non-linear editing), video processing, and creation of custom effects. See the gall

10k Jan 08, 2023
A python program which converts images and video into excel spreadsheets.

image2excel A program which converts images and video into Excel spreadsheets. Usage examples can be found in examples Videos can take a long time to

Oscar Peace 2 Aug 09, 2021
DICexport is a GUI (PyQt5) to export digital image correlation videos

DIC Video Exporter DICexport is a GUI (PyQt5) to export digital image correlation videos. It offers the flexibility to choose a selected range of a vi

Chaoyi Zhu 0 Jun 23, 2022
Stream anime from kaa.si with python

kaa.si-cli Stream anime using MPV player from kaa.si with python

Muhammad Rovino Sanjaya 52 Dec 24, 2022
Help for manipulating the plex-media-server transcode on the raspberry pi

raspi-plex-transcode Help for manipulating the plex-media-server transcode on the raspberry pi Ensure hardware decoding works and your firmware is up

10 Sep 29, 2022
Spotify playlist video generator

This program creates a video version of your Spotify playlist by using the Spotify API and YouTube-dl.

0 Mar 03, 2022
Python script for extracting audio from video files and creating Mel spectrograms

video2spectrogram About This package is meant to automate the process of extracting audio files from videos and saving the plots computed from these a

Alexandros Stergiou 1 Oct 28, 2021
Add the dislike count back to my YouTube videos via a comment containing that information.

YouTube Dislikes Forrest Knight Python Version 3.0+ Only use if you know what the code actually does. I'm not responsible for your use of this code in

Forrest Knight 155 Dec 19, 2022
camKapture is an open source application that allows users to access their webcam device and take pictures or create videos.

camKapture is an open source application that allows users to access their webcam device and take pictures or create videos.

manoj 1 Jun 21, 2022
Youtube-dislikes-adder - Add dislikes to the description of your YouTube videos.

Add number of dislikes to the description of your YouTube videos. Number of dislikes are updated if you let this function as a bot.

fluks 1 Aug 23, 2022
Скрипт который выводит видео в консоль. Ничего лишнего)

video-to-ascii Скрипт который выводит видео в консоль. Ничего лишнего) Требования Минимальное разрешение экрана: 1280x720 Видео в качестве 360p 10-45f

Daniil Pisarev 155 Nov 28, 2022
Search a video semantically with AI.

Which Frame? Search a video semantically with AI. For example, try a natural language search query like "a person with sunglasses". You can also searc

David Chuan-En Lin 1 Nov 06, 2021
Jio TV Server - Watch TV right from your laptop

Jio-PyServer Jio TV - Python Server Watch TV right from your laptop! Requirements: Python 3.X Internet Access A Jio Account Known Issues: Channel Stre

Elvis Tony 11 Apr 05, 2022
Video processing routines for SciPy

scikit-video Video Processing SciKit BETA Video processing algorithms, including I/O, quality metrics, temporal filtering, motion/object detection, mo

Alex Izvorski 119 Dec 27, 2022
pyffstream - A CLI frontend for streaming over SRT and RTMP specializing in sending off files

pyffstream - A CLI frontend for streaming over SRT and RTMP specializing in sending off files

Gregory Beauregard 3 Mar 04, 2022