FaceAPI: AI-powered Face Detection & Rotation Tracking, Face Description & Recognition, Age & Gender & Emotion Prediction for Browser and NodeJS using TensorFlow/JS

Overview

Git Version NPM Version Last Commit License GitHub Status Checks Vulnerabilities

FaceAPI

AI-powered Face Detection & Rotation Tracking, Face Description & Recognition, Age & Gender & Emotion Prediction for Browser and NodeJS using TensorFlow/JS


Live Demo: https://vladmandic.github.io/face-api/demo/webcam.html


Additional Documentation




Examples


Browser

Browser example that uses static images and showcases both models
as well as all of the extensions is included in /demo/index.html
Example can be accessed directly using Git pages using URL:
https://vladmandic.github.io/face-api/demo/index.html

Browser example that uses live webcam is included in /demo/webcam.html
Example can be accessed directly using Git pages using URL:
https://vladmandic.github.io/face-api/demo/webcam.html


Demo using FaceAPI to process images
Note: Photos shown below are taken by me

screenshot

Demo using FaceAPI to process live webcam

screenshot


NodeJS

Three NodeJS examples are:

  • /demo/node.js:
    Regular usage of FaceAPI from NodeJS
    Using TFJS native methods to load images without external dependencies
  • /demo/node-canvas.js:
    Regular usage of FaceAPI from NodeJS
    Using external canvas module to load images
    Which also allows for image drawing and saving inside NodeJS environment
  • /demo/node-multiprocess.js:
    Multiprocessing showcase that uses pool of worker processes
    (node-multiprocess-worker.js)
    Main starts fixed pool of worker processes with each worker having
    it's instance of FaceAPI
    Workers communicate with main when they are ready and main dispaches
    job to each ready worker until job queue is empty
2021-03-14 08:42:03 INFO:  @vladmandic/face-api version 1.0.2
2021-03-14 08:42:03 INFO:  User: vlado Platform: linux Arch: x64 Node: v15.7.0
2021-03-14 08:42:03 INFO:  FaceAPI multi-process test
2021-03-14 08:42:03 STATE:  Main: started worker: 1888019
2021-03-14 08:42:03 STATE:  Main: started worker: 1888025
2021-03-14 08:42:04 STATE:  Worker: PID: 1888025 TensorFlow/JS 3.3.0 FaceAPI 1.0.2 Backend: tensorflow
2021-03-14 08:42:04 STATE:  Worker: PID: 1888019 TensorFlow/JS 3.3.0 FaceAPI 1.0.2 Backend: tensorflow
2021-03-14 08:42:04 STATE:  Main: dispatching to worker: 1888019
2021-03-14 08:42:04 STATE:  Main: dispatching to worker: 1888025
2021-03-14 08:42:04 DATA:  Worker received message: 1888019 { image: 'demo/sample1.jpg' }
2021-03-14 08:42:04 DATA:  Worker received message: 1888025 { image: 'demo/sample2.jpg' }
2021-03-14 08:42:06 DATA:  Main: worker finished: 1888025 detected faces: 3
2021-03-14 08:42:06 STATE:  Main: dispatching to worker: 1888025
2021-03-14 08:42:06 DATA:  Worker received message: 1888025 { image: 'demo/sample3.jpg' }
2021-03-14 08:42:06 DATA:  Main: worker finished: 1888019 detected faces: 3
2021-03-14 08:42:06 STATE:  Main: dispatching to worker: 1888019
2021-03-14 08:42:06 DATA:  Worker received message: 1888019 { image: 'demo/sample4.jpg' }
2021-03-14 08:42:07 DATA:  Main: worker finished: 1888025 detected faces: 3
2021-03-14 08:42:07 STATE:  Main: dispatching to worker: 1888025
2021-03-14 08:42:07 DATA:  Worker received message: 1888025 { image: 'demo/sample5.jpg' }
2021-03-14 08:42:08 DATA:  Main: worker finished: 1888019 detected faces: 4
2021-03-14 08:42:08 STATE:  Main: dispatching to worker: 1888019
2021-03-14 08:42:08 DATA:  Worker received message: 1888019 { image: 'demo/sample6.jpg' }
2021-03-14 08:42:09 DATA:  Main: worker finished: 1888025 detected faces: 5
2021-03-14 08:42:09 STATE:  Main: worker exit: 1888025 0
2021-03-14 08:42:09 DATA:  Main: worker finished: 1888019 detected faces: 4
2021-03-14 08:42:09 INFO:  Processed 15 images in 5944 ms
2021-03-14 08:42:09 STATE:  Main: worker exit: 1888019 0

Note that @tensorflow/tfjs-node or @tensorflow/tfjs-node-gpu
must be installed before using NodeJS example




Quick Start

Simply include latest version of FaceAPI directly from a CDN in your HTML:
(pick one, jsdelivr or unpkg)

">
<script src="https://cdn.jsdelivr.net/npm/@vladmandic/face-api/dist/face-api.js">script>
<script src="https://unpkg.dev/@vladmandic/face-api/dist/face-api.js">script>

Installation

FaceAPI ships with several pre-build versions of the library:

  • dist/face-api.js: IIFE format for client-side Browser execution
    with TFJS pre-bundled
  • dist/face-api.esm.js: ESM format for client-side Browser execution
    with TFJS pre-bundled
  • dist/face-api.esm-nobundle.js: ESM format for client-side Browser execution
    without TFJS pre-bundled
  • dist/face-api.node.js: CommonJS format for server-side NodeJS execution
    without TFJS pre-bundled
  • dist/face-api.node-gpu.js: CommonJS format for server-side NodeJS execution
    without TFJS pre-bundled and optimized for CUDA GPU acceleration

Defaults are:

{
  "main": "dist/face-api.node-js",
  "module": "dist/face-api.esm.js",
  "browser": "dist/face-api.esm.js",
}

Bundled TFJS can be used directly via export: faceapi.tf

Reason for additional nobundle version is if you want to
include a specific version of TFJS and not rely on pre-packaged one

FaceAPI is compatible with TFJS 2.0+ and TFJS 3.0+

All versions include sourcemap




There are several ways to use FaceAPI:

1. IIFE script

Recommened for quick tests and backward compatibility with older Browsers that do not support ESM such as IE

This is simplest way for usage within Browser
Simply download dist/face-api.js, include it in your HTML file & it's ready to use:

">
<script src="https://cdn.jsdelivr.net/npm/@vladmandic/face-api/dist/face-api.js">script>

IIFE script bundles TFJS and auto-registers global namespace faceapi within Window object which can be accessed directly from a

Comments
  • Migration @vladmandic/face-api to old face-api

    Migration @vladmandic/face-api to old face-api

    Hi, What are steps that need to be done ? 1.pacakge json for @vladmandic/face-api we used: "@tensorflow/tfjs-node": "^3.9.0", "@vladmandic/face-api": "^1.5.4", what are in old face-api ? 2.The project old face-api written in typescript, can I used it in js ? 3.What about modal they can be loaded in startup like in @vladmandic/face-api ? 4.const faceapi = require('@vladmandic/face-api'); in old api how is it in js? 5.Does the interface(methods of faceapi are same on both platform ? Thanks,

    opened by danies8 53
  • how to fully optimize processing to take advance of all available hardware

    how to fully optimize processing to take advance of all available hardware

    I run this function:

      async function analyzeFrame (frameData, index) {
        const tensor = await getTensorFromBuffer(frameData)
        const faces = await faceapi.detectAllFaces(tensor, optionsSSDMobileNet).withFaceLandmarks().withFaceDescriptors()
        tensor.dispose()
        faces.forEach(async (face) => {
          // console.log(face)
        })
      }
    

    for hundreds of frames of a video. When doing so, it takes about half the time as if it where using only tfjs-node. It fills the RAM of my two 1080s, however the only usage that changes when I start the script is GPU 1s copy utilization goes to about 15%.

    I want to take better advantage of my hardware and run this faster.

    Windows 10, cuda 10, TFJS 2.7.0

    question 
    opened by Nuzzlet 33
  •   return process.dlopen(module, path.toNamespacedPath(filename));

    return process.dlopen(module, path.toNamespacedPath(filename));

    hey! im using your package in my project for face recognition and it works fine. i copied the same project to different computer and im getting this error. tried all solutions available online, reinstalled node modules a number of times, tried all versions of node and tensorflow as well as your package, not sure where is the error coming from.

    here is the error stack:

    return process.dlopen(module, path.toNamespacedPath(filename)); ^

    Error: A dynamic link library (DLL) initialization routine failed. \?\C:\Users\User\Documents\digitallending_sql\[email protected]\tfjs-node\lib\napi-v5\tfjs_binding.node at Object.Module._extensions..node (internal/modules/cjs/loader.js:1206:18) at Module.load (internal/modules/cjs/loader.js:1000:32) at Function.Module._load (internal/modules/cjs/loader.js:899:14) at Module.require (internal/modules/cjs/loader.js:1042:19) at require (internal/modules/cjs/helpers.js:77:18) at Object. (C:\Users\User\Documents\digitallending_sql\[email protected]\tfjs-node\dist\index.js:58:16) at Module._compile (internal/modules/cjs/loader.js:1156:30) at Object.Module._extensions..js (internal/modules/cjs/loader.js:1176:10) at Module.load (internal/modules/cjs/loader.js:1000:32) at Function.Module._load (internal/modules/cjs/loader.js:899:14) at Module.require (internal/modules/cjs/loader.js:1042:19) at require (internal/modules/cjs/helpers.js:77:18) at Object. (C:\Users\User\Documents\digitallending_sql\functions\facedetection.js:2:1) at Module._compile (internal/modules/cjs/loader.js:1156:30) at Object.Module._extensions..js (internal/modules/cjs/loader.js:1176:10) at Module.load (internal/modules/cjs/loader.js:1000:32) at Function.Module._load (internal/modules/cjs/loader.js:899:14) at Module.require (internal/modules/cjs/loader.js:1042:19) at require (internal/modules/cjs/helpers.js:77:18) at Object. (C:\Users\User\Documents\digitallending_sql\controllers\applicationController.js:6:20) at Module._compile (internal/modules/cjs/loader.js:1156:30) at Object.Module._extensions..js (internal/modules/cjs/loader.js:1176:10) at Module.load (internal/modules/cjs/loader.js:1000:32) at Function.Module._load (internal/modules/cjs/loader.js:899:14) at Module.require (internal/modules/cjs/loader.js:1042:19) at require (internal/modules/cjs/helpers.js:77:18) at Object. (C:\Users\User\Documents\digitallending_sql\routes\applicationRouter.js:3:29) at Module._compile (internal/modules/cjs/loader.js:1156:30)


    im using windows 10, node 12.16.2

    wontfix 
    opened by Muhammad-Ehsan-Ul-Haq 28
  • Unable to use faceapi in a nexjs - react application

    Unable to use faceapi in a nexjs - react application "Module not found: Can't resolve 'fs'"

    Issue Description Getting the following error:

    error - ./node_modules/@vladmandic/face-api/dist/face-api.esm.js:8:25031 Module not found: Can't resolve 'fs'

    Steps to Reproduce create a nextjs application as given here:

    https://nextjs.org/learn/basics/create-nextjs-app/setup

    added face api packages (npm install). Including tensorflow Invoked the api to load the models: await faceapi.nets.ssdMobilenetv1.loadFromUri('/models')

    And got the error:

    Expected Behavior It should have loaded the models.

    **Environment Windows 10. Nodejs. React application. Using VS code editor. Browser is chrome/Edge.

    • Module version?
    • Built-in demo or custom code? - custom
    • Type of module used (e.g. js, esm, esm-nobundle)? js
    • Browser or NodeJS and version (e.g. NodeJS 14.15 or Chrome 89)? - Node v14.13.1, Chrome Version 89.0.4389.90 (Official Build) (64-bit)
    • OS and Hardware platform (e.g. Windows 10, Ubuntu Linux on x64, Android 10)? Windows 10
    • Packager (if any) (e.g, webpack, rollup, parcel, esbuild, etc.)? standard webpack

    Additional

    • For installation or startup issues include your package.json
    • For usage issues, it is recommended to post your code as gist
    question 
    opened by karthik-Gopalan 26
  • Can't use in a lerna/create-react app project

    Can't use in a lerna/create-react app project

    I am using the library in a TypeScript lerna module which is build with tsc and then bundled as part of a create-react-app. I had no issue with the original face-api but wanted the latest fdjs. I am using the npm module with npm install.

    If I only do:

    import * as faceapi from '@vladmandic/face-api'

    I get a compile error:

    Failed to compile ../face-detect-plugin/node_modules/@vladmandic/face-api/dist/face-api.js 344:47 Module parse failed: Unexpected token (344:47) File was processed with these loaders:

    • ./node_modules/babel-loader/lib/index.js You may need an additional loader to handle the result of these loaders. | } : T || {}; |
        var E = g(f(T.entropy ? [x, w(e)] : x ?? y(), 3), _),
    

    | F = new d(_), | D = function () {

    if I add:

    import * as tf from '@tensorflow/tfjs'

    before importing face-api then I get an error in the console:

    Uncaught SyntaxError: Unexpected token '!'

    If I look at the code I see this:

    class MathBackendCPU extends !(function webpackMissingModule() { var e = new Error("Cannot find module '@tensorflow/tfjs-core'"); e.code = 'MODULE_NOT_FOUND'; throw e; }()) { constructor() { super(); this.blockSize = 48; this.firstUse = true; this.data = new !(function webpackMissingModule() { var e = new Error("Cannot find module '@tensorflow/tfjs-core'"); e.code = 'MODULE_NOT_FOUND'; throw e; }())(this, !(function webpackMissingModule() { var e = new Error("Cannot find module '@tensorflow/tfjs-core'"); e.code = 'MODULE_NOT_FOUND'; throw e; }())()); }

    question 
    opened by ost12666 23
  • Implement head position angle of  (yaw, roll, pitch)

    Implement head position angle of (yaw, roll, pitch)

    HI do you have plan to implement Head position angle of (Yaw, Roll, Pitch)

    pose: {
      pitch_angle: {value: 11.102898}
      roll_angle: {value: -20.291693}
      yaw_angle: {value: 14.172521}
    }
    

    like face-api discuss here https://github.com/justadudewhohacks/face-api.js/issues/107

    enhancement 
    opened by tianyingchun 19
  • There is a leak memory: faceapi.extractFaceTensors and  faceapi.extractFaces

    There is a leak memory: faceapi.extractFaceTensors and faceapi.extractFaces

    faceapi.tf.setBackend('webgl');
    faceapi.tf.enableProdMode();
    faceapi.tf.ENV.set('DEBUG', false);
    faceapi.tf.ready();
    
    .......
    const videoTensor = await faceapi.tf.browser.fromPixels(video);
    const detections = await faceapi.detectAllFaces(videoTensor, new faceapi.SsdMobilenetv1Options({ minConfidence: minScore, maxResults }));
    const faceImages = await faceapi.extractFaceTensors(videoTensor, detections);
    
    await videoTensor.dispose();
    await faceImages[0].dispose();
    
    

    I follow my GPU memory. I detect a leak memory. Maybe we can use x.dispose(); I tried it, but this problem continue... I checked faceapi.detectAllFaces function. There is not any leak. I think faceapi.extractFaceTensors function. How can I fix it?

    question 
    opened by umitkacar 19
  • @vladmandic/face-api/dist/face-api.node.js requires ES module???

    @vladmandic/face-api/dist/face-api.node.js requires ES module???

    trying to migrate to your fork of face-api

    Using:

    let faceapi   = require('@vladmandic/face-api/dist/face-api.node.js');
    

    I get:

    Error [ERR_REQUIRE_ESM]: Must use import to load ES Module: /home/meeki/node-red-contrib-facial-recognition/node_modules/@vladmandic/face-api/dist/face-api.node.js
    require() of ES modules is not supported.
    require() of /home/meeki/node-red-contrib-facial-recognition/node_modules/@vladmandic/face-api/dist/face-api.node.js from /home/meeki/node-red-contrib-facial-recognition/facial-recognition.js is an ES module file as it is a .js file whose nearest parent package.json contains "type": "module" which defines all .js files in that package scope as ES modules.
    Instead rename face-api.node.js to end in .cjs, change the requiring code to use import(), or remove "type": "module" from /home/meeki/node-red-contrib-facial-recognition/node_modules/@vladmandic/face-api/package.json.
    

    interesting

    bug help wanted 
    opened by meeki007 17
  • How does detectAllFaces function will handle fake image photo by mobile

    How does detectAllFaces function will handle fake image photo by mobile

    Hi, I used this code that detect all faces, I want to avoid that user will photo himself by cellular and show the cellular photo to camera , how I avoid by code ? For know fake image by cellular also work. I saw this link in history issue and there is no option do install through npm ? https://github.com/vladmandic/anti-spoofing

     const ssdOptions = { minConfidence: 0.1, maxResults: 10 };
          const optionsSSDMobileNet = new faceapi.SsdMobilenetv1Options(ssdOptions);
          const faces = await faceapi
            .detectAllFaces(tensor, optionsSSDMobileNet)
            .withFaceLandmarks()
            .withFaceExpressions()
            .withFaceDescriptors()
            .withAgeAndGender();
    
    
    opened by danies8 15
  • Resource load failed

    Resource load failed

    Issue Description Vue2 builds a demo, loadFromUri loads tinyFaceDetector, and loads loadFaceLandmarkModel, PC loads resources successfully, but Apple mobile safari fails to load

    Expected Behavior Resources can be loaded on both PC and mobile

    **Environment window 10 + chrome 98.0.4758.102(PC) + safari(mobile)

    • Module version? "@vladmandic/face-api": "^1.6.5" "vue": "^2.5.2"

    • Built-in demo or custom code? https://busyshadow.github.io/#/

    • Type of module used (e.g. js, esm, esm-nobundle)? js

    • Packager (if any) (e.g, webpack, rollup, parcel, esbuild, etc.)? webpack

    • For installation or startup issues include your package.json

    {
      "name": "faceDemo",
      "version": "1.0.0",
      "description": "A Vue.js project",
      "author": "",
      "private": true,
      "scripts": {
        "dev": "vue-cli-service serve",
        "build": "vue-cli-service build"
      },
      "dependencies": {
        "@vladmandic/face-api": "^1.6.5",
        "uglifyjs-webpack-plugin": "^2.2.0",
        "vconsole": "^3.12.0",
        "vue": "^2.5.2",
        "vue-router": "^3.1.6"
      },
      "devDependencies": {
        "@vue/cli-plugin-babel": "~4.3.1",
        "@vue/cli-plugin-router": "~4.3.1",
        "@vue/cli-service": "~4.3.1",
        "vue-template-compiler": "^2.6.11"
      },
      "engines": {
        "node": ">= 6.0.0",
        "npm": ">= 3.0.0"
      },
      "browserslist": [
        "> 1%",
        "last 2 versions",
        "not ie <= 8"
      ]
    }
    

    index.vue

    <template>
        <div>
            <div>err1:{{err1}}</div>
            <div>err2:{{err2}}</div>
        </div>
    </template>
    <script>
        import * as faceapi from '@vladmandic/face-api';
        // import * as faceapi from "face-api.js";
        import vconsole from 'vconsole';
        let _this;
        export default {
            data(){
                return {
                    err1:"",
                    err2:"",
                }
            },
            created(){
                new vconsole();
            },
            mounted(){
                _this = this;
                this.$nextTick(() => {
                    this.fnInit();
                });
            },
            methods:{
                async fnInit(){
                    try {
                        await faceapi.nets['tinyFaceDetector'].loadFromUri("https://busyshadow.github.io/models");
                    }catch(e){
                        this.err1 = e;
                    }
                    try {
                        await faceapi.loadFaceLandmarkModel("https://busyshadow.github.io/models");
                    } catch(e){
                        this.err2 = e;
                    }
    
                    _this.options = new faceapi.TinyFaceDetectorOptions({
                        inputSize: 224, // 160 224 320 416 512 608
                        scoreThreshold: 0.3, // 0.1 ~ 0.9
                    });
                }
            }
        }
    </script>
    

    success success

    error error

    opened by busyShadow 14
  • faceapi is working for me on desktop but not on mobile

    faceapi is working for me on desktop but not on mobile

    faceapi is working for me on desktop but not on mobile.

    I am using wasm, as recommended to me and it worked perfect for a long time, both on desktop and mobil.

    import * as faceapi from "@vladmandic/face-api/dist/face-api.esm.js";

    async start() { /**el face api solo se necesita para el selfie */ if (this.type == "selfie") { await this.backendWasm(); await this.setupFaceAPI(); } } async setupFaceAPI() { await faceapi.nets.tinyFaceDetector.loadFromUri("/statics/models"); },

    async backendWasm() {
      await faceapi.tf.setWasmPaths("../statics/");
      await faceapi.tf.setBackend("wasm");
    },
    

    for a couple of days it stopped working on mobile, will it be a question of versions of the libraries?

    tensorflow face api ?? Captura de Pantalla 2021-06-28 a la(s) 1 33 21 p  m Captura de Pantalla 2021-06-28 a la(s) 12 57 45 p  m Captura de Pantalla 2021-06-28 a la(s) 12 57 50 p  m

    if you look at the first image they don't load all the wasm files, that's in mobile.

    but in the other two images, if you see if they load all the files, that's on desktop

    uso chrome.

    "@tensorflow/tfjs": "^3.3.0", "@tensorflow/tfjs-backend-wasm": "^3.3.0", "@vladmandic/face-api": "^1.1.12",

    Captura de Pantalla 2021-06-28 a la(s) 1 29 27 p  m
    opened by deylyn 14
Releases(1.7.1)
Simple tutorials on Pytorch DDP training

pytorch-distributed-training Distribute Dataparallel (DDP) Training on Pytorch Features Easy to study DDP training You can directly copy this code for

Ren Tianhe 188 Jan 06, 2023
For storing the complete exploration of Visual Question Answering for our B.Tech Project

Multi-Image vqa @authors: Akhilesh, Janhavi, Harsh Paper summary, Ideas tried and their corresponding results: on wiki Other discussions: on discussio

Harsh Raj 3 Jun 16, 2022
(ICCV'21) Official PyTorch implementation of Relational Embedding for Few-Shot Classification

Relational Embedding for Few-Shot Classification (ICCV 2021) Dahyun Kang, Heeseung Kwon, Juhong Min, Minsu Cho [paper], [project hompage] We propose t

Dahyun Kang 82 Dec 24, 2022
Official implementation of "Learning to Discover Cross-Domain Relations with Generative Adversarial Networks"

DiscoGAN Official PyTorch implementation of Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. Prerequisites Python 2.7

SK T-Brain 754 Dec 29, 2022
AirCode: A Robust Object Encoding Method

AirCode This repo contains source codes for the arXiv preprint "AirCode: A Robust Object Encoding Method" Demo Object matching comparison when the obj

Chen Wang 30 Dec 09, 2022
Self-supervised Deep LiDAR Odometry for Robotic Applications

DeLORA: Self-supervised Deep LiDAR Odometry for Robotic Applications Overview Paper: link Video: link ICRA Presentation: link This is the correspondin

Robotic Systems Lab - Legged Robotics at ETH Zürich 181 Dec 29, 2022
MAVE: : A Product Dataset for Multi-source Attribute Value Extraction

MAVE: : A Product Dataset for Multi-source Attribute Value Extraction The dataset contains 3 million attribute-value annotations across 1257 unique ca

Google Research Datasets 89 Jan 08, 2023
Code for the paper One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation, CVPR 2021.

One Thing One Click One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation (CVPR2021) Code for the paper One Thi

44 Dec 12, 2022
This repo contains the implementation of YOLOv2 in Keras with Tensorflow backend.

Easy training on custom dataset. Various backends (MobileNet and SqueezeNet) supported. A YOLO demo to detect raccoon run entirely in brower is accessible at https://git.io/vF7vI (not on Windows).

Huynh Ngoc Anh 1.7k Dec 24, 2022
Open-source code for Generic Grouping Network (GGN, CVPR 2022)

Open-World Instance Segmentation: Exploiting Pseudo Ground Truth From Learned Pairwise Affinity Pytorch implementation for "Open-World Instance Segmen

Meta Research 99 Dec 06, 2022
This is the repository for Learning to Generate Piano Music With Sustain Pedals

SusPedal-Gen This is the official repository of Learning to Generate Piano Music With Sustain Pedals Demo Page Dataset The dataset used in this projec

Joann Ching 12 Sep 02, 2022
Creating Multi Task Models With Keras

Creating Multi Task Models With Keras About The Project! I used the keras and Tensorflow Library, To build a Deep Learning Neural Network to Creating

Srajan Chourasia 4 Nov 28, 2022
[2021][ICCV][FSNet] Full-Duplex Strategy for Video Object Segmentation

Full-Duplex Strategy for Video Object Segmentation (ICCV, 2021) Authors: Ge-Peng Ji, Keren Fu, Zhe Wu, Deng-Ping Fan*, Jianbing Shen, & Ling Shao This

Daniel-Ji 55 Dec 22, 2022
Adaptation through prediction: multisensory active inference torque control

Adaptation through prediction: multisensory active inference torque control Submitted to IEEE Transactions on Cognitive and Developmental Systems Abst

Cristian Meo 1 Nov 07, 2022
Official implementation of "Accelerating Reinforcement Learning with Learned Skill Priors", Pertsch et al., CoRL 2020

Accelerating Reinforcement Learning with Learned Skill Priors [Project Website] [Paper] Karl Pertsch1, Youngwoon Lee1, Joseph Lim1 1CLVR Lab, Universi

Cognitive Learning for Vision and Robotics (CLVR) lab @ USC 134 Dec 06, 2022
Trains an agent with stochastic policy gradient ascent to solve the Lunar Lander challenge from OpenAI

Introduction This script trains an agent with stochastic policy gradient ascent to solve the Lunar Lander challenge from OpenAI. In order to run this

Momin Haider 0 Jan 02, 2022
Codes for "CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation"

CSDI This is the github repository for the NeurIPS 2021 paper "CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation

106 Jan 04, 2023
PyTorch implementation of CloudWalk's recent work DenseBody

densebody_pytorch PyTorch implementation of CloudWalk's recent paper DenseBody. Note: For most recent updates, please check out the dev branch. Update

Lingbo Yang 401 Nov 19, 2022
This repository collects 100 papers related to negative sampling methods.

Negative-Sampling-Paper This repository collects 100 papers related to negative sampling methods, covering multiple research fields such as Recommenda

RUCAIBox 119 Dec 29, 2022
EdiBERT, a generative model for image editing

EdiBERT, a generative model for image editing EdiBERT is a generative model based on a bi-directional transformer, suited for image manipulation. The

16 Dec 07, 2022