Neural Caption Generator with Attention

Last update: Nov 30, 2022

Overview

Neural Caption Generator with Attention

Tensorflow implementation of "Show, attend and Tell" http://arxiv.org/abs/1502.03044
Borrowed most of the idea from the author's source code https://github.com/kelvinxu/arctic-captions

Code

make_flickr_dataset.py: Extracts conv5_3 layer activations of VGG Network for flickr30k images, and save them in 'data/feats.npy'
model_tensorflow.py: Main codes

Usage

Download flickr30k Dataset.
Extract VGG conv5_3 features using make_flickr_dataset.py
Train: run train() in model_tensorflow.py
Test: run test() in model_tensorflow.py

Owner

Taeksoo Kim

GitHub Repository

Code for the paper "Relation of the Relations: A New Formalization of the Relation Extraction Problem"

This repo contains the code for the EMNLP 2020 paper "Relation of the Relations: A New Paradigm of the Relation Extraction Problem" (Jin et al., 2020)

27 Oct 26, 2022

Using contrastive learning and OpenAI's CLIP to find good embeddings for images with lossy transformations

The official code for the paper "Inverse Problems Leveraging Pre-trained Contrastive Representations" (to appear in NeurIPS 2021).

26 Dec 10, 2022

An OpenAI-Gym Package for Training and Testing Reinforcement Learning algorithms with OpenSim Models

Authors: Utkarsh A. Mishra and Dr. Dimitar Stanev Advisors: Dr. Dimitar Stanev and Prof. Auke Ijspeert, Biorobotics Laboratory (BioRob), EPFL Video Pl

16 Dec 13, 2022

RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting

RATCHET: RAdiological Text Captioning for Human Examined Thoraxes RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting. Based on t

26 Nov 14, 2022

Official PyTorch implementation of paper: Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentation (ICCV 2021 Oral Presentation)

SML (ICCV 2021, Oral) : Official Pytorch Implementation This repository provides the official PyTorch implementation of the following paper: Standardi

61 Dec 27, 2022

A Parameter-free Deep Embedded Clustering Method for Single-cell RNA-seq Data

A Parameter-free Deep Embedded Clustering Method for Single-cell RNA-seq Data Overview Clustering analysis is widely utilized in single-cell RNA-seque

3 May 08, 2022

LUKE -- Language Understanding with Knowledge-based Embeddings

LUKE (Language Understanding with Knowledge-based Embeddings) is a new pre-trained contextualized representation of words and entities based on transf

587 Dec 30, 2022

Keras-1D-NN-Classifier

Keras-1D-NN-Classifier This code is based on the reference codes linked below. reference 1, reference 2 This code is for 1-D array data classification

6 May 18, 2021

NeuralCompression is a Python repository dedicated to research of neural networks that compress data

NeuralCompression is a Python repository dedicated to research of neural networks that compress data. The repository includes tools such as JAX-based entropy coders, image compression models, video c

297 Jan 06, 2023

Repository for the NeurIPS 2021 paper: "Exploiting Domain-Specific Features to Enhance Domain Generalization".

meta-Domain Specific-Domain Invariant (mDSDI) Source code implementation for the paper: Manh-Ha Bui, Toan Tran, Anh Tuan Tran, Dinh Phung. "Exploiting

12 Nov 25, 2022

Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification

258 Dec 29, 2022

GANTheftAuto is a fork of the Nvidia's GameGAN

Description GANTheftAuto is a fork of the Nvidia's GameGAN, which is research focused on emulating dynamic game environments. The early research done

801 Dec 27, 2022

Fight Recognition from Still Images in the Wild @ WACVW2022, Real-world Surveillance Workshop

Fight Detection from Still Images in the Wild Detecting fights from still images is an important task required to limit the distribution of social med

10 Nov 09, 2022

Pytorch implementation of Hinton's Dynamic Routing Between Capsules

pytorch-capsule A Pytorch implementation of Hinton's "Dynamic Routing Between Capsules". https://arxiv.org/pdf/1710.09829.pdf Thanks to @naturomics fo

625 Oct 27, 2022

Code repository for paper `Skeleton Merger: an Unsupervised Aligned Keypoint Detector`.

Skeleton Merger Skeleton Merger, an Unsupervised Aligned Keypoint Detector. The paper is available at https://arxiv.org/abs/2103.10814. A map of the r

48 Nov 14, 2022

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

#NeuralTalk Warning: Deprecated. Hi there, this code is now quite old and inefficient, and now deprecated. I am leaving it on Github for educational p

5.3k Jan 07, 2023

Neural Caption Generator with Attention

Related tags

Overview

Neural Caption Generator with Attention

Code

Usage

Owner

Taeksoo Kim

Code for the paper "Relation of the Relations: A New Formalization of the Relation Extraction Problem"

Using contrastive learning and OpenAI's CLIP to find good embeddings for images with lossy transformations

An OpenAI-Gym Package for Training and Testing Reinforcement Learning algorithms with OpenSim Models

RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting

Official PyTorch implementation of paper: Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentation (ICCV 2021 Oral Presentation)

A Parameter-free Deep Embedded Clustering Method for Single-cell RNA-seq Data

LUKE -- Language Understanding with Knowledge-based Embeddings

Keras-1D-NN-Classifier

NeuralCompression is a Python repository dedicated to research of neural networks that compress data

Repository for the NeurIPS 2021 paper: "Exploiting Domain-Specific Features to Enhance Domain Generalization".

Band-Adaptive Spectral-Spatial Feature Learning Neural Network for Hyperspectral Image Classification

GANTheftAuto is a fork of the Nvidia's GameGAN

Fight Recognition from Still Images in the Wild @ WACVW2022, Real-world Surveillance Workshop

Pytorch implementation of Hinton's Dynamic Routing Between Capsules

Code repository for paper `Skeleton Merger: an Unsupervised Aligned Keypoint Detector`.

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

This Repostory contains the pretrained DTLN-aec model for real-time acoustic echo cancellation.

Implementation of experiments in the paper Clockwork Variational Autoencoders (project website) using JAX and Flax

A little Python application to auto tag your photos with the power of machine learning.

[ICML 2021] “ Self-Damaging Contrastive Learning”, Ziyu Jiang, Tianlong Chen, Bobak Mortazavi, Zhangyang Wang