LPAQA: Language model Prompt And Query Archive

This repository contains data and code for the paper How Can We Know What Language Models Know?

Install

Our repository is based on LAMA. Please download our fork from here and follow the instructions to set up the environment and download pre-trained language models.

# clone LPAQA
git clone https://github.com/jzbjyb/LPAQA.git LPAQA
# clone LAMA
git clone https://github.com/jzbjyb/LAMA.git LAMA
pushd LAMA && git reset --hard b6b1885c64de5981f249a8b65de25cb0802b4bd5 && rm -rf .git && popd
mv LAMA/* LPAQA/ && rm -rf LAMA
# follow the instructions to install
cd LPAQA
./setup.sh

Retrieve factual knowledge from LMs

For example, to query the owner of MSN (Microsoft is the answer), you can either use manually created prompts (x is owned by y):

python lama/eval_generation.py --lm bert --t "MSN is owned by [MASK]."

or use LPAQA that ensembles a diversity of prompts:

# mined prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/mine
# paraphrased prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/paraphrase

Language model Prompt And Query Archive

Related tags

Overview

LPAQA: Language model Prompt And Query Archive

Install

Retrieve factual knowledge from LMs

Owner

Implementing a simplified copy of Shazam application from scratch using MinHashing and LSH.

HAT: Hierarchical Aggregation Transformers for Person Re-identification

Time Series Forecasting with Temporal Fusion Transformer in Pytorch

Unofficial PyTorch reimplementation of the paper Swin Transformer V2: Scaling Up Capacity and Resolution

A simple, high level, easy-to-use open source Computer Vision library for Python.

Contra is a lightweight, production ready Tensorflow alternative for solving time series prediction challenges with AI

Image-retrieval-baseline - MUGE Multimodal Retrieval Baseline

Instant-Teaching: An End-to-End Semi-Supervised Object Detection Framework

Source code for CAST - Crisis Domain Adaptation Using Sequence-to-sequence Transformers (Accepted to ISCRAM 2021, CorePaper).

🏆 The 1st Place Submission to AICity Challenge 2021 Natural Language-Based Vehicle Retrieval Track (Alibaba-UTS submission)

Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch

Nsdf: A mesh SDF with just some code we can directly paste into our raymarcher

Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imaging, ICCV2021 [PyTorch Code]

Rax is a Learning-to-Rank library written in JAX

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

Official implementation of "A Shared Representation for Photorealistic Driving Simulators" in PyTorch.

Fedlearn支持前沿算法研发的Python工具库 | Fedlearn algorithm toolkit for researchers

Multispectral Object Detection with Yolov5

Implementation of "RaScaNet: Learning Tiny Models by Raster-Scanning Image" from CVPR 2021.

A small library for creating and manipulating custom JAX Pytree classes