CaLiGraph for Semantic Reasoning Evaluation Challenge

This repository contains code and data to use CaLiGraph as a benchmark dataset in the Semantic Reasoning Evaluation Challange at the International Semantic Web Conference 2021 (ISWC'21).

The paper describing the dataset characteristics and results for well-known reasoners will be linked here as soon as a preprint is available.

Datasets

We use CaLiGraph version 2.1.0 as foundation for the challenge dataset. In particular, we use the files caligraph-ontology.nt.bz2 and caligraph-instances_types.nt.bz2 to generate our sample data.

We provide sample datasets having roughly 10ⁿ classes with n in [1,6]. The datasets and all potentially inferrable assertions can be found here. Please refer to our paper if you are interested in how the sample datasets were constructed.

Evaluated Reasoners

We evaluated the following reasoners with our sample datasets:

To evaluate the reasoners, we used their connectors in OWL API. The source code for the evaluation of the reasoners can be found in the folder reasoner_evaluation. As Pellet needs an OWL API version lower than 4 (while the others need a version higher than 4) we provide two pom.xml files. Depending on which reasoner you want to run, you have to use the correct one. Further, you have to uncomment the respective reasoners in the getReasoners() function of the java file org.unima.nheist.App.

Alternatively, you can use the two provided jar files to run the reasoners with the datasets. First download the sample dataset you want to run the reasoners on, then run the jar file and provide the location of the dataset as first argument like this:

java -jar semrec-caligraph-elk-hermit.jar <PATH-TO-DATASET-FILE> &> log_elk-hermit.txt

The result is a realization of the input dataset through the selected reasoners. Have a look at the log file (in the case of the example: log_elk-hermit.txt) for additional information about the reasoning process.

The precomputed results for all the sample datasets can be found here.

CaLiGraph Ontology as a Challenge for Semantic Reasoners ([email protected]'21)

Related tags

Overview

CaLiGraph for Semantic Reasoning Evaluation Challenge

Datasets

Evaluated Reasoners

Owner

Nico Heist

Python implementation of "Single Image Haze Removal Using Dark Channel Prior"

The repo of Feedback Networks, CVPR17

ComPhy: Compositional Physical Reasoning ofObjects and Events from Videos

Shape Matching of Real 3D Object Data to Synthetic 3D CADs (3DV project @ ETHZ)

Code of TVT: Transferable Vision Transformer for Unsupervised Domain Adaptation

Semi-supervised Semantic Segmentation with Directional Context-aware Consistency (CVPR 2021)

QAT(quantize aware training) for classification with MQBench

Unofficial implementation of the ImageNet, CIFAR 10 and SVHN Augmentation Policies learned by AutoAugment using pillow

Plenoxels: Radiance Fields without Neural Networks, Code release WIP

RoMa: A lightweight library to deal with 3D rotations in PyTorch.

my graduation project is about live human face augmentation by projection mapping by using CNN

Example of a Quantum LSTM

Tianshou - An elegant PyTorch deep reinforcement learning library.

League of Legends Reinforcement Learning Environment (LoLRLE) multiple training scenarios using PPO.

Image Classification - A research on image classification and auto insurance claim prediction, a systematic experiments on modeling techniques and approaches

A large-scale video dataset for the training and evaluation of 3D human pose estimation models

This repository is for the preprint "A generative nonparametric Bayesian model for whole genomes"

🚩🚩🚩

A tensorflow model that predicts if the image is of a cat or of a dog.

[CVPR 2020] Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generation