Implementation of U-Net and SegNet for building segmentation

Last update: Dec 07, 2022

Overview

Specialized project

Created by Katrine Nguyen and Martin Wangen-Eriksen as a part of our specialized project at Norwegian University of Science and Technology (NTNU).

Models

Most of our code and the U-net model is significantly inspired by this project Unet-for-Person-Segmentation. The SegNet model we created on our own based on other implementations of SegNet in Tensorflow.

Data

The model is trained and tested on Massachusetts Buildings Dataset from Kaggle. The original images where 1500X1500 pixels each over an area of 1500x1500 meters (1mx1m resolution). The original 137 images were cropped into 64x64 pixels and images without building were filtered out.

To make the masks compatible with our model the masks was changed from white (255,255,255) labels to greyscale with value 1. This is done in image_fix.py found in the repo.

Folder structure

Images and masks are saved in local directories and used in data.py and test.py. This is of course possible to change, however if you want to use the exact same code you can follow this folder structure.


.
├── ...
├── building-segmentation                # Directory for all images
│   ├── Images                           # Directory for raw images
│   │   ├── cropped_images_train_64      # Directory for cropped images where number specifies resolution, containg .jpg
│   │   ├── cropped_images_train_128     # Directory for cropped images where number specifies resolution, containg .jpg 
│   │   └── ...                          # More directories with other resolutions
│   ├── Masks                            # Directory for all maskes
│   │   ├── cropped_masks_train_64       # Directory for cropped masks where number specifies resolution, containg .jpg
│   │   ├── cropped_masks_train_128      # Directory for cropped masks where number specifies resolution, containg .jpg 
│   │   └── ...                          # More directories with other resolutions
│   └── Test                             # Miscellaneous information
│       ├── test_64                      # Directory for images where number specifies resolution, containing .jpg
│       └── ...                          # More directories with other resolutions
└── ...

# data.py
    images = glob(os.path.join(dataset_path, "images/cropped_images_train_64/*"))
    masks = glob(os.path.join(dataset_path, "masks/cropped_masks_train_64/*"))
    
    # In main:
        dataset_path = "building-segmentation"
    
# test.py
    test_images = glob("building-segmentation/test/test_64/*")

Implementation of U-Net and SegNet for building segmentation

Related tags

Overview

Specialized project

Models

Data

Folder structure

Running the project

Requirements

Training

Testing

Owner

Martin.w-e

A framework to train language models to learn invariant representations.

KwaiRec: A Fully-observed Dataset for Recommender Systems (Density: Almost 100%)

To prepare an image processing model to classify the type of disaster based on the image dataset

Set of methods to ensemble boxes from different object detection models, including implementation of "Weighted boxes fusion (WBF)" method.

Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening

Code release for General Greedy De-bias Learning

This is an official implementation for the WTW Dataset in "Parsing Table Structures in the Wild " on table detection and table structure recognition.

Code for "Diffusion is All You Need for Learning on Surfaces"

High level network definitions with pre-trained weights in TensorFlow

Public Implementation of ChIRo from "Learning 3D Representations of Molecular Chirality with Invariance to Bond Rotations"

Python library for loading and using triangular meshes.

A PyTorch implementation of "TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?"

A short code in python, Enchpyter, is able to encrypt and decrypt words as you determine, of course

Pytorch Implementation of Auto-Compressing Subset Pruning for Semantic Image Segmentation

Official repository for "On Improving Adversarial Transferability of Vision Transformers" (2021)

Tooling for the Common Objects In 3D dataset.

(CVPR2021) Kaleido-BERT: Vision-Language Pre-training on Fashion Domain

Implementation of the paper: "SinGAN: Learning a Generative Model from a Single Natural Image"

This is a project based on retinaface face detection, including ghostnet and mobilenetv3

Causal estimators for use with WhyNot