Pansharpening by convolutional neural networks in the full resolution framework

Last update: Nov 24, 2022

Related tags

Overview

Z-PNN: Zoom Pansharpening Neural Network

Pansharpening by convolutional neural networks in the full resolution framework is a deep learning method for Pansharpening based on unsupervised and full-resolution framework training.

Team members

Matteo Ciotola ([email protected]);
Sergio Vitale ([email protected]);
Antonio Mazza ([email protected]);
Giovanni Poggi ([email protected]);
Giuseppe Scarpa ([email protected]).

License

Copyright (c) 2021 Image Processing Research Group of University Federico II of Naples ('GRIP-UNINA'). All rights reserved. This software should be used, reproduced and modified only for informational and nonprofit purposes.

By downloading and/or using any of these files, you implicitly agree to all the terms of the license, as specified in the document LICENSE (included in this package)

Prerequisites

All the functions and scripts were tested on Windows and Ubuntu O.S., with these constrains:

Python 3.9
PyTorch 1.8.1 or 1.10.0
Cuda 10.1 and 11.3 (For GPU acceleration).

the operation is not guaranteed with other configurations.

Installation

Install Anaconda and git
Create a folder in which save the algorithm
Download the algorithm and unzip it into the folder or, alternatively, from CLI:

git clone https://github.com/matciotola/Z-PNN

Create the virtual environment with the z_pnn_environment.yml

conda env create -n z_pnn_env -f z_pnn_environment.yml

Activate the Conda Environment

conda activate z_pnn_env

Test it

python main.py -i example/WV3_example.mat -o ./Output_Example -s WV3 -m Z-PNN --coregistration --view_results

Usage

Before to start

To test this algorithm it is needed to create a .mat file. It must contain:

I_MS_LR: Original Multi-Spectral Stack in channel-last configuration (Dimensions: H x W x B);
I_PAN: Original Panchromatic band, without the third dimension (Dimensions: H x W).

Testing

The easiest command to use the algorithm on full resolution data:

python main.py -i path/to/file.mat -s sensor_name -m method

Several options are possible. Please refer to the parser help for more details:

python main.py -h

Complex-Valued Neural Networks (CVNN)Complex-Valued Neural Networks (CVNN)

Complex-Valued Neural Networks (CVNN) Done by @NEGU93 - J. Agustin Barrachina Using this library, the only difference with a Tensorflow code is that y

1 Nov 12, 2021

Code for our ICASSP 2021 paper: SA-Net: Shuffle Attention for Deep Convolutional Neural Networks

SA-Net: Shuffle Attention for Deep Convolutional Neural Networks (paper) By Qing-Long Zhang and Yu-Bin Yang [State Key Laboratory for Novel Software T

199 Jan 8, 2023

《Truly shift-invariant convolutional neural networks》(2021)

Truly shift-invariant convolutional neural networks [Paper] Authors: Anadi Chaman and Ivan Dokmanić Convolutional neural networks were always assumed

46 Dec 19, 2022

《A-CNN: Annularly Convolutional Neural Networks on Point Clouds》(2019)

A-CNN: Annularly Convolutional Neural Networks on Point Clouds Created by Artem Komarichev, Zichun Zhong, Jing Hua from Department of Computer Science

44 Feb 24, 2022

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks Abstract Facial expression recognition in video

103 Dec 29, 2022

This project is a loose implementation of paper "Algorithmic Financial Trading with Deep Convolutional Neural Networks: Time Series to Image Conversion Approach"

Stock Market Buy/Sell/Hold prediction Using convolutional Neural Network This repo is an attempt to implement the research paper titled "Algorithmic F

136 Dec 28, 2022

Fine-tune pretrained Convolutional Neural Networks with PyTorch

Fine-tune pretrained Convolutional Neural Networks with PyTorch. Features Gives access to the most popular CNN architectures pretrained on ImageNet. A

694 Nov 23, 2022

Pytorch implementation of AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks

AngularGrad Optimizer This repository contains the oficial implementation for AngularGrad: A New Optimization Technique for Angular Convergence of Con

124 Sep 16, 2022

PyTorch implementation of "ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context" (INTERSPEECH 2020)

ContextNet ContextNet has CNN-RNN-transducer architecture and features a fully convolutional encoder that incorporates global context information into

24 Nov 24, 2022

Comments

Add license scan report and status
Your FOSSA integration was successful! Attached in this PR is a badge and license report to track scan status in your README.

Below are docs for integrating FOSSA license checks into your CI:

CircleCI

TravisCI

Jenkins

Other
opened by fossabot 1

Releases(v1.0.2)

v1.0.2(Jun 17, 2022)
What's Changed

Added the possibility to test the algorithms without the Target-Adaptive modality

Source code(tar.gz)
Source code(zip)
v1.0.0(May 30, 2022)
What's Changed

Create codeql-analysis.yml by @matciotola in https://github.com/matciotola/Z-PNN/pull/2

New Contributors

@matciotola made their first contribution in https://github.com/matciotola/Z-PNN/pull/2

Full Changelog: https://github.com/matciotola/Z-PNN/commits/v1.0.0
Source code(tar.gz)
Source code(zip)

Pansharpening by convolutional neural networks in the full resolution framework

Related tags

Overview

Z-PNN: Zoom Pansharpening Neural Network

Team members

License

Prerequisites

Installation

Usage

Before to start

Testing

You might also like...

Complex-Valued Neural Networks (CVNN)Complex-Valued Neural Networks (CVNN)

Code for our ICASSP 2021 paper: SA-Net: Shuffle Attention for Deep Convolutional Neural Networks

《Truly shift-invariant convolutional neural networks》(2021)

《A-CNN: Annularly Convolutional Neural Networks on Point Clouds》(2019)

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks

This project is a loose implementation of paper "Algorithmic Financial Trading with Deep Convolutional Neural Networks: Time Series to Image Conversion Approach"

Fine-tune pretrained Convolutional Neural Networks with PyTorch

Pytorch implementation of AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks

PyTorch implementation of "ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context" (INTERSPEECH 2020)

Comments

Add license scan report and status

Releases(v1.0.2)

v1.0.2(Jun 17, 2022)

What's Changed

v1.0.0(May 30, 2022)

What's Changed

New Contributors

Owner

Keep CALM and Improve Visual Feature Attribution

🚩🚩🚩

Charsiu: A transformer-based phonetic aligner

Pyramid addon for OpenAPI3 validation of requests and responses.

A simple AI that will give you si ple task and this is made with python

ICCV2021 Paper: AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

PyTorch Autoencoders - Implementing a Variational Autoencoder (VAE) Series in Pytorch.

Patch Rotation: A Self-Supervised Auxiliary Task for Robustness and Accuracy of Supervised Models

Intrinsic Image Harmonization

The code of NeurIPS 2021 paper "Scalable Rule-Based Representation Learning for Interpretable Classification".

Checking fibonacci - Generating the Fibonacci sequence is a classic recursive problem

Camera-caps - Examine the camera capabilities for V4l2 cameras

Fastshap: A fast, approximate shap kernel

This is the official pytorch implementation for the paper: Instance Similarity Learning for Unsupervised Feature Representation.

SwinTrack: A Simple and Strong Baseline for Transformer Tracking

Parris, the automated infrastructure setup tool for machine learning algorithms.

ICCV2021 Oral SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networks

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

PyTorch code accompanying our paper on Maximum Entropy Generators for Energy-Based Models

Image-popularity-score - A novel deep regression method for image scoring.