The Balloon Learning Environment - flying stratospheric balloons with deep reinforcement learning.

Last update: Dec 25, 2022

Overview

Balloon Learning Environment

The Balloon Learning Environment (BLE) is a simulator for stratospheric balloons. It is designed as a benchmark environment for deep reinforcement learning algorithms, and is a followup to the Nature paper "Autonomous navigation of stratospheric balloons using reinforcement learning".

Getting Started

Note: The BLE requires python >= 3.7

The BLE can easily be installed with pip:

pip install --upgrade pip && pip install balloon_learning_environment

Once the package has been installed, you can test it runs correctly by evaluating one of the benchmark agents:

python -m balloon_learning_environment.eval.eval \
  --agent=station_seeker \
  --renderer=matplotlib \
  --suite=micro_eval \
  --output_dir=/tmp/ble/eval

Ensure the BLE is Using Your GPU/TPU

The BLE contains a VAE for generating winds, which you will probably want to run on your accelerator. See the jax documentation for installing with GPU or TPU.

As a sanity check, you can open interactive python and run:

from balloon_learning_environment.env import balloon_env
env = balloon_env.BalloonEnv()

If you are not running with GPU/TPU, you should see a log like:

WARNING:absl:No GPU/TPU found, falling back to CPU. (Set TF_CPP_MIN_LOG_LEVEL=0 and rerun for more info.)

If you don't see this log, you should be good to go!

Next Steps

For more information, see the docs.

Giving credit

If you use the Balloon Learning Environment in your work, we ask that you use the following BibTeX entry:

@software{Greaves_Balloon_Learning_Environment_2021,
  author = {Greaves, Joshua and Candido, Salvatore and Dumoulin, Vincent and Goroshin, Ross and Ponda, Sameera S. and Bellemare, Marc G. and Castro, Pablo Samuel},
  month = {12},
  title = {{Balloon Learning Environment}},
  url = {https://github.com/google/balloon-learning-environment},
  version = {1.0.0},
  year = {2021}
}

If you use the ble_wind_field dataset, you should also cite

Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A.,
Muñoz‐Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A.,
Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G.,
Bidlot, J., Bonavita, M., De Chiara, G., Dahlgren, P., Dee, D., Diamantakis, M.,
Dragani, R., Flemming, J., Forbes, R., Fuentes, M., Geer, A., Haimberger, L.,
Healy, S., Hogan, R.J., Hólm, E., Janisková, M., Keeley, S., Laloyaux, P.,
Lopez, P., Lupu, C., Radnoti, G., de Rosnay, P., Rozum, I., Vamborg, F.,
Villaume, S., Thépaut, J-N. (2017): Complete ERA5: Fifth generation of ECMWF
atmospheric reanalyses of the global climate. Copernicus Climate Change Service
(C3S) Data Store (CDS). (Accessed on 01-04-2021)

The Balloon Learning Environment - flying stratospheric balloons with deep reinforcement learning.

Related tags

Overview

Balloon Learning Environment

Getting Started

Ensure the BLE is Using Your GPU/TPU

Next Steps

Giving credit

Owner

Google

This repository contains python code necessary to replicated the experiments performed in our paper "Invariant Ancestry Search"

The original implementation of TNDM used in the NeurIPS 2021 paper (no longer being updated)

Training code and evaluation benchmarks for the "Self-Supervised Policy Adaptation during Deployment" paper.

Solve a Rubiks Cube using Python Opencv and Kociemba module

Official PyTorch implementation of U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation

Dirty Pixels: Towards End-to-End Image Processing and Perception

An end-to-end implementation of intent prediction with Metaflow and other cool tools

A tutorial showing how to train, convert, and run TensorFlow Lite object detection models on Android devices, the Raspberry Pi, and more!

Moon-patrol - A faithful recreation of the 1983 hit classic Moon Patrol for the Atari 2600 created using the Pygame library for Python

python debugger and anti-vm that checks if you're in a virtual machine or if someones trying to debug your file

An open framework for Federated Learning.

(NeurIPS 2021) Realistic Evaluation of Transductive Few-Shot Learning

A collection of papers about Transformer in the field of medical image analysis.

A PyTorch implementation of "TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?"

Code for paper "ASAP-Net: Attention and Structure Aware Point Cloud Sequence Segmentation"

DNA-RECON { Automatic Web Reconnaissance Tool }

This repo implements a 3D segmentation task for an airport baggage dataset.

iNAS: Integral NAS for Device-Aware Salient Object Detection

DAFNe: A One-Stage Anchor-Free Deep Model for Oriented Object Detection

FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset (CVPR2022)