Projects for AI/ML and IoT integration for games and other presented at re:Invent 2021.

This project is a Minecraft Modding using Forge platform, Node-Red, IoT device with ESP32 and AWS IoT Core to manage messages, security and device fleet. With this Minecraft Mod you can turn on and off a lamp (or any other thing!) breaking blocks; once you break a block a TCP connection between Minecraft and Node-RED will be stabilished and Node-RED will communicate with AWS IoT Core using MQTT protocol.

We choose to use Node-RED instead of adding the AWS IoT Core API inside Minecraft to avoid issues with the complex classloading system from Minecraft Forge and also because it's easy, simple and fun to use Node-RED as a gaming gateway to IoT devices.

To replicate this tutorial you will need:

1. Install Java Development Kit
2. Install Node-RED
3. Clone the github project
4. Configure AWS IoT Core
5. Configure Node-RED

Follow this tutorial to replicate this demo.

Check the running demo here:

We are using two different devices to provide sensors and control relay / lamp:

1. Playground4IoT: this is an open-source hardware project developed in Brazil that you can replicate, produce, use or sell it! This device uses an ESP32 module and has LCD display, accelerometer, temperature, humidity, light sensors, connectors for 200+ different sensors, connector for solar panel and battery recharger circuit.

2. ESP32 Do it your self device: this version is very simple to build it your self and it has an ESP32 module, temperature and humidity, relay board and some wires. You can follow this complete Let's Build tutorial to replicate the project:

• Let's Build #1: Introduction to ESP32
• Let's Build #2: Building your first IoT App
• Let's Build #3: Monitoring temperature and humidity with ESP32

This agent is a Python3 script that uses Amazon Rekognition and your computer's camera to recognize objects and send IoT messages to AWS IoT Core. This agent is very simple to run and you can use it for multiple projects: you can recognize helmet, mask, glasses, hat, count people and much more.

Follow this tutorial do build and run the AI2IoT Agent.