Random Nerd Tutorials
Shares

ESP8266 and Node-RED with MQTT (Publish and Subscribe)

Shares

In this post we’re going to show you how to control ESP8266 outputs and display sensor data from the ESP8266 on Node-RED. The Node-RED software is running on a Raspberry Pi, and the communication between the ESP8266 and the Node-RED software is achieved with the MQTT communication protocol.

The following figure shows an overview of what we’re going to do in this tutorial.

First, watch the video demonstration below


Node-RED and Node-RED Dashboard

You need to have Node-RED and Node-RED Dashboard installed in your Raspberry Pi. The following blog posts are useful for getting started with Node-RED and Node-RED dashboard:

MQTT Protocol

In this tutorial we’re going to establish a communication between a Raspberry Pi running the Node-RED software and an ESP8266 using MQTT.

MQTT stands for MQ Telemetry Transport and it is a nice lightweight publish and subscribe system where you can publish and receive messages as a client. It is a simple messaging protocol, designed for constrained devices and with low-bandwidth. So, it’s the perfect solution for Internet of Things applications.

If you want to learn more about MQTT, watch the video below.


For a written version of this video and additional resources, read this blog post What is MQTT and How It Works.

Installing Mosquitto Broker

In MQTT, the broker is primarily responsible for receiving all messages, filtering the messages, decide who is interested in it and then publishing the message to all subscribed clients.

There are several brokers you can use. In this tutorial we’re going to use the Mosquitto Broker which needs to be installed on Raspberry Pi.

To install the Mosquitto broker on Raspberry pi follow the next steps.

For additional information you can read How to Install Mosquitto Broker on Raspberry Pi.

Updating the repository

To update the repository you need to import the repository package signing key:

pi@raspberry:~ $ wget http://repo.mosquitto.org/debian/mosquitto-repo.gpg.key
pi@raspberry:~ $ sudo apt-key add mosquitto-repo.gpg.key

Make the repository available to be installed with apt:

pi@raspberry:~ $ cd /etc/apt/sources.list.d/
pi@raspberrypi:/etc/apt/sources.list.d $

Then, run the following command:

pi@raspberrypi:/etc/apt/sources.list.d $ sudo wget http://repo.mosquitto.org/debian/mosquitto-jessie.list

Go back to the root directory:

pi@raspberrypi:/etc/apt/sources.list.d $ cd
pi@raspberry:~ $

Finally, update apt information:

pi@raspberry:~ $ sudo apt update

Installing

To install the Mosquitto broker and make it auto start enter the following command:

pi@raspberry:~ $ sudo apt install mosquitto
pi@raspberry:~ $ sudo systemctl enable mosquitto.service

You need to type Y and press Enter to confirm the installation.

Testing

To see if Mosquitto broker was successfully installed, send the following command:

pi@raspberry:~ $ mosquitto -v

This returns the Mosquitto version that is currently running in your Raspberry Pi. It should be 1.4 or above.

Note: the Mosquitto command returns the Mosquitto version that is currently installed, but it also tries to initialize Mosquitto again. Since Mosquitto is already running it prompts an error message. Don’t worry Mosquitto is properly installed and running if you see a similar message.

Establishing an MQTT communication with Node-RED

In this section we’re going to establish an MQTT communication using the Node-RED nodes.

Dashboard Layout

The first step is to create the dashboard layout. In this example, we’ll have a button to control an ESP8266 output; a chart and a gauge to display temperature and humidity readings from the DHT11 sensor.

On the top right corner of the Node-RED window, select the Layout tab under the dashboard tab. Create a tab called Room and inside the Room tab, create two groups: Lamp and Sensor as shown in figure below.

Creating the Flow

Drag the following nodes to the flow – see figure below:

  • switch – this will control the ESP8266 output
  • mqtt output node – this will publish a message to the ESP8266 accordingly to the switch state
  • 2x mqtt input nodes – this nodes will be subscribed to the temperature and humidity topics to receive sensor data from the ESP
  • chart – will display the temperature sensor readings
  • gauge – will display the humidity sensor readings

Node-RED and the MQTT broker need to be connected. To connect the MQTT broker to Node-REd, double-click the MQTT output node. A new window pops up – as shown in figure below.

  1. Click the Add new mqtt-broker option.
  2. Type localhost in the server field
  3. All the other settings are configured properly by default.
  4. Press Add and the MQTT output node automatically connects to your broker.

Edit all the other nodes properties as shown in the following figures:

  • switch – the switch sends an on  string message when it’s on; and sends an off string message when it’s off. This node will publish on the room/lamp topic. Your ESP will then be subscribed to this topic, to receive its messages.
  • mqtt output node. This node is connected to the mosquitto broker and it will publish in the room/lamp topic.
  • mqtt input node. This node is subscribed to the room/temperature topic to receive temperature sensor data from the ESP8266. The ESP8266 will be pusblishing the temperature readings on this topic.
  • chart. The chart will display the readings received on the room/temperature topic.
  • mqtt input node. This node is subscribed to the room/humidity topic to receive humidity sensor data from the ESP8266. The ESP8266 will be pusblishing the humidity readings on this same topic.
  • gauge. The gauge will display the readings received on the room/humidity topic.

Wire your nodes as shown in the figure below.

Your Node-RED application is ready. Click the Deploy button on the top right corner.

The Node-RED application is ready. To see how your dashboard looks go to  http://your-pi-ip-address/ui.

Now, follow the next sections to prepare your ESP8266.

Preparing your Arduino IDE

We’ll program the ESP8266 using the Arduino IDE. In order to upload code to your ESP8266 using the Arduino IDE, you need to install the ESP8266 add-on (How to Install the ESP8266 Board in Arduino IDE). You’ll also need to install two additional libraries to have everything ready for your ESP8266.

Installing the PubSubClient Library

The PubSubClient library provides a client for doing simple publish/subscribe messaging with a server that supports MQTT (basically allows your ESP8266 to talk with Node-RED).

1) Click here to download the PubSubClient library. You should have a .zip folder in your Downloads folder

2) Unzip the .zip folder and you should get pubsubclient-master folder

3) Rename your folder from pubsubclient-master to pubsubclient

4) Move the pubsubclient folder to your Arduino IDE installation libraries folder

5) Then, re-open your Arduino IDE

The library comes with a number of example sketches. See File >Examples > PubSubClient within the Arduino IDE software.

Installing the DHT Sensor Library

The DHT sensor library provides an easy way of using any DHT sensor to read temperature and humidity with your ESP8266 or Arduino boards.

1) Click here to download the DHT sensor library. You should have a .zip folder in your Downloads

2) Unzip the .zip folder and you should get DHT-sensor-library-master folder

3) Rename your folder from DHT-sensor-library-master to DHT

4) Move the DHT folder to your Arduino IDE installation libraries folder

5) Then re-open your Arduino IDE

For more information about the DHT11 sensor and the ESP8266, read ESP8266 DHT11/DHT22 Temperature and Humidity Web Server with Arduino IDE.

Selecting the right board on Arduino IDE

You also need to select the right board on Arduino IDE:

1) Go to Tools and select “NodeMCU 1.0 (ESP-12E Module)”.

2) Select your ESP port number under the Tools > Port > COM4 (in my case)

Uploading code

Now, you can upload the following code to your ESP8266. This code publishes messages of the temperature and humidity from the DHT11 sensor on the room/temperature and room/humidity topics trough MQTT protocol.

The ESP is subscribed to the room/lamp topic to receive the messages published on that topic by the Node-RED application, to turn the lamp on or off.

The code is well commented on where you need to make changes. You need to edit the code with your own SSID, password and RPi IP address.

This code is also compatible with other DHT sensors – you just need to uncomment and comment the right lines of code to chose your sensor.

After uploading the code, and with the Raspberry Pi running your Node-RED application and the Mosquitto broker, you can open the Arduino IDE serial monitor at a baud rate of 115200 and see what’s happening in real time.

This is helpful to check if the ESP has established a successful connection to your router and to the Mosquitto broker. You can also see the messages the ESP is receiving and publishing.

Building the Circuit

The following sections show you the needed parts and schematics to build the circuit for this project.

Parts required

These are the parts required to build the circuit (click the links below to find the best price at Maker Advisor):

You can use the preceding links or go directly to MakerAdvisor.com/tools to find all the parts for your projects at the best price!

Schematics

Here are the schematics for this project’s circuit.

Demonstration

Congratulations! You project is now completed.

Go to http://your-pi-ip-address/ui to control the ESP with the  Node-RED application. You can access your application in any browser on the same network that your Pi (watch the video demonstration below).


The application should look something the figure below.

Wrapping up

In this tutorial we’ve shown you the basic concepts that will allow you to turn on lights and monitor sensors on your ESP using Node-RED and the MQTT communication protocol. You can follow these basic steps to build more advanced projects.

We hope you’ve found this tutorial useful.

If you liked this project and Home Automation make sure you check our course: Build a Home Automation System for $100.

Recommended Resources

Home Automation using ESP8266 »
Build IoT projects and home automation gadgets with the ESP8266 Wi-Fi module.

Build a Home Automation System »
Learn how to build a automation system using open-source hardware and software from scratch.

Arduino Step-by-Step Projects »
Build 25 cool Arduino projects with our couse even with no prior experience!

Leave a Comment:

Add Your Reply

⏰ Early Black Friday 2017 Special ⏰
Download all our courses up to 35% off