Quickly deploy mqtt clusters on AWS using terraform

Terraform By HashiCorp An infrastructure launched is code （IaC） Tools , It includes low-level components such as computing instances 、 Storage and networking , And high-level components such as DNS、LBS etc. . Users can use Terraform Security 、 Build... Efficiently 、 Change and update infrastructure .

In the traditional private cloud or public cloud deployment , Users need to deploy the infrastructure first （ virtual machine 、 Network and storage, etc ）, Before deployment MQTT colony . And if you use Terraform, Users can complete these two tasks at the same time . Besides , The same set of tools can be deployed on different platforms , Repeatable by template 、 Define and configure resources in a predictable way , It can greatly reduce errors caused by human factors .

This article will focus on the distributed Internet of things ​ ​MQTT Message server EMQX​​ For example , use AWS As a public cloud platform , How to use Terraform Quickly deploy a highly available ​ ​MQTT colony ​​.

Terraform brief introduction

As a tool to manage the service life cycle ,Terraform You can use status files to record and track all environmental changes . The default state is stored locally , adopt HCL perhaps JSON To define ,HCL yes HashiCorp The template language provided .

• Coding： use HCL To write infrastructure code . Blocks can be defined , Parameters and expressions .
• Plan： function Terraform Plan To check whether the implementation plan meets expectations .
• Apply： function Terraform Apply To build the infrastructure that users need

Installation and preparation

install Terraform

With Mac For example , adopt brew install .

Log in and copy

      
      

       
       brew tap hashicorp/tap 2brew install hashicorp/tap/terraform
      
      
      
      

       
       
1.
      
      

Verify the installation

Log in and copy

      
      

       
       terraform 
       
       -help
      
      
      
      

       
       
1.
      
      

Specific reference ​ ​ Official documents ​​

install AWS Cli

With Mac For example

Log in and copy

      
      

       
       curl "https://awscli.amazonaws.com/AWSCLIV2.pkg" -o "AWSCLIV2.pkg"
       
       
sudo installer -pkg AWSCLIV2.pkg -target /
      
      
      
      

       
       
1.
       
       
2.
      
      

Verify the installation

Log in and copy

      
      

       
       which aws
       
       
aws --version
      
      
      
      

       
       
1.
       
       
2.
      
      

Reference resources ​ ​ Official documents ​​

Add users

1. Get into AWS Of IAM menu , Click on “ Add users ”

2. In adding users , Remember to check “ Access key ”
   

3. choice “ Create group ”
   

4. Add “AdministratorAccess” Strategy

5. Click on “ Create user ”, Finish adding users

6. obtain Access Key and Secret

To configure AWS Of Access Key

Get the one created above access key and secret, Set the environment variable

Log in and copy

      
      

       
       AWS_ACCESS_KEY_ID: ${anaccesskey}
       
       
AWS_SECRET_ACCESS_KEY: ${asecretkey}
      
      
      
      

       
       
1.
       
       
2.
      
      

Use Terraform stay AWS Upper Department EMQX colony

download AWS Deployment scripts

Log in and copy

      
      

       
       git clone 
       
       "https://github.com/emqx/terraform-emqx-emqx-aws.git"
      
      
      
      

       
       
1.
      
      

Deployment script description ：

• Temporarily not supported EMQX 5.X
• AWS CLI：aws-cli/2.2.41 Python/3.8.8 Darwin/21.4.0 exe/x86_64 prompt/off

Script configuration file path ：

• Stand alone deployment Profile ：services/emqx/terraform.tfvars
• Cluster deployment profile ：services/emqx_cluster/terraform.tfvars

The deployment script uses the following configuration by default , Readers can modify it according to the actual situation terraform.tfvars file ：

• Default EMQX edition ： Enterprise Edition 4.4.3

If you want to deploy the open source version , Need modification ​​emqx_package​​ value , For example, deploy the open source version 4.4.3：​​https://www.emqx.com/en/downloads/broker/v4.4.3/emqx-4.4.3-otp23.3.4.9-3-ubuntu20.04-amd64.zip​​

• Default AWS Region by us-east-1
• Default cluster node ：3 platform ​​t3.small​​

Deploy EMQX colony

Users can modify terraform.tfvars file , To change the default configuration

Log in and copy

      
      

       
       cd services/emqx_cluster
       
       
terraform init
       
       
terraform plan
       
       
terraform apply 
       
       -auto
       
       -approve
      
      
      
      

       
       
1.
       
       
2.
       
       
3.
       
       
4.
      
      

Wait a few minutes , The results of the deployment are as follows

verification EMQX Cluster deployment results

After the cluster deployment is successful , We can simply test whether the cluster is running normally . First get the cluster's IP Address , And access through the following information EMQX Enterprise Edition Dashboard.

user name ：​​admin​​

password ：​​public​​

http://tf-elb-nlb-5bff6976b15586dd.elb.us-east-1.amazonaws.com:18083

We can see from the above figure that we have deployed 3 Nodes , You can pass Websocket Tools for simple verification ：

1. Select tools in the left menu bar →WebSocket
   

2. Click on “ Connect ”
   

3. Subscribe to topics

4. Click publish , Normally, you can see the following results

Conclusion

thus , We've done it through Terraform stay AWS On rapid deployment MQTT The whole process of the cluster . Readers can modify the deployment script according to the actual situation , Create a EMQX colony , With the help of EMQX Data connection in the Internet of things 、 Advantages in mobile and processing, build a competitive Internet of things platform and Application .

Reference resources ：

Code warehouse ：​ ​https://github.com/emqx/terraform-emqx-emqx-aws​​

EMQX Terraform Module official documentation ：​ ​https://docs.emqx.com/zh/emqx-terraform/latest​​

Copyright notice ： This paper is about EMQ original , Reprint please indicate the source .

Link to the original text ：​ ​https://www.emqx.com/zh/blog/deploy-mqtt-cluster-on-aws-using-terraform​​