Table of Contents

1. Challenge

   Install Alertmanager

   1. Log in to the Prometheus server.

   2. Create a user and group for Alertmanager:

      sudo useradd -M -r -s /bin/false alertmanager
      

   3. Download and install the Alertmanager binaries:

      wget https://github.com/prometheus/alertmanager/releases/download/v0.20.0/alertmanager-0.20.0.linux-amd64.tar.gz
      

      tar xvfz alertmanager-0.20.0.linux-amd64.tar.gz
      

      sudo cp alertmanager-0.20.0.linux-amd64/alertmanager /usr/local/bin/
      

      sudo chown alertmanager:alertmanager /usr/local/bin/alertmanager
      

      sudo mkdir -p /etc/alertmanager
      

      sudo cp alertmanager-0.20.0.linux-amd64/alertmanager.yml /etc/alertmanager
      

      sudo chown -R alertmanager:alertmanager /etc/alertmanager
      

      sudo mkdir -p /var/lib/alertmanager
      

      sudo chown alertmanager:alertmanager /var/lib/alertmanager
      

   4. Create a systemd unit for Alertmanager:

      sudo vi /etc/systemd/system/alertmanager.service
      

      [Unit]
      Description=Prometheus Alertmanager
      Wants=network-online.target
      After=network-online.target
      
      [Service]
      User=alertmanager
      Group=alertmanager
      Type=simple
      ExecStart=/usr/local/bin/alertmanager 
        --config.file /etc/alertmanager/alertmanager.yml 
        --storage.path /var/lib/alertmanager/
      
      [Install]
      WantedBy=multi-user.target
      

   5. Start and enable the alertmanager service:

      sudo systemctl enable alertmanager
      

      sudo systemctl start alertmanager
      

   6. Verify the service is running and you can reach it:

      sudo systemctl status alertmanager
      

      curl localhost:9093
      

   7. You can also access Alertmanager in a web browser at http://<PROMETHEUS_SERVER_PUBLIC_IP>:9093.

2. Challenge

   Install `amtool`

   1. Install the amtool binary:

      sudo cp alertmanager-0.20.0.linux-amd64/amtool /usr/local/bin/
      

   2. Create a config file for amtool:

      sudo mkdir -p /etc/amtool
      

      sudo vi /etc/amtool/config.yml
      

   3. Enter the following content in the config file:

      alertmanager.url: http://localhost:9093
      

   4. Verify amtool is working by pulling the current Alertmanager configuration:

      amtool config show
      

3. Challenge

   Configure Prometheus to Use Alertmanager

   1. Edit the Prometheus config:

      sudo vi /etc/prometheus/prometheus.yml
      

   2. Under alerting, add your Alertmanager as a target:

      alerting:
        alertmanagers:
        - static_configs:
          - targets: ["localhost:9093"]
      

   3. Restart Prometheus to reload the configuration:

      sudo systemctl restart prometheus
      

   4. Verify Prometheus is able to reach the Alertmanager. Access the Prometheus Expression Browser in a web browser at http://<PROMETHEUS_SERVER_PUBLIC_IP>:9090/graph. Run the following query and ensure the current value is 1:

      prometheus_notifications_alertmanagers_discovered