1.使用shell指令碼監聽錯誤日誌

監聽日誌檔案中含有”ERROR”的日誌

grep -E "ERROR " /big_data/log/log_bi_report/Report_$(date -d "$a days ago" +%Y-%m-%d).log

/big_data/log/log_bi_report/Report_(date−d"a days ago” +%Y-%m-%d).log是程式執行輸出的日誌檔案

2.編寫釘釘機器人呼叫python指令碼

#!/usr/bin/python
import requests
import json
import sys
import os

headers = {'Content-Type'
 
: 'application/json;charset=utf-8'}
api_url = "https://oapi.dingtalk.com/robot/send?access_token=7430c841a41d8161b9720de88*******************"

def msg(text):
    json_text= {
     "msgtype": "text",
        "at": {
            "atMobiles": [
                "136********"
            ],
            "isAtAll"
 
: False
        },
        "text": {
            "content": text
        }
    }
    print requests.post(api_url,json.dumps(json_text),headers=headers).content

if __name__ == '__main__':
    text = sys.argv[1]
    msg(text)

命名python檔案為dingdingrobot.py, 要記得chmod +x dingdingrobot.py

3.編寫呼叫dingdingrobot.py的指令碼dingdingrobot.sh

#!/bin/bash

if [ `grep -E "ERROR " /big_data/log/log_bi_report/Report_$(date -d "$a days ago" +%Y-%m-%d).log|wc -l`  -gt 0 ];then
DATA="`grep -E "ERROR " /big_data/log/log_bi_report/Report_$(date -d "$a days ago" +%Y-%m-%d).log`"
python /big_data/log/log_bi_report/dingdingrobot.py "$DATA" 
fi

4.每天定時呼叫dingdingrobot.sh檢查日誌錯誤併發送播報

crontab -e

#每天凌晨8點跑日誌錯誤檢查告警
00 08 * * *   /var/lib/hadoop-hdfs/dingdingrobot.sh >/dev/null 2>&1

5.整體思路流程

6.釘釘機器人安裝

這個過程大家在網上找找資料很簡單就出來了