elk-logstash-kibana(三)
阿新 • • 發佈:2018-08-25
source 類型 oat sage png 安裝 logs 編譯 mat
一、修改logstash.yml
unzip logstash-6.3.2 vim config/logstash.yml #添加:檢查所有ip http.host: "0.0.0.0"
二、在logstash下的config下創建(根據自己log日誌地址設置:安裝nginx等)
[elk@xiaoyuer config]$ cat syslog.conf input { syslog { type => "system-syslog" port => 10514 } } output { elasticsearch { hosts => ["139.199.124.136:9200"] # 定義es服務器的ip index => "system-syslog-%{+YYYY.MM.dd}" # 定義索引 } } input { file { # 指定一個文件作為輸入源 path => "/home/elk/nginx/logs/elk_access.log" # 指定文件的路徑 start_position => "beginning" # 指定何時開始收集 type => "nginx" # 定義日誌類型,可自定義 } } filter { # 配置過濾器 grok { match => { "message" => "%{IPORHOST:http_host} %{IPORHOST:clientip} - %{USERNAME:remote_user} \[%{HTTPDATE:timestamp}\] \"(?:%{WORD:http_verb} %{NOTSPACE:http_request}(?: HTTP/%{NUMBER:http_version})?|%{DATA:raw_http_request})\" %{NUMBER:response} (?:%{NUMBER:bytes_read}|-) %{QS:referrer} %{QS:agent} %{QS:xforwardedfor} %{NUMBER:request_time:float}"} # 定義日誌的輸出格式 } geoip { source => "clientip" } } output { stdout { codec => rubydebug } elasticsearch { hosts => ["139.199.124.136:9200"] index => "nginx-test-%{+YYYY.MM.dd}" } }
nginx日誌編譯二進制:
nginx添加: log_format main ‘$remote_addr - $remote_user [$time_local] "$request" ‘ ‘$status $body_bytes_sent "$http_referer" ‘ ‘"$http_user_agent" "$http_x_forwarded_for"‘; access_log logs/access.log main;
三、vim kibana.yml
tar xf kibana-6.3.2-linux-x86_64.tar.gz #vim kibana-6.3.2-linux-x86_64/config/kibana.yml
elasticsearch.url: "http://139.199.124.136:9200" #ela地址 server.host: 0.0.0.0 server.port: 5601 logging.dest: /elk/logs/kibana.log #日誌存放目錄,自定義
四、配置kibana服務器的ip以及配置的監聽端口:
vim /etc/rsyslog.conf
*.* @@192.168.77.130:10514
重啟rsyslog
systemctl restart rsyslog
-----------啟動服務查看
[root@xiaoyuer ~]# netstat -lntup|egrep ‘9600|5601‘
tcp 0 0 0.0.0.0:9600 0.0.0.0:* LISTEN 5076/java tcp 0 0 0.0.0.0:5601 0.0.0.0:* LISTEN 5073/node
五、啟動服務匯總
#cat /etc/rc.local /home/elk/nginx/sbin/nginx su -c ‘/home/elk/elasticsearch-6.3.2/bin/elasticsearch -d >>/dev/null 2>&1 &‘ elk #su -c ‘cd /home/elk/elasticsearch-head-master;grunt server >>/dev/null 2>&1 &‘ elk su -c ‘/home/elk/kibana-6.3.2-linux-x86_64//bin/kibana >>/dev/null 2>&1 &‘ elk su -c ‘/home/elk/logstash-6.3.2/bin/logstash -f /home/elk/logstash-6.3.2/config/syslog.conf >>/dev/null 2>&1 &‘ elk #su -c ‘/home/elk/filebeat-6.3.2-linux-x86_64/filebeat &‘ elk
elk-logstash-kibana(三)