centos 本人親測可以 首先安裝好mysql，elasticsearch 不懂的請參考另一篇文章

安裝logstash
官方：https://www.elastic.co/guide/en/logstash/current/installing-logstash.html
1.下載公共密鑰
rpm --import https://artifacts.elastic.co/GPG-KEY-elasticsearch
2.添加yum源
vim /etc/yum.repos.d/logstash.repo
文件中寫入
[logstash-5.x]
name=Elastic repository for 5.x packages
baseurl=https://artifacts.elastic.co/packages/5.x/yum
gpgcheck=1
gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticsearch
enabled=1
autorefresh=1
type=rpm-md
保存退出
3.使用yum安裝
yum install logstash
4.驗證是否安裝成功
進入 logstash 安裝目錄
cd /usr/share/logstash
運行
bin/logstash -e ‘input { stdin { } } output { stdout {} }‘
等待幾秒鐘 出現
The stdin plugin is now waiting for input:
然後輸入
hello world
得到類似的結果
2016-11-24T08:01:55.949Z bogon hello world

安裝logstash-input-jdbc插件

1.安裝 ruby 和 rubygems（註意：需要 ruby 的版本在 1.8.7 以上）
# yum install -y ruby rubygems
檢查 ruby 版本：
# ruby -v
ruby 1.8.7 (2013-06-27 patchlevel 374) [x86_64-linux]
替換國內的鏡像
gem sources --remove http://rubygems.org/

gem sources -a http://gems.ruby-china.org/
驗證是否成功
gem sources -l
修改Gemfile的數據源地址
whereis logstash # 查看logstash安裝的位置， 我的在 /usr/share/logstash目錄

cd /usr/share/logstash
vim Gemfile
修改 source 的值 為： "https://gems.ruby-china.org/"

vim Gemfile.jruby-1.9.lock

# 找到 remote 修改它的值為：https://gems.ruby-china.org/

開始安裝

./bin/logstash-plugin install --no-verify logstash-input-jdbc

2.寫配置文件開始同步 vi xxx.conf

1. input {
2. jdbc {
3. type => "user"
4. jdbc_connection_string => "jdbc:mysql://192.168.33.101:3306/test"
5. jdbc_user => "root"
6. jdbc_password => "123456"
7. jdbc_driver_library => "/usr/share/logstash/mysql-connector-java-5.1.41.jar"
8. jdbc_driver_class => "com.mysql.jdbc.Driver"
9. jdbc_paging_enabled => "true"
10. jdbc_page_size => "1000"
11. statement => "select * from user"
12. schedule => "* * * * *"
13. }
15. jdbc {
16. type => "task"
17. jdbc_connection_string => "jdbc:mysql://192.168.33.101:3306/test"
18. jdbc_user => "root"
19. jdbc_password => "123456"
20. jdbc_driver_library => "/usr/share/logstash/mysql-connector-java-5.1.41.jar"
21. jdbc_driver_class => "com.mysql.jdbc.Driver"
22. jdbc_paging_enabled => "true"
23. jdbc_page_size => "1000"
24. statement => "select * from task"
25. schedule => "* * * * *"
26. }
27. }
29. filter{
30. mutate{
31. remove_field => [ "@timestamp", "@version"]
32. }
33. }
35. output {
36. if [type] == "user" {
37. elasticsearch {
38. hosts => ["192.168.33.111:9200","192.168.33.112:9200","192.168.33.113:9200"]
39. index => "testindex"
40. document_type => "user"
41. document_id => "%{id}"
42. user => "elastic"
43. password => "changeme"
44. }
45. }
46. if [type] == "task" {
47. elasticsearch {
48. hosts => ["192.168.33.111:9200","192.168.33.112:9200","192.168.33.113:9200"]
49. index => "testindex"
50. document_type => "task"
51. document_id => "%{id}"
52. user => "elastic"
53. password => "changeme"
54. }
55. }
56. }

elasticsearch5.2.1使用logstash同步mysql