2. 程式人生 > >LVS/NAT + keepalived負載均衡實現

LVS/NAT + keepalived負載均衡實現

阿新 • • 發佈：2018-05-19
ha lvs nat keepaliv

一、keepalived簡介

keepalived是分布式部署解決系統高可用的軟件，結合lvs(LinuxVirtual Server)使用，解決單機宕機的問題。
keepalived是一個基於VRRP協議來實現IPVS的高可用的解決方案。對於LVS負載均衡來說，如果前端的調度器direct發生故障，則後端的realserver是無法接受請求並響應的。因此，保證前端direct的高可用性是非常關鍵的，否則後端的服務器是無法進行服務的。而我們的keepalived就可以用來解決單點故障（如LVS的前端direct故障）問題。keepalived的主要工作原理是：運行keepalived的兩臺服務器，其中一臺為

MASTER，另一臺為BACKUP，正常情況下，所有的數據轉換功能和ARP請求響應都是由MASTER完成的，一旦MASTER發生故障，則BACKUP會馬上接管MASTER的工作，這種切換時非常迅速的。

二、測試環境

下面拿4臺虛擬機進行環境測試,實驗環境為centos6.6 x86_64,在lvs NAT模式環境下只有前端兩臺keepalived調度機有公網ip，後端真實機只有內網ip，具體用途和ip如下

服務器類型

公網ip

內網ip

LVS VIP

192.168.214.70

192.168.211.254

Keepalived Master

192.168.214.76

192.168.211.76

Keepalived Backup

192.168.214.77

192.168.211.77

Realserver A


192.168.211.79

Realserver B


192.168.211.83

三、軟件安裝

1、安裝lvs所需包ipvsadm

yum install -y ipvsadm

ln -s /usr/src/kernels/`uname -r` /usr/src/linux

lsmod |grep ip_vs

#註意Centos 6.X安裝lvs，使用1.26版本。並且需要先安裝yuminstall libnl* popt* -y

執行ipvsadm(modprobe ip_vs)把ip_vs模塊加載到內核

[root@test85 ~]# ipvsadm -L -n

IP Virtual Server version 1.2.1 (size=4096)

Prot LocalAddress:Port Scheduler Flags

-> RemoteAddress:Port Forward Weight ActiveConn InActConn

#IP Virtual Server version 1.2.1 ---- ip_vs內核模塊版本

2、安裝keepalived

yum install -y keepalived

chkconfig keepalived on

註：在centos7系列系統中開機自動啟動使用systemctl enable keepalived


四、開啟路由轉發

在lvs/NAT模式下前端兩臺調度機192.168.211.76和192.168.211.77上需要開啟路由轉發功能

vi /etc/sysctl.conf

修改net.ipv4.ip_forward = 0為net.ipv4.ip_forward= 1

保存退出後，使用systcl –p命令讓其生效

五、keepalived配置

先看下211.76 keepalivedmaster主機上的配置

具體詳細的參數說明見上篇LVS/DR + keepalived負載均衡實現

[root@localhost ~]# cat /etc/keepalived/keepalived.conf 
! Configuration File for keepalived

global_defs {
   notification_email {
     [email protected] 
   }
   notification_email_from [email protected] 
   #smtp_server 127.0.0.1 
   #smtp_connect_timeout 30
    router_id LVS_1
   #lvs_id LVS_EXAMPLE_01 
}

vrrp_sync_group VG1 {
   group {
      VI_1
      VI_GATEWAY
   }
} 

vrrp_instance VI_1 {
    state MASTER
    interface eth0    #公網ip網口
    virtual_router_id 51
    priority 150
    advert_int 1
    lvs_sync_daemon_inteface eth0
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.214.70    #公網vip地址
    }
}

vrrp_instance VI_GATEWAY {
    state MASTER
    interface eth1         #內網ip網口
    lvs_sync_daemon_inteface eth1
    virtual_router_id 52
    priority 150
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.211.254  #內網vip地址
    }
}

virtual_server 192.168.214.70 80 {
    delay_loop 6
    lb_algo rr
    lb_kind NAT         #使用lvs的NAT工作模式
    #nat_mask 255.255.255.0
    persistence_timeout 10 
    protocol TCP

    real_server 192.168.211.79 80 {
        TCP_CHECK {
            connect_timeout 3
            connect_port 80
            nb_get_retry 3
            delay_before_retry 3
        }
    }
   real_server 192.168.211.83 80 {
        TCP_CHECK {
            connect_timeout 3
            connect_port 80
            nb_get_retry 3
            delay_before_retry 3
        }
    }
}


再看下211.77 keepalived BACKUP主機上的配置

[root@localhost ~]# cat /etc/keepalived/keepalived.conf 
! Configuration File for keepalived
global_defs {
   notification_email {
     [email protected] 
   }
   notification_email_from [email protected] 
   #smtp_server 127.0.0.1 
   #smtp_connect_timeout 30
   router_id LVS_1
   #lvs_id LVS_EXAMPLE_02 
}

vrrp_sync_group VG1 {
   group {
      VI_1
      VI_GATEWAY
   }
} 

vrrp_instance VI_1 {
    state BACKUP
    interface eth0
    lvs_sync_daemon_inteface eth0
    virtual_router_id 51
    priority 100
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.214.70 
    }
}

vrrp_instance VI_GATEWAY {
    state BACKUP
    interface eth1
    lvs_sync_daemon_inteface eth1
    virtual_router_id 52
    priority 100
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.211.254 
    }
}

virtual_server 192.168.214.70 80 {
    delay_loop 6
    lb_algo rr
    lb_kind NAT
    #nat_mask 255.255.255.0
    persistence_timeout 10
    protocol TCP

 real_server 192.168.211.79 80 {
        TCP_CHECK {
            connect_timeout 3
            connect_port 80
            nb_get_retry 3
            delay_before_retry 3
        }
    }
real_server 192.168.211.83 80 {
        TCP_CHECK {
            connect_timeout 3
            connect_port 80
            nb_get_retry 3
            delay_before_retry 3
        }
    }

}

六、後端真實機配置

後端兩臺web服務真實機192.168.211.79和192.168.211.83需要配置默認網關為vip內網ip地址192.168.211.254。

註意，線上環境如果更改默認網關為vip內網地址後，可能會造成連接不上服務器，需要提前添加相關靜態路由。

七、啟動keepalived服務及查看相關信息

在211.76和211.77上分別啟動keepalived服務

在211.76keepalived Master主機上查看信息

通過ip addr可以看到vip 地址已經綁定在eth0和eth1網口

[root@localhost ~]# ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu65536 qdisc noqueue state UNKNOWN 
   link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
   inet 127.0.0.1/8 scope host lo
   inet6 ::1/128 scope host 
      valid_lft forever preferred_lft forever
2: eth0:<BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen1000
   link/ether 52:54:00:55:b2:d4 brd ff:ff:ff:ff:ff:ff
   inet 192.168.214.76/24 brd 192.168.214.255 scope global eth0
   inet 192.168.214.70/32 scope global eth0
   inet6 fe80::5054:ff:fe55:b2d4/64 scope link 
      valid_lft forever preferred_lft forever
3: eth1:<BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen1000
   link/ether 52:54:00:85:11:95 brd ff:ff:ff:ff:ff:ff
   inet 192.168.211.76/24 brd 192.168.211.255 scope global eth1
   inet 192.168.211.254/32 scope global eth1
   inet6 fe80::5054:ff:fe85:1195/64 scope link 
      valid_lft forever preferred_lft forever

在211.76上查看日誌信息，看到已成功進入keepalived主機模式
[root@localhost ~]# tail -f/var/log/messages
May 10 10:25:47 localhostKeepalived_vrrp[6210]: VRRP_Instance(VI_GATEWAY) setting protocol VIPs.
May 10 10:25:47 localhost Keepalived_healthcheckers[6209]:Netlink reflector reports IP 192.168.211.254 added
May 10 10:25:47 localhostKeepalived_vrrp[6210]: VRRP_Instance(VI_GATEWAY) Sending gratuitous ARPs oneth1 for 192.168.211.254
May 10 10:25:47 localhostKeepalived_vrrp[6210]: VRRP_Group(VG1) Syncing instances to MASTER state
May 10 10:25:47 localhostKeepalived_vrrp[6210]: VRRP_Instance(VI_1) EnteringMASTER STATE
May 10 10:25:47 localhostKeepalived_vrrp[6210]: VRRP_Instance(VI_1) setting protocol VIPs.
May 10 10:25:47 localhost Keepalived_healthcheckers[6209]:Netlink reflector reports IP 192.168.214.70 added
May 10 10:25:47 localhostKeepalived_vrrp[6210]: VRRP_Instance(VI_1) Sendinggratuitous ARPs on eth0 for 192.168.214.70
May 10 10:25:52 localhostKeepalived_vrrp[6210]: VRRP_Instance(VI_GATEWAY) Sendinggratuitous ARPs on eth1 for 192.168.211.254
May 10 10:25:52 localhostKeepalived_vrrp[6210]: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for192.168.214.70


在211.77上查看日誌信息，看到已成功進入keepalived備機模式

[root@localhost ~]# tail -f/var/log/messages
May 10 10:27:54 localhostKeepalived_vrrp[6249]: Opening file '/etc/keepalived/keepalived.conf'.
May 10 10:27:54 localhostKeepalived_vrrp[6249]: Configuration is using : 69554 Bytes
May 10 10:27:54 localhostKeepalived_vrrp[6249]: Using LinkWatch kernel netlink reflector...
May 10 10:27:54 localhostKeepalived_vrrp[6249]: VRRP_Instance(VI_1) Entering BACKUP STATE
May 10 10:27:54 localhostKeepalived_vrrp[6249]: VRRP_Instance(VI_GATEWAY) Entering BACKUP STATE
May 10 10:27:54 localhost Keepalived_vrrp[6249]:VRRP sockpool: [ifindex(2), proto(112), unicast(0), fd(10,11)]
May 10 10:27:54 localhostKeepalived_vrrp[6249]: VRRP sockpool: [ifindex(3), proto(112), unicast(0),fd(12,13)]
May 10 10:27:54 localhostKeepalived_healthcheckers[6248]: Using LinkWatch kernel netlink reflector...
May 10 10:27:54 localhostKeepalived_healthcheckers[6248]: Activating healthchecker for service[192.168.211.79]:80
May 10 10:27:54 localhostKeepalived_healthcheckers[6248]: Activating healthchecker for service[192.168.211.83]:80

通過ipvsadm -L –n 查看相應lvs連接信息
[root@localhost ~]# ipvsadm -L -n
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
TCP 192.168.214.70:80 rr persistent 10
-> 192.168.211.79:80 Masq 1 0 0
-> 192.168.211.83:80 Masq 1 3 0


八、keepalived測試

使用vip地址192.168.214.70訪問後端192.168.211.79和192.168.211.83的頁面

技術分享圖片

技術分享圖片

正常訪問沒問題後，我們來模擬lvs集群故障，讓主備進行自動切換下

首先把keepalived master主機211.76宕機，看備機能否接管過來，vip地址是否會漂移過來

在211.77上查看日誌，發現備機成功切換成了主機狀態，vip地址成功漂移了過來

[root@localhost ~]# ip addr

1: lo: <LOOPBACK,UP,LOWER_UP> mtu65536 qdisc noqueue state UNKNOWN

link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00

inet 127.0.0.1/8 scope host lo

inet6 ::1/128 scope host

valid_lft forever preferred_lft forever

2: eth0:<BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen1000

link/ether 52:54:00:1b:a2:11 brd ff:ff:ff:ff:ff:ff

inet 192.168.214.77/24 brd 192.168.214.255 scope global eth0

inet 192.168.214.70/32 scope global eth0

inet6 fe80::5054:ff:fe1b:a211/64 scope link

valid_lft forever preferred_lft forever

3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP>mtu 1500 qdisc pfifo_fast state UP qlen 1000

link/ether 52:54:00:64:47:7d brd ff:ff:ff:ff:ff:ff

inet 192.168.211.77/24 brd 192.168.211.255 scope global eth1

inet 192.168.211.254/32 scope global eth1

inet6 fe80::5054:ff:fe64:477d/64 scope link

valid_lft forever preferred_lft forever


[root@localhost ~]# tail -f /var/log/messages
May 10 10:27:54 localhost Keepalived_vrrp[6249]: Opening file '/etc/keepalived/keepalived.conf'.
May 10 10:27:54 localhost Keepalived_vrrp[6249]: Configuration is using : 69554 Bytes
May 10 10:27:54 localhost Keepalived_vrrp[6249]: Using LinkWatch kernel netlink reflector...
May 10 10:27:54 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_1) Entering BACKUP STATE
May 10 10:27:54 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_GATEWAY) Entering BACKUP STATE
May 10 10:27:54 localhost Keepalived_vrrp[6249]: VRRP sockpool: [ifindex(2), proto(112), unicast(0), fd(10,11)]
May 10 10:27:54 localhost Keepalived_vrrp[6249]: VRRP sockpool: [ifindex(3), proto(112), unicast(0), fd(12,13)]
May 10 10:27:54 localhost Keepalived_healthcheckers[6248]: Using LinkWatch kernel netlink reflector...
May 10 10:27:54 localhost Keepalived_healthcheckers[6248]: Activating healthchecker for service [192.168.211.79]:80
May 10 10:27:54 localhost Keepalived_healthcheckers[6248]: Activating healthchecker for service [192.168.211.83]:80
May 10 11:09:26 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_1) Transition to MASTER STATE
May 10 11:09:26 localhost Keepalived_vrrp[6249]: VRRP_Group(VG1) Syncing instances to MASTER state
May 10 11:09:26 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_GATEWAY) Transition to MASTER STATE
May 10 11:09:27 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_GATEWAY) Entering MASTER STATE
May 10 11:09:27 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_GATEWAY) setting protocol VIPs.
May 10 11:09:27 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_GATEWAY) Sending gratuitous ARPs on eth1 for 192.168.211.254
May 10 11:09:27 localhost Keepalived_healthcheckers[6248]: Netlink reflector reports IP 192.168.211.254 added
May 10 11:09:27 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_1) Entering MASTER STATE
May 10 11:09:27 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_1) setting protocol VIPs.
May 10 11:09:27 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.214.70
May 10 11:09:27 localhost Keepalived_healthcheckers[6248]: Netlink reflector reports IP 192.168.214.70 added
May 10 11:09:32 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_GATEWAY) Sending gratuitous ARPs on eth1 for 192.168.211.254
May 10 11:09:32 localhost Keepalived_vrrp[6249]: VRRP_Instance(VI_1) Sending


如果想了解更多，請關註我們的公眾號
公眾號ID:opdevos

掃碼關註

技術分享圖片

LVS/NAT + keepalived負載均衡實現

相關推薦

LVS/NAT + keepalived負載均衡實現

ha lvs nat keepaliv 一、keepalived簡介keepalived是分布式部署解決系統高可用的軟件，結合lvs(LinuxVirtual Server)使用，解決單機宕機的問題。keepalived是一個基於VRRP協議來實現IPVS的高可用的解決方案。對於LVS負載均衡

LVS/NAT雙主 + keepalived負載均衡實現

ha lvs 雙主 keepalive 一、keepalived簡介keepalived是分布式部署解決系統高可用的軟件，結合lvs(LinuxVirtual Server)使用，解決單機宕機的問題。keepalived是一個基於VRRP協議來實現IPVS的高可用的解決方案。對於LVS負載均衡

LVS/DR + keepalived負載均衡高可用實現

ha lvs keepalive 一、keepalived簡介keepalived是分布式部署解決系統高可用的軟件，結合lvs(LinuxVirtual Server)使用，解決單機宕機的問題。keepalived是一個基於VRRP協議來實現IPVS的高可用的解決方案。對於LVS負載均衡來說，如果

使用虛擬機器實現lvs nat模式負載均衡

1.準備伺服器與配置網路 以真實PC機作為使用者，為節省資源在虛擬機器中只克隆配置了3臺centos伺服器，一臺作為LVS伺服器，兩臺作為真正處理資料的web伺服器，由於LVS伺服器充當了路由的功能，所以要兩個網絡卡，LVS伺服器連線主機的網絡卡用Host-only方式與

基於LVS的負載均衡實現之NAT

ftp服務器 replicat 會話 集群 負載均衡技術 方式 conn 需要 執行 一 什麽是負載均衡 負載均衡，英文名稱為Load Balance，其意思就是分攤到多個操作單元上進行執行，例如Web服務器、FTP服務器、企業關鍵應用服務器和其它關鍵任務服務器等，從而共同

LVS-NAT與LVS-DR類型的負載均衡實現原理

限制 ann 所有 來講 默認 51cto 沖突 lvs-dr 配置 lvs-dr類型工作原理：①：client端向目標IP(VIP)發送請求，經由路由器和交換機設備和後，此時的請求數據包頭文件的目標MAC值為調度器的MAC，源MAC值為client的MAC，目標IP為VI

MySQL 高可用：mysql+Lvs+Keepalived 負載均衡及故障轉移

ica 目錄 details software fwm 多個 優先級 sql 服務器 規則 轉自 MySQL 高可用：mysql+Lvs+Keepalived 負載均衡及故障轉移 - KK ——專註數據 - 博客頻道 - CSDN.NETh

實現基於Haproxy_NAT+Keepalived負載均衡高可用架構

haproxy實驗思路：1.做這個實驗首先可以想象一個場景，用戶訪問webserver的時候首先會經過調度器，首先需要明白的一點就是一般公司一般是在內網，客戶端是通過外網訪問webserver的。2.haproxy是一個負載均衡器，Keepalived通過VRRP功能能再結合LVS負載均衡軟件即可部署一個高性

實現基於Haproxy+Keepalived負載均衡高可用架構

keepalived+haproxy一：環境準備centos系統服務器4臺，兩臺用於做haproxy主從架構，兩臺作為後端server,服務器配置好yum源，防火墻關閉，關閉selinux,各節點時鐘服務同步，各節點之間可以通過主機名互相通信。二：安裝步驟1.iptables –F &&set

keepalived lvs 高可用負載均衡

keepalived lvs 高可用 負載均衡 主分發器設置 安裝keepalived和nginxyum install -y keepalivedyum install -y nginx關閉防火墻和SELinuxsystemctl stop firewalldsetenforce 0配置網卡

LVS DR模式負載均衡搭建、keepalived高可用+LVS負載均衡配合

lvs lvs dr模式 lvs負載均衡 keepalived+LVS LVS DR模式搭建 準備：dir（調度器）：192.168.188.2rs1：192.168.188.3rs2：192.168.188.6vip：192.168.188.200 安裝ipvsadm yum insta

Consul+Nginx+Upsync+Linux+Keepalived+Lvs的動態負載均衡

node 查看ip 存在 pop tar -c onf www The 註： Nginx版本必須大於等於1.9，linux我使用的是7.0版本，記得關閉防火墻 開始正文： 這裏只提一下兩個比較會出錯的配置，consul，upsync，PCRE庫，SSL庫，ZLIB庫的配

LVS+Keepalived負載均衡主備&雙主架構全攻略

LVS+Keepalived 介紹 LVS LVS 是 Linux Virtual Server 的簡寫，意即 Linux 虛擬伺服器，是一個虛擬的伺服器集群系統。本專案在 1998 年 5 月由章文嵩博士成立，是中國國內最早出現的自由軟體專案之一。目前有三種 IP 負載均衡技術（VS/NAT、VS/TUN

Lvs負載均衡實現

NAT模式 NAT模式的優點是伺服器可以執行任何支援TCP/IP的作業系統,它只需要一個IP地址配置在排程器上,伺服器組可以用私有的IP地址。缺點是它的伸縮能力有限, 當伺服器結點數目上升到20時,排程器本身有可能成為系統的新瓶頸,因為在NAT模式中請求和響應

搭建LVS-DR負載均衡叢集、Keepalived-LVS高可用負載均衡叢集

LVS DR模式搭建準備工作三臺機器， 三臺機器均有公網IP。排程器（director）IP：192.168.8.133real server1(real1)IP：192.168.8.134real server2(real2)IP：192.168.8.135VIP：192.

CentOS7 搭建LVS+keepalived負載均衡（二）

本文講繼續講述LVS+keepalived實現負載均衡 一、本次搭建的系統架構圖 - 虛擬機器：VirtualBox - virtaulbox host-only的IP地址：192.168.137.1 - 所用系統：CentOS7 - 真實we

Keepalived+LVS高可用負載均衡配置

說明 LVS是Linux Virtual Server的簡寫，意即Linux虛擬伺服器，是一個虛擬的伺服器集群系統。本專案在1998年5月由章文嵩博士成立，是中國國內最早出現的自由軟體專案之一。 目前有三種IP負載均衡技術（VS/NAT、VS/TUN和VS/DR）；十

LVS+Keepalived負載均衡配置部署

相關概念 一、準備工作 1. 伺服器、作業系統（當前CentOS6.6 x86_64）、網路環境（服務期間網路互通） ； # 作業系統：CentOS6.6 x86_64# 伺服器 （LVS主備各1臺，WEB伺服器3臺，圖片伺服器2臺）WEBServer負載虛擬IP：192.168.0.20IMGServ

Keepalived+LVS高可用負載均衡

一、Keepablived介紹 1、簡介 Keepalived是一個用C語言編寫的軟體。該專案的主要目標是為Linux系統和基於Linux的基礎架構提供簡單而強大的負載均衡及高可用性。 負載平衡框架依賴於眾所周知且廣泛使用的Linux虛擬伺服器（IP

Lvs的安裝及負載均衡實現

Lvs安裝 1.首先配置yum源，本機配置映象版本為6.5，如圖所示： 在Linux2.4核心以前，使用Lvs時必須要重新編譯核心以支援LVS功能模組，但是從Linux2.4核心以後，已經完全內建了LVS的各個功能模組，只需要下載ipvsadm 即可使用