1. 程式人生 > 其它 >docker部署kafka、kafkamanager、zookeeper

docker部署kafka、kafkamanager、zookeeper

我這裡是將kafka和zookeeper放在一個yml檔案中的,其實可以把這三個都放在一個yml裡面,就不會出現網路不通的問題了。

zookeeper和kafka

# yaml 配
version: '2'
services:
    zookeeper:
        image: wurstmeister/zookeeper
        restart: always
        ports:
            - 2181:2181
    kafka1:
        image: wurstmeister/kafka
        restart: always
        depends_on:
            
- zookeeper ports: - 9093:9093 environment: KAFKA_ADVERTISED_HOST_NAME: kafka1 KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181/kafka KAFKA_LISTENERS: PLAINTEXT://:9093 KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://192.168.1.6:9093 KAFKA_BROKER_ID: 1
kafka2: image: wurstmeister/kafka restart: always depends_on: - zookeeper ports: - 9094:9094 environment: KAFKA_ADVERTISED_HOST_NAME: kafka2 KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181/kafka KAFKA_LISTENERS: PLAINTEXT:
//:9094 KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://192.168.1.6:9094 KAFKA_BROKER_ID: 2 kafka3: image: wurstmeister/kafka restart: always depends_on: - zookeeper ports: - 9095:9095 environment: KAFKA_ADVERTISED_HOST_NAME: kafka3 KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181/kafka KAFKA_LISTENERS: PLAINTEXT://:9095 KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://192.168.1.6:9095 KAFKA_BROKER_ID: 3# yaml 配

kafkamanager

docker run -it -d  --net zookeeper_default --link  kafka-zookeeper-1:zookeeper --link kafka-kafka1-1:kafka --link kafka-kafka2-1:kafka --link kafka-kafka3-1:kafka -p 9000:9000 -e ZK_HOSTS=192.168.1.6:2181 sheepkiller/kafka-manager 

注意這裡我遇到了三個坑:

1:網段不同 導致容器啟動失敗

/usr/bin/docker-current: Error response from daemon: Cannot link to /kafka-kafka1-1, as it does not belong to the default network.

這是因為之前部署的zookeeper和kafka在同一個網路中,而kafkmanager是另外部署的,重新啟了一個容器,他們就不在一個網路中了,所以需要加一個  --net zookeepe_default

這是查詢容器網路的命令

docker network ls

2:容器啟動成但是kafkamanager連不上zookeeper

這是開始使用的命令,沒有指定IP,導致連線zookeeper失敗

o.a.z.ClientCnxn - Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) ~[na:1.8.0_161]
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) ~[na:1.8.0_161]
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) ~[org.apache.zookeeper.zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) ~[org.apache.zookeeper.zookeeper-3.4.6.jar:3.4.6-1569965]

然後我就指定了具體的IP問題得到解決
docker run -it -d --net zookeeper_default --link kafka-zookeeper-1:zookeeper --link kafka-kafka1-1:kafka --link kafka-kafka2-1:kafka --link kafka-kafka3-1:kafka -p 9000:9000 -e ZK_HOSTS=zookeeper:2181 sheepkiller/kafka-manager

 3:沒有關閉防火牆,在訪問http://192.168.1.6:9000/ 頁面時報錯

關閉防火牆後解決

//檢視防火牆狀態
systemctl status firewalld
//關閉防火牆
systemctl stop firewalld
 //永久關閉防火牆
systemctl disable firewalld
//啟用防火牆
systemctl enable firewalld
//開啟防火牆
systemctl start firewalld