kafka的開發，基於java的方式，使用maven管理jar包依賴。

我主要是基於C/c++，採用了librdkafka 。

librdkafka 是Apache  Kafka  客戶端C語言的高效能實現， 能夠提供可靠並且表現優秀的客戶端，同時它也提供比較初級的C++介面，提供了Kafka生產者、消費者介面。

1.     librdkafka的安裝

首先在 https://github.com/edenhill/librdkafka 下載 librdkafka-master.zip，上傳至linux；

yum install -y unzip zip 
unzip librdkafka-master.zip

yum -y update gcc
yum -y install gcc+ gcc-c++ 

以上兩行沒有的話configure出錯  
mklove/modules/configure.base: line 1183: c++: command not found

cd librdkafka-master
chmod 777 configure lds-gen.py
./configure
make
make install     
 

          最終標頭檔案和庫檔案會分別安裝在

         /usr/local/include/librdkafka
         /usr/local/lib       

echo "/usr/local/lib" >> /etc/ld.so.conf
ldconfig
         
檢視結果如下：

[[email protected] test]# ll /usr/local/lib
total 22972
lrwxrwxrwx 1 root root       12 Jul 17 15:13 librdkafka -> librdkafka.1
lrwxrwxrwx 1 root root       14 Jul 17 15:13 librdkafka++ -> librdkafka++.1
-rwxr-xr-x 1 root root 14274004 Jul 17 15:22 librdkafka.a
-rwxr-xr-x 1 root root  2493016 Jul 17 15:22 librdkafka++.a
lrwxrwxrwx 1 root root       15 Jul 17 15:22 librdkafka.so -> librdkafka.so.1
lrwxrwxrwx 1 root root       17 Jul 17 15:22 librdkafka++.so -> librdkafka++.so.1
-rwxr-xr-x 1 root root  5783120 Jul 17 15:22 librdkafka.so.1
-rwxr-xr-x 1 root root   964000 Jul 17 15:22 librdkafka++.so.1
drwxr-xr-x 2 root root     4096 Jul 17 15:22 pkgconfig
[
 
[email protected] test]# ll /usr/local/include/librdkafka
total 256
-rwxr-xr-x 1 root root  74175 Jul 17 15:22 rdkafkacpp.h
-rwxr-xr-x 1 root root 182959 Jul 17 15:22 rdkafka.h

          2.  開發實踐          

         包含標頭檔案 #include "librdkafka/rdkafka.h"
        編譯過程中出錯： 

/usr/bin/ld: cannot find -lz  

解決：
yum install zlib-devel

gcc my_consumer.c -o my_consumer  -lrdkafka -lz -lpthread -lrt
gcc my_producer.c -o my_producer -lrdkafka -lz -lpthread -lrt


./my_producer localhost:9092 test_topic

./my_consumer -b localhost:9092 -t test_topic