一，準備環境

　　CentOs7，jdk1.7，hadoop -2.6.1， apache-flume-1.6.0-bin.tar.gz

二，編寫配置檔案

        在/home/flume/conf的目錄下  建立 配置檔案

#定義三大元件的名稱
agent1.sources = source1
agent1.sinks = sink1
agent1.channels = channel1

# 配置source元件
agent1.sources.source1.type = spooldir
agent1.sources.source1.spoolDir = /home/data
agent1.sources.source1.fileHeader = false

#配置攔截器
agent1.sources.source1.interceptors = i1
agent1.sources.source1.interceptors.i1.type = host
agent1.sources.source1.interceptors.i1.hostHeader = hostname

# 配置sink元件
agent1.sinks.sink1.type = hdfs
agent1.sinks.sink1.hdfs.path =hdfs://server1:9000/flume/collection/%y-%m-%d/%H-%M   #按時間的格式命名
agent1.sinks.sink1.hdfs.filePrefix = access_log
agent1.sinks.sink1.hdfs.maxOpenFiles = 5000
agent1.sinks.sink1.hdfs.batchSize= 100
agent1.sinks.sink1.hdfs.fileType = DataStream
agent1.sinks.sink1.hdfs.writeFormat =Text
agent1.sinks.sink1.hdfs.rollSize = 102400
agent1.sinks.sink1.hdfs.rollCount = 1000000
agent1.sinks.sink1.hdfs.rollInterval = 60
agent1.sinks.sink1.hdfs.useLocalTimeStamp = true


# 配置channels元件
agent1.channels.channel1.type = memory
agent1.channels.channel1.keep-alive = 120
agent1.channels.channel1.capacity = 500000
agent1.channels.channel1.transactionCapacity = 600


# 配置元件關係
agent1.sources.source1.channels = channel1
agent1.sinks.sink1.channel = channel1

　　在/home下建立data資料夾

三，執行程式

　　在/home/flume 目錄下執行程式碼

 bin/flume-ng agent -c conf -f conf/hdfs-logger.conf -n agent1  -Dflume.root.logger=INFO,console

　　成功後，向data中新增txt檔案。

四，檢視結果

　　用HDFS檢視Flume目錄下的結果收集檔案。

五，錯誤糾正

Resources are low on NN. Please add or free up more resources then turn off safe mode manually.
NOTE:  If you turn off safe mode before adding resources, the NN will immediately return to safe mode. 
Use "hdfs dfsadmin -safemode leave" to turn safe mode off.

　　在hadoop的目錄下執行程式碼：

 bin/hadoop  dfsadmin -safemode leave