基於Maven使用eclipse開發mapreduce 程式
阿新 • • 發佈：2019-01-31
1.安裝mvn(可以省略)
1.1上傳安裝包到linux
1.2解壓maven安裝包
mkdir /usr/maven
tar -zxvf apache-maven-3.2.1-bin.tar.gz -C /usr/maven vim /etc/profile
export JAVA_HOME=/usr/java/jdk1.7.0_55
export MAVEN_HOME=/usr/maven/apache-maven-3.2.1
export PATH=$PATH:$JAVA_HOME/bin:$MAVEN_HOME/bin:2.將m2.tar.gz解壓到當前使用者的家目錄下
tar -zxvf m2.tar.gz -C ~/
3.在Eclipse下新建maven project，如果出錯，在當前專案的pom.xml中新增如下內容，重新整理即可（需要有網路）
<dependencies> <dependency> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-resources-plugin</artifactId> <version>2.4.3</version> </dependency> </dependencies>
4.編寫hadoop程式
hdfs程式需要引入依賴：
<dependencies> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>4.8.2</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-common</artifactId> <version>2.4.1</version> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-hdfs</artifactId> <version>2.4.1</version> </dependency> </dependencies>
mr程式需要引入依賴：
<dependencies> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>4.8.2</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-common</artifactId> <version>2.4.1</version> </dependency> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-mapreduce-client-core</artifactId> <version>2.4.1</version> </dependency> </dependencies>