hdfs的相關api
阿新 • • 發佈:2020-12-13
連線hdfs
根據hdfs的版本引用相關的hdfs依賴
<!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-client --> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-client</artifactId> <version>2.6.5</version> </dependency> <!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common --> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-common</artifactId> <version>2.6.5</version> </dependency> <!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-hdfs --> <dependency> <groupId>org.apache.hadoop</groupId> <artifactId>hadoop-hdfs</artifactId> <version>2.6.5</version> </dependency>
將hdfs中的core-site.xml
和hdfs-site.xml
放進專案的resources目錄裡
簡單編碼測試下
public class Connection { public static void main(String[] args) throws IOException, URISyntaxException, InterruptedException { Configuration configuration=new Configuration(); System.setProperty("HADOOP_USER_NAME", "root"); FileSystem fs = FileSystem.get(configuration); System.out.println(fs.getHomeDirectory()); //拿到FileSystem後可以簡單操作下hdfs,若是執行成功則代表連線成功! } }