Spark 安裝與啟動
阿新 • • 發佈:2018-03-01
nbsp after example explicit 解決 cdh driver fail 建議
1.安裝
- 下載cdh5(http://archive.cloudera.com/cdh5/cdh/5/) 中下載bin.tar到software,然後解壓到應用文件夾(建議名稱為app)
- 配置環境變量
2.啟動與退出
1.spark 啟動——進入${sparkhome} 執行 spark --master local[4]
2.spark 退出——:quit
3.錯誤排查
java.net.BindException: Cannot assign requested address: Service ‘sparkDriver‘ failed after 16 retries (on a random free port)! Consider explicitly setting the appropriate binding address for the service ‘sparkDriver‘ (for example spark.driver.bindAddress for SparkDriver) to the correct binding address.
1.錯誤原因——虛擬機復制後/etc/hosts 文件的ip未修改
2.解決方法——修改etc/hosts
Spark 安裝與啟動