cloudera manager的7180 web介面訪問不了的解決辦法(圖文詳解)
說在前面的話
我的機器是總共4臺,分別為ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。(注意啦,以下是針對Ubuntu系統的)
在ubuntucmbigdata1上執行了
sudo apt-get install cloudera-manager-daemons cloudera-manager-server sudo apt-get install cloudera-manager-daemons cloudera-manager-agent
即,ubuntucmbigdata1是既做server,又做agent。
在ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4上執行了
sudo apt-get install cloudera-manager-daemons cloudera-manager-agent
即,ubuntucmbigdata2、3、和4是隻做agent。
在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上
新建檔案sudo vi /etc/apt/sources.list.d/cloudera-manager.list
cloudera.list裡
# Packages for Cloudera Manager, Version 5, on Ubuntu 14.04 x86_64 deb [arch=amd64] http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib deb-src http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib
並且在在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上
向apt新增cloudera源公鑰,在所有節點執行如下命令:
curl -s http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/archive.key | sudo apt-key add -
然後,再sudo apt-get update
問題詳情
解決辦法
思路1:
思路2:
檢視cloudera-scm-agent的執行日誌
[email protected]:/opt/cm-5.6.0/log$ ll total 20 drwxr-xr-x 5 bigdata bigdata 4096 2月 12 2016 ./ drwxr-xr-x 8 bigdata bigdata 4096 2月 12 2016 ../ drwxr-xr-x 2 bigdata bigdata 4096 6月 25 19:53 cloudera-scm-agent/ drwxr-xr-x 2 bigdata bigdata 4096 6月 25 19:52 cloudera-scm-server/ drwxr-xr-x 2 bigdata bigdata 4096 2月 12 2016 cmf/ [email protected]:/opt/cm-5.6.0/log$ cd cloudera-scm-agent/ [email protected]:/opt/cm-5.6.0/log/cloudera-scm-agent$ ll total 40 drwxr-xr-x 2 bigdata bigdata 4096 6月 25 19:53 ./ drwxr-xr-x 5 bigdata bigdata 4096 2月 12 2016 ../ -rw-r--r-- 1 root root 14757 6月 25 19:57 cloudera-scm-agent.log -rw-r--r-- 1 root root 935 6月 25 19:53 cloudera-scm-agent.out -rw-r--r-- 1 root root 202 6月 25 19:53 cmf_listener.log -rw-r--r-- 1 root root 539 6月 25 19:53 supervisord.log -rw-r--r-- 1 root root 449 6月 25 19:53 supervisord.out [email protected]:/opt/cm-5.6.0/log/cloudera-scm-agent$ cat cloudera-scm-agent.out [25/Jun/2017 19:53:01 +0000] 9651 MainThread agent INFO SCM Agent Version: 5.6.0 [25/Jun/2017 19:53:01 +0000] 9651 MainThread util INFO Generating Agent UUID for the first time: '/opt/cm-5.6.0/lib/cloudera-scm-agent/uuid' [25/Jun/2017 19:53:01 +0000] 9651 MainThread agent INFO Adding env vars that start with CMF_AGENT_ [25/Jun/2017 19:53:01 +0000] 9651 MainThread agent INFO explicitly passing env var to supervisee: MGMT_HOME: /opt/cm-5.6.0/share/cmf [25/Jun/2017 19:53:01 +0000] 9651 MainThread agent INFO explicitly passing env var to supervisee: ROOT: /opt/cm-5.6.0/lib/cmf [25/Jun/2017 19:53:01 +0000] 9651 MainThread agent INFO Logging to /opt/cm-5.6.0/log/cloudera-scm-agent/cloudera-scm-agent.log Error: could not find config file /opt/cm-5.6.0/run/cloudera-scm-agent/supervisor/supervisord.conf For help, use /opt/cm-5.6.0/lib/cmf/agent/src/cmf/agent.py -h [email protected]:/opt/cm-5.6.0/log/cloudera-scm-agent$
當cloudera-scm-server、cloudera-scm-agent start啟動成功之後,可通過http://主節點IP:7180來訪問CM,使用者名稱密碼都為admin。剩下的就是一直點下一步和根據具體的需求來配置叢集了。
注意,在此之前。
注意,在此之前。
ubuntucmbigdata1機器上,則需要執行
[email protected]:~$ sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm scm_password [sudo] password for bigdata: Sorry, try again. [sudo] password for bigdata: JAVA_HOME=/usr/java/jdk1.7.0_80 Verifying that we can write to /etc/cloudera-scm-server Creating SCM configuration file in /etc/cloudera-scm-server Executing: /usr/java/jdk1.7.0_80/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db. [ main] DbCommandExecutor INFO Successfully connected to database. All done, your SCM database is configured correctly!
[email protected]ubuntucmbigdata1:~$ sudo service cloudera-scm-server start
[sudo] password for bigdata:
Starting cloudera-scm-server: * cloudera-scm-server started
[email protected]ubuntucmbigdata1:~$ sudo service cloudera-scm-agent start
[sudo] password for bigdata:
Starting cloudera-scm-agent: * cloudera-scm-agent started
然後,在ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上
[email protected]ubuntucmbigdata2:~$ sudo service cloudera-scm-agent start
[sudo] password for bigdata:
Starting cloudera-scm-agent: * cloudera-scm-agent started
[email protected]ubuntucmbigdata3:~$ sudo service cloudera-scm-agent start
[sudo] password for bigdata:
Starting cloudera-scm-agent: * cloudera-scm-agent started
[email protected]ubuntucmbigdata4:~$ sudo service cloudera-scm-agent start
[sudo] password for bigdata:
Starting cloudera-scm-agent: * cloudera-scm-agent started
思路3:
關閉這臺機器的防火牆
[email protected]:/opt$ sudo ufw disable
Firewall stopped and disabled on system startup
[email protected]:/opt$ sudo ufw status
Status: inactive
[email protected]:/opt$
思路4:
[email protected]:/opt/cm-5.6.0/etc$ netstat -nltp
(No info could be read for "-p": geteuid()=1000 but you should be root.)
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:631 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:19001 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:6010 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:6011 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:6012 0.0.0.0:* LISTEN -
tcp 0 0 127.0.1.1:9000 0.0.0.0:* LISTEN -
tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN -
tcp6 0 0 :::22 :::* LISTEN -
tcp6 0 0 ::1:631 :::* LISTEN -
tcp6 0 0 ::1:6010 :::* LISTEN -
tcp6 0 0 ::1:6011 :::* LISTEN -
tcp6 0 0 ::1:6012 :::* LISTEN -
思路5:
思路6:
時間同步
ntpdate pool.ntp.org
一般前面的6種思路是一定可以解決cloudera manager的7180 web介面訪問不了
思路7:(萬不得已)
最戳的辦法,就是
http://www.aboutyun.com/thread-8992-1-1.html (包含centos、ubuntu、debian和rehat各版本都有)
解除安裝它,重新來過。
正用得上,剛安裝好的CDH5的CM server啟不來,只好全部四節點解除安裝來過。
如在ubuntu系統下
[email protected]:/opt/softwares/cm-5.6.0$ sudo rm -Rf /usr/share/cmf /var/lib/cloudera* /var/cache/yum/cloudera* [email protected]:/opt/softwares/cm-5.6.0$ sudo apt-get purge 'cloudera-manager-*' [email protected]:/opt/softwares/cm-5.6.0$ sudo apt-get purge 'cloudera-manager-*' avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-python sqoop sqoop2 whirr
[email protected]:/opt/softwares/cm-5.6.0$ sudo apt-get clean
[email protected]:/opt/softwares/cm-5.6.0$ sudo rm -Rf /usr/share/cmf /var/lib/cloudera* /var/cache/yum/cloudera* /var/log/cloudera* /var/run/cloudera*
[email protected]:/opt/softwares/cm-5.6.0$ sudo rm -Rf /var/cache/apt/archives/cloudera*
再進一步解除安裝徹底乾淨
見
1、通過管理平臺分別停止元件服務和Cloudera Management Service 2、通過管理平臺登出並移除Parcles (在控制檯登出並移除,無論是安裝的Parcles還是未安裝的Parcles) 3、停止後臺服務 sudo service cloudera-scm-agent stop sudo service cloudera-scm-server stop sudo service cloudera-scm-server-db stop sudo service mysqld stop 4、解除安裝Cloudera Manager Server 執行命令:sudo /usr/share/cmf/uninstall-cloudera-manager.sh 5、清理配置和快取資訊 在所有agent上執行:sudo umount -v /var/run/cloudera-scm-agent/process 在所有主機上執行:sudo rm -rf /usr/share/cmf; sudo rm -rf /var/lib/cloudera*; sudo rm -rf /var/cache/yum/x86_64/6/cloudera*; sudo rm -rf /var/log/cloudera*; sudo rm -rf /var/run/cloudera* /etc/cloudera* 6、解除安裝rpm安裝包 1)檢視 rpm -qa | grep cloudera 2)解除安裝 for f in `rpm -qa | grep cloudera ` ; do sudo rpm -e ${f} ; done 7、清理安裝檔案 sudo rm -rf /var/lib/hadoop-* /var/lib/impala /var/lib/solr /var/lib/zookeeper /var/lib/hue /var/lib/oozie /var/lib/pgsql /var/lib/sqoop2 /data/dfs/ /data/impala/ /data/yarn/ /dfs/ /impala/ /yarn/ /var/run/hadoop-*/ /var/run/hdfs-*/ /usr/bin/hadoop* /usr/bin/zookeeper* /usr/bin/hbase* /usr/bin/hive* /usr/bin/hdfs /usr/bin/mapred /usr/bin/yarn /usr/bin/sqoop* /usr/bin/oozie /etc/hadoop* /etc/zookeeper* /etc/hive* /etc/hue /etc/impala /etc/sqoop* /etc/oozie /etc/hbase* /etc/hcatalog 略過其它軟體,只刪除hadoop相關 sudo rm -rf ` find /var/lib/alternatives/* ! -name "mta" ! -name "print" ! -name "zlibrary-ui" -mtime -3` 8、如果有hadoop先關程序還在,則殺死 for u in hdfs mapred cloudera-scm hbase hue zookeeper oozie hive impala flume; do sudo kill $(ps -u $u -o pid=); done 9、清理parcel sudo rm -rf /opt/cloudera/parcel-cache /opt/cloudera/parcels 10、清理元件使用者 sudo userdel hue;sudo userdel impala;sudo userdel spark;sudo userdel sentry;sudo userdel sqoop2;sudo userdel hbase;sudo userdel oozie;sudo userdel yarn;sudo userdel mapred;sudo userdel zookeeper;sudo userdel httpfs;sudo userdel solr;sudo userdel kms;sudo userdel hive;sudo userdel flume;sudo userdel hdfs;sudo userdel sqoop;sudo userdel llama;sudo userdel cloudera-scm;sudo userdel postgres;
然後,就可以繼續了。(這是針對bin方式來安裝)
更多安裝方法,請見
也許,你在解除安裝中,會遇到如下問題
最後成功!
歡迎大家,加入我的微信公眾號:大資料躺過的坑 人工智慧躺過的坑同時,大家可以關注我的個人部落格:
http://www.cnblogs.com/zlslch/ 和 http://www.cnblogs.com/lchzls/ http://www.cnblogs.com/sunnyDream/
詳情請見:http://www.cnblogs.com/zlslch/p/7473861.html
人生苦短,我願分享。本公眾號將秉持活到老學到老學習無休止的交流分享開源精神,匯聚於網際網路和個人學習工作的精華乾貨知識,一切來於網際網路,反饋回網際網路。
目前研究領域:大資料、機器學習、深度學習、人工智慧、資料探勘、資料分析。 語言涉及:Java、Scala、Python、Shell、Linux等 。同時還涉及平常所使用的手機、電腦和網際網路上的使用技巧、問題和實用軟體。 只要你一直關注和呆在群裡,每天必須有收穫
對應本平臺的討論和答疑QQ群:大資料和人工智慧躺過的坑(總群)(161156071)
相關推薦
cloudera manager的7180 web介面訪問不了的解決辦法(圖文詳解)
說在前面的話 我的機器是總共4臺,分別為ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。(注意啦,以下是針對Ubuntu系統的) 在ubuntucmbigdata1上執行了 sudo apt-ge
全網最詳細的再次或多次格式化導致namenode的ClusterID和datanode的ClusterID之間不一致的問題解決辦法(圖文詳解)
rwx log bsp 挖掘 fail tro listener 大數 www. 不多說,直接上幹貨! java.io.IOException: Incompatible clusterIDs in /opt/modules/ha
全網最詳細的HBase啟動以後,HMaster進程啟動了,幾秒鐘以後自動關閉問題的解決辦法(圖文詳解)
圖片 png 刪除 sunny lan 技術 領域 regions pre 不多說,直接上幹貨! 問題詳情 情況描述如題所示,hbase啟動以後,HMaster進程啟動了,幾秒鐘以後自動關閉,但是HRegionServer進程正常運
Hive執行過程中出現Caused by : java.lang.ClassNotFoundException: org.cloudera.htrace.Trace的錯誤解決辦法(圖文詳解)
pre wid logs In 實用 過程 ase edit 微信 不多說,直接上幹貨! 問題詳情 如下 這個錯誤的意思是缺少 htrace-core-2.04.jar。 解決辦法:
Starting cloudera-scm-server: * Couldn't start cloudera-scm-server的解決辦法(圖文詳解)
[email protected]:/opt/cm-5.6.0/log/cloudera-scm-server$ pwd /opt/cm-5.6.0/log/cloudera-scm-server [email protected]:/opt/cm-5.6.0/log/cloude
全網最詳細的跑python2.7時出現from mysql import connector ImportError: No module named mysql的問題解決辦法(圖文詳解)
領域 conda load 機器學習 同時 精華 center mod con 不多說,直接上幹貨! C:\Users\lenovo>pip install mysql-connector-python-rf==2.1.3 Col
Windows環境下執行hadoop命令出現Error: JAVA_HOME is incorrectly set Please update D:SoftWarehadoop-2.6.0confhadoop-env.cmd錯誤的解決辦法(圖文詳解)
scala software ksum cal .com from 問題 jdk sun 不多說,直接上幹貨! 導讀 win下安裝hadoop 大家,別小看win下的安裝大數據組件和使用 玩過dubbo和disc
IDEA跑代碼出現Error(7,8) ***App is already defined as object App object App extends Application { 錯誤的解決辦法(圖文詳解)
機器 strong ima 分析 挖掘 extend AS 收獲 qq群 不多說,直接上幹貨! 問題現象 Error(7,8) App is already defined as object App
全網最詳細的CentOS7裏安裝MySQL時出現No package mysql-server available錯誤的解決辦法(圖文詳解)
shell clear database 機器 AI rest secure can removing 不多說,直接上幹貨! 直接yum install mysql的話會報錯,原因在於yum安裝庫裏沒有直接可以用的安裝包,此時需要用到Mar
執行HBase shell時出現ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet錯誤解決辦法(圖文詳解)
cep ESS 關註 align comm util code ade dap 不多說,直接上幹貨! [kfk@bigdata-pro01 bin]$ jps 1968 NameNode 2385 ResourceManager 2259 Jou
全網最詳細的Hadoop HA集群啟動後,兩個namenode都是standby的解決辦法(圖文詳解)
config bubuko 測試 IE oop per ali col 學到老 不多說,直接上幹貨! 解決辦法 因為,如下,我的Hadoop HA集群。
全網最詳細的Hadoop HA集群啟動後,兩個namenode都是active的解決辦法(圖文詳解)
oop 精神 問題 python shell enter 深度 In 智能 不多說,直接上幹貨! 這個問題,跟 是大同小異。 歡迎大家,加入我的微信公眾號:大數據躺過的坑
全網最詳細的啟動或格式化zkfc時出現java.net.NoRouteToHostException: No route to host ... Will not attempt to authenticate using SASL (unknown error)錯誤的解決辦法(圖文詳解)
手機 TP 關註 fail AS hadoop .net ror cep 不多說,直接上幹貨! 解決辦法: 每臺機器都,先執行,sudo chkconfig ipta
全網最詳細的zkfc啟動以後,幾秒鐘以後自動關閉問題的解決辦法(圖文詳解)
qq群 spa 同時 CA 研究 圖文 ogg bigdata 火墻 不多說,直接上幹貨! 問題詳情 情況描述如題所示,zkfc啟動以後,幾秒鐘以後自動關閉。 解決辦法: 1、檢查下每臺機
CentOS5/6/7系統下搭建安裝Amabari大資料叢集時出現SSLError: Failed to connect. Please check openssl library versions.錯誤的解決辦法(圖文詳解)
不多說,直接上乾貨! ========================== Creating target directory... ======================
CentOS5/6/7系統下搭建安裝Amabari大數據集群時出現SSLError: Failed to connect. Please check openssl library versions.錯誤的解決辦法(圖文詳解)
詳解 warning 個人博客 xxx pin fig scp oca str 不多說,直接上幹貨! ========================== Creating target directory...
ambari-server啟動出現Caused by: java.lang.RuntimeException:java.lang.ClassNotFoundEception:com.mysql.jdbc.Driver問題解決辦法(圖文詳解)
不多說,直接上乾貨! 問題詳解 啟動ambari-server出現 Caused by: java.lang.RuntimeException:java.lang.ClassNotFoundEception:com.mysql.jdbc.Driver
Error while creating database accessor java.lang.ClassNotFoundException:com.mysql.jdbc.Driver問題解決辦法(圖文詳解)
不多說,直接上乾貨! 問題詳情 ambari-server啟動時,報如下的錯誤 問題分析 注:啟動ambari訪問前,請確保mysql驅動已經放置在/usr/share/Java內且名字是mysql-connector-java.jar不然a
sudo apt-get install openssh-server時提示需要安裝1:6.6p1-2ubuntu1的解決辦法(圖文詳解)
最近,在執行 sudo apt-get install openssh-server 提示,如下。 解決辦法 先要執行 sudo apt-get install openssh-client=1:6.6.p1-2ubuntu1
IDEA裡執行程式碼時出現Caused by: java.lang.ClassNotFoundException: org.apache.log4j.Logger的解決辦法(圖文詳解)
不多說,直接上乾貨! 問題詳情 執行出現log4j的問題 "C:\Program Files\Java\jdk1.8.0_66\bin\java" -Didea.launcher.port=7533 "-Didea.launcher.bin.path=D:\Soft