Metron學習5_Install/Deploy Metron to the Cluster過程及出現的問題
Note: Adding -u user -k to the below command lines allows deployment in environments where passwordless SSH has not been enabled.
- cd /root/incubator-metron/metron-deployment/playbooks
- Run the following ansible command to deploy Metron with the standard services (Metron Topologies, WebUI, and Monit)
ansible-playbook -i /root/incubator-metron/metron-deployment/inventory/$INSTALL_CONF_DIRECTORY metron_install.yml --skip-tags="solr" - Run the following Ansible command to deploy Metron without installing Sensors
ansible-playbook -i /root/incubator-metron/metron-deployment/inventory/$INSTALL_CONF_DIRECTORY metron_install.yml --skip-tags="solr,sensors"
這三條安裝命令在本機上為：
cd /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/playbooks
ansible-playbook -i /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf metron_install.yml --skip-tags="solr"
ansible-playbook -i /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf metron_install.yml --skip-tags="solr,sensors"
安裝過程為：
[[email protected] playbooks]# ansible-playbook -i /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf metron_install.yml --skip-tags="solr" [WARNING]: While constructing a mapping from /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/inventory/installConf/group_vars/all, line 19, column 1, found a duplicate dict key (sniff_interface). Using last defined value only. PLAY [metron] ****************************************************************** TASK [setup] ******************************************************************* ok: [master] ok: [slave2] ok: [slave1] TASK [epel : Get epel-repo rpm] ************************************************ changed: [master] changed: [slave2] changed: [slave1] TASK [epel : Install epel-repo rpm] ******************************************** ok: [slave2] ok: [slave1] ok: [master] TASK [ntp : Install ntp] ******************************************************* ok: [slave2] ok: [slave1] ok: [master] TASK [ntp : Ensure ntp is running and enabled] ********************************* ok: [slave2] ok: [slave1] ok: [master] TASK [metron_common : Check OS Version] **************************************** skipping: [slave1] skipping: [slave2] skipping: [master] TASK [metron_common : Check for Metron jar path] ******************************* ok: [slave2] ok: [slave1] ok: [master] TASK [metron_common : Verify Metron jars exist] ******************************** fatal: [master]: FAILED! => {"changed": false, "failed": true, "msg": "Unable to locate staged Metron jars at /home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/playbooks/../../metron-platform/metron-elasticsearch/target/metron-elasticsearch-0.2.0BETA.jar. Did you run 'mvn package'?"} skipping: [slave2] skipping: [slave1] TASK [metron_common : Ensure iptables is stopped and is not running at boot time.] *** ok: [slave2] changed: [slave1] PLAY [search] ****************************************************************** TASK [setup] ******************************************************************* ok: [slave2] ok: [slave1] TASK [java_jdk : Check for java at "/usr/jdk64/jdk1.8.0_40"] ******************* ok: [slave1] ok: [slave2] TASK [java_jdk : Alternatives link for java] *********************************** skipping: [slave1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) skipping: [slave2] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/java', u'link': u'/usr/bin/java', u'name': u'java'}) skipping: [slave1] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) skipping: [slave2] => (item={u'path': u'/usr/jdk64/jdk1.8.0_40/bin/jar', u'link': u'/usr/bin/jar', u'name': u'jar'}) TASK [java_jdk : Install openjdk] ********************************************** changed: [slave1] => (item=[u'java-1.8.0-openjdk', u'java-1.8.0-openjdk-devel']) changed: [slave2] => (item=[u'java-1.8.0-openjdk', u'java-1.8.0-openjdk-devel']) TASK [epel : Get epel-repo rpm] ************************************************ ok: [slave2] ok: [slave1] TASK [epel : Install epel-repo rpm] ******************************************** ok: [slave2] ok: [slave1] TASK [python-pip : Install python-pip] ***************************************** changed: [slave2] changed: [slave1] TASK [httplib2 : Install python httplib2 dependency] *************************** changed: [slave1] changed: [slave2] TASK [libselinux-python : Install libselinux-python] *************************** ok: [slave2] ok: [slave1] TASK [elasticsearch : Add Elasticsearch GPG key] ******************************* changed: [slave2] changed: [slave1] TASK [elasticsearch : Add Elasticsearch repository] **************************** changed: [slave2] changed: [slave1] TASK [elasticsearch : Install Elasticsearch] *********************************** changed: [slave2] changed: [slave1] TASK [elasticsearch : Create Data Directories] ********************************* changed: [slave2] => (item=/data1/elasticsearch) changed: [slave1] => (item=/data1/elasticsearch) changed: [slave2] => (item=/data2/elasticsearch) changed: [slave1] => (item=/data2/elasticsearch) TASK [elasticsearch : Configure Elasticsearch - remove stale entries] ********** ok: [slave2] => (item=^cluster\.name:) ok: [slave1] => (item=^cluster\.name:) ok: [slave2] => (item=^network\.host:) ok: [slave1] => (item=^network\.host:) ok: [slave2] => (item=^discovery\.zen\.ping\.unicast\.hosts:) ok: [slave1] => (item=^discovery\.zen\.ping\.unicast\.hosts:) ok: [slave2] => (item=^path\.data) ok: [slave1] => (item=^path\.data) TASK [elasticsearch : Configure Elasticsearch] ********************************* changed: [slave1] => (item={u'regexp': u'^# *cluster\\.name:', u'line': u'cluster.name: metron'}) changed: [slave2] => (item={u'regexp': u'^# *cluster\\.name:', u'line': u'cluster.name: metron'}) changed: [slave1] => (item={u'regexp': u'^# *network\\.host:', u'line': u'network.host: _eth0:ipv4_'}) changed: [slave2] => (item={u'regexp': u'^# *network\\.host:', u'line': u'network.host: _eth0:ipv4_'}) changed: [slave1] => (item={u'regexp': u'^# *discovery\\.zen\\.ping\\.unicast\\.hosts:', u'line': u'discovery.zen.ping.unicast.hosts: [ master,slave1,slave2 ]'}) changed: [slave2] => (item={u'regexp': u'^# *discovery\\.zen\\.ping\\.unicast\\.hosts:', u'line': u'discovery.zen.ping.unicast.hosts: [ master,slave1,slave2 ]'}) changed: [slave1] => (item={u'regexp': u'^# *path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'}) changed: [slave2] => (item={u'regexp': u'^# *path\\.data', u'line': u'path.data: /data1/elasticsearch,/data2/elasticsearch'}) TASK [elasticsearch : Create Logrotate Script for Elasticsearch] *************** changed: [slave1] changed: [slave2] TASK [metron_elasticsearch_templates : Start Elasticsearch] ******************** fatal: [slave2]: FAILED! => {"changed": false, "failed": true, "msg": "Exception in thread \"main\" java.lang.IllegalArgumentException: No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1)]\n\tat org.elasticsearch.common.network.NetworkUtils.getAddressesForInterface(NetworkUtils.java:232)\n\tat org.elasticsearch.common.network.NetworkService.resolveInternal(NetworkService.java:257)\n\tat org.elasticsearch.common.network.NetworkService.resolveInetAddresses(NetworkService.java:209)\n\tat org.elasticsearch.common.network.NetworkService.resolveBindHostAddresses(NetworkService.java:122)\n\tat org.elasticsearch.transport.netty.NettyTransport.bindServerBootstrap(NettyTransport.java:435)\n\tat org.elasticsearch.transport.netty.NettyTransport.doStart(NettyTransport.java:332)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.transport.TransportService.doStart(TransportService.java:182)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.node.Node.start(Node.java:278)\n\tat org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:222)\n\tat org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:288)\n\tat org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)\nRefer to the log for complete error details.\n"} fatal: [slave1]: FAILED! => {"changed": false, "failed": true, "msg": "Exception in thread \"main\" java.lang.IllegalArgumentException: No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1), name:docker0 (docker0)]\n\tat org.elasticsearch.common.network.NetworkUtils.getAddressesForInterface(NetworkUtils.java:232)\n\tat org.elasticsearch.common.network.NetworkService.resolveInternal(NetworkService.java:257)\n\tat org.elasticsearch.common.network.NetworkService.resolveInetAddresses(NetworkService.java:209)\n\tat org.elasticsearch.common.network.NetworkService.resolveBindHostAddresses(NetworkService.java:122)\n\tat org.elasticsearch.transport.netty.NettyTransport.bindServerBootstrap(NettyTransport.java:435)\n\tat org.elasticsearch.transport.netty.NettyTransport.doStart(NettyTransport.java:332)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.transport.TransportService.doStart(TransportService.java:182)\n\tat org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\tat org.elasticsearch.node.Node.start(Node.java:278)\n\tat org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:222)\n\tat org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:288)\n\tat org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)\nRefer to the log for complete error details.\n"} PLAY [search] ****************************************************************** PLAY [mysql] ******************************************************************* PLAY [ambari_slave] ************************************************************ PLAY [metron_hbase_tables] ***************************************************** PLAY [metron_kafka_topics] ***************************************************** PLAY [enrichment] ************************************************************** PLAY [pcap_server] ************************************************************* PLAY [web] ********************************************************************* PLAY [sensors] ***************************************************************** PLAY [metron] ****************************************************************** PLAY [metron] ****************************************************************** to retry, use: --limit @/home/szx/incubator-metron-Metron_0.2.0BETA_rc2/metron-deployment/playbooks/metron_install.retry PLAY RECAP ********************************************************************* master : ok=6 changed=1 unreachable=0 failed=1 slave1 : ok=22 changed=11 unreachable=0 failed=1 slave2 : ok=22 changed=10 unreachable=0 failed=1
重點關注兩處失敗：
TASK [metron_elasticsearch_templates : Start Elasticsearch] ********************
fatal: [slave2]: FAILED! => {"changed": false, "failed": true, "msg":
"Exception in thread \"main\" java.lang.IllegalArgumentException:
No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1)]\n\t
at org.elasticsearch.common.network.NetworkUtils.getAddressesForInterface(NetworkUtils.java:232)\n\t
at org.elasticsearch.common.network.NetworkService.resolveInternal(NetworkService.java:257)\n\t
at org.elasticsearch.common.network.NetworkService.resolveInetAddresses(NetworkService.java:209)\n\t
at org.elasticsearch.common.network.NetworkService.resolveBindHostAddresses(NetworkService.java:122)\n\t
at org.elasticsearch.transport.netty.NettyTransport.bindServerBootstrap(NettyTransport.java:435)\n\t
at org.elasticsearch.transport.netty.NettyTransport.doStart(NettyTransport.java:332)\n\t
at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\t
at org.elasticsearch.transport.TransportService.doStart(TransportService.java:182)\n\t
at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\t
at org.elasticsearch.node.Node.start(Node.java:278)\n\tat org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:222)\n\t
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:288)\n\t
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)\nRefer to the log for complete error details.\n"}
fatal: [slave1]: FAILED! => {"changed": false, "failed": true, "msg": "Exception in thread \"main\" java.lang.IllegalArgumentException:
No interface named 'eth0' found, got [name:lo (lo), name:em1 (em1), name:docker0 (docker0)]\n\t
at org.elasticsearch.common.network.NetworkUtils.getAddressesForInterface(NetworkUtils.java:232)\n\t
at org.elasticsearch.common.network.NetworkService.resolveInternal(NetworkService.java:257)\n\t
at org.elasticsearch.common.network.NetworkService.resolveInetAddresses(NetworkService.java:209)\n\t
at org.elasticsearch.common.network.NetworkService.resolveBindHostAddresses(NetworkService.java:122)\n\t
at org.elasticsearch.transport.netty.NettyTransport.bindServerBootstrap(NettyTransport.java:435)\n\t
at org.elasticsearch.transport.netty.NettyTransport.doStart(NettyTransport.java:332)\n\t
at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\t
at org.elasticsearch.transport.TransportService.doStart(TransportService.java:182)\n\t
at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:68)\n\t
at org.elasticsearch.node.Node.start(Node.java:278)\n\tat org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:222)\n\t
at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:288)\n\t
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)\nRefer to the log for complete error details.\n"}
參考：https://cwiki.apache.org/confluence/display/METRON/Metron+Installation+on+an+Ambari-Managed+Cluster
相關推薦
Metron學習5_Install/Deploy Metron to the Cluster過程及出現的問題
Note: Adding -u user -k to the below command lines allows deployment in environments where passwordless SSH has not been enabled. cd /r
多線程系列七：記錄一次學習項目性能優化的過程及心得
安全問題 ota except dex 等等 exception family print 單個 一、項目背景和問題 有一個自適應的考試學習系統，對學員的學習要求經常考試進行檢查，學員的成績出來以後，老師會要求系統根據每個學員的考卷上錯誤的題目從容量為10萬左右的題庫中抽取
Metron學習10_Deploying a fresh Metron cluster via Ambari Management pack
Article Note: This article is an extension of the instructions at this link.This article uses the example of a 12-node CentOS 7 VM cluster on Openstack
redis Waiting for the cluster to join
redis 搭建叢集時，一直join。。。。 redis-cli --cluster create 127.0.0.1:6379 127.0.0.1:6380 127.0.0.1:6381 127.0.0.1:6382 127.0.0.1:6383 127.0.0.1:63
redis叢集 Waiting for the cluster to join 一直等待
redis叢集建立執行 ./redis-trib.rb create --replicas 1 XXXX:PORT1 XXXX:PORT2 .... 的時候 一直等待 Waiting for the cluster to join 很久都沒有反應 原因： re
Redis叢集一直提示Waiting for the cluster to join....的終極解決方案
最近在進行redis叢集的時候遇到一個問題 如下圖 一直提示Waiting for the cluster to join.... 這裡直接ctrl+c了 解決方案： 1：開啟所有節點的redis.conf 配置bind屬性 值是伺服器的外網IP 如：bind
redis叢集部署一直卡在Waiting for the cluster to join ......
純手打，轉載請附上本文網址！！！ 這裡是redis多機多節點叢集部署的問題解決！ 這個是困擾了我最久的問題，使用cluster meet ip port命令無效，感謝同事大佬的解答幫助我解決了問題。 同時，很少有部落格提到redis叢集匯流排的內容，都是叫你關閉防火牆，
Assign a Static Private IP Address to the Master Node of an Amazon EMR Cluster
Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So
kubectl error: The connection to the server localhost:8080 was refused
init log use using after hub server iss error did you run below commands after kubeadm init To start using your cluster, you need to run
The path to the driver executable must be set by the webdriver.gecko.driver system property;
pack 如果 leg ide rec sel window win find 今天安裝了webdriver後，編寫了一個測試小程序，但運行時控制臺報了這樣的錯誤： 1 Exception in thread "main" java.lang.IllegalStat
The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server
att sed abs cte gist hang app caused ctp ? 版權聲明：本文為博主原創文章，轉載請註明出處 1.問題描述 搭建SSH框架，啟動時報錯如下： The last packet sent successfully to the ser
安卓控件獲取器uiautomatorviewer初體驗："unable to connect to the adb. check if adb is installed correctly"
isn tdi pty all hal hot cep accep challenge 解決方法：轉自:https://plus.google.com/108487870030743970488/posts/2TrMqs1ZGQv Challenge Accepted:1.
My SQL 插入空間數據報錯:Cannot get geometry object from data you send to the GEOMETRY field
ext 點數據 ges cnblogs bject ron rom val images My SQL 插入空間數據報錯:Cannot get geometry object from data you send to the GEOMETRY field 發生該問題，百度
add nodes to the swarm
docker swarm一旦你們創建了一個帶有管理節點的swarm集群，你就可以開始添加 worker節點$ docker-machine ssh worker1 $ docker swarm join --token SWMTKN-1-49nj1cmql0jkz5s954yi3oex3nedyz0fb
Welcome to the Real World
efi enter div har check trac ins where const ? Welcome to the Real World Gregor Hohpe EnginEERS liKE pRECiSion, especially
hdu 4348 To the moon(主席樹區間操作)
esp ace 標記 return ++i urn div acm str 題目鏈接：hdu 4348 To the moon 題意: 給你n個數，有m個操作。 1.給區間[l,r]的所有數+d，並且時間戳+1 2.詢問當前時間戳的區間和。 3.詢問過去時間戳t的區間和。
Linq學習隨筆二------LINQ to XML
program str arp -s {0} ocs pla ges mes LINQ to XML LINQ to XML provides an in-memory XML programming interface that leverages the .NET L
NetBeans IDE驅動報錯The path to the driver executable must be set by the web driver.chrome.driver.system property......
system32 分享 pat appdata .... log google drive exe 問題：defaulstUserDataPath=C:\\Users\\user1\\AppData\\Local\\Google\\Chrome\\User Data\\De
selenium執行打開瀏覽器,報Can not connect to the Service xxxxdriver
selenium2 robotframework 把hosts(在此目錄C:\Windows\System32\drivers\etc)文件裏的127.0.0.1 localhost這行註釋去掉就可以參考:https://stackoverflow.com/questions/24900922/web