1. 程式人生 > >持續集成與自動化部署 - jenkins & sonar代碼質量管理平臺 部署和基礎使用(五)

持續集成與自動化部署 - jenkins & sonar代碼質量管理平臺 部署和基礎使用(五)

jenkins sonar

1 jenkins

安裝參考鏈接

1.1 安裝jenkins

[root@test-node3 ~]# yum install -y java-1.8.0
[root@test-node3 ~]# cd /etc/yum.repos.d/
[root@test-node3 yum.repos.d]# wget http://pkg.jenkins.io/redhat/jenkins.repo
[root@test-node3 yum.repos.d]# rpm --import http://pkg.jenkins.io/redhat/jenkins.io.key
[root@test-node3 yum.repos.d]# yum install -y jenkins
[root@test-node3 yum.repos.d]# systemctl start jenkins

1.2 安裝jenkins插件

[root@test-node3 ~]# cat /var/lib/jenkins/secrets/initialAdminPassword
d71307d2e9764f428d853bc49ac6b5ea

技術分享圖片

選擇默認安裝,會安裝通用的插件,剩下的在需要用的的時候再安裝。
技術分享圖片

等待安裝完成
技術分享圖片
設置用戶名密碼
user:admin
key: 123..abc
技術分享圖片
技術分享圖片

1.3 新建一個任務

[root@test-node3 ~]# usermod -s /bin/bash jenkins
 -bash-4.2$ ssh-copy-id -i .ssh/id_rsa.pub [email protected]
The authenticity of host ‘10.0.0.204 (10.0.0.204)‘ can‘t be established.
ECDSA key fingerprint is cd:9c:13:52:1a:96:c6:2b:4c:0c:5a:83:f6:94:01:48.
Are you sure you want to continue connecting (yes/no)? yes
/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
[email protected]‘s password: 

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh ‘[email protected]‘"
and check to make sure that only the key(s) you wanted were added.

-bash-4.2$ 
-bash-4.2$ ssh [email protected]
Last login: Wed Apr 12 09:33:40 2017
[www@salt-node4 ~]$ 
[www@salt-node4 ~]$ logout
Connection to 10.0.0.204 closed.

技術分享圖片
技術分享圖片

測試
點擊立即構建
技術分享圖片
自動部署完成。
技術分享圖片

1.4 jenkins安裝gitlab插件

註:jenkins填寫的是私鑰(gitlab服務器上填寫的是公鑰 - 步驟同gitlab添加ssh 公鑰,jenkins用ssh協議到gitlab上面去拉取代碼。)

技術分享圖片

技術分享圖片

2. 代碼質量管理 - sonar

Sonar 是一個用於代碼質量管理的開放平臺。通過插件機制,Sonar 可以集成不同的測試工具,代碼分析工具,以及持續集成工具。與持續集成工具(例如 Hudson/Jenkins 等)不同,Sonar 並不是簡單地把不同的代碼檢查工具結果(例如 FindBugs,PMD 等)直接顯示在 Web 頁面上,而是通過不同的插件對這些結果進行再加工處理,通過量化的方式度量代碼質量的變化,從而可以方便地對不同規模和種類的工程進行代碼質量管理。
在對其他工具的支持方面,Sonar 不僅提供了對 IDE 的支持,可以在 Eclipse 和 IntelliJ IDEA 這些工具裏聯機查看結果;同時 Sonar 還對大量的持續集成工具提供了接口支持,可以很方便地在持續集成中使用 Sonar。
此外,Sonar 的插件還可以對 Java 以外的其他編程語言提供支持,對國際化以及報告文檔化也有良好的支持

2.1 部署sonar

註:1 sonar 需要安裝數據庫版本為mysql 5.6及以上。 2 需要java環境,java版本為1.8以上

mysql 5.6 Yum源
https://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm
yum -y install  mysql-community-server

[sonar部署參考鏈接] (https://www.unixhot.com/article/56)

2.1.1 下載 安裝 sonar源碼

[root@test-node3 ~]# cd /server/tools/
[root@test-node3 ~]# wget https://sonarsource.bintray.com/Distribution/sonarqube/sonarqube-5.6.zip
[root@test-node3 tools]#  unzip sonarqube-5.6.zip
[root@test-node3 tools]# mv sonarqube-5.6 /usr/local/
[root@test-node3 tools]# ln -s /usr/local/sonarqube-5.6/ /usr/local/sonarqube

2.1.2 準備Sonar數據庫

CREATE DATABASE sonar CHARACTER SET utf8 COLLATE utf8_general_ci;
GRANT ALL ON sonar.* TO ‘sonar‘@‘localhost‘ IDENTIFIED BY ‘sonar@pw‘;
GRANT ALL ON sonar.* TO ‘sonar‘@‘%‘ IDENTIFIED BY ‘sonar@pw‘;
FLUSH PRIVILEGES;
[root@test-node3 ~]# mysql
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.6.36 MySQL Community Server (GPL)

Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type ‘help;‘ or ‘\h‘ for help. Type ‘\c‘ to clear the current input statement.

mysql> CREATE DATABASE sonar CHARACTER SET utf8 COLLATE utf8_general_ci;
Query OK, 1 row affected (0.01 sec)

mysql> GRANT ALL ON sonar.* TO ‘sonar‘@‘localhost‘ IDENTIFIED BY ‘sonar@pw‘;
GRANT ALL ON sonar.* TO ‘sonar‘@‘%‘ IDENTIFIED BY ‘sonar@pw‘;
Query OK, 0 rows affected (0.06 sec)

mysql> GRANT ALL ON sonar.* TO ‘sonar‘@‘%‘ IDENTIFIED BY ‘sonar@pw‘;
Query OK, 0 rows affected (0.00 sec)

mysql> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.01 sec)

mysql> 

2.1.3 配置Sonar

[root@test-node3 tools]# cd /usr/local/sonarqube/conf/
[root@test-node3 conf]# vim sonar.properties
sonar.jdbc.username=sonar
sonar.jdbc.password=sonar@pw
sonar.jdbc.url=jdbc:mysql://localhost:3306/sonar?useUnicode=true&characterEncoding=utf8&rewriteBatchedStatements=true&useConfigs=maxPerformance

2.1.4 啟動Sonar

如果沒有正常啟動,查看日誌一般就可以解決。

可以在Sonar的配置文件來配置Sonar Web監聽的IP地址和端口,默認是9000端口。

[root@test-node3 conf]# vim sonar.properties
sonar.web.host=0.0.0.0
sonar.web.port=9000

[root@test-node3 conf]# /usr/local/sonarqube/bin/linux-x86-64/sonar.sh start
[root@test-node3 logs]# netstat -tnlpua|grep 9000
tcp        0      0 0.0.0.0:9000            0.0.0.0:*               LISTEN      44042/java  

2.2 安裝語言插件

分析什麽語言就下載對應的語言插件。

web界面 用戶名密碼,默認為:admin/admin

步驟:
方法一 web界面安裝

Administration --> System -->  Update Center --> Available  搜索chiness Pack 點擊install。

安裝完成之後需要重啟sonar
[root@test-node3 plugins]# /usr/local/sonarqube/bin/linux-x86-64/sonar.sh restart

技術分享圖片

方法二 下載jar包進行替換
下載的連接可以根據在web界面安裝插件的失敗提醒來下載,如果不能下載,用迅雷下載。

https://github.com/SonarQubeCommunity/sonar-l10n-zh/releases

https://github.com/SonarQubeCommunity/sonar-l10n-zh/releases/download/sonar-l10n-zh-plugin-1.11/sonar-l10n-zh-plugin-1.11.jar
下載到/usr/local/sonarqube/extensions/plugins目錄

需要重啟才能生效
[root@test-node3 plugins]# /usr/local/sonarqube/bin/linux-x86-64/sonar.sh restart

技術分享圖片

2.3 安裝sonar 代碼掃描工具插件

參考鏈接

2.3.1 下載安裝源碼文件

[root@test-node3 plugins]# cd /server/tools/
[root@test-node3 tools]# wget https://sonarsource.bintray.com/Distribution/sonar-scanner-cli/sonar-scanner-2.6.1.zip  
[root@test-node3 tools]# cp -rf sonar-scanner-2.6.1 /usr/local/sonar-scanner

2.3.2 修改配置文件

[root@test-node3 tools]# cd /usr/local/sonar-scanner/conf
[root@test-node3 conf]# cat sonar-scanner.properties 

#----- Default SonarQube server
sonar.host.url=http://localhost:9000

#----- Default source code encoding
sonar.sourceEncoding=UTF-8

#----- Global database settings (not used for SonarQube 5.2+)
sonar.jdbc.username=sonar
sonar.jdbc.password=sonar@pw

#----- MySQL
sonar.jdbc.url=jdbc:mysql://localhost:3306/sonar?useUnicode=true&characterEncoding=utf8

2.3.3 下載測試代碼進行掃描

掃描的是php語言,因此需要php語言的插件SonarPHP

[root@test-node3 tools]# unzip sonar-examples-4.5.zip
[root@test-node3 tools]#  cd /server/tools/sonar-examples-4.5/projects/languages/php/php-sonar-runner

[root@test-node3 php-sonar-runner]# /usr/local/sonar-scanner/bin/sonar-scanner
.....
INFO: Sensor PHP sensor
INFO: 1 source files to be analyzed
INFO: 1/1 source files have been analyzed
INFO: No PHPUnit test report provided (see ‘sonar.php.tests.reportPath‘ property)
INFO: No PHPUnit unit test coverage report provided (see ‘sonar.php.coverage.reportPath‘ property)
INFO: No PHPUnit integration test coverage report provided (see ‘sonar.php.coverage.itReportPath‘ property)
INFO: No PHPUnit overall coverage report provided (see ‘sonar.php.coverage.overallReportPath‘ property)
INFO: Sensor PHP sensor (done) | time=1030ms
INFO: Sensor Analyzer for "php.ini" files
INFO: Sensor Analyzer for "php.ini" files (done) | time=6ms
INFO: Sensor Zero Coverage Sensor
INFO: Sensor Zero Coverage Sensor (done) | time=24ms
INFO: Sensor Code Colorizer Sensor
INFO: Sensor Code Colorizer Sensor (done) | time=1ms
INFO: Sensor CPD Block Indexer
INFO: DefaultCpdBlockIndexer is used for php
INFO: Sensor CPD Block Indexer (done) | time=0ms
INFO: Calculating CPD for 1 files
INFO: CPD calculation finished
INFO: Analysis report generated in 265ms, dir size=22 KB
INFO: Analysis reports compressed in 14ms, zip size=9 KB
INFO: Analysis report uploaded in 472ms
INFO: ANALYSIS SUCCESSFUL, you can browse http://localhost:9000/dashboard/index/org.sonarqube:php-simple-sq-scanner
INFO: Note that you will be able to access the updated dashboard once the server has processed the submitted analysis report
INFO: More about the report processing at http://localhost:9000/api/ce/task?id=AVthpV-GZk_1lOkjIdp8
INFO: ------------------------------------------------------------------------
INFO: EXECUTION SUCCESS
INFO: ------------------------------------------------------------------------
INFO: Total time: 16.131s
INFO: Final Memory: 43M/117M

註意:這裏面有一個文件需要定義的,告訴sonar 語言,版本,及相關。

[root@test-node3 php-sonar-runner]# cat sonar-project.properties 
# Required metadata
sonar.projectKey=org.sonarqube:php-simple-sq-scanner
sonar.projectName=PHP :: Simple Project :: SonarQube Scanner
sonar.projectVersion=1.0

# Comma-separated paths to directories with sources (required)
sonar.sources=src

# Language
sonar.language=php

# Encoding of the source files
sonar.sourceEncoding=UTF-8

技術分享圖片

技術分享圖片

持續集成與自動化部署 - jenkins & sonar代碼質量管理平臺 部署和基礎使用(五)