Arcgis Server 使用 selenium grid +Java 壓力測試實錄

阿新 • • 發佈：2019-01-16

1.測試思路

建立一臺測試虛擬機器,使用selenium 自動化UI測試方法測試 arcgis 地圖引擎，驗證200臺終端同時持續的隨機訪問arcgis 伺服器時，arcgis 伺服器是否可以正常服務.

Arcgis 伺服器配置: 虛擬機器 Arcgis 10.5 安裝在windows2008, 記憶體32GB，硬碟500GB，CPU 4個

記憶體 100GB，硬碟100GB，CPU 40個，作業系統cenos7

建立完成後，記得優化centos7

2.構造一個簡單的頁面，可以開啟指定的地圖，這裡用的是cgs2000座標系， index.html 內容如下面的web程式碼,

3.用瀏覽器開啟這個頁面,確保可以開啟地圖。

4.把這個頁面部署到nginx 伺服器測試虛擬機器上。

這裡我用的是nginx docker, 外掛一個目錄，目錄裡放的是index.html

記得開啟web埠，8777 （不用80,8080 因為測試機在單位內網，單位禁止使用這2個埠)

5. 用瀏覽器開啟 http://11.23.3.114:8777/index.html 確保一切正常瀏覽。

6.測試方法地圖上找個中心點（下面用的是福州市的地圖中心點) //119.30239300, latitude=26.06971100 福州茶亭公園 wgs84, 修改index.html

7. 採用本地WebDriver 方式測試（我是在Mac + chrome ）

8. 瀏覽器開啟 http://11.23.3.114:8777/index.html 這個頁面後, 隨機生成經度和緯度，偏差控制在新的點在指定城市（福州市）地圖上即可，最好加上市區的落點概率80%，郊區的20%，也就是20%的市區面積有80%的訪問率，80%面積的郊區有20%的落點概率。

9. 載入圖層後,聯絡點選+ 放大圖層，直到最大。

9.重複7的步驟。

10. 確認單一chrome 瀏覽器測試正常，達到預期。

11. 部署整套測試環境

1.部署nginx

happy:nginx happy$ tree
.
├── start-docker.sh
└── www
└── index.html

1 directory, 2 files

happy:nginx happy$ more start-docker.sh
#!/bin/bash
#確保shell 切換到當前shell 指令碼資料夾
current_file_path=$(cd "$(dirname "$0")"; pwd)
cd ${current_file_path}

sudo firewall-cmd --add-port=8777/tcp --zone=public --permanent
sudo firewall-cmd --add-port=443/tcp --zone=public --permanent
sudo firewall-cmd --reload
sudo firewall-cmd --list-all

docker stop testnginx
docker rm testnginx

docker run \
--restart=always \
--name=testnginx \
-p 8777:80 \
-p 443:443 \
-v `pwd`/www:/usr/share/nginx/html \
-d nginx:1.13-alpine

echo "開啟http://localhost:8777/index.html 可以瀏覽"

happy:nginx happy$ more www/index.html
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"/>
<title>ArcGIS JavaScript API: Image2013_CGCS2000</title>
<script src="http://11.23.2.101/arcgis_js_api/library/3.20/3.20/init.js"></script>
<link rel="stylesheet" href="http://11.23.2.101/arcgis_js_api/library/3.20/3.20/esri/css/esri.css">

var m_map={};

require([
"esri/layers/ArcGISDynamicMapServiceLayer",
"esri/layers/ArcGISTiledMapServiceLayer",
"esri/map",
"dojo/parser",
"dojo/domReady!",
"dijit/layout/BorderContainer",
"dijit/layout/ContentPane"

], function(ArcGISDynamicMapServiceLayer, ArcGISTiledMapServiceLayer, Map, parser){
parser.parse();
var map = new Map("map");
var layer;
layer = new ArcGISTiledMapServiceLayer("http://11.23.2.101/arcgis/rest/services/Image2013_CGCS2000/MapServer");
map.addLayer(layer);
map.setZoom(3);
//map.centerAt(new esri.geometry.Point(119.3,25.9,new esri.SpatialReference({wkid:4490})));
//119.30239300, latitude=26.06971100
map.centerAt(new esri.geometry.Point(119.30239300,26.06971100,new esri.SpatialReference({wkid:4490})));

m_map=map;
m_map.test = function (lon,lat,level) {
map.setZoom(level);
map.centerAt(new esri.geometry.Point(lon,lat,new esri.SpatialReference({wkid:4490})));
}
});

var m_randomMove = function (lon,lat,level) {
m_map.test(lon,lat,level);
}
</script> </head> <body > <div id="map" style="width:1200px;height:1500px;" >
</div> </body>
</html>

2.部署selenium-grid

在測試虛擬機器上。

mkdir -p /var/server/selenium-grid

happy:selenium-grid happy$ more start-selenium-grid-docker.sh
#!/bin/bash
#確保shell 切換到當前shell 指令碼資料夾
current_file_path=$(cd "$(dirname "$0")"; pwd)
cd ${current_file_path}

echo "命令格式 ./start-selenium-grid-docker.sh {瀏覽器docker容器數量}"
echo "命令格式 ./start-selenium-grid-docker.sh {瀏覽器docker容器數量}"
echo "將執行$1個瀏覽器docker,按CTRL+C 中斷退出"

if [ ! -n "$1" ] ;then
echo "請輸入瀏覽器docker容器數量"
exit 1
else
echo "瀏覽器docker容器數量是 $1"
fi

sleep 10

docker stop $(docker ps -a | grep 'selenium' | awk '{print $1 }')
docker rm $(docker ps -a | grep 'selenium' | grep 'Exited' | awk '{print $1 }')

#docker stop $(docker ps -a | grep 'selenium' | awk '{print $1 }')
#docker rm $(docker ps -a | grep 'selenium' | awk '{print $1 }')

#docker stop selenium-hub
#docker rm selenium-hub

dockerimage_compressed_tgz="selenium-hub-20180930.image.tgz"
dockerimage_name_version="selenium/hub:latest"
dockerimagelist=$(docker images | grep -v REPOSITORY | awk '{a=$1;b=$2;c=(a":"b);print c}')
found=0
#判斷dockerimagelist裡是否包含$dockerimage_name_version
case "${dockerimagelist}" in
*${dockerimage_name_version}*)
found=1;;
esac

if found==1 ; then
echo "${dockerimage_name_version}已經存在."
else
echo "本系統尚未載入${dockerimage_name_version} docker映象,馬上載入,請稍等一會兒..."
gunzip -c ${dockerimage_compressed_tgz} | docker load
fi
#gunzip -c selenium-hub-20180930.image.tgz | docker load
#gunzip -c selenium-node-chrome-20180930.image.tgz | docker load
#gunzip -c selenium-node-firefox-20180930.image.tgz | docker load

firewall-cmd --add-port=4444/tcp --zone=public --permanent
firewall-cmd --reload

docker run -d -p 4444:4444 --name selenium-hub selenium/hub:latest

COUNT=$1
for i in $(seq 1 $COUNT);
do
echo $i;
#docker run -d --link selenium-hub:hub selenium/node-firefox:latest
docker run -d --link selenium-hub:hub selenium/node-chrome:latest
done

echo "http://localhost:4444/grid/console"

12. 修改webdriver 為 RemoteWebDriver

    public static void main(String[] args) throws Exception {

        ArcgisPerformanceTest test = new ArcgisPerformanceTest();
        String driverType="chrome";

//        //1.本地測試，方便初期驗證測試方法是否正確.
//        for(int i=0;i<5;i++) {
//            new Thread(()-> test.localTask(driverType)).start();
//            test.waitFor(100);
//        }
//        test.waitFor(1000*60*60*24);

        //2.selenium-grid 遠端測試,用於大規模的壓力測試,模擬真實使用者訪問.
        int thread_number=180;  //
        for(int i=1;i<=thread_number;i++){
            new Thread(()-> test.remoteTask(driverType)).start();
            test.waitFor(100);
        }
    }

13. 執行測試我是採用200個docker 例項

14. 手動開啟Arcgis 看看是否還能開啟，監控網路流量.

java 測試程式碼如下:

package com.linyingjie.tool.documentTranslate;

import com.linyingjie.tool.documentTranslate.translate.GoogleFreeTranslate;

import com.linyingjie.tool.documentTranslate.translate.TranslateDirection;

import com.linyingjie.tool.documentTranslate.webdriver.config.DriverFactory;

import org.openqa.selenium.By;

import org.openqa.selenium.JavascriptExecutor;

import org.openqa.selenium.WebDriver;

import org.openqa.selenium.WebElement;

import org.openqa.selenium.chrome.ChromeDriver;

import org.openqa.selenium.firefox.FirefoxDriver;

import org.openqa.selenium.interactions.Actions;

import org.openqa.selenium.remote.DesiredCapabilities;

import org.openqa.selenium.remote.RemoteWebDriver;

import java.net.MalformedURLException;

import java.net.URL;

import java.util.ArrayList;

import java.util.Collections;

import java.util.List;

import java.util.concurrent.TimeUnit;

public class Application {

private static List<DriverFactory> webDriverThreadPool = Collections.synchronizedList(new ArrayList<DriverFactory>());

private static ThreadLocal<DriverFactory> driverThread;

public static void main(String[] args) throws Exception {

String driverType="chrome";

for(int i=1;i<=180;i++){

new Thread(()-> remoteTask(driverType)).start();

waitFor(100);

}

for(int i=0;i<20;i++) {

new Thread(()-> localTask(driverType)).start();

waitFor(100);

}

waitFor(1000*60*60*24);

}

public static void remoteTask(String driverType){

String seleniumGridHubURL="http://11.23.3.114:4444/wd/hub";

try {

WebDriver webDriver = getRemoteDriver(driverType, seleniumGridHubURL);

String entryURL = "http://11.23.3.114:8777/index.html";

arcgisTest(webDriver, entryURL);

}catch(Exception e){

e.printStackTrace();

}

public static void localTask(String driverType){

try {

WebDriver webDriver = getLocalDriver(driverType);//getDriver();

String entryURL = "http://11.23.3.114:8777/index.html";

arcgisTest(webDriver, entryURL);

}catch(Exception e){

e.printStackTrace();

}

/**

* 遠端版

* @throws Exception

public static void remoteDriverTest() throws Exception {

DesiredCapabilities firefoxDesiredcap = DesiredCapabilities.firefox();

DesiredCapabilities chromeDesiredcap = DesiredCapabilities.chrome();

//DesiredCapabilities ieDesiredcap = DesiredCapabilities.internetExplorer();

//DesiredCapabilities desiredCapabilities = firefoxDesiredcap;

DesiredCapabilities desiredCapabilities = chromeDesiredcap;

//String seleniumGridHubURL="http://192.168.102.6:4444/wd/hub";

String seleniumGridHubURL="http://11.23.3.114:4444/wd/hub";

WebDriver webDriver = new RemoteWebDriver(new URL(seleniumGridHubURL), desiredCapabilities);

webDriverTest(webDriver);

}

/**

* 遠端版

* @throws Exception

public static WebDriver getRemoteDriver(String driverType,String seleniumGridHubURL) throws Exception {

DesiredCapabilities desiredCapabilities = null;

if("firefox".equals(driverType.toLowerCase())){

desiredCapabilities = DesiredCapabilities.firefox();

}

else if("chrome".equals(driverType.toLowerCase())){

desiredCapabilities = DesiredCapabilities.chrome();

}

else if("ie".equals(driverType.toLowerCase())){

desiredCapabilities = DesiredCapabilities.internetExplorer();

}

else {

throw new UnsupportedOperationException("尚未支援的型別....");

}

System.out.println("driverType="+driverType+" desiredCapabilities="+desiredCapabilities);

WebDriver webDriver = new RemoteWebDriver(new URL(seleniumGridHubURL), desiredCapabilities);

return webDriver;

}

public static void localWebDriverTest(){

WebDriver driver = getLocalDriver("chrome");//getDriver();

webDriverTest(driver);

}

//http://11.23.3.114:8777/

public static void arcgisTest(WebDriver webDriver, String entryURL) {

try {

webDriver.manage().window().maximize();

}catch(Exception e){

e.printStackTrace();

}

webDriver.manage().timeouts().implicitlyWait(8, TimeUnit.SECONDS);

//driver.manage().timeouts().pageLoadTimeout(20,TimeUnit.SECONDS);

//driver.manage().timeouts().setScriptTimeout(20,TimeUnit.SECONDS);

webDriver.get(entryURL);

Thread.sleep(4000);

System.out.println(entryURL+" 載入成功.");

long step = 100000+System.nanoTime()%100000;

randomMove(webDriver,step);

webDriver.close();

} catch (Exception e) {

e.printStackTrace();

System.exit(1);

}

if (webDriver != null) {

System.out.println("driver!=null");

} else {

System.out.println("driver==null");

}

private static void randomMove(WebDriver webDriver,long step){

WebElement plusButton = null;

try {

plusButton = webDriver.findElement(By.xpath("//div[contains(@class,'esriSimpleSliderIncrementButton')]"));

}catch(Exception e){

e.printStackTrace();

}

//WebElement minusButton = webDriver.findElement(By.xpath("//div[contains(@class,'esriSimpleSliderDecrementButton')]"));

for(int i=0;i<step;i++) {

//119.30239300, latitude=26.06971100 福州茶亭公園

//119.30033306347656,26.06078460839844

double fuzhouCenterLongitude=119.30239300;

double fuzhouCenterLatitude=26.06971100;

double longitude=(fuzhouCenterLongitude-0.5)+0.5*Math.random();

double latitude=(fuzhouCenterLatitude-0.2)+0.5*Math.random();

int zoomLevel=1+(int)(Math.random()*8);

String randomMoveJavascript = "m_randomMove("+longitude+","+latitude+","+zoomLevel+");";

waitFor(1000);

if (webDriver instanceof JavascriptExecutor) {

try {

((JavascriptExecutor) webDriver).executeScript(randomMoveJavascript);

}catch(Exception e){

e.printStackTrace();

}

} else {

throw new IllegalStateException("This driver does not support JavaScript!");

}

int maxZoomLevel=12;

int k=1+(int)(Math.random()*maxZoomLevel);

if(plusButton!=null) {

for (int t = 0; t < k; t++) {

plusButton.click();

waitFor(100);

}

long timeWaitForInMilliseconds=3000+(long)(Math.random()*2000);

System.out.println("將等待"+timeWaitForInMilliseconds+"毫秒. longitude="+longitude+" latitude="+latitude);

waitFor(timeWaitForInMilliseconds);

}

public static void waitFor(long timeInMilliseconds) {

try {

Thread.sleep(timeInMilliseconds);

} catch (InterruptedException e) {

e.printStackTrace();

}

public static WebDriver getLocalDriver(String name) {

if ("firefox".equals(name.toLowerCase())) {

return getLocalFireFoxDriver();

}

if ("chrome".equals(name.toLowerCase())) {

return getLocalChromeDriver();

}

return null;

}

public static WebDriver getLocalFireFoxDriver() {

// declaration and instantiation of objects/variables

System.setProperty("webdriver.firefox.marionette", "/Users/happy/server/selenium/firefox/mac/0.21.0/geckodriver");

WebDriver driver = new FirefoxDriver();

return driver;

}

public static WebDriver getLocalChromeDriver() {

System.setProperty("webdriver.chrome.driver", "/Users/happy/server/selenium/chrome/mac/2.40/chromedriver");

WebDriver driver = new ChromeDriver();

return driver;

}

Arcgis Server 使用 selenium grid +Java 壓力測試實錄

Arcgis Server 使用 selenium grid +Java 壓力測試實錄

JMeter-Java壓力測試工具-02

Selenium Grid分布式測試入門詳解

java+Selenium+TestNg搭建自動化測試架構(1)實現代碼和數據的分離

Java + Selenium + Appium手機自動化測試

Java+Maven+selenium+testing+reportNG自動化測試框架

Java+Selenium Web UI自動化測試的一些小總結

docker+selenium Grid搭建自動化分布式測試環境

selenium-java自動化測試環境搭建中的問題以及解決方法

selenium-java自動化測試環境搭建

java服務端程式部署伺服器以及壓力測試過程

jmeter壓力測試報錯:java.net.BindException: Address already in use: connect

[搬運工系列]-JMeter（二十一）壓力測試-測試Java請求

shell方式telnet方式lua方式java方式壓力測試redis

走進Java介面測試之簡單快速的Mock Server Moco

java程序在經過壓力測試後，系統記憶體佔用比居高不下

【開發筆記】茶餘飯後：2、Java問題排查（壓力測試效能監控）

運用Jmeter做Java Web壓力測試例項

【高併發】壓力測試 java.io.IOException: Too many open files解決方案

Selenium+Java自動化測試的方法

Arcgis Server 使用 selenium grid +Java 壓力測試實錄

相關推薦