1. 程式人生 > >elasticsearch 壓測優化後的配置

elasticsearch 壓測優化後的配置

配置說明

一、JVM配置:

Jdk1.8es要求最低jdk1.7

最大堆最小堆均為32G

GC型別:-XX:+UseG1Gc -XX:MaxGCPauseMillis=200 

其他預設。

二、Es叢集配置:

cluster.name: es-test

node.name: "test-169-71"

node.master: false

node.data: true

index.store.type: niofs                                讀寫檔案方式

index.cache.field.type: soft                         快取型別

bootstrap.mlockall: true                             禁用swap

gateway.type: local                                    本地儲存

gateway.recover_after_nodes: 3                   3個數據節點開始恢復

gateway.recover_after_time: 5m                  5分鐘後開始恢復資料

gateway.expected_nodes: 4                         4

es節點開始恢復

cluster.routing.allocation.node_initial_primaries_recoveries:8           併發恢復分片數

cluster.routing.allocation.node_concurrent_recoveries:2            同時recovery併發數

indices.recovery.max_bytes_per_sec: 250mb                            資料在節點間傳輸最大頻寬

indices.recovery.concurrent_streams: 8                             同時讀取資料檔案流執行緒

discovery.zen.ping.multicast.enabled: false                        禁用多播

discovery.zen.ping.unicast.hosts:["192.168.169.51:9300", "192.168.169.52:9300"]

discovery.zen.fd.ping_interval: 10s                     節點間存活檢測間隔

discovery.zen.fd.ping_timeout: 120s                   存活超時時間

discovery.zen.fd.ping_retries: 6                          存活超時重試次數

http.cors.enabled: true                                       使用監控

index.analysis.analyzer.ik.type:"ik"                   ik分詞

#####thread pool setting#################

threadpool.index.type: fixed                              寫索引執行緒池型別

threadpool.index.size: 64                                   執行緒池大小(建議2~3cpu數)

threadpool.index.queue_size: 1000                            佇列大小

threadpool.search.size: 64                                  搜尋執行緒池大小

threadpool.search.type: fixed                             搜尋執行緒池型別

threadpool.search.queue_size: 1000                    佇列大小

threadpool.get.type: fixed                                  取資料執行緒池型別

threadpool.get.size: 32                                      取資料執行緒池大小

threadpool.get.queue_size: 1000                         佇列大小

threadpool.bulk.type: fixed                                批量請求執行緒池型別

threadpool.bulk.size: 32                                    批量請求執行緒池大小

threadpool.bulk.queue_size: 1000                       佇列大小

threadpool.flush.type: fixed                               刷磁碟執行緒池型別

threadpool.flush.size: 32                                          刷磁碟執行緒池大小

threadpool.flush.queue_size: 1000                      佇列大小

#indices.store.throttle.type: merge

indices.store.throttle.type: none                                 寫磁碟型別

indices.store.throttle.max_bytes_per_sec:500mb        寫磁碟最大頻寬

index.merge.scheduler.max_thread_count: 8               索引merge最大執行緒數

index.translog.flush_threshold_size:600MB               重新整理translog檔案閥值