利用系統快取提高PostgreSQL操作效率

環境介紹：

OS：Centos 6.4 64bit
Database：PostgreSQL9.4
Memory：2G
CPU：1核

下載安裝：

在pgfoundry下載pgfincore-v1.1.1.tar.gz，，將原始碼解壓到資料庫原始碼下的contrib下。不要在其github上下載，目前應該有一些bug，最新版本為1.1.1，1.1.2在我試用的時候發現大部分函式無法使用。

其次在我編譯時一直出現如下錯誤：

Shell

[postgres@localhost pgfincore-1.1.1]$ make
/bin/sh: pg_config: command not found
make: pg_config: Command not found
cp pgfincore.sql pgfincore--1.1.1.sql
cp: cannot create regular file `pgfincore--1.1.1.sql': Permission denied
make: *** [pgfincore--1.1.1.sql] Erro<code>r 1

123456

[postgres@localhost pgfincore-1.1.1]$make/bin/sh:pg_config:commandnotfoundmake:pg_config:Commandnotfoundcppgfincore.sqlpgfincore--1.1.1.sqlcp:cannot create regular file`pgfincore--1.1.1.sql':Permission deniedmake:***[pgfincore--1.1.1.sql]Erro<code>

所以在此我修改了一下Makefile檔案，內容如下：

Shell

# contrib/pgfincore/Makefile

MODULE_big = pgfincore
OBJS = pgfincore.o

EXTENSION = pgfincore
DATA = pgfincore--1.1.1.sql pgfincore--unpackaged--1.1.1.sql

ifdef USE_PGXS
PG_CONFIG = pg_config
PGXS := $(shell $(PG_CONFIG) --pgxs)
include $(PGXS)
else
subdir = contrib/pgfincore
top_builddir = ../..
include $(top_builddir)/src/Makefile.global
include $(top_srcdir)/contrib/contrib-global.mk

1234567891011121314151617

# contrib/pgfincore/MakefileMODULE_big=pgfincoreOBJS=pgfincore.oEXTENSION=pgfincoreDATA=pgfincore--1.1.1.sqlpgfincore--unpackaged--1.1.1.sqlifdef USE_PGXSPG_CONFIG=pg_configPGXS:=$(shell$(PG_CONFIG)--pgxs)include$(PGXS)elsesubdir=contrib/pgfincoretop_builddir=../..include$(top_builddir)/src/Makefile.globalinclude$(top_srcdir)/contrib/contrib-global.mk

現在進行make，即可：

Shell

[postgres@localhost pgfincore-1.1.1]$ make
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -g -O2 -fpic -I. -I. -I../../src/include -D_GNU_SOURCE   -c -o pgfincore.o pgfincore.c
pgfincore.c: In function ‘pgsysconf’:
pgfincore.c:227: warning: implicit declaration of function ‘heap_form_tuple’
pgfincore.c:227: warning: assignment makes pointer from integer without a cast
pgfincore.c: In function ‘pgfadvise’:
pgfincore.c:477: warning: assignment makes pointer from integer without a cast
pgfincore.c: In function ‘pgfadvise_loader’:
pgfincore.c:710: warning: assignment makes pointer from integer without a cast
pgfincore.c: In function ‘pgfincore’:
pgfincore.c:1016: warning: assignment makes pointer from integer without a cast
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -g -O2 -fpic -shared -o pgfincore.so pgfincore.o -L../../src/port -L../../src/common -Wl,--as-needed -Wl,-rpath,'/opt/hg3.0/lib',--enable-new-dtags  
[postgres@localhost pgfincore-1.1.1]$ make install
/bin/mkdir -p '/opt/hg3.0/lib/postgresql'
/bin/mkdir -p '/opt/hg3.0/share/postgresql/extension'
/bin/mkdir -p '/opt/hg3.0/share/postgresql/extension'
/usr/bin/install -c -m 755  pgfincore.so '/opt/hg3.0/lib/postgresql/pgfincore.so'
/usr/bin/install -c -m 644 pgfincore.control '/opt/hg3.0/share/postgresql/extension/'
/usr/bin/install -c -m 644 pgfincore--1.1.1.sql pgfincore--unpackaged--1.1.1.sql '/opt/hg3.0/share/postgresql/extension/'
[postgres@localhost pgfincore-1.1.1]$

1234567891011121314151617181920

[postgres@localhost pgfincore-1.1.1]$makegcc-Wall-Wmissing-prototypes-Wpointer-arith-Wdeclaration-after-statement-Wendif-labels-Wmissing-format-attribute-Wformat-security-fno-strict-aliasing-fwrapv-g-O2-fpic-I.-I.-I../../src/include-D_GNU_SOURCE-c-opgfincore.opgfincore.cpgfincore.c:Infunction‘pgsysconf’:pgfincore.c:227:warning:implicit declaration of function‘heap_form_tuple’pgfincore.c:227:warning:assignment makes pointer from integerwithoutacastpgfincore.c:Infunction‘pgfadvise’:pgfincore.c:477:warning:assignment makes pointer from integerwithoutacastpgfincore.c:Infunction‘pgfadvise_loader’:pgfincore.c:710:warning:assignment makes pointer from integerwithoutacastpgfincore.c:Infunction‘pgfincore’:pgfincore.c:1016:warning:assignment makes pointer from integerwithoutacastgcc-Wall-Wmissing-prototypes-Wpointer-arith-Wdeclaration-after-statement-Wendif-labels-Wmissing-format-attribute-Wformat-security-fno-strict-aliasing-fwrapv-g-O2-fpic-shared-opgfincore.sopgfincore.o-L../../src/port-L../../src/common-Wl,--as-needed-Wl,-rpath,'/opt/hg3.0/lib',--enable-new-dtags[postgres@localhost pgfincore-1.1.1]$makeinstall/bin/mkdir-p'/opt/hg3.0/lib/postgresql'/bin/mkdir-p'/opt/hg3.0/share/postgresql/extension'/bin/mkdir-p'/opt/hg3.0/share/postgresql/extension'/usr/bin/install-c-m755pgfincore.so'/opt/hg3.0/lib/postgresql/pgfincore.so'/usr/bin/install-c-m644pgfincore.control'/opt/hg3.0/share/postgresql/extension/'/usr/bin/install-c-m644pgfincore--1.1.1.sqlpgfincore--unpackaged--1.1.1.sql'/opt/hg3.0/share/postgresql/extension/'[postgres@localhost pgfincore-1.1.1]$

實驗記錄：

1、安裝：

Shell

[postgres@localhost bin]$ ./psql 
psql (9.4.5)
Type "help" for help.

postgres=# create extension pgfincore ;
CREATE EXTENSION
postgres=# select * from pg_extension ;
  extname  | extowner | extnamespace | extrelocatable | extversion | extconfig |
 extcondition 
-----------+----------+--------------+----------------+------------+-----------+
--------------
 plpgsql   |       10 |           11 | f              | 1.0        |           |
 
 pgfincore |       10 |         2200 | t              | 1.1.1      |           |
 
(2 rows)

postgres=#

123456789101112131415161718

[postgres@localhost bin]$./psql psql(9.4.5)Type"help"forhelp.postgres=# create extension pgfincore ;CREATE EXTENSIONpostgres=# select * from pg_extension ;extname|extowner|extnamespace|extrelocatable|extversion|extconfig|extcondition-----------+----------+--------------+----------------+------------+-----------+--------------plpgsql|10|11|f|1.0||pgfincore|10|2200|t|1.1.1||(2rows)postgres=#

2、準備工作：記錄比較使用pgfincore前後的效能差，使用外掛pg_stat_statments記錄每條sql的使用時間。
其次將shared_buffer改為16mb，減少其對pgfincore的影響。

Shell

postgres=# create extension pg_stat_statements ;
CREATE EXTENSION
postgres=# select * from pg_extension ;
      extname       | extowner | extnamespace | extrelocatable | extversion | ex
tconfig | extcondition 
--------------------+----------+--------------+----------------+------------+---
--------+--------------
 plpgsql            |       10 |           11 | f              | 1.0        |   
        | 
 pgfincore          |       10 |         2200 | t              | 1.1.1      |   
        | 
 pg_stat_statements |       10 |         2200 | t              | 1.2        |   
        | 
(3 rows)

1234567891011121314

postgres=# create extension pg_stat_statements ;CREATE EXTENSIONpostgres=# select * from pg_extension ;extname|extowner|extnamespace|extrelocatable|extversion|extconfig|extcondition--------------------+----------+--------------+----------------+------------+-----------+--------------plpgsql|10|11|f|1.0||pgfincore|10|2200|t|1.1.1||pg_stat_statements|10|2200|t|1.2||(3rows)

3、建立表testmem，分別在使用和不適用pgfincore情況下進行select, update, delete的操作，並對比執行時間，在這裡為了更好的去作比較，建立三張表testmem1，testmem2，testmem3，分別進行三種操作進行對比。並插入相同的資料。

Shell

[postgres@localhost bin]$ ./psql 
psql (9.4.5)
Type "help" for help.

postgres=# d
No relations found.
postgres=# create table testmem1(t1 int, t2 text, t3 text, t4 bigint, t5 text, t6 text, t7 varchar, t8 char(22), t9 numeric);CREATE TABLE
postgres=# create table testmem2(t1 int, t2 text, t3 text, t4 bigint, t5 text, t6 text, t7 varchar, t8 char(22), t9 numeric);
CREATE TABLE
postgres=# create table testmem3(t1 int, t2 text, t3 text, t4 bigint, t5 text, t6 text, t7 varchar, t8 char(22), t9 numeric);
CREATE TABLE
postgres=# insert into testmem1 select generate_series(1,999999), 'wangshuo'||generate_series(1,999999)::text||random()::text, generate_series(1,999999)::text||'sure',generate_series(1,999999), random()::text,random()::text,random()::text,'liuyuanyuan', generate_series(1,999999);
INSERT 0 999999
postgres=# select pg_relation_size('testmem1')/1024/1024||'MB';
 ?column? 
----------
 166MB
(1 row)

postgres=# insert into testmem2 select generate_series(1,999999), 'wangshuo'||generate_series(1,999999)::text||random()::text, generate_series(1,999999)::text||'sure',generate_series(1,999999), random()::text,random()::text,random()::text,'liuyuanyuan', generate_series(1,999999);
INSERT 0 999999
postgres=# insert into testmem3 select generate_series(1,999999), 'wangshuo'||generate_series(1,999999)::text||random()::text, generate_series(1,999999)::text||'sure',generate_series(1,999999), random()::text,random()::text,random()::text,'liuyuanyuan', generate_series(1,999999);
INSERT 0 999999
postgres=# select pg_relation_size('testmem2')/1024/1024||'MB'; ?column? 
----------
 166MB
(1 row)

postgres=# select pg_relation_size('testmem3')/1024/1024||'MB';
 ?column? 
----------
 166MB
(1 row)

postgres=#

1234567891011121314151617181920212223242526272829303132333435

[postgres@localhost bin]$./psql psql(9.4.5)Type"help"forhelp.postgres=# dNo relations found.postgres=# create table testmem1(t1 int, t2 text, t3 text, t4 bigint, t5 text, t6 text, t7 varchar, t8 char(22), t9 numeric);CREATE TABLEpostgres=# create table testmem2(t1 int, t2 text, t3 text, t4 bigint, t5 text, t6 text, t7 varchar, t8 char(22), t9 numeric);CREATE TABLEpostgres=# create table testmem3(t1 int, t2 text, t3 text, t4 bigint, t5 text, t6 text, t7 varchar, t8 char(22), t9 numeric);CREATE TABLEpostgres=# insert into testmem1 select generate_series(1,999999), 'wangshuo'||generate_series(1,999999)::text||random()::text, generate_series(1,999999)::text||'sure',generate_series(1,999999), random()::text,random()::text,random()::text,'liuyuanyuan', generate_series(1,999999);INSERT0999999postgres=# select pg_relation_size('testmem1')/1024/1024||'MB';?column?----------166MB(1row)postgres=# insert into testmem2 select generate_series(1,999999), 'wangshuo'||generate_series(1,999999)::text||random()::text, generate_series(1,999999)::text||'sure',generate_series(1,999999), random()::text,random()::text,random()::text,'liuyuanyuan', generate_series(1,999999);INSERT0999999postgres=# insert into testmem3 select generate_series(1,999999), 'wangshuo'||generate_series(1,999999)::text||random()::text, generate_series(1,999999)::text||'sure',generate_series(1,999999), random()::text,random()::text,random()::text,'liuyuanyuan', generate_series(1,999999);INSERT0999999postgres=# select pg_relation_size('testmem2')/1024/1024||'MB'; ?column? ----------166MB(1row)postgres=# select pg_relation_size('testmem3')/1024/1024||'MB';?column?----------166MB(1row)postgres=#

三種操作效能對比：

Shell

postgres=# select * from testmem1 where t1  1208;
   t1   |                 t2                 |     t3     |   t4   |          t5
          |          t6          |          t7          |           t8          
 |   t9   
--------+------------------------------------+------------+--------+------------
----------+----------------------+----------------------+-----------------------
-+--------
   1209 | wangshuo12090.964191045146435      | 1209sure   |   1209 | 0.075409890
152514    | 0.468206159770489    | 0.692714618053287    | liuyuanyuan           
 |   1209
   1210 | wangshuo12100.652063825167716      | 1210sure   |   1210 | 0.026932121
720165    | 0.802233531605452    | 0.706556385848671    | liuyuanyuan           
 |   1210
   1211 | wangshuo12110.724962076637894      | 1211sure   |   1211 | 0.732285636
477172    | 0.816857317462564    | 0.868489125277847    | liuyuanyuan           
 |   1211
   1212 | wangshuo12120.0478062951005995     | 1212sure   |   1212 | 0.190716865
006834    | 0.898683389648795    | 0.537546805106103    | liuyuanyuan           
 |   1212
   1213 | wangshuo12130.582098880317062      | 1213sure   |   1213 | 0.161297460
086644    | 0.395338968373835    | 0.684920639265329    | liuyuanyuan           
 |   1213
   1214 | wangshuo12140.53120110463351       | 1214sure   |   1214 | 0.253457680
810243    | 0.428548218682408    | 0.671272001229227    | liuyuanyuan           

postgres=# update testmem2 set t7 = random()::text where t1  1208;
UPDATE 788223
postgres=# delete from testmem3 where t1  1208;
DELETE 788223

利用系統快取提高PostgreSQL操作效率

利用系統快取提高PostgreSQL操作效率

oa辦公管理系統，提高企業辦公效率

利用jdbc操作資料庫——prepareStatement和Statement的比較以及利用batch模式提高效率的心得

充分利用CPU快取記憶體，提高程式效率（原理篇）

利用U盤裝Ubuntu操作系統

各種引用方式提高string的操作效率

善用快取提高你的Spring工程效率

如何通過TotalControl系統設定，提高電腦操作手機速度(教程)

oracle 並行parallel操作,會大大提高sql執行效率

如何高效地利用時間，提高工作效率？

（Linux）釋放系統快取操作

利用redis快取對 list集合中的資料進行分頁操作（一）

Linux性能優化實戰：如何利用系統緩存優化程序的運行效率？（17）

go 自己封的postgresql操作包

五十個小技巧提高PHP執行效率(一)

怎樣利用JDBC連接並操作Oracle數據庫

幾款實力很強的小工具，提高Windows使用效率

利用SQL索引提高查詢速度

從零開始學Linux系統之Vi/Vim操作

公司管理軟件真的可以提高企業辦公效率嗎？

利用系統快取提高PostgreSQL操作效率

相關推薦