05: MongoDB副本集 MongoDB文件管理
NSD NOSQL DAY05
1 案例1:配置MongoDB副本集
1.1 問題
- 具體要求:
- 準備3臺mongodb伺服器
- 配置副本集服務
- 驗證副本集配置
1.2 方案
準備三臺虛擬機器,配置mongodb副本集,ip分別為192.158.4.51, 192.168.4.52,192.168.4.53其中一個是主節點,負責處理客戶端請求,其餘的都是從節點,負責複製主節點上的資料,實現儲存資料副本,提高了資料的可用性,具體分配如表-1所示:
表-1
1.3 步驟
實現此案例需要按照如下步驟進行。
步驟一:建立mongodb副本集
1)三臺主機安裝mongodb(以4.51為例)
- [[email protected] ~]# cd mongodb/
- [[email protected] mongodb]# mkdir /usr/local/mongodb
- [[email protected] mongodb]# cd /usr/local/mongodb
- [[email protected] mongodb]# cp -r \
- /root/mongodb/mongodb-linux-x86_64-rhel70-3.6.3/bin/ .
- [[email protected] mongodb]# ls
- bin
- [[email protected]
- [[email protected] mongodb]# mkdir log
- [[email protected] mongodb]# mkdir -p data/db
- [[email protected] mongodb]# vim etc/mongodb.conf
- dbpath=/usr/local/mongodb/data/db/
- logpath=/usr/local/mongodb/log/mongodb.log
- logappend=true
- fork=true
- bind_ip=192.168.4.51
- port=27077
- replSet=rs1
- //加入到副本集,rs1名字隨便起,想知道誰和我在一個副本集裡,三臺機器的名字一樣,都寫rs1
2)設定PATH變數
- [[email protected] mongodb]# vim /etc/profile
- export PATH=/usr/local/mongodb/bin:$PATH
- [[email protected] mongodb]# source /etc/profile
3)由於啟動和停止服務名字太長,可以起一個別名
給停止服務起一個別名
- [[email protected] mongodb]# alias cmdb='mongod --dbpath=/usr/local/mongodb/data/db/ --shutdown'
給啟動服務起一個別名
- [[email protected] mongodb]# alias smdb='mongod -f /usr/local/mongodb/etc/mongodb.conf'
4)啟動服務並連線
- [[email protected] ~]# smdb
- about to fork child process, waiting until server is ready for connections.
- forked process: 5656
- child process started successfully, parent exiting
- [[email protected] ~]# mongo --host 192.168.4.51 --port 27077
- MongoDB shell version v3.6.3
- connecting to: mongodb://192.168.4.51:27077/
- MongoDB server version: 3.6.3
- ...
- >
5)配置叢集資訊,任意一臺都可以,在這裡在51上面操作
- > rs1_config = { //rs1_config隨便起變數名,要記住
- _id:"rs1", //必須為rs1這個,三臺主機叢集名,配置檔案裡面寫的是這個
- members:[
- {_id:0,host:"192.168.4.51:27077"}, //_id值隨意,host值固定
- {_id:1,host:"192.168.4.52:27078"},
- {_id:2,host:"192.168.4.53:27079"}
- ]
- }; //回車,出現下面情況為成功
- {
- "_id" : "rs1",
- "members" : [
- {
- "_id" : 0,
- "host" : "192.168.4.51:27077"
- },
- {
- "_id" : 1,
- "host" : "192.168.4.52:27078"
- },
- {
- "_id" : 2,
- "host" : "192.168.4.53:27079"
- }
- ]
- }
- >
6)初始化Replica Sets環境
- > rs.initiate(rs1_config)
- {
- "ok" : 1,
- "operationTime" : Timestamp(1538187475, 1),
- "$clusterTime" : {
- "clusterTime" : Timestamp(1538187475, 1),
- "signature" : {
- "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
- "keyId" : NumberLong(0)
- }
- }
- }
- rs1:SECONDARY>
- rs1:PRIMARY> //提示PRIMARY,51為主
7)在52和53上面檢視
- [[email protected] ~]# mongo --host 192.168.4.52 --port 27078
- MongoDB shell version v3.6.3
- connecting to: mongodb://192.168.4.52:27078/
- MongoDB server version: 3.6.3
- ...
- ...
- rs1:SECONDARY> //提示SECONDARY,52為從
- rs1:SECONDARY>
- rs1:SECONDARY>
- [[email protected] ~]# mongo --host 192.168.4.53 --port 27079
- MongoDB shell version v3.6.3
- connecting to: mongodb://192.168.4.53:27079/
- MongoDB server version: 3.6.3
- ...
- ...
- rs1:SECONDARY> //提示SECONDARY,53為從
- rs1:SECONDARY>
注意:如果初始化錯誤,重啟服務登陸之後重新設定變數,之後再重新初始化
8)檢視狀態資訊
- rs1:PRIMARY> rs.status()
- ...
- "members" : [
- {
- "_id" : 0,
- "name" : "192.168.4.51:27077",
- "health" : 1,
- "state" : 1,
- "stateStr" : "PRIMARY",
- "uptime" : 2295,
- ...
- ...
- },
- {
- "_id" : 1,
- "name" : "192.168.4.52:27078",
- "health" : 1,
- "state" : 2,
- "stateStr" : "SECONDARY",
- "uptime" : 384,
- ...
- ...
- },
- {
- "_id" : 2,
- "name" : "192.168.4.53:27079",
- "health" : 1,
- "state" : 2,
- "stateStr" : "SECONDARY",
- ...
- ...
9)檢視是否是master庫
- rs1:PRIMARY> rs .isMaster( )
- {
- "hosts" : [
- "192.168.4.51:27077",
- "192.168.4.52:27078",
- "192.168.4.53:27079"
- ],
- "setName" : "rs1",
- "setVersion" : 1,
- "ismaster" : true, //主庫
- "secondary" : false,
- "primary" : "192.168.4.51:27077",
- "me" : "192.168.4.51:27077",
- ...
- ...
10)驗證副本集,同步資料驗證(51上面寫資料)
- rs1:PRIMARY> use gamedb2
- switched to db gamedb2
- rs1:PRIMARY> db.a.save({name:"yaya",age:75,em:"[email protected]"})
- WriteResult({ "nInserted" : 1 })
52上面檢視
- [[email protected] ~]# mongo --host 192.168.4.52 --port 27078
- rs1:SECONDARY> db.getMongo().setSlaveOk()
- rs1:SECONDARY> show dbs //有gamedb2庫
- admin 0.000GB
- config 0.000GB
- ddsdb 0.000GB
- gamedb2 0.000GB
- local 0.000GB
- test 0.000GB
步驟三:切換主庫驗證
1)自動切換主庫驗證
關閉51
- [[email protected] ~]# cmdb //之前設定的別名
- killing process with pid: 5656
檢視52和53
- [[email protected] ~]# mongo --host 192.168.4.52 --port 27078
- MongoDB shell version v3.6.3
- connecting to: mongodb://192.168.4.52:27078/
- MongoDB server version: 3.6.3
- ...
- ...
- rs1:PRIMARY> //52為主
- rs1:PRIMARY>
- [[email protected] ~]# mongo --host 192.168.4.53 --port 27079
- MongoDB shell version v3.6.3
- connecting to: mongodb://192.168.4.53:27079/
- MongoDB server version: 3.6.3
- ...
- ...
- rs1:SECONDARY> //53為從
啟動51,啟動後不會再變為主,會成為52的從
- [[email protected] ~]# smdb
- about to fork child process, waiting until server is ready for connections.
- forked process: 6598
- child process started successfully, parent exiting
- rs1:SECONDARY> rs.isMaster()
- {
- "hosts" : [
- "192.168.4.51:27077",
- "192.168.4.52:27078",
- "192.168.4.53:27079"
- ],
- "setName" : "rs1",
- "setVersion" : 1,
- "ismaster" : false,
- "secondary" : true,
- "primary" : "192.168.4.52:27078",
- "me" : "192.168.4.51:27077",
- ...
2 案例2:文件管理
2.1 問題
- 基於MongoDB環境完成下列練習:
- 插入文件
- 查詢文件
- 更新文件
- 刪除文件
2.2 步驟
實現此案例需要按照如下步驟進行。
步驟一:管理文件
1)把系統使用者資訊/etc/passwd儲存到mdb庫下的user集合裡
- rs1:PRIMARY> use mdb
- switched to db mdb
- rs1:PRIMARY> db.user.save({name:"yaya",password:"x",uid:9999,gid:9999,comment:"",homdir:"/home",shell:"/bin/bash"})
- WriteResult({ "nInserted" : 1 })
- rs1:PRIMARY> exit
- bye
- [[email protected] ~]# mongoexport --host 192.168.4.52 --port 27078 -d mdb -c user -f name,password,uid,gid,comment,homdir,shell --type=csv -o /tmp/user.csv
- 2018-09-29T11:04:14.967+0800 connected to: 192.168.4.52:27078
- 2018-09-29T11:04:14.968+0800 exported 1 record
- [[email protected] ~]# cp /etc/passwd /tmp
- [[email protected] ~]# sed -i 's/:/,/g' /tmp/passwd
- [[email protected] ~]# sed -i '$r /tmp/passwd' /tmp/user.csv
- [[email protected] ~]# mongoimport --host 192.168.4.52 --port 27078 -d mdb -c user --headerline --type=csv /tmp/user.csv
- 2018-09-29T11:06:08.355+0800 connected to: 192.168.4.52:27078
- 2018-09-29T11:06:08.363+0800 imported 41 documents
2)檢視
- [[email protected] ~]# mongo --host 192.168.4.52 --port 27078
- rs1:PRIMARY> use mdb
- switched to db mdb
- rs1:PRIMARY> db.user.findOne()
- {
- "_id" : ObjectId("5baeeb37ce3cc5539aa21f38"),
- "name" : "yaya",
- "password" : "x",
- "uid" : 9999,
- "gid" : 9999,
- "comment" : "",
- "homdir" : "/home",
- "shell" : "/bin/bash"
- }
db.user.find({條件},{定義顯示的欄位}) #指定查詢條件並指定顯示的欄位
- rs1:PRIMARY> db.user.find()
- { "_id" : ObjectId("5baeeb37ce3cc5539aa21f38"), "name" : "yaya", "password" : "x", "uid" : 9999, "gid" : 9999, "comment" : "", "homdir" : "/home", "shell" : "/bin/bash" }
- ...
- Type "it" for more //出現這個按it,默認出現20行
檢視每行的name欄位
- rs1:PRIMARY> db.user.find({},{name:1})
- { "_id" : ObjectId("5baeeb37ce3cc5539aa21f38"), "name" : "yaya" }
- ...
- ...
- { "_id" : ObjectId("5baeec2001805180a1011843"), "name" : "rpc" }
- Type "it" for more
不看_id欄位
- rs1:PRIMARY> db.user.find({},{_id:0})
- { "name" : "yaya", "password" : "x", "uid" : 9999, "gid" : 9999, "comment" : "", "homdir" : "/home", "shell" : "/bin/bash" }
- ...
- ...
- { "name" : "rpc", "password" : "x", "uid" : 32, "gid" : 32, "comment" : "Rpcbind Daemon", "homdir" : "/var/lib/rpcbind", "shell" : "/sbin/nologin" }
- Type "it" for more
不看_id那一列,看name那一列
- rs1:PRIMARY> db.user.find({},{_id:0,name:1})
- { "name" : "yaya" }
- ...
- ...
- { "name" : "rpc" }
- Type "it" for more
檢視以a開頭的name欄位
- rs1:PRIMARY> db.user.find({name:/^a/},{_id:0})
- { "name" : "adm", "password" : "x", "uid" : 3, "gid" : 4, "comment" : "adm", "homdir" : "/var/adm", "shell" : "/sbin/nologin" }
- { "name" : "abrt", "password" : "x", "uid" : 173, "gid" : 173, "comment" : "", "homdir" : "/etc/abrt", "shell" : "/sbin/nologin" }
- { "name" : "avahi", "password" : "x", "uid" : 70, "gid" : 70, "comment" : "Avahi mDNS/DNS-SD Stack", "homdir" : "/var/run/avahi-daemon", "shell" : "/sbin/nologin" }
顯示查詢結果的前一行
limit 數字
- rs1:PRIMARY> db.user.find({name:/^a/},{_id:0}).limit (1)
- { "name" : "adm", "password" : "x", "uid" : 3, "gid" : 4, "comment" : "adm", "homdir" : "/var/adm", "shell" : "/sbin/nologin" }
顯示name欄位以a開頭的第一行
- rs1:PRIMARY> db.user.findOne({name:/^a/},{_id:0,name:1,shell:1,uid:1})
- { "name" : "adm", "uid" : 3, "shell" : "/sbin/nologin" }
跳過幾行顯示 (2行)
skip 數字
- rs1:PRIMARY> db.user.find({name:/^a/},{_id:0,name:1,shell:1}).skip (2)
- { "name" : "avahi", "shell" : "/sbin/nologin" }
預設升序排序
sort 欄位名
- rs1:PRIMARY> db.user.find({name:/^a/},{_id:0,name:1,shell:1,uid:1}).sort({uid:1})
- { "name" : "adm", "uid" : 3, "shell" : "/sbin/nologin" }
- { "name" : "avahi", "uid" : 70, "shell" : "/sbin/nologin" }
- { "name" : "abrt", "uid" : 173, "shell" : "/sbin/nologin" }
降序排序
- rs1:PRIMARY> db.user.find({name:/^a/},{_id:0,name:1,shell:1,uid:1}).sort({uid:-1})
- { "name" : "abrt", "uid" : 173, "shell" : "/sbin/nologin" }
- { "name" : "avahi", "uid" : 70, "shell" : "/sbin/nologin" }
- { "name" : "adm", "uid" : 3, "shell" : "/sbin/nologin" }
顯示name欄位以a開頭和uid為3的所有行
- rs1:PRIMARY> db.user.find({name:/^a/,uid:3},{_id:0,name:1,shell:1,uid:1})
- { "name" : "adm", "uid" : 3, "shell" : "/sbin/nologin" }
3)條件判斷的表示方式
$in 在...裡
- rs1:PRIMARY> db.user.find({uid:{$in:[1,6,9]}}) //uid的為1或者6或者9的匹配
- { "_id" : ObjectId("5baeec2001805180a1011833"), "name" : "bin", "password" : "x", "uid" : 1, "gid" : 1, "comment" : "bin", "homdir" : "/bin", "shell" : "/sbin/nologin" }
- { "_id" : ObjectId("5baeec2001805180a1011838"), "name" : "shutdown", "password" : "x", "uid" : 6, "gid" : 0, "comment" : "shutdown", "homdir" : "/sbin", "shell" : "/sbin/shutdown" }
$nin 不在...裡
- rs1:PRIMARY> db.user.find({uid:{$nin:[1,6,9]}},{_id:0,name:1,uid:1})
- { "name" : "yaya", "uid" : 9999 }
- ...
- ...
- { "name" : "saslauth", "uid" : 996 }
- Type "it" for more
$or 條件滿足任意其中一個即可
- rs1:PRIMARY> db.user.find({$or:[{name:"root"},{uid:1}]},{_id:0,name:1,uid:1})
- { "name" : "root", "uid" : 0 }
- { "name" : "bin", "uid" : 1 }
4)正則匹配,以a開頭的name欄位
- rs1:PRIMARY> db.user.find({name:/^a/},{_id:0,name:1,uid:1})
- { "name" : "adm", "uid" : 3 }
- { "name" : "abrt", "uid" : 173 }
- { "name" : "avahi", "uid" : 70 }
5)數值比較
$lt(小於) $lte(小於等於) $gt(大於) $gte(大於等於) $ne(不等於)
- rs1:PRIMARY> db.user.find({uid:{$gte:10,$lte:40}},{_id:0,name:1,uid:1})
- { "name" : "operator", "uid" : 11 }
- { "name" : "games", "uid" : 12 }
- { "name" : "ftp", "uid" : 14 }
- { "name" : "rpc", "uid" : 32 }
- { "name" : "rpcuser", "uid" : 29 }
- { "name" : "ntp", "uid" : 38 }
匹配null:可以匹配沒有的欄位,也可以檢查這個欄位有沒有
- rs1:PRIMARY> db.user.save({name:null,uid:null})
- WriteResult({ "nInserted" : 1 })
- rs1:PRIMARY> db.user.find({name:null})
- { "_id" : ObjectId("5baef385f9f3bf625ea1dbd6"), "name" : null, "uid" : null }
- rs1:PRIMARY> db.user.find({shell:null}) //表示此條文件沒有shell欄位
- { "_id" : ObjectId("5baef385f9f3bf625ea1dbd6"), "name" : null, "uid" : null }
- rs1:PRIMARY>
6)save和insert的區別
相同點:當集合不存在時建立集合,並插入記錄
不同點:save() _id欄位值已經存在時,修改文件欄位值
insert() _id欄位值已經存在時,放棄修改文件欄位值
- rs1:PRIMARY> db.t1.save({name:"bob",age:19})
- WriteResult({ "nInserted" : 1 })
- rs1:PRIMARY> db.t1.insert({name:"bob",age:19})
- WriteResult({ "nInserted" : 1 })
- rs1:PRIMARY> db.t1.save({_id:7,name:"bob",age:19})
- WriteResult({ "nMatched" : 0, "nUpserted" : 1, "nModified" : 0, "_id" : 7 })
- rs1:PRIMARY> db.t1.find()
- ...
- ...
- { "_id" : 7, "name" : "bob", "age" : 19 }
- rs1:PRIMARY> db.t1.save({_id:7,name:"tom",age:19}) //把上一條的記錄直接修改
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.t1.find()
- ...
- ...
- { "_id" : 7, "name" : "tom", "age" : 19 }
- rs1:PRIMARY>
- rs1:PRIMARY>
- rs1:PRIMARY> db.t1.insert({_id:8,name:"tom",age:19}) //可以存上
- WriteResult({ "nInserted" : 1 })
- rs1:PRIMARY> db.t1.insert({_id:8,name:"tom",age:19}) //存不上
- WriteResult({
- "nInserted" : 0,
- "writeError" : {
- "code" : 11000,
- "errmsg" : "E11000 duplicate key error collection: mdb.t1 index: _id_ dup key: { : 8.0 }"
- }
- })
7)插入多行文件
- rs1:PRIMARY> db.t1.insertMany([{name:"xiaojiu"},{name:"laoshi"}])
- {
- "acknowledged" : true,
- "insertedIds" : [
- ObjectId("5baef526f9f3bf625ea1dbd9"),
- ObjectId("5baef526f9f3bf625ea1dbda")
- ]
- }
- rs1:PRIMARY> db.t1.find()
- ...
- ...
- { "_id" : ObjectId("5baef526f9f3bf625ea1dbd9"), "name" : "xiaojiu" }
- { "_id" : ObjectId("5baef526f9f3bf625ea1dbda"), "name" : "laoshi" }
8)update修改
- rs1:PRIMARY> db.user.update({name:"root"},{password:"XXX"})
- //如果這一列不寫完整,這一行除了password這一行,這一列的其他值都沒有了相當於刪除(要寫完整)
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.t1.find({name:"root"})
- rs1:PRIMARY> db.user.find({name:"root"}) //沒有東西,除了password:"XXX"
9)$set 條件匹配時,修改指定欄位的值(區域性修改)
- rs1:PRIMARY> db.user.update({name:"adm"},{$set:{password:"AAA"}})
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.user.find({name:"adm"}) //還存在
- { "_id" : ObjectId("5baeec2001805180a1011835"), "name" : "adm", "password" : "AAA", "uid" : 3, "gid" : 4, "comment" : "adm", "homdir" : "/var/adm", "shell" : "/sbin/nologin" }
- rs1:PRIMARY> db.user.update({name:/^r/},{$set:{password:"FFF"}})
- //預設修改匹配條件的第一行
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.user.update({name:/^a/},{$set:{password:"FFF"}},false,true)
- //改匹配到的所有
- WriteResult({ "nMatched" : 3, "nUpserted" : 0, "nModified" : 3 })
10)$unset 刪除與條件匹配文件的欄位
- rs1:PRIMARY> db.user.update({name:"sync"},{$unset:{password:1}})
- //刪除password欄位
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
11)陣列
- rs1:PRIMARY> db.user.insert({name:"bob",like:["a","b","c","d","e","f",]})
- WriteResult({ "nInserted" : 1 })
$pop 刪除陣列末尾一個元素,1刪除最後一個,-1刪除第一個
- rs1:PRIMARY> db.user.update({name:"bob"},{$pop:{like:1}})
- //刪除匹配的第一條的最後一個
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.user.update({name:"bob"},{$pop:{like:-1}})
- //刪除匹配的第一條的第一個
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
$push 向陣列中新增新元素
- rs1:PRIMARY> db.user.update({name:"bob"},{$push:{like:"Z"}}) //預設新增到最後
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.user.update({name:"bob"},{$push:{like:"W"}})
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.user.find({name:"bob"})
- { "_id" : ObjectId("5baef7b2034891a205de2959"), "name" : "bob", "like" : [ "b", "c", "d", "e", "Z", "W" ] }
$addToSet 避免重複新增
- rs1:PRIMARY> db.user.update({name:"bob"},{$addToSet:{like:"W"}})
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 0 })
- rs1:PRIMARY> db.user.find({name:"bob"})
- { "_id" : ObjectId("5baef7b2034891a205de2959"), "name" : "bob", "like" : [ "b", "c", "d", "e", "Z", "W" ] }
$pull 刪除數組裡的指定元素,若有兩個bob可以用_id值定義把name:"bob"換成id值
- rs1:PRIMARY> db.user.update({name:"bob"},{$pull:{like:"c"}})
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.user.find({name:"bob"})
- { "_id" : ObjectId("5baef7b2034891a205de2959"), "name" : "bob", "like" : [ "b", "d", "e", "Z", "W" ] }
- rs1:PRIMARY> db.user.update({"_id":ObjectId("5afc1a717eff45e9cfc57ed3")},{$push:{like:"S"}})
- WriteResult({ "nMatched" : 0, "nUpserted" : 0, "nModified" : 0 })
- rs1:PRIMARY>
$inc 條件匹配時,欄位值自加或自減
- rs1:PRIMARY> db.user.update({uid:{$lte:10}},{$inc:{uid:2}})
- //設定欄位值自加2,預設改第一行
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
- rs1:PRIMARY> db.user.update({uid:{$lte:10}},{$inc:{uid:2}},false,true)
- //設定欄位值自加2,false,true改全部
- WriteResult({ "nMatched" : 8, "nUpserted" : 0, "nModified" : 8 })
- rs1:PRIMARY>
- rs1:PRIMARY> db.user.update({uid:{$lte:10}},{$inc:{uid:-1}})
- //負數時是自減1,預設改第一行
- WriteResult({ "nMatched" : 1, "nUpserted" : 0, "nModified" : 1 })
12)刪除文件
remove()與drop()的區別
remove()刪除文件時不刪除索引
drop()刪除集合的時候同時刪除索引
- rs1:PRIMARY> db.t1.remove({})
- WriteResult({ "nRemoved" : 6 })
- rs1:PRIMARY> db.user.remove({name:"/^a/"}) //刪除以a開頭的記錄
- WriteResult({ "nRemoved" : 0 })
- rs1:PRIMARY> db.t1.drop() //刪除集合t1
- true
- rs1:PRIMARY>