mysql 全備+binlog自動恢復shell指令碼

注意：

1、資料庫全備的命名規則 bak_dbname_xxx_sql

2、BAKUPDIR存放所有的資料全備的檔案的目錄

3、BINLOGBAKDIR用與存放所有用到的binlog的目錄

該指令碼主要用於資料庫故障時，進行及時的整庫加日誌的增量恢復，以求資料損失降低的最小值。

 該指令碼的主要思想：

1. 首先進行全庫匯入；

2. 通過查詢二進位制日誌的pos來進行日誌的恢復；

1. #!/bin/bash

2. BASEDIR=/data1/xxx/xxx/backuptest

3. BAKUPDIR=$BASEDIR/tmpbak

4. #BAKUPDIR=$

5. BINLOGBAKDIR=$BASEDIR/binlog

6. LOGDIR=$BASEDIR/log

7. RECOVERY_LOG=$LOGDIR/recovery.log

8. MYSQL=/usr/local/mysql/bin/mysql

9. MYSQLBINLOG=/usr/local/mysql/bin/mysqlbinlog

10.USER=root

11.PASS=123

12.MYSQLIP=localhost

13. 

14.mkdir -p $LOGDIR

15.BAKUPSQL=`find$BAKUPDIR -type f -name"*sql"|xargs-

16. 

17.for i in $BAKUPSQL

18.do

19.cd $BAKUPDIR

20. 

21.#########CHECK BINLOG POSITION############

22.BINLOG=`head -n 50 $i |grep "CHANGE MASTER TO MASTER_LOG_FILE"|awk -F "'" '{print$2}'`

23.BINLOGPOS=`head -n 50 $i |grep "CHANGE MASTER TO MASTER_LOG_FILE"|awk -F "=" '{print$3}'|

24.DATABASE=`echo $i|awk-F"_"'{print$2}'`

25.# echo $i $DATABASE $BINLOG $BINLOGPOS

26. 

27.####BEGINE FULLBAKUP RECOVERY#############

28.echo "#`date +'%Y-%m-%d%H:%M:%S'`: start recover $DATABASE ">>${RECOVERY_LOG}

29.if $MYSQL -h$MYSQLIP -u$USER-p$PASS< $i>>${RECOVERY_LOG}2>&1;then

30.echo "recovery $DATABASEsucessfully">> ${RECOVERY_LOG}

31.else

32.echo "recovery $DATABASEfail">> ${RECOVERY_LOG}

33.exit;

34.fi

35.echo "#`date +'%Y-%m-%d%H:%M:%S'`: end recover $DATABASE">>${RECOVERY_LOG}

36. 

37. 

38.#####BEGINE BINLOGBAKUP RECOVERY##########

39. 

40.cd $BINLOGBAKDIR

41.find . -type f -name "*bin*" |xargs-i basename{}>/tmp/binlog.tmp

42.sort -n /tmp/binlog.tmp>$LOGDIR/binlog.tmp2

43.sed '/md5/d' $LOGDIR/binlog.tmp2> $LOGDIR/binlog.tmp3

44.sed -n "/$BINLOG/,\$p" $LOGDIR/binlog.tmp3> $LOGDIR/binlog${DATABASE}.log

45.RECBINLOGS=`awk '{printf "%s"," "$1}' $LOGDIR/binlog${DATABASE}.log `

46.#echo $DATABASE $BINLOGPOS $RECBINLOGS

47. 

48.echo "#`date +'%Y-%m-%d%H:%M:%S'`: start recover $DATABASE binlog ">> ${RECOVERY_LOG}

49.echo " $MYSQLBINLOG--no-defaults --disable-log-bin --start-position=$BINLOGPOS $RECBINLOGS -d$DATABASE |$MYSQL -h$MYSQLIP -u$USER -p$PASS -f ">> ${RECOVERY_LOG}

50.if$MYSQLBINLOG --no-defaults--disable-log-bin--start-position=$BINLOGPOS$RECBINLOGS-d $DATABASE |$MYSQL-h$MYSQLIP-u$USER-p$PASS-f >> ${RECOVERY_LOG} 2>&1;then

51.echo "recover $DATABASEbinlog sucessfully">> ${RECOVERY_LOG}

52.else

53.echo "recover $DATABASEbinlog fail">> ${RECOVERY_LOG}

54.exit;

55.fi

56.echo "#`date +'%Y-%m-%d%H:%M:%S'`:end recover $DATABASE binlog">>${RECOVERY_LOG}

57. 

58. 

59.done

附指令碼原始碼：

full_db_log_imp.sh

#   !/bin/bash

BASEDIR=/data/bak/test

BAKUPDIR=$BASEDIR/20121024

BINLOGBAKDIR=$BASEDIR/bin-log-bk

LOGDIR=$BASEDIR/log

RECOVERY_LOG=$LOGDIR/recovery.log

MYSQL=/usr/local/mysql/bin/mysql

MYSQLBINLOG=/usr/local/mysql/bin/mysqlbinlog

USER=root

[email protected]

MYSQLIP=localhost

cd $BAKUPDIR

find $BAKUPDIR -name '*.gz'

gunzip $BAKUPDIR *.gz

BAKUPSQL=`find $BAKUPDIR -type f -name"*.sql" |xargs -i basename {}`

for i in $BAKUPSQL

do

cd $BAKUPDIR

#########CHECK BINLOG POSITION############

BINLOG=`head -n 50 $i |grep "CHANGEMASTER TO MASTER_LOG_FILE"|awk -F "'" '{print $2}'`

BINLOGPOS=`head -n 50 $i |grep "CHANGEMASTER TO MASTER_LOG_FILE"|awk -F "=" '{print $3}'|sed 's/;//'`

DATABASE=`echo $i|awk -F"_"'{print $2}'`

echo $i $DATABASE $BINLOG $BINLOGPOS

####BEGINE FULLBAKUP RECOVERY#############

echo "#`date +'%Y-%m-%d %H:%M:%S'`:start recover $DATABASE " >> ${RECOVERY_LOG}

if $MYSQL -h$MYSQLIP -u$USER -p$PASS <$i >> ${RECOVERY_LOG} 2>&1;then

echo "recovery $DATABASE sucessfully">> ${RECOVERY_LOG}

else

echo "recovery $DATABASE fail">> ${RECOVERY_LOG}

exit;

fi

echo "#`date +'%Y-%m-%d %H:%M:%S'`:end recover $DATABASE" >> ${RECOVERY_LOG}

#####BEGINE BINLOGBAKUP RECOVERY##########

cd $BASEDIR

#find ./ -type f -name "*bin*"|xargs -i basename {} > /tmp/binlog.tmp

find ./ -type f -name"*mysql-bin*"  >/tmp/binlog.tmp

sort -n /tmp/binlog.tmp >$LOGDIR/binlog.tmp2

sed '/md5/d' $LOGDIR/binlog.tmp2 >$LOGDIR/binlog.tmp3

sed -n "/$BINLOG/,\$p"$LOGDIR/binlog.tmp3 > $LOGDIR/binlog${DATABASE}.log

RECBINLOGS=`awk '{printf"%s"," "$1}' $LOGDIR/binlog${DATABASE}.log `

echo $DATABASE $BINLOGPOS $RECBINLOGS

#exit 0

echo "#`date +'%Y-%m-%d %H:%M:%S'`:start recover $DATABASE binlog " >> ${RECOVERY_LOG}

echo " $MYSQLBINLOG --no-defaults --disable-log-bin--start-position=$BINLOGPOS $RECBINLOGS -d $DATABASE |$MYSQL -h$MYSQLIP -u$USER-p$PASS -f " >> ${RECOVERY_LOG}

if $MYSQLBINLOG --no-defaults--disable-log-bin --start-position=$BINLOGPOS $RECBINLOGS  $DATABASE |$MYSQL -h$MYSQLIP -u$USER -p$PASS-f >> ${RECOVERY_LOG} 2>&1;then

echo $BINLOGPOS $RECBINLOGS

echo "recover $DATABASE binlogsucessfully" >> ${RECOVERY_LOG}

else

echo "recover $DATABASE binlogfail" >> ${RECOVERY_LOG}

exit;

fi

echo "#`date +'%Y-%m-%d %H:%M:%S'`:endrecover $DATABASE binlog" >> ${RECOVERY_LOG}

done

指令碼執行後，恢復到的資料為：