1. 程式人生 > >字段更改造成ogg進程停止解決辦法

字段更改造成ogg進程停止解決辦法

kafka ogg

收到開發人員的變更郵件申請,需要在某個表增加字段,由於我們的環境DDL是沒有開啟的。用的消息中間件Kafka做傳輸消費,應用到目標庫。由於緊急變更,先做字段變更吧。
技術分享圖片

變更完成後,查看ogg狀態;
[oracle@bapdb1 ggs12]$ ./ggsci

Oracle GoldenGate Command Interpreter for Oracle
Version 12.1.2.1.0 OGGCORE_12.1.2.1.0_PLATFORMS_140727.2135.1_FBO
Linux, x64, 64bit (optimized), Oracle 11g on Aug 7 2014 09:14:25

Operating system character set identified as UTF-8.

Copyright (C) 1995, 2014, Oracle and/or its affiliates. All rights reserved.

GGSCI (bapdb1) 2> info all

Program Status Group Lag at Chkpt Time Since Chkpt

MANAGER RUNNING
JAGENT RUNNING

EXTRACT RUNNING EXTDMQ 00:00:03 00:00:07
EXTRACT RUNNING EXTNEWP 00:00:04 00:00:09
EXTRACT RUNNING EXT_KAF 00:00:03 00:00:00
EXTRACT RUNNING EXT_KAF2 00:00:03 00:00:03
EXTRACT RUNNING EXT_KAF4 00:00:03 00:00:03
EXTRACT RUNNING EXT_KAF5 00:00:01 00:00:04
EXTRACT RUNNING EXT_KAF6 00:00:02 00:00:01
EXTRACT RUNNING EXT_KAF7 00:00:03 00:00:08
EXTRACT RUNNING EXT_KAF8 00:00:03 00:00:06
EXTRACT RUNNING PMP_KAF 00:00:00 00:00:04
EXTRACT RUNNING PMP_KAF2 00:00:00 00:00:08
EXTRACT RUNNING PMP_KAF4 00:00:00 00:00:10
EXTRACT RUNNING PMP_KAF5 00:00:03 00:00:06
EXTRACT RUNNING PMP_KAF6 00:00:04 00:00:02
EXTRACT RUNNING PMP_KAF7 00:00:03 00:00:03
EXTRACT RUNNING PMP_KAF8 00:00:04 00:00:05
EXTRACT RUNNING PUDMQ 00:00:00 00:00:04
EXTRACT RUNNING PUMPNEWP 00:00:00 00:00:01
REPLICAT RUNNING REPZW1 00:00:00 00:00:01

手工停止該表用到的進程,抽取和投遞均停止後,等待郵件報錯,找到對應的目標端機器;

技術分享圖片

找到kafka地址為10.1.x.9的地址,登陸機器

[systemusers@PBSDATASKAFKAGROUP2-1 ~]$ sudo su - app
[app@PBSDATASKAFKAGROUP2-1 ~]$ ls
data datalogs glt jdk1.8.0_101 jdk1.8.0_25 kafka_2.12-1.0.0 logs nohup.out ogg scripts shell tools zookeeper-3.4.11
[app@PBSDATASKAFKAGROUP2-1 ~]$ ps -ef |grep mgr
root 22 2 0 Mar19 ? 00:00:00 [async/mgr]
app 11451 1 0 Mar22 ? 00:43:43 ./mgr PARAMFILE /home/app/ogg/ggs12/dirprm/mgr.prm REPORTFILE /home/app/ogg/ggs12/dirrpt/MGR.rpt PROCESSID MGR
app 71909 71834 0 17:36 pts/0 00:00:00 grep mgr
[app@PBSDATASKAFKAGROUP2-1 ~]$ pwd
/home/app
[app@PBSDATASKAFKAGROUP2-1 ~]$ cd ogg/ggs12/
[app@PBSDATASKAFKAGROUP2-1 ggs12]$ ./ggsci
Oracle GoldenGate for Big Data
Version 12.3.1.1.1

Oracle GoldenGate Command Interpreter
Version 12.3.0.1.0 OGGCORE_OGGADP.12.3.0.1.0GA_PLATFORMS_170828.1608
Linux, x64, 64bit (optimized), Generic on Aug 28 2017 17:13:45
Operating system character set identified as UTF-8.

Copyright (C) 1995, 2017, Oracle and/or its affiliates. All rights reserved.

GGSCI (PBSDATASKAFKAGROUP2-1) 1> info all

Program Status Group Lag at Chkpt Time Since Chkpt

MANAGER RUNNING
REPLICAT RUNNING REP_75 00:00:00 00:00:06
REPLICAT RUNNING REP_75_2 00:00:03 00:00:04
REPLICAT ABENDING REP_75_3 00:00:03 00:00:02
REPLICAT RUNNING REP_90 00:00:00 00:00:00
REPLICAT RUNNING REP_90_1 00:00:05 00:00:08
REPLICAT RUNNING REP_90_2 00:00:00 00:00:00
REPLICAT RUNNING REP_90_3 00:00:00 00:00:01

2018-05-31 17:04:28 ERROR OGG-01161 Bad column index (31) specified for table CFS.T_CFS_ACCT_ITEM, max columns = 31.

2018-05-31 17:04:28 ERROR OGG-01668 PROCESS ABENDING.

源端進行操作,先將原來的defgen文件轉存一份加時間日期。
[oracle@bapdb1 ggs12]$cd dirdef/
[oracle@bapdb1 ggs12]$mv defgen75_3.def defgen75_3.def_0531
[oracle@bapdb1 ggs12]$ pwd
/ggs/ggs12
[oracle@bapdb1 ggs12]$defgen paramfile ./dirprm/defgen75_3.prm
生成新的defgen75_3.def文件,傳送到目標kafka服務器中,

目標端操作:
[app@PBSDATASKAFKAGROUP2-1 ggs12]$cd dirdef/
[app@PBSDATASKAFKAGROUP2-1 dirdef]$ mv defgen75_3.def defgen75_3.def_0531

然後kafka目標機中ogg進程啟動即可,
GGSCI (PBSDATASKAFKAGROUP2-1) 1> info all

Program Status Group Lag at Chkpt Time Since Chkpt

MANAGER RUNNING
REPLICAT RUNNING REP_75 00:00:05 00:00:01
REPLICAT RUNNING REP_75_2 00:00:03 00:00:02
REPLICAT RUNNING REP_75_3 00:00:04 00:00:05
REPLICAT RUNNING REP_90 00:00:00 00:00:00
REPLICAT RUNNING REP_90_1 00:00:05 00:00:05
REPLICAT RUNNING REP_90_2 00:00:00 00:00:05
REPLICAT RUNNING REP_90_3 00:00:00 00:00:07

字段更改造成ogg進程停止解決辦法