1. 程式人生 > 其它 >阿里DataX支援mysql8.X 改造記錄

阿里DataX支援mysql8.X 改造記錄

1、從mysql8 往elasticsearch 7匯入資料時,報錯。

2、經查詢,官方datax僅支援my5.x,以下為改造適配mysql 8.x 資料記錄。

DataX支援mysql8.X
https://blog.csdn.net/qq_41852045/article/details/108485749
https://blog.csdn.net/qq_42502354/article/details/108824761
https://blog.csdn.net/qq_38115310/article/details/108662659      Datax mysql8外掛開發
https://blog.csdn.net/Loiterer_Y/article/details/115692010
https://blog.csdn.net/jason_9527/article/details/100995505 https://www.cnblogs.com/shuyao268/p/14879486.html https://www.cnblogs.com/harvey2017/p/12148090.html https://www.cnblogs.com/zifan/p/12550747.html https://rxf113.xyz/DataX%E5%AE%9E%E8%B7%B5/ https://www.jianshu.com/p/997727d488e6 http://www.manongjc.com/detail/14-iexdburliccybhe.html
https://www.gitmemory.com/issue/alibaba/DataX/146/826093789 https://www.zybuluo.com/Catyee/note/1790630 https://github.com/alibaba/DataX/issues/677 https://github.com/alibaba/DataX/issues/1062 https://github.com/alibaba/DataX/issues/172 https://github.com/alibaba/DataX/issues/146 全文替換 convertToNull 為 CONVERT_TO_NULL; zeroDateTimeBehavior的值convertToNull 為 CONVERT_TO_NULL: ​ 全文替換
"com.mysql.jdbc.Driver""com.mysql.cj.jdbc.Driver", 用maven重新編輯構建釋出 mvn -U clean package assembly:assembly -Dmaven.test.skip=true 其中mysqlwriter 中: "jdbcUrl": "jdbc:mysql://192.125.30.169:3306/wjybjy?useUnicode=true&characterEncoding=gbk&useSSL=false&serverTimezone=UTC", 比如:python datax.py file.json , 則file.json的配置項: "jdbcUrl":"jdbc:mysql://${writer_gateway}/oms?useUnicode=true&characterEncoding=UTF-8&useSSL=false", 第五步jdbc連結追加useSSL=false設定: 比如:python datax.py file.json , 則file.json的配置項: "jdbcUrl":"jdbc:mysql://${writer_gateway}/oms?useUnicode=true&characterEncoding=UTF-8&useSSL=false", "jdbcUrl": "jdbc:mysql://192.125.30.169:3306/wjybjy?useUnicode=true&characterEncoding=gbk&useSSL=false&serverTimezone=UTC", 需要注意的幾點:1.writer中不能帶[]; reader中必須帶[]。 2.需要加&useSSL=false&serverTimezone=UTC" 3."setting": { "speed": { "channel": 1 } },