mybatis 使用經驗小結，batch批量提交大量資料

阿新 • • 發佈：2019-02-05

<div id="article_content" class="article_content csdn-tracking-statistics tracking-click" data-mod="popu_519" data-dsm="post" style="overflow: hidden;">
<div class="htmledit_views">

<div id="cnblogs_post_body" style="margin:0px 0px 20px;padding:0px;color:rgb(69,69,69);font-family:verdana, Arial, Helvetica, sans-serif;font-size:14px;line-height:25.200000762939453px;">
一、多資料來源問題
主要思路是把dataSource、sqlSesstionFactory、MapperScannerConfigurer在配置中區分開，各Mapper對應的包名、類名區分開
<div class="cnblogs_code" style="margin:5px 0px;padding:5px;border:1px solid rgb(204,204,204);overflow:auto;color:rgb(0,0,0);font-family:'Courier New' !important;font-size:12px !important;background-color:rgb(245,245,245);">
<div class="cnblogs_code_toolbar" style="margin:5px 0px 0px;padding:0px;"><a title="複製程式碼" style="margin:0px;padding:0px;color:rgb(57,154,178) !important;border:none !important;" target="_blank"><img src="http://common.cnblogs.com/images/copycode.gif" alt="複製程式碼" style="margin:0px;padding:0px;border:none !important;"></a></div>
<pre style="margin-top:0px;margin-bottom:0px;padding:0px;white-space:pre-wrap;font-family:'Courier New' !important;"> 1 <?xml version="1.0" encoding="UTF-8"?>
 2 <beans xmlns="http://www.springframework.org/schema/beans"
 3 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:aop="http://www.springframework.org/schema/aop"
 4 xmlns:tx="http://www.springframework.org/schema/tx" xmlns:jdbc="http://www.springframework.org/schema/jdbc"
 5 xmlns:context="http://www.springframework.org/schema/context"
 6 xsi:schemaLocation="
 7 http://www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context-3.0.xsd
 8 http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-3.0.xsd
 9 http://www.springframework.org/schema/jdbc http://www.springframework.org/schema/jdbc/spring-jdbc-3.0.xsd
10 http://www.springframework.org/schema/tx http://www.springframework.org/schema/tx/spring-tx-3.0.xsd
11 http://www.springframework.org/schema/aop http://www.springframework.org/schema/aop/spring-aop-3.0.xsd"
12 default-autowire="byName">
13
14 <bean id="dataSource1" class="org.h2.jdbcx.JdbcConnectionPool"
15 destroy-method="dispose">
16 <constructor-arg>
17 <bean class="org.h2.jdbcx.JdbcDataSource">
18 <property name="URL" value="jdbc:h2:r:/h2db/awbprint/a"/>
19 <property name="user" value="sa"/>
20 <property name="password" value="sa"/>
21 </bean>
22 </constructor-arg>
23 </bean>
24
25
26 <bean id="dataSource2" class="org.h2.jdbcx.JdbcConnectionPool"
27 destroy-method="dispose">
28 <constructor-arg>
29 <bean class="org.h2.jdbcx.JdbcDataSource">
30 <property name="URL" value="jdbc:h2:r:/h2db/awbprint/b"/>
31 <property name="user" value="sa"/>
32 <property name="password" value="sa"/>
33 </bean>
34 </constructor-arg>
35 </bean>
36
37 <bean id="sqlSessionFactory1" class="org.mybatis.spring.SqlSessionFactoryBean">
38 <property name="dataSource" ref="dataSource1"/>
39 <property name="configLocation" value="classpath:mybatis-config.xml"></property>
40 <property name="typeAliasesPackage" value="awbprint.mybatis.entity"></property>
41 <property name="mapperLocations" value="classpath:mybatis/a/**/*.xml"></property>
42 </bean>
43
44 <bean id="sqlSessionFactory2" class="org.mybatis.spring.SqlSessionFactoryBean">
45 <property name="dataSource" ref="dataSource2"/>
46 <property name="configLocation" value="classpath:mybatis-config.xml"></property>
47 <property name="typeAliasesPackage" value="awbprint.mybatis.entity"></property>
48 <property name="mapperLocations" value="classpath:mybatis/b/**/*.xml"></property>
49 </bean>
50
51 <bean class="org.mybatis.spring.mapper.MapperScannerConfigurer">
52 <property name="sqlSessionFactoryBeanName" value="sqlSessionFactory1"></property>
53 <property name="basePackage" value="awbprint.mybatis.mapper.a"/>
54 </bean>
55
56 <bean class="org.mybatis.spring.mapper.MapperScannerConfigurer">
57 <property name="sqlSessionFactoryBeanName" value="sqlSessionFactory2"></property>
58 <property name="basePackage" value="awbprint.mybatis.mapper.b"/>
59 </bean>
60
61
62 </beans></pre>
<div class="cnblogs_code_toolbar" style="margin:5px 0px 0px;padding:0px;"><a title="複製程式碼" style="margin:0px;padding:0px;color:rgb(57,154,178) !important;border:none !important;" target="_blank"><img src="http://common.cnblogs.com/images/copycode.gif" alt="複製程式碼" style="margin:0px;padding:0px;border:none !important;"></a></div>
</div>
上面的配置，一個連h2的a資料庫，一個連h2的b資料庫，至於事務管理器，大家可參考這個思路，建二個，各管各的。
專案中mapper介面及對映檔案均用包名區分開，如下圖：
<img src="http://images.cnitblog.com/blog/27612/201501/292250045345255.jpg" alt="" style="margin:0px;padding:0px;border:0px;">
 
二、如何使用Map做為引數及動態條件生成
<div class="cnblogs_code" style="margin:5px 0px;padding:5px;border:1px solid rgb(204,204,204);overflow:auto;color:rgb(0,0,0);font-family:'Courier New' !important;font-size:12px !important;background-color:rgb(245,245,245);">
<div class="cnblogs_code_toolbar" style="margin:5px 0px 0px;padding:0px;"><a title="複製程式碼" style="margin:0px;padding:0px;color:rgb(57,154,178) !important;border:none !important;" target="_blank"><img src="http://common.cnblogs.com/images/copycode.gif" alt="複製程式碼" style="margin:0px;padding:0px;border:none !important;"></a></div>
<pre style="margin-top:0px;margin-bottom:0px;padding:0px;white-space:pre-wrap;font-family:'Courier New' !important;"> 1 <resultMap id="BaseResultMap" type="awbprint.mybatis.entity.PrintLayout">
 2 <id column="D_RECID" property="recid" jdbcType="DECIMAL"/>
 3 <result column="D_USER_NAME" property="userName" jdbcType="VARCHAR"/>
 4 <result column="D_NAME" property="name" jdbcType="VARCHAR"/>
 5 <result column="D_TYPE" property="type" jdbcType="VARCHAR"/>
 6 ...
 7
 8 </resultMap>
 9
10 <sql id="Base_Column_List">
11 D_RECID, D_USER_NAME, D_NAME, D_TYPE, ...
12 </sql>
13
14 <select id="select" resultMap="BaseResultMap"
15 parameterType="java.util.Map">
16 select
17 <include refid="Base_Column_List"/>
18 from T_PRINT_LAYOUT
19 where D_USER_NAME = #{userName,jdbcType=VARCHAR} and D_TYPE = #{awbType,jdbcType=VARCHAR}
20 <if test="recId != null">
21 and D_RECID = #{recId,jdbcType=DECIMAL}
22 </if>
23 <if test="ids != null">
24 or D_RECID in
25 <foreach item="item" index="index" collection="ids"
26 open="(" separator="," close=")">
27 #{item}
28 </foreach>
29 </if>
30
31 </select></pre>
<div class="cnblogs_code_toolbar" style="margin:5px 0px 0px;padding:0px;"><a title="複製程式碼" style="margin:0px;padding:0px;color:rgb(57,154,178) !important;border:none !important;" target="_blank"><img src="http://common.cnblogs.com/images/copycode.gif" alt="複製程式碼" style="margin:0px;padding:0px;border:none !important;"></a></div>
</div>
14-31演示瞭如何使用Map做為引數，動態傳入查詢條件，及List引數生成in(...)條件
java端程式碼示例：
<div class="cnblogs_code" style="margin:5px 0px;padding:5px;border:1px solid rgb(204,204,204);overflow:auto;color:rgb(0,0,0);font-family:'Courier New' !important;font-size:12px !important;background-color:rgb(245,245,245);">
<div class="cnblogs_code_toolbar" style="margin:5px 0px 0px;padding:0px;"><a title="複製程式碼" style="margin:0px;padding:0px;color:rgb(57,154,178) !important;border:none !important;" target="_blank"><img src="http://common.cnblogs.com/images/copycode.gif" alt="複製程式碼" style="margin:0px;padding:0px;border:none !important;"></a></div>
<pre style="margin-top:0px;margin-bottom:0px;padding:0px;white-space:pre-wrap;font-family:'Courier New' !important;"> 1 PrintLayoutMapper mapper = context.getBean(PrintLayoutMapper.class);
 2
 3 Map<String, Object> map = new HashMap<String, Object>();
 4 map.put("userName", "ADMIN");
 5 map.put("awbType", "CARGOLABEL_MU");
 6 map.put("recId", 1);
 7
 8 List<Integer> ids = new ArrayList<Integer>();
 9 ids.add(0, 1);
10 ids.add(0, 2);
11 ids.add(0, 3);
12
13 map.put("ids", ids);
14
15 List<?> list = mapper.select(map);</pre>
<div class="cnblogs_code_toolbar" style="margin:5px 0px 0px;padding:0px;"><a title="複製程式碼" style="margin:0px;padding:0px;color:rgb(57,154,178) !important;border:none !important;" target="_blank"><img src="http://common.cnblogs.com/images/copycode.gif" alt="複製程式碼" style="margin:0px;padding:0px;border:none !important;"></a></div>
</div>
其實PrintLayoutMapper介面的定義為：
<div class="cnblogs_code" style="margin:5px 0px;padding:5px;border:1px solid rgb(204,204,204);overflow:auto;color:rgb(0,0,0);font-family:'Courier New' !important;font-size:12px !important;background-color:rgb(245,245,245);">
<pre style="margin-top:0px;margin-bottom:0px;padding:0px;white-space:pre-wrap;font-family:'Courier New' !important;">1 public interface PrintLayoutMapper {
2 ...
3
4 List<PrintLayout> select(Map<String, Object> map);
5 }</pre>
</div>
最終生成的SQL語句為：
<div class="cnblogs_code" style="margin:5px 0px;padding:5px;border:1px solid rgb(204,204,204);overflow:auto;color:rgb(0,0,0);font-family:'Courier New' !important;font-size:12px !important;background-color:rgb(245,245,245);">
<pre style="margin-top:0px;margin-bottom:0px;padding:0px;white-space:pre-wrap;font-family:'Courier New' !important;">1 select D_RECID, D_USER_NAME, D_NAME, D_TYPE, ... from T_PRINT_LAYOUT where D_USER_NAME = ? and D_TYPE = ? and D_RECID = ? or D_RECID in ( ? , ? , ? )</pre>
</div>
 
三、相容不同的資料庫
<div class="cnblogs_code" style="margin:5px 0px;padding:5px;border:1px solid rgb(204,204,204);overflow:auto;color:rgb(0,0,0);font-family:'Courier New' !important;font-size:12px !important;background-color:rgb(245,245,245);">
<div class="cnblogs_code_toolbar" style="margin:5px 0px 0px;padding:0px;"><a title="複製程式碼" style="margin:0px;padding:0px;color:rgb(57,154,178) !important;border:none !important;" target="_blank"><img src="http://common.cnblogs.com/images/copycode.gif" alt="複製程式碼" style="margin:0px;padding:0px;border:none !important;"></a></div>
<pre style="margin-top:0px;margin-bottom:0px;padding:0px;white-space:pre-wrap;font-family:'Courier New' !important;"> 1 <insert id="insert">
 2 <selectKey keyProperty="id" resultType="int" order="BEFORE">
 3 <if test="_databaseId == 'oracle'">
 4 select seq_users.nextval from<span s

mybatis 使用經驗小結，batch批量提交大量資料

mybatis 使用經驗小結，batch批量提交大量資料

mybatis batch批量提交大量資料

Spring Spring mvc mybatis 經驗小結(2)

mysql進階(十五) mysql批量刪除大量資料

asp.net access 批量插入大量資料提高速度的方法

mysql進階十五 mysql批量刪除大量資料

利用多執行緒（用到原子類AtomicInteger）往資料庫批量插入大量資料

ajax 提交表單，PHP處理提交的資料

MySQL批量插入大量資料方法

JAVA開發中，頁面post提交的資料後臺通過request取出時是空的，所有引數都消失了

mybatis insert update delete返回都是整型 0，1，增，刪，改要提交事物

Excel生成批量SQL語句，處理大量資料的好辦法

EMQ X 3.0-rc.5 釋出，支援 `metrics` 的批量提交

Mybatis 進行批量插入資料時，處理已經存在的資料

mybatis 批量插入oracle 如果表裡存在就更新，不存在就插入資料

jdbc存在的問題，mybatis架構小結

【心得】Lattice後端使用經驗小結（ECP5UM，DDR3，Diamond3.10，Reveal邏輯分析）

深度學習中的三種梯度下降方式：批量（batch），隨機（stochastic），小批量（mini-batch）

navicat 匯出嚮導，通過Excel生成批量SQL語句，處理大量資料

mybatis 使用經驗小結

mybatis 使用經驗小結，batch批量提交大量資料

相關推薦