工具框架用spring-batch,數據庫是mysql(未做特殊優化)。
比較數據框架mybatis和spring jdbc的插入效率。
Mybatis三種實現:
1、mybatis的官方寫法
- public void batchInsert1(List<Poi> poilist) throws Exception {
- SqlSession sqlSession = sqlSessionFactory.getObject().openSession(ExecutorType.BATCH);
- PoiMapper pmapper = sqlSession.getMapper(PoiMapper.class);
- try {
- for (Poi poi : poilist) {
- pmapper.insertPoi(poi);
- }
- sqlSession.commit();
- } finally {
- sqlSession.close();
- }
- }
其中Poi是一個bean。
PoiMapper定義:
- public interface PoiMapper {
- @Insert("insert into tb_poi (tag, poi, poiid, meshid, owner, featcode, sortcode, namec, namee, namep, names) values (#{tag}, GeomFromText(#{point}), #{poiid}, #{meshid}, #{owner}, #{featcode}, #{sortcode}, #{namec}, #{namee}, #{namep}, #{names}) ")
- public void insertPoi(Poi poi);
- }
2、利用mysql特性,拼寫insert sql。
- public void batchInsert2(List<Poi> poilist) throws Exception {
- SqlSession sqlSession = sqlSessionFactory.getObject().openSession(ExecutorType.BATCH);
- try {
- sqlSession.insert("com.emg.trans.mapper.batchMapper.batchInsert", poilist);
- sqlSession.commit();
- } finally {
- sqlSession.close();
- }
- }
“com.emg.trans.mapper.batchMapper.batchInsert”在mybatis的xml中定義的sql,定義如下:
- <mapper namespace="com.emg.trans.mapper.batchMapper">
- <insert id="batchInsert" parameterType="List">
- insert into tb_poi (tag, poi, poiid, meshid, owner, featcode, sortcode, namec, namee, namep, names) values
- <foreach collection="list" item="poi" index="index" separator="," >
- (#{poi.tag}, GeomFromText(#{poi.point}), #{poi.poiid}, #{poi.meshid}, #{poi.owner}, #{poi.featcode}, #{poi.sortcode}, #{poi.namec}, #{poi.namee}, #{poi.namep}, #{poi.names})
- </foreach>
- </insert>
- </mapper>
3、利用spring的事務,直接執行插入操作。
- @Transactional("dbTransaction")
- public void batchInsert3(List<Poi> poilist) throws Exception {
- for (Poi poi : poilist) {
- apmapper.insertPoi(poi);
- }
- }
apmapper是PoiMapper的實例,用@Autowired配置。
Spring-JDBC的三種實現:
A、用spring事務執行插入操作
- @Transactional("dbTransaction")
- public void batchInsertJDBC1(List<Poi> poilist) throws DataAccessException {
- String sql = "insert into tb_poi (tag, poi, poiid, meshid, owner, featcode, sortcode, namec, namee, namep, names) values (?, GeomFromText(?), ?, ?, ?, ?, ?, ?, ?, ?, ?)";
- for (Poi poi : poilist) {
- Object[] args = {poi.getTag(), poi.getPoint(), poi.getPoiid(), poi.getMeshid(), poi.getOwner(), poi.getFeatcode(), poi.getSortcode(), poi.getNamec(),
- poi.getNamee(), poi.getNamep(), poi.getNames()};
- jdbcTemplate.update(sql, args);
- }
- }
B、用spring事務和springjdbc的batchUpdate
- @Transactional("dbTransaction")
- public void batchInsertJDBC2(List<Poi> poilist) throws DataAccessException {
- String sql = "insert into tb_poi (tag, poi, poiid, meshid, owner, featcode, sortcode, namec, namee, namep, names) values (?, GeomFromText(?), ?, ?, ?, ?, ?, ?, ?, ?, ?)";
- List<Object[]> batchArgs = new ArrayList<Object[]>();
- for (Poi poi : poilist) {
- Object[] args = {poi.getTag(), poi.getPoint(), poi.getPoiid(), poi.getMeshid(), poi.getOwner(), poi.getFeatcode(), poi.getSortcode(), poi.getNamec(),
- poi.getNamee(), poi.getNamep(), poi.getNames()};
- batchArgs.add(args);
- }
- jdbcTemplate.batchUpdate(sql, batchArgs);
- }
C、用spring事務,利用mysql特性,拼寫insert sql。
- @Transactional("dbTransaction")
- public void batchInsertJDBC3(List<Poi> poilist) throws DataAccessException {
- StringBuffer sqlbuf = new StringBuffer()
- .append("insert into tb_poi (tag, poi, poiid, meshid, owner, featcode, sortcode, namec, namee, namep, names) values ");
- MessageFormat form = new MessageFormat("(''{0}'', GeomFromText(''{1}''), ''{2}'', ''{3}'', ''{4}'', ''{5}'', ''{6}'', ''{7}'', ''{8}'', ''{9}'', ''{10}''),");
- for (Poi poi : poilist) {
- Object[] args = {poi.getTag(), poi.getPoint(), poi.getPoiid(), poi.getMeshid(), poi.getOwner(), poi.getFeatcode(), poi.getSortcode(), poi.getNamec().replaceAll("'", "\\\\'"),
- poi.getNamee().replaceAll("'", "\\\\'"), poi.getNamep().replaceAll("'", "\\\\'"), poi.getNames().replaceAll("'", "\\\\'")};
- sqlbuf.append(form.format(args));
- }
- String sql = sqlbuf.toString();
- sql = sql.substring(0, sql.length()-1);
- jdbcTemplate.update(sql);
- }
測試一:每次處理100條,共600條。
測試二:每次處理1000條,共9000條。
直接上結論:
mybatis.1最慢。而且慢很多,很多。
mybatis.2很快。是mybatis中最快的。
mybatis.3比2慢一點。
jdbc.A比B稍快,兩者差不多,和mybatis.3也在伯仲之間。
jdbc.C最快,比其他5種都快。
大排行,從用時少到用時多:
jdbc.C < mybatis.2 < jdbc.A < jdbc.B , mybatis.3 << mybatis.1