Mongodb批量插入大量數據,使用python腳本也能實現。在這種場景下盡量減少與數據庫的通信,即准備好一定量的數據后批量插入。java mongodb的api提供了批量插入的功能。代碼如下。
import com.mongodb.BasicDBObject; import com.mongodb.DBCollection; import com.mongodb.DBObject; import com.mongodb.MongoClient; import java.util.ArrayList; import java.util.Date; import java.util.List; public class MonConnections { //Mongo db 批量插入數據 private static MongoClient mongoClient = new MongoClient("127.0.0.1", 30000); private static long count = 2000000; public static MongoClient getClient(){ return mongoClient; } public static void main(String[] args){ List<DBObject> list = new ArrayList<>(); DBCollection collection = mongoClient.getDB("test").getCollection("book"); for (int i = 0; i < 2200000; i++){ DBObject object = new BasicDBObject(); object.put("id", String.valueOf(count)); Date date = new Date(); object.put("add_time", date); object.put("title", "mongo"+count++); list.add(object); if (i != 0 && i %10000 == 0){ System.out.println("插入" + " " + i + "本書"); collection.insert(list); list.clear(); } } } }
注意插入后list一定要clear,否則可能出現id重復。