Java序列化框架性能比較

 博客: http://colobu.com

jvm-serializers提供了一個非常好的比較各種Java序列化的的測試套件。 它羅列了各種序列化框架。 能夠自己主動生成測試報告。
我在AWS c3.xlarge機器上進行了測試，一下是測試報告與解析。

關鍵的測試數據的統計代碼例如以下：

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27

public double runWithTimeMeasurement( int timeMillis, TestCase tc, int iterations) throws Exception { long start = System.currentTimeMillis(); double sumTime = 0; int count = 0; System.err.println( "test-time "+timeMillis+ " iteration "+iterations); while ( System.currentTimeMillis()-start < timeMillis ) { double time = tc.run(transformer, serializer, value, iterations); sumTime += time; measurementVals[count] = time; count++; } double avg = sumTime / count; Arrays.sort(measurementVals, 0,count); System.err.println( "-----------------------------------------------------------------------------"); System.err.println(serializer.getName()); System.err.println( "min:" + measurementVals[ 0]); System.err.println( "1/4:"+measurementVals[count/ 4]); System.err.println( "1/2:"+measurementVals[count/ 2]); System.err.println( "3/4:"+measurementVals[count/ 4* 3]); System.err.println( "max:"+measurementVals[count- 1]); System.err.println( "average:"+ avg + " deviation:"+(avg-measurementVals[count/ 2])); System.err.println( "-----------------------------------------------------------------------------"); return avg; }

測試時序列化和反序列化會迭代多次。默認2000次。

測試會有一個限定時間，一輪測試完畢后時間還有的話還會繼續新的一輪的測試。 因此， 因為不同的框架花費的時間不同， 測試的輪數也不一樣。

測試平台

OS:Linux (CentOS 6.4)
JVM:JDK 1.7.0_17
CPU: c3.xlarge
Cores (incl HT):4

免責聲明

本測試主要關注無循環引用的數據結構， 可是如此眾多的序列化框架還是各有不同：

• 有些支持循環引用檢測
• 有些會輸出所有的元數據。有些不會
• 有些支持跨平台，有些僅僅支持特定的編程語言
• 有些是基於文本的。有些卻基於二進制
• 有些支持向前向后兼容， 有些僅僅支持向前或者向后，有些所有不支持

(查看ToolBehavior頁面以了解一些框架的特性)
雖然別的測試數據可能會生成不同的測試結果(比如在每一個字符串中添加非ascii字符), 此測試還是會提供一個各個序列化框架的性能的原始預計。

序列化框架Serializers(無共享引用)

• 無循環引用。 一個對象假設被引用兩次則會序列化兩次
• 沒有手工優化
• schema預先已知

Ser Time+Deser Time (ns)
Ser Time+Deser Time (ns)

Size, Compressed in bytes
Size, Compressed in bytes

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27

pre. create ser deser total size +dfl protostuff 112 663 917 1580 239 150 fst-flat-pre 81 908 984 1893 251 165 kryo-flat-pre 81 831 1083 1914 212 132 protobuf 149 1625 942 2567 239 149 msgpack-databind 81 1123 1821 2944 233 146 thrift-compact 139 1844 1101 2945 240 148 json/fastjson/databind 82 1710 1633 3343 486 262 thrift 139 2216 1253 3469 349 197 scala/sbinary 166 2122 1451 3573 255 147 smile/jackson+afterburner/databind 81 1757 1868 3625 352 252 smile/jackson/databind 81 2095 2250 4346 338 241 json/jackson+afterburner/databind 81 2006 2548 4554 485 261 json/protostuff-runtime 80 2008 2741 4748 469 243 json/jackson/databind 80 2173 2972 5145 485 261 json/jackson-jr/databind 81 2282 3435 5716 468 255 cbor/jackson/databind 81 4112 2659 6771 397 246 xml/jackson/databind 81 3558 7028 10585 683 286 json/gson/databind 81 7322 7063 14386 486 259 bson/jackson/databind 80 6974 8318 15291 506 286 xml/xstream+c 81 9050 28265 37315 487 244 xml/exi-manual 83 19634 18063 37697 337 327 json/javax-tree/glassfish 1558 16804 23814 40618 485 263 java-built- in 82 7154 37804 44958 889 514 scala/java-built- in 164 11195 62423 73617 1312 700 json/protobuf 142 11815 73133 84949 488 253 json/json-lib/databind 81 45857 165134 210991 485 263

全對象圖序列化框架Full Object Graph Serializers

• 支持所有的object graph讀寫. Object graph可能包括循環引用.
• 無預先處理, 沒有預先的類生成。注冊. 所有都執行時產生， 比方使用反射.
• 注意通常不會跨編程語言。

  然而JSON/XML格式因為其特殊性能夠跨語言.

Ser Time+Deser Time (ns)
Ser Time+Deser Time (ns)

Size, Compressed [light] in bytes
Size, Compressed in bytes

1 2 3 4 5 6 7 8 9 10 11 12 13 14

pre. create ser deser total size +dfl protostuff-graph 112 946 963 1909 239 150 protostuff-graph-runtime 82 1187 1208 2395 241 151 kryo-serializer 81 2091 1858 3949 286 188 fst 81 2075 2041 4116 316 203 jboss-marshalling-river-ct 81 4057 2810 6867 298 199 hessian 80 6683 7234 13917 501 313 jboss-serialization 83 9529 8508 18036 932 582 jboss-marshalling-river 81 5915 28347 34261 694 400 java-built- in-serializer 81 7273 36274 43547 889 514 stephenerialization 59 8396 37359 45756 1093 517 jboss-marshalling- serial 80 15148 39180 54328 856 498 yaml/jackson/databind 82 25969 41084 67053 505 260 json/flexjson/databind 81 25717 61700 87417 503 273

跨語言二進制序列化框架cross Lang Binary Serializers

• 無循環引用
• schema預先已知

Ser Time+Deser Time (ns)
Ser Time+Deser Time (ns)

Size, Compressed in bytes
Size, Compressed in bytes

1 2 3 4 5 6 7 8 9 10

pre. create ser deser total size +dfl protobuf/protostuff 113 695 927 1622 239 149 protobuf/protostuff- runtime 81 971 1105 2075 241 150 protobuf 149 1625 942 2567 239 149 msgpack-databind 81 1123 1821 2944 233 146 thrift-compact 139 1844 1101 2945 240 148 thrift 139 2216 1253 3469 349 197 cbor/jackson/databind 81 4112 2659 6771 397 246 hessian 80 6683 7234 13917 501 313 bson/jackson/databind 80 6974 8318 15291 506 286

XML/JSon序列化框架

• 基於文本
• Mixed regarding required preparation, object graph awareness (references).

Ser Time+Deser Time (ns)
Ser Time+Deser Time (ns)

Size, Compressed in bytes
Size, Compressed in bytes

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

pre. create ser deser total size +dfl json/fastjson/databind 82 1710 1633 3343 486 262 json/jackson+afterburner/databind 81 2006 2548 4554 485 261 json/protostuff-runtime 80 2008 2741 4748 469 243 json/jackson/databind 80 2173 2972 5145 485 261 json/jackson-jr/databind 81 2282 3435 5716 468 255 xml/jackson/databind 81 3558 7028 10585 683 286 json/gson/databind 81 7322 7063 14386 486 259 xml/xstream+c 81 9050 28265 37315 487 244 xml/exi-manual 83 19634 18063 37697 337 327 json/javax-tree/glassfish 1558 16804 23814 40618 485 263 yaml/jackson/databind 82 25969 41084 67053 505 260 json/protobuf 142 11815 73133 84949 488 253 json/flexjson/databind 81 25717 61700 87417 503 273 json/json-lib/databind 81 45857 165134 210991 485 263

手工優化的序列化框架Manually optimized Serializers

Ser Time+Deser Time (ns)
Ser Time+Deser Time (ns)

Size, Compressed in bytes
Size, Compressed in bytes

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33

pre. create ser deser total size +dfl kryo-manual 81 670 792 1462 211 131 protostuff-manual 81 608 915 1523 239 150 wobly 48 1147 701 1848 251 151 kryo-opt 81 837 1059 1896 209 129 wobly-compact 48 1175 748 1923 225 139 java-manual 80 1341 848 2190 255 147 smile/jackson/manual 82 1270 1476 2746 341 244 msgpack-manual 80 1141 1668 2809 233 146 json/jackson/manual 83 1467 1949 3416 468 253 jboss-marshalling-river-ct-manual 82 2314 1586 3900 289 167 avro-generic 488 2485 1527 4012 221 133 avro-specific 118 2191 1916 4108 221 133 json/protostuff-manual 81 1757 2472 4229 449 233 cbor/jackson/manual 80 3659 1667 5326 386 238 xml/aalto-manual 82 2724 3902 6626 653 304 jboss-marshalling-river-manual 81 2967 5620 8587 483 240 json/gson/manual 81 4798 5826 10624 468 253 xml/woodstox-manual 81 4801 6355 11156 653 304 json/json-smart/manual-tree 82 7623 5110 12733 495 269 json/gson/manual-tree 82 7234 8202 15437 485 259 xml/fastinfo-manual 81 8406 7207 15613 377 284 xml/javolution/manual 80 6781 10766 17547 504 263 json/json.simple/manual 81 7394 10923 18317 495 269 json/org.json/manual-tree 81 8368 10959 19327 485 259 json/svenson/databind 81 5956 14026 19981 495 269 xml/xstream+c-aalto 81 5641 14743 20384 525 273 xml/xstream+c-fastinfo 81 10471 11640 22111 345 264 bson/mongodb/manual 81 4283 19559 23842 495 278 xml/xstream+c-woodstox 80 7326 18877 26203 525 273 json/javax-stream/glassfish 81 12791 21756 34547 468 253 json/jsonij/manual-jpath 83 38635 15094 53729 478 257 json/argo/manual-tree 81 85473 19416 104889 485 263

特性對性能的影響Cost of features

shows performance vs convenience of manually-selected libs.

• 循環引用。 schema預知。手工優化cycle free, schema known at compile time, manual optimization: kryo-manual, msgpack-manual
• 循環引用， schema預知cycle free, schema known at compile time: protostuff, fst-flat-pre, kryo-flat-pre. (note: protostuff uses class generation while the other two just require a list of classes to be written)
• 循環引用， schema編譯時未知 cycle free, schema UNKNOWN at compile time: fst-flat, kryo-flat, protostuff-runtime, msgpack-databind
• 全圖讀寫。schema編譯時未知 full object graph awareness, schema UNKNOWN at compile time: fst, kryo.

Ser Time+Deser Time (ns)
Ser Time+Deser Time (ns)

Size, Compressed in bytes
Size, Compressed in bytes

1 2 3 4 5 6 7 8 9 10 11 12

pre. create ser deser total size +dfl kryo-manual 81 670 792 1462 211 131 protostuff 112 663 917 1580 239 150 fst-flat- pre 81 908 984 1893 251 165 kryo-flat- pre 81 831 1083 1914 212 132 protostuff- runtime 82 839 1104 1943 241 151 kryo-flat 81 1037 1468 2505 268 177 fst-flat 81 1230 1469 2700 314 204 msgpack-manual 80 1141 1668 2809 233 146 msgpack-databind 81 1123 1821 2944 233 146 kryo-serializer 81 2091 1858 3949 286 188 fst 81 2075 2041 4116 316 203

所有的測試結果

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77

pre. create ser deser total size +dfl kryo-manual 81 670 792 1462 211 131 protostuff-manual 81 608 915 1523 239 150 protostuff 112 663 917 1580 239 150 protobuf/protostuff 113 695 927 1622 239 149 wobly 48 1147 701 1848 251 151 fst-flat-pre 81 908 984 1893 251 165 kryo-opt 81 837 1059 1896 209 129 protostuff-graph 112 946 963 1909 239 150 kryo-flat-pre 81 831 1083 1914 212 132 wobly-compact 48 1175 748 1923 225 139 protostuff-runtime 82 839 1104 1943 241 151 protobuf/protostuff-runtime 81 971 1105 2075 241 150 java-manual 80 1341 848 2190 255 147 protostuff-graph-runtime 82 1187 1208 2395 241 151 kryo-flat 81 1037 1468 2505 268 177 protobuf 149 1625 942 2567 239 149 fst-flat 81 1230 1469 2700 314 204 smile/jackson/manual 82 1270 1476 2746 341 244 msgpack-manual 80 1141 1668 2809 233 146 msgpack-databind 81 1123 1821 2944 233 146 thrift-compact 139 1844 1101 2945 240 148 json/fastjson/databind 82 1710 1633 3343 486 262 json/jackson/manual 83 1467 1949 3416 468 253 thrift 139 2216 1253 3469 349 197 scala/sbinary 166 2122 1451 3573 255 147 smile/jackson+afterburner/databind 81 1757 1868 3625 352 252 jboss-marshalling-river-ct-manual 82 2314 1586 3900 289 167 kryo-serializer 81 2091 1858 3949 286 188 avro-generic 488 2485 1527 4012 221 133 avro-specific 118 2191 1916 4108 221 133 fst 81 2075 2041 4116 316 203 json/protostuff-manual 81 1757 2472 4229 449 233 smile/jackson/databind 81 2095 2250 4346 338 241 json/jackson+afterburner/databind 81 2006 2548 4554 485 261 json/protostuff-runtime 80 2008 2741 4748 469 243 json/jackson/databind 80 2173 2972 5145 485 261 cbor/jackson/manual 80 3659 1667 5326 386 238 json/jackson-jr/databind 81 2282 3435 5716 468 255 xml/aalto-manual 82 2724 3902 6626 653 304 cbor/jackson/databind 81 4112 2659 6771 397 246 jboss-marshalling-river-ct 81 4057 2810 6867 298 199 jboss-marshalling-river-manual 81 2967 5620 8587 483 240 xml/jackson/databind 81 3558 7028 10585 683 286 json/gson/manual 81 4798 5826 10624 468 253 xml/woodstox-manual 81 4801 6355 11156 653 304 json/json-smart/manual-tree 82 7623 5110 12733 495 269 hessian 80 6683 7234 13917 501 313 json/gson/databind 81 7322 7063 14386 486 259 bson/jackson/databind 80 6974 8318 15291 506 286 json/gson/manual-tree 82 7234 8202 15437 485 259 xml/fastinfo-manual 81 8406 7207 15613 377 284 xml/javolution/manual 80 6781 10766 17547 504 263 jboss-serialization 83 9529 8508 18036 932 582 json/json.simple/manual 81 7394 10923 18317 495 269 json/org.json/manual-tree 81 8368 10959 19327 485 259 json/svenson/databind 81 5956 14026 19981 495 269 xml/xstream+c-aalto 81 5641 14743 20384 525 273 xml/xstream+c-fastinfo 81 10471 11640 22111 345 264 bson/mongodb/manual 81 4283 19559 23842 495 278 xml/xstream+c-woodstox 80 7326 18877 26203 525 273 jboss-marshalling-river 81 5915 28347 34261 694 400 json/javax-stream/glassfish 81 12791 21756 34547 468 253 xml/xstream+c 81 9050 28265 37315 487 244 xml/exi-manual 83 19634 18063 37697 337 327 json/javax-tree/glassfish 1558 16804 23814 40618 485 263 java-built- in-serializer 81 7273 36274 43547 889 514 java-built- in 82 7154 37804 44958 889 514 stephenerialization 59 8396 37359 45756 1093 517 json/jsonij/manual-jpath 83 38635 15094 53729 478 257 jboss-marshalling- serial 80 15148 39180 54328 856 498 yaml/jackson/databind 82 25969 41084 67053 505 260 scala/java-built- in 164 11195 62423 73617 1312 700 json/protobuf 142 11815 73133 84949 488 253 json/flexjson/databind 81 25717 61700 87417 503 273 json/argo/manual-tree 81 85473 19416 104889 485 263 json/json-lib/databind 81 45857 165134 210991 485 263

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77

pre. Effort Format Structure Misc kryo-manual MANUAL_OPT BINARY FLAT_TREE [] manually optimized protostuff-manual MANUAL_OPT BINARY FLAT_TREE [] manual protostuff CLASSES_KNOWN BINARY FLAT_TREE [] generated code protobuf/protostuff CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] protobuf + generated code wobly MANUAL_OPT BINARY FLAT_TREE [] fst-flat-pre CLASSES_KNOWN BINARY FLAT_TREE [] fst in unshared mode with preregistered classes kryo-opt MANUAL_OPT BINARY FLAT_TREE [] manually optimized protostuff-graph CLASSES_KNOWN BINARY FULL_GRAPH [] graph + generated code kryo-flat-pre CLASSES_KNOWN BINARY FLAT_TREE [] no shared refs, preregistered classes wobly-compact MANUAL_OPT BINARY FLAT_TREE [] protostuff-runtime ZERO_KNOWLEDGE BINARY FLAT_TREE [] reflection protobuf/protostuff-runtime ZERO_KNOWLEDGE BIN_CROSSLANG FLAT_TREE [] protobuf + reflection java-manual MANUAL_OPT BINARY FLAT_TREE [] protostuff-graph-runtime ZERO_KNOWLEDGE BINARY FULL_GRAPH [] graph + reflection kryo-flat ZERO_KNOWLEDGE BINARY FLAT_TREE [] default, no shared refs protobuf CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] fst-flat ZERO_KNOWLEDGE BINARY FLAT_TREE [] fst default, but unshared mode smile/jackson/manual MANUAL_OPT BINARY FLAT_TREE [] msgpack-manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE [] msgpack-databind CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] thrift-compact CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] json/fastjson/databind ZERO_KNOWLEDGE JSON FLAT_TREE [] json/jackson/manual MANUAL_OPT JSON FLAT_TREE [] thrift CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] scala/sbinary MISC MISC UNKNOWN [] null smile/jackson+afterburner/databind ZERO_KNOWLEDGE BINARY FLAT_TREE [] jboss-marshalling-river-ct-manual MANUAL_OPT BINARY FULL_GRAPH [] full graph preregistered classes, manual optimization kryo-serializer ZERO_KNOWLEDGE BINARY FULL_GRAPH [] default avro-generic MANUAL_OPT BIN_CROSSLANG FLAT_TREE [] avro-specific MANUAL_OPT BIN_CROSSLANG UNKNOWN [] fst ZERO_KNOWLEDGE BINARY FULL_GRAPH [] default: JDK serialization drop-in-replacement mode json/protostuff-manual MANUAL_OPT JSON FLAT_TREE [] json + manual smile/jackson/databind ZERO_KNOWLEDGE BINARY FLAT_TREE [] json/jackson+afterburner/databind ZERO_KNOWLEDGE JSON FLAT_TREE [] uses bytecode generation to reduce overhead json/protostuff-runtime ZERO_KNOWLEDGE JSON FLAT_TREE [] json + reflection json/jackson/databind ZERO_KNOWLEDGE JSON FLAT_TREE [] cbor/jackson/manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE [] json/jackson-jr/databind ZERO_KNOWLEDGE JSON FLAT_TREE [] xml/aalto-manual MANUAL_OPT XML UNKNOWN [] cbor/jackson/databind ZERO_KNOWLEDGE BIN_CROSSLANG FLAT_TREE [] jboss-marshalling-river-ct CLASSES_KNOWN BINARY FULL_GRAPH [] full graph with preregistered classes jboss-marshalling-river-manual MANUAL_OPT BINARY FULL_GRAPH [] full graph with manual optimizations xml/jackson/databind ZERO_KNOWLEDGE XML FLAT_TREE [] json/gson/manual MANUAL_OPT JSON FLAT_TREE [] xml/woodstox-manual MANUAL_OPT XML UNKNOWN [] json/json-smart/manual-tree MANUAL_OPT JSON FLAT_TREE [] hessian ZERO_KNOWLEDGE BIN_CROSSLANG FULL_GRAPH [] json/gson/databind ZERO_KNOWLEDGE JSON FLAT_TREE [] bson/jackson/databind CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] json/gson/manual-tree MANUAL_OPT JSON FLAT_TREE [] xml/fastinfo-manual MANUAL_OPT XML UNKNOWN [] xml/javolution/manual MANUAL_OPT XML FLAT_TREE [] jboss-serialization ZERO_KNOWLEDGE BINARY FULL_GRAPH [] json/json.simple/manual MANUAL_OPT JSON FLAT_TREE [] json/org.json/manual-tree MANUAL_OPT JSON FLAT_TREE [] json/svenson/databind MANUAL_OPT JSON FLAT_TREE [] xml/xstream+c-aalto MANUAL_OPT XML FLAT_TREE [] xml/xstream+c-fastinfo MANUAL_OPT XML FLAT_TREE [] bson/mongodb/manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE [] xml/xstream+c-woodstox MANUAL_OPT XML FLAT_TREE [] jboss-marshalling-river ZERO_KNOWLEDGE BINARY FULL_GRAPH [] full graph zero knowledge json/javax-stream/glassfish MANUAL_OPT JSON FLAT_TREE [] xml/xstream+c ZERO_KNOWLEDGE XML FLAT_TREE [] xml/exi-manual ZERO_KNOWLEDGE XML UNKNOWN [] json/javax-tree/glassfish ZERO_KNOWLEDGE JSON FLAT_TREE [] java-built- in-serializer ZERO_KNOWLEDGE BINARY FULL_GRAPH [] java-built- in ZERO_KNOWLEDGE BINARY FLAT_TREE [] stephenerialization ZERO_KNOWLEDGE BINARY FULL_GRAPH [] null json/jsonij/manual-jpath MANUAL_OPT JSON FLAT_TREE [] jboss-marshalling- serial ZERO_KNOWLEDGE BINARY FULL_GRAPH [] yaml/jackson/databind ZERO_KNOWLEDGE JSON FULL_GRAPH [] scala/java-built- in MISC MISC UNKNOWN [] null json/protobuf CLASSES_KNOWN JSON FLAT_TREE [] json/flexjson/databind ZERO_KNOWLEDGE JSON FULL_GRAPH [] json/argo/manual-tree MANUAL_OPT JSON FLAT_TREE [] json/json-lib/databind ZERO_KNOWLEDGE JSON FLAT_TREE []