Golang Serialization Benchmark

Serializers

This project test the below go serializers, which compares with go standard json and xml.

• encoding/json
• encoding/xml
• github.com/tinylib/msgp
• github.com/golang/protobuf
• github.com/gogo/protobuf
• Apache/Thrift
• Apache/Avro
• andyleap/gencode
• ugorji/go/codec
• colfer
• zebrapack
• gotiny
• github.com/ugorji/go/codec
• hprose-golang
• vmihailenco/msgpack/v4
• Sereal
• ffjson
• easyjson
• jsoniter
• go-ethereum/rlp

Excluded Serializers

Given existed benchmark by alecthomas，or complexity， or activity, the below serializers are excluded from this test because of their poor performance.

• encoding/gob
• github.com/alecthomas/binary
• github.com/davecgh/go-xdr/xdr
• labix.org/v2/mgo/bson
• github.com/DeDiS/protobuf
• bson
• go-memdump
• github.com/google/flatbuffers
• go-memdump

Test Environment

go version: 1.13.4

Test:

go test -bench=.

Test Data Model

All tests are using the same data model as below:

type ColorGroup struct {
    ID     int `json:"id" xml:"id,attr""`
    Name   string `json:"name" xml:"name"`
    Colors []string `json:"colors" xml:"colors"`
}
`

Benchmark

Marshal

include marshalled bytes

BenchmarkMarshalByJson-6                         2543781               480 ns/op                65.0 marshaledBytes
BenchmarkMarshalByXml-6                           401060              2842 ns/op               137 marshaledBytes
BenchmarkMarshalByMsgp-6                        15432038                80.7 ns/op              47.0 marshaledBytes
BenchmarkMarshalByProtoBuf-6                     8019920               150 ns/op                36.0 marshaledBytes
BenchmarkMarshalByGogoProtoBuf-6                12277683                94.9 ns/op              36.0 marshaledBytes
BenchmarkMarshalByThrift-6                       3795267               317 ns/op                63.0 marshaledBytes
BenchmarkMarshalByAvro-6                         3668318               331 ns/op                32.0 marshaledBytes
BenchmarkMarshalByGencode-6                     37568914                31.3 ns/op              34.0 marshaledBytes
BenchmarkMarshalByUgorjiCodecAndCbor-6           1447856               849 ns/op                47.0 marshaledBytes
BenchmarkMarshalByUgorjiCodecAndMsgp-6           1465488               806 ns/op                47.0 marshaledBytes
BenchmarkMarshalByUgorjiCodecAndBinc-6           1469070               823 ns/op                47.0 marshaledBytes
BenchmarkMarshalByUgorjiCodecAndJson-6           1000000              1037 ns/op                65.0 marshaledBytes
BenchmarkMarshalByEasyjson-6                     6106801               196 ns/op                65.0 marshaledBytes
BenchmarkMarshalByFfjson-6                       1666495               728 ns/op                65.0 marshaledBytes
BenchmarkMarshalByJsoniter-6                     3208327               375 ns/op                65.0 marshaledBytes
BenchmarkMarshalByGoMemdump-6                     344076              3496 ns/op               200 marshaledBytes
BenchmarkMarshalByColfer-6                      50134317                23.9 ns/op              35.0 marshaledBytes
BenchmarkMarshalByZebrapack-6                    9549326               116 ns/op               109 marshaledBytes
BenchmarkMarshalByGotiny-6                       4663609               258 ns/op                32.0 marshaledBytes
BenchmarkMarshalByHprose-6                       4645060               259 ns/op                49.0 marshaledBytes
BenchmarkMarshalBySereal-6                        750622              1590 ns/op                76.0 marshaledBytes
BenchmarkMarshalByVmihMsgpackv4-6                2378013               500 ns/op                55.0 marshaledBytes
BenchmarkMarshalByRlp-6                          3351589               359 ns/op                32.0 marshaledBytes
BenchmarkMarshalBySegmentioJSON-6                3249405               369 ns/op                65.0 marshaledBytes

Unmarshal

BenchmarkUnmarshalByJson-6                        752025              1597 ns/op
BenchmarkUnmarshalByXml-6                         128037              9597 ns/op
BenchmarkUnmarshalByMsgp-6                       8075196               148 ns/op
BenchmarkUnmarshalByProtoBuf-6                   3069420               382 ns/op
BenchmarkUnmarshalByGogoProtoBuf-6               4064895               304 ns/op
BenchmarkUnmarshalByThrift-6                     1405612               856 ns/op
BenchmarkUnmarshalByAvro-6                         76148             16803 ns/op
BenchmarkUnmarshalByGencode-6                   12796027                92.0 ns/op
BenchmarkUnmarshalByUgorjiCodecAndCbor-6         1000000              1116 ns/op
BenchmarkUnmarshalByUgorjiCodecAndMsgp-6         1000000              1221 ns/op
BenchmarkUnmarshalByUgorjiCodecAndBinc-6         1000000              1104 ns/op
BenchmarkUnmarshalByUgorjiCodecAndJson-6          600756              1934 ns/op
BenchmarkUnmarshalByEasyjson-6                   3208314               384 ns/op
BenchmarkUnmarshalByFfjson-6                      925518              1250 ns/op
BenchmarkUnmarshalByJsoniter-6                   3092865               388 ns/op
BenchmarkUnmarshalByGJSON-6                      1000000              1276 ns/op
BenchmarkUnmarshalByGoMemdump-6                  1339832               934 ns/op
BenchmarkUnmarshalByColfer-6                     7762653               156 ns/op
BenchmarkUnmarshalByZebrapack-6                  5323958               224 ns/op
BenchmarkUnmarshalByGotiny-6                     4870737               241 ns/op
BenchmarkUnmarshalByHprose-6                     2527753               474 ns/op
BenchmarkUnmarshalBySereal-6                     2114608               565 ns/op
BenchmarkUnmarshalByVmihMsgpackv4-6              1432388               823 ns/op
BenchmarkUnmarshalByRlp-6                        1675710               706 ns/op
BenchmarkUnmarshalBySegmentioJSON-6              2772384               430 ns/op