Benchmarks
62 updates on Benchmarks.
MobileBERT runs in 62 ms on a Pixel 4 with 25.3M parameters
Carnegie Mellon and Google Brain distilled BERT into a 25.3M-parameter model that answers in 62 ms on a Pixel 4 and scores 77.7 on GLUE.
TinyBERT shrinks BERT-base to 14.5M parameters and runs 9.4x faster
Huawei's distilled BERT keeps more than 96.8% of its teacher's GLUE score at 14.5M parameters, 7.5x smaller and 9.4x faster on inference.