Transformer related optimization, including BERT, GPT
Why do you think that https://github.com/ELS-RD/transformer-deploy is a good alternative to FasterTransformer
Transformer related optimization, including BERT, GPT
Why do you think that https://github.com/ELS-RD/transformer-deploy is a good alternative to FasterTransformer