fastertransformer_backend

By triton-inference-server

Fastertransformer_backend Alternatives

Similar projects and alternatives to fastertransformer_backend

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better fastertransformer_backend alternative or higher similarity.

fastertransformer_backend reviews and mentions

Posts with mentions or reviews of fastertransformer_backend. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-04-26.
  • Free alternative to OpenAI Copilot
    7 projects | /r/selfhosted | 26 Apr 2023
    This is an attempt to build a locally hosted alternative to GitHub Copilot. It uses the SalesForce CodeGen models inside of NVIDIA's Triton Inference Server with the FasterTransformer backend.

Stats

Basic fastertransformer_backend repo stats
1
412
5.4
6 months ago

triton-inference-server/fastertransformer_backend is an open source project licensed under BSD 3-clause "New" or "Revised" License which is an OSI approved license.

The primary programming language of fastertransformer_backend is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com