Llama2.rs Alternatives

Similar projects and alternatives to llama2.rs

• rust

  2,683 93,041 10.0 Rust llama2.rs VS rust

  Empowering everyone to build reliable and efficient software.

  

• llama.cpp

  772 56,891 10.0 C++ llama2.rs VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ollama

  196 62,615 9.9 Go llama2.rs VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• petals

  98 8,661 8.5 Python llama2.rs VS petals

  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  

• rust-gpu

  82 6,952 7.7 Rust llama2.rs VS rust-gpu

  🐉 Making Rust a first-class language and ecosystem for GPU shaders 🚧

  

• exllama

  64 2,594 9.0 Python llama2.rs VS exllama

  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

• tch-rs

  37 3,843 7.5 Rust llama2.rs VS tch-rs

  Rust bindings for the C++ api of PyTorch.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• burn

  34 4,845 8.9 Rust llama2.rs VS burn

  Discontinued Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals. [Moved to: https://github.com/Tracel-AI/burn] (by burn-rs)

  

• candle

  17 13,475 9.9 Rust llama2.rs VS candle

  Minimalist ML framework for Rust

  

• dfdx

  22 1,607 8.7 Rust llama2.rs VS dfdx

  Deep learning in Rust, with shape checked tensors and neural networks

• burn

  9 7,020 9.8 Rust llama2.rs VS burn

  Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

  

• euclid

  1 454 6.0 Rust llama2.rs VS euclid

  Geometry primitives (basic linear algebra) for Rust

  

• syntaxdot

  4 65 6.2 Rust llama2.rs VS syntaxdot

  Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.