effort

An implementation of bucketMul LLM inference (by kolinko)

Effort Alternatives

Similar projects and alternatives to effort

  • cria

    3 effort VS cria

    Tiny inference-only implementation of LLaMA (by recmo)

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better effort alternative or higher similarity.

effort reviews and mentions

Posts with mentions or reviews of effort. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-04-17.
  • Show HN: Speeding up LLM inference 2x times (possibly)
    3 projects | news.ycombinator.com | 17 Apr 2024
    I think it was somewhere around that tag:

    https://github.com/kolinko/effort/releases/tag/5.0-last-mixt...

    Cannot rerun easily any more, because the underlying model/weight names changed in the meantime. It doesn't help that Mixtral's published .safetensor files seem messed up, and I needed to hack a conversion from pytorch - it added an extra layer of confusion into the project.

Stats

Basic effort repo stats
2
181
9.7
9 days ago

kolinko/effort is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of effort is Swift.

Popular Comparisons


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com