Anthropic launches Tool Use (function calling)

• litellm

  28 8,225 10.0 Python

  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  

There are a few libs that already abstract this away, for example:

- https://github.com/BerriAI/litellm

- https://jxnl.github.io/instructor/

- langchain

It's not hard for me to imagine a future where there is something like the CNCF for AI models, tools, and infra.

• plandex

  12 8,826 9.7 Go

  An AI coding engine for building complex, real-world software with LLMs

  

I'm looking forward to trying this out with Plandex[1] (a terminal-based AI coding tool I recently launched that can build large features and whole projects).

Plandex does rely on OpenAI's streaming function calls for its build progress indicators, so the lack of streaming is a bit unfortunate. But great to hear that it will be included in GA.

I've been getting a lot of requests to support Claude, as well as open source models. A humble suggestion for folks working on models: focus on full compatibility with the OpenAI API as soon as you can, including function calls and streaming function calls. Full support for function calls is crucial for building advanced functionality.

1 - https://github.com/plandex-ai/plandex

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• LLMEasyTools

  2 18 8.3 Python

  OpenAI tools and functions with no fuss

I have a library with similar api but in python: https://github.com/zby/LLMEasyTools. Even the names match.

Suggest a related project