Anthropic launches Tool Use (function calling)

• litellm

  28 8,907 10.0 Python

  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  

There are a few libs that already abstract this away, for example:

- https://github.com/BerriAI/litellm

- https://jxnl.github.io/instructor/

- langchain

It's not hard for me to imagine a future where there is something like the CNCF for AI models, tools, and infra.

• plandex

  16 9,433 9.8 Go

  An AI coding engine for building complex, real-world software with LLMs

  

I'm looking forward to trying this out with Plandex[1] (a terminal-based AI coding tool I recently launched that can build large features and whole projects).

Plandex does rely on OpenAI's streaming function calls for its build progress indicators, so the lack of streaming is a bit unfortunate. But great to hear that it will be included in GA.

I've been getting a lot of requests to support Claude, as well as open source models. A humble suggestion for folks working on models: focus on full compatibility with the OpenAI API as soon as you can, including function calls and streaming function calls. Full support for function calls is crucial for building advanced functionality.

1 - https://github.com/plandex-ai/plandex

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• LLMEasyTools

  2 23 9.1 Python

  Tools for LLM agents.

I have a library with similar api but in python: https://github.com/zby/LLMEasyTools. Even the names match.

Suggest a related project