Voyager: An Open-Ended Embodied Agent with LLMs

• Voyager

  53 5,152 4.7 JavaScript

  An Open-Ended Embodied Agent with Large Language Models (by MineDojo)

  

I read through the code and tried it out for 15 mins.

It's a hard-coded program that can do a text search for it's own hard-coded, human-implemented functions. Apparently it can string those functions together, but doesn't do it correctly.

https://github.com/MineDojo/Voyager/tree/main/voyager/contro...

20 minutes of light reading through the repository pretty much dispels any notions that this is a self-learning system that can reason and think. It's the same minecraft automation we have been seeing for a decade now, with a chatbot text search builtin.

• mineflayer

  18 4,580 8.3 JavaScript

  Create Minecraft bots with a powerful, stable, and high level JavaScript API.

  

Looking at the paper, as I understand it they're using Mineflayer https://github.com/PrismarineJS/mineflayer and passing parts of the state of the game as JSON to the LLM that are used for code generation to complete tasks.

> I still don't understand it and it blows my mind - how such properties emerge just from compressing the task of next word prediction.

The Mineflayer library is very popular, so all the relevant tasks are likely already extant in the training data.

• SurveyJS

  surveyjs.io sponsored

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

Suggest a related project