ollama VS azurechatgpt

- Basic internet search (I start ollama CLI faster than I can start a browser - https://ollama.com)

- Formatting/changing text

- Troubleshooting code, esp. new frameworks/libs

- Recipes

- Data entry

- Organizing thoughts: High-level lists, comparison, classification, synonyms, jargon & nomenclature

- Learning esp. by analogy and example

RAG for:

- Website assistants (https://github.com/bennyschmidt/ragdoll-studio/tree/master/e...)

- Game NPCs (https://github.com/bennyschmidt/ragdoll-studio/tree/master/e...)

- Discord/Slack/forum bots (https://github.com/bennyschmidt/ragdoll-studio/tree/master/e...)

- Character-driven storytelling and creating art in a specific style for video game loading screens, background images, avatars, website art, etc. (https://github.com/bennyschmidt/ragdoll-studio/tree/master/r...)

Jan goes a step further by integrating with other local engines like LM Studio and ollama.

# install the Ollama curl -fsSL https://ollama.com/install.sh | sh # get the llama3 model ollama pull llama2 # install the MLFlow pip install mlflow

Ollama for running LLMs locally

curl -fsSL https://ollama.com/install.sh | sh

Streaming is not a problem (it's just a simple flag: https://github.com/wiktor-k/llama-chat/blob/main/index.ts#L2...) but I've never used voice input.

The examples show image input though: https://github.com/ollama/ollama/blob/main/docs/api.md#reque...

Maybe you can file an issue here: https://github.com/ollama/ollama/issues

I’m a huge fan of open source models, especially the newly release Llama 3. Because of the performance of both the large 70B Llama 3 model as well as the smaller and self-host-able 8B Llama 3, I’ve actually cancelled my ChatGPT subscription in favor of Open WebUI, a self-hostable ChatGPT-like UI that allows you to use Ollama and other AI providers while keeping your chat history, prompts, and other data locally on any computer you control.

I was excited about the fact that we could finally use GPT without worrying about privacy issues. I saw this on HN a while ago:

https://news.ycombinator.com/item?id=37112741

But now the link no longer works. Did Microsoft stop doing this?

https://github.com/microsoft/azurechatgpt

Microsoft released Azure ChatGPT on Github.

The repo was trending on Hacker News yesterday but no longer available as of now https://github.com/microsoft/azurechatgpt

Any thought?

The repository (https://github.com/microsoft/azurechatgpt) is now hidden from GitHub

It's also really excellent at a bunch of other things.

For example I am currently doing self-directed study in maths. It turns out chatgpt is very good at explaining lots of things if you prompt correctly. You need to check things yourself and be on the lookout for plausible but wrong explanations, but it's like having a patient pure maths friend to work on things with - your friend won't get everything right either after all.

Something with real commercial potential is what microsoft released (I think today) [1] which is a sort of wizard thing that accellerates various azure gpt-powered standard deployments that do things like set up private ephemeral instances that connect to your enterprise data sources behind your firewall. This has enormous potential given how difficult it is in most large enterprises to actually join data sources together, find basic information etc. Think of an automated helpdesk that can draw on all of the stuff in all of the various disjointed systems in most big companies. That has the potential to be quite transformative to the workplace for a lot of people.

In general I think this bar of "transforming humanity" is just arbitrary and way too high for any technology. You could look at the map on your phone and say "that's all very well but will it transform humanity?" well no. It won't make toast either, but it's quite useful sometimes. Just as overinflated expectations and hype are unhelpful I think it's easy to be cynical and miss important tech developments just because we impose arbitrary standards on them that other technologies didn't have to meet on their way to adoption.

[1] https://github.com/microsoft/azurechatgpt