Apple Intelligence, the personal intelligence system

1. emoji-kitchen

   1 22 1,398 9.4 TypeScript

   🧑‍🍳 This repository contains the source code for the website https://emojikitchen.dev and allows for quick and easy browsing of the over 100,000 supported emoji mashups as part of Google's Emoji Kitchen.

   

   I think the genmoji is going to be tons of fun. Basically seems like https://emojikitchen.dev/ on steroids.

2. InfluxDB

   influxdata.com featured

   InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.

   

3. llama.cpp

   2 883 78,821 10.0 C++

   LLM inference in C/C++

   

   > Doing everything on-device would result in a horrible user experience. They might as well not participate in this generative AI rush at all if they hoped to keep it on-device.

   On the contrary, I'm shocked over the last few months how "on device" on a Macbook Pro or Mac Studio competes plausibly with last year's early GPT-4, leveraging Llama 3 70b or Qwen2 72b.

   There are surprisingly few things you "need" 128GB of so-called "unified RAM" for, but with M-series processors and the memory bandwidth, this is a use case that shines.

   From this thread covering performance of llama.cpp on Apple Silicon M-series …

   https://github.com/ggerganov/llama.cpp/discussions/4167

   … "Buy as much memory as you can afford would be my bottom line!"

4. mlx-examples

   3 32 7,327 9.4 Python

   Examples in the MLX framework

   

   Yeah that seems very reasonable/likely. The release of the training toolkit for Apple silicon too points that way: https://github.com/ml-explore/mlx-examples/tree/main/transfo...

5. Signal-Server

   4 203 9,683 9.8 Java

   Server supporting the Signal Private Messenger applications on Android, Desktop, and iOS

   

   I don't think so. Signal regularly stops committing code to the public repos (https://github.com/signalapp/Signal-Server) when they're working on some kind of big reveal (cryptocurrency integration and such), but the server code is out there for you to run yourself.

   Signal has the added benefit that it doesn't need to read what's in the messages you send. It needs some very basic routing information and the rest can be encrypted end to end. With AI stuff, the contents need to be decrypted in the cloud, so the end-to-end protections don't apply.

Suggest a related project