SynapseML
dspy
Our great sponsors
| SynapseML | dspy | |
|---|---|---|
| 18 | 20 | |
| 4,967 | 10,471 | |
| 0.6% | 31.0% | |
| 8.9 | 9.9 | |
| 8 days ago | 4 days ago | |
| Scala | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
SynapseML
- FLaNK Stack Weekly for 12 September 2023
-
Microsoft announces new tool for applying ChatGPT and GPT-4 at massive scales
Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.11.0
-
Data science in Scala
b) There are libraries around e.g. Microsoft SynapseML, LinkedIn Photon ML
- [N] Microsoft Announces New Integrations with OpenAI and MLFlow
- [N] Microsoft Releases new Integrations with OpenAI and MLflow as part of SynapseML
-
[P] Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on large-scale data
Link to Release Notes: https://github.com/microsoft/SynapseML/releases/tag/v0.9.5
- Microsoft releases SynapseML v0.9.5 for distributed geospatial analytics, speech synthesis, and anomaly detection in PySpark.
- [P] SynapseML v0.9.5 announces support for geospatial analytics, speech synthesis, and anomaly detection on large-scale datasets
- Microsoft releases SynapseML v0.9.5 with support for speech synthesis, anomaly detection, and geospatial analytics on Apache Spark
dspy
- Ask HN: Most efficient way to fine-tune an LLM in 2024?
-
Princeton group open sources "SWE-agent", with 12.3% fix rate for GitHub issues
DSPy is the best tool for optimizing prompts [0]: https://github.com/stanfordnlp/dspy
Think of it as a meta-prompt optimizer, it uses a LLM to optimize your prompts, to optimize your LLM.
-
Winner of the SF Mistral AI Hackathon: Automated Test Driven Prompting
Isn’t this just a very naive implementation of what DsPY does?
https://github.com/stanfordnlp/dspy
I don’t understand what is exceptional here.
-
Show HN: Fructose, LLM calls as strongly typed functions
Have you done any comparison with DSPy ? (https://github.com/stanfordnlp/dspy)
Feels very similiar to DSPy except you dont have optimizations yet. But I like your API and the programming model your are enforcing through this.
-
AI Prompt Engineering Is Dead
I'm interested in hearing if anyone has used DSPy (https://github.com/stanfordnlp/dspy) just for prompt optimization for GPT-3.5 or GPT-4. Was it worth the effort and much better than manual prompt iteration? Was the optimized prompt some weird incantation? Any other insights?
-
Ask HN: Are you using a GPT to prompt-engineer another GPT?
You should check out x.com/lateinteraction's DSPy — which is like an optimizer for prompts — https://github.com/stanfordnlp/dspy
- SuperDuperDB - how to use it to talk to your documents locally using llama 7B or Mistral 7B?
- FLaNK Stack Weekly for 12 September 2023
- Stanford DSPy: The framework for programming with foundation models
What are some alternatives?
mmlspark - Simple and Distributed Machine Learning [Moved to: https://github.com/microsoft/SynapseML]
semantic-kernel - Integrate cutting-edge LLM technology quickly and easily into your apps
isolation-forest - A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.
open-interpreter - A natural language interface for computers
Tensorflow_scala - TensorFlow API for the Scala Programming Language
playground - Play with neural networks!
deequ - Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
FastMJPG - FastMJPG is a command line tool for capturing, sending, receiving, rendering, piping, and recording MJPG video with extremely low latency. It is optimized for running on constrained hardware and battery powered devices.
Breeze - Breeze is a numerical processing library for Scala.
prompt-engine-py - A utility library for creating and maintaining prompts for Large Language Models
azure-kusto-spark - Apache Spark Connector for Azure Kusto
clip-interrogator - Image to prompt with BLIP and CLIP