finetuner
Milvus
finetuner | Milvus | |
---|---|---|
36 | 105 | |
1,427 | 26,979 | |
1.2% | 2.5% | |
5.5 | 10.0 | |
about 2 months ago | 5 days ago | |
Python | Go | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
finetuner
-
How do you think search will change with technology like ChatGPT, Bing’s new AI search engine and the upcoming Google Bard?
And all of that has something to do with finetuners. It basically fine-tunes AI models for specific use cases. With it can create a custom search experience that is tailored to their specific needs. I also wonder how this is going to be integrated into SEO tools soon since those tools are catered to traditional search engines.
-
Combining multiple lists into one, meaningfully
Combining multiple lists into one is tough, but it's doable if you have the right approach. Fine-tuning GPT-3 might help, but finding enough examples is tough. You could use existing text data or manually label a set of training examples. A finetuner could be help too. It's a platform-agnostic toolkit that can fine-tune pre-trained models and it's customizable to do lots of tasks.
-
speech_recognition not able to convert the full live audio to text. Please help me to fine-tune it.
You can adjust the pause threshold a little longer for pauses between and phrases. You can also use the phrase detection mode, which sets a time limit for the entire phrase instead of ending the transcription prematurely. If your microphone sensitivity is low, you can also try adjusting the energy threshold. If you want, you can use finetuners.
-
Questions about fine-tuned results. Should the completion results be identical to fine-tune examples?
It's possible that completion results may be identical to fine-tuned examples, but not guaranteed. Even with the same prompt, slight variations in output are expected due to the nature of probabilistic language models. You can experiment with different settings and parameters, including those with finetuners like these.
-
How can I create a dataset to refine Whisper AI from old videos with subtitles?
You can try creating your own dataset. Get some audio data that you want, preprocess it, and then create a custom dataset you can use to fine tune. You could use finetuners like these if you want as well.
-
A Guide to Using OpenTelemetry in Jina for Monitoring and Tracing Applications
We derived the dataset by pre-processing the deepfashion dataset using Finetuner. The image label generated by Finetuner is extracted and formatted to produce the text attribute of each product.
-
[D] Looking for an open source Downloadable model to run on my local device.
You can either use Hugging Face Transformers as they have a lot of pre-trained models that you can customize. Or Finetuners like this one: which is a toolkit for fine-tuning multiple models.
-
Improving Search Quality for Non-English Queries with Fine-tuned Multilingual CLIP Models
Very recently, a few non-English and multilingual CLIP models have appeared, using various sources of training data. In this article, we’ll evaluate a multilingual CLIP model’s performance in a language other than English, and show how you can improve it even further using Jina AI’s Finetuner.
-
Is there a way I can feed the gpt3 model database object like tables? I know we can create fine tune model but not sure about the completion part. Please help!
I think you can convert your data into text and fine-tune the model on it. But that might not be the ideal way to go since you kind of base that on the model. Try transfer learning or finetuning with a finetuner.
-
Classification using prompt or fine tuning?
you can try prompt-based classification or fine-tuning with a Finetuner. Prompts work well for simple tasks but fine-tuning may give better results for complex ones. Althouigh it's going to need more resources, but try both and see what works best for you.
Milvus
-
Computer Vision Meetup: Develop a Legal Search Application from Scratch using Milvus and DSPy!
Legal practitioners often need to find specific cases and clauses across thousands of dense documents. While traditional keyword-based search techniques are useful, they fail to fully capture semantic content of queries and case files. Vector search engines and large language models provide an intriguing alternative. In this talk, I will show you how to build a legal search application using the DSPy framework and the Milvus vector search engine.
-
Ask HN: Who is hiring? (April 2024)
Zilliz (zilliz.com) | Hybrid/ONSITE (SF, NYC) | Full-time
I am part of the hiring team for DevRel
NYC - https://boards.greenhouse.io/zilliz/jobs/4307910005
SF - https://boards.greenhouse.io/zilliz/jobs/4317590005
Zilliz is the company behind Milvus (https://github.com/milvus-io/milvus), the most starred vector database on GitHub. Milvus is a distributed vector database that shines in 1B+ vector use cases. Examples include autonomous driving, e-commerce, and drug discovery. (and, of course, RAG)
We are also hiring for other roles that I am not personally involved in the hiring process for such as product managers, software engineers, and recruiters.
-
Unlock Advanced Search Capabilities with Milvus and Read about RAG
Get started with Milvus on GitHub.
-
Milvus VS pgvecto.rs - a user suggested alternative
2 projects | 13 Mar 2024
-
How to choose the right type of database
Milvus: An open-source vector database designed for AI and ML applications. It excels in handling large-scale vector similarity searches, making it suitable for recommendation systems, image and video retrieval, and natural language processing tasks.
-
Simplifying the Milvus Selection Process
Selecting the right version of open-source Milvus is important to the success of any project leveraging vector search technology. With Milvus offering different versions of its vector database tailored to varying requirements, understanding the significance of selecting the correct version is key for achieving desired outcomes.
-
7 Vector Databases Every Developer Should Know!
Milvus is an open-source vector database designed to handle large-scale similarity search and vector indexing. It supports multiple index types and offers highly efficient search capabilities, making it suitable for a wide range of AI and ML applications, including image and video recognition, natural language processing, and recommendation systems.
-
Ask HN: Who is hiring? (February 2024)
Zilliz is hiring! We're looking for REMOTE and/or HYBRID roles in SF
Zilliz is the company behind Milvus (https://github.com/milvus-io/milvus), the most widely adopted vector database. Vector databases are a crucial piece of any technology stack looking to take advantage of unstructured data. Most recently and notably, Retrieval Augmented Generation (RAG). For RAG, vector databases like Milvus are used as the tool to inject customized data. In other words, vector databases make things like customized chat bots, personalized product recommendations, and more possible.
We are hiring for Developer Advocates, Senior+ Level Engineers and Product people, and Talent Acquisition. Check out all the roles here: https://zilliz.com/careers
-
Qdrant, the Vector Search Database, raised $28M in a Series A round
Good on them, I know the crustaceans are out here happy about this raise for a Rust based Vector DB!
(now I'm gonna plug what I work on)
If you're interested in a more scalable vector database written in Go, check out Milvus (https://github.com/milvus-io/milvus)
-
Open Source Advent Fun Wraps Up!
But before we do, I do want to say that 🤩 all these lovely Open-Source projects would love a little 🎉💕 love by getting a GitHub star ⭐ for their efforts. Including Open Source Milvus 🥰
What are some alternatives?
gpt_index - LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM's with external data. [Moved to: https://github.com/jerryjliu/llama_index]
pgvector - Open-source vector similarity search for Postgres
Jina AI examples - Jina examples and demos to help you get started
faiss - A library for efficient similarity search and clustering of dense vectors.
RWKV-LM - RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
qdrant - Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
jina - ☁️ Build multimodal AI applications with cloud-native stack
Weaviate - Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
Promptify - Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
Elasticsearch - Free and Open, Distributed, RESTful Search Engine
pysot - SenseTime Research platform for single object tracking, implementing algorithms like SiamRPN and SiamMask.
Face Recognition - The world's simplest facial recognition api for Python and the command line