finetuner
Jina AI examples
finetuner | Jina AI examples | |
---|---|---|
36 | 22 | |
1,462 | 403 | |
0.5% | - | |
5.5 | 9.6 | |
6 months ago | almost 3 years ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
finetuner
-
How do you think search will change with technology like ChatGPT, Bing’s new AI search engine and the upcoming Google Bard?
And all of that has something to do with finetuners. It basically fine-tunes AI models for specific use cases. With it can create a custom search experience that is tailored to their specific needs. I also wonder how this is going to be integrated into SEO tools soon since those tools are catered to traditional search engines.
-
Combining multiple lists into one, meaningfully
Combining multiple lists into one is tough, but it's doable if you have the right approach. Fine-tuning GPT-3 might help, but finding enough examples is tough. You could use existing text data or manually label a set of training examples. A finetuner could be help too. It's a platform-agnostic toolkit that can fine-tune pre-trained models and it's customizable to do lots of tasks.
-
speech_recognition not able to convert the full live audio to text. Please help me to fine-tune it.
You can adjust the pause threshold a little longer for pauses between and phrases. You can also use the phrase detection mode, which sets a time limit for the entire phrase instead of ending the transcription prematurely. If your microphone sensitivity is low, you can also try adjusting the energy threshold. If you want, you can use finetuners.
-
Questions about fine-tuned results. Should the completion results be identical to fine-tune examples?
It's possible that completion results may be identical to fine-tuned examples, but not guaranteed. Even with the same prompt, slight variations in output are expected due to the nature of probabilistic language models. You can experiment with different settings and parameters, including those with finetuners like these.
-
How can I create a dataset to refine Whisper AI from old videos with subtitles?
You can try creating your own dataset. Get some audio data that you want, preprocess it, and then create a custom dataset you can use to fine tune. You could use finetuners like these if you want as well.
-
A Guide to Using OpenTelemetry in Jina for Monitoring and Tracing Applications
We derived the dataset by pre-processing the deepfashion dataset using Finetuner. The image label generated by Finetuner is extracted and formatted to produce the text attribute of each product.
-
[D] Looking for an open source Downloadable model to run on my local device.
You can either use Hugging Face Transformers as they have a lot of pre-trained models that you can customize. Or Finetuners like this one: which is a toolkit for fine-tuning multiple models.
-
Improving Search Quality for Non-English Queries with Fine-tuned Multilingual CLIP Models
Very recently, a few non-English and multilingual CLIP models have appeared, using various sources of training data. In this article, we’ll evaluate a multilingual CLIP model’s performance in a language other than English, and show how you can improve it even further using Jina AI’s Finetuner.
-
Is there a way I can feed the gpt3 model database object like tables? I know we can create fine tune model but not sure about the completion part. Please help!
I think you can convert your data into text and fine-tune the model on it. But that might not be the ideal way to go since you kind of base that on the model. Try transfer learning or finetuning with a finetuner.
-
Classification using prompt or fine tuning?
you can try prompt-based classification or fine-tuning with a Finetuner. Prompts work well for simple tasks but fine-tuning may give better results for complex ones. Althouigh it's going to need more resources, but try both and see what works best for you.
Jina AI examples
-
Show HN: Search PDFs with Transformers and Python Notebook
- Modern PDFs - if you wanna extract text and images, then the PDFSegmenter used in my example will work. If tables too, might need some additional jiggery-pokery, but definitely doable. I know other ppl using the same framework (Jina) who've accomplished it.
- Exact word search - pretty simple. I've focused on more advanced stuff because color vs colour is same same but different. Also just because it's pretty easy since I'm just using pre-defined building blocks, not manually integrating stuff
- Cross platform frontend - I've seen a lyrics search frontend [0] and I've built stuff in Streamlit before. Jina offers RESTful/gRPC/WebSockets gateways so it can't be too tough
- Lightweight? I mean how lightweight do you want it? C? Bash? Assembly? I've found Python good for text parsing
- Long-term: The notebook I wrote has a few (each of which have their own), but compared to others they're relatively lightweight.
- Gluing code: I've been using pre-existing building blocks, and writing new Executors (i.e. building blocks) is relatively straightforward, and then scaling them up with shards, replicas, etc is just a parameter away.
I'm more into the search side then the PDF stuff. The PDF side I've had experience with through bitter suffering and torment. Not a fun format to work with (unless you're into sado-masochism)
[0] https://github.com/jina-ai/examples/tree/master/multires-lyr...
-
Getting started with Jina AI
Semantic Wikipedia Search
- Do what Google does: build a semantic search app powered by Jina AI's open source, neural search framework.
- A semantic search app powered by Jina AI's open source, neural search framework. Using this, you can index and search song lyrics using state-of-the-art machine learning language models
-
[P] A week ago, I came across this super cool project to build Cross Modal Search. I will now share more details about the project
I was looking for some projects based on search engines, and building a tool which could search across various types of data, and that's when I came across this GitHub project: https://github.com/jina-ai/jina/blob/master/.github/pages/hello-world.md#-multimodal-document-search. Encouraged by thorough, step by step instructions on how to build a search service that can use diverse modal features to provide accurate results; I ventured through the documents till I came to the latest updated version, here: https://github.com/jina-ai/examples/tree/master/cross-modal-search.
- Build your own Google Image search powered by deep-learning, open-source
-
[P] Open-source Neural Search framework to implement semantic search & multimedia search. Just released 2.0, seeking your feedback.
There are already some examples on music search, pdf search and video search that shows some POC of it's capabilities around those use cases. You can discuss your specific use case in detail with Jina community on slack
-
I was wrong! A big thank you to r/python members 🙏
Thank you so much for the appreciation and sharing your use cases. Checkout examples for chatbot and financial analysis - https://github.com/jina-ai/examples
-
PDF search - Another project I built using Jina(AI Search framework)
git clone --depth 1 --filter=blob:none --sparse https://github.com/jina-ai/examples git sparse-checkout set multimodal-search-pdf
- Alternative to Google Images - Open-Source image search engine
What are some alternatives?
gpt_index - LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM's with external data. [Moved to: https://github.com/jerryjliu/llama_index]
jina - ☁️ Build multimodal AI applications with cloud-native stack
RWKV-LM - RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
jina-hub - An open-registry for hosting Jina executors via container images
jina-financial-qa-search
Promptify - Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
jina-app-store-example - App store search example, using Jina as backend and Streamlit as frontend [Moved to: https://github.com/jina-ai/example-app-store]
pysot - SenseTime Research platform for single object tracking, implementing algorithms like SiamRPN and SiamMask.
jina-meme-search-example - Meme search engine built with Jina neural search framework. Search with captions or image files to find matching memes. [Moved to: https://github.com/jina-ai/example-meme-search]
similarity - TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
pdfminer.six - Community maintained fork of pdfminer - we fathom PDF