fst
ripgrep-all
Our great sponsors
fst | ripgrep-all | |
---|---|---|
11 | 43 | |
1,698 | 6,106 | |
- | - | |
3.5 | 8.0 | |
2 months ago | 29 days ago | |
Rust | Rust | |
The Unlicense | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fst
-
How to use mmap safely in Rust?
The fst crate effectively relies on mmap for it to work right. The folks here suggesting you just use the heap might be right, but only if using the heap is actually plausible. If your dictionary is GBs big (an FST might be bigger than available memory), then copying it the heap first would be disastrous.
-
Official /r/rust "Who's Hiring" thread for job-seekers and job-offerers [Rust 1.64]
You'll love what we're working on if you're interested in the implementation of:- Tantivy- Meilisearch- Finite State Transducers
-
rustc is unacceptably slow compiling long lists of constant slices
Here's an example of longest prefix matching using a FST which I based my approach on: https://github.com/BurntSushi/fst/pull/104/files
-
Official /r/rust "Who's Hiring" thread for job-seekers and job-offerers [Rust 1.63]
Finite State Transducers
-
Wikit Desktop - A dictionary application using tauri GUI framework
As a result, I have a plan to implement a desktop version from then and I finished today with a beta version. The desktop is based on tauri, and the dictionary index algorithm is FST (it is an awesome index algorithm).
-
WordBueno.com online dictionary. Fast, no frills, mobile friendly.
WordBueno’s data is currently derived from Wiktionary. The backend is using Rust’s warp with fst for indexing.
- Show HN: WordBueno: sleek dictionary built with Rust and Svelte
-
Speed of Rust vs. C
No you don't. I've written multiple programs that load things instantly off the file system via memory maps. See the fst crate[1], for example, which is designed to work with memory maps.
Rust "works badly with memory mapped files" doesn't mean, "Rust can't use memory mapped files." It means, "it is difficult to reconcile Rust's safety story with memory maps." ripgrep for example uses memory maps because they are faster sometimes, and its safety contract[2] is a bit strained. But it works.
[1] - https://github.com/BurntSushi/fst/
[2] - https://docs.rs/grep-searcher/0.1.7/grep_searcher/struct.Mma...
-
Debian discusses vendoring again
Good catch. That's a lapse on my part. I typically would not use a crate for something like that. I've implemented fnv several times: here, here and here. Looks like I just didn't do that for globset.
ripgrep-all
-
Ripgrep is faster than {grep, ag, Git grep, ucg, pt, sift}
I searched in portage, and it seems there is another version working also with other documents like PDFs and doc.
-
Calibre – New in Calibre 7.0
If you want even faster search across different formats, you can try ripgrep-all ( https://github.com/phiresky/ripgrep-all ). It can search across epub, docx, pdf, zip, mp4 etc. If you are handy with the tool, you can write custom adaptor to search across images using OCR with tesseract.
-
Show HN: Khoj – Chat Offline with Your Second Brain Using Llama 2
1. If you want better adoption especially among corporations, GPL-3 wont cut it. Maybe think of some business friendly licenses (MIT etc)
2. I understand the excitement about llm's. But how about making something more accessible. I use rip-grep-all (rga) along with fzf [1] that can search all files including pdfs in a specific folders. However, I would like a GUI tool to search across multiple folders, provide priority of results across folders and store and search histories where I can do a meta-search. This is sufficient for 95% of my usecases to search locally and I dont need LLM. If khoj can enable such search as default without LLM that will be a gamechanger for many people without a heavy compute machine or who dont want to use OpenAI.
[1] https://github.com/phiresky/ripgrep-all/wiki/fzf-Integration
- Burgr – Books in Your Terminal
-
Internet Archive Scholar
I wanted to say 'au contrer' to your 'screenshots are not searchable' and link this[0] but I don't actually see images in the readme.. I swear it was there, maybe it's a buried extra flag..
- Recoll – Full-text search for your desktop
-
Soldiers, im trying to find the best way to storage pdfs and be possible to search for words in all of them at the same time. Is there any app for that (windows) ?
CLI: rga
- Soldiers, im trying to find the best way to storage pdfs and be possible to search for words in all of them at the same time. Is there any app for that ?
-
Can You please help me in finding a workflow that allows me to leave Evernote for good?
You might be interested in https://github.com/phiresky/ripgrep-all
-
Are there any TUI apps you recommend outside of ncdu / nnn / htop / vim / bat / fd / tig / duf?
Found ripgrep-all and I am very happy
What are some alternatives?
pdfgrep - PDFGrep is a GNU/Emacs module providing grep comparable facilities but for PDF files
OCRmyPDF - OCRmyPDF adds an OCR text layer to scanned PDF files, allowing them to be searched
InvoiceNet - Deep neural network to extract intelligent information from invoice documents.
notational-fzf-vim - Notational velocity for vim.
fd - A simple, fast and user-friendly alternative to 'find'
ripgrep - ripgrep recursively searches directories for a regex pattern while respecting your gitignore
nixpkgs - Nix Packages collection & NixOS
onedrive - OneDrive Client for Linux
Camlistore - Perkeep (née Camlistore) is your personal storage system for life: a way of storing, syncing, sharing, modelling and backing up content.
ucd-generate - A command line tool to generate Unicode tables as source code.
Shiori - Simple bookmark manager built with Go
mu - maildir indexer/searcher + emacs mail client + guile bindings