mitta-screenshot
search-lib
mitta-screenshot | search-lib | |
---|---|---|
2 | 1 | |
2 | 1 | |
- | - | |
1.1 | 10.0 | |
about 1 year ago | about 3 years ago | |
JavaScript | Python | |
MIT License | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mitta-screenshot
-
Nomnoml
This could be rewritten to save locally or an endpoint you run: https://github.com/kordless/mitta-screenshot. The code is in background.js. Just fullscreen the graph then click the icon.
-
I want to dive into how to make search engines
Not finished, but the Selenium based crawler works pretty well to combat most blocks: https://github.com/kordless/grub-2.0
For IP blocks, try this: https://github.com/kordless/mitta-screenshot
search-lib
-
I want to dive into how to make search engines
I wrote my own little search engine years ago.
It's pretty simple: You crawl a website and search for all links, then you crawl all the links from these linked websites and so on.
You can still see some of my code here: https://github.com/Wronnay/search-lib
What are some alternatives?
grub-2.0 - Grub is an AI powered Web crawler.
markov - Materials for book: "Markov Chains for programmers"
search-engines - Reviewing alternative search engines
go-sstables - Go library for protobuf compatible sstables, a skiplist, a recordio format and other database building blocks like a write-ahead log. Ships now with an embedded key-value store.
sonic - 🦔 Fast, lightweight & schema-less search backend. An alternative to Elasticsearch that runs on a few MBs of RAM.
protein_search - The neural search engine for proteins.
phalanx - Phalanx is a cloud-native distributed search engine that provides endpoints through gRPC and traditional RESTful API.
bleve - A modern text/numeric/geo-spatial/vector indexing library for go
nomnoml - The sassy UML diagram renderer