featurebase
libu8ident
| featurebase | libu8ident | |
|---|---|---|
| 13 | 9 | |
| 2,515 | 16 | |
| - | - | |
| 0.0 | 1.8 | |
| 7 months ago | 10 months ago | |
| Go | C | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
featurebase
-
Feature store for real time inference
You can try https://www.featurebase.com/, they have an open source version but they are focusing on the cloud offering
-
Roaring bitmaps are compressed bitmaps, can be 100x faster
Featurebase[1] is a database based on bitmaps. (Formerly known as Piloasa) I'm not sure if they actually use Roaring Bitmaps [2] or they implemented it themselves. Either way it's based on the idea of compressed bitmaps.
[1] https://github.com/FeatureBaseDB/featurebase
- FeatureBase v3.34.0: The fast Database and Analytics Engine
- FeatureBase v3.33.0 is Released with SQL B-tree Roaring Bitmaps
- FeatureBase v3.32.0 released B-tree Roaring Bitmaps SQL support
- FeatureBase v3.27.0 Is Released
- FeatureBase
- FeatureBase Community v1.3.0 is Released
- Bitmap Indexes in Go: Search Speed
-
TIL What a Bitmap DB is, 2 months after getting hired to work on one
If this still sounds complex, or if you want to see what happens when some smart people make it even faster, then give it a try with FeatureBase.
libu8ident
- Roaring bitmaps are compressed bitmaps, can be 100x faster
-
International domain names: where does HTTPS://meßagefactory.ca lead you?
In programming languages it's much worse. Identifiers can either be unidentifiable, and if so everybody has a different opinion what "identifiable" means. Even the standard on identifiers, UTF-39, is buggy and has too many interpretations, leading to a complete disaster. https://github.com/rurban/libu8ident/blob/master/doc/c11.md
In punycode domain names it's quite simple still.
With other names, it's even worse. No-one cares. Linkers do not, username and filesystem drivers do not. The Apple HFS+ did care a bit one day, until someone in the higher ranks decided that no-one needs unicode security anymore and switched the new APFS to unsafe again.
-
Using Unicode in a compiler
No, it's definitely not safe to use unrestricted Unicode in a compiler. See https://github.com/rurban/libu8ident/ for identifier rules, and http://www.unicode.org/reports/tr55/ for much worse problems.
- Ask HN: What interesting problems are you working on? ( 2022 Edition)
- Unicode Utilities: Confusables
-
How can you be fooled by the U+202E trick?
That's why unicode published the security guidelines and mechanisms to avoid such attacks. In 2004 already.
The problem is that nobody cared. Browsers invented punycode instead of following tr39, email ditto. But ok, at least something. Java did it, cperl did, rust did it.
Everybody else is vulnerable. Esp. most other programming languages, filesystems and login systems. https://github.com/rurban/libu8ident/blob/master/doc/c11.md
- Prevent Trojan Source attacks with GCC 12
-
Unicode Normalization Forms: When ö = ö
I'm maintaining such a library.
coreutils, diff, grep, patch, sed and friends all cannot find Unicode strings, they have no string support. They can only mimic filesystems, finding binary garbage. Strings are so rthi g different than pure ASCII or BINARY garbage. Strings have an encoding and are Unicode.
Filesystems are even worse because they need to treat filenames as identifiers, but do not. Nobody cares about TR31, TR39, TR36 and so on.
Here is an overview of the sad state of Unicode unsafeties in programming languages: https://github.com/rurban/libu8ident/blob/master/c11.md
- Why does Windows 10 run faster than Fedora?
What are some alternatives?
annoy - Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
Confusables - Simple library for matching a string to another string that is same but has letters that only *look* the same as original string