SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Encoding Open-Source Projects
-
-
CyberChef
The Cyber Swiss Army Knife - a web app for encryption, encoding, compression and data analysis
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
hashids
A small PHP library to generate YouTube-like ids from numbers. Use it when you don't want to expose your database ids to the user.
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Hashids.net
A small .NET package to generate YouTube-like hashes from one or many numbers. Use hashids when you do not want to expose your database ids to the user.
-
incubator-fury
A blazingly fast multi-language serialization framework powered by JIT and zero-copy.
-
-
-
-
awesome-video
A curated list of awesome streaming video tools, frameworks, libraries, and learning resources.
-
-
psl
📚 PHP Standard Library - a modern, consistent, centralized, well-typed, non-blocking set of APIs for PHP programmers
-
encoding
Go package containing implementations of efficient encoding, decoding, and validation APIs.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Pre-made solution for allowing a client to upload a file to my web hosting (via browser, not FTP client)? | /r/web_design | 2023-06-26I just found uppy. This will be the next one I use. https://uppy.io/
Then we take the encrypted text and use CyberChef to decrypt it.
I don't need/use IDA, Nemlei just used https://obfuscator.io/, which just obfuscates the crap out of the code using various known methods (which I won't go into detail, it's public knowledge) and an un-obfuscation was cooked up by others. The one fucked-up thing the website does is randomizing function names, it just changes every variable/function name. We can't "un-obfuscate" those, so it's up to our brains to figure out what the code does, and change the names back.
Project mention: Empowering Web Privacy with Rust: Building a Decentralized Identity Management System | dev.to | 2024-04-09Serde Documentation: Comprehensive guide and reference for using Serde, Rust's framework for serializing and deserializing data.
That would mean a bit of string concatenation. Luckily, Strapi suggest a library called qs to make this a bit more streamlined:
Project mention: Show HN: Sqids (formely Hashids) – Generate short unique IDs from numbers | news.ycombinator.com | 2023-11-07More than 10 years ago, I released the first version of Hashids in PHP, an encoding library to generate unique IDs from numbers [0]. Over the years, many developers have converted the library to plenty of other programming languages. It was nice to see it grow, but there were always a few things that bothered me about the original algorithm, so a few months ago I've decided to try and address those issues.
With lots of help from the community, we've rebranded the library to Sqids (you can see the proposed changes here [1]).
The new library generates unique IDs faster and with a simpler algorithm. You can read all about it on the FAQ page [2] and try it out via the playground [3]. As always, feedback is welcome via HN or Github.
[0] https://github.com/vinkla/hashids/commit/98d72eac456aabbf2da...
Oh wow. So serde_json doesn't roundtrip floats by default, it uses some imprecise faster algorithm https://github.com/serde-rs/json/issues/707
Good thing there's msgpack I guess.
If you're just doing this to avoid Insecure Direct Object Reference (IDOR) problems, then perhaps something like Hashids might be a better choice?
Project mention: Fast Cloud Native Java Serialization:Fury JIT and GraalVM Native Image AOT | news.ycombinator.com | 2023-12-01
Someone made a benchmark of serialization libraries in go [1], and I was surprised to see gobs is one of the slowest ones, specially for decoding. I suspect part of the reason is that the API doesn't not allow reusing decoders [2]. From my explorations it seems like both JSON [3], message-pack [4] and CBOR [5] are better alternatives.
By the way, in Go there are a like a million JSON encoders because a lot of things in the std library are not really coded for maximum performance but more for easy of usage, it seems. Perhaps this is the right balance for certain things (ex: the http library, see [6]).
There are also a bunch of libraries that allow you to modify a JSON file "in place", without having to fully deserialize into structs (ex: GJSON/SJSON [7] [8]). This sounds very convenient and more efficient that fully de/serializing if we just need to change the data a little.
--
1: https://github.com/alecthomas/go_serialization_benchmarks
2: https://github.com/golang/go/issues/29766#issuecomment-45492...
--
3: https://github.com/goccy/go-json
4: https://github.com/vmihailenco/msgpack
5: https://github.com/fxamacker/cbor
--
6: https://github.com/valyala/fasthttp#faq
--
7: https://github.com/tidwall/gjson
8: https://github.com/tidwall/sjson
Would you consider using some libraries in your project? There are lots of good ones in the Rust ecosystem, and many of them are not part of any existing browsers.
For example:
- https://github.com/servo/html5ever (HTML parsing - note: this is used in Servo)
- https://github.com/parcel-bundler/lightningcss (CSS parsing)
- https://github.com/DioxusLabs/taffy (web layout)
- https://github.com/pop-os/cosmic-text (text layout and rendering)
Obviously you should be free to work on whatever you like, but just as a benchmark on the scope of your project: I spent ~6 months implementing just the CSS Grid algorithm in Taffy last year. An entire browser from literal scratch is probably a 10 year project for one person.
The Xiph.org foundation maintains FLAC and they have a list of tools that might be helpful.
azjezz/psl: PHP Standard Library - a modern, consistent, centralized, well-typed, non-blocking set of APIs for PHP programmers
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Encoding related posts
- Morton: Bit Interleaving in C/C++
- Empowering Web Privacy with Rust: Building a Decentralized Identity Management System
- PicoCTF 2024: packer
- Unbreakable 2024: secrets-of-winter
- Timeline of the xz open source attack
- What even is a JSON number?
- PicoCTF 2024- CanYouSee
-
A note from our sponsor - SaaSHub
www.saashub.com | 23 Apr 2024
Index
What are some of the best open-source Encoding projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Uppy | 28,079 |
| 2 | CyberChef | 25,384 |
| 3 | javascript-obfuscator | 12,704 |
| 4 | serde | 8,558 |
| 5 | qs | 8,329 |
| 6 | hashids | 5,183 |
| 7 | json | 4,517 |
| 8 | Hashids.net | 3,247 |
| 9 | iconv-lite | 3,019 |
| 10 | incubator-fury | 2,598 |
| 11 | bincode | 2,519 |
| 12 | msgpack | 2,280 |
| 13 | html5ever | 1,978 |
| 14 | flac | 1,516 |
| 15 | MLBox | 1,474 |
| 16 | awesome-video | 1,430 |
| 17 | AnyCodable | 1,249 |
| 18 | avsc | 1,245 |
| 19 | stegify | 1,163 |
| 20 | psl | 1,148 |
| 21 | msgpack-rust | 1,073 |
| 22 | encoding | 961 |
| 23 | byteorder | 925 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com